2024-04-26T20:41:28.641 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T20:41:28.642 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180 --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/orig.config.yaml 2024-04-26T20:41:28.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:41:28.794 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180 branch: wip-rishabh-testing-20240426.111959 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7675180' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPw453MPbWAo5XoxLaHlJWNg4ZQPN4wLTbgEyR1xEDmRiWHVOikZDFA8KFeg2ksbYugfOiI9HtL8iHufw4fHExA= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0t1iVYO//DK/xH7+Dm/oN+SXSfcEx4cxUHN+k/jMKPGDIRZfoxqGhDRkpLWBNCKyi49mSFZWWgN+5wxYzyVrk= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-26T20:41:28.794 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T20:41:28.794 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T20:41:28.795 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T20:41:28.796 INFO:teuthology.task.internal:Checking packages... 2024-04-26T20:41:28.819 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T20:41:28.819 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:41:28.819 INFO:teuthology.packaging:ref: None 2024-04-26T20:41:28.819 INFO:teuthology.packaging:tag: None 2024-04-26T20:41:28.819 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T20:41:28.819 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:41:28.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T20:41:28.962 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T20:41:28.964 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T20:41:28.970 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T20:41:28.970 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T20:41:29.020 INFO:teuthology.task.internal:Saving configuration 2024-04-26T20:41:29.041 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T20:41:29.048 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T20:41:29.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:36:16.644534', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPw453MPbWAo5XoxLaHlJWNg4ZQPN4wLTbgEyR1xEDmRiWHVOikZDFA8KFeg2ksbYugfOiI9HtL8iHufw4fHExA='} 2024-04-26T20:41:29.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 20:36:16.643092', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0t1iVYO//DK/xH7+Dm/oN+SXSfcEx4cxUHN+k/jMKPGDIRZfoxqGhDRkpLWBNCKyi49mSFZWWgN+5wxYzyVrk='} 2024-04-26T20:41:29.090 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T20:41:29.096 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-26T20:41:29.096 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-26T20:41:29.096 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T20:41:29.222 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe42facb160>, signals=[15]) 2024-04-26T20:41:29.223 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T20:41:29.228 INFO:teuthology.task.internal:Opening connections... 2024-04-26T20:41:29.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T20:41:29.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:41:29.310 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-04-26T20:41:29.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:41:29.384 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T20:41:29.390 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-04-26T20:41:29.408 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-04-26T20:41:29.408 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:41:29.467 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:41:29.468 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:41:29.468 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-26T20:41:29.487 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-04-26T20:41:29.505 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-04-26T20:41:29.505 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-04-26T20:41:29.563 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T20:41:29.564 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T20:41:29.564 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-04-26T20:41:29.587 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T20:41:29.596 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T20:41:29.628 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T20:41:29.628 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:41:29.631 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-04-26T20:41:29.648 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T20:41:29.658 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T20:41:29.658 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:41:29.688 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-04-26T20:41:29.718 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T20:41:29.763 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T20:41:29.806 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T20:41:29.806 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T20:41:29.806 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:41:29.807 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:41:29.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:29.824 DEBUG:teuthology.task.kernel:sha1 for host.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:29.824 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:41:29.824 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-26T20:41:29.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:41:29.825 DEBUG:teuthology.task.kernel:sha1 for host.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:29.825 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T20:41:29.825 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-04-26T20:41:29.881 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-437.el9.x86_64 2024-04-26T20:41:29.882 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:29.882 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:41:29.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:29.886 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-437.el9.x86_64 2024-04-26T20:41:29.886 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:29.886 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T20:41:29.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:30.021 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum upgrade -y linux-firmware 2024-04-26T20:41:30.037 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum upgrade -y linux-firmware 2024-04-26T20:41:32.211 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-26T20:41:32.467 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-26T20:41:34.424 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T20:41:35.546 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 19 MB 00:02 2024-04-26T20:41:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.2 MB 00:01 2024-04-26T20:41:40.015 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.2 MB 00:00 2024-04-26T20:41:40.968 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-26T20:41:41.746 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-26T20:41:42.530 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T20:41:43.976 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-04-26T20:41:47.661 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-26T20:41:49.181 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-26T20:41:49.681 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:41:49.682 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:41:49.682 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:41:49.769 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-26T20:41:49.769 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:49.920 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T20:41:49.920 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T20:41:49.923 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi055.front.sepia.ceph.com to complete... 2024-04-26T20:41:51.258 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:41:51.259 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:41:51.259 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:41:51.370 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-26T20:41:51.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T20:41:51.521 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T20:41:51.522 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T20:41:51.524 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi064.front.sepia.ceph.com to complete... 2024-04-26T20:42:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26 20:42:15 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T20:42:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:FINISHED --2024-04-26 20:42:15-- 2024-04-26T20:42:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:Total wall clock time: 25s 2024-04-26T20:42:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:Downloaded: 1 files, 341M in 25s (13.6 MB/s) 2024-04-26T20:42:15.334 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-26T20:42:15.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T20:42:17.529 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying... ######################################## 2024-04-26T20:42:17.658 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing... ######################################## 2024-04-26T20:42:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:Updating / installing... 2024-04-26T20:42:18.449 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26 20:42:18 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T20:42:18.449 INFO:teuthology.orchestra.run.smithi064.stderr:FINISHED --2024-04-26 20:42:18-- 2024-04-26T20:42:18.449 INFO:teuthology.orchestra.run.smithi064.stderr:Total wall clock time: 27s 2024-04-26T20:42:18.449 INFO:teuthology.orchestra.run.smithi064.stderr:Downloaded: 1 files, 341M in 26s (12.9 MB/s) 2024-04-26T20:42:18.452 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-26T20:42:18.452 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T20:42:20.641 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying... ######################################## 2024-04-26T20:42:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing... ######################################## 2024-04-26T20:42:20.889 INFO:teuthology.orchestra.run.smithi064.stdout:Updating / installing... 2024-04-26T20:42:26.064 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T20:42:29.229 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T20:43:04.619 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T20:43:04.619 DEBUG:teuthology.orchestra.run.smithi055:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T20:43:04.712 INFO:teuthology.orchestra.run.smithi055.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T20:43:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T20:43:04.714 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T20:43:04.715 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T20:43:04.716 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T20:43:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T20:43:04.718 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T20:43:04.719 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T20:43:04.720 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T20:43:04.721 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T20:43:04.722 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T20:43:04.723 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T20:43:04.724 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T20:43:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T20:43:04.726 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T20:43:04.727 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T20:43:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T20:43:04.729 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T20:43:04.730 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T20:43:04.731 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T20:43:04.732 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T20:43:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T20:43:04.734 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T20:43:04.735 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T20:43:04.736 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T20:43:04.737 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T20:43:04.738 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T20:43:04.739 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T20:43:04.740 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T20:43:04.741 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T20:43:04.742 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T20:43:04.743 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T20:43:04.744 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T20:43:04.745 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T20:43:04.746 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T20:43:04.747 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T20:43:04.748 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T20:43:04.749 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T20:43:04.750 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T20:43:04.751 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T20:43:04.752 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T20:43:04.753 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T20:43:04.754 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T20:43:04.755 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T20:43:04.756 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T20:43:04.757 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T20:43:04.758 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T20:43:04.759 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T20:43:04.760 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T20:43:04.761 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T20:43:04.762 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T20:43:04.763 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T20:43:04.764 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T20:43:04.765 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T20:43:04.766 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T20:43:04.767 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T20:43:04.768 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T20:43:04.769 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T20:43:04.770 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T20:43:04.771 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T20:43:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T20:43:04.773 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T20:43:04.774 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T20:43:04.775 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T20:43:04.776 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T20:43:04.777 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T20:43:04.778 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T20:43:04.779 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T20:43:04.780 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T20:43:04.781 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T20:43:04.782 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T20:43:04.783 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T20:43:04.784 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T20:43:04.785 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T20:43:04.786 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T20:43:04.787 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T20:43:04.788 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T20:43:04.789 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T20:43:04.790 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T20:43:04.791 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T20:43:04.792 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T20:43:04.793 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T20:43:04.794 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T20:43:04.795 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T20:43:04.796 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T20:43:04.797 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T20:43:04.798 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T20:43:04.799 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T20:43:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T20:43:04.801 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T20:43:04.802 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T20:43:04.803 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T20:43:04.804 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T20:43:04.805 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T20:43:04.806 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T20:43:04.807 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T20:43:04.808 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T20:43:04.809 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T20:43:04.810 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T20:43:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T20:43:04.812 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T20:43:04.813 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T20:43:04.814 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T20:43:04.815 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T20:43:04.816 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T20:43:04.817 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T20:43:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T20:43:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T20:43:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T20:43:04.821 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T20:43:04.822 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T20:43:04.823 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T20:43:04.824 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T20:43:04.825 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T20:43:04.826 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T20:43:04.827 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T20:43:04.828 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T20:43:04.829 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T20:43:04.830 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T20:43:04.831 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T20:43:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T20:43:04.833 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T20:43:04.834 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T20:43:04.835 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T20:43:04.836 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T20:43:04.837 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T20:43:04.838 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T20:43:04.839 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T20:43:04.840 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T20:43:04.841 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T20:43:04.842 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T20:43:04.843 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T20:43:04.844 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T20:43:04.845 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T20:43:04.846 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T20:43:04.847 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T20:43:04.848 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T20:43:04.849 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T20:43:04.850 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T20:43:04.851 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T20:43:04.852 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T20:43:04.853 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T20:43:04.854 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T20:43:04.855 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T20:43:04.856 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T20:43:04.857 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T20:43:04.858 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T20:43:04.859 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T20:43:04.860 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T20:43:04.861 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T20:43:04.862 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T20:43:04.866 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.866 DEBUG:teuthology.orchestra.run.smithi055:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout:for file in vmlinuz System.map config; do 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T20:43:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: fi 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:done 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.892 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-04-26T20:43:04.893 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -qi grub2-tools 2024-04-26T20:43:04.967 INFO:teuthology.orchestra.run.smithi055.stdout:Name : grub2-tools 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Epoch : 1 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Version : 2.06 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Release : 68.el9 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: x86_64 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Group : Unspecified 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Size : 8264254 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:License : GPLv3+ 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T20:43:04.968 INFO:teuthology.orchestra.run.smithi055.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Packager : builder@centos.org 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Vendor : CentOS 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Summary : Support tools for GRUB. 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:Description : 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:hardware devices. 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:43:04.969 INFO:teuthology.orchestra.run.smithi055.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T20:43:04.970 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T20:43:04.970 INFO:teuthology.task.kernel:Updating grub on smithi055 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:04.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T20:43:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-04-26T20:43:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T20:43:07.034 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-04-26T20:43:07.036 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-04-26T20:43:07.041 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi064.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T20:43:07.042 DEBUG:teuthology.orchestra.run.smithi064:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T20:43:07.057 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.hLFtxsjoEx 2024-04-26T20:43:07.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hLFtxsjoEx 2024-04-26T20:43:07.122 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T20:43:07.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T20:43:07.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T20:43:07.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T20:43:07.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T20:43:07.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T20:43:07.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T20:43:07.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T20:43:07.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T20:43:07.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T20:43:07.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T20:43:07.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T20:43:07.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T20:43:07.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T20:43:07.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T20:43:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T20:43:07.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T20:43:07.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T20:43:07.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T20:43:07.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T20:43:07.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T20:43:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T20:43:07.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T20:43:07.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T20:43:07.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T20:43:07.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T20:43:07.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T20:43:07.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T20:43:07.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T20:43:07.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T20:43:07.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T20:43:07.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T20:43:07.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T20:43:07.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T20:43:07.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T20:43:07.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T20:43:07.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T20:43:07.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T20:43:07.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T20:43:07.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T20:43:07.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T20:43:07.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T20:43:07.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T20:43:07.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T20:43:07.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T20:43:07.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T20:43:07.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T20:43:07.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T20:43:07.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T20:43:07.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T20:43:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T20:43:07.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T20:43:07.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T20:43:07.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T20:43:07.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T20:43:07.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T20:43:07.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T20:43:07.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T20:43:07.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T20:43:07.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T20:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T20:43:07.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T20:43:07.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T20:43:07.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T20:43:07.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T20:43:07.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T20:43:07.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T20:43:07.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T20:43:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T20:43:07.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T20:43:07.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T20:43:07.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T20:43:07.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T20:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T20:43:07.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T20:43:07.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T20:43:07.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T20:43:07.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T20:43:07.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T20:43:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T20:43:07.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T20:43:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T20:43:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T20:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T20:43:07.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T20:43:07.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T20:43:07.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T20:43:07.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T20:43:07.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T20:43:07.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T20:43:07.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T20:43:07.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T20:43:07.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T20:43:07.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T20:43:07.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T20:43:07.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T20:43:07.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T20:43:07.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T20:43:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T20:43:07.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T20:43:07.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T20:43:07.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T20:43:07.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T20:43:07.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T20:43:07.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T20:43:07.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T20:43:07.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T20:43:07.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T20:43:07.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T20:43:07.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T20:43:07.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T20:43:07.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T20:43:07.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T20:43:07.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T20:43:07.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T20:43:07.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T20:43:07.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T20:43:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T20:43:07.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T20:43:07.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T20:43:07.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T20:43:07.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T20:43:07.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T20:43:07.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T20:43:07.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T20:43:07.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T20:43:07.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T20:43:07.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T20:43:07.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T20:43:07.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T20:43:07.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T20:43:07.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T20:43:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T20:43:07.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T20:43:07.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T20:43:07.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T20:43:07.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T20:43:07.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T20:43:07.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T20:43:07.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T20:43:07.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T20:43:07.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T20:43:07.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T20:43:07.267 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.268 DEBUG:teuthology.orchestra.run.smithi064:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T20:43:07.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.hLFtxsjoEx 2024-04-26T20:43:07.293 INFO:teuthology.orchestra.run.smithi064.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T20:43:07.293 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T20:43:07.293 INFO:teuthology.orchestra.run.smithi064.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T20:43:07.293 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout:for file in vmlinuz System.map config; do 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: fi 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout:done 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2024-04-26T20:43:07.294 INFO:teuthology.orchestra.run.smithi064.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.295 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2024-04-26T20:43:07.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -qi grub2-tools 2024-04-26T20:43:07.376 INFO:teuthology.orchestra.run.smithi064.stdout:Name : grub2-tools 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Epoch : 1 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Version : 2.06 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Release : 68.el9 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Architecture: x86_64 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Group : Unspecified 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Size : 8264254 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:License : GPLv3+ 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T20:43:07.377 INFO:teuthology.orchestra.run.smithi064.stdout:Packager : builder@centos.org 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:Vendor : CentOS 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:Summary : Support tools for GRUB. 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:Description : 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout:hardware devices. 2024-04-26T20:43:07.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:43:07.379 INFO:teuthology.orchestra.run.smithi064.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T20:43:07.379 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T20:43:07.379 INFO:teuthology.task.kernel:Updating grub on smithi064 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T20:43:07.409 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.hLFtxsjoEx is 6KB 2024-04-26T20:43:07.457 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.hLFtxsjoEx 2024-04-26T20:43:07.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T20:43:07.542 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T20:43:07.542 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T20:43:07.542 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T20:43:07.542 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T20:43:07.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:07.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2024-04-26T20:43:08.069 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2024-04-26T20:43:09.460 INFO:teuthology.orchestra.run.smithi064.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T20:43:09.473 INFO:teuthology.orchestra.run.smithi064.stderr:done 2024-04-26T20:43:09.475 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-04-26T20:43:09.491 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.GGBXV9WYJ9 2024-04-26T20:43:09.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GGBXV9WYJ9 2024-04-26T20:43:09.557 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.GGBXV9WYJ9 2024-04-26T20:43:09.701 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.GGBXV9WYJ9 is 6KB 2024-04-26T20:43:09.749 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.GGBXV9WYJ9 2024-04-26T20:43:09.763 DEBUG:teuthology.orchestra.run.smithi064:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T20:43:09.831 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T20:43:09.831 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T20:43:09.831 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T20:43:09.831 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T20:43:09.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T20:43:09.974 DEBUG:teuthology.orchestra.run.smithi064:> sudo shutdown -r now 2024-04-26T20:43:37.723 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-26T20:43:37.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-26T20:43:37.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:43:39.979 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-26T20:43:39.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-26T20:43:39.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:44:37.784 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T20:44:39.984 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T20:44:46.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-26T20:44:46.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:44:47.242 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-26T20:44:47.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-26T20:44:47.987 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:44:47.987 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-26T20:44:48.027 INFO:teuthology.orchestra.run.smithi055.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:44:48.027 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:44:48.027 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:44:48.028 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T20:44:48.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-26T20:44:48.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:44:49.028 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-26T20:44:49.029 DEBUG:teuthology.orchestra.run.smithi055:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T20:44:49.177 INFO:teuthology.orchestra.run.smithi055.stdout:ttyS1 2024-04-26T20:44:49.244 DEBUG:teuthology.parallel:result is None 2024-04-26T20:44:56.566 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-04-26T20:44:57.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-26T20:44:57.240 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:44:57.241 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-04-26T20:44:57.280 INFO:teuthology.orchestra.run.smithi064.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:44:57.280 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:44:57.281 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:44:57.281 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T20:44:58.281 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-26T20:44:58.282 DEBUG:teuthology.orchestra.run.smithi064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T20:44:58.422 INFO:teuthology.orchestra.run.smithi064.stdout:ttyS1 2024-04-26T20:44:58.495 DEBUG:teuthology.parallel:result is None 2024-04-26T20:44:58.495 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T20:44:58.502 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T20:44:58.502 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:44:58.511 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:44:58.566 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T20:44:58.575 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T20:44:58.637 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T20:44:58.638 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:44:58.644 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:44:58.792 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T20:44:58.801 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T20:44:58.801 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:44:58.808 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:44:58.890 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:44:58.912 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:44:58.923 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:44:58.939 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:44:58.944 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T20:44:58.951 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T20:44:58.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:44:58.956 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:44:59.025 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T20:44:59.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T20:44:59.034 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:44:59.039 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:44:59.081 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:44:59.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:44:59.309 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:44:59.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:44:59.456 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:44:59.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:44:59.520 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:44:59.599 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:44:59.680 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:44:59.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:44:59.839 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:44:59.840 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:44:59.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-04-26T20:44:59.930 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-04-26T20:45:00.063 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:45:00.097 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T20:45:00.638 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T20:45:00.647 INFO:teuthology.task.internal:Starting timer... 2024-04-26T20:45:00.647 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T20:45:00.695 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T20:45:00.737 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T20:45:00.738 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-04-26T20:45:00.916 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-04-26T20:45:00.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-04-26T20:45:01.040 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-04-26T20:45:01.044 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T20:45:01.044 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-04-26T20:45:01.125 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-04-26T20:45:01.129 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-04-26T20:45:01.176 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-04-26T20:45:01.177 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive'} 2024-04-26T20:45:01.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:45:01.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:45:01.319 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T20:45:01.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:45:01.397 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T20:45:01.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:45:01.524 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-04-26T20:45:01.605 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T20:45:01.615 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T20:45:01.635 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T20:45:01.637 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T20:50:22.655 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com')] 2024-04-26T20:50:22.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-26T20:50:22.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:50:22.773 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-26T20:50:22.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-26T20:50:22.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-26T20:50:22.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:50:23.046 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-04-26T20:50:23.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-26T20:50:23.201 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T20:50:23.215 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T20:50:23.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:50:23.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:50:23.223 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:50:23.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:50:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:50:23.319 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T20:50:23.360 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:50:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T20:50:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-04-26T20:50:23.442 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-04-26T20:50:23.475 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-04-26T20:50:23.477 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-04-26T20:50:23.518 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:50:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T20:50:23.560 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:50:23.569 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T20:50:23.704 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:50:23.711 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.714 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.721 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T20:50:23.723 INFO:teuthology.run_tasks:Running task install... 2024-04-26T20:50:23.738 DEBUG:teuthology.task.install:project ceph 2024-04-26T20:50:23.738 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T20:50:23.738 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:50:23.739 INFO:teuthology.task.install:Using flavor: default 2024-04-26T20:50:23.744 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T20:50:23.744 INFO:teuthology.task.install:extra packages: [] 2024-04-26T20:50:23.745 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:50:23.745 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:50:23.745 INFO:teuthology.packaging:ref: None 2024-04-26T20:50:23.745 INFO:teuthology.packaging:tag: None 2024-04-26T20:50:23.745 INFO:teuthology.packaging:branch: reef 2024-04-26T20:50:23.745 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:50:23.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T20:50:23.747 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T20:50:23.747 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:50:23.747 INFO:teuthology.packaging:ref: None 2024-04-26T20:50:23.748 INFO:teuthology.packaging:tag: None 2024-04-26T20:50:23.748 INFO:teuthology.packaging:branch: reef 2024-04-26T20:50:23.748 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:50:23.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T20:50:23.999 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/ 2024-04-26T20:50:23.999 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1260.g5403a021 2024-04-26T20:50:24.071 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/ 2024-04-26T20:50:24.071 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1260.g5403a021 2024-04-26T20:50:24.174 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:50:24.174 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:50:24.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:50:24.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T20:50:24.182 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:50:24.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T20:50:24.271 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T20:50:24.271 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:50:24.271 INFO:teuthology.packaging:ref: None 2024-04-26T20:50:24.271 INFO:teuthology.packaging:tag: None 2024-04-26T20:50:24.271 INFO:teuthology.packaging:branch: reef 2024-04-26T20:50:24.271 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:50:24.272 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:50:24.276 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T20:50:24.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:50:24.277 INFO:teuthology.packaging:ref: None 2024-04-26T20:50:24.277 INFO:teuthology.packaging:tag: None 2024-04-26T20:50:24.277 INFO:teuthology.packaging:branch: reef 2024-04-26T20:50:24.277 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:50:24.277 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T20:50:24.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:50:24.411 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T20:50:24.515 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:50:24.531 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T20:50:24.607 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-04-26T20:50:24.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-04-26T20:50:24.617 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-04-26T20:50:24.621 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-04-26T20:50:24.942 INFO:teuthology.orchestra.run.smithi064.stdout:48 files removed 2024-04-26T20:50:24.946 INFO:teuthology.orchestra.run.smithi055.stdout:48 files removed 2024-04-26T20:50:24.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw 2024-04-26T20:50:24.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw 2024-04-26T20:50:25.934 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 154 kB/s | 77 kB 00:00 2024-04-26T20:50:25.967 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 143 kB/s | 77 kB 00:00 2024-04-26T20:50:26.434 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-26T20:50:26.475 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-26T20:50:26.927 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-26T20:50:27.118 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-04-26T20:50:27.774 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T20:50:29.075 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.0 MB 00:02 2024-04-26T20:50:31.426 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-26T20:50:31.698 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-04-26T20:50:36.110 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-26T20:50:36.782 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-04-26T20:50:38.077 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-26T20:50:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-26T20:50:39.393 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-26T20:50:41.455 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T20:50:45.462 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-26T20:50:47.637 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-26T20:50:47.931 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:18.2.2-1260.g5403a021.el9 ceph 7.7 M 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-04-26T20:50:47.945 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.3 M 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.0 M 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:18.2.2-1260.g5403a021.el9 ceph 5.1 M 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:18.2.2-1260.g5403a021.el9 ceph 18 M 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:18.2.2-1260.g5403a021.el9 ceph 25 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 708 k 2024-04-26T20:50:47.946 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 474 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 4.5 M 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 45 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:18.2.2-1260.g5403a021.el9 ceph 129 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:18.2.2-1260.g5403a021.el9 ceph 162 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:50:47.947 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:18.2.2-1260.g5403a021.el9 ceph 321 k 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 298 k 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:18.2.2-1260.g5403a021.el9 ceph 99 k 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout:Install 28 Packages 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 2 Packages 2024-04-26T20:50:47.948 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:50:47.949 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 53 M 2024-04-26T20:50:47.949 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:50:50.123 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:50:50.147 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:50:50.147 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:50:50.147 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:50:50.147 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:18.2.2-1260.g5403a021.el9 ceph 7.7 M 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.3 M 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.0 M 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:18.2.2-1260.g5403a021.el9 ceph 5.1 M 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:18.2.2-1260.g5403a021.el9 ceph 18 M 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:18.2.2-1260.g5403a021.el9 ceph 25 k 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T20:50:50.148 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 708 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 474 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:18.2.2-1260.g5403a021.el9 ceph 4.5 M 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 45 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:18.2.2-1260.g5403a021.el9 ceph 129 k 2024-04-26T20:50:50.149 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:18.2.2-1260.g5403a021.el9 ceph 162 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:18.2.2-1260.g5403a021.el9 ceph 321 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 298 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:18.2.2-1260.g5403a021.el9 ceph 99 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout:Install 28 Packages 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 2 Packages 2024-04-26T20:50:50.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:50:50.151 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 53 M 2024-04-26T20:50:50.151 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:50:50.513 INFO:teuthology.orchestra.run.smithi064.stdout:(1/30): ceph-base-18.2.2-1260.g5403a021.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-04-26T20:50:50.647 INFO:teuthology.orchestra.run.smithi064.stdout:(2/30): ceph-selinux-18.2.2-1260.g5403a021.el9. 190 kB/s | 25 kB 00:00 2024-04-26T20:50:50.980 INFO:teuthology.orchestra.run.smithi064.stdout:(3/30): libcephfs2-18.2.2-1260.g5403a021.el9.x8 2.1 MB/s | 708 kB 00:00 2024-04-26T20:50:51.272 INFO:teuthology.orchestra.run.smithi064.stdout:(4/30): libradosstriper1-18.2.2-1260.g5403a021. 1.6 MB/s | 474 kB 00:00 2024-04-26T20:50:52.681 INFO:teuthology.orchestra.run.smithi064.stdout:(5/30): ceph-common-18.2.2-1260.g5403a021.el9.x 4.3 MB/s | 18 MB 00:04 2024-04-26T20:50:52.806 INFO:teuthology.orchestra.run.smithi064.stdout:(6/30): python3-ceph-argparse-18.2.2-1260.g5403 364 kB/s | 45 kB 00:00 2024-04-26T20:50:52.914 INFO:teuthology.orchestra.run.smithi064.stdout:(7/30): python3-ceph-common-18.2.2-1260.g5403a0 1.2 MB/s | 129 kB 00:00 2024-04-26T20:50:53.024 INFO:teuthology.orchestra.run.smithi064.stdout:(8/30): python3-cephfs-18.2.2-1260.g5403a021.el 1.5 MB/s | 162 kB 00:00 2024-04-26T20:50:53.157 INFO:teuthology.orchestra.run.smithi064.stdout:(9/30): python3-rados-18.2.2-1260.g5403a021.el9 2.4 MB/s | 321 kB 00:00 2024-04-26T20:50:53.274 INFO:teuthology.orchestra.run.smithi064.stdout:(10/30): python3-rbd-18.2.2-1260.g5403a021.el9. 2.5 MB/s | 298 kB 00:00 2024-04-26T20:50:53.374 INFO:teuthology.orchestra.run.smithi064.stdout:(11/30): librgw2-18.2.2-1260.g5403a021.el9.x86_ 2.1 MB/s | 4.5 MB 00:02 2024-04-26T20:50:53.408 INFO:teuthology.orchestra.run.smithi064.stdout:(12/30): python3-rgw-18.2.2-1260.g5403a021.el9. 749 kB/s | 99 kB 00:00 2024-04-26T20:50:53.675 INFO:teuthology.orchestra.run.smithi064.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 357 kB/s | 107 kB 00:00 2024-04-26T20:50:53.733 INFO:teuthology.orchestra.run.smithi064.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 493 kB/s | 160 kB 00:00 2024-04-26T20:50:53.750 INFO:teuthology.orchestra.run.smithi055.stdout:(1/30): ceph-radosgw-18.2.2-1260.g5403a021.el9. 2.5 MB/s | 7.7 MB 00:03 2024-04-26T20:50:53.758 INFO:teuthology.orchestra.run.smithi064.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 548 kB/s | 45 kB 00:00 2024-04-26T20:50:53.813 INFO:teuthology.orchestra.run.smithi055.stdout:(2/30): ceph-selinux-18.2.2-1260.g5403a021.el9. 406 kB/s | 25 kB 00:00 2024-04-26T20:50:53.859 INFO:teuthology.orchestra.run.smithi064.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-04-26T20:50:53.892 INFO:teuthology.orchestra.run.smithi064.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-04-26T20:50:53.955 INFO:teuthology.orchestra.run.smithi055.stdout:(3/30): libcephfs2-18.2.2-1260.g5403a021.el9.x8 4.9 MB/s | 708 kB 00:00 2024-04-26T20:50:54.018 INFO:teuthology.orchestra.run.smithi064.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 267 kB/s | 42 kB 00:00 2024-04-26T20:50:54.072 INFO:teuthology.orchestra.run.smithi055.stdout:(4/30): libradosstriper1-18.2.2-1260.g5403a021. 4.0 MB/s | 474 kB 00:00 2024-04-26T20:50:54.293 INFO:teuthology.orchestra.run.smithi064.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 277 kB/s | 111 kB 00:00 2024-04-26T20:50:54.385 INFO:teuthology.orchestra.run.smithi064.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 849 kB/s | 309 kB 00:00 2024-04-26T20:50:54.664 INFO:teuthology.orchestra.run.smithi055.stdout:(5/30): librgw2-18.2.2-1260.g5403a021.el9.x86_6 7.5 MB/s | 4.5 MB 00:00 2024-04-26T20:50:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:(6/30): python3-ceph-argparse-18.2.2-1260.g5403 686 kB/s | 45 kB 00:00 2024-04-26T20:50:54.798 INFO:teuthology.orchestra.run.smithi055.stdout:(7/30): python3-ceph-common-18.2.2-1260.g5403a0 1.9 MB/s | 129 kB 00:00 2024-04-26T20:50:54.810 INFO:teuthology.orchestra.run.smithi064.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 61 kB/s | 26 kB 00:00 2024-04-26T20:50:54.873 INFO:teuthology.orchestra.run.smithi055.stdout:(8/30): python3-cephfs-18.2.2-1260.g5403a021.el 2.1 MB/s | 162 kB 00:00 2024-04-26T20:50:54.957 INFO:teuthology.orchestra.run.smithi055.stdout:(9/30): python3-rados-18.2.2-1260.g5403a021.el9 3.8 MB/s | 321 kB 00:00 2024-04-26T20:50:55.027 INFO:teuthology.orchestra.run.smithi064.stdout:(22/30): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-04-26T20:50:55.032 INFO:teuthology.orchestra.run.smithi055.stdout:(10/30): python3-rbd-18.2.2-1260.g5403a021.el9. 3.9 MB/s | 298 kB 00:00 2024-04-26T20:50:55.086 INFO:teuthology.orchestra.run.smithi064.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 177 kB/s | 49 kB 00:00 2024-04-26T20:50:55.099 INFO:teuthology.orchestra.run.smithi055.stdout:(11/30): python3-rgw-18.2.2-1260.g5403a021.el9. 1.5 MB/s | 99 kB 00:00 2024-04-26T20:50:55.219 INFO:teuthology.orchestra.run.smithi064.stdout:(24/30): ceph-radosgw-18.2.2-1260.g5403a021.el9 1.1 MB/s | 7.7 MB 00:06 2024-04-26T20:50:55.253 INFO:teuthology.orchestra.run.smithi064.stdout:(25/30): libunwind-1.6.2-1.el9.x86_64.rpm 300 kB/s | 67 kB 00:00 2024-04-26T20:50:55.358 INFO:teuthology.orchestra.run.smithi055.stdout:(12/30): boost-program-options-1.75.0-8.el9.x86 415 kB/s | 107 kB 00:00 2024-04-26T20:50:55.458 INFO:teuthology.orchestra.run.smithi055.stdout:(13/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-26T20:50:55.567 INFO:teuthology.orchestra.run.smithi055.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 421 kB/s | 45 kB 00:00 2024-04-26T20:50:55.628 INFO:teuthology.orchestra.run.smithi064.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.5 MB/s | 839 kB 00:00 2024-04-26T20:50:55.661 INFO:teuthology.orchestra.run.smithi064.stdout:(27/30): re2-20211101-3.el9.x86_64.rpm 434 kB/s | 192 kB 00:00 2024-04-26T20:50:55.675 INFO:teuthology.orchestra.run.smithi055.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-04-26T20:50:55.751 INFO:teuthology.orchestra.run.smithi055.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.9 MB/s | 292 kB 00:00 2024-04-26T20:50:55.753 INFO:teuthology.orchestra.run.smithi064.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-04-26T20:50:55.843 INFO:teuthology.orchestra.run.smithi055.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 466 kB/s | 42 kB 00:00 2024-04-26T20:50:56.187 INFO:teuthology.orchestra.run.smithi064.stdout:(29/30): librbd1-18.2.2-1260.g5403a021.el9.x86_ 5.7 MB/s | 3.0 MB 00:00 2024-04-26T20:50:56.477 INFO:teuthology.orchestra.run.smithi055.stdout:(18/30): ceph-base-18.2.2-1260.g5403a021.el9.x8 896 kB/s | 5.1 MB 00:05 2024-04-26T20:50:56.637 INFO:teuthology.orchestra.run.smithi064.stdout:(30/30): librados2-18.2.2-1260.g5403a021.el9.x8 3.3 MB/s | 3.3 MB 00:01 2024-04-26T20:50:56.650 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:50:56.650 INFO:teuthology.orchestra.run.smithi064.stdout:Total 6.1 MB/s | 53 MB 00:08 2024-04-26T20:50:56.760 INFO:teuthology.orchestra.run.smithi055.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-26T20:50:56.880 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:50:56.987 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:50:56.987 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:50:57.085 INFO:teuthology.orchestra.run.smithi055.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 89 kB/s | 111 kB 00:01 2024-04-26T20:50:57.177 INFO:teuthology.orchestra.run.smithi055.stdout:(21/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T20:50:57.227 INFO:teuthology.orchestra.run.smithi055.stdout:(22/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 193 kB/s | 26 kB 00:00 2024-04-26T20:50:57.277 INFO:teuthology.orchestra.run.smithi055.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 491 kB/s | 49 kB 00:00 2024-04-26T20:50:57.311 INFO:teuthology.orchestra.run.smithi055.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 820 kB/s | 67 kB 00:00 2024-04-26T20:50:57.395 INFO:teuthology.orchestra.run.smithi055.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 839 kB 00:00 2024-04-26T20:50:57.429 INFO:teuthology.orchestra.run.smithi055.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-26T20:50:57.545 INFO:teuthology.orchestra.run.smithi055.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T20:50:57.979 INFO:teuthology.orchestra.run.smithi055.stdout:(28/30): ceph-common-18.2.2-1260.g5403a021.el9. 2.5 MB/s | 18 MB 00:07 2024-04-26T20:50:57.998 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:50:57.999 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:50:58.104 INFO:teuthology.orchestra.run.smithi055.stdout:(29/30): librbd1-18.2.2-1260.g5403a021.el9.x86_ 5.4 MB/s | 3.0 MB 00:00 2024-04-26T20:50:59.063 INFO:teuthology.orchestra.run.smithi055.stdout:(30/30): librados2-18.2.2-1260.g5403a021.el9.x8 2.0 MB/s | 3.3 MB 00:01 2024-04-26T20:50:59.073 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:50:59.074 INFO:teuthology.orchestra.run.smithi055.stdout:Total 5.9 MB/s | 53 MB 00:08 2024-04-26T20:50:59.316 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:50:59.438 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:50:59.438 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:50:59.683 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:50:59.850 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-26T20:50:59.899 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-26T20:51:00.067 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-26T20:51:00.383 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:51:00.384 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:51:00.493 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-26T20:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:00.774 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:00.894 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 6/32 2024-04-26T20:51:00.926 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:01.020 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:01.053 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-26T20:51:01.119 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9. 9/32 2024-04-26T20:51:01.218 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 10/32 2024-04-26T20:51:01.245 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 11/32 2024-04-26T20:51:01.364 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 11/32 2024-04-26T20:51:01.567 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-26T20:51:01.605 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-04-26T20:51:01.667 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-26T20:51:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-26T20:51:01.745 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-04-26T20:51:01.821 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-26T20:51:01.869 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-26T20:51:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:51:02.251 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-26T20:51:02.280 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-26T20:51:02.317 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 20/32 2024-04-26T20:51:02.393 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-26T20:51:02.440 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 20/32 2024-04-26T20:51:02.475 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 21/32 2024-04-26T20:51:02.534 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-26T20:51:02.550 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-26T20:51:02.984 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-26T20:51:03.030 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-04-26T20:51:03.070 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 24/32 2024-04-26T20:51:03.092 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:03.204 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 24/32 2024-04-26T20:51:03.258 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:03.323 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 25/32 2024-04-26T20:51:03.356 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x8 26/32 2024-04-26T20:51:03.382 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 6/32 2024-04-26T20:51:03.410 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:03.495 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:03.529 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-26T20:51:03.629 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9. 9/32 2024-04-26T20:51:03.733 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 10/32 2024-04-26T20:51:03.763 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 11/32 2024-04-26T20:51:03.867 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 11/32 2024-04-26T20:51:04.085 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-26T20:51:04.132 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-04-26T20:51:04.196 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-26T20:51:04.232 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-26T20:51:04.260 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-04-26T20:51:04.322 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-26T20:51:04.372 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-26T20:51:04.791 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-26T20:51:04.836 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 20/32 2024-04-26T20:51:04.976 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 20/32 2024-04-26T20:51:05.035 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 21/32 2024-04-26T20:51:05.099 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-26T20:51:05.606 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-04-26T20:51:05.646 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 24/32 2024-04-26T20:51:05.764 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 24/32 2024-04-26T20:51:05.847 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:05.872 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 25/32 2024-04-26T20:51:05.907 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x8 26/32 2024-04-26T20:51:05.927 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:06.616 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:06.664 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 28/32 2024-04-26T20:51:06.865 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 28/32 2024-04-26T20:51:06.866 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:51:06.866 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:51:06.866 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:06.907 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:08.614 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:08.673 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:09.350 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 27/32 2024-04-26T20:51:09.393 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 28/32 2024-04-26T20:51:09.564 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 28/32 2024-04-26T20:51:09.565 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T20:51:09.565 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T20:51:09.565 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:09.602 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:18.036 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-04-26T20:51:18.037 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:18.907 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 30/32 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 30/32 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:51:18.979 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:18.985 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-26T20:51:19.110 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-26T20:51:19.110 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:20.826 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:20.826 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 1/32 2024-04-26T20:51:20.826 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2/32 2024-04-26T20:51:20.826 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 3/32 2024-04-26T20:51:20.826 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 4/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 6/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9. 8/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x8 9/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 10/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 11/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 12/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 13/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-26T20:51:20.827 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-26T20:51:20.828 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 31/32 2024-04-26T20:51:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:20.972 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-04-26T20:51:20.972 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-04-26T20:51:20.973 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:51:21.725 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:51:21.726 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:21.727 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:21.894 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 30/32 2024-04-26T20:51:21.975 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 30/32 2024-04-26T20:51:21.975 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:21.975 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T20:51:21.975 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:51:21.976 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:51:21.976 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:21.981 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-26T20:51:22.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-test 2024-04-26T20:51:22.122 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-26T20:51:22.123 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:22.949 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:37 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:23.094 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:18.2.2-1260.g5403a021.el9 ceph 40 M 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:18.2.2-1260.g5403a021.el9 ceph 166 k 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:23.095 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout:Install 4 Packages 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 40 M 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 163 M 2024-04-26T20:51:23.096 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:51:23.680 INFO:teuthology.orchestra.run.smithi064.stdout:(1/4): libcephsqlite-18.2.2-1260.g5403a021.el9. 364 kB/s | 166 kB 00:00 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 1/32 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2/32 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 3/32 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 4/32 2024-04-26T20:51:23.688 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 5/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_6 6/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 7/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9. 8/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x8 9/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 10/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 11/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 12/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 13/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-26T20:51:23.689 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:18.2.2-1260.g5403a021.el9.x86_64 29/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-26T20:51:23.690 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 31/32 2024-04-26T20:51:24.140 INFO:teuthology.orchestra.run.smithi064.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 333 kB/s | 305 kB 00:00 2024-04-26T20:51:24.341 INFO:teuthology.orchestra.run.smithi064.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 96 kB/s | 64 kB 00:00 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.569 INFO:teuthology.orchestra.run.smithi055.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T20:51:24.570 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:24.571 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:51:24.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-test 2024-04-26T20:51:25.496 INFO:teuthology.orchestra.run.smithi064.stdout:(4/4): ceph-test-18.2.2-1260.g5403a021.el9.x86_ 17 MB/s | 40 MB 00:02 2024-04-26T20:51:25.503 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:25.504 INFO:teuthology.orchestra.run.smithi064.stdout:Total 17 MB/s | 40 MB 00:02 2024-04-26T20:51:25.576 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:51:25.607 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:51:25.608 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:51:25.740 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:38 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:51:25.878 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:51:25.878 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:18.2.2-1260.g5403a021.el9 ceph 40 M 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:18.2.2-1260.g5403a021.el9 ceph 166 k 2024-04-26T20:51:25.882 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout:Install 4 Packages 2024-04-26T20:51:25.883 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:25.884 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 40 M 2024-04-26T20:51:25.884 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 163 M 2024-04-26T20:51:25.884 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:51:26.016 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:51:26.016 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:51:26.175 INFO:teuthology.orchestra.run.smithi055.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 305 kB 00:00 2024-04-26T20:51:26.259 INFO:teuthology.orchestra.run.smithi055.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 782 kB/s | 64 kB 00:00 2024-04-26T20:51:26.426 INFO:teuthology.orchestra.run.smithi055.stdout:(3/4): libcephsqlite-18.2.2-1260.g5403a021.el9. 395 kB/s | 166 kB 00:00 2024-04-26T20:51:26.631 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:51:26.787 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T20:51:26.921 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T20:51:26.950 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 3/4 2024-04-26T20:51:29.281 INFO:teuthology.orchestra.run.smithi055.stdout:(4/4): ceph-test-18.2.2-1260.g5403a021.el9.x86_ 12 MB/s | 40 MB 00:03 2024-04-26T20:51:29.284 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:29.285 INFO:teuthology.orchestra.run.smithi055.stdout:Total 12 MB/s | 40 MB 00:03 2024-04-26T20:51:29.356 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:51:29.417 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:51:29.417 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:51:29.838 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:51:29.838 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:51:30.425 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:51:30.593 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T20:51:30.663 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T20:51:30.729 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 3/4 2024-04-26T20:51:31.335 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 3/4 2024-04-26T20:51:31.626 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 4/4 2024-04-26T20:51:33.437 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 4/4 2024-04-26T20:51:33.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 1/4 2024-04-26T20:51:33.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 2/4 2024-04-26T20:51:33.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:33.749 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:34.086 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph 2024-04-26T20:51:34.858 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:49 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:34.994 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:34.996 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:34.996 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:51:34.996 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:34.996 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:18.2.2-1260.g5403a021.el9 ceph 6.5 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:18.2.2-1260.g5403a021.el9 ceph 2.1 M 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:18.2.2-1260.g5403a021.el9 ceph 1.5 M 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 246 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:18.2.2-1260.g5403a021.el9 ceph 4.7 M 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 17 M 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:51:34.997 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:51:34.998 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout:Install 33 Packages 2024-04-26T20:51:34.999 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:35.000 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 29 M 2024-04-26T20:51:35.000 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 104 M 2024-04-26T20:51:35.000 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:51:35.164 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 3/4 2024-04-26T20:51:35.277 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 4/4 2024-04-26T20:51:35.874 INFO:teuthology.orchestra.run.smithi064.stdout:(1/33): ceph-18.2.2-1260.g5403a021.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2024-04-26T20:51:36.358 INFO:teuthology.orchestra.run.smithi064.stdout:(2/33): ceph-mds-18.2.2-1260.g5403a021.el9.x86_ 2.7 MB/s | 2.1 MB 00:00 2024-04-26T20:51:36.491 INFO:teuthology.orchestra.run.smithi064.stdout:(3/33): ceph-mon-18.2.2-1260.g5403a021.el9.x86_ 7.6 MB/s | 4.7 MB 00:00 2024-04-26T20:51:36.550 INFO:teuthology.orchestra.run.smithi064.stdout:(4/33): ceph-mgr-18.2.2-1260.g5403a021.el9.x86_ 1.5 MB/s | 1.5 MB 00:00 2024-04-26T20:51:36.583 INFO:teuthology.orchestra.run.smithi064.stdout:(5/33): ceph-mgr-modules-core-18.2.2-1260.g5403 2.6 MB/s | 246 kB 00:00 2024-04-26T20:51:36.742 INFO:teuthology.orchestra.run.smithi064.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-26T20:51:36.792 INFO:teuthology.orchestra.run.smithi064.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T20:51:36.842 INFO:teuthology.orchestra.run.smithi064.stdout:(8/33): python3-cryptography-36.0.1-4.el9.x86_6 4.8 MB/s | 1.2 MB 00:00 2024-04-26T20:51:36.876 INFO:teuthology.orchestra.run.smithi064.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-04-26T20:51:36.909 INFO:teuthology.orchestra.run.smithi064.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.9 MB/s | 125 kB 00:00 2024-04-26T20:51:36.945 INFO:teuthology.orchestra.run.smithi064.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-04-26T20:51:36.985 INFO:teuthology.orchestra.run.smithi064.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-04-26T20:51:37.027 INFO:teuthology.orchestra.run.smithi064.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 419 kB/s | 35 kB 00:00 2024-04-26T20:51:37.069 INFO:teuthology.orchestra.run.smithi064.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 617 kB/s | 51 kB 00:00 2024-04-26T20:51:37.111 INFO:teuthology.orchestra.run.smithi064.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 503 kB/s | 42 kB 00:00 2024-04-26T20:51:37.453 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 4/4 2024-04-26T20:51:37.453 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 1/4 2024-04-26T20:51:37.453 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 2/4 2024-04-26T20:51:37.453 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T20:51:37.470 INFO:teuthology.orchestra.run.smithi064.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 109 kB/s | 43 kB 00:00 2024-04-26T20:51:37.622 INFO:teuthology.orchestra.run.smithi064.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 337 kB/s | 172 kB 00:00 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T20:51:37.749 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T20:51:37.749 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:37.749 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:51:37.837 INFO:teuthology.orchestra.run.smithi064.stdout:(18/33): ceph-osd-18.2.2-1260.g5403a021.el9.x86 11 MB/s | 17 MB 00:01 2024-04-26T20:51:37.870 INFO:teuthology.orchestra.run.smithi064.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 898 kB/s | 358 kB 00:00 2024-04-26T20:51:37.912 INFO:teuthology.orchestra.run.smithi064.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 37 kB/s | 11 kB 00:00 2024-04-26T20:51:37.954 INFO:teuthology.orchestra.run.smithi064.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 156 kB/s | 18 kB 00:00 2024-04-26T20:51:38.013 INFO:teuthology.orchestra.run.smithi064.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 234 kB/s | 23 kB 00:00 2024-04-26T20:51:38.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph 2024-04-26T20:51:38.054 INFO:teuthology.orchestra.run.smithi064.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 138 kB/s | 19 kB 00:00 2024-04-26T20:51:38.121 INFO:teuthology.orchestra.run.smithi064.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 118 kB/s | 20 kB 00:00 2024-04-26T20:51:38.164 INFO:teuthology.orchestra.run.smithi064.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 310 kB/s | 46 kB 00:00 2024-04-26T20:51:38.205 INFO:teuthology.orchestra.run.smithi064.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 962 kB/s | 79 kB 00:00 2024-04-26T20:51:38.264 INFO:teuthology.orchestra.run.smithi064.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-04-26T20:51:38.306 INFO:teuthology.orchestra.run.smithi064.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 116 kB/s | 16 kB 00:00 2024-04-26T20:51:38.331 INFO:teuthology.orchestra.run.smithi064.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 724 kB/s | 90 kB 00:00 2024-04-26T20:51:38.381 INFO:teuthology.orchestra.run.smithi064.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 306 kB/s | 36 kB 00:00 2024-04-26T20:51:38.415 INFO:teuthology.orchestra.run.smithi064.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-26T20:51:38.457 INFO:teuthology.orchestra.run.smithi064.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.4 MB/s | 427 kB 00:00 2024-04-26T20:51:38.507 INFO:teuthology.orchestra.run.smithi064.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 163 kB/s | 20 kB 00:00 2024-04-26T20:51:38.516 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:38.517 INFO:teuthology.orchestra.run.smithi064.stdout:Total 8.3 MB/s | 29 MB 00:03 2024-04-26T20:51:38.831 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:51 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:51:38.886 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:51:38.970 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:51:38.973 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:38.973 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:51:38.973 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:18.2.2-1260.g5403a021.el9 ceph 6.5 k 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:18.2.2-1260.g5403a021.el9 ceph 2.1 M 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:18.2.2-1260.g5403a021.el9 ceph 1.5 M 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 246 k 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:18.2.2-1260.g5403a021.el9 ceph 4.7 M 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 17 M 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T20:51:38.974 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T20:51:38.975 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T20:51:38.976 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout:Install 33 Packages 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 29 M 2024-04-26T20:51:38.977 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 104 M 2024-04-26T20:51:38.978 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:51:38.980 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:51:38.980 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:51:39.571 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:51:39.572 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:51:39.767 INFO:teuthology.orchestra.run.smithi055.stdout:(1/33): ceph-18.2.2-1260.g5403a021.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-04-26T20:51:40.038 INFO:teuthology.orchestra.run.smithi055.stdout:(2/33): ceph-mgr-18.2.2-1260.g5403a021.el9.x86_ 2.4 MB/s | 1.5 MB 00:00 2024-04-26T20:51:40.237 INFO:teuthology.orchestra.run.smithi055.stdout:(3/33): ceph-mds-18.2.2-1260.g5403a021.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-04-26T20:51:40.363 INFO:teuthology.orchestra.run.smithi055.stdout:(4/33): ceph-mgr-modules-core-18.2.2-1260.g5403 1.9 MB/s | 246 kB 00:00 2024-04-26T20:51:40.498 INFO:teuthology.orchestra.run.smithi055.stdout:(5/33): ceph-mon-18.2.2-1260.g5403a021.el9.x86_ 6.4 MB/s | 4.7 MB 00:00 2024-04-26T20:51:40.664 INFO:teuthology.orchestra.run.smithi055.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 846 kB/s | 253 kB 00:00 2024-04-26T20:51:40.714 INFO:teuthology.orchestra.run.smithi055.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T20:51:40.772 INFO:teuthology.orchestra.run.smithi055.stdout:(8/33): python3-cryptography-36.0.1-4.el9.x86_6 4.5 MB/s | 1.2 MB 00:00 2024-04-26T20:51:40.806 INFO:teuthology.orchestra.run.smithi055.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.5 MB/s | 135 kB 00:00 2024-04-26T20:51:40.857 INFO:teuthology.orchestra.run.smithi055.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-04-26T20:51:40.906 INFO:teuthology.orchestra.run.smithi055.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-04-26T20:51:40.930 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:51:41.045 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-26T20:51:41.096 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-26T20:51:41.132 INFO:teuthology.orchestra.run.smithi055.stdout:(12/33): ceph-osd-18.2.2-1260.g5403a021.el9.x86 15 MB/s | 17 MB 00:01 2024-04-26T20:51:41.157 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-26T20:51:41.182 INFO:teuthology.orchestra.run.smithi055.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 126 kB/s | 35 kB 00:00 2024-04-26T20:51:41.216 INFO:teuthology.orchestra.run.smithi055.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 481 kB/s | 172 kB 00:00 2024-04-26T20:51:41.300 INFO:teuthology.orchestra.run.smithi055.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-04-26T20:51:41.314 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-26T20:51:41.350 INFO:teuthology.orchestra.run.smithi055.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 235 kB/s | 51 kB 00:00 2024-04-26T20:51:41.414 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-26T20:51:41.417 INFO:teuthology.orchestra.run.smithi055.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 218 kB/s | 43 kB 00:00 2024-04-26T20:51:41.477 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-26T20:51:41.492 INFO:teuthology.orchestra.run.smithi055.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 144 kB/s | 11 kB 00:00 2024-04-26T20:51:41.526 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-26T20:51:41.526 INFO:teuthology.orchestra.run.smithi055.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 764 kB/s | 172 kB 00:00 2024-04-26T20:51:41.563 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-26T20:51:41.576 INFO:teuthology.orchestra.run.smithi055.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 213 kB/s | 18 kB 00:00 2024-04-26T20:51:41.600 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-26T20:51:41.642 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-26T20:51:41.643 INFO:teuthology.orchestra.run.smithi055.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 199 kB/s | 23 kB 00:00 2024-04-26T20:51:41.685 INFO:teuthology.orchestra.run.smithi055.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 180 kB/s | 19 kB 00:00 2024-04-26T20:51:41.707 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-26T20:51:41.719 INFO:teuthology.orchestra.run.smithi055.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 975 kB/s | 358 kB 00:00 2024-04-26T20:51:41.798 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-26T20:51:41.846 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-26T20:51:41.916 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-26T20:51:42.011 INFO:teuthology.orchestra.run.smithi055.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 54 kB/s | 20 kB 00:00 2024-04-26T20:51:42.058 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-26T20:51:42.153 INFO:teuthology.orchestra.run.smithi055.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 99 kB/s | 46 kB 00:00 2024-04-26T20:51:42.178 INFO:teuthology.orchestra.run.smithi055.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 172 kB/s | 79 kB 00:00 2024-04-26T20:51:42.220 INFO:teuthology.orchestra.run.smithi055.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 248 kB/s | 16 kB 00:00 2024-04-26T20:51:42.245 INFO:teuthology.orchestra.run.smithi055.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-26T20:51:42.269 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-26T20:51:42.278 INFO:teuthology.orchestra.run.smithi055.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-04-26T20:51:42.320 INFO:teuthology.orchestra.run.smithi055.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 359 kB/s | 36 kB 00:00 2024-04-26T20:51:42.354 INFO:teuthology.orchestra.run.smithi055.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-26T20:51:42.379 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-26T20:51:42.405 INFO:teuthology.orchestra.run.smithi055.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-04-26T20:51:42.446 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-26T20:51:42.471 INFO:teuthology.orchestra.run.smithi055.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 134 kB/s | 20 kB 00:00 2024-04-26T20:51:42.474 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:42.475 INFO:teuthology.orchestra.run.smithi055.stdout:Total 8.3 MB/s | 29 MB 00:03 2024-04-26T20:51:42.496 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-26T20:51:42.563 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-26T20:51:42.644 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-26T20:51:42.859 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:51:42.911 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-26T20:51:42.952 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:51:42.952 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:51:42.975 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-26T20:51:43.069 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-26T20:51:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-26T20:51:43.265 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-26T20:51:43.423 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-26T20:51:43.456 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:51:43.460 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:51:43.607 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9. 28/33 2024-04-26T20:51:43.645 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 29/33 2024-04-26T20:51:43.728 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 29/33 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:51:43.729 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:44.885 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:51:45.017 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-26T20:51:45.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-26T20:51:45.119 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-26T20:51:45.275 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-26T20:51:45.388 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-26T20:51:45.413 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 30/33 2024-04-26T20:51:45.458 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-26T20:51:45.500 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-26T20:51:45.502 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 30/33 2024-04-26T20:51:45.503 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:45.503 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:51:45.503 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:51:45.503 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:51:45.503 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:45.536 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-26T20:51:45.574 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-26T20:51:45.616 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-26T20:51:45.678 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-26T20:51:45.755 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-26T20:51:45.802 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-26T20:51:45.867 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-26T20:51:46.004 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-26T20:51:46.022 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 31/33 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 31/33 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:51:46.096 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:46.247 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-26T20:51:46.331 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 32/33 2024-04-26T20:51:46.353 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 32/33 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:51:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:46.419 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-26T20:51:46.478 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-26T20:51:46.504 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:18.2.2-1260.g5403a021.el9.x86_64 33/33 2024-04-26T20:51:46.548 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-26T20:51:46.633 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-26T20:51:46.663 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-2:18.2.2-1260.g5403a021.el9.x86_64 33/33 2024-04-26T20:51:46.663 INFO:teuthology.orchestra.run.smithi064.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T20:51:46.663 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:46.909 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-26T20:51:46.982 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-26T20:51:47.075 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-26T20:51:47.195 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-26T20:51:47.247 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-26T20:51:47.408 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-26T20:51:47.598 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9. 28/33 2024-04-26T20:51:47.636 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 29/33 2024-04-26T20:51:47.711 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 29/33 2024-04-26T20:51:47.711 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:47.712 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T20:51:47.712 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:51:47.712 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T20:51:47.712 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:18.2.2-1260.g5403a021.el9.x86_64 1/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 2/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 3/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 4/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 5/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9. 6/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-26T20:51:48.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-26T20:51:48.437 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-26T20:51:48.438 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-26T20:51:48.439 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-26T20:51:48.439 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-26T20:51:48.439 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-26T20:51:48.439 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-26T20:51:48.439 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-26T20:51:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 30/33 2024-04-26T20:51:49.453 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 30/33 2024-04-26T20:51:49.453 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:49.454 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T20:51:49.454 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:51:49.454 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T20:51:49.454 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:49.465 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-26T20:51:49.465 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:49.465 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:51:49.465 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:49.465 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:51:49.466 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:51:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:49.468 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:49.863 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-base 2024-04-26T20:51:49.971 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 31/33 2024-04-26T20:51:50.043 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 31/33 2024-04-26T20:51:50.043 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:50.043 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T20:51:50.043 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:51:50.043 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T20:51:50.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:50.289 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 32/33 2024-04-26T20:51:50.388 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 32/33 2024-04-26T20:51:50.388 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:50.388 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T20:51:50.389 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:51:50.389 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T20:51:50.389 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:50.468 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:18.2.2-1260.g5403a021.el9.x86_64 33/33 2024-04-26T20:51:50.598 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-2:18.2.2-1260.g5403a021.el9.x86_64 33/33 2024-04-26T20:51:50.598 INFO:teuthology.orchestra.run.smithi055.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T20:51:50.598 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:50.639 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:05 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:50.722 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:51:50.766 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:50.767 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:51:50.768 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:50.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install cephadm 2024-04-26T20:51:51.620 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:06 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:51.747 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 224 k 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:51:51.749 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:51.749 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 224 k 2024-04-26T20:51:51.749 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 216 k 2024-04-26T20:51:51.749 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:51:52.029 INFO:teuthology.orchestra.run.smithi064.stdout:cephadm-18.2.2-1260.g5403a021.el9.noarch.rpm 802 kB/s | 224 kB 00:00 2024-04-26T20:51:52.030 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:52.031 INFO:teuthology.orchestra.run.smithi064.stdout:Total 794 kB/s | 224 kB 00:00 2024-04-26T20:51:52.032 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:51:52.050 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:51:52.051 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:51:52.061 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:51:52.062 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:51:52.200 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:51:52.458 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:18.2.2-1260.g5403a021.el9.x86_64 1/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 2/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 3/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 4/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 5/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9. 6/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-26T20:51:52.459 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-26T20:51:52.460 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-26T20:51:52.461 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-26T20:51:52.461 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-26T20:51:52.461 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-26T20:51:52.461 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-26T20:51:52.835 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:52.976 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:53.500 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-26T20:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T20:51:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T20:51:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T20:51:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:53.642 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:53.773 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:54.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-base 2024-04-26T20:51:54.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T20:51:54.822 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:07 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:51:54.876 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:09 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:54.904 INFO:teuthology.orchestra.run.smithi055.stdout:Package ceph-base-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:51:54.949 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:51:54.950 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:51:54.950 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:51:55.009 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:55.009 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:55.009 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-04-26T20:51:55.009 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:55.009 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1260.g5403a021.el9 ceph 142 k 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 142 k 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 395 k 2024-04-26T20:51:55.010 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:51:55.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install cephadm 2024-04-26T20:51:55.568 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-immutable-object-cache-18.2.2-1260.g5403a0 256 kB/s | 142 kB 00:00 2024-04-26T20:51:55.569 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:55.570 INFO:teuthology.orchestra.run.smithi064.stdout:Total 254 kB/s | 142 kB 00:00 2024-04-26T20:51:55.571 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:51:55.599 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:51:55.599 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:51:55.708 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:51:55.709 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:51:55.787 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:08 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:51:55.921 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:51:55.923 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:55.923 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:51:55.923 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:55.923 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:51:55.923 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 224 k 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 224 k 2024-04-26T20:51:55.924 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 216 k 2024-04-26T20:51:55.925 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:51:55.948 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:51:56.019 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:51:56.096 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:51:56.096 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:51:56.097 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:51:56.097 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:56.671 INFO:teuthology.orchestra.run.smithi055.stdout:cephadm-18.2.2-1260.g5403a021.el9.noarch.rpm 300 kB/s | 224 kB 00:00 2024-04-26T20:51:56.672 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:56.673 INFO:teuthology.orchestra.run.smithi055.stdout:Total 299 kB/s | 224 kB 00:00 2024-04-26T20:51:56.673 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:51:56.693 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:51:56.693 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:51:56.703 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:51:56.705 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:51:56.834 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:51:57.480 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:57.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:51:57.518 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:57.518 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:51:57.519 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:51:57.519 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:57.519 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:57.630 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:57.819 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr 2024-04-26T20:51:58.154 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:58.443 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/1 2024-04-26T20:51:58.444 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:58.444 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:51:58.444 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:51:58.444 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:58.444 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:51:58.623 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:13 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:58.718 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:51:58.755 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T20:51:58.765 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:58.766 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:51:58.766 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:51:58.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T20:51:59.562 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:12 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:51:59.591 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:14 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:51:59.689 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repo Size 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1260.g5403a021.el9 ceph 142 k 2024-04-26T20:51:59.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 142 k 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 395 k 2024-04-26T20:51:59.691 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:51:59.718 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 3.5 M 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 24 k 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 15 k 2024-04-26T20:51:59.719 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout:Install 5 Packages 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 3.8 M 2024-04-26T20:51:59.720 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 87 M 2024-04-26T20:51:59.721 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:51:59.918 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-immutable-object-cache-18.2.2-1260.g5403a0 628 kB/s | 142 kB 00:00 2024-04-26T20:51:59.919 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:51:59.920 INFO:teuthology.orchestra.run.smithi055.stdout:Total 619 kB/s | 142 kB 00:00 2024-04-26T20:51:59.921 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:51:59.949 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:51:59.949 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:00.055 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:00.056 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:00.312 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:00.385 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:52:00.462 INFO:teuthology.orchestra.run.smithi064.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1260.g5403 54 kB/s | 15 kB 00:00 2024-04-26T20:52:00.462 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:52:00.462 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:52:00.463 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T20:52:00.463 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:00.487 INFO:teuthology.orchestra.run.smithi064.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1260.g540 78 kB/s | 24 kB 00:00 2024-04-26T20:52:00.646 INFO:teuthology.orchestra.run.smithi064.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 168 kB/s | 31 kB 00:00 2024-04-26T20:52:00.746 INFO:teuthology.orchestra.run.smithi064.stdout:(4/5): ceph-mgr-dashboard-18.2.2-1260.g5403a021 6.2 MB/s | 3.5 MB 00:00 2024-04-26T20:52:00.779 INFO:teuthology.orchestra.run.smithi064.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 647 kB/s | 188 kB 00:00 2024-04-26T20:52:00.784 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:00.785 INFO:teuthology.orchestra.run.smithi064.stdout:Total 3.5 MB/s | 3.8 MB 00:01 2024-04-26T20:52:00.786 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:00.812 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:00.813 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:00.977 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:00.978 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:01.317 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:01.395 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-04-26T20:52:01.427 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-04-26T20:52:01.458 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.n 3/5 2024-04-26T20:52:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1260.g5403a021. 1/1 2024-04-26T20:52:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:01.758 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:01.758 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:02.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-mgr 2024-04-26T20:52:02.810 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9. 4/5 2024-04-26T20:52:02.847 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:15 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:02.868 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 5/5 2024-04-26T20:52:02.932 INFO:teuthology.orchestra.run.smithi055.stdout:Package ceph-mgr-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:02.977 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:02.978 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:02.979 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:03.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T20:52:03.849 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:16 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:03.976 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:03.976 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 3.5 M 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 24 k 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 15 k 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:03.977 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout:Install 5 Packages 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 3.8 M 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 87 M 2024-04-26T20:52:03.978 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:04.096 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 5/5 2024-04-26T20:52:04.096 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9. 1/5 2024-04-26T20:52:04.096 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 2/5 2024-04-26T20:52:04.096 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.n 3/5 2024-04-26T20:52:04.096 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-04-26T20:52:04.338 INFO:teuthology.orchestra.run.smithi055.stdout:(1/5): ceph-grafana-dashboards-18.2.2-1260.g540 94 kB/s | 24 kB 00:00 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:52:04.436 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:04.437 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:04.510 INFO:teuthology.orchestra.run.smithi055.stdout:(2/5): ceph-prometheus-alerts-18.2.2-1260.g5403 36 kB/s | 15 kB 00:00 2024-04-26T20:52:04.663 INFO:teuthology.orchestra.run.smithi055.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 95 kB/s | 31 kB 00:00 2024-04-26T20:52:04.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T20:52:04.772 INFO:teuthology.orchestra.run.smithi055.stdout:(4/5): ceph-mgr-dashboard-18.2.2-1260.g5403a021 5.1 MB/s | 3.5 MB 00:00 2024-04-26T20:52:04.939 INFO:teuthology.orchestra.run.smithi055.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 443 kB/s | 188 kB 00:00 2024-04-26T20:52:04.948 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:04.948 INFO:teuthology.orchestra.run.smithi055.stdout:Total 3.9 MB/s | 3.8 MB 00:00 2024-04-26T20:52:04.949 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:04.975 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:04.975 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:05.143 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:05.143 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:05.518 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:05.552 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:20 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:05.642 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-04-26T20:52:05.683 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:05.684 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-04-26T20:52:05.684 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:52:05.684 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-04-26T20:52:05.684 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 7.4 M 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:52:05.685 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:Install 12 Packages 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 38 M 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 209 M 2024-04-26T20:52:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:05.688 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-04-26T20:52:05.735 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.n 3/5 2024-04-26T20:52:05.988 INFO:teuthology.orchestra.run.smithi064.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-26T20:52:06.046 INFO:teuthology.orchestra.run.smithi064.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-04-26T20:52:06.096 INFO:teuthology.orchestra.run.smithi064.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 308 kB/s | 33 kB 00:00 2024-04-26T20:52:06.172 INFO:teuthology.orchestra.run.smithi064.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 246 kB/s | 18 kB 00:00 2024-04-26T20:52:06.222 INFO:teuthology.orchestra.run.smithi064.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 721 kB/s | 35 kB 00:00 2024-04-26T20:52:06.501 INFO:teuthology.orchestra.run.smithi064.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.6 MB/s | 3.0 MB 00:00 2024-04-26T20:52:06.605 INFO:teuthology.orchestra.run.smithi064.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.3 MB/s | 244 kB 00:00 2024-04-26T20:52:06.806 INFO:teuthology.orchestra.run.smithi064.stdout:(8/12): ceph-mgr-diskprediction-local-18.2.2-12 7.6 MB/s | 7.4 MB 00:00 2024-04-26T20:52:06.923 INFO:teuthology.orchestra.run.smithi064.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-04-26T20:52:07.073 INFO:teuthology.orchestra.run.smithi064.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 5.6 MB/s | 4.7 MB 00:00 2024-04-26T20:52:07.093 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9. 4/5 2024-04-26T20:52:07.143 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 5/5 2024-04-26T20:52:07.365 INFO:teuthology.orchestra.run.smithi064.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.7 MB/s | 5.1 MB 00:00 2024-04-26T20:52:08.049 INFO:teuthology.orchestra.run.smithi064.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-04-26T20:52:08.051 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:08.052 INFO:teuthology.orchestra.run.smithi064.stdout:Total 16 MB/s | 38 MB 00:02 2024-04-26T20:52:08.355 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 5/5 2024-04-26T20:52:08.355 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9. 1/5 2024-04-26T20:52:08.355 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarc 2/5 2024-04-26T20:52:08.355 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.n 3/5 2024-04-26T20:52:08.355 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:08.665 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:08.724 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:08.805 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:08.805 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:08.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T20:52:09.429 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:09.429 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:22 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:09.882 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 7.4 M 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:52:09.883 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-04-26T20:52:09.884 INFO:teuthology.orchestra.run.smithi055.stdout:Install 12 Packages 2024-04-26T20:52:09.885 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:09.885 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 38 M 2024-04-26T20:52:09.885 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 209 M 2024-04-26T20:52:09.885 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-26T20:52:10.370 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:10.388 INFO:teuthology.orchestra.run.smithi055.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-26T20:52:10.472 INFO:teuthology.orchestra.run.smithi055.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 232 kB/s | 33 kB 00:00 2024-04-26T20:52:10.490 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T20:52:10.530 INFO:teuthology.orchestra.run.smithi055.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 316 kB/s | 18 kB 00:00 2024-04-26T20:52:10.551 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T20:52:10.614 INFO:teuthology.orchestra.run.smithi055.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 427 kB/s | 35 kB 00:00 2024-04-26T20:52:10.714 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T20:52:10.759 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T20:52:10.864 INFO:teuthology.orchestra.run.smithi055.stdout:(6/12): ceph-mgr-diskprediction-local-18.2.2-12 10 MB/s | 7.4 MB 00:00 2024-04-26T20:52:11.027 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T20:52:11.079 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T20:52:11.081 INFO:teuthology.orchestra.run.smithi055.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-26T20:52:11.204 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T20:52:11.248 INFO:teuthology.orchestra.run.smithi055.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.5 MB/s | 3.0 MB 00:00 2024-04-26T20:52:11.341 INFO:teuthology.orchestra.run.smithi055.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-04-26T20:52:11.949 INFO:teuthology.orchestra.run.smithi055.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.6 MB/s | 4.7 MB 00:01 2024-04-26T20:52:12.110 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T20:52:12.256 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T20:52:12.333 INFO:teuthology.orchestra.run.smithi055.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-04-26T20:52:13.952 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T20:52:14.383 INFO:teuthology.orchestra.run.smithi055.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:03 2024-04-26T20:52:14.385 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:14.386 INFO:teuthology.orchestra.run.smithi055.stdout:Total 8.4 MB/s | 38 MB 00:04 2024-04-26T20:52:15.039 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:15.117 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:15.117 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:15.183 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T20:52:15.221 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 12/12 2024-04-26T20:52:15.741 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:15.741 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:16.663 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:16.729 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T20:52:16.779 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T20:52:16.946 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T20:52:16.992 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T20:52:17.254 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T20:52:17.282 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T20:52:17.389 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 12/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 1/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T20:52:18.041 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T20:52:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T20:52:18.281 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T20:52:18.423 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:52:18.566 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:18.567 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:19.024 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-rook 2024-04-26T20:52:19.823 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:34 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:19.952 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 49 k 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:52:19.954 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout:Install 13 Packages 2024-04-26T20:52:19.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:19.956 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 2.2 M 2024-04-26T20:52:19.956 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 26 M 2024-04-26T20:52:19.956 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:20.070 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T20:52:20.705 INFO:teuthology.orchestra.run.smithi064.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 130 kB/s | 26 kB 00:00 2024-04-26T20:52:20.730 INFO:teuthology.orchestra.run.smithi064.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 19 kB 00:00 2024-04-26T20:52:20.797 INFO:teuthology.orchestra.run.smithi064.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-04-26T20:52:20.822 INFO:teuthology.orchestra.run.smithi064.stdout:(4/13): ceph-mgr-rook-18.2.2-1260.g5403a021.el9 157 kB/s | 49 kB 00:00 2024-04-26T20:52:20.856 INFO:teuthology.orchestra.run.smithi064.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-26T20:52:20.889 INFO:teuthology.orchestra.run.smithi064.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.0 MB/s | 279 kB 00:00 2024-04-26T20:52:20.940 INFO:teuthology.orchestra.run.smithi064.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 463 kB/s | 54 kB 00:00 2024-04-26T20:52:21.161 INFO:teuthology.orchestra.run.smithi064.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 55 kB/s | 15 kB 00:00 2024-04-26T20:52:21.190 INFO:teuthology.orchestra.run.smithi064.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 97 kB/s | 32 kB 00:00 2024-04-26T20:52:21.310 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T20:52:21.339 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 12/12 2024-04-26T20:52:21.424 INFO:teuthology.orchestra.run.smithi064.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 254 kB/s | 59 kB 00:00 2024-04-26T20:52:21.449 INFO:teuthology.orchestra.run.smithi064.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 404 kB/s | 206 kB 00:00 2024-04-26T20:52:21.632 INFO:teuthology.orchestra.run.smithi064.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 432 kB/s | 90 kB 00:00 2024-04-26T20:52:21.758 INFO:teuthology.orchestra.run.smithi064.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-04-26T20:52:21.759 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:21.759 INFO:teuthology.orchestra.run.smithi064.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-04-26T20:52:21.980 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:22.030 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:22.030 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:22.186 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:22.193 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:22.936 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:23.196 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T20:52:23.261 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T20:52:23.339 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T20:52:23.381 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T20:52:23.438 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T20:52:23.596 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T20:52:23.747 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T20:52:23.813 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T20:52:23.929 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 12/12 2024-04-26T20:52:23.929 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a 1/12 2024-04-26T20:52:23.929 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T20:52:23.930 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T20:52:24.523 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:24.524 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:24.779 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T20:52:24.853 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T20:52:24.888 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T20:52:24.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-mgr-rook 2024-04-26T20:52:24.957 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T20:52:24.987 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 13/13 2024-04-26T20:52:25.734 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:38 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:25.865 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 49 k 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T20:52:25.866 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:25.867 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:25.868 INFO:teuthology.orchestra.run.smithi055.stdout:Install 13 Packages 2024-04-26T20:52:25.868 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:25.868 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 2.2 M 2024-04-26T20:52:25.868 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 26 M 2024-04-26T20:52:25.868 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 13/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 1/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T20:52:25.940 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T20:52:25.941 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T20:52:25.941 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T20:52:25.941 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:52:26.404 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:26.405 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:26.407 INFO:teuthology.orchestra.run.smithi055.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 209 kB/s | 26 kB 00:00 2024-04-26T20:52:26.424 INFO:teuthology.orchestra.run.smithi055.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 138 kB/s | 19 kB 00:00 2024-04-26T20:52:26.508 INFO:teuthology.orchestra.run.smithi055.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-04-26T20:52:26.570 INFO:teuthology.orchestra.run.smithi055.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-04-26T20:52:26.591 INFO:teuthology.orchestra.run.smithi055.stdout:(5/13): ceph-mgr-rook-18.2.2-1260.g5403a021.el9 160 kB/s | 49 kB 00:00 2024-04-26T20:52:26.633 INFO:teuthology.orchestra.run.smithi055.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 857 kB/s | 54 kB 00:00 2024-04-26T20:52:26.667 INFO:teuthology.orchestra.run.smithi055.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-04-26T20:52:26.719 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T20:52:26.867 INFO:teuthology.orchestra.run.smithi055.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 117 kB/s | 32 kB 00:00 2024-04-26T20:52:26.893 INFO:teuthology.orchestra.run.smithi055.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 58 kB/s | 15 kB 00:00 2024-04-26T20:52:27.118 INFO:teuthology.orchestra.run.smithi055.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 263 kB/s | 59 kB 00:00 2024-04-26T20:52:27.168 INFO:teuthology.orchestra.run.smithi055.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 411 kB/s | 206 kB 00:00 2024-04-26T20:52:27.318 INFO:teuthology.orchestra.run.smithi055.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 450 kB/s | 90 kB 00:00 2024-04-26T20:52:27.485 INFO:teuthology.orchestra.run.smithi055.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-04-26T20:52:27.489 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:27.489 INFO:teuthology.orchestra.run.smithi055.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-04-26T20:52:27.506 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:42 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:27.639 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 138 k 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:52:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout:Install 6 Packages 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:27.641 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 7.0 M 2024-04-26T20:52:27.642 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 33 M 2024-04-26T20:52:27.642 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:27.705 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:27.755 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:27.755 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:27.910 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:27.911 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:28.368 INFO:teuthology.orchestra.run.smithi064.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-04-26T20:52:28.610 INFO:teuthology.orchestra.run.smithi064.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-04-26T20:52:28.644 INFO:teuthology.orchestra.run.smithi064.stdout:(3/6): ceph-mgr-cephadm-18.2.2-1260.g5403a021.e 317 kB/s | 138 kB 00:00 2024-04-26T20:52:28.675 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:28.852 INFO:teuthology.orchestra.run.smithi064.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 243 kB/s | 58 kB 00:00 2024-04-26T20:52:28.877 INFO:teuthology.orchestra.run.smithi064.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 219 kB/s | 51 kB 00:00 2024-04-26T20:52:28.928 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T20:52:28.953 INFO:teuthology.orchestra.run.smithi064.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 940 kB/s | 548 kB 00:00 2024-04-26T20:52:28.957 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:28.958 INFO:teuthology.orchestra.run.smithi064.stdout:Total 5.3 MB/s | 7.0 MB 00:01 2024-04-26T20:52:28.996 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T20:52:29.071 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T20:52:29.093 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:29.134 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:29.134 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:29.142 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T20:52:29.203 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T20:52:29.289 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:29.290 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:29.357 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T20:52:29.500 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T20:52:29.573 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T20:52:29.687 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:29.917 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T20:52:30.004 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T20:52:30.537 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T20:52:30.598 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T20:52:30.631 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T20:52:30.689 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T20:52:30.709 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T20:52:30.715 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 13/13 2024-04-26T20:52:30.821 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T20:52:30.922 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T20:52:30.950 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 6/6 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 13/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 1/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T20:52:31.641 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 6/6 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/6 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T20:52:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T20:52:32.110 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:32.111 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:32.260 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T20:52:32.260 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:32.261 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:32.405 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T20:52:32.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-fuse 2024-04-26T20:52:33.205 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:46 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:33.336 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:33.337 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:33.337 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:52:33.337 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:33.337 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1260.g5403a021.el9 ceph-noarch 138 k 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout:Install 6 Packages 2024-04-26T20:52:33.338 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:33.339 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 7.0 M 2024-04-26T20:52:33.339 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 33 M 2024-04-26T20:52:33.339 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:33.377 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:48 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:33.509 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 848 k 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:33.510 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:33.511 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:33.511 INFO:teuthology.orchestra.run.smithi064.stdout:Install 2 Packages 2024-04-26T20:52:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:33.511 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 929 k 2024-04-26T20:52:33.512 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 2.7 M 2024-04-26T20:52:33.512 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:33.755 INFO:teuthology.orchestra.run.smithi055.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 957 kB/s | 248 kB 00:00 2024-04-26T20:52:33.780 INFO:teuthology.orchestra.run.smithi055.stdout:(2/6): ceph-mgr-cephadm-18.2.2-1260.g5403a021.e 485 kB/s | 138 kB 00:00 2024-04-26T20:52:34.180 INFO:teuthology.orchestra.run.smithi064.stdout:(1/2): ceph-fuse-18.2.2-1260.g5403a021.el9.x86_ 2.2 MB/s | 848 kB 00:00 2024-04-26T20:52:34.306 INFO:teuthology.orchestra.run.smithi055.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 110 kB/s | 58 kB 00:00 2024-04-26T20:52:34.456 INFO:teuthology.orchestra.run.smithi055.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 342 kB/s | 51 kB 00:00 2024-04-26T20:52:34.521 INFO:teuthology.orchestra.run.smithi064.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 112 kB/s | 80 kB 00:00 2024-04-26T20:52:34.523 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:34.524 INFO:teuthology.orchestra.run.smithi064.stdout:Total 916 kB/s | 929 kB 00:01 2024-04-26T20:52:34.566 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:34.641 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:34.642 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:34.656 INFO:teuthology.orchestra.run.smithi055.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2024-04-26T20:52:34.752 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:34.752 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:34.848 INFO:teuthology.orchestra.run.smithi055.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-04-26T20:52:34.854 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:34.855 INFO:teuthology.orchestra.run.smithi055.stdout:Total 4.6 MB/s | 7.0 MB 00:01 2024-04-26T20:52:34.984 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:35.025 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:35.025 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:35.030 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:35.179 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:35.180 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T20:52:35.276 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2/2 2024-04-26T20:52:35.616 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:35.868 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T20:52:35.932 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T20:52:36.268 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2/2 2024-04-26T20:52:36.268 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/2 2024-04-26T20:52:36.639 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T20:52:36.639 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:36.639 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:36.640 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T20:52:36.640 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:36.640 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:36.653 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T20:52:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T20:52:36.861 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T20:52:36.890 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 6/6 2024-04-26T20:52:36.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados-devel 2024-04-26T20:52:37.730 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:52 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:37.747 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 6/6 2024-04-26T20:52:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 1/6 2024-04-26T20:52:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T20:52:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T20:52:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T20:52:37.748 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T20:52:37.862 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:18.2.2-1260.g5403a021.el9 ceph 127 k 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:37.863 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 127 k 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 456 k 2024-04-26T20:52:37.864 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:18.2.2-1260.g5403a021.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:38.081 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:38.118 INFO:teuthology.orchestra.run.smithi064.stdout:librados-devel-18.2.2-1260.g5403a021.el9.x86_64 500 kB/s | 127 kB 00:00 2024-04-26T20:52:38.120 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:38.121 INFO:teuthology.orchestra.run.smithi064.stdout:Total 492 kB/s | 127 kB 00:00 2024-04-26T20:52:38.121 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:38.141 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:38.142 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:38.261 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:38.262 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:38.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-fuse 2024-04-26T20:52:38.473 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:38.653 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:39.144 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:52 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:39.215 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 848 k 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:Install 2 Packages 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 929 k 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 2.7 M 2024-04-26T20:52:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:39.521 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:39.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs2 2024-04-26T20:52:39.792 INFO:teuthology.orchestra.run.smithi055.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 343 kB/s | 80 kB 00:00 2024-04-26T20:52:39.884 INFO:teuthology.orchestra.run.smithi055.stdout:(2/2): ceph-fuse-18.2.2-1260.g5403a021.el9.x86_ 2.5 MB/s | 848 kB 00:00 2024-04-26T20:52:39.886 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:39.886 INFO:teuthology.orchestra.run.smithi055.stdout:Total 1.5 MB/s | 929 kB 00:00 2024-04-26T20:52:39.927 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:40.000 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:40.000 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:40.110 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:40.111 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:40.399 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:40.559 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:55 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:40.603 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T20:52:40.647 INFO:teuthology.orchestra.run.smithi064.stdout:Package libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:40.684 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2/2 2024-04-26T20:52:40.693 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:40.695 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:40.695 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:40.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs-devel 2024-04-26T20:52:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:41.630 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2/2 2024-04-26T20:52:41.630 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/2 2024-04-26T20:52:41.663 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:18.2.2-1260.g5403a021.el9 ceph 31 k 2024-04-26T20:52:41.664 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 31 k 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 139 k 2024-04-26T20:52:41.665 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:41.947 INFO:teuthology.orchestra.run.smithi064.stdout:libcephfs-devel-18.2.2-1260.g5403a021.el9.x86_6 110 kB/s | 31 kB 00:00 2024-04-26T20:52:41.948 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:41.949 INFO:teuthology.orchestra.run.smithi064.stdout:Total 109 kB/s | 31 kB 00:00 2024-04-26T20:52:41.950 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:41.962 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:41.963 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:41.967 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T20:52:41.967 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:41.967 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:41.967 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T20:52:41.967 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:41.968 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:41.982 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:41.983 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:42.159 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:42.295 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install librados-devel 2024-04-26T20:52:42.309 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:42.780 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:43.069 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:43.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:43.070 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:43.070 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:43.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:43.070 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:43.093 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:43.225 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:43.226 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:43.226 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repo Size 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:18.2.2-1260.g5403a021.el9 ceph 127 k 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 127 k 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 456 k 2024-04-26T20:52:43.227 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:43.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados2 2024-04-26T20:52:43.547 INFO:teuthology.orchestra.run.smithi055.stdout:librados-devel-18.2.2-1260.g5403a021.el9.x86_64 396 kB/s | 127 kB 00:00 2024-04-26T20:52:43.549 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:43.550 INFO:teuthology.orchestra.run.smithi055.stdout:Total 392 kB/s | 127 kB 00:00 2024-04-26T20:52:43.550 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:43.570 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:43.570 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:43.690 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:43.691 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:43.917 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:44.086 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:44.087 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:01:59 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:44.170 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:44.214 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:44.215 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:44.215 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:44.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librbd1 2024-04-26T20:52:44.639 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:44.922 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:45.047 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:00 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:45.137 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:45.180 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:45.181 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:45.181 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:45.215 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install libcephfs2 2024-04-26T20:52:45.258 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rados 2024-04-26T20:52:46.032 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:01 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:46.034 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:59 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:46.115 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:46.118 INFO:teuthology.orchestra.run.smithi055.stdout:Package libcephfs2-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:46.159 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:46.160 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:46.160 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:46.162 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:46.163 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:46.163 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:46.241 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rgw 2024-04-26T20:52:46.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install libcephfs-devel 2024-04-26T20:52:46.979 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:01:59 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:46.999 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:01 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:47.082 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:47.109 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repo Size 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:18.2.2-1260.g5403a021.el9 ceph 31 k 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:47.110 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:47.111 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:52:47.111 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:47.111 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 31 k 2024-04-26T20:52:47.111 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 139 k 2024-04-26T20:52:47.111 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:47.125 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:47.127 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:47.127 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:47.215 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-cephfs 2024-04-26T20:52:47.288 INFO:teuthology.orchestra.run.smithi055.stdout:libcephfs-devel-18.2.2-1260.g5403a021.el9.x86_6 176 kB/s | 31 kB 00:00 2024-04-26T20:52:47.289 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:47.289 INFO:teuthology.orchestra.run.smithi055.stdout:Total 174 kB/s | 31 kB 00:00 2024-04-26T20:52:47.290 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:47.299 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:47.299 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:47.339 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:47.340 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:47.491 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:47.649 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:47.971 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:02 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:48.059 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:48.085 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:48.102 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:48.103 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:48.103 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:48.180 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rbd 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:48.345 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:48.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install librados2 2024-04-26T20:52:48.940 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:03 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:49.023 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:49.070 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:49.071 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-26T20:52:49.071 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:49.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-fuse 2024-04-26T20:52:49.426 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:02 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:49.510 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:49.553 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:49.554 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:49.554 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:49.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install librbd1 2024-04-26T20:52:49.937 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:04 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:50.065 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 86 k 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:52:50.066 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:50.067 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 86 k 2024-04-26T20:52:50.067 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 227 k 2024-04-26T20:52:50.067 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:50.372 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:03 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:50.441 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-fuse-18.2.2-1260.g5403a021.el9.x86_64.rpm 231 kB/s | 86 kB 00:00 2024-04-26T20:52:50.443 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:50.444 INFO:teuthology.orchestra.run.smithi064.stdout:Total 229 kB/s | 86 kB 00:00 2024-04-26T20:52:50.444 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:50.459 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:50.470 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:50.470 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:50.502 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:50.503 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:50.504 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:50.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install python3-rados 2024-04-26T20:52:50.590 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:50.590 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:50.801 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:50.926 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:51.353 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:04 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:51.435 INFO:teuthology.orchestra.run.smithi055.stdout:Package python3-rados-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:51.463 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:51.478 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:51.480 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:51.480 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:51.559 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install python3-rgw 2024-04-26T20:52:51.764 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:51.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:51.765 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:51.765 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:51.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:51.765 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:52.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-mirror 2024-04-26T20:52:52.325 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:05 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:52.407 INFO:teuthology.orchestra.run.smithi055.stdout:Package python3-rgw-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:52.451 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:52.452 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:52.452 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:52.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install python3-cephfs 2024-04-26T20:52:52.831 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:07 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:52.963 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:52.969 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:52.969 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-04-26T20:52:52.969 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.0 M 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 3.0 M 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 12 M 2024-04-26T20:52:52.970 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:53.277 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:06 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:53.365 INFO:teuthology.orchestra.run.smithi055.stdout:Package python3-cephfs-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:53.405 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-mirror-18.2.2-1260.g5403a021.el9.x86_64.rpm 6.8 MB/s | 3.0 MB 00:00 2024-04-26T20:52:53.407 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:53.408 INFO:teuthology.orchestra.run.smithi064.stdout:Total 6.7 MB/s | 3.0 MB 00:00 2024-04-26T20:52:53.408 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:53.409 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:53.411 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:53.411 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:53.442 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:53.442 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:53.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install python3-rbd 2024-04-26T20:52:53.568 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:53.568 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:54.108 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:54.173 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:54.245 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:54.245 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:52:54.245 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:52:54.245 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:52:54.245 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:52:54.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:54.275 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:07 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:54.358 INFO:teuthology.orchestra.run.smithi055.stdout:Package python3-rbd-2:18.2.2-1260.g5403a021.el9.x86_64 is already installed. 2024-04-26T20:52:54.402 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:54.403 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2024-04-26T20:52:54.403 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:54.477 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install rbd-fuse 2024-04-26T20:52:55.260 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:08 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:55.388 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:55.388 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:18.2.2-1260.g5403a021.el9 ceph 86 k 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:52:55.389 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:55.390 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 86 k 2024-04-26T20:52:55.390 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 227 k 2024-04-26T20:52:55.390 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:55.600 INFO:teuthology.orchestra.run.smithi055.stdout:rbd-fuse-18.2.2-1260.g5403a021.el9.x86_64.rpm 412 kB/s | 86 kB 00:00 2024-04-26T20:52:55.601 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:55.602 INFO:teuthology.orchestra.run.smithi055.stdout:Total 407 kB/s | 86 kB 00:00 2024-04-26T20:52:55.602 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:55.618 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:55.618 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:55.646 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:55.700 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:55.701 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:52:55.867 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:52:55.922 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-nbd 2024-04-26T20:52:55.975 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:56.405 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:56.661 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:52:56.707 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:02:11 ago on Fri 26 Apr 2024 08:50:45 PM UTC. 2024-04-26T20:52:56.834 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-26T20:52:56.835 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 172 k 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 172 k 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 494 k 2024-04-26T20:52:56.836 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-26T20:52:56.945 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install rbd-mirror 2024-04-26T20:52:57.450 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-nbd-18.2.2-1260.g5403a021.el9.x86_64.rpm 280 kB/s | 172 kB 00:00 2024-04-26T20:52:57.452 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:57.453 INFO:teuthology.orchestra.run.smithi064.stdout:Total 279 kB/s | 172 kB 00:00 2024-04-26T20:52:57.453 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-26T20:52:57.483 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-26T20:52:57.483 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-26T20:52:57.601 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-26T20:52:57.601 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-26T20:52:57.746 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:10 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:52:57.808 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repo Size 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:52:57.873 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:18.2.2-1260.g5403a021.el9 ceph 3.0 M 2024-04-26T20:52:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:52:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:52:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:52:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:52:57.875 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 3.0 M 2024-04-26T20:52:57.875 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 12 M 2024-04-26T20:52:57.875 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:52:57.939 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:58.457 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:58.719 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:52:58.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:58.720 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-26T20:52:58.720 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:52:58.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:52:58.720 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-26T20:52:59.069 DEBUG:teuthology.parallel:result is None 2024-04-26T20:52:59.556 INFO:teuthology.orchestra.run.smithi055.stdout:rbd-mirror-18.2.2-1260.g5403a021.el9.x86_64.rpm 1.8 MB/s | 3.0 MB 00:01 2024-04-26T20:52:59.557 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:52:59.558 INFO:teuthology.orchestra.run.smithi055.stdout:Total 1.8 MB/s | 3.0 MB 00:01 2024-04-26T20:52:59.559 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:52:59.593 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:52:59.593 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:52:59.723 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:52:59.723 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:53:00.281 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:53:00.448 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:00.526 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:00.527 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T20:53:00.527 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T20:53:00.527 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:53:00.527 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T20:53:00.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:02.014 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:53:02.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install rbd-nbd 2024-04-26T20:53:03.085 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:02:16 ago on Fri 26 Apr 2024 08:50:47 PM UTC. 2024-04-26T20:53:03.212 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-04-26T20:53:03.212 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:53:03.212 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:18.2.2-1260.g5403a021.el9 ceph 172 k 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-04-26T20:53:03.213 INFO:teuthology.orchestra.run.smithi055.stdout:Install 1 Package 2024-04-26T20:53:03.214 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:03.214 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 172 k 2024-04-26T20:53:03.214 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 494 k 2024-04-26T20:53:03.214 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-04-26T20:53:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:rbd-nbd-18.2.2-1260.g5403a021.el9.x86_64.rpm 721 kB/s | 172 kB 00:00 2024-04-26T20:53:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:53:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:Total 711 kB/s | 172 kB 00:00 2024-04-26T20:53:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-04-26T20:53:03.484 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-04-26T20:53:03.484 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-04-26T20:53:03.600 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-04-26T20:53:03.600 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-04-26T20:53:03.776 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-04-26T20:53:03.877 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:04.417 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 1/1 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:18.2.2-1260.g5403a021.el9.x86_64 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:53:04.717 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-04-26T20:53:05.071 DEBUG:teuthology.parallel:result is None 2024-04-26T20:53:05.071 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:53:05.072 INFO:teuthology.packaging:ref: None 2024-04-26T20:53:05.072 INFO:teuthology.packaging:tag: None 2024-04-26T20:53:05.072 INFO:teuthology.packaging:branch: reef 2024-04-26T20:53:05.072 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:53:05.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T20:53:05.321 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:53:05.394 INFO:teuthology.orchestra.run.smithi055.stdout:18.2.2-1260.g5403a021.el9 2024-04-26T20:53:05.395 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1260.g5403a021.el9 2024-04-26T20:53:05.395 INFO:teuthology.task.install:The correct ceph version 18.2.2-1260.g5403a021 is installed. 2024-04-26T20:53:05.397 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T20:53:05.397 INFO:teuthology.packaging:ref: None 2024-04-26T20:53:05.397 INFO:teuthology.packaging:tag: None 2024-04-26T20:53:05.397 INFO:teuthology.packaging:branch: reef 2024-04-26T20:53:05.397 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:53:05.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T20:53:05.640 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T20:53:05.717 INFO:teuthology.orchestra.run.smithi064.stdout:18.2.2-1260.g5403a021.el9 2024-04-26T20:53:05.717 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1260.g5403a021.el9 2024-04-26T20:53:05.717 INFO:teuthology.task.install:The correct ceph version 18.2.2-1260.g5403a021 is installed. 2024-04-26T20:53:05.719 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T20:53:05.719 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:53:05.719 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:53:05.813 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:53:05.813 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:53:05.910 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T20:53:05.911 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:53:05.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:53:05.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:53:06.079 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:53:06.079 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:53:06.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:53:06.317 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T20:53:06.317 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:53:06.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:53:06.414 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:53:06.548 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:53:06.548 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:53:06.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:53:06.753 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T20:53:06.753 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:53:06.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:53:06.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:53:06.937 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:53:06.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:53:07.014 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:53:07.088 INFO:teuthology.run_tasks:Running task print... 2024-04-26T20:53:07.098 INFO:teuthology.task.print:**** done install task... 2024-04-26T20:53:07.098 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T20:53:07.203 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:53:07.203 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-04-26T20:53:07.204 INFO:tasks.cephadm:Cluster fsid is fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:53:07.204 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T20:53:07.204 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-26T20:53:07.204 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi055': '172.21.15.55', 'mon.smithi064': '172.21.15.64'} 2024-04-26T20:53:07.204 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T20:53:07.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname $(hostname -s) 2024-04-26T20:53:07.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname $(hostname -s) 2024-04-26T20:53:07.380 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-04-26T20:53:07.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:53:07.522 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78918/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3306-gbc612ffb', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3306.gbc612ffb'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 13:02:42.256491', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240426.111959', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-26T20:53:07.761 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref reef, sha1 5403a02127f27ec6c3309ef057522ab70cdeb9d2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-04-26T20:53:07.763 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/x86_64/flavors/default/cephadm 2024-04-26T20:53:07.763 DEBUG:teuthology.orchestra.run.smithi055:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:08.257 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 Apr 26 20:53 /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:08.258 DEBUG:teuthology.orchestra.run.smithi064:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/5403a02127f27ec6c3309ef057522ab70cdeb9d2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:08.945 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r--. 1 ubuntu ubuntu 215333 Apr 26 20:53 /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:08.946 DEBUG:teuthology.orchestra.run.smithi055:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:09.011 DEBUG:teuthology.orchestra.run.smithi064:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T20:53:09.086 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-04-26T20:53:09.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-04-26T20:53:09.094 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-04-26T20:53:10.992 INFO:teuthology.orchestra.run.smithi064.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-26T20:53:11.131 INFO:teuthology.orchestra.run.smithi055.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)", 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout: "image_id": "79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19", 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout: "repo_digests": [ 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69" 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-26T20:54:05.879 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)", 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout: "image_id": "79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19", 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout: "repo_digests": [ 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69" 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-04-26T20:54:07.065 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-04-26T20:54:07.097 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph 2024-04-26T20:54:07.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph 2024-04-26T20:54:07.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /etc/ceph 2024-04-26T20:54:07.384 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /etc/ceph 2024-04-26T20:54:07.477 INFO:tasks.cephadm:Writing seed config... 2024-04-26T20:54:07.478 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-26T20:54:07.478 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-26T20:54:07.478 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-26T20:54:07.478 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-26T20:54:07.478 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T20:54:07.479 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T20:54:07.480 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T20:54:07.481 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T20:54:07.482 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:54:07.482 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T20:54:07.539 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = fbc85ba0-040e-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T20:54:07.540 DEBUG:teuthology.orchestra.run.smithi055:mon.smithi055> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service 2024-04-26T20:54:07.587 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T20:54:07.588 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.55 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:54:07.836 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-04-26T20:54:07.836 INFO:teuthology.orchestra.run.smithi055.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'fbc85ba0-040e-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.55', '--skip-admin-label'] 2024-04-26T20:54:07.899 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:54:07.899 INFO:teuthology.orchestra.run.smithi055.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T20:54:07.900 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying podman|docker is present... 2024-04-26T20:54:07.954 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:54:07.954 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying lvm2 is present... 2024-04-26T20:54:07.954 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying time synchronization is in place... 2024-04-26T20:54:07.970 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:54:07.970 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:54:07.983 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:54:07.983 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:54:08.001 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout enabled 2024-04-26T20:54:08.018 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout active 2024-04-26T20:54:08.018 INFO:teuthology.orchestra.run.smithi055.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:54:08.018 INFO:teuthology.orchestra.run.smithi055.stdout:Repeating the final host check... 2024-04-26T20:54:08.075 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T20:54:08.075 INFO:teuthology.orchestra.run.smithi055.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T20:54:08.075 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl is present 2024-04-26T20:54:08.075 INFO:teuthology.orchestra.run.smithi055.stdout:lvcreate is present 2024-04-26T20:54:08.090 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T20:54:08.090 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T20:54:08.104 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T20:54:08.104 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:54:08.120 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout enabled 2024-04-26T20:54:08.142 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout active 2024-04-26T20:54:08.142 INFO:teuthology.orchestra.run.smithi055.stdout:Unit chronyd.service is enabled and running 2024-04-26T20:54:08.142 INFO:teuthology.orchestra.run.smithi055.stdout:Host looks OK 2024-04-26T20:54:08.143 INFO:teuthology.orchestra.run.smithi055.stdout:Cluster fsid: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:08.143 INFO:teuthology.orchestra.run.smithi055.stdout:Acquiring lock 140551906739200 on /run/cephadm/fbc85ba0-040e-11ef-bc93-c7b262605968.lock 2024-04-26T20:54:08.144 INFO:teuthology.orchestra.run.smithi055.stdout:Lock 140551906739200 acquired on /run/cephadm/fbc85ba0-040e-11ef-bc93-c7b262605968.lock 2024-04-26T20:54:08.145 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying IP 172.21.15.55 port 3300 ... 2024-04-26T20:54:08.146 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying IP 172.21.15.55 port 6789 ... 2024-04-26T20:54:08.146 INFO:teuthology.orchestra.run.smithi055.stdout:Base mon IP(s) is [172.21.15.55:3300, 172.21.15.55:6789], mon addrv is [v2:172.21.15.55:3300,v1:172.21.15.55:6789] 2024-04-26T20:54:08.161 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.55 metric 100 2024-04-26T20:54:08.161 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.55 metric 100 2024-04-26T20:54:08.174 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T20:54:08.174 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-26T20:54:08.174 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-26T20:54:08.185 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T20:54:08.185 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T20:54:08.185 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:54:08.186 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-26T20:54:08.186 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-26T20:54:08.186 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T20:54:08.188 INFO:teuthology.orchestra.run.smithi055.stdout:Mon IP `172.21.15.55` is in CIDR network `172.21.0.0/20` 2024-04-26T20:54:08.188 INFO:teuthology.orchestra.run.smithi055.stdout:Mon IP `172.21.15.55` is in CIDR network `172.21.0.0/20` 2024-04-26T20:54:08.189 INFO:teuthology.orchestra.run.smithi055.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T20:54:08.191 INFO:teuthology.orchestra.run.smithi055.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T20:54:08.194 INFO:teuthology.orchestra.run.smithi055.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-26T20:54:08.897 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19 2024-04-26T20:54:08.897 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-04-26T20:54:08.897 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T20:54:08.897 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying blob sha256:0706a02e12dd545f590c1735bb09ab9bae2bcdbcf178ce26439ab9431bd5f024 2024-04-26T20:54:08.897 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T20:54:08.898 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying config sha256:79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19 2024-04-26T20:54:08.898 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T20:54:10.171 INFO:teuthology.orchestra.run.smithi055.stdout:ceph: stdout ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable) 2024-04-26T20:54:10.172 INFO:teuthology.orchestra.run.smithi055.stdout:Ceph version: ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable) 2024-04-26T20:54:10.172 INFO:teuthology.orchestra.run.smithi055.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T20:54:11.386 INFO:teuthology.orchestra.run.smithi055.stdout:stat: stdout 167 167 2024-04-26T20:54:11.386 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial keys... 2024-04-26T20:54:12.601 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQBzFCxmTjnANBAAEQ1NZrtf3hwyjZg5nmH4QQ== 2024-04-26T20:54:13.694 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQB1FCxm4PyeAxAAX4va9AqhHa+q2FQLejxI1Q== 2024-04-26T20:54:14.810 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQB2FCxmY+EUCBAAaeYRLmMaoK5igDdE4lrNsA== 2024-04-26T20:54:14.813 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial monmap... 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool for smithi055 [v2:172.21.15.55:3300,v1:172.21.15.55:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = pacific 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: set fsid to fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:54:16.025 INFO:teuthology.orchestra.run.smithi055.stdout:Creating mon... 2024-04-26T20:54:17.116 INFO:teuthology.orchestra.run.smithi055.stdout:create mon.smithi055 on 2024-04-26T20:54:17.521 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T20:54:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T20:54:18.064 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target. 2024-04-26T20:54:18.064 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target. 2024-04-26T20:54:18.431 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055 2024-04-26T20:54:18.431 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service: Unit ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service not loaded. 2024-04-26T20:54:18.729 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target.wants/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service → /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@.service. 2024-04-26T20:54:19.418 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 podman[25083]: 2024-04-26 20:54:19.178971925 +0000 UTC m=+0.176966491 container create 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:54:19.419 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 podman[25083]: 2024-04-26 20:54:19.416140983 +0000 UTC m=+0.414135556 container init 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T20:54:19.618 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:54:19.619 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-04-26T20:54:19.644 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:54:19.644 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:54:19.645 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-04-26T20:54:19.645 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:54:19.647 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mon to start... 2024-04-26T20:54:19.647 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mon... 2024-04-26T20:54:19.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 podman[25083]: 2024-04-26 20:54:19.427851771 +0000 UTC m=+0.425846324 container start 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f) 2024-04-26T20:54:19.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 ceph-mon[25102]: mkfs fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:19.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 ceph-mon[25102]: mon.smithi055 is new leader, mons smithi055 in quorum (ranks 0) 2024-04-26T20:54:19.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 bash[25083]: 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 2024-04-26T20:54:19.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:19 smithi055 systemd[1]: Started Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: mon.smithi055 is new leader, mons smithi055 in quorum (ranks 0) 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: monmap e1: 1 mons at {smithi055=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: fsmap 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: mgrmap e1: no daemons active 2024-04-26T20:54:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:20 smithi055 ceph-mon[25102]: from='client.? 172.21.15.55:0/4160576694' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T20:54:21.117 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout id: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout services: 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi055 (age 0.882654s) 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout data: 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T20:54:21.118 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.308+0000 7f6be7200700 1 Processor -- start 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.309+0000 7f6be7200700 1 -- start start 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.309+0000 7f6be7200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.309+0000 7f6be7200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be010d970 con 0x7f6be010cf80 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.310+0000 7f6bdfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.310+0000 7f6bdfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33140/0 (socket says 172.21.15.55:33140) 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.310+0000 7f6bdfe00700 1 -- 172.21.15.55:0/3195348563 learned_addr learned my addr 172.21.15.55:0/3195348563 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.310+0000 7f6bdfe00700 1 -- 172.21.15.55:0/3195348563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be010dd60 con 0x7f6be010cf80 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.311+0000 7f6bdfe00700 1 --2- 172.21.15.55:0/3195348563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00098a0 tx=0x7f6bd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e0ee882515d57c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.311+0000 7f6bdf400700 1 -- 172.21.15.55:0/3195348563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd0004180 con 0x7f6be010cf80 2024-04-26T20:54:21.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.311+0000 7f6bdf400700 1 -- 172.21.15.55:0/3195348563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00042e0 con 0x7f6be010cf80 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.311+0000 7f6bdf400700 1 -- 172.21.15.55:0/3195348563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd00036a0 con 0x7f6be010cf80 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 -- 172.21.15.55:0/3195348563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 msgr2=0x7f6be010d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 --2- 172.21.15.55:0/3195348563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00098a0 tx=0x7f6bd0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 -- 172.21.15.55:0/3195348563 shutdown_connections 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 --2- 172.21.15.55:0/3195348563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be010d3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 -- 172.21.15.55:0/3195348563 >> 172.21.15.55:0/3195348563 conn(0x7f6be007bbd0 msgr2=0x7f6be007e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 -- 172.21.15.55:0/3195348563 shutdown_connections 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.312+0000 7f6be7200700 1 -- 172.21.15.55:0/3195348563 wait complete. 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.313+0000 7f6be7200700 1 Processor -- start 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.313+0000 7f6be7200700 1 -- start start 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.313+0000 7f6be7200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.313+0000 7f6be7200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01a0540 con 0x7f6be010cf80 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33150/0 (socket says 172.21.15.55:33150) 2024-04-26T20:54:21.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdfe00700 1 -- 172.21.15.55:0/4160576694 learned_addr learned my addr 172.21.15.55:0/4160576694 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdfe00700 1 -- 172.21.15.55:0/4160576694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009550 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdfe00700 1 --2- 172.21.15.55:0/4160576694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6be007f250 tx=0x7f6bd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd0003ce0 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0020070 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd0011630 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be01a0740 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.315+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be01a0be0 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.316+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6bd0022030 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.316+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6bd0025d40 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.316+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be0199cd0 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.320+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6bd0025480 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.400+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6be010e2b0 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.401+0000 7f6bdd600700 1 -- 172.21.15.55:0/4160576694 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f6bd0011c20 con 0x7f6be010cf80 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 msgr2=0x7f6be01a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:21.121 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 --2- 172.21.15.55:0/4160576694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6be007f250 tx=0x7f6bd0004750 comp rx=0 tx=0).stop 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 shutdown_connections 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 --2- 172.21.15.55:0/4160576694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6be010cf80 0x7f6be01a0000 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 >> 172.21.15.55:0/4160576694 conn(0x7f6be007bbd0 msgr2=0x7f6be0196e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 shutdown_connections 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:20.403+0000 7f6be7200700 1 -- 172.21.15.55:0/4160576694 wait complete. 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:mon is available 2024-04-26T20:54:21.122 INFO:teuthology.orchestra.run.smithi055.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T20:54:22.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:21 smithi055 ceph-mon[25102]: from='client.? 172.21.15.55:0/2841571087' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T20:54:22.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:21 smithi055 ceph-mon[25102]: from='client.? 172.21.15.55:0/2841571087' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout fsid = fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.55:3300,v1:172.21.15.55:6789] 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:54:22.473 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:54:22.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.703+0000 7fb71c800700 1 Processor -- start 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.704+0000 7fb71c800700 1 -- start start 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.704+0000 7fb71c800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.704+0000 7fb71c800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714106fb0 con 0x7fb7141065c0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.704+0000 7fb719e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.705+0000 7fb719e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33154/0 (socket says 172.21.15.55:33154) 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.705+0000 7fb719e00700 1 -- 172.21.15.55:0/3918588245 learned_addr learned my addr 172.21.15.55:0/3918588245 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.705+0000 7fb719e00700 1 -- 172.21.15.55:0/3918588245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7141077c0 con 0x7fb7141065c0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.705+0000 7fb719e00700 1 --2- 172.21.15.55:0/3918588245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098a0 tx=0x7fb708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13710bc4f7b38b8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb718a00700 1 -- 172.21.15.55:0/3918588245 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb708004180 con 0x7fb7141065c0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb718a00700 1 -- 172.21.15.55:0/3918588245 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080042e0 con 0x7fb7141065c0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb718a00700 1 -- 172.21.15.55:0/3918588245 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7080036a0 con 0x7fb7141065c0 2024-04-26T20:54:22.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 -- 172.21.15.55:0/3918588245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 msgr2=0x7fb7141069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 --2- 172.21.15.55:0/3918588245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7080098a0 tx=0x7fb708009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 -- 172.21.15.55:0/3918588245 shutdown_connections 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 --2- 172.21.15.55:0/3918588245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb7141069e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 -- 172.21.15.55:0/3918588245 >> 172.21.15.55:0/3918588245 conn(0x7fb714101be0 msgr2=0x7fb714104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.706+0000 7fb71c800700 1 -- 172.21.15.55:0/3918588245 shutdown_connections 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.707+0000 7fb71c800700 1 -- 172.21.15.55:0/3918588245 wait complete. 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.708+0000 7fb71c800700 1 Processor -- start 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.708+0000 7fb71c800700 1 -- start start 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.708+0000 7fb71c800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.708+0000 7fb71c800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71419c200 con 0x7fb7141065c0 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.708+0000 7fb719e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.709+0000 7fb719e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33170/0 (socket says 172.21.15.55:33170) 2024-04-26T20:54:22.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.709+0000 7fb719e00700 1 -- 172.21.15.55:0/2841571087 learned_addr learned my addr 172.21.15.55:0/2841571087 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.709+0000 7fb719e00700 1 -- 172.21.15.55:0/2841571087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009550 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.709+0000 7fb719e00700 1 --2- 172.21.15.55:0/2841571087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb708004000 tx=0x7fb708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.709+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb708003ce0 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708020070 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb708011630 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71419c400 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71419c8a0 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb708022030 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.710+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb708025d40 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.711+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb714107b30 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.714+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb708025480 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.791+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb71419f130 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.802+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fb708011bd0 con 0x7fb7141065c0 2024-04-26T20:54:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.802+0000 7fb70ea00700 1 -- 172.21.15.55:0/2841571087 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fb708036020 con 0x7fb7141065c0 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.803+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 msgr2=0x7fb71419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.803+0000 7fb71c800700 1 --2- 172.21.15.55:0/2841571087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb708004000 tx=0x7fb708004750 comp rx=0 tx=0).stop 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.804+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 shutdown_connections 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.804+0000 7fb71c800700 1 --2- 172.21.15.55:0/2841571087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7141065c0 0x7fb71419bcc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.804+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 >> 172.21.15.55:0/2841571087 conn(0x7fb714101be0 msgr2=0x7fb71407b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.804+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 shutdown_connections 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:21.804+0000 7fb71c800700 1 -- 172.21.15.55:0/2841571087 wait complete. 2024-04-26T20:54:22.478 INFO:teuthology.orchestra.run.smithi055.stdout:Generating new minimal ceph.conf... 2024-04-26T20:54:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:23 smithi055 ceph-mon[25102]: from='client.? 172.21.15.55:0/3372510178' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:32.966 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.061+0000 7f40cdc00700 1 Processor -- start 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.061+0000 7f40cdc00700 1 -- start start 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.062+0000 7f40cdc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.062+0000 7f40cdc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c81091a0 con 0x7f40c81087b0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.062+0000 7f40c6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.062+0000 7f40c6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33180/0 (socket says 172.21.15.55:33180) 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.062+0000 7f40c6a00700 1 -- 172.21.15.55:0/1913446313 learned_addr learned my addr 172.21.15.55:0/1913446313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.063+0000 7f40c6a00700 1 -- 172.21.15.55:0/1913446313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c81099b0 con 0x7f40c81087b0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.063+0000 7f40c6a00700 1 --2- 172.21.15.55:0/1913446313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f40b80098a0 tx=0x7f40b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fd7183005c367f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.063+0000 7f40c5600700 1 -- 172.21.15.55:0/1913446313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b8004180 con 0x7f40c81087b0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.063+0000 7f40c5600700 1 -- 172.21.15.55:0/1913446313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f40b80042e0 con 0x7f40c81087b0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.063+0000 7f40c5600700 1 -- 172.21.15.55:0/1913446313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b8011a70 con 0x7f40c81087b0 2024-04-26T20:54:32.967 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.064+0000 7f40cdc00700 1 -- 172.21.15.55:0/1913446313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 msgr2=0x7f40c8108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.064+0000 7f40cdc00700 1 --2- 172.21.15.55:0/1913446313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f40b80098a0 tx=0x7f40b8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.064+0000 7f40cdc00700 1 -- 172.21.15.55:0/1913446313 shutdown_connections 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.064+0000 7f40cdc00700 1 --2- 172.21.15.55:0/1913446313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c8108bd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.064+0000 7f40cdc00700 1 -- 172.21.15.55:0/1913446313 >> 172.21.15.55:0/1913446313 conn(0x7f40c807bc20 msgr2=0x7f40c81064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.065+0000 7f40cdc00700 1 -- 172.21.15.55:0/1913446313 shutdown_connections 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.065+0000 7f40cdc00700 1 -- 172.21.15.55:0/1913446313 wait complete. 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40cdc00700 1 Processor -- start 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40cdc00700 1 -- start start 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40cdc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40cdc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c819ca20 con 0x7f40c81087b0 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40c6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40c6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33184/0 (socket says 172.21.15.55:33184) 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.066+0000 7f40c6a00700 1 -- 172.21.15.55:0/3372510178 learned_addr learned my addr 172.21.15.55:0/3372510178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40c6a00700 1 -- 172.21.15.55:0/3372510178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8009550 con 0x7f40c81087b0 2024-04-26T20:54:32.968 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40c6a00700 1 --2- 172.21.15.55:0/3372510178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40b8011710 tx=0x7f40b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b8003b10 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f40b801b8c0 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40b8019770 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.067+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c819cc20 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.068+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c819d0c0 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.068+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f40b8019ca0 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.068+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f40b801a710 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.069+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c8062510 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.072+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f40b8029060 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.150+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f40c810cbe0 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.151+0000 7f40bf400700 1 -- 172.21.15.55:0/3372510178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f40b801f070 con 0x7f40c81087b0 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.152+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 msgr2=0x7f40c819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:32.969 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.152+0000 7f40cdc00700 1 --2- 172.21.15.55:0/3372510178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40b8011710 tx=0x7f40b80047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.152+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 shutdown_connections 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.153+0000 7f40cdc00700 1 --2- 172.21.15.55:0/3372510178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40c81087b0 0x7f40c819c4e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.153+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 >> 172.21.15.55:0/3372510178 conn(0x7f40c807bc20 msgr2=0x7f40c8105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.153+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 shutdown_connections 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:23.153+0000 7f40cdc00700 1 -- 172.21.15.55:0/3372510178 wait complete. 2024-04-26T20:54:32.970 INFO:teuthology.orchestra.run.smithi055.stdout:Restarting the monitor... 2024-04-26T20:54:33.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:33 smithi055 systemd[1]: Stopping Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T20:54:34.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:33 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[25098]: 2024-04-26T20:54:33.705+0000 7f7165000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi055 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T20:54:34.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:33 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[25098]: 2024-04-26T20:54:33.705+0000 7f7165000700 -1 mon.smithi055@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T20:54:34.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:33 smithi055 podman[25346]: 2024-04-26 20:54:33.87101542 +0000 UTC m=+0.404156868 container died 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T20:54:34.737 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:34 smithi055 podman[25346]: 2024-04-26 20:54:34.279959056 +0000 UTC m=+0.813100538 container cleanup 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T20:54:34.737 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:34 smithi055 bash[25346]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055 2024-04-26T20:54:34.737 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:34 smithi055 podman[25358]: 2024-04-26 20:54:34.514289767 +0000 UTC m=+0.628178106 container remove 1bfb99e65be4bf59149651657001411efde4fc4515df216713ec5a7473f62f50 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, RELEASE=reef-7d2137f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:54:35.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service: Deactivated successfully. 2024-04-26T20:54:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 systemd[1]: Stopped Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T20:54:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service: Consumed 1.991s CPU time. 2024-04-26T20:54:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 systemd[1]: Starting Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T20:54:35.652 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 podman[25457]: 2024-04-26 20:54:35.373397326 +0000 UTC m=+0.124621032 container create 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T20:54:35.652 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 podman[25457]: 2024-04-26 20:54:35.282676312 +0000 UTC m=+0.033899981 image pull 79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19 quay.ceph.io/ceph-ci/ceph:reef 2024-04-26T20:54:35.743 INFO:teuthology.orchestra.run.smithi055.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T20:54:36.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 podman[25457]: 2024-04-26 20:54:35.651617106 +0000 UTC m=+0.402840819 container init 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5) 2024-04-26T20:54:36.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 podman[25457]: 2024-04-26 20:54:35.661915793 +0000 UTC m=+0.413139468 container start 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:54:36.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable), process ceph-mon, pid 2 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: pidfile_write: ignore empty --pid-file 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: load: jerasure load: lrc 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Git sha 0 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Compile date 2024-04-25 19:04:37 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: DB SUMMARY 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: DB Session ID: AEVXCNUTK6J66KHALXMC 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi055/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi055/store.db: 000009.log size: 98493 ; 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:54:36.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.env: 0x55fa11cfa820 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.info_log: 0x55fa513eb420 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.statistics: (nil) 2024-04-26T20:54:36.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.use_fsync: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.db_log_dir: 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.wal_dir: 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:54:36.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.write_buffer_manager: 0x55fa50660140 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:54:36.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.unordered_write: 0 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.row_cache: None 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.wal_filter: None 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:54:36.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.wal_compression: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:54:36.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_open_files: -1 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:54:36.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Compression algorithms supported: 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kZSTD supported: 0 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:54:36.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi055/store.db/MANIFEST-000010 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.merge_operator: 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_filter: None 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa513eb520) 2024-04-26T20:54:36.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_type: 0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: data_block_index_type: 0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_shortening: 1 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: checksum: 4 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: no_block_cache: 0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache: 0x55fa507011f0 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_options: 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: capacity : 536870912 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: num_shard_bits : 4 2024-04-26T20:54:36.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: strict_capacity_limit : 0 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_compressed: (nil) 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: persistent_cache: (nil) 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_size: 4096 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_size_deviation: 10 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_restart_interval: 16 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_block_restart_interval: 1 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: metadata_block_size: 4096 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: partition_filters: 0 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: use_delta_encoding: 1 2024-04-26T20:54:36.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: filter_policy: bloomfilter 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: whole_key_filtering: 1 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: verify_compression: 0 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: format_version: 5 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: enable_index_compression: 1 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_align: 0 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: max_auto_readahead_size: 262144 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: prepopulate_block_cache: 0 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression: NoCompression 2024-04-26T20:54:36.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.num_levels: 7 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:54:36.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:54:36.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:54:36.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:54:36.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.table_properties_collectors: 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:54:36.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.ttl: 2592000 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:54:36.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi055/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b4ab6299-c839-4768-8953-4b3c686e6918 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714164875723703, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714164875726952, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93770, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 91804, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84368, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714164875, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b4ab6299-c839-4768-8953-4b3c686e6918", "db_session_id": "AEVXCNUTK6J66KHALXMC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714164875727178, "job": 1, "event": "recovery_finished"} 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 bash[25457]: 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi055/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fa507a0000 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: DB pointer 0x55fa5078e000 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:54:36.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** DB Stats ** 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** Compaction Stats [default] ** 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: L0 2/0 93.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 43.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Sum 2/0 93.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 43.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T20:54:36.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 43.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** Compaction Stats [default] ** 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 43.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:54:36.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative compaction: 0.00 GB write, 6.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval compaction: 0.00 GB write, 6.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Block cache BinnedLRUCache@0x55fa507011f0#2 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: starting mon.smithi055 rank 0 at public addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] at bind addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi055 fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???) e1 preinit fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).mds e1 new map 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).mds e1 print_map 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: e1 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T20:54:36.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: legacy client fscid: -1 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: No filesystems configured 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 systemd[1]: Started Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mon.smithi055 is new leader, mons smithi055 in quorum (ranks 0) 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: monmap e1: 1 mons at {smithi055=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: fsmap 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T20:54:36.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:35 smithi055 ceph-mon[25475]: mgrmap e1: no daemons active 2024-04-26T20:54:37.134 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.373+0000 7f9c01e00700 1 Processor -- start 2024-04-26T20:54:37.135 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.374+0000 7f9c01e00700 1 -- start start 2024-04-26T20:54:37.135 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.374+0000 7f9c01e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:37.135 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.374+0000 7f9c01e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc079ed0 con 0x7f9bfc107020 2024-04-26T20:54:37.135 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.375+0000 7f9bfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:37.136 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.375+0000 7f9bfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57176/0 (socket says 172.21.15.55:57176) 2024-04-26T20:54:37.136 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.375+0000 7f9bfaa00700 1 -- 172.21.15.55:0/3260266220 learned_addr learned my addr 172.21.15.55:0/3260266220 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:37.136 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.375+0000 7f9bfaa00700 1 -- 172.21.15.55:0/3260266220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc109950 con 0x7f9bfc107020 2024-04-26T20:54:37.137 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.376+0000 7f9bfaa00700 1 --2- 172.21.15.55:0/3260266220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098a0 tx=0x7f9bec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b88afc0e772eeaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:37.137 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.376+0000 7f9bfa000700 1 -- 172.21.15.55:0/3260266220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec004180 con 0x7f9bfc107020 2024-04-26T20:54:37.137 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.376+0000 7f9bfa000700 1 -- 172.21.15.55:0/3260266220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f9bec0042e0 con 0x7f9bfc107020 2024-04-26T20:54:37.137 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.376+0000 7f9bfa000700 1 -- 172.21.15.55:0/3260266220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec011a70 con 0x7f9bfc107020 2024-04-26T20:54:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 -- 172.21.15.55:0/3260266220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 msgr2=0x7f9bfc109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 --2- 172.21.15.55:0/3260266220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098a0 tx=0x7f9bec009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 -- 172.21.15.55:0/3260266220 shutdown_connections 2024-04-26T20:54:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 --2- 172.21.15.55:0/3260266220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc109410 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 -- 172.21.15.55:0/3260266220 >> 172.21.15.55:0/3260266220 conn(0x7f9bfc100ab0 msgr2=0x7f9bfc102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 -- 172.21.15.55:0/3260266220 shutdown_connections 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.377+0000 7f9c01e00700 1 -- 172.21.15.55:0/3260266220 wait complete. 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.378+0000 7f9c01e00700 1 Processor -- start 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.378+0000 7f9c01e00700 1 -- start start 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9c01e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:37.139 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9c01e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc106d90 con 0x7f9bfc107020 2024-04-26T20:54:37.140 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9bfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:37.140 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9bfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57190/0 (socket says 172.21.15.55:57190) 2024-04-26T20:54:37.141 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9bfaa00700 1 -- 172.21.15.55:0/2203766136 learned_addr learned my addr 172.21.15.55:0/2203766136 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:37.141 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.379+0000 7f9bfaa00700 1 -- 172.21.15.55:0/2203766136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec009550 con 0x7f9bfc107020 2024-04-26T20:54:37.141 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9bfaa00700 1 --2- 172.21.15.55:0/2203766136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9bec011710 tx=0x7f9bec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:37.141 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec003b10 con 0x7f9bfc107020 2024-04-26T20:54:37.141 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f9bec01b8c0 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bec0197e0 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc104fd0 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.380+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc105470 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.381+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9bec019cd0 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.381+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bec01a3d0 con 0x7f9bfc107020 2024-04-26T20:54:37.142 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.381+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc10a6d0 con 0x7f9bfc107020 2024-04-26T20:54:37.143 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.385+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9bec029060 con 0x7f9bfc107020 2024-04-26T20:54:37.143 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.461+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f9bfc10a8c0 con 0x7f9bfc107020 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.470+0000 7f9c00a00700 1 -- 172.21.15.55:0/2203766136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9bec01f070 con 0x7f9bfc107020 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 msgr2=0x7f9bfc106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 --2- 172.21.15.55:0/2203766136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9bec011710 tx=0x7f9bec0047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 shutdown_connections 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 --2- 172.21.15.55:0/2203766136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bfc107020 0x7f9bfc106850 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 >> 172.21.15.55:0/2203766136 conn(0x7f9bfc100ab0 msgr2=0x7f9bfc1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 shutdown_connections 2024-04-26T20:54:37.144 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:36.472+0000 7f9c01e00700 1 -- 172.21.15.55:0/2203766136 wait complete. 2024-04-26T20:54:37.145 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T20:54:37.165 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:54:37.165 INFO:teuthology.orchestra.run.smithi055.stdout:Creating mgr... 2024-04-26T20:54:37.166 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T20:54:37.168 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T20:54:37.168 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying port 0.0.0.0:8443 ... 2024-04-26T20:54:37.641 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mgr.smithi055.ybbowr 2024-04-26T20:54:37.642 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mgr.smithi055.ybbowr.service: Unit ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mgr.smithi055.ybbowr.service not loaded. 2024-04-26T20:54:37.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:37 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2203766136' entity='client.admin' 2024-04-26T20:54:38.166 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968.target.wants/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mgr.smithi055.ybbowr.service → /etc/systemd/system/ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@.service. 2024-04-26T20:54:38.984 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:54:38.984 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-04-26T20:54:39.000 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:54:39.000 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:54:39.001 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-04-26T20:54:39.001 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T20:54:39.025 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:54:39.026 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-04-26T20:54:39.048 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:54:39.048 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:54:39.048 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-04-26T20:54:39.048 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-04-26T20:54:39.049 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr to start... 2024-04-26T20:54:39.049 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr... 2024-04-26T20:54:39.952 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:39 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/897246414' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:54:40.508 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:40.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:54:40.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "fbc85ba0-040e-11ef-bc93-c7b262605968", 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:54:40.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "smithi055" 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:54:40.512 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:40.513 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:54:40.513 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:54:40.513 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:54:40.521 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:54:40.522 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:54:19.523845+0000", 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.699+0000 7fe2b8600700 1 Processor -- start 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.699+0000 7fe2b8600700 1 -- start start 2024-04-26T20:54:40.523 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.700+0000 7fe2b8600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.700+0000 7fe2b8600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00747b0 con 0x7fe2b0107020 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.700+0000 7fe2b5c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.701+0000 7fe2b5c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57228/0 (socket says 172.21.15.55:57228) 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.701+0000 7fe2b5c00700 1 -- 172.21.15.55:0/3356967602 learned_addr learned my addr 172.21.15.55:0/3356967602 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.701+0000 7fe2b5c00700 1 -- 172.21.15.55:0/3356967602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0109950 con 0x7fe2b0107020 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.701+0000 7fe2b5c00700 1 --2- 172.21.15.55:0/3356967602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098a0 tx=0x7fe2a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725890cb5fb3badc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.702+0000 7fe2afe00700 1 -- 172.21.15.55:0/3356967602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2a4004180 con 0x7fe2b0107020 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.702+0000 7fe2afe00700 1 -- 172.21.15.55:0/3356967602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe2a40042e0 con 0x7fe2b0107020 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.702+0000 7fe2afe00700 1 -- 172.21.15.55:0/3356967602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2a4011a70 con 0x7fe2b0107020 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.702+0000 7fe2b8600700 1 -- 172.21.15.55:0/3356967602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 msgr2=0x7fe2b0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.702+0000 7fe2b8600700 1 --2- 172.21.15.55:0/3356967602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40098a0 tx=0x7fe2a4009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.703+0000 7fe2b8600700 1 -- 172.21.15.55:0/3356967602 shutdown_connections 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.703+0000 7fe2b8600700 1 --2- 172.21.15.55:0/3356967602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b0109410 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:40.524 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.703+0000 7fe2b8600700 1 -- 172.21.15.55:0/3356967602 >> 172.21.15.55:0/3356967602 conn(0x7fe2b0100a50 msgr2=0x7fe2b0102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.703+0000 7fe2b8600700 1 -- 172.21.15.55:0/3356967602 shutdown_connections 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.703+0000 7fe2b8600700 1 -- 172.21.15.55:0/3356967602 wait complete. 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.704+0000 7fe2b8600700 1 Processor -- start 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.704+0000 7fe2b8600700 1 -- start start 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.704+0000 7fe2b8600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.704+0000 7fe2b8600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b019ca70 con 0x7fe2b0107020 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.705+0000 7fe2b5c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.705+0000 7fe2b5c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57244/0 (socket says 172.21.15.55:57244) 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.705+0000 7fe2b5c00700 1 -- 172.21.15.55:0/897246414 learned_addr learned my addr 172.21.15.55:0/897246414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.705+0000 7fe2b5c00700 1 -- 172.21.15.55:0/897246414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009550 con 0x7fe2b0107020 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.705+0000 7fe2b5c00700 1 --2- 172.21.15.55:0/897246414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4011710 tx=0x7fe2a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.706+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2a4003b10 con 0x7fe2b0107020 2024-04-26T20:54:40.525 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.706+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe2a401b8c0 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.706+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b019cc70 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.706+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2a40197e0 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.706+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b019d110 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.707+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b010a6d0 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.707+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe2a4019a20 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.707+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe2a401a3d0 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.710+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe2a4029060 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.788+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe2b010a910 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.789+0000 7fe2ae000700 1 -- 172.21.15.55:0/897246414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fe2a4032090 con 0x7fe2b0107020 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 msgr2=0x7fe2b019c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 --2- 172.21.15.55:0/897246414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4011710 tx=0x7fe2a40047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 shutdown_connections 2024-04-26T20:54:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 --2- 172.21.15.55:0/897246414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b0107020 0x7fe2b019c530 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:40.527 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 >> 172.21.15.55:0/897246414 conn(0x7fe2b0100a50 msgr2=0x7fe2b0101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:40.527 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 shutdown_connections 2024-04-26T20:54:40.527 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:39.791+0000 7fe2b8600700 1 -- 172.21.15.55:0/897246414 wait complete. 2024-04-26T20:54:40.527 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (1/15)... 2024-04-26T20:54:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:43 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1255567925' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:54:44.013 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "fbc85ba0-040e-11ef-bc93-c7b262605968", 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:54:44.014 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:44.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:54:44.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "smithi055" 2024-04-26T20:54:44.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:44.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:54:44.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:44.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:54:44.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:54:44.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:54:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:54:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:54:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:54:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.025 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:54:44.026 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:54:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:54:19.523845+0000", 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.118+0000 7fef23a00700 1 Processor -- start 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.118+0000 7fef23a00700 1 -- start start 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.118+0000 7fef23a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.118+0000 7fef23a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c0797a0 con 0x7fef1c07ad70 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.119+0000 7fef21000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.119+0000 7fef21000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57246/0 (socket says 172.21.15.55:57246) 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.119+0000 7fef21000700 1 -- 172.21.15.55:0/943166552 learned_addr learned my addr 172.21.15.55:0/943166552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.119+0000 7fef21000700 1 -- 172.21.15.55:0/943166552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0798e0 con 0x7fef1c07ad70 2024-04-26T20:54:44.028 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.120+0000 7fef21000700 1 --2- 172.21.15.55:0/943166552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef100098a0 tx=0x7fef10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a3f0205d45132d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.120+0000 7fef1b400700 1 -- 172.21.15.55:0/943166552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef10004180 con 0x7fef1c07ad70 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.120+0000 7fef1b400700 1 -- 172.21.15.55:0/943166552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fef100042e0 con 0x7fef1c07ad70 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.120+0000 7fef1b400700 1 -- 172.21.15.55:0/943166552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef10011a70 con 0x7fef1c07ad70 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.121+0000 7fef23a00700 1 -- 172.21.15.55:0/943166552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 msgr2=0x7fef1c0791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.121+0000 7fef23a00700 1 --2- 172.21.15.55:0/943166552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fef100098a0 tx=0x7fef10009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.121+0000 7fef23a00700 1 -- 172.21.15.55:0/943166552 shutdown_connections 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.121+0000 7fef23a00700 1 --2- 172.21.15.55:0/943166552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c0791d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.121+0000 7fef23a00700 1 -- 172.21.15.55:0/943166552 >> 172.21.15.55:0/943166552 conn(0x7fef1c101ba0 msgr2=0x7fef1c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.122+0000 7fef23a00700 1 -- 172.21.15.55:0/943166552 shutdown_connections 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.122+0000 7fef23a00700 1 -- 172.21.15.55:0/943166552 wait complete. 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.123+0000 7fef23a00700 1 Processor -- start 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.123+0000 7fef23a00700 1 -- start start 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.124+0000 7fef23a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:44.029 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.124+0000 7fef23a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19cac0 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.124+0000 7fef21000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.124+0000 7fef21000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57260/0 (socket says 172.21.15.55:57260) 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.124+0000 7fef21000700 1 -- 172.21.15.55:0/1255567925 learned_addr learned my addr 172.21.15.55:0/1255567925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef21000700 1 -- 172.21.15.55:0/1255567925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009550 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef21000700 1 --2- 172.21.15.55:0/1255567925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef10006af0 tx=0x7fef100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef10003a00 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fef10003b60 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef10023750 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c19ccc0 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.125+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c19d160 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.126+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fef10023c80 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.126+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fef10019710 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.127+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c10c8e0 con 0x7fef1c07ad70 2024-04-26T20:54:44.030 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.129+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fef1001bbe0 con 0x7fef1c07ad70 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.223+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fef1c10caa0 con 0x7fef1c07ad70 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.224+0000 7fef19600700 1 -- 172.21.15.55:0/1255567925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fef100198d0 con 0x7fef1c07ad70 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 msgr2=0x7fef1c19c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 --2- 172.21.15.55:0/1255567925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef10006af0 tx=0x7fef100047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 shutdown_connections 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 --2- 172.21.15.55:0/1255567925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c07ad70 0x7fef1c19c580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 >> 172.21.15.55:0/1255567925 conn(0x7fef1c101ba0 msgr2=0x7fef1c102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 shutdown_connections 2024-04-26T20:54:44.031 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:43.225+0000 7fef23a00700 1 -- 172.21.15.55:0/1255567925 wait complete. 2024-04-26T20:54:44.032 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (2/15)... 2024-04-26T20:54:47.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:46 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/386880816' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:54:47.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:47.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:54:47.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "fbc85ba0-040e-11ef-bc93-c7b262605968", 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "smithi055" 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-26T20:54:47.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:54:47.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:54:47.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:54:19.523845+0000", 2024-04-26T20:54:47.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.626+0000 7f05a5000700 1 Processor -- start 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.626+0000 7f05a5000700 1 -- start start 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.627+0000 7f05a5000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.627+0000 7f05a5000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a0079820 con 0x7f05a007adf0 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.627+0000 7f059de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.627+0000 7f059de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58170/0 (socket says 172.21.15.55:58170) 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.627+0000 7f059de00700 1 -- 172.21.15.55:0/3495935432 learned_addr learned my addr 172.21.15.55:0/3495935432 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.628+0000 7f059de00700 1 -- 172.21.15.55:0/3495935432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0079960 con 0x7f05a007adf0 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.628+0000 7f059de00700 1 --2- 172.21.15.55:0/3495935432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05900098a0 tx=0x7f0590009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25520085c030432 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:47.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.628+0000 7f059ca00700 1 -- 172.21.15.55:0/3495935432 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0590004180 con 0x7f05a007adf0 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f059ca00700 1 -- 172.21.15.55:0/3495935432 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f05900042e0 con 0x7f05a007adf0 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f059ca00700 1 -- 172.21.15.55:0/3495935432 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0590011a70 con 0x7f05a007adf0 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f05a5000700 1 -- 172.21.15.55:0/3495935432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 msgr2=0x7f05a0079250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f05a5000700 1 --2- 172.21.15.55:0/3495935432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05900098a0 tx=0x7f0590009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f05a5000700 1 -- 172.21.15.55:0/3495935432 shutdown_connections 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f05a5000700 1 --2- 172.21.15.55:0/3495935432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a0079250 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.629+0000 7f05a5000700 1 -- 172.21.15.55:0/3495935432 >> 172.21.15.55:0/3495935432 conn(0x7f05a0101c00 msgr2=0x7f05a0104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.630+0000 7f05a5000700 1 -- 172.21.15.55:0/3495935432 shutdown_connections 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.630+0000 7f05a5000700 1 -- 172.21.15.55:0/3495935432 wait complete. 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f05a5000700 1 Processor -- start 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f05a5000700 1 -- start start 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f05a5000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:47.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f05a5000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a019ca90 con 0x7f05a007adf0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f059de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f059de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58178/0 (socket says 172.21.15.55:58178) 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.631+0000 7f059de00700 1 -- 172.21.15.55:0/386880816 learned_addr learned my addr 172.21.15.55:0/386880816 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f059de00700 1 -- 172.21.15.55:0/386880816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009550 con 0x7f05a007adf0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f059de00700 1 --2- 172.21.15.55:0/386880816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0590011710 tx=0x7f05900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0590003b10 con 0x7f05a007adf0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f059001b8c0 con 0x7f05a007adf0 2024-04-26T20:54:47.465 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a019cc90 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.632+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0590019770 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.633+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a019d130 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.633+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0590019cf0 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.633+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f059001a710 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.634+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a0062510 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.638+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0590029060 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.719+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f05a010cb70 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.719+0000 7f0596a00700 1 -- 172.21.15.55:0/386880816 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f059001f070 con 0x7f05a007adf0 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 msgr2=0x7f05a019c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 --2- 172.21.15.55:0/386880816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0590011710 tx=0x7f05900047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 shutdown_connections 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 --2- 172.21.15.55:0/386880816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05a007adf0 0x7f05a019c550 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:47.466 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 >> 172.21.15.55:0/386880816 conn(0x7f05a0101c00 msgr2=0x7f05a01027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:47.467 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.721+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 shutdown_connections 2024-04-26T20:54:47.467 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:46.722+0000 7f05a5000700 1 -- 172.21.15.55:0/386880816 wait complete. 2024-04-26T20:54:47.467 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (3/15)... 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: Activating manager daemon smithi055.ybbowr 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: mgrmap e2: smithi055.ybbowr(active, starting, since 0.0112734s) 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:54:48.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: Manager daemon smithi055.ybbowr is now available 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' 2024-04-26T20:54:48.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:48 smithi055 ceph-mon[25475]: from='mgr.14100 172.21.15.55:0/3780586494' entity='mgr.smithi055.ybbowr' 2024-04-26T20:54:50.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:50 smithi055 ceph-mon[25475]: mgrmap e3: smithi055.ybbowr(active, since 1.02118s) 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "fbc85ba0-040e-11ef-bc93-c7b262605968", 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T20:54:51.045 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "smithi055" 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:51.046 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T20:54:51.047 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T20:54:51.048 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T20:54:19.523845+0000", 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.075+0000 7fb06c200700 1 Processor -- start 2024-04-26T20:54:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.075+0000 7fb06c200700 1 -- start start 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb06c200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb06c200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064074730 con 0x7fb064104e90 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb069800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb069800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58260/0 (socket says 172.21.15.55:58260) 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb069800700 1 -- 172.21.15.55:0/2261214374 learned_addr learned my addr 172.21.15.55:0/2261214374 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.076+0000 7fb069800700 1 -- 172.21.15.55:0/2261214374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0641057f0 con 0x7fb064104e90 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.077+0000 7fb069800700 1 --2- 172.21.15.55:0/2261214374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0580098a0 tx=0x7fb058009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d531663e679cf4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.077+0000 7fb063e00700 1 -- 172.21.15.55:0/2261214374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb058004180 con 0x7fb064104e90 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.077+0000 7fb063e00700 1 -- 172.21.15.55:0/2261214374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fb0580042e0 con 0x7fb064104e90 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.077+0000 7fb063e00700 1 -- 172.21.15.55:0/2261214374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb058011a70 con 0x7fb064104e90 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 -- 172.21.15.55:0/2261214374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 msgr2=0x7fb0641052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 --2- 172.21.15.55:0/2261214374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0580098a0 tx=0x7fb058009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 -- 172.21.15.55:0/2261214374 shutdown_connections 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 --2- 172.21.15.55:0/2261214374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb0641052b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 -- 172.21.15.55:0/2261214374 >> 172.21.15.55:0/2261214374 conn(0x7fb064100a50 msgr2=0x7fb064102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 -- 172.21.15.55:0/2261214374 shutdown_connections 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.078+0000 7fb06c200700 1 -- 172.21.15.55:0/2261214374 wait complete. 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.079+0000 7fb06c200700 1 Processor -- start 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.079+0000 7fb06c200700 1 -- start start 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.080+0000 7fb06c200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.080+0000 7fb06c200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06419ca50 con 0x7fb064104e90 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.080+0000 7fb069800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.080+0000 7fb069800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58276/0 (socket says 172.21.15.55:58276) 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.080+0000 7fb069800700 1 -- 172.21.15.55:0/2377478552 learned_addr learned my addr 172.21.15.55:0/2377478552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb069800700 1 -- 172.21.15.55:0/2377478552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009550 con 0x7fb064104e90 2024-04-26T20:54:51.051 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb069800700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb058011710 tx=0x7fb0580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb058003b10 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fb05801b8c0 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb06c200700 1 -- 172.21.15.55:0/2377478552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06419cc50 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0580197e0 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.081+0000 7fb06c200700 1 -- 172.21.15.55:0/2377478552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06419d0f0 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.083+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fb05801ba30 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.083+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0400052f0 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.083+0000 7fb062000700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 0x7fb04c03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.083+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb05804c870 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.083+0000 7fb068e00700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 0x7fb04c03abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.084+0000 7fb068e00700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 0x7fb04c03abe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb050006fd0 tx=0x7fb050006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.089+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb05801bce0 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.403+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb040005160 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.404+0000 7fb062000700 1 -- 172.21.15.55:0/2377478552 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fb05801f030 con 0x7fb064104e90 2024-04-26T20:54:51.052 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.407+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 msgr2=0x7fb04c03abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 0x7fb04c03abe0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb050006fd0 tx=0x7fb050006e40 comp rx=0 tx=0).stop 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 msgr2=0x7fb06419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb058011710 tx=0x7fb0580047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 shutdown_connections 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fb04c038720 0x7fb04c03abe0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 --2- 172.21.15.55:0/2377478552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb064104e90 0x7fb06419c510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 >> 172.21.15.55:0/2377478552 conn(0x7fb064100a50 msgr2=0x7fb0641933a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 shutdown_connections 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:50.408+0000 7fb057400700 1 -- 172.21.15.55:0/2377478552 wait complete. 2024-04-26T20:54:51.053 INFO:teuthology.orchestra.run.smithi055.stdout:mgr is available 2024-04-26T20:54:51.361 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:51 smithi055 ceph-mon[25475]: mgrmap e4: smithi055.ybbowr(active, since 2s) 2024-04-26T20:54:51.361 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:51 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2377478552' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T20:54:52.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:52 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3595813399' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout fsid = fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:52.764 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T20:54:52.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T20:54:52.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-04-26T20:54:52.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T20:54:52.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.718+0000 7fbadc400700 1 Processor -- start 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.719+0000 7fbadc400700 1 -- start start 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.719+0000 7fbadc400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.719+0000 7fbadc400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad410da70 con 0x7fbad410d080 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.720+0000 7fbad9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.720+0000 7fbad9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58284/0 (socket says 172.21.15.55:58284) 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.720+0000 7fbad9a00700 1 -- 172.21.15.55:0/2787238573 learned_addr learned my addr 172.21.15.55:0/2787238573 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.720+0000 7fbad9a00700 1 -- 172.21.15.55:0/2787238573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad410de00 con 0x7fbad410d080 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.721+0000 7fbad9a00700 1 --2- 172.21.15.55:0/2787238573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbac80098a0 tx=0x7fbac8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b3d22372b711d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.721+0000 7fbad3e00700 1 -- 172.21.15.55:0/2787238573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbac8004180 con 0x7fbad410d080 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.721+0000 7fbad3e00700 1 -- 172.21.15.55:0/2787238573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fbac80042e0 con 0x7fbad410d080 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.721+0000 7fbad3e00700 1 -- 172.21.15.55:0/2787238573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbac8011a70 con 0x7fbad410d080 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 -- 172.21.15.55:0/2787238573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 msgr2=0x7fbad410d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 --2- 172.21.15.55:0/2787238573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbac80098a0 tx=0x7fbac8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 -- 172.21.15.55:0/2787238573 shutdown_connections 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 --2- 172.21.15.55:0/2787238573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad410d4a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 -- 172.21.15.55:0/2787238573 >> 172.21.15.55:0/2787238573 conn(0x7fbad407bbf0 msgr2=0x7fbad407e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 -- 172.21.15.55:0/2787238573 shutdown_connections 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.722+0000 7fbadc400700 1 -- 172.21.15.55:0/2787238573 wait complete. 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.723+0000 7fbadc400700 1 Processor -- start 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbadc400700 1 -- start start 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbadc400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbadc400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41a0e50 con 0x7fbad410d080 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbad9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbad9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58300/0 (socket says 172.21.15.55:58300) 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.724+0000 7fbad9a00700 1 -- 172.21.15.55:0/3595813399 learned_addr learned my addr 172.21.15.55:0/3595813399 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbad9a00700 1 -- 172.21.15.55:0/3595813399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009550 con 0x7fbad410d080 2024-04-26T20:54:52.773 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbad9a00700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbac8011710 tx=0x7fbac80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbac8003b10 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fbac801b8c0 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbac8019770 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad41a1050 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.725+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad41a14f0 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.727+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad4111030 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.727+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fbac801ba30 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.727+0000 7fbad2000700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 0x7fbabc03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.727+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbac804c870 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.728+0000 7fbad9000700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 0x7fbabc03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.729+0000 7fbad9000700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 0x7fbabc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbac0006fd0 tx=0x7fbac0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.732+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fbac802cce0 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.955+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fbad41a3d80 con 0x7fbad410d080 2024-04-26T20:54:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.956+0000 7fbad2000700 1 -- 172.21.15.55:0/3595813399 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fbac801f070 con 0x7fbad410d080 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 msgr2=0x7fbabc03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 0x7fbabc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbac0006fd0 tx=0x7fbac0006e40 comp rx=0 tx=0).stop 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 msgr2=0x7fbad41a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbac8011710 tx=0x7fbac80047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 shutdown_connections 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fbabc038770 0x7fbabc03ac30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 --2- 172.21.15.55:0/3595813399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbad410d080 0x7fbad41a0910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 >> 172.21.15.55:0/3595813399 conn(0x7fbad407bbf0 msgr2=0x7fbad407c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 shutdown_connections 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:51.960+0000 7fbadc400700 1 -- 172.21.15.55:0/3595813399 wait complete. 2024-04-26T20:54:52.775 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling cephadm module... 2024-04-26T20:54:54.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:53 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/541898437' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T20:54:54.729 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.384+0000 7fe888a00700 1 Processor -- start 2024-04-26T20:54:54.729 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.384+0000 7fe888a00700 1 -- start start 2024-04-26T20:54:54.729 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.384+0000 7fe888a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:54.729 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.384+0000 7fe888a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841091f0 con 0x7fe884108800 2024-04-26T20:54:54.729 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.385+0000 7fe881e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.385+0000 7fe881e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58302/0 (socket says 172.21.15.55:58302) 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.385+0000 7fe881e00700 1 -- 172.21.15.55:0/4125409435 learned_addr learned my addr 172.21.15.55:0/4125409435 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.385+0000 7fe881e00700 1 -- 172.21.15.55:0/4125409435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8841099b0 con 0x7fe884108800 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.386+0000 7fe881e00700 1 --2- 172.21.15.55:0/4125409435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe8740098a0 tx=0x7fe874009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd7d749c799ce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.386+0000 7fe881400700 1 -- 172.21.15.55:0/4125409435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe874004180 con 0x7fe884108800 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.386+0000 7fe881400700 1 -- 172.21.15.55:0/4125409435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe8740042e0 con 0x7fe884108800 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.386+0000 7fe881400700 1 -- 172.21.15.55:0/4125409435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe874011a70 con 0x7fe884108800 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 -- 172.21.15.55:0/4125409435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 msgr2=0x7fe884108c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 --2- 172.21.15.55:0/4125409435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe8740098a0 tx=0x7fe874009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 -- 172.21.15.55:0/4125409435 shutdown_connections 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 --2- 172.21.15.55:0/4125409435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe884108c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 -- 172.21.15.55:0/4125409435 >> 172.21.15.55:0/4125409435 conn(0x7fe88407bd30 msgr2=0x7fe8841064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:54.730 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 -- 172.21.15.55:0/4125409435 shutdown_connections 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.387+0000 7fe888a00700 1 -- 172.21.15.55:0/4125409435 wait complete. 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.388+0000 7fe888a00700 1 Processor -- start 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe888a00700 1 -- start start 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe888a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe888a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88419ca20 con 0x7fe884108800 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe881e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe881e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58314/0 (socket says 172.21.15.55:58314) 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.389+0000 7fe881e00700 1 -- 172.21.15.55:0/541898437 learned_addr learned my addr 172.21.15.55:0/541898437 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe881e00700 1 -- 172.21.15.55:0/541898437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874009550 con 0x7fe884108800 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe881e00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe874011710 tx=0x7fe8740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe874003b10 con 0x7fe884108800 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe87401b8c0 con 0x7fe884108800 2024-04-26T20:54:54.731 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe874019770 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.390+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88419cc20 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.391+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88419d0c0 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.392+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fe87401ba30 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.392+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88410cbe0 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.392+0000 7fe87aa00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 0x7fe86803abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.392+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe87404c860 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.393+0000 7fe87be00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 0x7fe86803abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.393+0000 7fe87be00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 0x7fe86803abe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe86c006fd0 tx=0x7fe86c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.398+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe87402cce0 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.682+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fe88419f9b0 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.740+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe8740199a0 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.743+0000 7fe87aa00700 1 -- 172.21.15.55:0/541898437 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fe87404c280 con 0x7fe884108800 2024-04-26T20:54:54.732 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 msgr2=0x7fe86803abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 0x7fe86803abe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe86c006fd0 tx=0x7fe86c006e40 comp rx=0 tx=0).stop 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 msgr2=0x7fe88419c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe874011710 tx=0x7fe8740047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 shutdown_connections 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7fe868038720 0x7fe86803abe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 --2- 172.21.15.55:0/541898437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe884108800 0x7fe88419c4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 >> 172.21.15.55:0/541898437 conn(0x7fe88407bd30 msgr2=0x7fe884105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 shutdown_connections 2024-04-26T20:54:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:53.746+0000 7fe888a00700 1 -- 172.21.15.55:0/541898437 wait complete. 2024-04-26T20:54:55.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:54 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/541898437' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T20:54:55.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:54 smithi055 ceph-mon[25475]: mgrmap e5: smithi055.ybbowr(active, since 5s) 2024-04-26T20:54:56.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:54:55 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4221057002' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "active_name": "smithi055.ybbowr", 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.326+0000 7f9a63200700 1 Processor -- start 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.327+0000 7f9a63200700 1 -- start start 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.327+0000 7f9a63200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:56.573 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.327+0000 7f9a63200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a64106e00 con 0x7f9a64106410 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.327+0000 7f9a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.327+0000 7f9a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54340/0 (socket says 172.21.15.55:54340) 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.328+0000 7f9a61e00700 1 -- 172.21.15.55:0/176413396 learned_addr learned my addr 172.21.15.55:0/176413396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.328+0000 7f9a61e00700 1 -- 172.21.15.55:0/176413396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64107610 con 0x7f9a64106410 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.328+0000 7f9a61e00700 1 --2- 172.21.15.55:0/176413396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a540098a0 tx=0x7f9a54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da035b36bcab004 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a60a00700 1 -- 172.21.15.55:0/176413396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a54004180 con 0x7f9a64106410 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a60a00700 1 -- 172.21.15.55:0/176413396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f9a540042e0 con 0x7f9a64106410 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a60a00700 1 -- 172.21.15.55:0/176413396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a54011a70 con 0x7f9a64106410 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a63200700 1 -- 172.21.15.55:0/176413396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 msgr2=0x7f9a64106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a63200700 1 --2- 172.21.15.55:0/176413396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a540098a0 tx=0x7f9a54009bb0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.574 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a63200700 1 -- 172.21.15.55:0/176413396 shutdown_connections 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.329+0000 7f9a63200700 1 --2- 172.21.15.55:0/176413396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a64106830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.330+0000 7f9a63200700 1 -- 172.21.15.55:0/176413396 >> 172.21.15.55:0/176413396 conn(0x7f9a64101a30 msgr2=0x7f9a64103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.330+0000 7f9a63200700 1 -- 172.21.15.55:0/176413396 shutdown_connections 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.330+0000 7f9a63200700 1 -- 172.21.15.55:0/176413396 wait complete. 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.331+0000 7f9a63200700 1 Processor -- start 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.331+0000 7f9a63200700 1 -- start start 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a63200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a63200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6419c800 con 0x7f9a64106410 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54346/0 (socket says 172.21.15.55:54346) 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a61e00700 1 -- 172.21.15.55:0/4221057002 learned_addr learned my addr 172.21.15.55:0/4221057002 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.332+0000 7f9a61e00700 1 -- 172.21.15.55:0/4221057002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009550 con 0x7f9a64106410 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a61e00700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a54011710 tx=0x7f9a540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:54:56.575 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a54003b10 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f9a5401b8c0 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a54019770 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6419ca00 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.333+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6419cea0 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.334+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6410a840 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.334+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f9a5401ba30 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.335+0000 7f9a5aa00700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 0x7f9a4803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.335+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9a5404c8c0 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.335+0000 7f9a61400700 1 -- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 msgr2=0x7f9a4803acf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.335+0000 7f9a61400700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 0x7f9a4803acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.340+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9a5402c9a0 con 0x7f9a64106410 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.536+0000 7f9a61400700 1 -- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 msgr2=0x7f9a4803acf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:54:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.536+0000 7f9a61400700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 0x7f9a4803acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.656+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9a6419f790 con 0x7f9a64106410 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.657+0000 7f9a5aa00700 1 -- 172.21.15.55:0/4221057002 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9a5401f070 con 0x7f9a64106410 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 msgr2=0x7f9a4803acf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 0x7f9a4803acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 msgr2=0x7f9a6419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a54011710 tx=0x7f9a540047c0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 shutdown_connections 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f9a48038830 0x7f9a4803acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 --2- 172.21.15.55:0/4221057002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a64106410 0x7f9a6419c2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.660+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 >> 172.21.15.55:0/4221057002 conn(0x7f9a64101a30 msgr2=0x7f9a64102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.661+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 shutdown_connections 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:55.661+0000 7f9a63200700 1 -- 172.21.15.55:0/4221057002 wait complete. 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for the mgr to restart... 2024-04-26T20:54:56.577 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr epoch 5... 2024-04-26T20:55:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T20:55:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: Activating manager daemon smithi055.ybbowr 2024-04-26T20:55:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T20:55:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: mgrmap e6: smithi055.ybbowr(active, starting, since 0.0126618s) 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: Manager daemon smithi055.ybbowr is now available 2024-04-26T20:55:03.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:02 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:04.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: Found migration_current of "None". Setting to last migration. 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T20:55:04.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:03 smithi055 ceph-mon[25475]: mgrmap e7: smithi055.ybbowr(active, since 1.0153s) 2024-04-26T20:55:04.633 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:55:04.633 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.292+0000 7f3030200700 1 Processor -- start 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.292+0000 7f3030200700 1 -- start start 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.293+0000 7f3030200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.293+0000 7f3030200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280746f0 con 0x7f30281070e0 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.293+0000 7f302d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.293+0000 7f302d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54360/0 (socket says 172.21.15.55:54360) 2024-04-26T20:55:04.635 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.293+0000 7f302d800700 1 -- 172.21.15.55:0/2989035959 learned_addr learned my addr 172.21.15.55:0/2989035959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:04.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.294+0000 7f302d800700 1 -- 172.21.15.55:0/2989035959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028074830 con 0x7f30281070e0 2024-04-26T20:55:04.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.294+0000 7f302d800700 1 --2- 172.21.15.55:0/2989035959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f301c0098a0 tx=0x7f301c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6f100dcd57f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.294+0000 7f3027e00700 1 -- 172.21.15.55:0/2989035959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301c004180 con 0x7f30281070e0 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.294+0000 7f3027e00700 1 -- 172.21.15.55:0/2989035959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f301c0042e0 con 0x7f30281070e0 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.294+0000 7f3027e00700 1 -- 172.21.15.55:0/2989035959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301c011a70 con 0x7f30281070e0 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.295+0000 7f3030200700 1 -- 172.21.15.55:0/2989035959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 msgr2=0x7f30281094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.295+0000 7f3030200700 1 --2- 172.21.15.55:0/2989035959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f301c0098a0 tx=0x7f301c009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.295+0000 7f3030200700 1 -- 172.21.15.55:0/2989035959 shutdown_connections 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.295+0000 7f3030200700 1 --2- 172.21.15.55:0/2989035959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f30281094d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.295+0000 7f3030200700 1 -- 172.21.15.55:0/2989035959 >> 172.21.15.55:0/2989035959 conn(0x7f3028100a50 msgr2=0x7f3028102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.296+0000 7f3030200700 1 -- 172.21.15.55:0/2989035959 shutdown_connections 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.296+0000 7f3030200700 1 -- 172.21.15.55:0/2989035959 wait complete. 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.297+0000 7f3030200700 1 Processor -- start 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.297+0000 7f3030200700 1 -- start start 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.297+0000 7f3030200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.297+0000 7f3030200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302819a820 con 0x7f30281070e0 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f302d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f302d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54368/0 (socket says 172.21.15.55:54368) 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f302d800700 1 -- 172.21.15.55:0/3261287414 learned_addr learned my addr 172.21.15.55:0/3261287414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f302d800700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c009550 con 0x7f30281070e0 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f302d800700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f301c011710 tx=0x7f301c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:04.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.298+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301c003b10 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.299+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f301c01b8c0 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.299+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302819aa20 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.299+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301c0197e0 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.299+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302819aec0 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.300+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f301c01b440 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.300+0000 7f3026000700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.300+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f301003b340 con 0x7f3010038770 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.300+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f301c04c920 con 0x7f30281070e0 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.300+0000 7f302ce00700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:55:04.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.301+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.502+0000 7f302ce00700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.502+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.903+0000 7f302ce00700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:57.903+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:58.704+0000 7f302ce00700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:54:58.704+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:00.306+0000 7f302ce00700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/4088155030 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:00.306+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:02.948+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f301c01a3d0 con 0x7f30281070e0 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:02.948+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 msgr2=0x7f301003ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:02.948+0000 7f3026000700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.948+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f301c018b30 con 0x7f30281070e0 2024-04-26T20:55:04.645 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.948+0000 7f3026000700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 0x7f301003e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.948+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f301003b340 con 0x7f301003bfb0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.950+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 0x7f301003e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.952+0000 7f302ce00700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 0x7f301003e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3014003a10 tx=0x7f30140092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.953+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f301003b340 con 0x7f301003bfb0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.961+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f302810a6f0 con 0x7f301003bfb0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.962+0000 7f3026000700 1 -- 172.21.15.55:0/3261287414 <== mgr.14120 v2:172.21.15.55:6800/2358731820 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f302810a6f0 con 0x7f301003bfb0 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 msgr2=0x7f301003e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 0x7f301003e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3014003a10 tx=0x7f30140092b0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 msgr2=0x7f302819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f301c011710 tx=0x7f301c0047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 shutdown_connections 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f301003bfb0 0x7f301003e3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.646 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30281070e0 0x7f302819a2e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 --2- 172.21.15.55:0/3261287414 >> [v2:172.21.15.55:6800/4088155030,v1:172.21.15.55:6801/4088155030] conn(0x7f3010038770 0x7f301003ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 >> 172.21.15.55:0/3261287414 conn(0x7f3028100a50 msgr2=0x7f3028101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 shutdown_connections 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:03.963+0000 7f3030200700 1 -- 172.21.15.55:0/3261287414 wait complete. 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:mgr epoch 5 is available 2024-04-26T20:55:04.647 INFO:teuthology.orchestra.run.smithi055.stdout:Setting orchestrator backend to cephadm... 2024-04-26T20:55:05.198 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:05 smithi055 ceph-mon[25475]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:55:05.199 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:05 smithi055 ceph-mon[25475]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: mgrmap e8: smithi055.ybbowr(active, since 2s) 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:06.222 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:06.223 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:06 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:05] ENGINE Bus STARTING 2024-04-26T20:55:06.341 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.274+0000 7fbc0f000700 1 Processor -- start 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.274+0000 7fbc0f000700 1 -- start start 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.275+0000 7fbc0f000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.275+0000 7fbc0f000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08074730 con 0x7fbc08106f00 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.275+0000 7fbc0dc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.275+0000 7fbc0dc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36584/0 (socket says 172.21.15.55:36584) 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.275+0000 7fbc0dc00700 1 -- 172.21.15.55:0/1977630665 learned_addr learned my addr 172.21.15.55:0/1977630665 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.276+0000 7fbc0dc00700 1 -- 172.21.15.55:0/1977630665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08109830 con 0x7fbc08106f00 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.276+0000 7fbc0dc00700 1 --2- 172.21.15.55:0/1977630665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098a0 tx=0x7fbbfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bed2514eca9325 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:06.346 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.276+0000 7fbc07e00700 1 -- 172.21.15.55:0/1977630665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbfc004180 con 0x7fbc08106f00 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.276+0000 7fbc07e00700 1 -- 172.21.15.55:0/1977630665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fbbfc0042e0 con 0x7fbc08106f00 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.276+0000 7fbc07e00700 1 -- 172.21.15.55:0/1977630665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbfc011a70 con 0x7fbc08106f00 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 -- 172.21.15.55:0/1977630665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 msgr2=0x7fbc081092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 --2- 172.21.15.55:0/1977630665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098a0 tx=0x7fbbfc009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 -- 172.21.15.55:0/1977630665 shutdown_connections 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 --2- 172.21.15.55:0/1977630665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc081092f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 -- 172.21.15.55:0/1977630665 >> 172.21.15.55:0/1977630665 conn(0x7fbc081008f0 msgr2=0x7fbc08102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 -- 172.21.15.55:0/1977630665 shutdown_connections 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.277+0000 7fbc0f000700 1 -- 172.21.15.55:0/1977630665 wait complete. 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.278+0000 7fbc0f000700 1 Processor -- start 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.278+0000 7fbc0f000700 1 -- start start 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0f000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0f000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0819a5c0 con 0x7fbc08106f00 2024-04-26T20:55:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0dc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0dc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36596/0 (socket says 172.21.15.55:36596) 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0dc00700 1 -- 172.21.15.55:0/545567360 learned_addr learned my addr 172.21.15.55:0/545567360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.279+0000 7fbc0dc00700 1 -- 172.21.15.55:0/545567360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc009550 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc0dc00700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc011710 tx=0x7fbbfc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbfc003b10 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fbbfc01b8c0 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0819a7c0 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbfc0197e0 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.280+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0819ac60 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.281+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbbfc01b440 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.281+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0810a550 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.282+0000 7fbc06000700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 0x7fbbf003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.282+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbbfc04c950 con 0x7fbc08106f00 2024-04-26T20:55:06.348 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.282+0000 7fbc0d200700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 0x7fbbf003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.283+0000 7fbc0d200700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 0x7fbbf003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4006fd0 tx=0x7fbbf4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.288+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fbbfc018530 con 0x7fbc08106f00 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.520+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc08101a70 con 0x7fbbf0038830 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.540+0000 7fbc06000700 1 -- 172.21.15.55:0/545567360 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbc08101a70 con 0x7fbbf0038830 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 msgr2=0x7fbbf003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 0x7fbbf003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4006fd0 tx=0x7fbbf4006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 msgr2=0x7fbc0819a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc011710 tx=0x7fbbfc0047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 shutdown_connections 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fbbf0038830 0x7fbbf003acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 --2- 172.21.15.55:0/545567360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc08106f00 0x7fbc0819a080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 >> 172.21.15.55:0/545567360 conn(0x7fbc081008f0 msgr2=0x7fbc08101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 shutdown_connections 2024-04-26T20:55:06.349 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:05.543+0000 7fbc0f000700 1 -- 172.21.15.55:0/545567360 wait complete. 2024-04-26T20:55:07.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:07 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:05] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T20:55:07.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:07 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:05] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T20:55:07.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:07 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:05] ENGINE Bus STARTED 2024-04-26T20:55:07.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:07 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:07.843 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T20:55:07.844 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.940+0000 7f6f0b200700 1 Processor -- start 2024-04-26T20:55:07.844 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.940+0000 7f6f0b200700 1 -- start start 2024-04-26T20:55:07.844 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f0b200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:07.844 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f0b200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c106e00 con 0x7f6f0c106410 2024-04-26T20:55:07.845 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f09e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:07.845 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f09e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36598/0 (socket says 172.21.15.55:36598) 2024-04-26T20:55:07.845 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f09e00700 1 -- 172.21.15.55:0/844443400 learned_addr learned my addr 172.21.15.55:0/844443400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:07.845 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.941+0000 7f6f09e00700 1 -- 172.21.15.55:0/844443400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c107610 con 0x7f6f0c106410 2024-04-26T20:55:07.846 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.942+0000 7f6f09e00700 1 --2- 172.21.15.55:0/844443400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098a0 tx=0x7f6efc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9715301803be9574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:07.846 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.942+0000 7f6f08a00700 1 -- 172.21.15.55:0/844443400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6efc004180 con 0x7f6f0c106410 2024-04-26T20:55:07.847 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.942+0000 7f6f08a00700 1 -- 172.21.15.55:0/844443400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6efc0042e0 con 0x7f6f0c106410 2024-04-26T20:55:07.847 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.942+0000 7f6f08a00700 1 -- 172.21.15.55:0/844443400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6efc011a70 con 0x7f6f0c106410 2024-04-26T20:55:07.847 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 -- 172.21.15.55:0/844443400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 msgr2=0x7f6f0c106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:07.847 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 --2- 172.21.15.55:0/844443400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098a0 tx=0x7f6efc009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:07.847 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 -- 172.21.15.55:0/844443400 shutdown_connections 2024-04-26T20:55:07.850 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 --2- 172.21.15.55:0/844443400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c106830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 -- 172.21.15.55:0/844443400 >> 172.21.15.55:0/844443400 conn(0x7f6f0c101a30 msgr2=0x7f6f0c103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 -- 172.21.15.55:0/844443400 shutdown_connections 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.943+0000 7f6f0b200700 1 -- 172.21.15.55:0/844443400 wait complete. 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.944+0000 7f6f0b200700 1 Processor -- start 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.944+0000 7f6f0b200700 1 -- start start 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.944+0000 7f6f0b200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.944+0000 7f6f0b200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c19c800 con 0x7f6f0c106410 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.945+0000 7f6f09e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:07.851 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.945+0000 7f6f09e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36610/0 (socket says 172.21.15.55:36610) 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.945+0000 7f6f09e00700 1 -- 172.21.15.55:0/3766675176 learned_addr learned my addr 172.21.15.55:0/3766675176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.945+0000 7f6f09e00700 1 -- 172.21.15.55:0/3766675176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc009550 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.945+0000 7f6f09e00700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6efc011710 tx=0x7f6efc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.946+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6efc003b10 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.946+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6efc01b8c0 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.946+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c19ca00 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.946+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6efc019710 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.946+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c19cea0 con 0x7f6f0c106410 2024-04-26T20:55:07.852 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.947+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c10a840 con 0x7f6f0c106410 2024-04-26T20:55:07.853 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.947+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f6efc01b440 con 0x7f6f0c106410 2024-04-26T20:55:07.853 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.948+0000 7f6f02a00700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 0x7f6ef003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:07.853 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.948+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6efc04cb90 con 0x7f6f0c106410 2024-04-26T20:55:07.853 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.948+0000 7f6f09400700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 0x7f6ef003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:07.853 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.949+0000 7f6f09400700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 0x7f6ef003acb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:07.854 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:06.954+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6efc018530 con 0x7f6f0c106410 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.198+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f0c19f790 con 0x7f6ef00387f0 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.200+0000 7f6f02a00700 1 -- 172.21.15.55:0/3766675176 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f6f0c19f790 con 0x7f6ef00387f0 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 msgr2=0x7f6ef003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 0x7f6ef003acb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 msgr2=0x7f6f0c19c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6efc011710 tx=0x7f6efc0047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 shutdown_connections 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6ef00387f0 0x7f6ef003acb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 --2- 172.21.15.55:0/3766675176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c106410 0x7f6f0c19c2c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 >> 172.21.15.55:0/3766675176 conn(0x7f6f0c101a30 msgr2=0x7f6f0c1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 shutdown_connections 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:07.203+0000 7f6f0b200700 1 -- 172.21.15.55:0/3766675176 wait complete. 2024-04-26T20:55:07.855 INFO:teuthology.orchestra.run.smithi055.stdout:Generating ssh key... 2024-04-26T20:55:08.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:08 smithi055 ceph-mon[25475]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:09.480 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:09 smithi055 ceph-mon[25475]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:09.480 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:09 smithi055 ceph-mon[25475]: Generating ssh key... 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.505+0000 7f56db800700 1 Processor -- start 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.505+0000 7f56db800700 1 -- start start 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.505+0000 7f56db800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.505+0000 7f56db800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40746f0 con 0x7f56d41070e0 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.506+0000 7f56d8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.506+0000 7f56d8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36614/0 (socket says 172.21.15.55:36614) 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.506+0000 7f56d8e00700 1 -- 172.21.15.55:0/688286750 learned_addr learned my addr 172.21.15.55:0/688286750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.507+0000 7f56d8e00700 1 -- 172.21.15.55:0/688286750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4074830 con 0x7f56d41070e0 2024-04-26T20:55:09.750 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.507+0000 7f56d8e00700 1 --2- 172.21.15.55:0/688286750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f56c80098a0 tx=0x7f56c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d41c4787cb7554 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.507+0000 7f56d3400700 1 -- 172.21.15.55:0/688286750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c8004180 con 0x7f56d41070e0 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.508+0000 7f56d3400700 1 -- 172.21.15.55:0/688286750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f56c80042e0 con 0x7f56d41070e0 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.508+0000 7f56d3400700 1 -- 172.21.15.55:0/688286750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c8011a70 con 0x7f56d41070e0 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.508+0000 7f56db800700 1 -- 172.21.15.55:0/688286750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 msgr2=0x7f56d41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.508+0000 7f56db800700 1 --2- 172.21.15.55:0/688286750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f56c80098a0 tx=0x7f56c8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.509+0000 7f56db800700 1 -- 172.21.15.55:0/688286750 shutdown_connections 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.509+0000 7f56db800700 1 --2- 172.21.15.55:0/688286750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d41094d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.509+0000 7f56db800700 1 -- 172.21.15.55:0/688286750 >> 172.21.15.55:0/688286750 conn(0x7f56d4100a50 msgr2=0x7f56d4102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.509+0000 7f56db800700 1 -- 172.21.15.55:0/688286750 shutdown_connections 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.509+0000 7f56db800700 1 -- 172.21.15.55:0/688286750 wait complete. 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.510+0000 7f56db800700 1 Processor -- start 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.510+0000 7f56db800700 1 -- start start 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.510+0000 7f56db800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:09.751 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.510+0000 7f56db800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4106e50 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.510+0000 7f56d8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.511+0000 7f56d8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36628/0 (socket says 172.21.15.55:36628) 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.511+0000 7f56d8e00700 1 -- 172.21.15.55:0/2640344718 learned_addr learned my addr 172.21.15.55:0/2640344718 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.511+0000 7f56d8e00700 1 -- 172.21.15.55:0/2640344718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8009550 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.511+0000 7f56d8e00700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f56c8011710 tx=0x7f56c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.511+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c8003b10 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.512+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f56c801b8c0 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.512+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56c80197e0 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.512+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d4105090 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.512+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4105530 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.513+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f56c801ba30 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.513+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d410a6f0 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.513+0000 7f56d1600700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 0x7f56bc03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.513+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f56c804ca10 con 0x7f56d41070e0 2024-04-26T20:55:09.752 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.514+0000 7f56d3e00700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 0x7f56bc03abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.514+0000 7f56d3e00700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 0x7f56bc03abe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006fd0 tx=0x7f56c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.519+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f56c801bce0 con 0x7f56d41070e0 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:08.743+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f56d4105d20 con 0x7f56bc038720 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.110+0000 7f56d1600700 1 -- 172.21.15.55:0/2640344718 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f56d4105d20 con 0x7f56bc038720 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.113+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 msgr2=0x7f56bc03abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.113+0000 7f56db800700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 0x7f56bc03abe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56c0006fd0 tx=0x7f56c0006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.113+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 msgr2=0x7f56d4106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.113+0000 7f56db800700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f56c8011710 tx=0x7f56c80047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 shutdown_connections 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f56bc038720 0x7f56bc03abe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 --2- 172.21.15.55:0/2640344718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41070e0 0x7f56d4106910 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 >> 172.21.15.55:0/2640344718 conn(0x7f56d4100a50 msgr2=0x7f56d4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 shutdown_connections 2024-04-26T20:55:09.753 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:09.114+0000 7f56db800700 1 -- 172.21.15.55:0/2640344718 wait complete. 2024-04-26T20:55:10.301 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:10 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:10.301 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:10 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:11.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:11 smithi055 ceph-mon[25475]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW6fgS4aANB+CyrQsADJDIU8mbN/ptK/HBYhI7uH7kTVQlpNQ0B/C2frjy50R2nngr5qDEZJRixjtegzp5gcF/rrR/nLkFDegvJKq163o74yxMWj60GfIKxDd2TvmwCBUcBApCX68yIr8AgVFnZrBpqgTCe8I9OFxLfbM7N4d6onmtroBH1hypYxjIRfBt0xAZBb1gKXrx3SCMDN9eFJH6zUDTFa1C3TTuPevyxqGGyxO+Y/HcwuNpw0EXiUtIAkjb6+Nw+IaPBHrymRwWDHTIJ1OTsFhC2l44rVSkCwDdSlFzXnHngrwmFro0/utYmyTrkvGcWSXwyX4tiqxn1ctPW12iJO1/2cjlHza6b2uLlHBM2i7wp2zCFQLvfdgyRXvkb3efihwQEndcbLtS5ldYZw/tB5MGoJ/DQcS8vXy1xo5f/359AB/RBNmEWOU3ID7Q+1fttk+u4qvj1CjIXxZt+/E8bF+3bS1+zIixzSrjgz+IjajoJvF8mvNQHrFCZ68= ceph-fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.378+0000 7f575e000700 1 Processor -- start 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.378+0000 7f575e000700 1 -- start start 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.379+0000 7f575e000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.379+0000 7f575e000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758105ea0 con 0x7f57581054b0 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.379+0000 7f5757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.379+0000 7f5757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36634/0 (socket says 172.21.15.55:36634) 2024-04-26T20:55:11.322 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.379+0000 7f5757400700 1 -- 172.21.15.55:0/1652579181 learned_addr learned my addr 172.21.15.55:0/1652579181 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.380+0000 7f5757400700 1 -- 172.21.15.55:0/1652579181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57581066b0 con 0x7f57581054b0 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.380+0000 7f5757400700 1 --2- 172.21.15.55:0/1652579181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57480098a0 tx=0x7f5748009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a512d82c5c13b73b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.380+0000 7f5756000700 1 -- 172.21.15.55:0/1652579181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5748004180 con 0x7f57581054b0 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.380+0000 7f5756000700 1 -- 172.21.15.55:0/1652579181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f57480042e0 con 0x7f57581054b0 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f5756000700 1 -- 172.21.15.55:0/1652579181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5748011a70 con 0x7f57581054b0 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 -- 172.21.15.55:0/1652579181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 msgr2=0x7f57581058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 --2- 172.21.15.55:0/1652579181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57480098a0 tx=0x7f5748009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 -- 172.21.15.55:0/1652579181 shutdown_connections 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 --2- 172.21.15.55:0/1652579181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f57581058d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 -- 172.21.15.55:0/1652579181 >> 172.21.15.55:0/1652579181 conn(0x7f5758100a50 msgr2=0x7f5758102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 -- 172.21.15.55:0/1652579181 shutdown_connections 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.381+0000 7f575e000700 1 -- 172.21.15.55:0/1652579181 wait complete. 2024-04-26T20:55:11.323 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.382+0000 7f575e000700 1 Processor -- start 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f575e000700 1 -- start start 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f575e000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f575e000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575819cb80 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f5757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f5757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36646/0 (socket says 172.21.15.55:36646) 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.383+0000 7f5757400700 1 -- 172.21.15.55:0/2626526866 learned_addr learned my addr 172.21.15.55:0/2626526866 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f5757400700 1 -- 172.21.15.55:0/2626526866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009550 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f5757400700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5748011710 tx=0x7f57480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5748003b10 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f574801b8c0 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575819cd80 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5748019770 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.384+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575819d220 con 0x7f57581054b0 2024-04-26T20:55:11.324 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.385+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f574801b440 con 0x7f57581054b0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.386+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57581968d0 con 0x7f57581054b0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.386+0000 7f574fe00700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 0x7f573c03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.386+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f574804c9f0 con 0x7f57581054b0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.386+0000 7f5756a00700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 0x7f573c03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.387+0000 7f5756a00700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 0x7f573c03ac30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5744006fd0 tx=0x7f5744006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.391+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5748018530 con 0x7f57581054b0 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.616+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5758061320 con 0x7f573c038770 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.617+0000 7f574fe00700 1 -- 172.21.15.55:0/2626526866 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f5758061320 con 0x7f573c038770 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.619+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 msgr2=0x7f573c03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.619+0000 7f575e000700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 0x7f573c03ac30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5744006fd0 tx=0x7f5744006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 msgr2=0x7f575819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5748011710 tx=0x7f57480047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 shutdown_connections 2024-04-26T20:55:11.325 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f573c038770 0x7f573c03ac30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 --2- 172.21.15.55:0/2626526866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57581054b0 0x7f575819c640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 >> 172.21.15.55:0/2626526866 conn(0x7f5758100a50 msgr2=0x7f5758101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 shutdown_connections 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:10.620+0000 7f575e000700 1 -- 172.21.15.55:0/2626526866 wait complete. 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T20:55:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T20:55:11.327 INFO:teuthology.orchestra.run.smithi055.stdout:Adding host smithi055... 2024-04-26T20:55:13.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:12 smithi055 ceph-mon[25475]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi055", "addr": "172.21.15.55", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:14.217 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:13 smithi055 ceph-mon[25475]: Deploying cephadm binary to smithi055 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Added host 'smithi055' with addr '172.21.15.55' 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.930+0000 7fdc9bc00700 1 Processor -- start 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.930+0000 7fdc9bc00700 1 -- start start 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.931+0000 7fdc9bc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.931+0000 7fdc9bc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940747b0 con 0x7fdc94107010 2024-04-26T20:55:17.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.931+0000 7fdc99200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:17.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.932+0000 7fdc99200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36662/0 (socket says 172.21.15.55:36662) 2024-04-26T20:55:17.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.932+0000 7fdc99200700 1 -- 172.21.15.55:0/2096544520 learned_addr learned my addr 172.21.15.55:0/2096544520 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:17.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.932+0000 7fdc99200700 1 -- 172.21.15.55:0/2096544520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94109940 con 0x7fdc94107010 2024-04-26T20:55:17.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.932+0000 7fdc99200700 1 --2- 172.21.15.55:0/2096544520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc880098a0 tx=0x7fdc88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58063dc0a39288c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:17.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.933+0000 7fdc93400700 1 -- 172.21.15.55:0/2096544520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc88004180 con 0x7fdc94107010 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.933+0000 7fdc93400700 1 -- 172.21.15.55:0/2096544520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdc880042e0 con 0x7fdc94107010 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.933+0000 7fdc93400700 1 -- 172.21.15.55:0/2096544520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc88011a70 con 0x7fdc94107010 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.933+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2096544520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 msgr2=0x7fdc94109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.933+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2096544520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc880098a0 tx=0x7fdc88009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.934+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2096544520 shutdown_connections 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.934+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2096544520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc94109400 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.934+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2096544520 >> 172.21.15.55:0/2096544520 conn(0x7fdc94100a60 msgr2=0x7fdc94102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.934+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2096544520 shutdown_connections 2024-04-26T20:55:17.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.934+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2096544520 wait complete. 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.935+0000 7fdc9bc00700 1 Processor -- start 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.935+0000 7fdc9bc00700 1 -- start start 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.935+0000 7fdc9bc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.935+0000 7fdc9bc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419a7f0 con 0x7fdc94107010 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.936+0000 7fdc99200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.936+0000 7fdc99200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36672/0 (socket says 172.21.15.55:36672) 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.936+0000 7fdc99200700 1 -- 172.21.15.55:0/2093319953 learned_addr learned my addr 172.21.15.55:0/2093319953 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.936+0000 7fdc99200700 1 -- 172.21.15.55:0/2093319953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009550 con 0x7fdc94107010 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.936+0000 7fdc99200700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc88011a20 tx=0x7fdc880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.937+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc88003b10 con 0x7fdc94107010 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.937+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdc8801b8c0 con 0x7fdc94107010 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.937+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc880237b0 con 0x7fdc94107010 2024-04-26T20:55:17.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.937+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9419a9f0 con 0x7fdc94107010 2024-04-26T20:55:17.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.937+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9419ae90 con 0x7fdc94107010 2024-04-26T20:55:17.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.938+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9410a6c0 con 0x7fdc94107010 2024-04-26T20:55:17.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.938+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fdc8801ba30 con 0x7fdc94107010 2024-04-26T20:55:17.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.939+0000 7fdc91600700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 0x7fdc7c03abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:17.461 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.939+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdc8804cac0 con 0x7fdc94107010 2024-04-26T20:55:17.462 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.939+0000 7fdc93e00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 0x7fdc7c03abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.940+0000 7fdc93e00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 0x7fdc7c03abf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc80006fd0 tx=0x7fdc80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:11.945+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fdc8801bce0 con 0x7fdc94107010 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:12.175+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi055", "addr": "172.21.15.55", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc94101cd0 con 0x7fdc7c038730 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.720+0000 7fdc91600700 1 -- 172.21.15.55:0/2093319953 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fdc94101cd0 con 0x7fdc7c038730 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.724+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 msgr2=0x7fdc7c03abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.724+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 0x7fdc7c03abf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc80006fd0 tx=0x7fdc80006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.724+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 msgr2=0x7fdc9419a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.724+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc88011a20 tx=0x7fdc880047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 shutdown_connections 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fdc7c038730 0x7fdc7c03abf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 --2- 172.21.15.55:0/2093319953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc94107010 0x7fdc9419a2b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:17.463 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 >> 172.21.15.55:0/2093319953 conn(0x7fdc94100a60 msgr2=0x7fdc941015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:17.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 shutdown_connections 2024-04-26T20:55:17.464 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:16.725+0000 7fdc9bc00700 1 -- 172.21.15.55:0/2093319953 wait complete. 2024-04-26T20:55:17.464 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying mon service with default placement... 2024-04-26T20:55:18.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:17 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:18.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:17 smithi055 ceph-mon[25475]: Added host smithi055 2024-04-26T20:55:18.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:17 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.294+0000 7f2fb8e00700 1 Processor -- start 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.294+0000 7f2fb8e00700 1 -- start start 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.295+0000 7f2fb8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.295+0000 7f2fb8e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4106f90 con 0x7f2fb41065a0 2024-04-26T20:55:19.243 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.295+0000 7f2fb1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.295+0000 7f2fb1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51986/0 (socket says 172.21.15.55:51986) 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.295+0000 7f2fb1e00700 1 -- 172.21.15.55:0/3144453504 learned_addr learned my addr 172.21.15.55:0/3144453504 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.296+0000 7f2fb1e00700 1 -- 172.21.15.55:0/3144453504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb41077a0 con 0x7f2fb41065a0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.296+0000 7f2fb1e00700 1 --2- 172.21.15.55:0/3144453504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40098a0 tx=0x7f2fa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625c97955056bd35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.296+0000 7f2fb0a00700 1 -- 172.21.15.55:0/3144453504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa4004180 con 0x7f2fb41065a0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.297+0000 7f2fb0a00700 1 -- 172.21.15.55:0/3144453504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2fa40042e0 con 0x7f2fb41065a0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.297+0000 7f2fb0a00700 1 -- 172.21.15.55:0/3144453504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa4011a70 con 0x7f2fb41065a0 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.297+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3144453504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 msgr2=0x7f2fb41069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.297+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3144453504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40098a0 tx=0x7f2fa4009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.298+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3144453504 shutdown_connections 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.298+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3144453504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb41069c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.298+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3144453504 >> 172.21.15.55:0/3144453504 conn(0x7f2fb4101ba0 msgr2=0x7f2fb4103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:19.244 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.298+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3144453504 shutdown_connections 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.298+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3144453504 wait complete. 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.299+0000 7f2fb8e00700 1 Processor -- start 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.299+0000 7f2fb8e00700 1 -- start start 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.299+0000 7f2fb8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.299+0000 7f2fb8e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb407af70 con 0x7f2fb41065a0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.299+0000 7f2fb1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.300+0000 7f2fb1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51988/0 (socket says 172.21.15.55:51988) 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.300+0000 7f2fb1e00700 1 -- 172.21.15.55:0/3928885665 learned_addr learned my addr 172.21.15.55:0/3928885665 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.300+0000 7f2fb1e00700 1 -- 172.21.15.55:0/3928885665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4009550 con 0x7f2fb41065a0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.300+0000 7f2fb1e00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006af0 tx=0x7f2fa40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.300+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa4003a00 con 0x7f2fb41065a0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.301+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2fa4003b60 con 0x7f2fb41065a0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.301+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb40791b0 con 0x7f2fb41065a0 2024-04-26T20:55:19.245 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.301+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa4023750 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.301+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb4079650 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.302+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb4062510 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.303+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2fa4023940 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.303+0000 7f2faaa00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 0x7f2f9803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.303+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2fa404ced0 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.304+0000 7f2fb1400700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 0x7f2f9803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.305+0000 7f2fb1400700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 0x7f2f9803ac30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006fd0 tx=0x7f2fa0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.309+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2fa402b760 con 0x7f2fb41065a0 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.553+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fb4079c30 con 0x7f2f98038770 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.568+0000 7f2faaa00700 1 -- 172.21.15.55:0/3928885665 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2fb4079c30 con 0x7f2f98038770 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 msgr2=0x7f2f9803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 0x7f2f9803ac30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006fd0 tx=0x7f2fa0006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:19.246 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 msgr2=0x7f2fb407aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006af0 tx=0x7f2fa40047c0 comp rx=0 tx=0).stop 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 shutdown_connections 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f2f98038770 0x7f2f9803ac30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 --2- 172.21.15.55:0/3928885665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb41065a0 0x7f2fb407aa30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 >> 172.21.15.55:0/3928885665 conn(0x7f2fb4101ba0 msgr2=0x7f2fb4102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 shutdown_connections 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:18.572+0000 7f2fb8e00700 1 -- 172.21.15.55:0/3928885665 wait complete. 2024-04-26T20:55:19.247 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying mgr service with default placement... 2024-04-26T20:55:19.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:19 smithi055 ceph-mon[25475]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:19.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:19 smithi055 ceph-mon[25475]: Saving service mon spec with placement count:5 2024-04-26T20:55:19.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:19 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:20.958 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:20 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:20.959 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:20 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:20.959 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:20 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:21.286 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T20:55:21.286 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.295+0000 7f1324a00700 1 Processor -- start 2024-04-26T20:55:21.286 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.295+0000 7f1324a00700 1 -- start start 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f1324a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f1324a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1320079820 con 0x7f132007adf0 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f131de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f131de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52002/0 (socket says 172.21.15.55:52002) 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f131de00700 1 -- 172.21.15.55:0/3328890626 learned_addr learned my addr 172.21.15.55:0/3328890626 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.296+0000 7f131de00700 1 -- 172.21.15.55:0/3328890626 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320079960 con 0x7f132007adf0 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.297+0000 7f131de00700 1 --2- 172.21.15.55:0/3328890626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13100098a0 tx=0x7f1310009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4418a3814acb92bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.297+0000 7f131ca00700 1 -- 172.21.15.55:0/3328890626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1310004180 con 0x7f132007adf0 2024-04-26T20:55:21.291 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.297+0000 7f131ca00700 1 -- 172.21.15.55:0/3328890626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13100042e0 con 0x7f132007adf0 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.297+0000 7f131ca00700 1 -- 172.21.15.55:0/3328890626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1310011b10 con 0x7f132007adf0 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 -- 172.21.15.55:0/3328890626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 msgr2=0x7f1320079250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 --2- 172.21.15.55:0/3328890626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13100098a0 tx=0x7f1310009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 -- 172.21.15.55:0/3328890626 shutdown_connections 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 --2- 172.21.15.55:0/3328890626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f1320079250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 -- 172.21.15.55:0/3328890626 >> 172.21.15.55:0/3328890626 conn(0x7f1320101c00 msgr2=0x7f1320104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 -- 172.21.15.55:0/3328890626 shutdown_connections 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.298+0000 7f1324a00700 1 -- 172.21.15.55:0/3328890626 wait complete. 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.299+0000 7f1324a00700 1 Processor -- start 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f1324a00700 1 -- start start 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f1324a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f1324a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132019cad0 con 0x7f132007adf0 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f131de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:21.292 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f131de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52016/0 (socket says 172.21.15.55:52016) 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.300+0000 7f131de00700 1 -- 172.21.15.55:0/1549449393 learned_addr learned my addr 172.21.15.55:0/1549449393 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f131de00700 1 -- 172.21.15.55:0/1549449393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009550 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f131de00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13100117b0 tx=0x7f1310011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13100038b0 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1310003a10 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13100246e0 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132019ccd0 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.301+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132019d170 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.303+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f131001ab80 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.303+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132010c9b0 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.303+0000 7f1316a00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 0x7f130403ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.303+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f131004c940 con 0x7f132007adf0 2024-04-26T20:55:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.304+0000 7f131d400700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 0x7f130403ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.304+0000 7f131d400700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 0x7f130403ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.309+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f131001a430 con 0x7f132007adf0 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.579+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f1320102ec0 con 0x7f1304038770 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.585+0000 7f1316a00700 1 -- 172.21.15.55:0/1549449393 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1320102ec0 con 0x7f1304038770 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.588+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 msgr2=0x7f130403ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.588+0000 7f1324a00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 0x7f130403ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.588+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 msgr2=0x7f132019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.588+0000 7f1324a00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13100117b0 tx=0x7f1310011890 comp rx=0 tx=0).stop 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 shutdown_connections 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f1304038770 0x7f130403ac30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 --2- 172.21.15.55:0/1549449393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f132007adf0 0x7f132019c590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 >> 172.21.15.55:0/1549449393 conn(0x7f1320101c00 msgr2=0x7f13201027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 shutdown_connections 2024-04-26T20:55:21.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:20.589+0000 7f1324a00700 1 -- 172.21.15.55:0/1549449393 wait complete. 2024-04-26T20:55:21.295 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying crash service with default placement... 2024-04-26T20:55:21.852 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:21 smithi055 ceph-mon[25475]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:21.852 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:21 smithi055 ceph-mon[25475]: Saving service mgr spec with placement count:2 2024-04-26T20:55:23.467 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:23 smithi055 ceph-mon[25475]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:23.467 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:23 smithi055 ceph-mon[25475]: Saving service crash spec with placement * 2024-04-26T20:55:23.467 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:23 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:23.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.904+0000 7fc9bb000700 1 Processor -- start 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.904+0000 7fc9bb000700 1 -- start start 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.905+0000 7fc9bb000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.905+0000 7fc9bb000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4106f80 con 0x7fc9b4106590 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.905+0000 7fc9b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.905+0000 7fc9b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52030/0 (socket says 172.21.15.55:52030) 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.905+0000 7fc9b3e00700 1 -- 172.21.15.55:0/4144310502 learned_addr learned my addr 172.21.15.55:0/4144310502 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.906+0000 7fc9b3e00700 1 -- 172.21.15.55:0/4144310502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4107790 con 0x7fc9b4106590 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.906+0000 7fc9b3e00700 1 --2- 172.21.15.55:0/4144310502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098a0 tx=0x7fc9a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ba2ee66fd54d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9b2a00700 1 -- 172.21.15.55:0/4144310502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9a4004180 con 0x7fc9b4106590 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9b2a00700 1 -- 172.21.15.55:0/4144310502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9a40042e0 con 0x7fc9b4106590 2024-04-26T20:55:23.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9b2a00700 1 -- 172.21.15.55:0/4144310502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9a4011b10 con 0x7fc9b4106590 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9bb000700 1 -- 172.21.15.55:0/4144310502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 msgr2=0x7fc9b41069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9bb000700 1 --2- 172.21.15.55:0/4144310502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098a0 tx=0x7fc9a4009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9bb000700 1 -- 172.21.15.55:0/4144310502 shutdown_connections 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9bb000700 1 --2- 172.21.15.55:0/4144310502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b41069b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.907+0000 7fc9bb000700 1 -- 172.21.15.55:0/4144310502 >> 172.21.15.55:0/4144310502 conn(0x7fc9b4101b70 msgr2=0x7fc9b4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.908+0000 7fc9bb000700 1 -- 172.21.15.55:0/4144310502 shutdown_connections 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.908+0000 7fc9bb000700 1 -- 172.21.15.55:0/4144310502 wait complete. 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.909+0000 7fc9bb000700 1 Processor -- start 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.909+0000 7fc9bb000700 1 -- start start 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.909+0000 7fc9bb000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.909+0000 7fc9bb000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b419cad0 con 0x7fc9b4106590 2024-04-26T20:55:23.481 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.910+0000 7fc9b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.910+0000 7fc9b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52044/0 (socket says 172.21.15.55:52044) 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.910+0000 7fc9b3e00700 1 -- 172.21.15.55:0/1579631751 learned_addr learned my addr 172.21.15.55:0/1579631751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.910+0000 7fc9b3e00700 1 -- 172.21.15.55:0/1579631751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009550 con 0x7fc9b4106590 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.910+0000 7fc9b3e00700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40117b0 tx=0x7fc9a4011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.911+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9a40038b0 con 0x7fc9b4106590 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.911+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9a4003a10 con 0x7fc9b4106590 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.911+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9a40246e0 con 0x7fc9b4106590 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.911+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b419ccd0 con 0x7fc9b4106590 2024-04-26T20:55:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.911+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b419d170 con 0x7fc9b4106590 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.912+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fc9a401ab80 con 0x7fc9b4106590 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.912+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b410a9c0 con 0x7fc9b4106590 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.912+0000 7fc9b0c00700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 0x7fc99803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.913+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc9a404c940 con 0x7fc9b4106590 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.913+0000 7fc9b3400700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 0x7fc99803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.914+0000 7fc9b3400700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 0x7fc99803ac30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0006fd0 tx=0x7fc9a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:21.918+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc9a401a430 con 0x7fc9b4106590 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.166+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9b419fa00 con 0x7fc998038770 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.176+0000 7fc9b0c00700 1 -- 172.21.15.55:0/1579631751 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc9b419fa00 con 0x7fc998038770 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.179+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 msgr2=0x7fc99803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.179+0000 7fc9bb000700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 0x7fc99803ac30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0006fd0 tx=0x7fc9a0006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.179+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 msgr2=0x7fc9b419c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.179+0000 7fc9bb000700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40117b0 tx=0x7fc9a4011890 comp rx=0 tx=0).stop 2024-04-26T20:55:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 shutdown_connections 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fc998038770 0x7fc99803ac30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 --2- 172.21.15.55:0/1579631751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9b4106590 0x7fc9b419c590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 >> 172.21.15.55:0/1579631751 conn(0x7fc9b4101b70 msgr2=0x7fc9b4102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 shutdown_connections 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:22.180+0000 7fc9bb000700 1 -- 172.21.15.55:0/1579631751 wait complete. 2024-04-26T20:55:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying ceph-exporter service with default placement... 2024-04-26T20:55:24.341 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:24 smithi055 ceph-mon[25475]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:24.341 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:24 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.084+0000 7ff444400700 1 Processor -- start 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.084+0000 7ff444400700 1 -- start start 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.084+0000 7ff444400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.084+0000 7ff444400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c079800 con 0x7ff43c07add0 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.085+0000 7ff441a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.085+0000 7ff441a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52050/0 (socket says 172.21.15.55:52050) 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.085+0000 7ff441a00700 1 -- 172.21.15.55:0/2957732213 learned_addr learned my addr 172.21.15.55:0/2957732213 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.085+0000 7ff441a00700 1 -- 172.21.15.55:0/2957732213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c079940 con 0x7ff43c07add0 2024-04-26T20:55:25.275 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.086+0000 7ff441a00700 1 --2- 172.21.15.55:0/2957732213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4300098a0 tx=0x7ff430009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c41ba232d74975 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.086+0000 7ff43be00700 1 -- 172.21.15.55:0/2957732213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff430004180 con 0x7ff43c07add0 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.086+0000 7ff43be00700 1 -- 172.21.15.55:0/2957732213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4300042e0 con 0x7ff43c07add0 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.086+0000 7ff43be00700 1 -- 172.21.15.55:0/2957732213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff430011b10 con 0x7ff43c07add0 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 -- 172.21.15.55:0/2957732213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 msgr2=0x7ff43c079230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 --2- 172.21.15.55:0/2957732213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4300098a0 tx=0x7ff430009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 -- 172.21.15.55:0/2957732213 shutdown_connections 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 --2- 172.21.15.55:0/2957732213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c079230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 -- 172.21.15.55:0/2957732213 >> 172.21.15.55:0/2957732213 conn(0x7ff43c101ba0 msgr2=0x7ff43c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 -- 172.21.15.55:0/2957732213 shutdown_connections 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.087+0000 7ff444400700 1 -- 172.21.15.55:0/2957732213 wait complete. 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.088+0000 7ff444400700 1 Processor -- start 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.088+0000 7ff444400700 1 -- start start 2024-04-26T20:55:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff444400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff444400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c19cb20 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff441a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff441a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52066/0 (socket says 172.21.15.55:52066) 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff441a00700 1 -- 172.21.15.55:0/460507302 learned_addr learned my addr 172.21.15.55:0/460507302 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.089+0000 7ff441a00700 1 -- 172.21.15.55:0/460507302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009550 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff441a00700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff430000c00 tx=0x7ff430011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4300038b0 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff430003a10 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c19cd20 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff430024780 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.090+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c19d1c0 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.091+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff43001ac10 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.091+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c10c940 con 0x7ff43c07add0 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.092+0000 7ff43a000700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 0x7ff42403ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:25.277 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.092+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff43004c650 con 0x7ff43c07add0 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.092+0000 7ff441000700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 0x7ff42403ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.093+0000 7ff441000700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 0x7ff42403ac30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff428006fd0 tx=0x7ff428006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.097+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff430010380 con 0x7ff43c07add0 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.340+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff43c102f30 con 0x7ff424038770 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.350+0000 7ff43a000700 1 -- 172.21.15.55:0/460507302 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff43c102f30 con 0x7ff424038770 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.353+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 msgr2=0x7ff42403ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.353+0000 7ff444400700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 0x7ff42403ac30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff428006fd0 tx=0x7ff428006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.353+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 msgr2=0x7ff43c19c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.353+0000 7ff444400700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff430000c00 tx=0x7ff430011890 comp rx=0 tx=0).stop 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 shutdown_connections 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7ff424038770 0x7ff42403ac30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:25.278 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 --2- 172.21.15.55:0/460507302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff43c07add0 0x7ff43c19c5e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:25.279 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 >> 172.21.15.55:0/460507302 conn(0x7ff43c101ba0 msgr2=0x7ff43c1027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:25.279 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 shutdown_connections 2024-04-26T20:55:25.279 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:24.354+0000 7ff444400700 1 -- 172.21.15.55:0/460507302 wait complete. 2024-04-26T20:55:25.279 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying prometheus service with default placement... 2024-04-26T20:55:25.597 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:25 smithi055 ceph-mon[25475]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:25.597 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:25 smithi055 ceph-mon[25475]: Saving service ceph-exporter spec with placement * 2024-04-26T20:55:25.597 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:25 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:25.597 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:25 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:26 smithi055 ceph-mon[25475]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:26 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:27.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.900+0000 7efcf6800700 1 Processor -- start 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.901+0000 7efcf6800700 1 -- start start 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.901+0000 7efcf6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.901+0000 7efcf6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0079820 con 0x7efcf007adf0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.902+0000 7efcef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.902+0000 7efcef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38198/0 (socket says 172.21.15.55:38198) 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.902+0000 7efcef400700 1 -- 172.21.15.55:0/1740950967 learned_addr learned my addr 172.21.15.55:0/1740950967 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.902+0000 7efcef400700 1 -- 172.21.15.55:0/1740950967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0079960 con 0x7efcf007adf0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.903+0000 7efcef400700 1 --2- 172.21.15.55:0/1740950967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efce00098a0 tx=0x7efce0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6241b74b87cc4b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.903+0000 7efcee000700 1 -- 172.21.15.55:0/1740950967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efce0004180 con 0x7efcf007adf0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.903+0000 7efcee000700 1 -- 172.21.15.55:0/1740950967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efce00042e0 con 0x7efcf007adf0 2024-04-26T20:55:27.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.903+0000 7efcee000700 1 -- 172.21.15.55:0/1740950967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efce0011b10 con 0x7efcf007adf0 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 -- 172.21.15.55:0/1740950967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 msgr2=0x7efcf0079250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 --2- 172.21.15.55:0/1740950967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efce00098a0 tx=0x7efce0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 -- 172.21.15.55:0/1740950967 shutdown_connections 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 --2- 172.21.15.55:0/1740950967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf0079250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 -- 172.21.15.55:0/1740950967 >> 172.21.15.55:0/1740950967 conn(0x7efcf0101c00 msgr2=0x7efcf0104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 -- 172.21.15.55:0/1740950967 shutdown_connections 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.904+0000 7efcf6800700 1 -- 172.21.15.55:0/1740950967 wait complete. 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.905+0000 7efcf6800700 1 Processor -- start 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcf6800700 1 -- start start 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcf6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcf6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf019cad0 con 0x7efcf007adf0 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:27.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38212/0 (socket says 172.21.15.55:38212) 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.906+0000 7efcef400700 1 -- 172.21.15.55:0/2172630311 learned_addr learned my addr 172.21.15.55:0/2172630311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efcef400700 1 -- 172.21.15.55:0/2172630311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0009550 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efcef400700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00117b0 tx=0x7efce0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efce00038b0 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efce0003a10 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efce00246e0 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.907+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf019ccd0 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.908+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf019d170 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.909+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf010c9b0 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.909+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7efce001ab80 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.910+0000 7efce7e00700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 0x7efcd403abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.910+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efce004c990 con 0x7efcf007adf0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.910+0000 7efceea00700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 0x7efcd403abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:27.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.911+0000 7efceea00700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 0x7efcd403abe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcdc006fd0 tx=0x7efcdc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:25.916+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7efce001a430 con 0x7efcf007adf0 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.164+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7efcf0102ec0 con 0x7efcd4038720 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.175+0000 7efce7e00700 1 -- 172.21.15.55:0/2172630311 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7efcf0102ec0 con 0x7efcd4038720 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 msgr2=0x7efcd403abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 0x7efcd403abe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcdc006fd0 tx=0x7efcdc006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 msgr2=0x7efcf019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efce00117b0 tx=0x7efce0011890 comp rx=0 tx=0).stop 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 shutdown_connections 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7efcd4038720 0x7efcd403abe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 --2- 172.21.15.55:0/2172630311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcf007adf0 0x7efcf019c590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 >> 172.21.15.55:0/2172630311 conn(0x7efcf0101c00 msgr2=0x7efcf01027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.178+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 shutdown_connections 2024-04-26T20:55:27.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:26.179+0000 7efcf6800700 1 -- 172.21.15.55:0/2172630311 wait complete. 2024-04-26T20:55:27.021 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying grafana service with default placement... 2024-04-26T20:55:27.753 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:27 smithi055 ceph-mon[25475]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:27.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:27 smithi055 ceph-mon[25475]: Saving service prometheus spec with placement count:1 2024-04-26T20:55:28.414 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:28 smithi055 ceph-mon[25475]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.472+0000 7f3684a00700 1 Processor -- start 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.472+0000 7f3684a00700 1 -- start start 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.472+0000 7f3684a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.472+0000 7f3684a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368007a8d0 con 0x7f368007bea0 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.473+0000 7f367de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.473+0000 7f367de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38222/0 (socket says 172.21.15.55:38222) 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.473+0000 7f367de00700 1 -- 172.21.15.55:0/2636161623 learned_addr learned my addr 172.21.15.55:0/2636161623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:29.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.473+0000 7f367de00700 1 -- 172.21.15.55:0/2636161623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368007aa10 con 0x7f368007bea0 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f367de00700 1 --2- 172.21.15.55:0/2636161623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbe25aa663f9022 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f367d400700 1 -- 172.21.15.55:0/2636161623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3670004180 con 0x7f368007bea0 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f367d400700 1 -- 172.21.15.55:0/2636161623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36700042e0 con 0x7f368007bea0 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f367d400700 1 -- 172.21.15.55:0/2636161623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3670011b10 con 0x7f368007bea0 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f3684a00700 1 -- 172.21.15.55:0/2636161623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 msgr2=0x7f368007a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.474+0000 7f3684a00700 1 --2- 172.21.15.55:0/2636161623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36700098a0 tx=0x7f3670009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.475+0000 7f3684a00700 1 -- 172.21.15.55:0/2636161623 shutdown_connections 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.475+0000 7f3684a00700 1 --2- 172.21.15.55:0/2636161623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368007a300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.475+0000 7f3684a00700 1 -- 172.21.15.55:0/2636161623 >> 172.21.15.55:0/2636161623 conn(0x7f3680101be0 msgr2=0x7f3680104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.475+0000 7f3684a00700 1 -- 172.21.15.55:0/2636161623 shutdown_connections 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.475+0000 7f3684a00700 1 -- 172.21.15.55:0/2636161623 wait complete. 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.476+0000 7f3684a00700 1 Processor -- start 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.476+0000 7f3684a00700 1 -- start start 2024-04-26T20:55:29.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.476+0000 7f3684a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.476+0000 7f3684a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019ca40 con 0x7f368007bea0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f367de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f367de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38234/0 (socket says 172.21.15.55:38234) 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f367de00700 1 -- 172.21.15.55:0/463554668 learned_addr learned my addr 172.21.15.55:0/463554668 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f367de00700 1 -- 172.21.15.55:0/463554668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009550 con 0x7f368007bea0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f367de00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36700117b0 tx=0x7f3670011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.477+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36700038b0 con 0x7f368007bea0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.478+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3670003a10 con 0x7f368007bea0 2024-04-26T20:55:29.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.478+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368019cc40 con 0x7f368007bea0 2024-04-26T20:55:29.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.478+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3670024780 con 0x7f368007bea0 2024-04-26T20:55:29.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.478+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368019d0e0 con 0x7f368007bea0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.479+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f367001ac10 con 0x7f368007bea0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.479+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368010c9a0 con 0x7f368007bea0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.479+0000 7f3676a00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 0x7f366403abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.479+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f367004c810 con 0x7f368007bea0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.480+0000 7f3677e00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 0x7f366403abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.480+0000 7f3677e00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 0x7f366403abe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3668006fd0 tx=0x7f3668006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.485+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f367002cb00 con 0x7f368007bea0 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.722+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f3680102dd0 con 0x7f3664038720 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.733+0000 7f3676a00700 1 -- 172.21.15.55:0/463554668 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f3680102dd0 con 0x7f3664038720 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.735+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 msgr2=0x7f366403abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.735+0000 7f3684a00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 0x7f366403abe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3668006fd0 tx=0x7f3668006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.735+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 msgr2=0x7f368019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:29.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.735+0000 7f3684a00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f36700117b0 tx=0x7f3670011890 comp rx=0 tx=0).stop 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 shutdown_connections 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f3664038720 0x7f366403abe0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 --2- 172.21.15.55:0/463554668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f368007bea0 0x7f368019c500 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 >> 172.21.15.55:0/463554668 conn(0x7f3680101be0 msgr2=0x7f36801026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 shutdown_connections 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:28.736+0000 7f3684a00700 1 -- 172.21.15.55:0/463554668 wait complete. 2024-04-26T20:55:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying node-exporter service with default placement... 2024-04-26T20:55:30.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:29 smithi055 ceph-mon[25475]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:30.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:29 smithi055 ceph-mon[25475]: Saving service grafana spec with placement count:1 2024-04-26T20:55:30.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:29 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:31.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:30 smithi055 ceph-mon[25475]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:31.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:30 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:31.114 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-26T20:55:31.115 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.083+0000 7f310a800700 1 Processor -- start 2024-04-26T20:55:31.115 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.083+0000 7f310a800700 1 -- start start 2024-04-26T20:55:31.115 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.083+0000 7f310a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:31.115 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.083+0000 7f310a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3104107000 con 0x7f3104106610 2024-04-26T20:55:31.115 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.084+0000 7f3103400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:31.116 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.084+0000 7f3103400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38248/0 (socket says 172.21.15.55:38248) 2024-04-26T20:55:31.116 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.084+0000 7f3103400700 1 -- 172.21.15.55:0/2300325416 learned_addr learned my addr 172.21.15.55:0/2300325416 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:31.116 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.084+0000 7f3103400700 1 -- 172.21.15.55:0/2300325416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31041077c0 con 0x7f3104106610 2024-04-26T20:55:31.117 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.085+0000 7f3103400700 1 --2- 172.21.15.55:0/2300325416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009e80 tx=0x7f30f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d972d6b01f11d00f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:31.117 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.085+0000 7f3102a00700 1 -- 172.21.15.55:0/2300325416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f400e070 con 0x7f3104106610 2024-04-26T20:55:31.117 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.085+0000 7f3102a00700 1 -- 172.21.15.55:0/2300325416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30f400b8c0 con 0x7f3104106610 2024-04-26T20:55:31.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.085+0000 7f3102a00700 1 -- 172.21.15.55:0/2300325416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f40044d0 con 0x7f3104106610 2024-04-26T20:55:31.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 -- 172.21.15.55:0/2300325416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 msgr2=0x7f3104106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:31.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 --2- 172.21.15.55:0/2300325416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009e80 tx=0x7f30f400b330 comp rx=0 tx=0).stop 2024-04-26T20:55:31.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 -- 172.21.15.55:0/2300325416 shutdown_connections 2024-04-26T20:55:31.119 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 --2- 172.21.15.55:0/2300325416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f3104106a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 -- 172.21.15.55:0/2300325416 >> 172.21.15.55:0/2300325416 conn(0x7f3104101bb0 msgr2=0x7f3104103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 -- 172.21.15.55:0/2300325416 shutdown_connections 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.086+0000 7f310a800700 1 -- 172.21.15.55:0/2300325416 wait complete. 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.087+0000 7f310a800700 1 Processor -- start 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.087+0000 7f310a800700 1 -- start start 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f310a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:31.120 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f310a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310407c080 con 0x7f3104106610 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f3103400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f3103400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38264/0 (socket says 172.21.15.55:38264) 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f3103400700 1 -- 172.21.15.55:0/3862131873 learned_addr learned my addr 172.21.15.55:0/3862131873 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.088+0000 7f3103400700 1 -- 172.21.15.55:0/3862131873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009b30 con 0x7f3104106610 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f3103400700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30f4000f80 tx=0x7f30f400bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f400e040 con 0x7f3104106610 2024-04-26T20:55:31.124 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30f4003c30 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f4012670 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310407a2c0 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.089+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310407a7c0 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.090+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3104062510 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.090+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f30f4019040 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.091+0000 7f3100c00700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 0x7f30e803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.091+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f30f404c170 con 0x7f3104106610 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.091+0000 7f30faa00700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 0x7f30e803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.092+0000 7f30faa00700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 0x7f30e803ac30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006fd0 tx=0x7f30ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.096+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f30f4003da0 con 0x7f3104106610 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.333+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f310407ad70 con 0x7f30e8038770 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.344+0000 7f3100c00700 1 -- 172.21.15.55:0/3862131873 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f310407ad70 con 0x7f30e8038770 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.347+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 msgr2=0x7f30e803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.347+0000 7f310a800700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 0x7f30e803ac30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006fd0 tx=0x7f30ec006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.347+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 msgr2=0x7f310407bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.347+0000 7f310a800700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30f4000f80 tx=0x7f30f400bd10 comp rx=0 tx=0).stop 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 shutdown_connections 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f30e8038770 0x7f30e803ac30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 --2- 172.21.15.55:0/3862131873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3104106610 0x7f310407bb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:31.126 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 >> 172.21.15.55:0/3862131873 conn(0x7f3104101bb0 msgr2=0x7f31041026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:31.127 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 shutdown_connections 2024-04-26T20:55:31.127 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:30.348+0000 7f310a800700 1 -- 172.21.15.55:0/3862131873 wait complete. 2024-04-26T20:55:31.127 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying alertmanager service with default placement... 2024-04-26T20:55:31.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:31 smithi055 ceph-mon[25475]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:31.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:31 smithi055 ceph-mon[25475]: Saving service node-exporter spec with placement * 2024-04-26T20:55:32.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-26T20:55:32.673 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.744+0000 7eff6d200700 1 Processor -- start 2024-04-26T20:55:32.673 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.745+0000 7eff6d200700 1 -- start start 2024-04-26T20:55:32.673 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.745+0000 7eff6d200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:32.673 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.745+0000 7eff6d200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680747b0 con 0x7eff68107020 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.746+0000 7eff65e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.746+0000 7eff65e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38272/0 (socket says 172.21.15.55:38272) 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.746+0000 7eff65e00700 1 -- 172.21.15.55:0/511204235 learned_addr learned my addr 172.21.15.55:0/511204235 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.747+0000 7eff65e00700 1 -- 172.21.15.55:0/511204235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68109950 con 0x7eff68107020 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.747+0000 7eff65e00700 1 --2- 172.21.15.55:0/511204235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff580098a0 tx=0x7eff58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28105f94f5a58c77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.747+0000 7eff64a00700 1 -- 172.21.15.55:0/511204235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58004180 con 0x7eff68107020 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.747+0000 7eff64a00700 1 -- 172.21.15.55:0/511204235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff580042e0 con 0x7eff68107020 2024-04-26T20:55:32.675 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.747+0000 7eff64a00700 1 -- 172.21.15.55:0/511204235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58011b10 con 0x7eff68107020 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 -- 172.21.15.55:0/511204235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 msgr2=0x7eff68109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 --2- 172.21.15.55:0/511204235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff580098a0 tx=0x7eff58009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 -- 172.21.15.55:0/511204235 shutdown_connections 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 --2- 172.21.15.55:0/511204235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff68109410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 -- 172.21.15.55:0/511204235 >> 172.21.15.55:0/511204235 conn(0x7eff68100a50 msgr2=0x7eff68102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 -- 172.21.15.55:0/511204235 shutdown_connections 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.748+0000 7eff6d200700 1 -- 172.21.15.55:0/511204235 wait complete. 2024-04-26T20:55:32.677 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.749+0000 7eff6d200700 1 Processor -- start 2024-04-26T20:55:32.678 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.749+0000 7eff6d200700 1 -- start start 2024-04-26T20:55:32.678 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff6d200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:32.678 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff6d200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6819a840 con 0x7eff68107020 2024-04-26T20:55:32.678 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff65e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:32.678 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff65e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38280/0 (socket says 172.21.15.55:38280) 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff65e00700 1 -- 172.21.15.55:0/4164046311 learned_addr learned my addr 172.21.15.55:0/4164046311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.750+0000 7eff65e00700 1 -- 172.21.15.55:0/4164046311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009550 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.751+0000 7eff65e00700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff580117b0 tx=0x7eff58011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.751+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff580038b0 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.751+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff58003a10 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.751+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58024780 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.751+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6819aa40 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.752+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6819aee0 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.753+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7eff5801ac10 con 0x7eff68107020 2024-04-26T20:55:32.680 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.753+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6810a740 con 0x7eff68107020 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.753+0000 7eff5ea00700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 0x7eff4c03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.753+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7eff5804c8a0 con 0x7eff68107020 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.753+0000 7eff65400700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 0x7eff4c03abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.754+0000 7eff65400700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 0x7eff4c03abe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff54006fd0 tx=0x7eff54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.759+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7eff5801a430 con 0x7eff68107020 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:31.997+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7eff68101ce0 con 0x7eff4c038720 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.010+0000 7eff5ea00700 1 -- 172.21.15.55:0/4164046311 <== mgr.14120 v2:172.21.15.55:6800/2358731820 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7eff68101ce0 con 0x7eff4c038720 2024-04-26T20:55:32.681 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 msgr2=0x7eff4c03abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 0x7eff4c03abe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff54006fd0 tx=0x7eff54006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 msgr2=0x7eff6819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff580117b0 tx=0x7eff58011890 comp rx=0 tx=0).stop 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 shutdown_connections 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7eff4c038720 0x7eff4c03abe0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 --2- 172.21.15.55:0/4164046311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff68107020 0x7eff6819a300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:32.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 >> 172.21.15.55:0/4164046311 conn(0x7eff68100a50 msgr2=0x7eff681015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:32.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 shutdown_connections 2024-04-26T20:55:32.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:32.013+0000 7eff6d200700 1 -- 172.21.15.55:0/4164046311 wait complete. 2024-04-26T20:55:33.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:32 smithi055 ceph-mon[25475]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:32 smithi055 ceph-mon[25475]: from='mgr.14120 172.21.15.55:0/2512251818' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:33.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:33 smithi055 ceph-mon[25475]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:33.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:33 smithi055 ceph-mon[25475]: Saving service alertmanager spec with placement count:1 2024-04-26T20:55:33.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:33 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1807749017' entity='client.admin' 2024-04-26T20:55:34.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.374+0000 7f5e2be00700 1 Processor -- start 2024-04-26T20:55:34.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.374+0000 7f5e2be00700 1 -- start start 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.375+0000 7f5e2be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.375+0000 7f5e2be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e24106fe0 con 0x7f5e241065f0 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.375+0000 7f5e29400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.375+0000 7f5e29400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38294/0 (socket says 172.21.15.55:38294) 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.375+0000 7f5e29400700 1 -- 172.21.15.55:0/2423387756 learned_addr learned my addr 172.21.15.55:0/2423387756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.376+0000 7f5e29400700 1 -- 172.21.15.55:0/2423387756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e241077a0 con 0x7f5e241065f0 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.376+0000 7f5e29400700 1 --2- 172.21.15.55:0/2423387756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098a0 tx=0x7f5e18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b9d01da535ef20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:34.312 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.376+0000 7f5e23e00700 1 -- 172.21.15.55:0/2423387756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e18004180 con 0x7f5e241065f0 2024-04-26T20:55:34.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.376+0000 7f5e23e00700 1 -- 172.21.15.55:0/2423387756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e180042e0 con 0x7f5e241065f0 2024-04-26T20:55:34.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.376+0000 7f5e23e00700 1 -- 172.21.15.55:0/2423387756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e18011b10 con 0x7f5e241065f0 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 -- 172.21.15.55:0/2423387756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 msgr2=0x7f5e24106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 --2- 172.21.15.55:0/2423387756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e180098a0 tx=0x7f5e18009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 -- 172.21.15.55:0/2423387756 shutdown_connections 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 --2- 172.21.15.55:0/2423387756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e24106a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 -- 172.21.15.55:0/2423387756 >> 172.21.15.55:0/2423387756 conn(0x7f5e24101bb0 msgr2=0x7f5e24103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 -- 172.21.15.55:0/2423387756 shutdown_connections 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.377+0000 7f5e2be00700 1 -- 172.21.15.55:0/2423387756 wait complete. 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e2be00700 1 Processor -- start 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e2be00700 1 -- start start 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e2be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:34.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e2be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2407c080 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e29400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e29400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38300/0 (socket says 172.21.15.55:38300) 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.379+0000 7f5e29400700 1 -- 172.21.15.55:0/1807749017 learned_addr learned my addr 172.21.15.55:0/1807749017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.380+0000 7f5e29400700 1 -- 172.21.15.55:0/1807749017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18009550 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.380+0000 7f5e29400700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e180117b0 tx=0x7f5e18011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.380+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e180038b0 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.380+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e18003a10 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.380+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e180246e0 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.381+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2407a2c0 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.381+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2407a760 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.382+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e24062510 con 0x7f5e241065f0 2024-04-26T20:55:34.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.382+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f5e1801ab80 con 0x7f5e241065f0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.382+0000 7f5e22000700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 0x7f5e0c03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.382+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5e1804c8f0 con 0x7f5e241065f0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.383+0000 7f5e28a00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 0x7f5e0c03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.383+0000 7f5e28a00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 0x7f5e0c03ac30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.388+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5e18010380 con 0x7f5e241065f0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.609+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f5e2407aa60 con 0x7f5e241065f0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.618+0000 7f5e22000700 1 -- 172.21.15.55:0/1807749017 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5e18018b40 con 0x7f5e241065f0 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 msgr2=0x7f5e0c03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 0x7f5e0c03ac30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 msgr2=0x7f5e2407bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e180117b0 tx=0x7f5e18011890 comp rx=0 tx=0).stop 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 shutdown_connections 2024-04-26T20:55:34.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f5e0c038770 0x7f5e0c03ac30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:34.320 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 --2- 172.21.15.55:0/1807749017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e241065f0 0x7f5e2407bb40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:34.320 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 >> 172.21.15.55:0/1807749017 conn(0x7f5e24101bb0 msgr2=0x7f5e241026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:34.320 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 shutdown_connections 2024-04-26T20:55:34.320 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:33.622+0000 7f5e2be00700 1 -- 172.21.15.55:0/1807749017 wait complete. 2024-04-26T20:55:34.893 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:34 smithi055 ceph-mon[25475]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:35.890 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.891+0000 7f652a800700 1 Processor -- start 2024-04-26T20:55:35.890 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.891+0000 7f652a800700 1 -- start start 2024-04-26T20:55:35.890 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.892+0000 7f652a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:35.890 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.892+0000 7f652a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6524106f90 con 0x7f65241065a0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.892+0000 7f6523400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.892+0000 7f6523400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48100/0 (socket says 172.21.15.55:48100) 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.892+0000 7f6523400700 1 -- 172.21.15.55:0/999279945 learned_addr learned my addr 172.21.15.55:0/999279945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.893+0000 7f6523400700 1 -- 172.21.15.55:0/999279945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65241077a0 con 0x7f65241065a0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.893+0000 7f6523400700 1 --2- 172.21.15.55:0/999279945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6514009e80 tx=0x7f651400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44fe6a1a220a90a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f6522a00700 1 -- 172.21.15.55:0/999279945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f651400e070 con 0x7f65241065a0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f6522a00700 1 -- 172.21.15.55:0/999279945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f651400b8c0 con 0x7f65241065a0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f6522a00700 1 -- 172.21.15.55:0/999279945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65140044d0 con 0x7f65241065a0 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f652a800700 1 -- 172.21.15.55:0/999279945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 msgr2=0x7f65241069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f652a800700 1 --2- 172.21.15.55:0/999279945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6514009e80 tx=0x7f651400b330 comp rx=0 tx=0).stop 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f652a800700 1 -- 172.21.15.55:0/999279945 shutdown_connections 2024-04-26T20:55:35.891 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f652a800700 1 --2- 172.21.15.55:0/999279945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f65241069c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.894+0000 7f652a800700 1 -- 172.21.15.55:0/999279945 >> 172.21.15.55:0/999279945 conn(0x7f6524101ba0 msgr2=0x7f6524103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.895+0000 7f652a800700 1 -- 172.21.15.55:0/999279945 shutdown_connections 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.895+0000 7f652a800700 1 -- 172.21.15.55:0/999279945 wait complete. 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.896+0000 7f652a800700 1 Processor -- start 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.896+0000 7f652a800700 1 -- start start 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.896+0000 7f652a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.896+0000 7f652a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652407af70 con 0x7f65241065a0 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.897+0000 7f6523400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.897+0000 7f6523400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48110/0 (socket says 172.21.15.55:48110) 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.897+0000 7f6523400700 1 -- 172.21.15.55:0/2777876280 learned_addr learned my addr 172.21.15.55:0/2777876280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.897+0000 7f6523400700 1 -- 172.21.15.55:0/2777876280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514009b30 con 0x7f65241065a0 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.897+0000 7f6523400700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6514000f80 tx=0x7f651400bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.898+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f651400e040 con 0x7f65241065a0 2024-04-26T20:55:35.892 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.898+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6514003c30 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.898+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65140125e0 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.898+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65240791b0 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.898+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65240796b0 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.899+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6524062510 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.899+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f6514019040 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.900+0000 7f6520c00700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 0x7f650803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.900+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f651404c010 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.900+0000 7f651aa00700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 0x7f650803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.901+0000 7f651aa00700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 0x7f650803ac30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:34.905+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f651407fc50 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.130+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f6524079b40 con 0x7f65241065a0 2024-04-26T20:55:35.893 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.136+0000 7f6520c00700 1 -- 172.21.15.55:0/2777876280 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f651401f0c0 con 0x7f65241065a0 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 msgr2=0x7f650803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 0x7f650803ac30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 msgr2=0x7f652407aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6514000f80 tx=0x7f651400bcf0 comp rx=0 tx=0).stop 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 shutdown_connections 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f6508038770 0x7f650803ac30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 --2- 172.21.15.55:0/2777876280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65241065a0 0x7f652407aa30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 >> 172.21.15.55:0/2777876280 conn(0x7f6524101ba0 msgr2=0x7f6524102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 shutdown_connections 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:35.139+0000 7f652a800700 1 -- 172.21.15.55:0/2777876280 wait complete. 2024-04-26T20:55:35.894 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling the dashboard module... 2024-04-26T20:55:36.450 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:36 smithi055 ceph-mon[25475]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:55:36.451 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:36 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2777876280' entity='client.admin' 2024-04-26T20:55:37.453 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:37 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2499072345' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T20:55:37.784 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.509+0000 7fade5400700 1 Processor -- start 2024-04-26T20:55:37.785 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.509+0000 7fade5400700 1 -- start start 2024-04-26T20:55:37.785 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.510+0000 7fade5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:37.785 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.510+0000 7fade5400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade00797a0 con 0x7fade007ad70 2024-04-26T20:55:37.785 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.510+0000 7fadde800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.510+0000 7fadde800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48118/0 (socket says 172.21.15.55:48118) 2024-04-26T20:55:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.510+0000 7fadde800700 1 -- 172.21.15.55:0/3283002007 learned_addr learned my addr 172.21.15.55:0/3283002007 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.511+0000 7fadde800700 1 -- 172.21.15.55:0/3283002007 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00798e0 con 0x7fade007ad70 2024-04-26T20:55:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.511+0000 7fadde800700 1 --2- 172.21.15.55:0/3283002007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098a0 tx=0x7fadd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ac39fff9782487 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.511+0000 7faddd400700 1 -- 172.21.15.55:0/3283002007 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd0004180 con 0x7fade007ad70 2024-04-26T20:55:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.512+0000 7faddd400700 1 -- 172.21.15.55:0/3283002007 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadd00042e0 con 0x7fade007ad70 2024-04-26T20:55:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.512+0000 7faddd400700 1 -- 172.21.15.55:0/3283002007 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd0011b10 con 0x7fade007ad70 2024-04-26T20:55:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.512+0000 7fade5400700 1 -- 172.21.15.55:0/3283002007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 msgr2=0x7fade00791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.512+0000 7fade5400700 1 --2- 172.21.15.55:0/3283002007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098a0 tx=0x7fadd0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.513+0000 7fade5400700 1 -- 172.21.15.55:0/3283002007 shutdown_connections 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.513+0000 7fade5400700 1 --2- 172.21.15.55:0/3283002007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade00791d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.513+0000 7fade5400700 1 -- 172.21.15.55:0/3283002007 >> 172.21.15.55:0/3283002007 conn(0x7fade0101ba0 msgr2=0x7fade0103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.513+0000 7fade5400700 1 -- 172.21.15.55:0/3283002007 shutdown_connections 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.513+0000 7fade5400700 1 -- 172.21.15.55:0/3283002007 wait complete. 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.514+0000 7fade5400700 1 Processor -- start 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.514+0000 7fade5400700 1 -- start start 2024-04-26T20:55:37.789 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.515+0000 7fade5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.515+0000 7fade5400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade019caf0 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.515+0000 7fadde800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.515+0000 7fadde800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48132/0 (socket says 172.21.15.55:48132) 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.515+0000 7fadde800700 1 -- 172.21.15.55:0/2499072345 learned_addr learned my addr 172.21.15.55:0/2499072345 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fadde800700 1 -- 172.21.15.55:0/2499072345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009550 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fadde800700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadd0004210 tx=0x7fadd0011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd00038b0 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadd0003a10 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd0024650 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade019ccf0 con 0x7fade007ad70 2024-04-26T20:55:37.790 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.516+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade019d190 con 0x7fade007ad70 2024-04-26T20:55:37.792 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.518+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade010c940 con 0x7fade007ad70 2024-04-26T20:55:37.792 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.518+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fadd001ab80 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.519+0000 7fadd7400700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 0x7fadc403ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.519+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fadd004c5d0 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.519+0000 7faddde00700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 0x7fadc403ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.520+0000 7faddde00700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 0x7fadc403ac30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.524+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fadd001a430 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:36.805+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fade010cb80 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.150+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fadd0024c40 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.153+0000 7fadd7400700 1 -- 172.21.15.55:0/2499072345 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fadd001a430 con 0x7fade007ad70 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 msgr2=0x7fadc403ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 0x7fadc403ac30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fadcc006fd0 tx=0x7fadcc006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 msgr2=0x7fade019c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fadd0004210 tx=0x7fadd0011940 comp rx=0 tx=0).stop 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 shutdown_connections 2024-04-26T20:55:37.793 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fadc4038770 0x7fadc403ac30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:37.794 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 --2- 172.21.15.55:0/2499072345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fade007ad70 0x7fade019c5b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:37.794 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 >> 172.21.15.55:0/2499072345 conn(0x7fade0101ba0 msgr2=0x7fade0102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:37.794 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 shutdown_connections 2024-04-26T20:55:37.794 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:37.157+0000 7fade5400700 1 -- 172.21.15.55:0/2499072345 wait complete. 2024-04-26T20:55:38.399 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:38 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2499072345' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T20:55:38.400 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:38 smithi055 ceph-mon[25475]: mgrmap e9: smithi055.ybbowr(active, since 34s) 2024-04-26T20:55:39.436 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:39 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1058400634' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "active_name": "smithi055.ybbowr", 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.466+0000 7fd9ee600700 1 Processor -- start 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.466+0000 7fd9ee600700 1 -- start start 2024-04-26T20:55:39.448 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.466+0000 7fd9ee600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:39.449 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.466+0000 7fd9ee600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8106f90 con 0x7fd9e81065a0 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.467+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.467+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48158/0 (socket says 172.21.15.55:48158) 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.467+0000 7fd9e7400700 1 -- 172.21.15.55:0/1900161883 learned_addr learned my addr 172.21.15.55:0/1900161883 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.467+0000 7fd9e7400700 1 -- 172.21.15.55:0/1900161883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e81077a0 con 0x7fd9e81065a0 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.468+0000 7fd9e7400700 1 --2- 172.21.15.55:0/1900161883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80098a0 tx=0x7fd9d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7b0d79517ae9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.468+0000 7fd9e6000700 1 -- 172.21.15.55:0/1900161883 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9d8004180 con 0x7fd9e81065a0 2024-04-26T20:55:39.450 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.468+0000 7fd9e6000700 1 -- 172.21.15.55:0/1900161883 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9d80042e0 con 0x7fd9e81065a0 2024-04-26T20:55:39.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.468+0000 7fd9e6000700 1 -- 172.21.15.55:0/1900161883 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9d8011b10 con 0x7fd9e81065a0 2024-04-26T20:55:39.451 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 -- 172.21.15.55:0/1900161883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 msgr2=0x7fd9e81069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1900161883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80098a0 tx=0x7fd9d8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 -- 172.21.15.55:0/1900161883 shutdown_connections 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1900161883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e81069c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 -- 172.21.15.55:0/1900161883 >> 172.21.15.55:0/1900161883 conn(0x7fd9e8101ba0 msgr2=0x7fd9e8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 -- 172.21.15.55:0/1900161883 shutdown_connections 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.469+0000 7fd9ee600700 1 -- 172.21.15.55:0/1900161883 wait complete. 2024-04-26T20:55:39.452 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.470+0000 7fd9ee600700 1 Processor -- start 2024-04-26T20:55:39.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.470+0000 7fd9ee600700 1 -- start start 2024-04-26T20:55:39.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9ee600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:39.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9ee600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e819cb30 con 0x7fd9e81065a0 2024-04-26T20:55:39.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:39.453 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48168/0 (socket says 172.21.15.55:48168) 2024-04-26T20:55:39.454 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9e7400700 1 -- 172.21.15.55:0/1058400634 learned_addr learned my addr 172.21.15.55:0/1058400634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:39.454 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.471+0000 7fd9e7400700 1 -- 172.21.15.55:0/1058400634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009550 con 0x7fd9e81065a0 2024-04-26T20:55:39.454 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9e7400700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8011670 tx=0x7fd9d8011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:39.454 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9d80038b0 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9d8003a10 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e819cd30 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9d801a7e0 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.472+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e819d1d0 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.473+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e810a9d0 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.473+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fd9d8024c10 con 0x7fd9e81065a0 2024-04-26T20:55:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.474+0000 7fd9dfe00700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 0x7fd9cc03abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.474+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd9d804ca50 con 0x7fd9e81065a0 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.474+0000 7fd9e6a00700 1 -- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 msgr2=0x7fd9cc03abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.474+0000 7fd9e6a00700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 0x7fd9cc03abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.479+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd9d8024430 con 0x7fd9e81065a0 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.675+0000 7fd9e6a00700 1 -- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 msgr2=0x7fd9cc03abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.675+0000 7fd9e6a00700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 0x7fd9cc03abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:55:39.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.756+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd9e819fa60 con 0x7fd9e81065a0 2024-04-26T20:55:39.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.756+0000 7fd9dfe00700 1 -- 172.21.15.55:0/1058400634 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd9d8018350 con 0x7fd9e81065a0 2024-04-26T20:55:39.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 msgr2=0x7fd9cc03abf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:55:39.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 0x7fd9cc03abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:39.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 msgr2=0x7fd9e819c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:39.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8011670 tx=0x7fd9d8011890 comp rx=0 tx=0).stop 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 shutdown_connections 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7fd9cc038730 0x7fd9cc03abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 --2- 172.21.15.55:0/1058400634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9e81065a0 0x7fd9e819c5f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 >> 172.21.15.55:0/1058400634 conn(0x7fd9e8101ba0 msgr2=0x7fd9e81027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.759+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 shutdown_connections 2024-04-26T20:55:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:38.760+0000 7fd9ee600700 1 -- 172.21.15.55:0/1058400634 wait complete. 2024-04-26T20:55:39.460 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for the mgr to restart... 2024-04-26T20:55:39.460 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr epoch 9... 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: Activating manager daemon smithi055.ybbowr 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: mgrmap e10: smithi055.ybbowr(active, starting, since 0.00947315s) 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:55:46.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:55:46.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:46 smithi055 ceph-mon[25475]: Manager daemon smithi055.ybbowr is now available 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:47 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:47 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:47 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:47 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:47] ENGINE Bus STARTING 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:47 smithi055 ceph-mon[25475]: mgrmap e11: smithi055.ybbowr(active, since 1.01443s) 2024-04-26T20:55:48.727 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:48 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:47] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T20:55:48.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:48 smithi055 ceph-mon[25475]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T20:55:48.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:48 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:47] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T20:55:48.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:48 smithi055 ceph-mon[25475]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T20:55:48.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:48 smithi055 ceph-mon[25475]: [26/Apr/2024:20:55:47] ENGINE Bus STARTED 2024-04-26T20:55:48.734 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.039+0000 7f8aa6400700 1 Processor -- start 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.039+0000 7f8aa6400700 1 -- start start 2024-04-26T20:55:48.735 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.039+0000 7f8aa6400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:48.736 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.039+0000 7f8aa6400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0074770 con 0x7f8aa0107060 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.040+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.040+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48170/0 (socket says 172.21.15.55:48170) 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.040+0000 7f8a9f400700 1 -- 172.21.15.55:0/3520587492 learned_addr learned my addr 172.21.15.55:0/3520587492 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.040+0000 7f8a9f400700 1 -- 172.21.15.55:0/3520587492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0109990 con 0x7f8aa0107060 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8a9f400700 1 --2- 172.21.15.55:0/3520587492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098a0 tx=0x7f8a90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb44fb866eb24f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8a9e000700 1 -- 172.21.15.55:0/3520587492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a90004180 con 0x7f8aa0107060 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8a9e000700 1 -- 172.21.15.55:0/3520587492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a900042e0 con 0x7f8aa0107060 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8a9e000700 1 -- 172.21.15.55:0/3520587492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a90011b10 con 0x7f8aa0107060 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8aa6400700 1 -- 172.21.15.55:0/3520587492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 msgr2=0x7f8aa0109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:48.737 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.041+0000 7f8aa6400700 1 --2- 172.21.15.55:0/3520587492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098a0 tx=0x7f8a90009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.738 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.042+0000 7f8aa6400700 1 -- 172.21.15.55:0/3520587492 shutdown_connections 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.042+0000 7f8aa6400700 1 --2- 172.21.15.55:0/3520587492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0109450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.042+0000 7f8aa6400700 1 -- 172.21.15.55:0/3520587492 >> 172.21.15.55:0/3520587492 conn(0x7f8aa0100a50 msgr2=0x7f8aa0102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.042+0000 7f8aa6400700 1 -- 172.21.15.55:0/3520587492 shutdown_connections 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.042+0000 7f8aa6400700 1 -- 172.21.15.55:0/3520587492 wait complete. 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.043+0000 7f8aa6400700 1 Processor -- start 2024-04-26T20:55:48.743 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.043+0000 7f8aa6400700 1 -- start start 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.043+0000 7f8aa6400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.043+0000 7f8aa6400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0106dd0 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48176/0 (socket says 172.21.15.55:48176) 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a9f400700 1 -- 172.21.15.55:0/255075560 learned_addr learned my addr 172.21.15.55:0/255075560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a9f400700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90009550 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a9f400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a900117b0 tx=0x7f8a90011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a900038b0 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.044+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a90003a10 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.045+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa0105010 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.045+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a90024780 con 0x7f8aa0107060 2024-04-26T20:55:48.744 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.045+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa01054b0 con 0x7f8aa0107060 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f8a9001a430 con 0x7f8aa0107060 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a97e00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a8403b390 con 0x7f8a840387c0 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8a9004c7e0 con 0x7f8aa0107060 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.046+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.247+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.247+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.648+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:40.648+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:41.449+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:41.449+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:43.051+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:43.051+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T20:55:48.745 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:46.254+0000 7f8a9ea00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2358731820 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:46.254+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:46.385+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f8a9001ac10 con 0x7f8aa0107060 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:46.385+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 msgr2=0x7f8a8403ac80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:46.385+0000 7f8a97e00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.389+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f8a9004e230 con 0x7f8aa0107060 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.390+0000 7f8a97e00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 0x7f8a8403e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.390+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a8403b390 con 0x7f8a8403c240 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.391+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 0x7f8a8403e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.392+0000 7f8a9ea00700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 0x7f8a8403e630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003a10 tx=0x7f8a8c009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.393+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f8a8403b390 con 0x7f8a8403c240 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.406+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8aa0062510 con 0x7f8a8403c240 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.406+0000 7f8a97e00700 1 -- 172.21.15.55:0/255075560 <== mgr.14164 v2:172.21.15.55:6800/154137240 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f8aa0062510 con 0x7f8a8403c240 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 msgr2=0x7f8a8403e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:48.746 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 0x7f8a8403e630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003a10 tx=0x7f8a8c009270 comp rx=0 tx=0).stop 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 msgr2=0x7f8aa0106890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a900117b0 tx=0x7f8a90011890 comp rx=0 tx=0).stop 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 shutdown_connections 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f8a8403c240 0x7f8a8403e630 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa0107060 0x7f8aa0106890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 --2- 172.21.15.55:0/255075560 >> [v2:172.21.15.55:6800/2358731820,v1:172.21.15.55:6801/2358731820] conn(0x7f8a840387c0 0x7f8a8403ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 >> 172.21.15.55:0/255075560 conn(0x7f8aa0100a50 msgr2=0x7f8aa01015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 shutdown_connections 2024-04-26T20:55:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:47.407+0000 7f8aa6400700 1 -- 172.21.15.55:0/255075560 wait complete. 2024-04-26T20:55:48.748 INFO:teuthology.orchestra.run.smithi055.stdout:mgr epoch 9 is available 2024-04-26T20:55:48.748 INFO:teuthology.orchestra.run.smithi055.stdout:Generating a dashboard self-signed certificate... 2024-04-26T20:55:49.593 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:49 smithi055 ceph-mon[25475]: mgrmap e12: smithi055.ybbowr(active, since 2s) 2024-04-26T20:55:49.593 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:49 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.340+0000 7fc94d800700 1 Processor -- start 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.340+0000 7fc94d800700 1 -- start start 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.340+0000 7fc94d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.340+0000 7fc94d800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480797a0 con 0x7fc94807ad70 2024-04-26T20:55:50.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.341+0000 7fc946a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.341+0000 7fc946a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47416/0 (socket says 172.21.15.55:47416) 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.341+0000 7fc946a00700 1 -- 172.21.15.55:0/3425265258 learned_addr learned my addr 172.21.15.55:0/3425265258 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.341+0000 7fc946a00700 1 -- 172.21.15.55:0/3425265258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480798e0 con 0x7fc94807ad70 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.342+0000 7fc946a00700 1 --2- 172.21.15.55:0/3425265258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9380098a0 tx=0x7fc938009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664b852fb6fd7f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.342+0000 7fc946000700 1 -- 172.21.15.55:0/3425265258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc938004180 con 0x7fc94807ad70 2024-04-26T20:55:50.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.342+0000 7fc946000700 1 -- 172.21.15.55:0/3425265258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9380042e0 con 0x7fc94807ad70 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.342+0000 7fc946000700 1 -- 172.21.15.55:0/3425265258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc938011b10 con 0x7fc94807ad70 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 -- 172.21.15.55:0/3425265258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 msgr2=0x7fc9480791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 --2- 172.21.15.55:0/3425265258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9380098a0 tx=0x7fc938009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 -- 172.21.15.55:0/3425265258 shutdown_connections 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 --2- 172.21.15.55:0/3425265258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc9480791d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 -- 172.21.15.55:0/3425265258 >> 172.21.15.55:0/3425265258 conn(0x7fc948101ba0 msgr2=0x7fc948103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 -- 172.21.15.55:0/3425265258 shutdown_connections 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.343+0000 7fc94d800700 1 -- 172.21.15.55:0/3425265258 wait complete. 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.344+0000 7fc94d800700 1 Processor -- start 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.344+0000 7fc94d800700 1 -- start start 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.345+0000 7fc94d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.345+0000 7fc94d800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94819caf0 con 0x7fc94807ad70 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.345+0000 7fc946a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.345+0000 7fc946a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47422/0 (socket says 172.21.15.55:47422) 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.345+0000 7fc946a00700 1 -- 172.21.15.55:0/3308120784 learned_addr learned my addr 172.21.15.55:0/3308120784 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.346+0000 7fc946a00700 1 -- 172.21.15.55:0/3308120784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc938009550 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.346+0000 7fc946a00700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc938004210 tx=0x7fc938011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.346+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9380038b0 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.347+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc938003a10 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.347+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94819ccf0 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.347+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc938024650 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.347+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94819d190 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.348+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94810c940 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.348+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fc93801a430 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.349+0000 7fc93fe00700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 0x7fc92c03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.349+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc93804c760 con 0x7fc94807ad70 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.349+0000 7fc93e000700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 0x7fc92c03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:50.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.350+0000 7fc93e000700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 0x7fc92c03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc930006fd0 tx=0x7fc930006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.355+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc938024e30 con 0x7fc94807ad70 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.591+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc948102f30 con 0x7fc92c038770 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.674+0000 7fc93fe00700 1 -- 172.21.15.55:0/3308120784 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc948102f30 con 0x7fc92c038770 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 msgr2=0x7fc92c03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 0x7fc92c03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc930006fd0 tx=0x7fc930006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 msgr2=0x7fc94819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc938004210 tx=0x7fc938011940 comp rx=0 tx=0).stop 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 shutdown_connections 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fc92c038770 0x7fc92c03ac30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 --2- 172.21.15.55:0/3308120784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc94807ad70 0x7fc94819c5b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 >> 172.21.15.55:0/3308120784 conn(0x7fc948101ba0 msgr2=0x7fc948102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 shutdown_connections 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:49.677+0000 7fc94d800700 1 -- 172.21.15.55:0/3308120784 wait complete. 2024-04-26T20:55:50.414 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial admin user... 2024-04-26T20:55:50.968 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:50 smithi055 ceph-mon[25475]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:50.968 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:50 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:50.969 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:50 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:50.969 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:50 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:51.890 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:51 smithi055 ceph-mon[25475]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:55:51.891 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:51 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:55:52.590 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$khM0JoEVRRifjAVo1APthOWNZJhj3o/E.HmpeRwHRH3tQlH7bNxjG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714164951, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T20:55:52.590 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.014+0000 7fd4bf200700 1 Processor -- start 2024-04-26T20:55:52.590 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.015+0000 7fd4bf200700 1 -- start start 2024-04-26T20:55:52.590 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.015+0000 7fd4bf200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:52.590 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.015+0000 7fd4bf200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8106f90 con 0x7fd4b81065a0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.016+0000 7fd4b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.016+0000 7fd4b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47436/0 (socket says 172.21.15.55:47436) 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.016+0000 7fd4b7e00700 1 -- 172.21.15.55:0/2563661574 learned_addr learned my addr 172.21.15.55:0/2563661574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.016+0000 7fd4b7e00700 1 -- 172.21.15.55:0/2563661574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b81077a0 con 0x7fd4b81065a0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.016+0000 7fd4b7e00700 1 --2- 172.21.15.55:0/2563661574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80098a0 tx=0x7fd4a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c666f9e60bc272a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.017+0000 7fd4b6a00700 1 -- 172.21.15.55:0/2563661574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8004180 con 0x7fd4b81065a0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.017+0000 7fd4b6a00700 1 -- 172.21.15.55:0/2563661574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4a80042e0 con 0x7fd4b81065a0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.017+0000 7fd4b6a00700 1 -- 172.21.15.55:0/2563661574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8011b10 con 0x7fd4b81065a0 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 -- 172.21.15.55:0/2563661574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 msgr2=0x7fd4b81069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 --2- 172.21.15.55:0/2563661574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80098a0 tx=0x7fd4a8009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 -- 172.21.15.55:0/2563661574 shutdown_connections 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 --2- 172.21.15.55:0/2563661574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b81069c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:52.591 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 -- 172.21.15.55:0/2563661574 >> 172.21.15.55:0/2563661574 conn(0x7fd4b8101ba0 msgr2=0x7fd4b8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 -- 172.21.15.55:0/2563661574 shutdown_connections 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.018+0000 7fd4bf200700 1 -- 172.21.15.55:0/2563661574 wait complete. 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.019+0000 7fd4bf200700 1 Processor -- start 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.019+0000 7fd4bf200700 1 -- start start 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.020+0000 7fd4bf200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.020+0000 7fd4bf200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b807af70 con 0x7fd4b81065a0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.020+0000 7fd4b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.020+0000 7fd4b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47438/0 (socket says 172.21.15.55:47438) 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.020+0000 7fd4b7e00700 1 -- 172.21.15.55:0/91958501 learned_addr learned my addr 172.21.15.55:0/91958501 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4b7e00700 1 -- 172.21.15.55:0/91958501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009550 con 0x7fd4b81065a0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4b7e00700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c00 tx=0x7fd4a8011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a80038b0 con 0x7fd4b81065a0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4a8003a10 con 0x7fd4b81065a0 2024-04-26T20:55:52.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8024780 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.021+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b80791b0 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.022+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b8079650 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.023+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b8062510 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.023+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fd4a801ac10 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.024+0000 7fd4b4c00700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 0x7fd49c03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.024+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd4a804cc80 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.025+0000 7fd4b7400700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 0x7fd49c03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.026+0000 7fd4b7400700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 0x7fd49c03ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006fd0 tx=0x7fd4a4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.030+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd4a8018db0 con 0x7fd4b81065a0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.289+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd4b8079900 con 0x7fd49c0387c0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.553+0000 7fd4b4c00700 1 -- 172.21.15.55:0/91958501 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd4b8079900 con 0x7fd49c0387c0 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 msgr2=0x7fd49c03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:52.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 0x7fd49c03ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006fd0 tx=0x7fd4a4006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 msgr2=0x7fd4b807aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c00 tx=0x7fd4a8011890 comp rx=0 tx=0).stop 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 shutdown_connections 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd49c0387c0 0x7fd49c03ac80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 --2- 172.21.15.55:0/91958501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4b81065a0 0x7fd4b807aa30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.556+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 >> 172.21.15.55:0/91958501 conn(0x7fd4b8101ba0 msgr2=0x7fd4b8102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.557+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 shutdown_connections 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:51.557+0000 7fd4bf200700 1 -- 172.21.15.55:0/91958501 wait complete. 2024-04-26T20:55:52.594 INFO:teuthology.orchestra.run.smithi055.stdout:Fetching dashboard port number... 2024-04-26T20:55:53.912 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:53 smithi055 ceph-mon[25475]: mgrmap e13: smithi055.ybbowr(active, since 6s) 2024-04-26T20:55:54.592 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.652+0000 7f7106200700 1 Processor -- start 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.652+0000 7f7106200700 1 -- start start 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.652+0000 7f7106200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.652+0000 7f7106200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710010db20 con 0x7f710010d130 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.653+0000 7f70ff400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.653+0000 7f70ff400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47446/0 (socket says 172.21.15.55:47446) 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.653+0000 7f70ff400700 1 -- 172.21.15.55:0/2970791736 learned_addr learned my addr 172.21.15.55:0/2970791736 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.653+0000 7f70ff400700 1 -- 172.21.15.55:0/2970791736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710010dda0 con 0x7f710010d130 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.654+0000 7f70ff400700 1 --2- 172.21.15.55:0/2970791736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b51693aee95f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.654+0000 7f70fe000700 1 -- 172.21.15.55:0/2970791736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f0004180 con 0x7f710010d130 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.654+0000 7f70fe000700 1 -- 172.21.15.55:0/2970791736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70f00042e0 con 0x7f710010d130 2024-04-26T20:55:54.593 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.654+0000 7f70fe000700 1 -- 172.21.15.55:0/2970791736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f0011b10 con 0x7f710010d130 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 -- 172.21.15.55:0/2970791736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 msgr2=0x7f710010d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 --2- 172.21.15.55:0/2970791736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f0009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 -- 172.21.15.55:0/2970791736 shutdown_connections 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 --2- 172.21.15.55:0/2970791736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f710010d550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 -- 172.21.15.55:0/2970791736 >> 172.21.15.55:0/2970791736 conn(0x7f710007bbf0 msgr2=0x7f710007e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 -- 172.21.15.55:0/2970791736 shutdown_connections 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.655+0000 7f7106200700 1 -- 172.21.15.55:0/2970791736 wait complete. 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.656+0000 7f7106200700 1 Processor -- start 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f7106200700 1 -- start start 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f7106200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f7106200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001a0e50 con 0x7f710010d130 2024-04-26T20:55:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f70ff400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f70ff400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47458/0 (socket says 172.21.15.55:47458) 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.657+0000 7f70ff400700 1 -- 172.21.15.55:0/641171770 learned_addr learned my addr 172.21.15.55:0/641171770 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f70ff400700 1 -- 172.21.15.55:0/641171770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009550 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f70ff400700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fb0 tx=0x7f70f0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f00038b0 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70f0003a10 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f0019770 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001a1050 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.658+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71001a14f0 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.660+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f70f001ac10 con 0x7f710010d130 2024-04-26T20:55:54.595 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.660+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100110fd0 con 0x7f710010d130 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.660+0000 7f70f7e00700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 0x7f70e403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.660+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f70f004ca50 con 0x7f710010d130 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.660+0000 7f70fea00700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 0x7f70e403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.661+0000 7f70fea00700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 0x7f70e403ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70ec006fd0 tx=0x7f70ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.666+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f70f00198d0 con 0x7f710010d130 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.888+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f71001a3d80 con 0x7f710010d130 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.889+0000 7f70f7e00700 1 -- 172.21.15.55:0/641171770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f70f0022310 con 0x7f710010d130 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 msgr2=0x7f70e403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 0x7f70e403ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70ec006fd0 tx=0x7f70ec006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 msgr2=0x7f71001a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009fb0 tx=0x7f70f0011890 comp rx=0 tx=0).stop 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 shutdown_connections 2024-04-26T20:55:54.596 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f70e4038870 0x7f70e403ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:54.597 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.892+0000 7f7106200700 1 --2- 172.21.15.55:0/641171770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f710010d130 0x7f71001a0910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:54.597 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.893+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 >> 172.21.15.55:0/641171770 conn(0x7f710007bbf0 msgr2=0x7f710007c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:54.597 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.893+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 shutdown_connections 2024-04-26T20:55:54.597 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:53.893+0000 7f7106200700 1 -- 172.21.15.55:0/641171770 wait complete. 2024-04-26T20:55:54.621 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T20:55:54.621 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-04-26T20:55:54.646 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T20:55:54.647 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-04-26T20:55:54.647 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-04-26T20:55:54.647 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T20:55:54.648 INFO:teuthology.orchestra.run.smithi055.stdout:Ceph Dashboard is now available at: 2024-04-26T20:55:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: URL: https://smithi055.front.sepia.ceph.com:8443/ 2024-04-26T20:55:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: User: admin 2024-04-26T20:55:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: Password: seka6qzz18 2024-04-26T20:55:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:54.649 INFO:teuthology.orchestra.run.smithi055.stdout:Saving cluster configuration to /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config directory 2024-04-26T20:55:54.650 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling autotune for osd_memory_target 2024-04-26T20:55:54.943 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:54 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/641171770' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T20:55:56.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.240+0000 7fea6a400700 1 Processor -- start 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.240+0000 7fea6a400700 1 -- start start 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.241+0000 7fea6a400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.241+0000 7fea6a400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64106fa0 con 0x7fea641065b0 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.241+0000 7fea63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.241+0000 7fea63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47448/0 (socket says 172.21.15.55:47448) 2024-04-26T20:55:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.241+0000 7fea63400700 1 -- 172.21.15.55:0/2213899599 learned_addr learned my addr 172.21.15.55:0/2213899599 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:56.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.242+0000 7fea63400700 1 -- 172.21.15.55:0/2213899599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea641077b0 con 0x7fea641065b0 2024-04-26T20:55:56.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.242+0000 7fea63400700 1 --2- 172.21.15.55:0/2213899599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea540098a0 tx=0x7fea54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09e33a3622b0ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:56.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.242+0000 7fea62a00700 1 -- 172.21.15.55:0/2213899599 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea54004180 con 0x7fea641065b0 2024-04-26T20:55:56.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea62a00700 1 -- 172.21.15.55:0/2213899599 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea540042e0 con 0x7fea641065b0 2024-04-26T20:55:56.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea62a00700 1 -- 172.21.15.55:0/2213899599 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea54011b10 con 0x7fea641065b0 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 -- 172.21.15.55:0/2213899599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 msgr2=0x7fea641069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 --2- 172.21.15.55:0/2213899599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea540098a0 tx=0x7fea54009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 -- 172.21.15.55:0/2213899599 shutdown_connections 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 --2- 172.21.15.55:0/2213899599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea641069d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 -- 172.21.15.55:0/2213899599 >> 172.21.15.55:0/2213899599 conn(0x7fea64101bd0 msgr2=0x7fea64103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.243+0000 7fea6a400700 1 -- 172.21.15.55:0/2213899599 shutdown_connections 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.244+0000 7fea6a400700 1 -- 172.21.15.55:0/2213899599 wait complete. 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.244+0000 7fea6a400700 1 Processor -- start 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea6a400700 1 -- start start 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea6a400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:56.191 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea6a400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6419cad0 con 0x7fea641065b0 2024-04-26T20:55:56.194 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47456/0 (socket says 172.21.15.55:47456) 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.245+0000 7fea63400700 1 -- 172.21.15.55:0/3169192011 learned_addr learned my addr 172.21.15.55:0/3169192011 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea63400700 1 -- 172.21.15.55:0/3169192011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54009550 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea63400700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea540117b0 tx=0x7fea54011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea540038b0 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea54003a10 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6419ccd0 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.246+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea540246e0 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.247+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6419d170 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.248+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fea5401ab80 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.248+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6410a9e0 con 0x7fea641065b0 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.248+0000 7fea60c00700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 0x7fea4803acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:56.195 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.248+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fea5404cad0 con 0x7fea641065b0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.248+0000 7fea5be00700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 0x7fea4803acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.249+0000 7fea5be00700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 0x7fea4803acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.254+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fea54010380 con 0x7fea641065b0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.475+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fea6419f9b0 con 0x7fea641065b0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.476+0000 7fea60c00700 1 -- 172.21.15.55:0/3169192011 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fea54018b40 con 0x7fea641065b0 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 msgr2=0x7fea4803acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 0x7fea4803acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea4c006fd0 tx=0x7fea4c006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 msgr2=0x7fea6419c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea540117b0 tx=0x7fea54011890 comp rx=0 tx=0).stop 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 shutdown_connections 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fea48038810 0x7fea4803acd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 --2- 172.21.15.55:0/3169192011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea641065b0 0x7fea6419c590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 >> 172.21.15.55:0/3169192011 conn(0x7fea64101bd0 msgr2=0x7fea64102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:56.196 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 shutdown_connections 2024-04-26T20:55:56.197 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:55.479+0000 7fea6a400700 1 -- 172.21.15.55:0/3169192011 wait complete. 2024-04-26T20:55:57.864 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.849+0000 7f21a2800700 1 Processor -- start 2024-04-26T20:55:57.864 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.850+0000 7f21a2800700 1 -- start start 2024-04-26T20:55:57.866 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.850+0000 7f21a2800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:57.866 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.850+0000 7f21a2800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c07a930 con 0x7f219c07bf00 2024-04-26T20:55:57.866 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.851+0000 7f21a1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.851+0000 7f21a1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47472/0 (socket says 172.21.15.55:47472) 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.851+0000 7f21a1400700 1 -- 172.21.15.55:0/3853505192 learned_addr learned my addr 172.21.15.55:0/3853505192 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.851+0000 7f21a1400700 1 -- 172.21.15.55:0/3853505192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c07aa70 con 0x7f219c07bf00 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f21a1400700 1 --2- 172.21.15.55:0/3853505192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21900098a0 tx=0x7f2190009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d13e590963af4fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f219be00700 1 -- 172.21.15.55:0/3853505192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190004180 con 0x7f219c07bf00 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f219be00700 1 -- 172.21.15.55:0/3853505192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21900042e0 con 0x7f219c07bf00 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f219be00700 1 -- 172.21.15.55:0/3853505192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190011b10 con 0x7f219c07bf00 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f21a2800700 1 -- 172.21.15.55:0/3853505192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 msgr2=0x7f219c07a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.852+0000 7f21a2800700 1 --2- 172.21.15.55:0/3853505192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f21900098a0 tx=0x7f2190009bb0 comp rx=0 tx=0).stop 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.853+0000 7f21a2800700 1 -- 172.21.15.55:0/3853505192 shutdown_connections 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.853+0000 7f21a2800700 1 --2- 172.21.15.55:0/3853505192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c07a360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.853+0000 7f21a2800700 1 -- 172.21.15.55:0/3853505192 >> 172.21.15.55:0/3853505192 conn(0x7f219c1019a0 msgr2=0x7f219c103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.853+0000 7f21a2800700 1 -- 172.21.15.55:0/3853505192 shutdown_connections 2024-04-26T20:55:57.867 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.853+0000 7f21a2800700 1 -- 172.21.15.55:0/3853505192 wait complete. 2024-04-26T20:55:57.871 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.854+0000 7f21a2800700 1 Processor -- start 2024-04-26T20:55:57.871 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.854+0000 7f21a2800700 1 -- start start 2024-04-26T20:55:57.871 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.854+0000 7f21a2800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:57.871 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.854+0000 7f21a2800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c19c840 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.855+0000 7f21a1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.855+0000 7f21a1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47486/0 (socket says 172.21.15.55:47486) 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.855+0000 7f21a1400700 1 -- 172.21.15.55:0/2344425561 learned_addr learned my addr 172.21.15.55:0/2344425561 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.855+0000 7f21a1400700 1 -- 172.21.15.55:0/2344425561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190009550 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.855+0000 7f21a1400700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.856+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21900038b0 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.856+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2190003a10 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.856+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190024780 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.856+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c19ca40 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.856+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c19cee0 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.857+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c10c7b0 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.857+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f219001ac10 con 0x7f219c07bf00 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.858+0000 7f219a000700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 0x7f218403ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:55:57.872 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.858+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f219004c8c0 con 0x7f219c07bf00 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.858+0000 7f21a0a00700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 0x7f218403ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.859+0000 7f21a0a00700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 0x7f218403ad90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2188006fd0 tx=0x7f2188006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:56.863+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2190010380 con 0x7f219c07bf00 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.209+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f219c19f7d0 con 0x7f219c07bf00 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.214+0000 7f219a000700 1 -- 172.21.15.55:0/2344425561 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f2190018b40 con 0x7f219c07bf00 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 msgr2=0x7f218403ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 0x7f218403ad90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2188006fd0 tx=0x7f2188006e40 comp rx=0 tx=0).stop 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 msgr2=0x7f219c19c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190011890 comp rx=0 tx=0).stop 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 shutdown_connections 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f21840388d0 0x7f218403ad90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:57.873 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 --2- 172.21.15.55:0/2344425561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f219c07bf00 0x7f219c19c300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 >> 172.21.15.55:0/2344425561 conn(0x7f219c1019a0 msgr2=0x7f219c1024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 shutdown_connections 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-04-26T20:55:57.217+0000 7f21a2800700 1 -- 172.21.15.55:0/2344425561 wait complete. 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T20:55:57.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout: ceph telemetry on 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout:For more information see: 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:55:57.875 INFO:teuthology.orchestra.run.smithi055.stdout:Bootstrap complete. 2024-04-26T20:55:57.946 INFO:tasks.cephadm:Fetching config... 2024-04-26T20:55:57.946 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:55:57.946 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T20:55:57.994 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T20:55:57.994 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:55:57.994 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T20:55:58.077 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T20:55:58.077 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:55:58.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/keyring of=/dev/stdout 2024-04-26T20:55:58.201 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T20:55:58.202 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:55:58.202 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T20:55:58.301 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T20:55:58.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW6fgS4aANB+CyrQsADJDIU8mbN/ptK/HBYhI7uH7kTVQlpNQ0B/C2frjy50R2nngr5qDEZJRixjtegzp5gcF/rrR/nLkFDegvJKq163o74yxMWj60GfIKxDd2TvmwCBUcBApCX68yIr8AgVFnZrBpqgTCe8I9OFxLfbM7N4d6onmtroBH1hypYxjIRfBt0xAZBb1gKXrx3SCMDN9eFJH6zUDTFa1C3TTuPevyxqGGyxO+Y/HcwuNpw0EXiUtIAkjb6+Nw+IaPBHrymRwWDHTIJ1OTsFhC2l44rVSkCwDdSlFzXnHngrwmFro0/utYmyTrkvGcWSXwyX4tiqxn1ctPW12iJO1/2cjlHza6b2uLlHBM2i7wp2zCFQLvfdgyRXvkb3efihwQEndcbLtS5ldYZw/tB5MGoJ/DQcS8vXy1xo5f/359AB/RBNmEWOU3ID7Q+1fttk+u4qvj1CjIXxZt+/E8bF+3bS1+zIixzSrjgz+IjajoJvF8mvNQHrFCZ68= ceph-fbc85ba0-040e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:55:58.406 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:55:58 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2344425561' entity='client.admin' 2024-04-26T20:55:58.413 INFO:teuthology.orchestra.run.smithi055.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW6fgS4aANB+CyrQsADJDIU8mbN/ptK/HBYhI7uH7kTVQlpNQ0B/C2frjy50R2nngr5qDEZJRixjtegzp5gcF/rrR/nLkFDegvJKq163o74yxMWj60GfIKxDd2TvmwCBUcBApCX68yIr8AgVFnZrBpqgTCe8I9OFxLfbM7N4d6onmtroBH1hypYxjIRfBt0xAZBb1gKXrx3SCMDN9eFJH6zUDTFa1C3TTuPevyxqGGyxO+Y/HcwuNpw0EXiUtIAkjb6+Nw+IaPBHrymRwWDHTIJ1OTsFhC2l44rVSkCwDdSlFzXnHngrwmFro0/utYmyTrkvGcWSXwyX4tiqxn1ctPW12iJO1/2cjlHza6b2uLlHBM2i7wp2zCFQLvfdgyRXvkb3efihwQEndcbLtS5ldYZw/tB5MGoJ/DQcS8vXy1xo5f/359AB/RBNmEWOU3ID7Q+1fttk+u4qvj1CjIXxZt+/E8bF+3bS1+zIixzSrjgz+IjajoJvF8mvNQHrFCZ68= ceph-fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:55:58.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW6fgS4aANB+CyrQsADJDIU8mbN/ptK/HBYhI7uH7kTVQlpNQ0B/C2frjy50R2nngr5qDEZJRixjtegzp5gcF/rrR/nLkFDegvJKq163o74yxMWj60GfIKxDd2TvmwCBUcBApCX68yIr8AgVFnZrBpqgTCe8I9OFxLfbM7N4d6onmtroBH1hypYxjIRfBt0xAZBb1gKXrx3SCMDN9eFJH6zUDTFa1C3TTuPevyxqGGyxO+Y/HcwuNpw0EXiUtIAkjb6+Nw+IaPBHrymRwWDHTIJ1OTsFhC2l44rVSkCwDdSlFzXnHngrwmFro0/utYmyTrkvGcWSXwyX4tiqxn1ctPW12iJO1/2cjlHza6b2uLlHBM2i7wp2zCFQLvfdgyRXvkb3efihwQEndcbLtS5ldYZw/tB5MGoJ/DQcS8vXy1xo5f/359AB/RBNmEWOU3ID7Q+1fttk+u4qvj1CjIXxZt+/E8bF+3bS1+zIixzSrjgz+IjajoJvF8mvNQHrFCZ68= ceph-fbc85ba0-040e-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T20:55:58.579 INFO:teuthology.orchestra.run.smithi064.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW6fgS4aANB+CyrQsADJDIU8mbN/ptK/HBYhI7uH7kTVQlpNQ0B/C2frjy50R2nngr5qDEZJRixjtegzp5gcF/rrR/nLkFDegvJKq163o74yxMWj60GfIKxDd2TvmwCBUcBApCX68yIr8AgVFnZrBpqgTCe8I9OFxLfbM7N4d6onmtroBH1hypYxjIRfBt0xAZBb1gKXrx3SCMDN9eFJH6zUDTFa1C3TTuPevyxqGGyxO+Y/HcwuNpw0EXiUtIAkjb6+Nw+IaPBHrymRwWDHTIJ1OTsFhC2l44rVSkCwDdSlFzXnHngrwmFro0/utYmyTrkvGcWSXwyX4tiqxn1ctPW12iJO1/2cjlHza6b2uLlHBM2i7wp2zCFQLvfdgyRXvkb3efihwQEndcbLtS5ldYZw/tB5MGoJ/DQcS8vXy1xo5f/359AB/RBNmEWOU3ID7Q+1fttk+u4qvj1CjIXxZt+/E8bF+3bS1+zIixzSrjgz+IjajoJvF8mvNQHrFCZ68= ceph-fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:55:58.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T20:55:59.026 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.658+0000 7ff835000700 1 -- 172.21.15.55:0/1935472933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 msgr2=0x7ff830107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.658+0000 7ff835000700 1 --2- 172.21.15.55:0/1935472933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff830107510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff820009910 tx=0x7ff820009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.659+0000 7ff835000700 1 -- 172.21.15.55:0/1935472933 shutdown_connections 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.659+0000 7ff835000700 1 --2- 172.21.15.55:0/1935472933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff830107510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.659+0000 7ff835000700 1 -- 172.21.15.55:0/1935472933 >> 172.21.15.55:0/1935472933 conn(0x7ff830075fd0 msgr2=0x7ff830078430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.659+0000 7ff835000700 1 -- 172.21.15.55:0/1935472933 shutdown_connections 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.659+0000 7ff835000700 1 -- 172.21.15.55:0/1935472933 wait complete. 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.660+0000 7ff835000700 1 Processor -- start 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.660+0000 7ff835000700 1 -- start start 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.660+0000 7ff835000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.660+0000 7ff835000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83019c840 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.661+0000 7ff82de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.661+0000 7ff82de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47508/0 (socket says 172.21.15.55:47508) 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.661+0000 7ff82de00700 1 -- 172.21.15.55:0/727531092 learned_addr learned my addr 172.21.15.55:0/727531092 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.661+0000 7ff82de00700 1 -- 172.21.15.55:0/727531092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200095f0 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.661+0000 7ff82de00700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff820006010 tx=0x7ff8200050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.662+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff82001d070 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.662+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff82000be20 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.662+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff82000f460 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.662+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83019ca40 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.662+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83019cee0 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.663+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff82000b960 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.663+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff830195c30 con 0x7ff8301070f0 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.664+0000 7ff826a00700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 0x7ff81403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:01.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.664+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff82004ca50 con 0x7ff8301070f0 2024-04-26T20:56:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.664+0000 7ff82d400700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 0x7ff81403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.665+0000 7ff82d400700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 0x7ff81403ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006fd0 tx=0x7ff81c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.669+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff820005c00 con 0x7ff8301070f0 2024-04-26T20:56:01.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.899+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff830062510 con 0x7ff8301070f0 2024-04-26T20:56:01.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.907+0000 7ff826a00700 1 -- 172.21.15.55:0/727531092 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff830062510 con 0x7ff8301070f0 2024-04-26T20:56:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 msgr2=0x7ff81403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 0x7ff81403ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006fd0 tx=0x7ff81c006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 msgr2=0x7ff83019c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:01.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff820006010 tx=0x7ff8200050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 shutdown_connections 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff814038820 0x7ff81403ace0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 --2- 172.21.15.55:0/727531092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8301070f0 0x7ff83019c300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 >> 172.21.15.55:0/727531092 conn(0x7ff830075fd0 msgr2=0x7ff830076ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.910+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 shutdown_connections 2024-04-26T20:56:01.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:01.911+0000 7ff835000700 1 -- 172.21.15.55:0/727531092 wait complete. 2024-04-26T20:56:02.590 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T20:56:02.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T20:56:02.977 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:56:03.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:02 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/727531092' entity='client.admin' 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 -- 172.21.15.55:0/2777996764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 msgr2=0x7f330c0ff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 --2- 172.21.15.55:0/2777996764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c0ff510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009910 tx=0x7f32fc009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 -- 172.21.15.55:0/2777996764 shutdown_connections 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 --2- 172.21.15.55:0/2777996764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c0ff510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 -- 172.21.15.55:0/2777996764 >> 172.21.15.55:0/2777996764 conn(0x7f330c0fad10 msgr2=0x7f330c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 -- 172.21.15.55:0/2777996764 shutdown_connections 2024-04-26T20:56:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.568+0000 7f3311e00700 1 -- 172.21.15.55:0/2777996764 wait complete. 2024-04-26T20:56:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.569+0000 7f3311e00700 1 Processor -- start 2024-04-26T20:56:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.569+0000 7f3311e00700 1 -- start start 2024-04-26T20:56:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.570+0000 7f3311e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.570+0000 7f3311e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c198410 con 0x7f330c0ff0f0 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.570+0000 7f330aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.570+0000 7f330aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54822/0 (socket says 172.21.15.55:54822) 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.570+0000 7f330aa00700 1 -- 172.21.15.55:0/502700003 learned_addr learned my addr 172.21.15.55:0/502700003 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.571+0000 7f330aa00700 1 -- 172.21.15.55:0/502700003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0095f0 con 0x7f330c0ff0f0 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.571+0000 7f330aa00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006010 tx=0x7f32fc0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.571+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32fc01d070 con 0x7f330c0ff0f0 2024-04-26T20:56:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.571+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32fc00be20 con 0x7f330c0ff0f0 2024-04-26T20:56:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.571+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32fc00f460 con 0x7f330c0ff0f0 2024-04-26T20:56:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.572+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c198610 con 0x7f330c0ff0f0 2024-04-26T20:56:05.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.572+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c198ab0 con 0x7f330c0ff0f0 2024-04-26T20:56:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.573+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f32fc022470 con 0x7f330c0ff0f0 2024-04-26T20:56:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.573+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c191890 con 0x7f330c0ff0f0 2024-04-26T20:56:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.573+0000 7f3310a00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 0x7f32f003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:05.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.573+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f32fc04ccf0 con 0x7f330c0ff0f0 2024-04-26T20:56:05.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.574+0000 7f330a000700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 0x7f32f003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:05.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.575+0000 7f330a000700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 0x7f32f003ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:05.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.580+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f32fc005c00 con 0x7f330c0ff0f0 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:05.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:05 smithi055 ceph-mon[25475]: Deploying daemon ceph-exporter.smithi055 on smithi055 2024-04-26T20:56:05.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.823+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f330c02cdb0 con 0x7f32f0038820 2024-04-26T20:56:05.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.833+0000 7f3310a00700 1 -- 172.21.15.55:0/502700003 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f330c02cdb0 con 0x7f32f0038820 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 msgr2=0x7f32f003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 0x7f32f003ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 msgr2=0x7f330c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32fc006010 tx=0x7f32fc0050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 shutdown_connections 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f32f0038820 0x7f32f003ace0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 --2- 172.21.15.55:0/502700003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f330c0ff0f0 0x7f330c197ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:05.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 >> 172.21.15.55:0/502700003 conn(0x7f330c0fad10 msgr2=0x7f330c0fb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:05.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 shutdown_connections 2024-04-26T20:56:05.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:05.836+0000 7f3311e00700 1 -- 172.21.15.55:0/502700003 wait complete. 2024-04-26T20:56:07.000 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi064 2024-04-26T20:56:07.001 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:56:07.001 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.conf 2024-04-26T20:56:07.061 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:56:07.061 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:56:07.161 INFO:tasks.cephadm:Adding host smithi064 to orchestrator... 2024-04-26T20:56:07.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch host add smithi064 2024-04-26T20:56:07.187 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:06 smithi055 ceph-mon[25475]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:56:07.187 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:06 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:07.572 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:56:07.963 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:07 smithi055 ceph-mon[25475]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:09.995 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:09 smithi055 ceph-mon[25475]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:10.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.079+0000 7f61ae800700 1 -- 172.21.15.55:0/2116940880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 msgr2=0x7f61a8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:10.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.079+0000 7f61ae800700 1 --2- 172.21.15.55:0/2116940880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8073370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6198009910 tx=0x7f6198009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:10.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.080+0000 7f61ae800700 1 -- 172.21.15.55:0/2116940880 shutdown_connections 2024-04-26T20:56:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.080+0000 7f61ae800700 1 --2- 172.21.15.55:0/2116940880 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8073370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.080+0000 7f61ae800700 1 -- 172.21.15.55:0/2116940880 >> 172.21.15.55:0/2116940880 conn(0x7f61a80fbe10 msgr2=0x7f61a80fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.080+0000 7f61ae800700 1 -- 172.21.15.55:0/2116940880 shutdown_connections 2024-04-26T20:56:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.080+0000 7f61ae800700 1 -- 172.21.15.55:0/2116940880 wait complete. 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.081+0000 7f61ae800700 1 Processor -- start 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.081+0000 7f61ae800700 1 -- start start 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.081+0000 7f61ae800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.081+0000 7f61ae800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a8198490 con 0x7f61a8074f10 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.081+0000 7f61a7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.082+0000 7f61a7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54852/0 (socket says 172.21.15.55:54852) 2024-04-26T20:56:10.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.082+0000 7f61a7400700 1 -- 172.21.15.55:0/405931391 learned_addr learned my addr 172.21.15.55:0/405931391 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:56:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.082+0000 7f61a7400700 1 -- 172.21.15.55:0/405931391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980095f0 con 0x7f61a8074f10 2024-04-26T20:56:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.082+0000 7f61a7400700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6198006010 tx=0x7f61980050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.083+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f619801d070 con 0x7f61a8074f10 2024-04-26T20:56:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.083+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f619800be20 con 0x7f61a8074f10 2024-04-26T20:56:10.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.083+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a8198690 con 0x7f61a8074f10 2024-04-26T20:56:10.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.083+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6198022de0 con 0x7f61a8074f10 2024-04-26T20:56:10.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.083+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a8198b30 con 0x7f61a8074f10 2024-04-26T20:56:10.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.084+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a81918b0 con 0x7f61a8074f10 2024-04-26T20:56:10.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.084+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f61980226c0 con 0x7f61a8074f10 2024-04-26T20:56:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.085+0000 7f619fe00700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 0x7f618c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:10.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.085+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f619804c8e0 con 0x7f61a8074f10 2024-04-26T20:56:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.085+0000 7f61a6a00700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 0x7f618c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.086+0000 7f61a6a00700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 0x7f618c03ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6194006fd0 tx=0x7f6194006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.091+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f619802a360 con 0x7f61a8074f10 2024-04-26T20:56:10.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:10.324+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}) v1 -- 0x7f61a8061320 con 0x7f618c038820 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T20:56:11.118 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:11.119 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:10 smithi055 ceph-mon[25475]: Deploying daemon crash.smithi055 on smithi055 2024-04-26T20:56:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:11 smithi055 ceph-mon[25475]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:56:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:11 smithi055 ceph-mon[25475]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:11 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:13.238 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:12 smithi055 ceph-mon[25475]: Deploying cephadm binary to smithi064 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:13 smithi055 ceph-mon[25475]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:13 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:13 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:13 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:13 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:14.803 INFO:teuthology.orchestra.run.smithi055.stdout:Added host 'smithi064' with addr '172.21.15.64' 2024-04-26T20:56:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.799+0000 7f619fe00700 1 -- 172.21.15.55:0/405931391 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f61a8061320 con 0x7f618c038820 2024-04-26T20:56:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 msgr2=0x7f618c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 0x7f618c03ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6194006fd0 tx=0x7f6194006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 msgr2=0x7f61a8197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6198006010 tx=0x7f61980050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 shutdown_connections 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f618c038820 0x7f618c03ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 --2- 172.21.15.55:0/405931391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61a8074f10 0x7f61a8197f50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.803+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 >> 172.21.15.55:0/405931391 conn(0x7f61a80fbe10 msgr2=0x7f61a80fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.804+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 shutdown_connections 2024-04-26T20:56:14.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:14.804+0000 7f61ae800700 1 -- 172.21.15.55:0/405931391 wait complete. 2024-04-26T20:56:15.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:14 smithi055 ceph-mon[25475]: Deploying daemon node-exporter.smithi055 on smithi055 2024-04-26T20:56:15.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:14 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:15.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T20:56:16.133 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:56:16.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:15 smithi055 ceph-mon[25475]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:16.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:15 smithi055 ceph-mon[25475]: Added host smithi064 2024-04-26T20:56:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:17 smithi055 ceph-mon[25475]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:17 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:19.647 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:19 smithi055 ceph-mon[25475]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:19.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.722+0000 7f195fa00700 1 -- 172.21.15.55:0/2165271768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 msgr2=0x7f1958073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:19.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.722+0000 7f195fa00700 1 --2- 172.21.15.55:0/2165271768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958073310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f194c009910 tx=0x7f194c009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:19.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.723+0000 7f195fa00700 1 -- 172.21.15.55:0/2165271768 shutdown_connections 2024-04-26T20:56:19.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.723+0000 7f195fa00700 1 --2- 172.21.15.55:0/2165271768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958073310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.723+0000 7f195fa00700 1 -- 172.21.15.55:0/2165271768 >> 172.21.15.55:0/2165271768 conn(0x7f19580fbe30 msgr2=0x7f19580fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.723+0000 7f195fa00700 1 -- 172.21.15.55:0/2165271768 shutdown_connections 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.723+0000 7f195fa00700 1 -- 172.21.15.55:0/2165271768 wait complete. 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.724+0000 7f195fa00700 1 Processor -- start 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.724+0000 7f195fa00700 1 -- start start 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.724+0000 7f195fa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:19.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.724+0000 7f195fa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1958198420 con 0x7f1958074eb0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.725+0000 7f195d000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.725+0000 7f195d000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52012/0 (socket says 172.21.15.55:52012) 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.725+0000 7f195d000700 1 -- 172.21.15.55:0/1358569612 learned_addr learned my addr 172.21.15.55:0/1358569612 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.725+0000 7f195d000700 1 -- 172.21.15.55:0/1358569612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0095f0 con 0x7f1958074eb0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.725+0000 7f195d000700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f194c009ed0 tx=0x7f194c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.726+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f194c01d070 con 0x7f1958074eb0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.726+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f194c00be20 con 0x7f1958074eb0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.726+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f194c00f460 con 0x7f1958074eb0 2024-04-26T20:56:19.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.726+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1958198620 con 0x7f1958074eb0 2024-04-26T20:56:19.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.726+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1958198ac0 con 0x7f1958074eb0 2024-04-26T20:56:19.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.727+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19581918a0 con 0x7f1958074eb0 2024-04-26T20:56:19.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.727+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f194c022800 con 0x7f1958074eb0 2024-04-26T20:56:19.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.728+0000 7f1955600700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 0x7f194003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:19.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.728+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f194c04cc70 con 0x7f1958074eb0 2024-04-26T20:56:19.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.728+0000 7f1957e00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 0x7f194003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:19.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.729+0000 7f1957e00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 0x7f194003ace0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1944006fd0 tx=0x7f1944006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:19.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.733+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f194c02ba00 con 0x7f1958074eb0 2024-04-26T20:56:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.970+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f195802cdb0 con 0x7f1940038820 2024-04-26T20:56:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.972+0000 7f1955600700 1 -- 172.21.15.55:0/1358569612 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f195802cdb0 con 0x7f1940038820 2024-04-26T20:56:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T20:56:19.973 INFO:teuthology.orchestra.run.smithi055.stdout:[{"addr": "172.21.15.55", "hostname": "smithi055", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}] 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 msgr2=0x7f194003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 0x7f194003ace0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1944006fd0 tx=0x7f1944006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 msgr2=0x7f1958197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f194c009ed0 tx=0x7f194c004690 comp rx=0 tx=0).stop 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 shutdown_connections 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f1940038820 0x7f194003ace0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 --2- 172.21.15.55:0/1358569612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1958074eb0 0x7f1958197ee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.975+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 >> 172.21.15.55:0/1358569612 conn(0x7f19580fbe30 msgr2=0x7f19580fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.976+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 shutdown_connections 2024-04-26T20:56:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:19.976+0000 7f195fa00700 1 -- 172.21.15.55:0/1358569612 wait complete. 2024-04-26T20:56:20.790 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T20:56:20.790 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T20:56:21.166 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:56:21.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T20:56:21.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:21.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:21.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:21.494 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:21.494 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:21 smithi055 ceph-mon[25475]: Deploying daemon alertmanager.smithi055 on smithi055 2024-04-26T20:56:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:22 smithi055 ceph-mon[25475]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:22 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.925+0000 7f5907600700 1 -- 172.21.15.55:0/3427496116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 msgr2=0x7f5900102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.925+0000 7f5907600700 1 --2- 172.21.15.55:0/3427496116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900102eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009910 tx=0x7f58f4009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.925+0000 7f5907600700 1 -- 172.21.15.55:0/3427496116 shutdown_connections 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.925+0000 7f5907600700 1 --2- 172.21.15.55:0/3427496116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900102eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.925+0000 7f5907600700 1 -- 172.21.15.55:0/3427496116 >> 172.21.15.55:0/3427496116 conn(0x7f59000fe030 msgr2=0x7f5900100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.926+0000 7f5907600700 1 -- 172.21.15.55:0/3427496116 shutdown_connections 2024-04-26T20:56:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.926+0000 7f5907600700 1 -- 172.21.15.55:0/3427496116 wait complete. 2024-04-26T20:56:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.928+0000 7f5907600700 1 Processor -- start 2024-04-26T20:56:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.928+0000 7f5907600700 1 -- start start 2024-04-26T20:56:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.928+0000 7f5907600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.928+0000 7f5907600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5900198420 con 0x7f5900102a90 2024-04-26T20:56:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.929+0000 7f5904c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.929+0000 7f5904c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52020/0 (socket says 172.21.15.55:52020) 2024-04-26T20:56:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.929+0000 7f5904c00700 1 -- 172.21.15.55:0/1162205990 learned_addr learned my addr 172.21.15.55:0/1162205990 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:56:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.930+0000 7f5904c00700 1 -- 172.21.15.55:0/1162205990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40095f0 con 0x7f5900102a90 2024-04-26T20:56:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.930+0000 7f5904c00700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58f4006010 tx=0x7f58f40050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.931+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58f401d070 con 0x7f5900102a90 2024-04-26T20:56:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.931+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58f400be20 con 0x7f5900102a90 2024-04-26T20:56:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.931+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58f4022de0 con 0x7f5900102a90 2024-04-26T20:56:23.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.931+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5900198620 con 0x7f5900102a90 2024-04-26T20:56:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.931+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5900198ac0 con 0x7f5900102a90 2024-04-26T20:56:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.932+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f58f400f460 con 0x7f5900102a90 2024-04-26T20:56:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.933+0000 7f58fd600700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 0x7f58e803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.933+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f58f404c7f0 con 0x7f5900102a90 2024-04-26T20:56:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.933+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59001918c0 con 0x7f5900102a90 2024-04-26T20:56:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.934+0000 7f58ffe00700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 0x7f58e803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:23.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.935+0000 7f58ffe00700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 0x7f58e803ace0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:23.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:23.940+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f58f4027020 con 0x7f5900102a90 2024-04-26T20:56:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.237+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f59001088d0 con 0x7f5900102a90 2024-04-26T20:56:24.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.255+0000 7f58fd600700 1 -- 172.21.15.55:0/1162205990 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f58f4017440 con 0x7f5900102a90 2024-04-26T20:56:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.258+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 msgr2=0x7f58e803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.258+0000 7f5907600700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 0x7f58e803ace0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.258+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 msgr2=0x7f5900197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.258+0000 7f5907600700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58f4006010 tx=0x7f58f40050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 shutdown_connections 2024-04-26T20:56:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f58e8038820 0x7f58e803ace0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 --2- 172.21.15.55:0/1162205990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5900102a90 0x7f5900197ee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 >> 172.21.15.55:0/1162205990 conn(0x7f59000fe030 msgr2=0x7f59000fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 shutdown_connections 2024-04-26T20:56:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:56:24.259+0000 7f5907600700 1 -- 172.21.15.55:0/1162205990 wait complete. 2024-04-26T20:56:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-04-26T20:56:24.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:24 smithi055 ceph-mon[25475]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:24.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:24 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1162205990' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T20:56:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:25 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1162205990' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T20:56:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:25 smithi055 ceph-mon[25475]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T20:56:25.752 INFO:tasks.cephadm:Adding mon.smithi055 on smithi055 2024-04-26T20:56:25.752 INFO:tasks.cephadm:Adding mon.smithi064 on smithi064 2024-04-26T20:56:25.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi055:172.21.15.55=smithi055;smithi064:172.21.15.64=smithi064' 2024-04-26T20:56:26.152 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:26.255 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:26 smithi055 ceph-mon[25475]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:28.563 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:28 smithi055 ceph-mon[25475]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:28.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.945+0000 7fe7f6400700 1 -- 172.21.15.64:0/2368937149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 msgr2=0x7fe7f0103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:28.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.945+0000 7fe7f6400700 1 --2- 172.21.15.64:0/2368937149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0103530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009910 tx=0x7fe7e4009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:28.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.946+0000 7fe7f6400700 1 -- 172.21.15.64:0/2368937149 shutdown_connections 2024-04-26T20:56:28.948 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.946+0000 7fe7f6400700 1 --2- 172.21.15.64:0/2368937149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0103530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:28.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.946+0000 7fe7f6400700 1 -- 172.21.15.64:0/2368937149 >> 172.21.15.64:0/2368937149 conn(0x7fe7f00fab50 msgr2=0x7fe7f00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:28.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.946+0000 7fe7f6400700 1 -- 172.21.15.64:0/2368937149 shutdown_connections 2024-04-26T20:56:28.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.946+0000 7fe7f6400700 1 -- 172.21.15.64:0/2368937149 wait complete. 2024-04-26T20:56:28.949 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.947+0000 7fe7f6400700 1 Processor -- start 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.947+0000 7fe7f6400700 1 -- start start 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.947+0000 7fe7f6400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.947+0000 7fe7f6400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0198280 con 0x7fe7f0101140 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.948+0000 7fe7f5000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.948+0000 7fe7f5000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:54554/0 (socket says 172.21.15.64:54554) 2024-04-26T20:56:28.950 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.948+0000 7fe7f5000700 1 -- 172.21.15.64:0/1321455533 learned_addr learned my addr 172.21.15.64:0/1321455533 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:28.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.949+0000 7fe7f5000700 1 -- 172.21.15.64:0/1321455533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e40095f0 con 0x7fe7f0101140 2024-04-26T20:56:28.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.949+0000 7fe7f5000700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009ed0 tx=0x7fe7e4004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:28.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.950+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e401d070 con 0x7fe7f0101140 2024-04-26T20:56:28.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.950+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0198480 con 0x7fe7f0101140 2024-04-26T20:56:28.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.950+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0198920 con 0x7fe7f0101140 2024-04-26T20:56:28.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.950+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7e400be20 con 0x7fe7f0101140 2024-04-26T20:56:28.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.950+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7e400f460 con 0x7fe7f0101140 2024-04-26T20:56:28.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.951+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f01918e0 con 0x7fe7f0101140 2024-04-26T20:56:28.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.951+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe7e40227e0 con 0x7fe7f0101140 2024-04-26T20:56:28.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.952+0000 7fe7ed600700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 0x7fe7d803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:28.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.952+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe7e404c830 con 0x7fe7f0101140 2024-04-26T20:56:28.954 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.953+0000 7fe7efe00700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 0x7fe7d803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:28.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.954+0000 7fe7efe00700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 0x7fe7d803ace0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc006fd0 tx=0x7fe7dc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:28.970 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:28.968+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe7e4022470 con 0x7fe7f0101140 2024-04-26T20:56:29.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.209+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 --> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi055:172.21.15.55=smithi055;smithi064:172.21.15.64=smithi064", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7f002ce90 con 0x7fe7d8038820 2024-04-26T20:56:29.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.226+0000 7fe7ed600700 1 -- 172.21.15.64:0/1321455533 <== mgr.14164 v2:172.21.15.55:6800/154137240 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe7f002ce90 con 0x7fe7d8038820 2024-04-26T20:56:29.228 INFO:teuthology.orchestra.run.smithi064.stdout:Scheduled mon update... 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.229+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 msgr2=0x7fe7d803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.229+0000 7fe7f6400700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 0x7fe7d803ace0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc006fd0 tx=0x7fe7dc006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 msgr2=0x7fe7f0197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009ed0 tx=0x7fe7e4004690 comp rx=0 tx=0).stop 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 shutdown_connections 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fe7d8038820 0x7fe7d803ace0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 --2- 172.21.15.64:0/1321455533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f0101140 0x7fe7f0197d40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 >> 172.21.15.64:0/1321455533 conn(0x7fe7f00fab50 msgr2=0x7fe7f00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:29.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 shutdown_connections 2024-04-26T20:56:29.233 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:29.230+0000 7fe7f6400700 1 -- 172.21.15.64:0/1321455533 wait complete. 2024-04-26T20:56:29.872 DEBUG:teuthology.orchestra.run.smithi064:mon.smithi064> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064.service 2024-04-26T20:56:29.879 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:29.879 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:30.247 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:30.344 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:30 smithi055 ceph-mon[25475]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:30 smithi055 ceph-mon[25475]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi055:172.21.15.55=smithi055;smithi064:172.21.15.64=smithi064", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:56:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:30 smithi055 ceph-mon[25475]: Saving service mon spec with placement smithi055:172.21.15.55=smithi055;smithi064:172.21.15.64=smithi064;count:2 2024-04-26T20:56:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:30 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 -- 172.21.15.64:0/298047787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 msgr2=0x7ff6f4075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 --2- 172.21.15.64:0/298047787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f4075cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009910 tx=0x7ff6e8009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 -- 172.21.15.64:0/298047787 shutdown_connections 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 --2- 172.21.15.64:0/298047787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f4075cb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 -- 172.21.15.64:0/298047787 >> 172.21.15.64:0/298047787 conn(0x7ff6f40fde70 msgr2=0x7ff6f4100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 -- 172.21.15.64:0/298047787 shutdown_connections 2024-04-26T20:56:32.286 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.283+0000 7ff6fb200700 1 -- 172.21.15.64:0/298047787 wait complete. 2024-04-26T20:56:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.285+0000 7ff6fb200700 1 Processor -- start 2024-04-26T20:56:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.285+0000 7ff6fb200700 1 -- start start 2024-04-26T20:56:32.287 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.285+0000 7ff6fb200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.285+0000 7ff6fb200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f419c630 con 0x7ff6f4075890 2024-04-26T20:56:32.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.286+0000 7ff6f9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.286+0000 7ff6f9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:54568/0 (socket says 172.21.15.64:54568) 2024-04-26T20:56:32.288 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.286+0000 7ff6f9e00700 1 -- 172.21.15.64:0/1175053934 learned_addr learned my addr 172.21.15.64:0/1175053934 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.286+0000 7ff6f9e00700 1 -- 172.21.15.64:0/1175053934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80095f0 con 0x7ff6f4075890 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6f9e00700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8006010 tx=0x7ff6e80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6e801d070 con 0x7ff6f4075890 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6e800be20 con 0x7ff6f4075890 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f419c830 con 0x7ff6f4075890 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6e800f460 con 0x7ff6f4075890 2024-04-26T20:56:32.289 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.287+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f419ccd0 con 0x7ff6f4075890 2024-04-26T20:56:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.288+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f4195ad0 con 0x7ff6f4075890 2024-04-26T20:56:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.288+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff6e800b960 con 0x7ff6f4075890 2024-04-26T20:56:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.289+0000 7ff6eea00700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 0x7ff6dc03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:32.290 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.289+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff6e804c990 con 0x7ff6f4075890 2024-04-26T20:56:32.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.289+0000 7ff6f9400700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 0x7ff6dc03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:32.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.290+0000 7ff6f9400700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 0x7ff6dc03ace0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4006fd0 tx=0x7ff6e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:32.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.298+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff6e8005c00 con 0x7ff6f4075890 2024-04-26T20:56:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-26T20:56:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:32 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:32.611 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.609+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff6f4062510 con 0x7ff6f4075890 2024-04-26T20:56:32.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.610+0000 7ff6eea00700 1 -- 172.21.15.64:0/1175053934 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff6e8027070 con 0x7ff6f4075890 2024-04-26T20:56:32.612 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:32.612 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:32.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.612+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 msgr2=0x7ff6dc03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.614 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.612+0000 7ff6fb200700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 0x7ff6dc03ace0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4006fd0 tx=0x7ff6e4006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.612+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 msgr2=0x7ff6f419c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.612+0000 7ff6fb200700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8006010 tx=0x7ff6e80050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 shutdown_connections 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7ff6dc038820 0x7ff6dc03ace0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 --2- 172.21.15.64:0/1175053934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6f4075890 0x7ff6f419c0f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 >> 172.21.15.64:0/1175053934 conn(0x7ff6f40fde70 msgr2=0x7ff6f40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 shutdown_connections 2024-04-26T20:56:32.615 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:32.613+0000 7ff6fb200700 1 -- 172.21.15.64:0/1175053934 wait complete. 2024-04-26T20:56:32.616 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:33 smithi055 ceph-mon[25475]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-26T20:56:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:33 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-26T20:56:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:33 smithi055 ceph-mon[25475]: Deploying daemon grafana.smithi055 on smithi055 2024-04-26T20:56:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:33 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1175053934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:34.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:34 smithi055 ceph-mon[25475]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:34.544 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:34.544 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:34.925 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:35.023 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:36.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:36 smithi055 ceph-mon[25475]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 -- 172.21.15.64:0/3591270273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 msgr2=0x7fd464073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 --2- 172.21.15.64:0/3591270273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd464073370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd454009910 tx=0x7fd454009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 -- 172.21.15.64:0/3591270273 shutdown_connections 2024-04-26T20:56:37.637 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 --2- 172.21.15.64:0/3591270273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd464073370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 -- 172.21.15.64:0/3591270273 >> 172.21.15.64:0/3591270273 conn(0x7fd4640fbc80 msgr2=0x7fd4640fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 -- 172.21.15.64:0/3591270273 shutdown_connections 2024-04-26T20:56:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.635+0000 7fd468a00700 1 -- 172.21.15.64:0/3591270273 wait complete. 2024-04-26T20:56:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.636+0000 7fd468a00700 1 Processor -- start 2024-04-26T20:56:37.638 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.637+0000 7fd468a00700 1 -- start start 2024-04-26T20:56:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.637+0000 7fd468a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.637+0000 7fd468a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46419c840 con 0x7fd464074f10 2024-04-26T20:56:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.638+0000 7fd463400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.638+0000 7fd463400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:46584/0 (socket says 172.21.15.64:46584) 2024-04-26T20:56:37.639 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.638+0000 7fd463400700 1 -- 172.21.15.64:0/896115108 learned_addr learned my addr 172.21.15.64:0/896115108 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.638+0000 7fd463400700 1 -- 172.21.15.64:0/896115108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540095f0 con 0x7fd464074f10 2024-04-26T20:56:37.640 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd463400700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd454006010 tx=0x7fd454009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:37.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd45401d070 con 0x7fd464074f10 2024-04-26T20:56:37.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464104300 con 0x7fd464074f10 2024-04-26T20:56:37.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd454005dc0 con 0x7fd464074f10 2024-04-26T20:56:37.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd454022e90 con 0x7fd464074f10 2024-04-26T20:56:37.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.639+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46419cd50 con 0x7fd464074f10 2024-04-26T20:56:37.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.640+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464195c90 con 0x7fd464074f10 2024-04-26T20:56:37.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.641+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fd454022470 con 0x7fd464074f10 2024-04-26T20:56:37.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.642+0000 7fd45be00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 0x7fd44803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:37.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.642+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd45404c8d0 con 0x7fd464074f10 2024-04-26T20:56:37.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.642+0000 7fd462a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 0x7fd44803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:37.645 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.643+0000 7fd462a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 0x7fd44803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd450006fd0 tx=0x7fd450006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:37.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.657+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd45400b960 con 0x7fd464074f10 2024-04-26T20:56:37.973 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.971+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd46410d5c0 con 0x7fd464074f10 2024-04-26T20:56:37.974 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.973+0000 7fd45be00700 1 -- 172.21.15.64:0/896115108 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd454027030 con 0x7fd464074f10 2024-04-26T20:56:37.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:37.975 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:37.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.975+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 msgr2=0x7fd44803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 0x7fd44803ac20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd450006fd0 tx=0x7fd450006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:37.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 msgr2=0x7fd46419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:37.977 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd454006010 tx=0x7fd454009f80 comp rx=0 tx=0).stop 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 shutdown_connections 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd448038760 0x7fd44803ac20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 --2- 172.21.15.64:0/896115108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd464074f10 0x7fd46419c300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 >> 172.21.15.64:0/896115108 conn(0x7fd4640fbc80 msgr2=0x7fd4640fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 shutdown_connections 2024-04-26T20:56:37.978 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:37.976+0000 7fd468a00700 1 -- 172.21.15.64:0/896115108 wait complete. 2024-04-26T20:56:37.979 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:38 smithi055 ceph-mon[25475]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:38 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/896115108' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:39.880 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:39.881 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:40.262 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:40.364 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:40.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:40 smithi055 ceph-mon[25475]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:42.330 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 -- 172.21.15.64:0/2877735207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 msgr2=0x7f246c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 --2- 172.21.15.64:0/2877735207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c102eb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2460009910 tx=0x7f2460009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 -- 172.21.15.64:0/2877735207 shutdown_connections 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 --2- 172.21.15.64:0/2877735207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c102eb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 -- 172.21.15.64:0/2877735207 >> 172.21.15.64:0/2877735207 conn(0x7f246c0fe050 msgr2=0x7f246c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 -- 172.21.15.64:0/2877735207 shutdown_connections 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.329+0000 7f2474200700 1 -- 172.21.15.64:0/2877735207 wait complete. 2024-04-26T20:56:42.331 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.331+0000 7f2474200700 1 Processor -- start 2024-04-26T20:56:42.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.331+0000 7f2474200700 1 -- start start 2024-04-26T20:56:42.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.331+0000 7f2474200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:42.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.331+0000 7f2474200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c198440 con 0x7f246c102a90 2024-04-26T20:56:42.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.332+0000 7f2471800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:42.332 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.332+0000 7f2471800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:46600/0 (socket says 172.21.15.64:46600) 2024-04-26T20:56:42.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.332+0000 7f2471800700 1 -- 172.21.15.64:0/2169838250 learned_addr learned my addr 172.21.15.64:0/2169838250 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:42.333 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.333+0000 7f2471800700 1 -- 172.21.15.64:0/2169838250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600095f0 con 0x7f246c102a90 2024-04-26T20:56:42.334 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.333+0000 7f2471800700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2460006010 tx=0x7f24600050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:42.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.334+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f246001d070 con 0x7f246c102a90 2024-04-26T20:56:42.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.334+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f246000be20 con 0x7f246c102a90 2024-04-26T20:56:42.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.334+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c198640 con 0x7f246c102a90 2024-04-26T20:56:42.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.334+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2460022de0 con 0x7f246c102a90 2024-04-26T20:56:42.335 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.334+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c198ae0 con 0x7f246c102a90 2024-04-26T20:56:42.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.335+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c1918c0 con 0x7f246c102a90 2024-04-26T20:56:42.336 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.336+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f24600226c0 con 0x7f246c102a90 2024-04-26T20:56:42.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.336+0000 7f246a000700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 0x7f245403ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:42.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.336+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f246004c9c0 con 0x7f246c102a90 2024-04-26T20:56:42.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.337+0000 7f2470e00700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 0x7f245403ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:42.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.338+0000 7f2470e00700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 0x7f245403ac70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f2458006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:42.348 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.348+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f246000b960 con 0x7f246c102a90 2024-04-26T20:56:42.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.660+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f246c062510 con 0x7f246c102a90 2024-04-26T20:56:42.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.661+0000 7f246a000700 1 -- 172.21.15.64:0/2169838250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2460027070 con 0x7f246c102a90 2024-04-26T20:56:42.663 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:42.663 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 msgr2=0x7f245403ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 0x7f245403ac70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f2458006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 msgr2=0x7f246c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2460006010 tx=0x7f24600050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 shutdown_connections 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f24540387b0 0x7f245403ac70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 --2- 172.21.15.64:0/2169838250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f246c102a90 0x7f246c197f00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.664+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 >> 172.21.15.64:0/2169838250 conn(0x7f246c0fe050 msgr2=0x7f246c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.665+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 shutdown_connections 2024-04-26T20:56:42.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:42.665+0000 7f2474200700 1 -- 172.21.15.64:0/2169838250 wait complete. 2024-04-26T20:56:42.667 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:42.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:42 smithi055 ceph-mon[25475]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:43.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:43 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/2169838250' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:44.536 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:44.536 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:44.743 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:44 smithi055 ceph-mon[25475]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:44.945 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:45.067 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:46.545 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:46 smithi055 ceph-mon[25475]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:47.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 -- 172.21.15.64:0/1536123965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 msgr2=0x7fd2e8100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1536123965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8100c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b0a0 tx=0x7fd2d800b3b0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 -- 172.21.15.64:0/1536123965 shutdown_connections 2024-04-26T20:56:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1536123965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8100c90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 -- 172.21.15.64:0/1536123965 >> 172.21.15.64:0/1536123965 conn(0x7fd2e80fbe30 msgr2=0x7fd2e80fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 -- 172.21.15.64:0/1536123965 shutdown_connections 2024-04-26T20:56:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.296+0000 7fd2eec00700 1 -- 172.21.15.64:0/1536123965 wait complete. 2024-04-26T20:56:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.298+0000 7fd2eec00700 1 Processor -- start 2024-04-26T20:56:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.298+0000 7fd2eec00700 1 -- start start 2024-04-26T20:56:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.298+0000 7fd2eec00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.298+0000 7fd2eec00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8198480 con 0x7fd2e8100870 2024-04-26T20:56:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.299+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.299+0000 7fd2e7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:43406/0 (socket says 172.21.15.64:43406) 2024-04-26T20:56:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.299+0000 7fd2e7e00700 1 -- 172.21.15.64:0/1990421928 learned_addr learned my addr 172.21.15.64:0/1990421928 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.299+0000 7fd2e7e00700 1 -- 172.21.15.64:0/1990421928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009d00 con 0x7fd2e8100870 2024-04-26T20:56:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2e7e00700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800bc90 tx=0x7fd2d800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2d800e040 con 0x7fd2e8100870 2024-04-26T20:56:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e8198680 con 0x7fd2e8100870 2024-04-26T20:56:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8198b20 con 0x7fd2e8100870 2024-04-26T20:56:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2d8003d50 con 0x7fd2e8100870 2024-04-26T20:56:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.300+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2d8026900 con 0x7fd2e8100870 2024-04-26T20:56:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.301+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8191aa0 con 0x7fd2e8100870 2024-04-26T20:56:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.302+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fd2d8012640 con 0x7fd2e8100870 2024-04-26T20:56:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.302+0000 7fd2e5600700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 0x7fd2cc03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.302+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd2d804ca00 con 0x7fd2e8100870 2024-04-26T20:56:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.303+0000 7fd2df400700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 0x7fd2cc03acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:47.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.304+0000 7fd2df400700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 0x7fd2cc03acd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0006fd0 tx=0x7fd2d0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:47.309 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.309+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd2d8024540 con 0x7fd2e8100870 2024-04-26T20:56:47.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.616+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd2e8062510 con 0x7fd2e8100870 2024-04-26T20:56:47.618 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.618+0000 7fd2e5600700 1 -- 172.21.15.64:0/1990421928 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd2e8062510 con 0x7fd2e8100870 2024-04-26T20:56:47.618 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:47.619 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.620+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 msgr2=0x7fd2cc03acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 0x7fd2cc03acd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0006fd0 tx=0x7fd2d0006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 msgr2=0x7fd2e8197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800bc90 tx=0x7fd2d800bd70 comp rx=0 tx=0).stop 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 shutdown_connections 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fd2cc038810 0x7fd2cc03acd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 --2- 172.21.15.64:0/1990421928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e8100870 0x7fd2e8197f40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 >> 172.21.15.64:0/1990421928 conn(0x7fd2e80fbe30 msgr2=0x7fd2e80fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 shutdown_connections 2024-04-26T20:56:47.622 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:47.621+0000 7fd2eec00700 1 -- 172.21.15.64:0/1990421928 wait complete. 2024-04-26T20:56:47.623 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:48 smithi055 ceph-mon[25475]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:48 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1990421928' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:49.368 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:49.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:49.769 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:49.876 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:50.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:50 smithi055 ceph-mon[25475]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 -- 172.21.15.64:0/3173751063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 msgr2=0x7f03a8107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 --2- 172.21.15.64:0/3173751063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a8107510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0398009910 tx=0x7f0398009c20 comp rx=0 tx=0).stop 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 -- 172.21.15.64:0/3173751063 shutdown_connections 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 --2- 172.21.15.64:0/3173751063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a8107510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 -- 172.21.15.64:0/3173751063 >> 172.21.15.64:0/3173751063 conn(0x7f03a8075fd0 msgr2=0x7f03a8078430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 -- 172.21.15.64:0/3173751063 shutdown_connections 2024-04-26T20:56:52.034 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.032+0000 7f03ae600700 1 -- 172.21.15.64:0/3173751063 wait complete. 2024-04-26T20:56:52.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.033+0000 7f03ae600700 1 Processor -- start 2024-04-26T20:56:52.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.034+0000 7f03ae600700 1 -- start start 2024-04-26T20:56:52.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.034+0000 7f03ae600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.035 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.034+0000 7f03ae600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a819c840 con 0x7f03a81070f0 2024-04-26T20:56:52.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.035+0000 7f03a7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.035+0000 7f03a7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:43414/0 (socket says 172.21.15.64:43414) 2024-04-26T20:56:52.036 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.035+0000 7f03a7400700 1 -- 172.21.15.64:0/2605511107 learned_addr learned my addr 172.21.15.64:0/2605511107 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.035+0000 7f03a7400700 1 -- 172.21.15.64:0/2605511107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980095f0 con 0x7f03a81070f0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f03a7400700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0398006010 tx=0x7f03980050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039801d070 con 0x7f03a81070f0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f039800be20 con 0x7f03a81070f0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039800f460 con 0x7f03a81070f0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a819ca40 con 0x7f03a81070f0 2024-04-26T20:56:52.037 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.036+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a819cee0 con 0x7f03a81070f0 2024-04-26T20:56:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.037+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8195c30 con 0x7f03a81070f0 2024-04-26T20:56:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.038+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f0398022470 con 0x7f03a81070f0 2024-04-26T20:56:52.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.038+0000 7f039fe00700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 0x7f038c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:52.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.038+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f039804ccf0 con 0x7f03a81070f0 2024-04-26T20:56:52.039 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.039+0000 7f03a6a00700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 0x7f038c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:52.040 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.040+0000 7f03a6a00700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 0x7f038c03ace0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0394006fd0 tx=0x7f0394006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:52.049 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.049+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0398005c00 con 0x7f03a81070f0 2024-04-26T20:56:52.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.357+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03a8062510 con 0x7f03a81070f0 2024-04-26T20:56:52.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.358+0000 7f039fe00700 1 -- 172.21.15.64:0/2605511107 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f03a8062510 con 0x7f03a81070f0 2024-04-26T20:56:52.359 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:52.359 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.360+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 msgr2=0x7f038c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.360+0000 7f03ae600700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 0x7f038c03ace0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0394006fd0 tx=0x7f0394006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:52.361 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.360+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 msgr2=0x7f03a819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.360+0000 7f03ae600700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0398006010 tx=0x7f03980050b0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 shutdown_connections 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f038c038820 0x7f038c03ace0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 --2- 172.21.15.64:0/2605511107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a81070f0 0x7f03a819c300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 >> 172.21.15.64:0/2605511107 conn(0x7f03a8075fd0 msgr2=0x7f03a8076a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 shutdown_connections 2024-04-26T20:56:52.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:52.361+0000 7f03ae600700 1 -- 172.21.15.64:0/2605511107 wait complete. 2024-04-26T20:56:52.363 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:52.431 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:52 smithi055 ceph-mon[25475]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:53.338 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:53 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/2605511107' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:54.067 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:54.067 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.376 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:54 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:54.449 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:54.561 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:55.569 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:55 smithi055 ceph-mon[25475]: Deploying daemon prometheus.smithi055 on smithi055 2024-04-26T20:56:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:56 smithi055 ceph-mon[25475]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:56.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.845+0000 7feed3400700 1 -- 172.21.15.64:0/669493748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 msgr2=0x7feecc073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.845+0000 7feed3400700 1 --2- 172.21.15.64:0/669493748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc073370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feec000b0a0 tx=0x7feec000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.846+0000 7feed3400700 1 -- 172.21.15.64:0/669493748 shutdown_connections 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.846+0000 7feed3400700 1 --2- 172.21.15.64:0/669493748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc073370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.846+0000 7feed3400700 1 -- 172.21.15.64:0/669493748 >> 172.21.15.64:0/669493748 conn(0x7feecc0fbe10 msgr2=0x7feecc0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.846+0000 7feed3400700 1 -- 172.21.15.64:0/669493748 shutdown_connections 2024-04-26T20:56:56.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.846+0000 7feed3400700 1 -- 172.21.15.64:0/669493748 wait complete. 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.847+0000 7feed3400700 1 Processor -- start 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.847+0000 7feed3400700 1 -- start start 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.847+0000 7feed3400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.847+0000 7feed3400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc198490 con 0x7feecc074f10 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.848+0000 7feed0a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.848+0000 7feed0a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:42108/0 (socket says 172.21.15.64:42108) 2024-04-26T20:56:56.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.848+0000 7feed0a00700 1 -- 172.21.15.64:0/1307918820 learned_addr learned my addr 172.21.15.64:0/1307918820 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:56:56.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.849+0000 7feed0a00700 1 -- 172.21.15.64:0/1307918820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009d00 con 0x7feecc074f10 2024-04-26T20:56:56.849 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.849+0000 7feed0a00700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feec000bc90 tx=0x7feec000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.850+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feec000e040 con 0x7feecc074f10 2024-04-26T20:56:56.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.850+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc198690 con 0x7feecc074f10 2024-04-26T20:56:56.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.850+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feec0003d50 con 0x7feecc074f10 2024-04-26T20:56:56.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.850+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feec001c8f0 con 0x7feecc074f10 2024-04-26T20:56:56.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.850+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc198b30 con 0x7feecc074f10 2024-04-26T20:56:56.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.851+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc1918b0 con 0x7feecc074f10 2024-04-26T20:56:56.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.851+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7feec001cbb0 con 0x7feecc074f10 2024-04-26T20:56:56.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.852+0000 7feec9600700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 0x7feeb403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:56:56.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.852+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feec004ca40 con 0x7feecc074f10 2024-04-26T20:56:56.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.853+0000 7feecbe00700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 0x7feeb403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:56:56.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.854+0000 7feecbe00700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 0x7feeb403ad20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006fd0 tx=0x7feeb8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:56:56.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:56.869+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7feec001c400 con 0x7feecc074f10 2024-04-26T20:56:57.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.179+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feecc062510 con 0x7feecc074f10 2024-04-26T20:56:57.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.181+0000 7feec9600700 1 -- 172.21.15.64:0/1307918820 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7feecc062510 con 0x7feecc074f10 2024-04-26T20:56:57.182 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:56:57.182 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 msgr2=0x7feeb403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 0x7feeb403ad20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006fd0 tx=0x7feeb8006e40 comp rx=0 tx=0).stop 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 msgr2=0x7feecc197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feec000bc90 tx=0x7feec000bd70 comp rx=0 tx=0).stop 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 shutdown_connections 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7feeb4038860 0x7feeb403ad20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 --2- 172.21.15.64:0/1307918820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc074f10 0x7feecc197f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 >> 172.21.15.64:0/1307918820 conn(0x7feecc0fbe10 msgr2=0x7feecc0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:56:57.185 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 shutdown_connections 2024-04-26T20:56:57.186 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:56:57.184+0000 7feed3400700 1 -- 172.21.15.64:0/1307918820 wait complete. 2024-04-26T20:56:57.186 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:56:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:57 smithi055 ceph-mon[25475]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:56:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:57 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:56:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:57 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1307918820' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:56:58.975 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:56:58.975 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:56:59.366 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:59.483 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:56:59.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:56:59 smithi055 ceph-mon[25475]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 -- 172.21.15.64:0/3664576504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 msgr2=0x7f03e8103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 --2- 172.21.15.64:0/3664576504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e8103590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009910 tx=0x7f03dc009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 -- 172.21.15.64:0/3664576504 shutdown_connections 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 --2- 172.21.15.64:0/3664576504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e8103590 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 -- 172.21.15.64:0/3664576504 >> 172.21.15.64:0/3664576504 conn(0x7f03e80fab50 msgr2=0x7f03e80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 -- 172.21.15.64:0/3664576504 shutdown_connections 2024-04-26T20:57:01.626 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.624+0000 7f03ef200700 1 -- 172.21.15.64:0/3664576504 wait complete. 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.625+0000 7f03ef200700 1 Processor -- start 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.625+0000 7f03ef200700 1 -- start start 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.626+0000 7f03ef200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.626+0000 7f03ef200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8100f10 con 0x7f03e81011a0 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.626+0000 7f03ede00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.626+0000 7f03ede00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:42116/0 (socket says 172.21.15.64:42116) 2024-04-26T20:57:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.626+0000 7f03ede00700 1 -- 172.21.15.64:0/1506695852 learned_addr learned my addr 172.21.15.64:0/1506695852 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.627+0000 7f03ede00700 1 -- 172.21.15.64:0/1506695852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0095f0 con 0x7f03e81011a0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.627+0000 7f03ede00700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009ed0 tx=0x7f03dc004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.627+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03dc01d070 con 0x7f03e81011a0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.627+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e80ff150 con 0x7f03e81011a0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.628+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e80ff5f0 con 0x7f03e81011a0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.628+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03dc00be20 con 0x7f03e81011a0 2024-04-26T20:57:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.628+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03dc00f460 con 0x7f03e81011a0 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.629+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e8106e10 con 0x7f03e81011a0 2024-04-26T20:57:01.629 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.629+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f03dc00b960 con 0x7f03e81011a0 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.629+0000 7f03e2a00700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 0x7f03d003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.629+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f03dc04c840 con 0x7f03e81011a0 2024-04-26T20:57:01.630 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.630+0000 7f03ed400700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 0x7f03d003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:01.631 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.631+0000 7f03ed400700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 0x7f03d003ad30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.641+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f03dc0227e0 con 0x7f03e81011a0 2024-04-26T20:57:01.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.954+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03e8062510 con 0x7f03e81011a0 2024-04-26T20:57:01.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.955+0000 7f03e2a00700 1 -- 172.21.15.64:0/1506695852 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f03dc027020 con 0x7f03e81011a0 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:01.956 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 msgr2=0x7f03d003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 0x7f03d003ad30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 msgr2=0x7f03e81009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009ed0 tx=0x7f03dc004690 comp rx=0 tx=0).stop 2024-04-26T20:57:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 shutdown_connections 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f03d0038870 0x7f03d003ad30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 --2- 172.21.15.64:0/1506695852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03e81011a0 0x7f03e81009d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 >> 172.21.15.64:0/1506695852 conn(0x7f03e80fab50 msgr2=0x7f03e80fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 shutdown_connections 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:01.958+0000 7f03ef200700 1 -- 172.21.15.64:0/1506695852 wait complete. 2024-04-26T20:57:01.960 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:02.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:01 smithi055 ceph-mon[25475]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:02.881 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:02 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1506695852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:03.637 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:03.637 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:04.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:03 smithi055 ceph-mon[25475]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:04.039 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:04.186 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:05.725 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:05 smithi055 ceph-mon[25475]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 -- 172.21.15.64:0/2809074473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 msgr2=0x7f5db8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 --2- 172.21.15.64:0/2809074473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8102eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5da800b0a0 tx=0x7f5da800b3b0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 -- 172.21.15.64:0/2809074473 shutdown_connections 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 --2- 172.21.15.64:0/2809074473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8102eb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 -- 172.21.15.64:0/2809074473 >> 172.21.15.64:0/2809074473 conn(0x7f5db80fe050 msgr2=0x7f5db8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 -- 172.21.15.64:0/2809074473 shutdown_connections 2024-04-26T20:57:06.212 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.211+0000 7f5dbec00700 1 -- 172.21.15.64:0/2809074473 wait complete. 2024-04-26T20:57:06.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.213+0000 7f5dbec00700 1 Processor -- start 2024-04-26T20:57:06.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.213+0000 7f5dbec00700 1 -- start start 2024-04-26T20:57:06.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.213+0000 7f5dbec00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.213+0000 7f5dbec00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8198440 con 0x7f5db8102a90 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.214+0000 7f5db7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.214+0000 7f5db7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:60228/0 (socket says 172.21.15.64:60228) 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.214+0000 7f5db7e00700 1 -- 172.21.15.64:0/1567228249 learned_addr learned my addr 172.21.15.64:0/1567228249 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.214+0000 7f5db7e00700 1 -- 172.21.15.64:0/1567228249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8009d00 con 0x7f5db8102a90 2024-04-26T20:57:06.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.215+0000 7f5db7e00700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5da800bc90 tx=0x7f5da800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.215+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5da800e040 con 0x7f5db8102a90 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.215+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5da8003d50 con 0x7f5db8102a90 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.215+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5da801c8f0 con 0x7f5db8102a90 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.215+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8198640 con 0x7f5db8102a90 2024-04-26T20:57:06.216 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.216+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db8198ae0 con 0x7f5db8102a90 2024-04-26T20:57:06.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.217+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db81918c0 con 0x7f5db8102a90 2024-04-26T20:57:06.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.217+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f5da801cb60 con 0x7f5db8102a90 2024-04-26T20:57:06.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.218+0000 7f5db5600700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 0x7f5d9c03ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:06.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.218+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5da804cbf0 con 0x7f5db8102a90 2024-04-26T20:57:06.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.218+0000 7f5daf400700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 0x7f5d9c03ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:06.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.219+0000 7f5daf400700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 0x7f5d9c03ad20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5da0006fd0 tx=0x7f5da0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:06.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.228+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5da801ce10 con 0x7f5db8102a90 2024-04-26T20:57:06.544 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.543+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5db8062510 con 0x7f5db8102a90 2024-04-26T20:57:06.545 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.544+0000 7f5db5600700 1 -- 172.21.15.64:0/1567228249 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5da801a3b0 con 0x7f5db8102a90 2024-04-26T20:57:06.545 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:06.545 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 msgr2=0x7f5d9c03ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 0x7f5d9c03ad20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5da0006fd0 tx=0x7f5da0006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 msgr2=0x7f5db8197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5da800bc90 tx=0x7f5da800bd70 comp rx=0 tx=0).stop 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 shutdown_connections 2024-04-26T20:57:06.548 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f5d9c038860 0x7f5d9c03ad20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 --2- 172.21.15.64:0/1567228249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5db8102a90 0x7f5db8197f00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 >> 172.21.15.64:0/1567228249 conn(0x7f5db80fe050 msgr2=0x7f5db80feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.547+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 shutdown_connections 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:06.548+0000 7f5dbec00700 1 -- 172.21.15.64:0/1567228249 wait complete. 2024-04-26T20:57:06.549 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:07.838 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:07 smithi055 ceph-mon[25475]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:07.839 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:07 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1567228249' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:08.441 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:08.442 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:08.830 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:08.937 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:09.836 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:09 smithi055 ceph-mon[25475]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.905+0000 7fef96c00700 1 -- 172.21.15.64:0/2406175646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 msgr2=0x7fef90073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.905+0000 7fef96c00700 1 --2- 172.21.15.64:0/2406175646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90073310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8000b0a0 tx=0x7fef8000b3b0 comp rx=0 tx=0).stop 2024-04-26T20:57:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.906+0000 7fef96c00700 1 -- 172.21.15.64:0/2406175646 shutdown_connections 2024-04-26T20:57:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.906+0000 7fef96c00700 1 --2- 172.21.15.64:0/2406175646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90073310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.906+0000 7fef96c00700 1 -- 172.21.15.64:0/2406175646 >> 172.21.15.64:0/2406175646 conn(0x7fef900fbe30 msgr2=0x7fef900fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.906+0000 7fef96c00700 1 -- 172.21.15.64:0/2406175646 shutdown_connections 2024-04-26T20:57:10.908 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.906+0000 7fef96c00700 1 -- 172.21.15.64:0/2406175646 wait complete. 2024-04-26T20:57:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.907+0000 7fef96c00700 1 Processor -- start 2024-04-26T20:57:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.907+0000 7fef96c00700 1 -- start start 2024-04-26T20:57:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.908+0000 7fef96c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:10.913 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.908+0000 7fef96c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90198420 con 0x7fef90074eb0 2024-04-26T20:57:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.908+0000 7fef8fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.909+0000 7fef8fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:60242/0 (socket says 172.21.15.64:60242) 2024-04-26T20:57:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.909+0000 7fef8fe00700 1 -- 172.21.15.64:0/1974809602 learned_addr learned my addr 172.21.15.64:0/1974809602 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.909+0000 7fef8fe00700 1 -- 172.21.15.64:0/1974809602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80009d00 con 0x7fef90074eb0 2024-04-26T20:57:10.914 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef8fe00700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef80015040 tx=0x7fef8000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef8000e040 con 0x7fef90074eb0 2024-04-26T20:57:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90198620 con 0x7fef90074eb0 2024-04-26T20:57:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef80003d70 con 0x7fef90074eb0 2024-04-26T20:57:10.917 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef8001c9e0 con 0x7fef90074eb0 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.910+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90198ac0 con 0x7fef90074eb0 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.911+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef901918a0 con 0x7fef90074eb0 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.912+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fef80012640 con 0x7fef90074eb0 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.912+0000 7fef8d600700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 0x7fef7403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.912+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fef8004cdc0 con 0x7fef90074eb0 2024-04-26T20:57:10.918 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.913+0000 7fef87400700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 0x7fef7403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:10.919 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.914+0000 7fef87400700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 0x7fef7403ad20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef78006fd0 tx=0x7fef78006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:10.928 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:10.927+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fef80024dc0 con 0x7fef90074eb0 2024-04-26T20:57:11.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.239+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fef90062510 con 0x7fef90074eb0 2024-04-26T20:57:11.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.241+0000 7fef8d600700 1 -- 172.21.15.64:0/1974809602 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fef80024360 con 0x7fef90074eb0 2024-04-26T20:57:11.242 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:11.242 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 msgr2=0x7fef7403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 0x7fef7403ad20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef78006fd0 tx=0x7fef78006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 msgr2=0x7fef90197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef80015040 tx=0x7fef8000bd40 comp rx=0 tx=0).stop 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 shutdown_connections 2024-04-26T20:57:11.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fef74038860 0x7fef7403ad20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 --2- 172.21.15.64:0/1974809602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef90074eb0 0x7fef90197ee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:11.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 >> 172.21.15.64:0/1974809602 conn(0x7fef900fbe30 msgr2=0x7fef900fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:11.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 shutdown_connections 2024-04-26T20:57:11.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:11.244+0000 7fef96c00700 1 -- 172.21.15.64:0/1974809602 wait complete. 2024-04-26T20:57:11.246 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1974809602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-26T20:57:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:12 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:12.899 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:12.900 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:13.287 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:13.386 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:13 smithi055 ceph-mon[25475]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-26T20:57:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:13 smithi055 ceph-mon[25475]: mgrmap e14: smithi055.ybbowr(active, since 85s) 2024-04-26T20:57:15.375 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.373+0000 7fa118c00700 1 -- 172.21.15.64:0/3583358782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 msgr2=0x7fa114102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.373+0000 7fa118c00700 1 --2- 172.21.15.64:0/3583358782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114102ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa104009910 tx=0x7fa104009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.373+0000 7fa118c00700 1 -- 172.21.15.64:0/3583358782 shutdown_connections 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.373+0000 7fa118c00700 1 --2- 172.21.15.64:0/3583358782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114102ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.373+0000 7fa118c00700 1 -- 172.21.15.64:0/3583358782 >> 172.21.15.64:0/3583358782 conn(0x7fa1140fe060 msgr2=0x7fa114100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.374+0000 7fa118c00700 1 -- 172.21.15.64:0/3583358782 shutdown_connections 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.374+0000 7fa118c00700 1 -- 172.21.15.64:0/3583358782 wait complete. 2024-04-26T20:57:15.376 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.375+0000 7fa118c00700 1 Processor -- start 2024-04-26T20:57:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.375+0000 7fa118c00700 1 -- start start 2024-04-26T20:57:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.376+0000 7fa118c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.377 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.376+0000 7fa118c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114198420 con 0x7fa114102aa0 2024-04-26T20:57:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.376+0000 7fa111e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.376+0000 7fa111e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:60266/0 (socket says 172.21.15.64:60266) 2024-04-26T20:57:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.376+0000 7fa111e00700 1 -- 172.21.15.64:0/3178017897 learned_addr learned my addr 172.21.15.64:0/3178017897 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.377+0000 7fa111e00700 1 -- 172.21.15.64:0/3178017897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040095f0 con 0x7fa114102aa0 2024-04-26T20:57:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.378+0000 7fa111e00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa104006010 tx=0x7fa1040050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:15.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.378+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa10401d070 con 0x7fa114102aa0 2024-04-26T20:57:15.380 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.379+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa114198620 con 0x7fa114102aa0 2024-04-26T20:57:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.379+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa10400be20 con 0x7fa114102aa0 2024-04-26T20:57:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.379+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa104022de0 con 0x7fa114102aa0 2024-04-26T20:57:15.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.379+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114198ac0 con 0x7fa114102aa0 2024-04-26T20:57:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.380+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1141918d0 con 0x7fa114102aa0 2024-04-26T20:57:15.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.381+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7fa1040226c0 con 0x7fa114102aa0 2024-04-26T20:57:15.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.381+0000 7fa10aa00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 0x7fa0f803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:15.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.381+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa10404c8b0 con 0x7fa114102aa0 2024-04-26T20:57:15.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.381+0000 7fa10be00700 1 -- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 msgr2=0x7fa0f803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/154137240 2024-04-26T20:57:15.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.381+0000 7fa10be00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 0x7fa0f803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:57:15.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.397+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa10400b960 con 0x7fa114102aa0 2024-04-26T20:57:15.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.582+0000 7fa10be00700 1 -- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 msgr2=0x7fa0f803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/154137240 2024-04-26T20:57:15.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.582+0000 7fa10be00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 0x7fa0f803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:57:15.712 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.710+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa114062510 con 0x7fa114102aa0 2024-04-26T20:57:15.713 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.712+0000 7fa10aa00700 1 -- 172.21.15.64:0/3178017897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa114062510 con 0x7fa114102aa0 2024-04-26T20:57:15.714 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:15.714 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:15.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 msgr2=0x7fa0f803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 0x7fa0f803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 msgr2=0x7fa114197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa104006010 tx=0x7fa1040050b0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 shutdown_connections 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7fa0f8038870 0x7fa0f803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 --2- 172.21.15.64:0/3178017897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114102aa0 0x7fa114197ee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 >> 172.21.15.64:0/3178017897 conn(0x7fa1140fe060 msgr2=0x7fa1140fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 shutdown_connections 2024-04-26T20:57:15.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:15.715+0000 7fa118c00700 1 -- 172.21.15.64:0/3178017897 wait complete. 2024-04-26T20:57:15.718 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:16.056 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:15 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/3178017897' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:17.376 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:17.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:17.776 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:17.881 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 -- 172.21.15.64:0/82706815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 msgr2=0x7f2b981036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 --2- 172.21.15.64:0/82706815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b981036f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009910 tx=0x7f2b88009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 -- 172.21.15.64:0/82706815 shutdown_connections 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 --2- 172.21.15.64:0/82706815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b981036f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 -- 172.21.15.64:0/82706815 >> 172.21.15.64:0/82706815 conn(0x7f2b980fad10 msgr2=0x7f2b980fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 -- 172.21.15.64:0/82706815 shutdown_connections 2024-04-26T20:57:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.888+0000 7f2b9d000700 1 -- 172.21.15.64:0/82706815 wait complete. 2024-04-26T20:57:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.889+0000 7f2b9d000700 1 Processor -- start 2024-04-26T20:57:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.889+0000 7f2b9d000700 1 -- start start 2024-04-26T20:57:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.889+0000 7f2b9d000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.889+0000 7f2b9d000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98198410 con 0x7f2b98101300 2024-04-26T20:57:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.890+0000 7f2b95e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.890+0000 7f2b95e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:53188/0 (socket says 172.21.15.64:53188) 2024-04-26T20:57:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.890+0000 7f2b95e00700 1 -- 172.21.15.64:0/2853971501 learned_addr learned my addr 172.21.15.64:0/2853971501 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.891+0000 7f2b95e00700 1 -- 172.21.15.64:0/2853971501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880095f0 con 0x7f2b98101300 2024-04-26T20:57:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.891+0000 7f2b95e00700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b88006010 tx=0x7f2b880050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.891+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b8801d070 con 0x7f2b98101300 2024-04-26T20:57:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.891+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98198610 con 0x7f2b98101300 2024-04-26T20:57:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.891+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b8800be20 con 0x7f2b98101300 2024-04-26T20:57:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.892+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b8800f460 con 0x7f2b98101300 2024-04-26T20:57:19.893 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.892+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98198ab0 con 0x7f2b98101300 2024-04-26T20:57:19.894 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.893+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98191aa0 con 0x7f2b98101300 2024-04-26T20:57:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.893+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7f2b88022470 con 0x7f2b98101300 2024-04-26T20:57:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.894+0000 7f2b8ea00700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 0x7f2b7c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.894+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2b8804ccb0 con 0x7f2b98101300 2024-04-26T20:57:19.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.894+0000 7f2b8fe00700 1 -- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 msgr2=0x7f2b7c03ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/154137240 2024-04-26T20:57:19.896 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.894+0000 7f2b8fe00700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 0x7f2b7c03ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:57:19.910 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:19.909+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2b88005c00 con 0x7f2b98101300 2024-04-26T20:57:20.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.095+0000 7f2b8fe00700 1 -- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 msgr2=0x7f2b7c03ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/154137240 2024-04-26T20:57:20.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.095+0000 7f2b8fe00700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 0x7f2b7c03ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:57:20.224 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.222+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b98062510 con 0x7f2b98101300 2024-04-26T20:57:20.225 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.224+0000 7f2b8ea00700 1 -- 172.21.15.64:0/2853971501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2b88027030 con 0x7f2b98101300 2024-04-26T20:57:20.225 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:20.226 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:20.228 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.226+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 msgr2=0x7f2b7c03ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.226+0000 7f2b9d000700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 0x7f2b7c03ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.226+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 msgr2=0x7f2b98197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.226+0000 7f2b9d000700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b88006010 tx=0x7f2b880050b0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 shutdown_connections 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:6800/154137240,v1:172.21.15.55:6801/154137240] conn(0x7f2b7c038820 0x7f2b7c03ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 --2- 172.21.15.64:0/2853971501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b98101300 0x7f2b98197ed0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 >> 172.21.15.64:0/2853971501 conn(0x7f2b980fad10 msgr2=0x7f2b980fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 shutdown_connections 2024-04-26T20:57:20.229 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:20.227+0000 7f2b9d000700 1 -- 172.21.15.64:0/2853971501 wait complete. 2024-04-26T20:57:20.230 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:20.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:20 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/2853971501' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: Activating manager daemon smithi055.ybbowr 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: mgrmap e15: smithi055.ybbowr(active, starting, since 0.016375s) 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T20:57:21.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:57:21.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:57:21.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:57:21.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:21 smithi055 ceph-mon[25475]: Manager daemon smithi055.ybbowr is now available 2024-04-26T20:57:21.971 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:21.971 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:22.337 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:22.443 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T20:57:22.883 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:22 smithi055 ceph-mon[25475]: mgrmap e16: smithi055.ybbowr(active, since 1.01576s) 2024-04-26T20:57:24.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:23 smithi055 ceph-mon[25475]: [26/Apr/2024:20:57:22] ENGINE Bus STARTING 2024-04-26T20:57:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:23 smithi055 ceph-mon[25475]: [26/Apr/2024:20:57:22] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T20:57:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:23 smithi055 ceph-mon[25475]: [26/Apr/2024:20:57:23] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T20:57:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:23 smithi055 ceph-mon[25475]: [26/Apr/2024:20:57:23] ENGINE Bus STARTED 2024-04-26T20:57:24.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 -- 172.21.15.64:0/1150111190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 msgr2=0x7f0e3c100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1150111190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c100c90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009910 tx=0x7f0e2c009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:24.349 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 -- 172.21.15.64:0/1150111190 shutdown_connections 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1150111190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c100c90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 -- 172.21.15.64:0/1150111190 >> 172.21.15.64:0/1150111190 conn(0x7f0e3c0fbe10 msgr2=0x7f0e3c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.347+0000 7f0e40a00700 1 -- 172.21.15.64:0/1150111190 shutdown_connections 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.348+0000 7f0e40a00700 1 -- 172.21.15.64:0/1150111190 wait complete. 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.349+0000 7f0e40a00700 1 Processor -- start 2024-04-26T20:57:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.349+0000 7f0e40a00700 1 -- start start 2024-04-26T20:57:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.349+0000 7f0e40a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.349+0000 7f0e40a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1984c0 con 0x7f0e3c100870 2024-04-26T20:57:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.350+0000 7f0e39e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.350+0000 7f0e39e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:53206/0 (socket says 172.21.15.64:53206) 2024-04-26T20:57:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.350+0000 7f0e39e00700 1 -- 172.21.15.64:0/1506649988 learned_addr learned my addr 172.21.15.64:0/1506649988 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.351+0000 7f0e39e00700 1 -- 172.21.15.64:0/1506649988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0095f0 con 0x7f0e3c100870 2024-04-26T20:57:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.351+0000 7f0e39e00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006010 tx=0x7f0e2c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.352+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e2c01d070 con 0x7f0e3c100870 2024-04-26T20:57:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.352+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1986c0 con 0x7f0e3c100870 2024-04-26T20:57:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.352+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c198b60 con 0x7f0e3c100870 2024-04-26T20:57:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.352+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e2c00be20 con 0x7f0e3c100870 2024-04-26T20:57:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.352+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e2c022dc0 con 0x7f0e3c100870 2024-04-26T20:57:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.353+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c191aa0 con 0x7f0e3c100870 2024-04-26T20:57:24.356 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.355+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f0e2c00b960 con 0x7f0e3c100870 2024-04-26T20:57:24.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.355+0000 7f0e32a00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 0x7f0e2003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:24.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.355+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0e2c04cd90 con 0x7f0e3c100870 2024-04-26T20:57:24.357 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.356+0000 7f0e39400700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 0x7f0e2003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.358+0000 7f0e39400700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 0x7f0e2003ad80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006fd0 tx=0x7f0e28006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:24.374 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.373+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0e2c02ab80 con 0x7f0e3c100870 2024-04-26T20:57:24.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.688+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0e3c062510 con 0x7f0e3c100870 2024-04-26T20:57:24.690 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.689+0000 7f0e32a00700 1 -- 172.21.15.64:0/1506649988 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0e2c027030 con 0x7f0e3c100870 2024-04-26T20:57:24.691 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:24.691 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:24.693 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.691+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 msgr2=0x7f0e2003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.691+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 0x7f0e2003ad80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006fd0 tx=0x7f0e28006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.691+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 msgr2=0x7f0e3c197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.691+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c006010 tx=0x7f0e2c0050b0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.691+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 shutdown_connections 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.692+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0e200388c0 0x7f0e2003ad80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.692+0000 7f0e40a00700 1 --2- 172.21.15.64:0/1506649988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e3c100870 0x7f0e3c197f80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.692+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 >> 172.21.15.64:0/1506649988 conn(0x7f0e3c0fbe10 msgr2=0x7f0e3c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.692+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 shutdown_connections 2024-04-26T20:57:24.694 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:24.692+0000 7f0e40a00700 1 -- 172.21.15.64:0/1506649988 wait complete. 2024-04-26T20:57:24.695 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:24.894 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:24 smithi055 ceph-mon[25475]: mgrmap e17: smithi055.ybbowr(active, since 2s) 2024-04-26T20:57:24.895 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:25.859 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:25 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1506649988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:25.859 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:25 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:26.477 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:26.478 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:27.426 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:27.532 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-26T20:57:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.171+0000 7f36a5000700 1 -- 172.21.15.64:0/660903472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 msgr2=0x7f36a01036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.171+0000 7f36a5000700 1 --2- 172.21.15.64:0/660903472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a01036f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3690009910 tx=0x7f3690009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.172+0000 7f36a5000700 1 -- 172.21.15.64:0/660903472 shutdown_connections 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.172+0000 7f36a5000700 1 --2- 172.21.15.64:0/660903472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a01036f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.172+0000 7f36a5000700 1 -- 172.21.15.64:0/660903472 >> 172.21.15.64:0/660903472 conn(0x7f36a00fad10 msgr2=0x7f36a00fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.174 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.172+0000 7f36a5000700 1 -- 172.21.15.64:0/660903472 shutdown_connections 2024-04-26T20:57:30.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.172+0000 7f36a5000700 1 -- 172.21.15.64:0/660903472 wait complete. 2024-04-26T20:57:30.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.173+0000 7f36a5000700 1 Processor -- start 2024-04-26T20:57:30.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.173+0000 7f36a5000700 1 -- start start 2024-04-26T20:57:30.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.174+0000 7f36a5000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.175 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.174+0000 7f36a5000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01961f0 con 0x7f36a0101300 2024-04-26T20:57:30.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.174+0000 7f369de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.175+0000 7f369de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:51804/0 (socket says 172.21.15.64:51804) 2024-04-26T20:57:30.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.175+0000 7f369de00700 1 -- 172.21.15.64:0/2249654161 learned_addr learned my addr 172.21.15.64:0/2249654161 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:30.176 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.175+0000 7f369de00700 1 -- 172.21.15.64:0/2249654161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900095f0 con 0x7f36a0101300 2024-04-26T20:57:30.177 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f369de00700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3690006010 tx=0x7f36900050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f369001d070 con 0x7f36a0101300 2024-04-26T20:57:30.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01963f0 con 0x7f36a0101300 2024-04-26T20:57:30.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f369000be20 con 0x7f36a0101300 2024-04-26T20:57:30.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f369000f460 con 0x7f36a0101300 2024-04-26T20:57:30.178 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.176+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a0196890 con 0x7f36a0101300 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.177+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a018f6a0 con 0x7f36a0101300 2024-04-26T20:57:30.179 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.178+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f3690022470 con 0x7f36a0101300 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.178+0000 7f3696a00700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 0x7f368403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.178+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f369004ce00 con 0x7f36a0101300 2024-04-26T20:57:30.180 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.179+0000 7f369d400700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 0x7f368403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:30.181 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.180+0000 7f369d400700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 0x7f368403add0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:30.195 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.194+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f3690005c00 con 0x7f36a0101300 2024-04-26T20:57:30.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:30.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:30.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:57:30.507 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.505+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f36a0062510 con 0x7f36a0101300 2024-04-26T20:57:30.508 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.506+0000 7f3696a00700 1 -- 172.21.15.64:0/2249654161 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f36a0062510 con 0x7f36a0101300 2024-04-26T20:57:30.508 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:30.508 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 msgr2=0x7f368403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 0x7f368403add0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 msgr2=0x7f36a0195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3690006010 tx=0x7f36900050b0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 shutdown_connections 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f3684038910 0x7f368403add0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 --2- 172.21.15.64:0/2249654161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36a0101300 0x7f36a0195cb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 >> 172.21.15.64:0/2249654161 conn(0x7f36a00fad10 msgr2=0x7f36a00fb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 shutdown_connections 2024-04-26T20:57:30.511 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:30.509+0000 7f36a5000700 1 -- 172.21.15.64:0/2249654161 wait complete. 2024-04-26T20:57:30.512 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/2249654161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:31 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:32.226 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:32.227 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:32.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:32 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T20:57:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:32 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T20:57:32.586 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:33.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:33 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:33 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:33 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:57:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:33 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:57:34.406 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T20:57:34.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 -- 172.21.15.64:0/3540838104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 msgr2=0x7f31b8073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 --2- 172.21.15.64:0/3540838104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8073690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009910 tx=0x7f31a8009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 -- 172.21.15.64:0/3540838104 shutdown_connections 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 --2- 172.21.15.64:0/3540838104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8073690 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 -- 172.21.15.64:0/3540838104 >> 172.21.15.64:0/3540838104 conn(0x7f31b80fc2e0 msgr2=0x7f31b80fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 -- 172.21.15.64:0/3540838104 shutdown_connections 2024-04-26T20:57:34.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.659+0000 7f31be400700 1 -- 172.21.15.64:0/3540838104 wait complete. 2024-04-26T20:57:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.660+0000 7f31be400700 1 Processor -- start 2024-04-26T20:57:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.660+0000 7f31be400700 1 -- start start 2024-04-26T20:57:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.660+0000 7f31be400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.660+0000 7f31be400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8198870 con 0x7f31b80732b0 2024-04-26T20:57:34.661 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.661+0000 7f31b7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.661+0000 7f31b7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:51824/0 (socket says 172.21.15.64:51824) 2024-04-26T20:57:34.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.661+0000 7f31b7400700 1 -- 172.21.15.64:0/1792925650 learned_addr learned my addr 172.21.15.64:0/1792925650 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:34.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.662+0000 7f31b7400700 1 -- 172.21.15.64:0/1792925650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80095f0 con 0x7f31b80732b0 2024-04-26T20:57:34.662 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.662+0000 7f31b7400700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31a80098e0 tx=0x7f31a8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.663+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a801d070 con 0x7f31b80732b0 2024-04-26T20:57:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.663+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8198a70 con 0x7f31b80732b0 2024-04-26T20:57:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.663+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31a80056b0 con 0x7f31b80732b0 2024-04-26T20:57:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.663+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a8022d80 con 0x7f31b80732b0 2024-04-26T20:57:34.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.663+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8198e90 con 0x7f31b80732b0 2024-04-26T20:57:34.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.664+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b8074960 con 0x7f31b80732b0 2024-04-26T20:57:34.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.664+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f31a8022470 con 0x7f31b80732b0 2024-04-26T20:57:34.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.665+0000 7f31afe00700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 0x7f319c03adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:34.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.665+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f31a804c930 con 0x7f31b80732b0 2024-04-26T20:57:34.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.665+0000 7f31b6a00700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 0x7f319c03adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:34.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.667+0000 7f31b6a00700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 0x7f319c03adc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f31a4006fd0 tx=0x7f31a4006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:34.680 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:34.680+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f31a802a360 con 0x7f31b80732b0 2024-04-26T20:57:35.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.006+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f31b810ce40 con 0x7f31b80732b0 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.007+0000 7f31afe00700 1 -- 172.21.15.64:0/1792925650 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f31a8027030 con 0x7f31b80732b0 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:35.008 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 msgr2=0x7f319c03adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 0x7f319c03adc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f31a4006fd0 tx=0x7f31a4006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 msgr2=0x7f31b8198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31a80098e0 tx=0x7f31a8005520 comp rx=0 tx=0).stop 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 shutdown_connections 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f319c038900 0x7f319c03adc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 --2- 172.21.15.64:0/1792925650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80732b0 0x7f31b8198330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 >> 172.21.15.64:0/1792925650 conn(0x7f31b80fc2e0 msgr2=0x7f31b8104af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.010+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 shutdown_connections 2024-04-26T20:57:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:35.011+0000 7f31be400700 1 -- 172.21.15.64:0/1792925650 wait complete. 2024-04-26T20:57:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:35 smithi055 ceph-mon[25475]: Deploying daemon ceph-exporter.smithi064 on smithi064 2024-04-26T20:57:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1792925650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:37.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:36 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:57:37.581 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:37.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:37.971 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 -- 172.21.15.64:0/633067022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 msgr2=0x7fe75c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 --2- 172.21.15.64:0/633067022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c106be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009910 tx=0x7fe74c009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 -- 172.21.15.64:0/633067022 shutdown_connections 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 --2- 172.21.15.64:0/633067022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c106be0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 -- 172.21.15.64:0/633067022 >> 172.21.15.64:0/633067022 conn(0x7fe75c075290 msgr2=0x7fe75c0756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 -- 172.21.15.64:0/633067022 shutdown_connections 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.119+0000 7fe762600700 1 -- 172.21.15.64:0/633067022 wait complete. 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.121+0000 7fe762600700 1 Processor -- start 2024-04-26T20:57:40.197 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.121+0000 7fe762600700 1 -- start start 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.121+0000 7fe762600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.121+0000 7fe762600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c198800 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.122+0000 7fe75b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.122+0000 7fe75b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:55726/0 (socket says 172.21.15.64:55726) 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.122+0000 7fe75b400700 1 -- 172.21.15.64:0/1279316697 learned_addr learned my addr 172.21.15.64:0/1279316697 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.122+0000 7fe75b400700 1 -- 172.21.15.64:0/1279316697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0095f0 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.123+0000 7fe75b400700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe74c005490 tx=0x7fe74c005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.123+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74c01d070 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.123+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c198a60 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.124+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c198ee0 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.124+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe74c005700 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.124+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe74c0038e0 con 0x7fe75c106800 2024-04-26T20:57:40.198 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.125+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c0052f0 con 0x7fe75c106800 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.125+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fe74c003b50 con 0x7fe75c106800 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.126+0000 7fe753e00700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 0x7fe74003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.126+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe74c04c4f0 con 0x7fe75c106800 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.127+0000 7fe75aa00700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 0x7fe74003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.128+0000 7fe75aa00700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 0x7fe74003add0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:40.199 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.142+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe74c02a980 con 0x7fe75c106800 2024-04-26T20:57:40.459 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.458+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe73c0055a0 con 0x7fe75c106800 2024-04-26T20:57:40.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.460+0000 7fe753e00700 1 -- 172.21.15.64:0/1279316697 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe74c026020 con 0x7fe75c106800 2024-04-26T20:57:40.460 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:40.460 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 msgr2=0x7fe74003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 0x7fe74003add0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 msgr2=0x7fe75c1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe74c005490 tx=0x7fe74c005570 comp rx=0 tx=0).stop 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 shutdown_connections 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe740038910 0x7fe74003add0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 --2- 172.21.15.64:0/1279316697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe75c106800 0x7fe75c1982c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 >> 172.21.15.64:0/1279316697 conn(0x7fe75c075290 msgr2=0x7fe75c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 shutdown_connections 2024-04-26T20:57:40.464 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:40.463+0000 7fe762600700 1 -- 172.21.15.64:0/1279316697 wait complete. 2024-04-26T20:57:40.465 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:57:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T20:57:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: Deploying daemon crash.smithi064 on smithi064 2024-04-26T20:57:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:41 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1279316697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:42.182 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:42.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:42.669 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:42 smithi055 ceph-mon[25475]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:42 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:44.962 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:44 smithi055 ceph-mon[25475]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:45.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.076+0000 7fed60000700 1 -- 172.21.15.64:0/161506147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 msgr2=0x7fed58073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.078 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.076+0000 7fed60000700 1 --2- 172.21.15.64:0/161506147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58073690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009910 tx=0x7fed4c009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.077+0000 7fed60000700 1 -- 172.21.15.64:0/161506147 shutdown_connections 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.077+0000 7fed60000700 1 --2- 172.21.15.64:0/161506147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58073690 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.077+0000 7fed60000700 1 -- 172.21.15.64:0/161506147 >> 172.21.15.64:0/161506147 conn(0x7fed580fc310 msgr2=0x7fed580fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.077+0000 7fed60000700 1 -- 172.21.15.64:0/161506147 shutdown_connections 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.077+0000 7fed60000700 1 -- 172.21.15.64:0/161506147 wait complete. 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.078+0000 7fed60000700 1 Processor -- start 2024-04-26T20:57:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.079+0000 7fed60000700 1 -- start start 2024-04-26T20:57:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.079+0000 7fed60000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.079+0000 7fed60000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed581988b0 con 0x7fed580732b0 2024-04-26T20:57:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.080+0000 7fed5d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.080+0000 7fed5d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:55742/0 (socket says 172.21.15.64:55742) 2024-04-26T20:57:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.080+0000 7fed5d600700 1 -- 172.21.15.64:0/1214767681 learned_addr learned my addr 172.21.15.64:0/1214767681 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.081+0000 7fed5d600700 1 -- 172.21.15.64:0/1214767681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0095f0 con 0x7fed580732b0 2024-04-26T20:57:45.081 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.081+0000 7fed5d600700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed4c005490 tx=0x7fed4c005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.081+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed4c01d070 con 0x7fed580732b0 2024-04-26T20:57:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.082+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed58198ab0 con 0x7fed580732b0 2024-04-26T20:57:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.082+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed4c005700 con 0x7fed580732b0 2024-04-26T20:57:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.082+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed4c003950 con 0x7fed580732b0 2024-04-26T20:57:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.082+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed58198ed0 con 0x7fed580732b0 2024-04-26T20:57:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.083+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed58074960 con 0x7fed580732b0 2024-04-26T20:57:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.083+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fed4c004240 con 0x7fed580732b0 2024-04-26T20:57:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.084+0000 7fed56000700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 0x7fed4003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.084+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fed4c04c590 con 0x7fed580732b0 2024-04-26T20:57:45.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.084+0000 7fed5cc00700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 0x7fed4003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:45.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.085+0000 7fed5cc00700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 0x7fed4003ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed44006fd0 tx=0x7fed44006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:45.099 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.099+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fed4c00ed30 con 0x7fed580732b0 2024-04-26T20:57:45.413 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.413+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fed5810ce50 con 0x7fed580732b0 2024-04-26T20:57:45.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.414+0000 7fed56000700 1 -- 172.21.15.64:0/1214767681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fed4c026030 con 0x7fed580732b0 2024-04-26T20:57:45.415 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:45.415 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:45.417 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.416+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 msgr2=0x7fed4003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.416+0000 7fed60000700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 0x7fed4003ad80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed44006fd0 tx=0x7fed44006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 msgr2=0x7fed58198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed4c005490 tx=0x7fed4c005570 comp rx=0 tx=0).stop 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 shutdown_connections 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fed400388c0 0x7fed4003ad80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 --2- 172.21.15.64:0/1214767681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed580732b0 0x7fed58198370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 >> 172.21.15.64:0/1214767681 conn(0x7fed580fc310 msgr2=0x7fed58104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 shutdown_connections 2024-04-26T20:57:45.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:45.417+0000 7fed60000700 1 -- 172.21.15.64:0/1214767681 wait complete. 2024-04-26T20:57:45.419 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:46.201 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:46.201 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:46.201 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:46.202 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:46.202 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: Deploying daemon node-exporter.smithi064 on smithi064 2024-04-26T20:57:46.202 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:45 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1214767681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:47.148 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:47.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:47 smithi055 ceph-mon[25475]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:47.546 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:49.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:49 smithi055 ceph-mon[25475]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 -- 172.21.15.64:0/2849869558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 msgr2=0x7f7948106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 --2- 172.21.15.64:0/2849869558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f7948106a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f793c009910 tx=0x7f793c009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 -- 172.21.15.64:0/2849869558 shutdown_connections 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 --2- 172.21.15.64:0/2849869558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f7948106a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 -- 172.21.15.64:0/2849869558 >> 172.21.15.64:0/2849869558 conn(0x7f79480fc120 msgr2=0x7f79480fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 -- 172.21.15.64:0/2849869558 shutdown_connections 2024-04-26T20:57:51.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.300+0000 7f794ee00700 1 -- 172.21.15.64:0/2849869558 wait complete. 2024-04-26T20:57:51.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.302+0000 7f794ee00700 1 Processor -- start 2024-04-26T20:57:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.302+0000 7f794ee00700 1 -- start start 2024-04-26T20:57:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.303+0000 7f794ee00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.303+0000 7f794ee00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79480750a0 con 0x7f7948106630 2024-04-26T20:57:51.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.304+0000 7f794da00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.304+0000 7f794da00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:42852/0 (socket says 172.21.15.64:42852) 2024-04-26T20:57:51.304 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.304+0000 7f794da00700 1 -- 172.21.15.64:0/161482813 learned_addr learned my addr 172.21.15.64:0/161482813 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.304+0000 7f794da00700 1 -- 172.21.15.64:0/161482813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0095f0 con 0x7f7948106630 2024-04-26T20:57:51.305 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.305+0000 7f794da00700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f793c005490 tx=0x7f793c005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.305+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c01d070 con 0x7f7948106630 2024-04-26T20:57:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.305+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7948073720 con 0x7f7948106630 2024-04-26T20:57:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.305+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f793c005700 con 0x7f7948106630 2024-04-26T20:57:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.305+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c0038e0 con 0x7f7948106630 2024-04-26T20:57:51.306 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.306+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7948073ba0 con 0x7f7948106630 2024-04-26T20:57:51.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.307+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7948101d70 con 0x7f7948106630 2024-04-26T20:57:51.307 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.307+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f793c003b50 con 0x7f7948106630 2024-04-26T20:57:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.308+0000 7f7946000700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 0x7f793003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.308+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f793c04c590 con 0x7f7948106630 2024-04-26T20:57:51.308 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.308+0000 7f794d000700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 0x7f793003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:51.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.309+0000 7f794d000700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 0x7f793003add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7934006fd0 tx=0x7f7934006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:51.324 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.323+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f793c02a590 con 0x7f7948106630 2024-04-26T20:57:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:51.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:57:51.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:57:51.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:57:51.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:51.649 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.648+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7948073de0 con 0x7f7948106630 2024-04-26T20:57:51.650 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.650+0000 7f7946000700 1 -- 172.21.15.64:0/161482813 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f793c026030 con 0x7f7948106630 2024-04-26T20:57:51.650 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:51.650 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 msgr2=0x7f793003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 0x7f793003add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7934006fd0 tx=0x7f7934006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 msgr2=0x7f79480731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:51.653 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f793c005490 tx=0x7f793c005570 comp rx=0 tx=0).stop 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 shutdown_connections 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7930038910 0x7f793003add0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 --2- 172.21.15.64:0/161482813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7948106630 0x7f79480731e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.652+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 >> 172.21.15.64:0/161482813 conn(0x7f79480fc120 msgr2=0x7f79480fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.653+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 shutdown_connections 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:51.653+0000 7f794ee00700 1 -- 172.21.15.64:0/161482813 wait complete. 2024-04-26T20:57:51.654 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:52 smithi055 ceph-mon[25475]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T20:57:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:57:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:52 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/161482813' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:53 smithi055 ceph-mon[25475]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:53.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:53.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:54.196 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:57:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:55 smithi055 ceph-mon[25475]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.482+0000 7f8342400700 1 -- 172.21.15.64:0/4189235285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 msgr2=0x7f833c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.482+0000 7f8342400700 1 --2- 172.21.15.64:0/4189235285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c106bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f832c009910 tx=0x7f832c009c20 comp rx=0 tx=0).stop 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.482+0000 7f8342400700 1 -- 172.21.15.64:0/4189235285 shutdown_connections 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.482+0000 7f8342400700 1 --2- 172.21.15.64:0/4189235285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c106bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.482+0000 7f8342400700 1 -- 172.21.15.64:0/4189235285 >> 172.21.15.64:0/4189235285 conn(0x7f833c0fc2e0 msgr2=0x7f833c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.483+0000 7f8342400700 1 -- 172.21.15.64:0/4189235285 shutdown_connections 2024-04-26T20:57:56.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.483+0000 7f8342400700 1 -- 172.21.15.64:0/4189235285 wait complete. 2024-04-26T20:57:56.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.484+0000 7f8342400700 1 Processor -- start 2024-04-26T20:57:56.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.484+0000 7f8342400700 1 -- start start 2024-04-26T20:57:56.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.485+0000 7f8342400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.485+0000 7f8342400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0750a0 con 0x7f833c1067f0 2024-04-26T20:57:56.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.486+0000 7f833b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.486+0000 7f833b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:34198/0 (socket says 172.21.15.64:34198) 2024-04-26T20:57:56.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.486+0000 7f833b400700 1 -- 172.21.15.64:0/442302134 learned_addr learned my addr 172.21.15.64:0/442302134 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:57:56.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.486+0000 7f833b400700 1 -- 172.21.15.64:0/442302134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0095f0 con 0x7f833c1067f0 2024-04-26T20:57:56.487 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.487+0000 7f833b400700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f832c0098e0 tx=0x7f832c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.487+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f832c01d070 con 0x7f833c1067f0 2024-04-26T20:57:56.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.488+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f832c0056b0 con 0x7f833c1067f0 2024-04-26T20:57:56.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.488+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f832c022d80 con 0x7f833c1067f0 2024-04-26T20:57:56.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.488+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c073720 con 0x7f833c1067f0 2024-04-26T20:57:56.488 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.488+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c073ba0 con 0x7f833c1067f0 2024-04-26T20:57:56.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.489+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c101f30 con 0x7f833c1067f0 2024-04-26T20:57:56.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.489+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f832c022470 con 0x7f833c1067f0 2024-04-26T20:57:56.490 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.490+0000 7f8333e00700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 0x7f832003adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:57:56.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.490+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f832c04c910 con 0x7f833c1067f0 2024-04-26T20:57:56.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.491+0000 7f833aa00700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 0x7f832003adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:57:56.492 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.492+0000 7f833aa00700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 0x7f832003adc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:57:56.506 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.505+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f832c02b590 con 0x7f833c1067f0 2024-04-26T20:57:56.824 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.823+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f833c073de0 con 0x7f833c1067f0 2024-04-26T20:57:56.825 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.824+0000 7f8333e00700 1 -- 172.21.15.64:0/442302134 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f832c027030 con 0x7f833c1067f0 2024-04-26T20:57:56.825 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:57:56.825 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:54:15.251095Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 msgr2=0x7f832003adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 0x7f832003adc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328006e40 comp rx=0 tx=0).stop 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 msgr2=0x7f833c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f832c0098e0 tx=0x7f832c005520 comp rx=0 tx=0).stop 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 shutdown_connections 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f8320038900 0x7f832003adc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 --2- 172.21.15.64:0/442302134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f833c1067f0 0x7f833c0731e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 >> 172.21.15.64:0/442302134 conn(0x7f833c0fc2e0 msgr2=0x7f833c1083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 shutdown_connections 2024-04-26T20:57:56.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:57:56.827+0000 7f8342400700 1 -- 172.21.15.64:0/442302134 wait complete. 2024-04-26T20:57:56.829 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-04-26T20:57:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:57.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:57:57.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:57.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:57:57.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:57 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/442302134' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:57:58.589 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-26T20:57:58.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T20:57:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:58 smithi055 ceph-mon[25475]: Deploying daemon mon.smithi064 on smithi064 2024-04-26T20:57:59.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:57:59 smithi055 ceph-mon[25475]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:57:59.942 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T20:58:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:00 smithi064 systemd[1]: Starting Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T20:58:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:01 smithi064 podman[33360]: 2024-04-26 20:58:01.423560422 +0000 UTC m=+0.039511984 image pull 79c5878083fbe06542581976a95ae9f60f161a436ca20d6249cd6b023ecdec19 quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69 2024-04-26T20:58:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:01 smithi064 podman[33360]: 2024-04-26 20:58:01.528085539 +0000 UTC m=+0.144037141 container create 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=reef-7d2137f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T20:58:01.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:01 smithi055 ceph-mon[25475]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.036 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:01 smithi064 podman[33360]: 2024-04-26 20:58:01.983342095 +0000 UTC m=+0.599293707 container init 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=reef-7d2137f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T20:58:02.037 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:01 smithi064 podman[33360]: 2024-04-26 20:58:01.99500558 +0000 UTC m=+0.610957142 container start 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-7d2137f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T20:58:02.389 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T20:58:02.389 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable), process ceph-mon, pid 2 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pidfile_write: ignore empty --pid-file 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: load: jerasure load: lrc 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: RocksDB version: 7.9.2 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Git sha 0 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Compile date 2024-04-25 19:04:37 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: DB SUMMARY 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: DB Session ID: 2OZNBSV4WM8IBHR71G8R 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: CURRENT file: CURRENT 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi064/store.db dir, Total Num: 0, files: 2024-04-26T20:58:02.390 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi064/store.db: 000004.log size: 511 ; 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.error_if_exists: 0 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.create_if_missing: 0 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.paranoid_checks: 1 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.env: 0x5570b8b6a820 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.info_log: 0x5570d54fd420 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.statistics: (nil) 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.use_fsync: 0 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_log_file_size: 0 2024-04-26T20:58:02.391 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_fallocate: 1 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.use_direct_reads: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.db_log_dir: 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.wal_dir: 2024-04-26T20:58:02.392 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T20:58:02.393 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.write_buffer_manager: 0x5570d4772140 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T20:58:02.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.unordered_write: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.row_cache: None 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.wal_filter: None 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.two_write_queues: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.wal_compression: 0 2024-04-26T20:58:02.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.atomic_flush: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.log_readahead_size: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_background_jobs: 2 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_background_compactions: -1 2024-04-26T20:58:02.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_subcompactions: 1 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_open_files: -1 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_background_flushes: -1 2024-04-26T20:58:02.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Compression algorithms supported: 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kZSTD supported: 0 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kXpressCompression supported: 0 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kZlibCompression supported: 1 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kSnappyCompression supported: 1 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kLZ4Compression supported: 1 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: kBZip2Compression supported: 0 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000005 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T20:58:02.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.merge_operator: 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_filter: None 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570d54fd520) 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks: 1 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_top_level_index_and_filter: 1 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_type: 0 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_index_type: 0 2024-04-26T20:58:02.399 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_shortening: 1 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: checksum: 4 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: no_block_cache: 0 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache: 0x5570d48131f0 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_name: BinnedLRUCache 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_options: 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: capacity : 536870912 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_shard_bits : 4 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: strict_capacity_limit : 0 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: high_pri_pool_ratio: 0.000 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_compressed: (nil) 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: persistent_cache: (nil) 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size: 4096 2024-04-26T20:58:02.400 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size_deviation: 10 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_restart_interval: 16 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_block_restart_interval: 1 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_block_size: 4096 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: partition_filters: 0 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: use_delta_encoding: 1 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: filter_policy: bloomfilter 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: whole_key_filtering: 1 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: verify_compression: 0 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: read_amp_bytes_per_bit: 0 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: format_version: 5 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_index_compression: 1 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_align: 0 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_auto_readahead_size: 262144 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: prepopulate_block_cache: 0 2024-04-26T20:58:02.401 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: initial_auto_readahead_size: 8192 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression: NoCompression 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.num_levels: 7 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T20:58:02.402 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T20:58:02.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T20:58:02.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T20:58:02.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T20:58:02.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T20:58:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T20:58:02.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.table_properties_collectors: 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.inplace_update_support: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.bloom_locality: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.max_successive_merges: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T20:58:02.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.ttl: 2592000 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enable_blob_files: false 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.min_blob_size: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T20:58:02.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: badd5ba4-b00d-4500-aa9c-1280bdf979b1 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165082047031, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165082048420, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714165082, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "badd5ba4-b00d-4500-aa9c-1280bdf979b1", "db_session_id": "2OZNBSV4WM8IBHR71G8R", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165082048669, "job": 1, "event": "recovery_finished"} 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi064/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5570d48b2000 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: DB pointer 0x5570d48a0000 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T20:58:02.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** DB Stats ** 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:58:02.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T20:58:02.412 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache BinnedLRUCache@0x5570d48131f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064 does not exist in monmap, will attempt to join an existing cluster 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: using public_addr v2:172.21.15.64:0/0 -> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: starting mon.smithi064 rank -1 at public addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] at bind addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi064 fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:58:02.413 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(???) e0 preinit fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).mds e1 new map 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).mds e1 print_map 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: e1 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: legacy client fscid: -1 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: No filesystems configured 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T20:58:02.414 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1974809602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14164 172.21.15.55:0/1989103226' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-26T20:58:02.415 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mgrmap e14: smithi055.ybbowr(active, since 85s) 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/3178017897' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/2853971501' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Activating manager daemon smithi055.ybbowr 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mgrmap e15: smithi055.ybbowr(active, starting, since 0.016375s) 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Manager daemon smithi055.ybbowr is now available 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.416 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mgrmap e16: smithi055.ybbowr(active, since 1.01576s) 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: [26/Apr/2024:20:57:22] ENGINE Bus STARTING 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: [26/Apr/2024:20:57:22] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: [26/Apr/2024:20:57:23] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: [26/Apr/2024:20:57:23] ENGINE Bus STARTED 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mgrmap e17: smithi055.ybbowr(active, since 2s) 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1506649988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.417 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/2249654161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:02.418 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T20:58:02.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Deploying daemon ceph-exporter.smithi064 on smithi064 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1792925650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Deploying daemon crash.smithi064 on smithi064 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1279316697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.420 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Deploying daemon node-exporter.smithi064 on smithi064 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1214767681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.421 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/161482813' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.422 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/442302134' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: Deploying daemon mon.smithi064 on smithi064 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 ceph-mon[33404]: mon.smithi064@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 bash[33360]: 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 2024-04-26T20:58:02.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:02 smithi064 systemd[1]: Started Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T20:58:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:58:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: mon.smithi055 calling monitor election 2024-04-26T20:58:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: mon.smithi064 calling monitor election 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T20:58:07.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: monmap e2: 2 mons at {smithi055=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: fsmap 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: mgrmap e17: smithi055.ybbowr(active, since 45s) 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: overall HEALTH_OK 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje started 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: mon.smithi055 calling monitor election 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: mon.smithi064 calling monitor election 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: monmap e2: 2 mons at {smithi055=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],smithi064=[v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: fsmap 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: osdmap e5: 0 total, 0 up, 0 in 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: mgrmap e17: smithi055.ybbowr(active, since 45s) 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: overall HEALTH_OK 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje started 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T20:58:07.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3822821229' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T20:58:07.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:07.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:08.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.248+0000 7f1c10000700 1 -- 172.21.15.64:0/2730452762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 msgr2=0x7f1bf0008700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.248+0000 7f1c10000700 1 --2- 172.21.15.64:0/2730452762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1bf0008700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c08074340 tx=0x7f1bfc00fe90 comp rx=0 tx=0).stop 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.248+0000 7f1c10000700 1 -- 172.21.15.64:0/2730452762 shutdown_connections 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.248+0000 7f1c10000700 1 --2- 172.21.15.64:0/2730452762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1bf0008700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.248+0000 7f1c10000700 1 -- 172.21.15.64:0/2730452762 >> 172.21.15.64:0/2730452762 conn(0x7f1c080fc430 msgr2=0x7f1c080fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.249+0000 7f1c10000700 1 -- 172.21.15.64:0/2730452762 shutdown_connections 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.249+0000 7f1c10000700 1 -- 172.21.15.64:0/2730452762 wait complete. 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 Processor -- start 2024-04-26T20:58:08.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 -- start start 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c081a3250 con 0x7f1bf0006290 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.251+0000 7f1c10000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0819cd70 con 0x7f1c081a2c30 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.64:49626/0 (socket says 172.21.15.64:49626) 2024-04-26T20:58:08.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0d600700 1 -- 172.21.15.64:0/887501645 learned_addr learned my addr 172.21.15.64:0/887501645 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T20:58:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0cc00700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0cc00700 1 -- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 msgr2=0x7f1c0819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:58:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0cc00700 1 -- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 msgr2=0x7f1c0819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:58:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.252+0000 7f1c0cc00700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:58:08.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.253+0000 7f1c0cc00700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:58:08.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:08 smithi055 ceph-mon[25475]: mgrmap e18: smithi055.ybbowr(active, since 45s), standbys: smithi064.tchyje 2024-04-26T20:58:08.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T20:58:08.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:08.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:08.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:08.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.253+0000 7f1c0d600700 1 -- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 msgr2=0x7f1c0819c830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.253+0000 7f1c0d600700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.253+0000 7f1c0d600700 1 -- 172.21.15.64:0/887501645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc00f8e0 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.254+0000 7f1c0d600700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005920 tx=0x7f1bfc005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.255+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bfc012d30 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.255+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0819cf90 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.255+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1bfc012e90 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.255+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bfc003c90 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.255+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0819d480 con 0x7f1bf0006290 2024-04-26T20:58:08.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.256+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c08103e10 con 0x7f1bf0006290 2024-04-26T20:58:08.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.259+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f1bfc0140d0 con 0x7f1bf0006290 2024-04-26T20:58:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.260+0000 7f1c06000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 0x7f1be806f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:08.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.260+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1bfc08e8e0 con 0x7f1bf0006290 2024-04-26T20:58:08.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.260+0000 7f1c0cc00700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 0x7f1be806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:08.263 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.262+0000 7f1c0cc00700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 0x7f1be806f270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009850 tx=0x7f1bf4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:08.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.273+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1bfc05d9a0 con 0x7f1bf0006290 2024-04-26T20:58:08.607 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.605+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1c0819dcf0 con 0x7f1bf0006290 2024-04-26T20:58:08.608 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:08 smithi064 ceph-mon[33404]: mgrmap e18: smithi055.ybbowr(active, since 45s), standbys: smithi064.tchyje 2024-04-26T20:58:08.608 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T20:58:08.608 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:08.608 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:08.608 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T20:58:08.609 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.607+0000 7f1c06000700 1 -- 172.21.15.64:0/887501645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1018 (secure 0 0 0) 0x7f1bfc05d530 con 0x7f1bf0006290 2024-04-26T20:58:08.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-26T20:58:08.609 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":2,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","modified":"2024-04-26T20:58:02.103436Z","created":"2024-04-26T20:54:15.251095Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi055","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi064","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 msgr2=0x7f1be806f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 0x7f1be806f270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009850 tx=0x7f1bf4008040 comp rx=0 tx=0).stop 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 msgr2=0x7f1c081a26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005920 tx=0x7f1bfc005690 comp rx=0 tx=0).stop 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 shutdown_connections 2024-04-26T20:58:08.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1be806cdb0 0x7f1be806f270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf0006290 0x7f1c081a26f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 --2- 172.21.15.64:0/887501645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c081a2c30 0x7f1c0819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 >> 172.21.15.64:0/887501645 conn(0x7f1c080fc430 msgr2=0x7f1c081954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 shutdown_connections 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T20:58:08.610+0000 7f1c10000700 1 -- 172.21.15.64:0/887501645 wait complete. 2024-04-26T20:58:08.613 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 2 2024-04-26T20:58:09.357 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:09 smithi064 ceph-mon[33404]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:09.357 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:09 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/887501645' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:09.397 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T20:58:09.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T20:58:09.480 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:09 smithi055 ceph-mon[25475]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:09.481 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:09 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/887501645' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T20:58:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:58:11.442 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:11 smithi055 ceph-mon[25475]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:11.443 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:11.443 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:11.443 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:11.443 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:11 smithi064 ceph-mon[33404]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 -- 172.21.15.55:0/3467057860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b4106800 msgr2=0x7ff5b4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 --2- 172.21.15.55:0/3467057860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b4106800 0x7ff5b4106be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009910 tx=0x7ff5a8009c20 comp rx=0 tx=0).stop 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 -- 172.21.15.55:0/3467057860 shutdown_connections 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 --2- 172.21.15.55:0/3467057860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b4106800 0x7ff5b4106be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 -- 172.21.15.55:0/3467057860 >> 172.21.15.55:0/3467057860 conn(0x7ff5b4075290 msgr2=0x7ff5b40756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 -- 172.21.15.55:0/3467057860 shutdown_connections 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.956+0000 7ff5bb600700 1 -- 172.21.15.55:0/3467057860 wait complete. 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.957+0000 7ff5bb600700 1 Processor -- start 2024-04-26T20:58:11.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5bb600700 1 -- start start 2024-04-26T20:58:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5bb600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5bb600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5bb600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41016e0 con 0x7ff5b40ffd20 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5bb600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41a2450 con 0x7ff5b4106800 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.958+0000 7ff5b3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54428/0 (socket says 172.21.15.55:54428) 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b3e00700 1 -- 172.21.15.55:0/906336131 learned_addr learned my addr 172.21.15.55:0/906336131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b8c00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b8c00700 1 -- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 msgr2=0x7ff5b40ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b8c00700 1 -- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 msgr2=0x7ff5b40ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b8c00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b8c00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b3e00700 1 -- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 msgr2=0x7ff5b40ff7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b3e00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:11.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.959+0000 7ff5b3e00700 1 -- 172.21.15.55:0/906336131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80095f0 con 0x7ff5b40ffd20 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5b3e00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000b700 tx=0x7ff5a000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a0011800 con 0x7ff5b40ffd20 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5a0011e20 con 0x7ff5b40ffd20 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a000f2e0 con 0x7ff5b40ffd20 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b41a25f0 con 0x7ff5b40ffd20 2024-04-26T20:58:11.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.960+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b41a2b10 con 0x7ff5b40ffd20 2024-04-26T20:58:11.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.962+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b4101f40 con 0x7ff5b40ffd20 2024-04-26T20:58:11.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.963+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7ff5a0010380 con 0x7ff5b40ffd20 2024-04-26T20:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.964+0000 7ff5b1600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 0x7ff59c06f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:11.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.964+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff5a008ae80 con 0x7ff5b40ffd20 2024-04-26T20:58:11.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.964+0000 7ff5b8c00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 0x7ff59c06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:11.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.965+0000 7ff5b8c00700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 0x7ff59c06f270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800b5c0 tx=0x7ff5a8005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:11.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:11.970+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff5a0056290 con 0x7ff5b40ffd20 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.200+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff5b40ff1d0 con 0x7ff5b40ffd20 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.200+0000 7ff5b1600700 1 -- 172.21.15.55:0/906336131 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7ff5a00598b0 con 0x7ff5b40ffd20 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stdout:# minimal ceph.conf for fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T20:58:12.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon_host = [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 msgr2=0x7ff59c06f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 0x7ff59c06f270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800b5c0 tx=0x7ff5a8005a90 comp rx=0 tx=0).stop 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 msgr2=0x7ff5b41001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000b700 tx=0x7ff5a000bac0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 shutdown_connections 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff59c06cdb0 0x7ff59c06f270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5b4106800 0x7ff5b40ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 --2- 172.21.15.55:0/906336131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5b40ffd20 0x7ff5b41001a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 >> 172.21.15.55:0/906336131 conn(0x7ff5b4075290 msgr2=0x7ff5b40fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 shutdown_connections 2024-04-26T20:58:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:12.204+0000 7ff5bb600700 1 -- 172.21.15.55:0/906336131 wait complete. 2024-04-26T20:58:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:12 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T20:58:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:12 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T20:58:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:12 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:12 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/906336131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:12 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T20:58:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:12 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T20:58:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:12 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:12 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/906336131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:13.036 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T20:58:13.036 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:58:13.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:58:13.112 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:58:13.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:58:13.232 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:58:13.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T20:58:13.330 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:58:13.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T20:58:13.464 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T20:58:13.465 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T20:58:13.465 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:58:13.509 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:58:13.509 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-04-26T20:58:13.590 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:58:13.590 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-26 20:57:10.147056415 +0000 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-26 20:49:54.095395280 +0000 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-26 20:49:54.096395260 +0000 2024-04-26T20:58:13.591 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-26 20:49:54.095395280 +0000 2024-04-26T20:58:13.591 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:58:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:58:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:13 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:58:13.658 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:13 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:13.715 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-26T20:58:13.715 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-26T20:58:13.715 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000491077 s, 1.0 MB/s 2024-04-26T20:58:13.718 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:58:13.822 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-04-26T20:58:13.874 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:58:13.874 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:13.874 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-26T20:58:13.874 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:13.875 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:13.875 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-26 20:57:10.148056396 +0000 2024-04-26T20:58:13.875 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-26 20:49:54.753382262 +0000 2024-04-26T20:58:13.875 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-26 20:49:54.753382262 +0000 2024-04-26T20:58:13.875 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-26 20:49:54.753382262 +0000 2024-04-26T20:58:13.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:58:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-26T20:58:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-26T20:58:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000553681 s, 925 kB/s 2024-04-26T20:58:13.949 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:58:14.004 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-04-26T20:58:14.047 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-26 20:57:10.148056396 +0000 2024-04-26T20:58:14.048 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-26 20:49:55.366370135 +0000 2024-04-26T20:58:14.049 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-26 20:49:55.366370135 +0000 2024-04-26T20:58:14.049 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-26 20:49:55.366370135 +0000 2024-04-26T20:58:14.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:58:14.163 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-26T20:58:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-26T20:58:14.164 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000410357 s, 1.2 MB/s 2024-04-26T20:58:14.167 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:58:14.220 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:14.271 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-26 20:57:10.149056376 +0000 2024-04-26T20:58:14.272 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-26 20:49:55.983357929 +0000 2024-04-26T20:58:14.272 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-26 20:49:55.983357929 +0000 2024-04-26T20:58:14.272 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-26 20:49:55.983357929 +0000 2024-04-26T20:58:14.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:58:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-26T20:58:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-26T20:58:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000382327 s, 1.3 MB/s 2024-04-26T20:58:14.355 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:58:14.402 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T20:58:14.403 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:58:14.460 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:58:14.460 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:14.511 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-26 20:58:00.523037683 +0000 2024-04-26T20:58:14.512 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-26 20:49:51.639339420 +0000 2024-04-26T20:58:14.512 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-26 20:49:51.639339420 +0000 2024-04-26T20:58:14.512 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-26 20:49:51.639339420 +0000 2024-04-26T20:58:14.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:58:14.584 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:14 smithi064 ceph-mon[33404]: Reconfiguring mon.smithi055 (unknown last config time)... 2024-04-26T20:58:14.585 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:14 smithi064 ceph-mon[33404]: Reconfiguring daemon mon.smithi055 on smithi055 2024-04-26T20:58:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-26T20:58:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-26T20:58:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000406032 s, 1.3 MB/s 2024-04-26T20:58:14.597 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:58:14.658 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-04-26T20:58:14.712 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:58:14.712 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:14.712 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-04-26T20:58:14.712 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:14.713 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:14.713 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-26 20:58:00.524037663 +0000 2024-04-26T20:58:14.713 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-26 20:49:52.250327427 +0000 2024-04-26T20:58:14.713 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-26 20:49:52.250327427 +0000 2024-04-26T20:58:14.713 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-26 20:49:52.250327427 +0000 2024-04-26T20:58:14.713 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:58:14.733 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:14 smithi055 ceph-mon[25475]: Reconfiguring mon.smithi055 (unknown last config time)... 2024-04-26T20:58:14.733 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:14 smithi055 ceph-mon[25475]: Reconfiguring daemon mon.smithi055 on smithi055 2024-04-26T20:58:14.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-26T20:58:14.794 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-26T20:58:14.794 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000369423 s, 1.4 MB/s 2024-04-26T20:58:14.798 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:58:14.859 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-04-26T20:58:14.916 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:58:14.916 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:14.916 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-26T20:58:14.916 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:14.916 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:14.917 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-26 20:58:00.524037663 +0000 2024-04-26T20:58:14.917 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-26 20:49:52.893314805 +0000 2024-04-26T20:58:14.917 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-26 20:49:52.893314805 +0000 2024-04-26T20:58:14.917 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-26 20:49:52.893314805 +0000 2024-04-26T20:58:14.917 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:58:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-26T20:58:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-26T20:58:15.003 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.00035857 s, 1.4 MB/s 2024-04-26T20:58:15.007 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:58:15.070 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-26 20:58:00.525037643 +0000 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-26 20:49:53.538302144 +0000 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-26 20:49:53.538302144 +0000 2024-04-26T20:58:15.123 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-26 20:49:53.538302144 +0000 2024-04-26T20:58:15.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:58:15.198 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-26T20:58:15.199 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-26T20:58:15.199 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000310204 s, 1.7 MB/s 2024-04-26T20:58:15.202 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:58:15.260 INFO:tasks.cephadm:Deploying osd.0 on smithi055 with /dev/vg_nvme/lv_4... 2024-04-26T20:58:15.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T20:58:15.327 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:15.327 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:15.327 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:15.327 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:58:15.328 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:58:15.328 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:58:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:58:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:58:16.426 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:16 smithi055 ceph-mon[25475]: Reconfiguring mgr.smithi055.ybbowr (unknown last config time)... 2024-04-26T20:58:16.427 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:16 smithi055 ceph-mon[25475]: Reconfiguring daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T20:58:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:16 smithi064 ceph-mon[33404]: Reconfiguring mgr.smithi055.ybbowr (unknown last config time)... 2024-04-26T20:58:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:16 smithi064 ceph-mon[33404]: Reconfiguring daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T20:58:17.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:17 smithi064 ceph-mon[33404]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:17.718 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:17 smithi055 ceph-mon[25475]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:19.104 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T20:58:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T20:58:19.105 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-04-26T20:58:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-04-26T20:58:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0366868 s, 286 MB/s 2024-04-26T20:58:19.105 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-04-26T20:58:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:19 smithi055 ceph-mon[25475]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:19 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:19 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:19 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:58:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:19 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:19 smithi064 ceph-mon[33404]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:19 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:19 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:19 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:58:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:19 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:19.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi055:vg_nvme/lv_4 2024-04-26T20:58:20.447 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:20 smithi055 ceph-mon[25475]: Reconfiguring ceph-exporter.smithi055 (monmap changed)... 2024-04-26T20:58:20.447 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:20 smithi055 ceph-mon[25475]: Reconfiguring daemon ceph-exporter.smithi055 on smithi055 2024-04-26T20:58:20.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:20 smithi064 ceph-mon[33404]: Reconfiguring ceph-exporter.smithi055 (monmap changed)... 2024-04-26T20:58:20.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:20 smithi064 ceph-mon[33404]: Reconfiguring daemon ceph-exporter.smithi055 on smithi055 2024-04-26T20:58:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:58:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:21 smithi064 ceph-mon[33404]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:21.678 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:21 smithi055 ceph-mon[25475]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:22.615 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:22.615 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:22.615 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: Reconfiguring crash.smithi055 (monmap changed)... 2024-04-26T20:58:22.616 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:58:22.616 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:22.616 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: Reconfiguring daemon crash.smithi055 on smithi055 2024-04-26T20:58:22.616 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:22.616 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: Reconfiguring crash.smithi055 (monmap changed)... 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: Reconfiguring daemon crash.smithi055 on smithi055 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:23.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 -- 172.21.15.55:0/2045856562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c107260 msgr2=0x7f9b1c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 --2- 172.21.15.55:0/2045856562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c107260 0x7f9b1c107680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00b0a0 tx=0x7f9b0c00b3b0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 -- 172.21.15.55:0/2045856562 shutdown_connections 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 --2- 172.21.15.55:0/2045856562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c108460 0x7f9b1c1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 --2- 172.21.15.55:0/2045856562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c107260 0x7f9b1c107680 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 -- 172.21.15.55:0/2045856562 >> 172.21.15.55:0/2045856562 conn(0x7f9b1c076400 msgr2=0x7f9b1c078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 -- 172.21.15.55:0/2045856562 shutdown_connections 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.623+0000 7f9b22c00700 1 -- 172.21.15.55:0/2045856562 wait complete. 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 Processor -- start 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 -- start start 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c107260 0x7f9b1c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c19d900 con 0x7f9b1c108460 2024-04-26T20:58:23.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.624+0000 7f9b22c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c19da40 con 0x7f9b1c107260 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60460/0 (socket says 172.21.15.55:60460) 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 -- 172.21.15.55:0/3903821806 learned_addr learned my addr 172.21.15.55:0/3903821806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b1be00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c107260 0x7f9b1c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 -- 172.21.15.55:0/3903821806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c107260 msgr2=0x7f9b1c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c107260 0x7f9b1c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.625+0000 7f9b13400700 1 -- 172.21.15.55:0/3903821806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c009d00 con 0x7f9b1c108460 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b13400700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b4b0 tx=0x7f9b0400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b04011800 con 0x7f9b1c108460 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b04011e20 con 0x7f9b1c108460 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b0400f2e0 con 0x7f9b1c108460 2024-04-26T20:58:23.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1a24a0 con 0x7f9b1c108460 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.626+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c1a2a70 con 0x7f9b1c108460 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.627+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c04ebb0 con 0x7f9b1c108460 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.628+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f9b04010380 con 0x7f9b1c108460 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.630+0000 7f9b19600700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 0x7f9b0006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.630+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9b0408adb0 con 0x7f9b1c108460 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.630+0000 7f9b1be00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 0x7f9b0006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.630+0000 7f9b1be00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 0x7f9b0006f110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009fd0 tx=0x7f9b0c00b7b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:58:23.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.635+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9b0408f070 con 0x7f9b1c108460 2024-04-26T20:58:23.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:58:23.872+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b1c10cdb0 con 0x7f9b0006cc50 2024-04-26T20:58:24.864 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:24.864 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:58:24.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:58:24.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:58:24.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:24.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:24.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:58:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:58:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:58:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:25.891 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:25 smithi055 ceph-mon[25475]: Reconfiguring alertmanager.smithi055 (dependencies changed)... 2024-04-26T20:58:25.891 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:25 smithi055 ceph-mon[25475]: Reconfiguring daemon alertmanager.smithi055 on smithi055 2024-04-26T20:58:25.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:25 smithi064 ceph-mon[33404]: Reconfiguring alertmanager.smithi055 (dependencies changed)... 2024-04-26T20:58:25.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:25 smithi064 ceph-mon[33404]: Reconfiguring daemon alertmanager.smithi055 on smithi055 2024-04-26T20:58:26.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:26 smithi055 ceph-mon[25475]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:26 smithi064 ceph-mon[33404]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:28.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:28 smithi055 ceph-mon[25475]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:28 smithi064 ceph-mon[33404]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:30.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:30 smithi064 ceph-mon[33404]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:31.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:30 smithi055 ceph-mon[25475]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:33 smithi064 ceph-mon[33404]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:33 smithi055 ceph-mon[25475]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: Reconfiguring grafana.smithi055 (dependencies changed)... 2024-04-26T20:58:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: Reconfiguring daemon grafana.smithi055 on smithi055 2024-04-26T20:58:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/521790434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5bf35a1-adc3-4e73-8968-1bf88bc80fd5"}]: dispatch 2024-04-26T20:58:34.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/521790434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5bf35a1-adc3-4e73-8968-1bf88bc80fd5"}]': finished 2024-04-26T20:58:34.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:58:34.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:58:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: Reconfiguring grafana.smithi055 (dependencies changed)... 2024-04-26T20:58:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: Reconfiguring daemon grafana.smithi055 on smithi055 2024-04-26T20:58:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/521790434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5bf35a1-adc3-4e73-8968-1bf88bc80fd5"}]: dispatch 2024-04-26T20:58:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/521790434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5bf35a1-adc3-4e73-8968-1bf88bc80fd5"}]': finished 2024-04-26T20:58:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T20:58:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:34 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:35 smithi055 ceph-mon[25475]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/683680367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:58:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:35 smithi064 ceph-mon[33404]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:35 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/683680367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:58:36.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:36 smithi064 ceph-mon[33404]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:37.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:36 smithi055 ceph-mon[25475]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:37.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:38.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:38 smithi064 ceph-mon[33404]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:39.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:38 smithi055 ceph-mon[25475]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:40.721 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:40 smithi055 ceph-mon[25475]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:40.802 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:40 smithi064 ceph-mon[33404]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:42 smithi055 ceph-mon[25475]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:42 smithi064 ceph-mon[33404]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:44.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:44 smithi055 ceph-mon[25475]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:44 smithi064 ceph-mon[33404]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:46.712 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:46 smithi055 ceph-mon[25475]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:46 smithi064 ceph-mon[33404]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:48.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:48.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:48.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:47 smithi055 ceph-mon[25475]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T20:58:48.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:47 smithi055 ceph-mon[25475]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T20:58:48.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:48.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:48.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:47 smithi064 ceph-mon[33404]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T20:58:48.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:47 smithi064 ceph-mon[33404]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T20:58:49.095 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:48 smithi055 ceph-mon[25475]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:49.095 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:58:49.095 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:49.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:48 smithi064 ceph-mon[33404]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:49.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T20:58:49.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:50.180 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:49 smithi055 ceph-mon[25475]: Deploying daemon osd.0 on smithi055 2024-04-26T20:58:50.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:49 smithi064 ceph-mon[33404]: Deploying daemon osd.0 on smithi055 2024-04-26T20:58:51.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:50 smithi055 ceph-mon[25475]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:51.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:50 smithi064 ceph-mon[33404]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:52.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:52.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:58:53.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:52 smithi055 ceph-mon[25475]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:52 smithi064 ceph-mon[33404]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:55.199 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:54 smithi055 ceph-mon[25475]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:54 smithi064 ceph-mon[33404]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: Reconfiguring ceph-exporter.smithi064 (monmap changed)... 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: Reconfiguring daemon ceph-exporter.smithi064 on smithi064 2024-04-26T20:58:56.546 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:56 smithi064 ceph-mon[33404]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: Reconfiguring ceph-exporter.smithi064 (monmap changed)... 2024-04-26T20:58:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T20:58:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: Reconfiguring daemon ceph-exporter.smithi064 on smithi064 2024-04-26T20:58:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:56 smithi055 ceph-mon[25475]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:58.560 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:58.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:58.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:58:58.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:58:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T20:58:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:59 smithi064 ceph-mon[33404]: Reconfiguring crash.smithi064 (monmap changed)... 2024-04-26T20:58:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:59 smithi064 ceph-mon[33404]: Reconfiguring daemon crash.smithi064 on smithi064 2024-04-26T20:58:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:58:59 smithi064 ceph-mon[33404]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:58:59.693 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:59 smithi055 ceph-mon[25475]: Reconfiguring crash.smithi064 (monmap changed)... 2024-04-26T20:58:59.693 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:59 smithi055 ceph-mon[25475]: Reconfiguring daemon crash.smithi064 on smithi064 2024-04-26T20:58:59.693 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:58:59 smithi055 ceph-mon[25475]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: Reconfiguring mgr.smithi064.tchyje (monmap changed)... 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: Reconfiguring daemon mgr.smithi064.tchyje on smithi064 2024-04-26T20:59:00.629 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:00 smithi055 ceph-mon[25475]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:00.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:00.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:00.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: Reconfiguring mgr.smithi064.tchyje (monmap changed)... 2024-04-26T20:59:00.639 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T20:59:00.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T20:59:00.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:00.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: Reconfiguring daemon mgr.smithi064.tchyje on smithi064 2024-04-26T20:59:00.640 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:00 smithi064 ceph-mon[33404]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: Reconfiguring mon.smithi064 (monmap changed)... 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:59:02.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:02.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:02 smithi064 ceph-mon[33404]: Reconfiguring daemon mon.smithi064 on smithi064 2024-04-26T20:59:03.002 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: Reconfiguring mon.smithi064 (monmap changed)... 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:03.003 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:02 smithi055 ceph-mon[25475]: Reconfiguring daemon mon.smithi064 on smithi064 2024-04-26T20:59:04.749 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:04.749 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.749 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi055.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi055.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi055.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T20:59:04.750 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi055.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi055.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi055.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.751 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi055.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T20:59:04.829 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi055.front.sepia.ceph.com:9093"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi055.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi055.front.sepia.ceph.com:3000"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi055.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi055.front.sepia.ceph.com:9095"}]: dispatch 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:04.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:06.692 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:06 smithi055 ceph-mon[25475]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:06.692 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:06.692 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:06 smithi064 ceph-mon[33404]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:07.801 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:07.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.626+0000 7f9b19600700 1 -- 172.21.15.55:0/3903821806 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9b1c10cdb0 con 0x7f9b0006cc50 2024-04-26T20:59:08.629 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 0 on host 'smithi055' 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 msgr2=0x7f9b0006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 0x7f9b0006f110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009fd0 tx=0x7f9b0c00b7b0 comp rx=0 tx=0).stop 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 msgr2=0x7f9b1c19d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b4b0 tx=0x7f9b0400b870 comp rx=0 tx=0).stop 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 shutdown_connections 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9b0006cc50 0x7f9b0006f110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b1c107260 0x7f9b1c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 --2- 172.21.15.55:0/3903821806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b1c108460 0x7f9b1c19d2e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 >> 172.21.15.55:0/3903821806 conn(0x7f9b1c076400 msgr2=0x7f9b1c10b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 shutdown_connections 2024-04-26T20:59:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:08.631+0000 7f9b22c00700 1 -- 172.21.15.55:0/3903821806 wait complete. 2024-04-26T20:59:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:08 smithi064 ceph-mon[33404]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:08 smithi064 ceph-mon[33404]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:59:09.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:08 smithi055 ceph-mon[25475]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:09.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:08 smithi055 ceph-mon[25475]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T20:59:09.788 DEBUG:teuthology.orchestra.run.smithi055:osd.0> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T20:59:09.795 INFO:tasks.cephadm:Deploying osd.1 on smithi055 with /dev/vg_nvme/lv_3... 2024-04-26T20:59:09.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T20:59:09.857 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:59:09.857 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:59:09.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:09.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T20:59:09.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:09.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:09.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T20:59:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T20:59:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T20:59:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:10.647 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:59:10.837 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-mon[25475]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:10.837 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-mon[25475]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T20:59:10.837 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-mon[25475]: osdmap e8: 1 total, 0 up, 1 in 2024-04-26T20:59:10.837 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:10.837 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:10.837 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[43835]: 2024-04-26T20:59:10.693+0000 7f6735400700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T20:59:10.837 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 20:59:10 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[43835]: 2024-04-26T20:59:10.714+0000 7f672bc00700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:59:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:10 smithi064 ceph-mon[33404]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:10 smithi064 ceph-mon[33404]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T20:59:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:10 smithi064 ceph-mon[33404]: osdmap e8: 1 total, 0 up, 1 in 2024-04-26T20:59:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:11.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:11 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T20:59:11.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:11 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T20:59:11.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:11 smithi064 ceph-mon[33404]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' 2024-04-26T20:59:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:11 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T20:59:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:11 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T20:59:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:11 smithi055 ceph-mon[25475]: from='osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072]' entity='osd.0' 2024-04-26T20:59:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:12 smithi064 ceph-mon[33404]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:12 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:12 smithi064 ceph-mon[33404]: osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] boot 2024-04-26T20:59:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:12 smithi064 ceph-mon[33404]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:59:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:12 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:12.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:12 smithi055 ceph-mon[25475]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T20:59:12.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:12 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:12.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:12 smithi055 ceph-mon[25475]: osd.0 [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] boot 2024-04-26T20:59:12.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:12 smithi055 ceph-mon[25475]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T20:59:12.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:12 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T20:59:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T20:59:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T20:59:14.830 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-04-26T20:59:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-04-26T20:59:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0339813 s, 309 MB/s 2024-04-26T20:59:14.831 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-04-26T20:59:14.870 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:14 smithi055 ceph-mon[25475]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:14.870 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:14 smithi055 ceph-mon[25475]: osdmap e10: 1 total, 1 up, 1 in 2024-04-26T20:59:14.871 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:14.871 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:14 smithi064 ceph-mon[33404]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:14 smithi064 ceph-mon[33404]: osdmap e10: 1 total, 1 up, 1 in 2024-04-26T20:59:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:15.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi055:vg_nvme/lv_3 2024-04-26T20:59:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:16 smithi064 ceph-mon[33404]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:16.982 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:16 smithi055 ceph-mon[25475]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:59:18.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:18 smithi055 ceph-mon[25475]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:18 smithi064 ceph-mon[33404]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 -- 172.21.15.55:0/4102271372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e0074e90 msgr2=0x7f96e00732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 --2- 172.21.15.55:0/4102271372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e0074e90 0x7f96e00732f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009910 tx=0x7f96d0009c20 comp rx=0 tx=0).stop 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 -- 172.21.15.55:0/4102271372 shutdown_connections 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 --2- 172.21.15.55:0/4102271372 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e00738c0 0x7f96e0073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 --2- 172.21.15.55:0/4102271372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e0074e90 0x7f96e00732f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 -- 172.21.15.55:0/4102271372 >> 172.21.15.55:0/4102271372 conn(0x7f96e00fc200 msgr2=0x7f96e00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 -- 172.21.15.55:0/4102271372 shutdown_connections 2024-04-26T20:59:20.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.125+0000 7f96e6200700 1 -- 172.21.15.55:0/4102271372 wait complete. 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.126+0000 7f96e6200700 1 Processor -- start 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.126+0000 7f96e6200700 1 -- start start 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96e6200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96e6200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e0074e90 0x7f96e0198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96e6200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0199350 con 0x7f96e00738c0 2024-04-26T20:59:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96e6200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0199490 con 0x7f96e0074e90 2024-04-26T20:59:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96df400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96df400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58662/0 (socket says 172.21.15.55:58662) 2024-04-26T20:59:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96df400700 1 -- 172.21.15.55:0/3679350871 learned_addr learned my addr 172.21.15.55:0/3679350871 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T20:59:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.127+0000 7f96dea00700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e0074e90 0x7f96e0198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96df400700 1 -- 172.21.15.55:0/3679350871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e0074e90 msgr2=0x7f96e0198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96df400700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e0074e90 0x7f96e0198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96df400700 1 -- 172.21.15.55:0/3679350871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00095f0 con 0x7f96e00738c0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96df400700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96d0006010 tx=0x7f96d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d001d070 con 0x7f96e00738c0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96d000f460 con 0x7f96e00738c0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.128+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d0021640 con 0x7f96e00738c0 2024-04-26T20:59:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.129+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e019de90 con 0x7f96e00738c0 2024-04-26T20:59:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.129+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e019e320 con 0x7f96e00738c0 2024-04-26T20:59:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.130+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e01929b0 con 0x7f96e00738c0 2024-04-26T20:59:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.131+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f96d000fab0 con 0x7f96e00738c0 2024-04-26T20:59:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.132+0000 7f96d7e00700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 0x7f96c406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:59:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.132+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f96d008c730 con 0x7f96e00738c0 2024-04-26T20:59:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.133+0000 7f96dea00700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 0x7f96c406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:59:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.133+0000 7f96dea00700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 0x7f96c406f120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96cc005fd0 tx=0x7f96cc00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:59:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.138+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f96d005b3f0 con 0x7f96e00738c0 2024-04-26T20:59:20.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:20.376+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f96e002ce50 con 0x7f96c406cc60 2024-04-26T20:59:20.649 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:20 smithi055 ceph-mon[25475]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:20.649 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:20 smithi055 ceph-mon[25475]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:59:20.649 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:20 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:59:20.649 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:20 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:59:20.649 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:20 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:20.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:20 smithi064 ceph-mon[33404]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:20 smithi064 ceph-mon[33404]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T20:59:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:20 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T20:59:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:20 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T20:59:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:20 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi055 2024-04-26T20:59:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:59:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi055 to 11846M 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:22.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi055 2024-04-26T20:59:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi055 to 11846M 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:23.189 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:23 smithi055 ceph-mon[25475]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:23.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:23 smithi064 ceph-mon[33404]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2317730359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3153742-3be4-40d5-9f37-da19d515b5bc"}]: dispatch 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2317730359' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3153742-3be4-40d5-9f37-da19d515b5bc"}]': finished 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:59:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:25 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:25.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:25.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:25.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:25.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2317730359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3153742-3be4-40d5-9f37-da19d515b5bc"}]: dispatch 2024-04-26T20:59:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2317730359' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3153742-3be4-40d5-9f37-da19d515b5bc"}]': finished 2024-04-26T20:59:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T20:59:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:25 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:27.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:26 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4097713586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:59:27.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:26 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4097713586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T20:59:28.059 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:27 smithi064 ceph-mon[33404]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:28.065 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:27 smithi055 ceph-mon[25475]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:29.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:29.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:29.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:31.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:30 smithi064 ceph-mon[33404]: pgmap v63: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:31.236 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:30 smithi055 ceph-mon[25475]: pgmap v63: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:33.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:32 smithi064 ceph-mon[33404]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:33.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:32 smithi055 ceph-mon[25475]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:35.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:34 smithi055 ceph-mon[25475]: pgmap v65: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:34 smithi064 ceph-mon[33404]: pgmap v65: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:36.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:35 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:59:36.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:35 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:36.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:35 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T20:59:36.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:35 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:36.969 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:36 smithi055 ceph-mon[25475]: pgmap v66: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:36.969 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:36 smithi055 ceph-mon[25475]: Deploying daemon osd.1 on smithi055 2024-04-26T20:59:36.969 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:36 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:37.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:36 smithi064 ceph-mon[33404]: pgmap v66: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:37.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:36 smithi064 ceph-mon[33404]: Deploying daemon osd.1 on smithi055 2024-04-26T20:59:37.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:36 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:38.958 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:38 smithi055 ceph-mon[25475]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:39.124 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:38 smithi064 ceph-mon[33404]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:41.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:40 smithi055 ceph-mon[25475]: pgmap v68: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:40 smithi064 ceph-mon[33404]: pgmap v68: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:42 smithi055 ceph-mon[25475]: pgmap v69: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:43.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:42 smithi064 ceph-mon[33404]: pgmap v69: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:45.581 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:45 smithi064 ceph-mon[33404]: pgmap v70: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:45.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:45 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:45.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:45 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:45.582 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:45 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:45.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:45 smithi055 ceph-mon[25475]: pgmap v70: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:45.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:45.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:45.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:45 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:46.664 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:46 smithi055 ceph-mon[25475]: pgmap v71: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:46.677 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:46 smithi064 ceph-mon[33404]: pgmap v71: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:48.412 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:48.413 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:48.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:48.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:49.540 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:49 smithi055 ceph-mon[25475]: pgmap v72: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:49.540 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:49 smithi055 ceph-mon[25475]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:59:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:49 smithi064 ceph-mon[33404]: pgmap v72: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:49 smithi064 ceph-mon[33404]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T20:59:49.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.984+0000 7f96d7e00700 1 -- 172.21.15.55:0/3679350871 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f96e002ce50 con 0x7f96c406cc60 2024-04-26T20:59:49.986 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 1 on host 'smithi055' 2024-04-26T20:59:49.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.987+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 msgr2=0x7f96c406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:49.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.987+0000 7f96e6200700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 0x7f96c406f120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f96cc005fd0 tx=0x7f96cc00a560 comp rx=0 tx=0).stop 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 msgr2=0x7f96e01987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96d0006010 tx=0x7f96d000be20 comp rx=0 tx=0).stop 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 shutdown_connections 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f96c406cc60 0x7f96c406f120 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96e00738c0 0x7f96e01987f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 --2- 172.21.15.55:0/3679350871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96e0074e90 0x7f96e0198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 >> 172.21.15.55:0/3679350871 conn(0x7f96e00fc200 msgr2=0x7f96e0106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 shutdown_connections 2024-04-26T20:59:49.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T20:59:49.988+0000 7f96e6200700 1 -- 172.21.15.55:0/3679350871 wait complete. 2024-04-26T20:59:50.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:59:50.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:59:50.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:50.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T20:59:50.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:50.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:50 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:50.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T20:59:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T20:59:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T20:59:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:50 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:51.179 DEBUG:teuthology.orchestra.run.smithi055:osd.1> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T20:59:51.184 INFO:tasks.cephadm:Deploying osd.2 on smithi055 with /dev/vg_nvme/lv_2... 2024-04-26T20:59:51.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T20:59:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-mon[25475]: pgmap v74: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-mon[25475]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T20:59:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-mon[25475]: osdmap e13: 2 total, 1 up, 2 in 2024-04-26T20:59:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:51.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[51687]: 2024-04-26T20:59:51.357+0000 7f1e33c00700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T20:59:51.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 20:59:51 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[51687]: 2024-04-26T20:59:51.374+0000 7f1e2a400700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:59:51.625 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:59:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:51 smithi064 ceph-mon[33404]: pgmap v74: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:51 smithi064 ceph-mon[33404]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T20:59:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:51 smithi064 ceph-mon[33404]: osdmap e13: 2 total, 1 up, 2 in 2024-04-26T20:59:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:52 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T20:59:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:52 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T20:59:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:52 smithi064 ceph-mon[33404]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' 2024-04-26T20:59:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:52.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:52 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T20:59:52.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:52 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T20:59:52.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:52.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:52 smithi055 ceph-mon[25475]: from='osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028]' entity='osd.1' 2024-04-26T20:59:52.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T20:59:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:53 smithi055 ceph-mon[25475]: pgmap v76: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:53 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:53 smithi055 ceph-mon[25475]: osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] boot 2024-04-26T20:59:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:53 smithi055 ceph-mon[25475]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:59:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:53 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:53 smithi064 ceph-mon[33404]: pgmap v76: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-04-26T20:59:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:53 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:53 smithi064 ceph-mon[33404]: osd.1 [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] boot 2024-04-26T20:59:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:53 smithi064 ceph-mon[33404]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T20:59:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:53 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T20:59:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:54 smithi064 ceph-mon[33404]: osdmap e15: 2 total, 2 up, 2 in 2024-04-26T20:59:54.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:54 smithi055 ceph-mon[25475]: osdmap e15: 2 total, 2 up, 2 in 2024-04-26T20:59:55.462 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T20:59:55.462 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T20:59:55.463 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-04-26T20:59:55.463 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-04-26T20:59:55.463 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0353515 s, 297 MB/s 2024-04-26T20:59:55.463 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-04-26T20:59:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:55 smithi064 ceph-mon[33404]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:59:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:55 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:55 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:55 smithi055 ceph-mon[25475]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:59:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:55 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:55 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T20:59:56.404 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi055:vg_nvme/lv_2 2024-04-26T20:59:57.357 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T20:59:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:57 smithi064 ceph-mon[33404]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:59:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:57 smithi055 ceph-mon[25475]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:59:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 20:59:59 smithi064 ceph-mon[33404]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T20:59:59.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 20:59:59 smithi055 ceph-mon[25475]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.395+0000 7f9d8e200700 1 -- 172.21.15.55:0/2560505870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 msgr2=0x7f9d88101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.395+0000 7f9d8e200700 1 --2- 172.21.15.55:0/2560505870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88101030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009910 tx=0x7f9d78009c20 comp rx=0 tx=0).stop 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 -- 172.21.15.55:0/2560505870 shutdown_connections 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 --2- 172.21.15.55:0/2560505870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 0x7f9d88102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 --2- 172.21.15.55:0/2560505870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88101030 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 -- 172.21.15.55:0/2560505870 >> 172.21.15.55:0/2560505870 conn(0x7f9d880fc1f0 msgr2=0x7f9d880fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 -- 172.21.15.55:0/2560505870 shutdown_connections 2024-04-26T21:00:00.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.396+0000 7f9d8e200700 1 -- 172.21.15.55:0/2560505870 wait complete. 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.397+0000 7f9d8e200700 1 Processor -- start 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.397+0000 7f9d8e200700 1 -- start start 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d8e200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d8e200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 0x7f9d88196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d8e200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88197190 con 0x7f9d88100c10 2024-04-26T21:00:00.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d8e200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881972d0 con 0x7f9d88101e10 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d87400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d87400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56366/0 (socket says 172.21.15.55:56366) 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d87400700 1 -- 172.21.15.55:0/3423919174 learned_addr learned my addr 172.21.15.55:0/3423919174 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.398+0000 7f9d86a00700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 0x7f9d88196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.399+0000 7f9d87400700 1 -- 172.21.15.55:0/3423919174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 msgr2=0x7f9d88196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.399+0000 7f9d87400700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 0x7f9d88196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:00.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.399+0000 7f9d87400700 1 -- 172.21.15.55:0/3423919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780095f0 con 0x7f9d88100c10 2024-04-26T21:00:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.399+0000 7f9d87400700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bd70 tx=0x7f9d7800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:00:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.399+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7801d070 con 0x7f9d88100c10 2024-04-26T21:00:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.400+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d78005dc0 con 0x7f9d88100c10 2024-04-26T21:00:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.400+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d78021410 con 0x7f9d88100c10 2024-04-26T21:00:00.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.400+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8819bcd0 con 0x7f9d88100c10 2024-04-26T21:00:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.400+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8819c1c0 con 0x7f9d88100c10 2024-04-26T21:00:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.401+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88190790 con 0x7f9d88100c10 2024-04-26T21:00:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.403+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f9d7800f460 con 0x7f9d88100c10 2024-04-26T21:00:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.403+0000 7f9d7fe00700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 0x7f9d6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.404+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f9d7808c770 con 0x7f9d88100c10 2024-04-26T21:00:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.404+0000 7f9d86a00700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 0x7f9d6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.405+0000 7f9d86a00700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 0x7f9d6c06f110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005950 tx=0x7f9d7400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:00:00.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.411+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9d7805b280 con 0x7f9d88100c10 2024-04-26T21:00:00.430 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:00 smithi055 ceph-mon[25475]: overall HEALTH_OK 2024-04-26T21:00:00.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:00 smithi064 ceph-mon[33404]: overall HEALTH_OK 2024-04-26T21:00:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:00.669+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d8802ce50 con 0x7f9d6c06cc50 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi055 2024-04-26T21:00:01.685 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi055 to 5923M 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:01.686 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:01 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi055 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi055 to 5923M 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:01.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:01 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:02.641 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:02 smithi055 ceph-mon[25475]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:02.641 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:02.750 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:02 smithi064 ceph-mon[33404]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:02.750 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:04.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:04 smithi064 ceph-mon[33404]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:04 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4176578166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b01aca-d29c-4eae-8676-f25c3670cd45"}]: dispatch 2024-04-26T21:00:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:04 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4176578166' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b01aca-d29c-4eae-8676-f25c3670cd45"}]': finished 2024-04-26T21:00:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:04 smithi064 ceph-mon[33404]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T21:00:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:04.940 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:04 smithi055 ceph-mon[25475]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:04.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:04 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4176578166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b01aca-d29c-4eae-8676-f25c3670cd45"}]: dispatch 2024-04-26T21:00:04.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:04 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4176578166' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b01aca-d29c-4eae-8676-f25c3670cd45"}]': finished 2024-04-26T21:00:04.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:04 smithi055 ceph-mon[25475]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T21:00:04.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:05.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:05 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:05.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:05 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:05.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:05 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/323878417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:00:05.909 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:05 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:05.909 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:05 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:05.910 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:05 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/323878417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:00:06.884 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:06 smithi055 ceph-mon[25475]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:06.884 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:06 smithi064 ceph-mon[33404]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:09.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:09 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:09.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:09 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:11 smithi064 ceph-mon[33404]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:11.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:11 smithi055 ceph-mon[25475]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:12.580 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:12 smithi055 ceph-mon[25475]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:12 smithi064 ceph-mon[33404]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:14 smithi055 ceph-mon[25475]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:14 smithi064 ceph-mon[33404]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:00:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:15 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:15 smithi064 ceph-mon[33404]: Deploying daemon osd.2 on smithi055 2024-04-26T21:00:16.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:00:16.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:15 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:16.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:15 smithi055 ceph-mon[25475]: Deploying daemon osd.2 on smithi055 2024-04-26T21:00:16.635 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:16 smithi055 ceph-mon[25475]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:16 smithi064 ceph-mon[33404]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:18.886 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:18 smithi055 ceph-mon[25475]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:18 smithi064 ceph-mon[33404]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:20.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:20 smithi064 ceph-mon[33404]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:20 smithi055 ceph-mon[25475]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:21.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:21 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:21.997 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:22 smithi064 ceph-mon[33404]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:22.963 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:22 smithi055 ceph-mon[25475]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:25.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:24 smithi055 ceph-mon[25475]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:25.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:25.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:25.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:25.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:24 smithi064 ceph-mon[33404]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:25.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:25.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:25.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:27.239 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:26 smithi055 ceph-mon[25475]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:26 smithi064 ceph-mon[33404]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:28.184 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:27 smithi055 ceph-mon[25475]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:00:28.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:27 smithi064 ceph-mon[33404]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:00:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:28 smithi055 ceph-mon[25475]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:28 smithi055 ceph-mon[25475]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:00:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:28 smithi055 ceph-mon[25475]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T21:00:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:28 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:28 smithi055 ceph-mon[25475]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:00:29.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:28 smithi064 ceph-mon[33404]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:29.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:28 smithi064 ceph-mon[33404]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:00:29.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:28 smithi064 ceph-mon[33404]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T21:00:29.309 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:28 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:29.309 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:28 smithi064 ceph-mon[33404]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:00:29.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.521+0000 7f9d7fe00700 1 -- 172.21.15.55:0/3423919174 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9d8802ce50 con 0x7f9d6c06cc50 2024-04-26T21:00:29.522 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 2 on host 'smithi055' 2024-04-26T21:00:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.524+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 msgr2=0x7f9d6c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.524+0000 7f9d8e200700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 0x7f9d6c06f110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005950 tx=0x7f9d7400b410 comp rx=0 tx=0).stop 2024-04-26T21:00:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.524+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 msgr2=0x7f9d88196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.524+0000 7f9d8e200700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800bd70 tx=0x7f9d7800bda0 comp rx=0 tx=0).stop 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 shutdown_connections 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f9d6c06cc50 0x7f9d6c06f110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d88100c10 0x7f9d88196630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 --2- 172.21.15.55:0/3423919174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d88101e10 0x7f9d88196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 >> 172.21.15.55:0/3423919174 conn(0x7f9d880fc1f0 msgr2=0x7f9d88105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 shutdown_connections 2024-04-26T21:00:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:00:29.525+0000 7f9d8e200700 1 -- 172.21.15.55:0/3423919174 wait complete. 2024-04-26T21:00:30.210 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T21:00:30.210 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: osdmap e18: 3 total, 2 up, 3 in 2024-04-26T21:00:30.210 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:30.211 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:30.211 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:30.211 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:30.331 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-04-26T21:00:30.331 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: osdmap e18: 3 total, 2 up, 3 in 2024-04-26T21:00:30.332 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:30.332 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:30.332 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:30.332 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:30.977 DEBUG:teuthology.orchestra.run.smithi055:osd.2> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T21:00:30.985 INFO:tasks.cephadm:Deploying osd.3 on smithi064 with /dev/vg_nvme/lv_4... 2024-04-26T21:00:30.985 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T21:00:31.250 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:30 smithi055 ceph-mon[25475]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:31.251 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:30 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T21:00:31.251 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:30 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T21:00:31.251 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:30 smithi055 ceph-mon[25475]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' 2024-04-26T21:00:31.251 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:31.367 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:00:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:30 smithi064 ceph-mon[33404]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:30 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T21:00:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:30 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T21:00:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:30 smithi064 ceph-mon[33404]: from='osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164]' entity='osd.2' 2024-04-26T21:00:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:30 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:32.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:32.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:32 smithi055 ceph-mon[25475]: osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] boot 2024-04-26T21:00:32.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:32 smithi055 ceph-mon[25475]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T21:00:32.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:32.537 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:32.537 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:32 smithi064 ceph-mon[33404]: osd.2 [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] boot 2024-04-26T21:00:32.537 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:32 smithi064 ceph-mon[33404]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T21:00:32.537 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:33 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:33.556 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:33.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:33 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:34.611 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T21:00:34.611 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:34 smithi055 ceph-mon[25475]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T21:00:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:34 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T21:00:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:34 smithi064 ceph-mon[33404]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0377342 s, 278 MB/s 2024-04-26T21:00:34.700 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-04-26T21:00:34.999 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:34 smithi055 sudo[61368]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:00:34.999 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:34 smithi055 sudo[61368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:34.999 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:34 smithi055 sudo[61368]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:34.999 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:34 smithi055 sudo[61368]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:35.254 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:00:35.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:35.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61429]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:35.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61429]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:35 smithi064 ceph-mon[33404]: pgmap v105: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:35 smithi064 ceph-mon[33404]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T21:00:35.563 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_4 2024-04-26T21:00:35.727 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:35 smithi055 ceph-mon[25475]: pgmap v105: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:35.727 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:35 smithi055 ceph-mon[25475]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T21:00:35.972 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:00:36.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61453]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:00:36.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61453]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:36.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61453]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:36.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:35 smithi055 sudo[61453]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:36.319 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:36 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:36.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:36 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:36.591 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:36 smithi055 sudo[61479]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:00:36.592 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:36 smithi055 sudo[61479]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:36.592 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:36 smithi055 sudo[61479]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:36.592 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:00:36 smithi055 sudo[61479]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:37.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61491]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:00:37.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:37.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61491]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:37.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61491]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:37.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:37 smithi064 ceph-mon[33404]: pgmap v107: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:37.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:37 smithi064 ceph-mon[33404]: mgrmap e19: smithi055.ybbowr(active, since 3m), standbys: smithi064.tchyje 2024-04-26T21:00:37.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:37.677 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:37 smithi055 ceph-mon[25475]: pgmap v107: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:37.677 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:37 smithi055 ceph-mon[25475]: mgrmap e19: smithi055.ybbowr(active, since 3m), standbys: smithi064.tchyje 2024-04-26T21:00:37.677 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:38.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61511]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:00:38.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61511]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:38.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61511]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:38.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:00:37 smithi055 sudo[61511]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.135+0000 7faf27e00700 1 -- 172.21.15.64:0/3767834742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20107260 msgr2=0x7faf20107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.135+0000 7faf27e00700 1 --2- 172.21.15.64:0/3767834742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20107260 0x7faf20107680 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faf14009910 tx=0x7faf14009c20 comp rx=0 tx=0).stop 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 -- 172.21.15.64:0/3767834742 shutdown_connections 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 --2- 172.21.15.64:0/3767834742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20108460 0x7faf201088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 --2- 172.21.15.64:0/3767834742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20107260 0x7faf20107680 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 -- 172.21.15.64:0/3767834742 >> 172.21.15.64:0/3767834742 conn(0x7faf20076400 msgr2=0x7faf20078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 -- 172.21.15.64:0/3767834742 shutdown_connections 2024-04-26T21:00:38.138 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.136+0000 7faf27e00700 1 -- 172.21.15.64:0/3767834742 wait complete. 2024-04-26T21:00:38.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.137+0000 7faf27e00700 1 Processor -- start 2024-04-26T21:00:38.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.137+0000 7faf27e00700 1 -- start start 2024-04-26T21:00:38.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf27e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20107260 0x7faf2019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:38.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf27e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:38.139 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf27e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2019d8c0 con 0x7faf20107260 2024-04-26T21:00:38.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf27e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf201a2280 con 0x7faf20108460 2024-04-26T21:00:38.140 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf24a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf25400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20107260 0x7faf2019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf24a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45672/0 (socket says 172.21.15.64:45672) 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.138+0000 7faf24a00700 1 -- 172.21.15.64:0/3544414622 learned_addr learned my addr 172.21.15.64:0/3544414622 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.139+0000 7faf24a00700 1 -- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20107260 msgr2=0x7faf2019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.139+0000 7faf24a00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20107260 0x7faf2019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.139+0000 7faf24a00700 1 -- 172.21.15.64:0/3544414622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140095f0 con 0x7faf20108460 2024-04-26T21:00:38.141 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.139+0000 7faf24a00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00b4b0 tx=0x7faf0c00b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.139+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0c011800 con 0x7faf20108460 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.140+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf0c011e20 con 0x7faf20108460 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.140+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf0c00f2e0 con 0x7faf20108460 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.140+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf201a2480 con 0x7faf20108460 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.140+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf201a2a20 con 0x7faf20108460 2024-04-26T21:00:38.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.141+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf20196e60 con 0x7faf20108460 2024-04-26T21:00:38.143 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.142+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faf0c010380 con 0x7faf20108460 2024-04-26T21:00:38.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.143+0000 7faf1e000700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 0x7faf0806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:00:38.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.143+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7faf0c08b420 con 0x7faf20108460 2024-04-26T21:00:38.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.143+0000 7faf25400700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 0x7faf0806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:00:38.146 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.144+0000 7faf25400700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 0x7faf0806f1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf14009fd0 tx=0x7faf14005180 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:00:38.150 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.149+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7faf0c056160 con 0x7faf20108460 2024-04-26T21:00:38.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:00:38.384+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7faf2002ce50 con 0x7faf0806cd30 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[62902]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[62902]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[62902]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:38.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[62902]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[63942]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:00:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[63942]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[63942]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:38 smithi055 sudo[63942]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:39.871 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:39 smithi064 sudo[37103]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T21:00:39.872 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:39 smithi064 sudo[37103]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:39.872 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:39 smithi064 sudo[37103]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:39.872 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:39 smithi064 sudo[37103]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:40.121 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 sudo[37161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 sudo[37161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 sudo[37161]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 sudo[37161]: pam_unix(sudo:session): session closed for user root 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: pgmap v108: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:00:40.122 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:40.123 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:00:40.123 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:00:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: pgmap v108: 1 pgs: 1 creating+activating; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:00:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:00:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:00:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:00:41.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:00:41.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi055 2024-04-26T21:00:41.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:41.395 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi055 to 3948M 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.396 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi055 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi055 to 3948M 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:41.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/2155939055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]: dispatch 2024-04-26T21:00:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]: dispatch 2024-04-26T21:00:43.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]': finished 2024-04-26T21:00:43.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T21:00:43.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:43 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/2155939055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]: dispatch 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]: dispatch 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "451e4cc2-a142-42e7-af62-c34d3ea9017d"}]': finished 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T21:00:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:43 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:00:44.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:44 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/672262556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:00:44.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:44 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/672262556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:00:45.478 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:45 smithi064 ceph-mon[33404]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-26T21:00:45.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:45 smithi055 ceph-mon[25475]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:47 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:47.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-26T21:00:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:47 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:00:49.279 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:49 smithi064 ceph-mon[33404]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-26T21:00:49.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:49 smithi055 ceph-mon[25475]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-26T21:00:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:51 smithi055 ceph-mon[25475]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:00:51.616 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:51 smithi064 ceph-mon[33404]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:00:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:00:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:00:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:00:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:53 smithi055 ceph-mon[25475]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:00:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:53 smithi055 ceph-mon[25475]: Deploying daemon osd.3 on smithi064 2024-04-26T21:00:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:53 smithi064 ceph-mon[33404]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-26T21:00:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:53 smithi064 ceph-mon[33404]: Deploying daemon osd.3 on smithi064 2024-04-26T21:00:55.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:55 smithi064 ceph-mon[33404]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-04-26T21:00:55.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:55 smithi055 ceph-mon[25475]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-04-26T21:00:57.423 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:57 smithi064 ceph-mon[33404]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:57 smithi055 ceph-mon[25475]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:59.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:00:59 smithi064 ceph-mon[33404]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:00:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:00:59 smithi055 ceph-mon[25475]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:01.028 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:00 smithi064 ceph-mon[33404]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:01.028 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:01.028 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:01.028 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:01.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:00 smithi055 ceph-mon[25475]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:01.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:01.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:01.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:03.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:02 smithi064 ceph-mon[33404]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:02 smithi055 ceph-mon[25475]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:04.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.808+0000 7faf1e000700 1 -- 172.21.15.64:0/3544414622 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faf2002ce50 con 0x7faf0806cd30 2024-04-26T21:01:04.810 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 3 on host 'smithi064' 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 msgr2=0x7faf0806f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 0x7faf0806f1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf14009fd0 tx=0x7faf14005180 comp rx=0 tx=0).stop 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 msgr2=0x7faf2019d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00b4b0 tx=0x7faf0c00b7c0 comp rx=0 tx=0).stop 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 shutdown_connections 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faf0806cd30 0x7faf0806f1f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf20107260 0x7faf2019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:04.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 --2- 172.21.15.64:0/3544414622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf20108460 0x7faf2019d2a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:04.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 >> 172.21.15.64:0/3544414622 conn(0x7faf20076400 msgr2=0x7faf2010bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:01:04.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 shutdown_connections 2024-04-26T21:01:04.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:04.812+0000 7faf27e00700 1 -- 172.21.15.64:0/3544414622 wait complete. 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:01:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:01:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:05.594 DEBUG:teuthology.orchestra.run.smithi064:osd.3> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T21:01:05.599 INFO:tasks.cephadm:Deploying osd.4 on smithi064 with /dev/vg_nvme/lv_3... 2024-04-26T21:01:05.600 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T21:01:06.102 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-mon[33404]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:01:06.103 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-mon[33404]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T21:01:06.103 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:06.103 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-mon[33404]: from='osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:06.103 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-mon[33404]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:06.103 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[39356]: 2024-04-26T21:01:05.936+0000 7f6008c00700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T21:01:06.103 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:01:05 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[39356]: 2024-04-26T21:01:05.954+0000 7f6004400700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:01:06.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:05 smithi055 ceph-mon[25475]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:01:06.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:05 smithi055 ceph-mon[25475]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T21:01:06.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:05 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:06.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:05 smithi055 ceph-mon[25475]: from='osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:06.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:05 smithi055 ceph-mon[25475]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:06.847 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:01:07.145 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:07.145 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:01:07.146 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T21:01:07.146 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:07.146 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:07.146 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:08.202 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:07 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T21:01:08.202 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:07 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T21:01:08.202 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:07 smithi064 ceph-mon[33404]: osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] boot 2024-04-26T21:01:08.203 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:07 smithi064 ceph-mon[33404]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T21:01:08.203 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:08.207 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:07 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T21:01:08.208 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:07 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T21:01:08.208 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:07 smithi055 ceph-mon[25475]: osd.3 [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] boot 2024-04-26T21:01:08.208 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:07 smithi055 ceph-mon[25475]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T21:01:08.208 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:01:09.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:08 smithi064 ceph-mon[33404]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:09.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:08 smithi064 ceph-mon[33404]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T21:01:09.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:08 smithi055 ceph-mon[25475]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:09.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:08 smithi055 ceph-mon[25475]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0336663 s, 311 MB/s 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 2024-04-26T21:01:10.023 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-04-26T21:01:10.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:09 smithi055 ceph-mon[25475]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T21:01:10.404 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:09 smithi064 ceph-mon[33404]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T21:01:10.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_3 2024-04-26T21:01:11.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi064 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi064 to 14913M 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:11.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:10 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.212 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:01:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T21:01:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi064 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi064 to 14913M 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:11.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:10 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:11 smithi055 ceph-mon[25475]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T21:01:12.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:12 smithi064 ceph-mon[33404]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T21:01:13.020 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:13 smithi064 ceph-mon[33404]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:13.291 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 -- 172.21.15.64:0/390251529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 msgr2=0x7f08e41002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 --2- 172.21.15.64:0/390251529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e41002f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009910 tx=0x7f08d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 -- 172.21.15.64:0/390251529 shutdown_connections 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 --2- 172.21.15.64:0/390251529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e41002f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 --2- 172.21.15.64:0/390251529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 0x7f08e40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 -- 172.21.15.64:0/390251529 >> 172.21.15.64:0/390251529 conn(0x7f08e40fb0b0 msgr2=0x7f08e40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 -- 172.21.15.64:0/390251529 shutdown_connections 2024-04-26T21:01:13.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.290+0000 7f08eaa00700 1 -- 172.21.15.64:0/390251529 wait complete. 2024-04-26T21:01:13.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.291+0000 7f08eaa00700 1 Processor -- start 2024-04-26T21:01:13.293 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08eaa00700 1 -- start start 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08eaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 0x7f08e41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08eaa00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08eaa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4199410 con 0x7f08e40ff510 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08eaa00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4199550 con 0x7f08e40ffe70 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08e3400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08e3400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:33500/0 (socket says 172.21.15.64:33500) 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.292+0000 7f08e3400700 1 -- 172.21.15.64:0/1088133095 learned_addr learned my addr 172.21.15.64:0/1088133095 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e3e00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 0x7f08e41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e3400700 1 -- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 msgr2=0x7f08e41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e3400700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 0x7f08e41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e3400700 1 -- 172.21.15.64:0/1088133095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00095f0 con 0x7f08e40ffe70 2024-04-26T21:01:13.294 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e3400700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f08d000bd70 tx=0x7f08d000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:01:13.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d001d070 con 0x7f08e40ffe70 2024-04-26T21:01:13.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08d000f460 con 0x7f08e40ffe70 2024-04-26T21:01:13.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d0021620 con 0x7f08e40ffe70 2024-04-26T21:01:13.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.293+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e419deb0 con 0x7f08e40ffe70 2024-04-26T21:01:13.295 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.294+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e419e3a0 con 0x7f08e40ffe70 2024-04-26T21:01:13.296 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.295+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e4192990 con 0x7f08e40ffe70 2024-04-26T21:01:13.297 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.297+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f08d000fa70 con 0x7f08e40ffe70 2024-04-26T21:01:13.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.298+0000 7f08e0c00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 0x7f08c806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:13.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.298+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f08d008d3c0 con 0x7f08e40ffe70 2024-04-26T21:01:13.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.299+0000 7f08e3e00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 0x7f08c806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:13.300 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.299+0000 7f08e3e00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 0x7f08c806f1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08d4005fd0 tx=0x7f08d400a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:01:13.303 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.303+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f08d005b8a0 con 0x7f08e40ffe70 2024-04-26T21:01:13.323 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:13 smithi055 ceph-mon[25475]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:13.538 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:13.537+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e402ce50 con 0x7f08c806ccf0 2024-04-26T21:01:14.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:01:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:01:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:01:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:01:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:15.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:15 smithi064 ceph-mon[33404]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:01:15.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:15 smithi064 ceph-mon[33404]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T21:01:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:15 smithi055 ceph-mon[25475]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:01:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:15 smithi055 ceph-mon[25475]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-04-26T21:01:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:17 smithi055 ceph-mon[25475]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-26T21:01:17.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:17 smithi064 ceph-mon[33404]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-04-26T21:01:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:18 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1886283309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]: dispatch 2024-04-26T21:01:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:18 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]: dispatch 2024-04-26T21:01:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:18 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]': finished 2024-04-26T21:01:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:18 smithi064 ceph-mon[33404]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T21:01:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:18.438 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:18 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1886283309' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]: dispatch 2024-04-26T21:01:18.438 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:18 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]: dispatch 2024-04-26T21:01:18.439 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:18 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fad5ee98-3422-47cf-9915-11690ee0dea0"}]': finished 2024-04-26T21:01:18.439 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:18 smithi055 ceph-mon[25475]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T21:01:18.439 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:19.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:19 smithi064 ceph-mon[33404]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-26T21:01:19.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:19 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/3291710730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:01:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:19 smithi055 ceph-mon[25475]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-04-26T21:01:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:19 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/3291710730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:01:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:21 smithi064 ceph-mon[33404]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-26T21:01:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:21 smithi055 ceph-mon[25475]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-04-26T21:01:22.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:23.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:23 smithi064 ceph-mon[33404]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T21:01:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:23 smithi055 ceph-mon[25475]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T21:01:25.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:25 smithi064 ceph-mon[33404]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:25 smithi055 ceph-mon[25475]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:27 smithi064 ceph-mon[33404]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:27 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:01:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:27 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:27 smithi055 ceph-mon[25475]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:27 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:01:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:27 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:28.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:28 smithi064 ceph-mon[33404]: Deploying daemon osd.4 on smithi064 2024-04-26T21:01:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:28 smithi055 ceph-mon[25475]: Deploying daemon osd.4 on smithi064 2024-04-26T21:01:29.338 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:29 smithi064 ceph-mon[33404]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:29 smithi055 ceph-mon[25475]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:31 smithi064 ceph-mon[33404]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:31 smithi055 ceph-mon[25475]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:33.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:33 smithi064 ceph-mon[33404]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:33 smithi055 ceph-mon[25475]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:35 smithi064 ceph-mon[33404]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:35.567 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:35 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:35.567 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:35 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:35.568 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:35 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:35.568 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:35 smithi055 ceph-mon[25475]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:35.568 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:35 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:35.568 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:35 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:35.568 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:35 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:37.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:37 smithi064 ceph-mon[33404]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:37.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:37.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:37 smithi055 ceph-mon[25475]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:37.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:39.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:39 smithi064 ceph-mon[33404]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:39.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:39 smithi064 ceph-mon[33404]: from='osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:01:39.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:39 smithi064 ceph-mon[33404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:01:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:39 smithi055 ceph-mon[25475]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:39 smithi055 ceph-mon[25475]: from='osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:01:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:39 smithi055 ceph-mon[25475]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:01:39.808 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.807+0000 7f08e0c00700 1 -- 172.21.15.64:0/1088133095 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f08e402ce50 con 0x7f08c806ccf0 2024-04-26T21:01:39.809 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 4 on host 'smithi064' 2024-04-26T21:01:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 msgr2=0x7f08c806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 0x7f08c806f1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08d4005fd0 tx=0x7f08d400a560 comp rx=0 tx=0).stop 2024-04-26T21:01:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 msgr2=0x7f08e4198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f08d000bd70 tx=0x7f08d000be50 comp rx=0 tx=0).stop 2024-04-26T21:01:39.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 shutdown_connections 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08c806ccf0 0x7f08c806f1b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e40ff510 0x7f08e41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 --2- 172.21.15.64:0/1088133095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f08e40ffe70 0x7f08e4198df0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.811+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 >> 172.21.15.64:0/1088133095 conn(0x7f08e40fb0b0 msgr2=0x7f08e4107ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.812+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 shutdown_connections 2024-04-26T21:01:39.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:39.812+0000 7f08eaa00700 1 -- 172.21.15.64:0/1088133095 wait complete. 2024-04-26T21:01:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:01:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T21:01:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.593 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:40.643 DEBUG:teuthology.orchestra.run.smithi064:osd.4> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T21:01:40.648 INFO:tasks.cephadm:Deploying osd.5 on smithi064 with /dev/vg_nvme/lv_2... 2024-04-26T21:01:40.648 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T21:01:41.196 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:01:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:41 smithi055 ceph-mon[25475]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:41 smithi055 ceph-mon[25475]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:01:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:41 smithi055 ceph-mon[25475]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T21:01:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:41.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-mon[33404]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:41.534 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-mon[33404]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:01:41.534 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-mon[33404]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T21:01:41.534 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:41.534 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:41.534 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[46119]: 2024-04-26T21:01:41.307+0000 7f90dfa00700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T21:01:41.534 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:01:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[46119]: 2024-04-26T21:01:41.334+0000 7f90d6200700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: osdmap e34: 5 total, 4 up, 5 in 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:42.419 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:42 smithi064 ceph-mon[33404]: from='osd.4 ' entity='osd.4' 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: osdmap e34: 5 total, 4 up, 5 in 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:42 smithi055 ceph-mon[25475]: from='osd.4 ' entity='osd.4' 2024-04-26T21:01:43.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:43 smithi064 ceph-mon[33404]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:43.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:43 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:43.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:43 smithi064 ceph-mon[33404]: osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] boot 2024-04-26T21:01:43.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:43 smithi064 ceph-mon[33404]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T21:01:43.465 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:43 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:43 smithi055 ceph-mon[25475]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-26T21:01:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:43 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:43 smithi055 ceph-mon[25475]: osd.4 [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] boot 2024-04-26T21:01:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:43 smithi055 ceph-mon[25475]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T21:01:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:43 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:01:44.415 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T21:01:44.416 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T21:01:44.416 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-04-26T21:01:44.416 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-04-26T21:01:44.416 INFO:teuthology.orchestra.run.smithi064.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0352411 s, 298 MB/s 2024-04-26T21:01:44.416 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-04-26T21:01:44.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:44 smithi064 ceph-mon[33404]: osdmap e36: 5 total, 5 up, 5 in 2024-04-26T21:01:44.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:44 smithi055 ceph-mon[25475]: osdmap e36: 5 total, 5 up, 5 in 2024-04-26T21:01:45.199 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_2 2024-04-26T21:01:45.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:45 smithi064 ceph-mon[33404]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:45 smithi055 ceph-mon[25475]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:45.792 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:01:47.580 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:47 smithi064 ceph-mon[33404]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:47 smithi055 ceph-mon[25475]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 -- 172.21.15.64:0/796762647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00074f10 msgr2=0x7f6e00073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 --2- 172.21.15.64:0/796762647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00074f10 0x7f6e00073370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009910 tx=0x7f6df0009c20 comp rx=0 tx=0).stop 2024-04-26T21:01:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 -- 172.21.15.64:0/796762647 shutdown_connections 2024-04-26T21:01:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 --2- 172.21.15.64:0/796762647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00073940 0x7f6e00073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 --2- 172.21.15.64:0/796762647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00074f10 0x7f6e00073370 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 -- 172.21.15.64:0/796762647 >> 172.21.15.64:0/796762647 conn(0x7f6e000fc1f0 msgr2=0x7f6e000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:01:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 -- 172.21.15.64:0/796762647 shutdown_connections 2024-04-26T21:01:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.715+0000 7f6e06000700 1 -- 172.21.15.64:0/796762647 wait complete. 2024-04-26T21:01:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 Processor -- start 2024-04-26T21:01:48.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 -- start start 2024-04-26T21:01:48.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:48.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00074f10 0x7f6e0019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:48.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0019d8c0 con 0x7f6e00074f10 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6e06000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e001a2280 con 0x7f6e00073940 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6dff400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.717+0000 7f6dff400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58612/0 (socket says 172.21.15.64:58612) 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dff400700 1 -- 172.21.15.64:0/1667592651 learned_addr learned my addr 172.21.15.64:0/1667592651 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dfea00700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00074f10 0x7f6e0019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dff400700 1 -- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00074f10 msgr2=0x7f6e0019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dff400700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00074f10 0x7f6e0019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dff400700 1 -- 172.21.15.64:0/1667592651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00095f0 con 0x7f6e00073940 2024-04-26T21:01:48.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.718+0000 7f6dff400700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6df00059d0 tx=0x7f6df000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:01:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.719+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df001d070 con 0x7f6e00073940 2024-04-26T21:01:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.719+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6df000f460 con 0x7f6e00073940 2024-04-26T21:01:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.719+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df0021640 con 0x7f6e00073940 2024-04-26T21:01:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.719+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e001a2420 con 0x7f6e00073940 2024-04-26T21:01:48.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.719+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e001a2960 con 0x7f6e00073940 2024-04-26T21:01:48.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.720+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e00196e40 con 0x7f6e00073940 2024-04-26T21:01:48.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.721+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6df000f5d0 con 0x7f6e00073940 2024-04-26T21:01:48.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.722+0000 7f6df7e00700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 0x7f6de406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:01:48.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.722+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f6df008d0b0 con 0x7f6e00073940 2024-04-26T21:01:48.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.723+0000 7f6dfea00700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 0x7f6de406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:01:48.724 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.724+0000 7f6dfea00700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 0x7f6de406f1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006fd0 tx=0x7f6dec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:01:48.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.728+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6df0057950 con 0x7f6e00073940 2024-04-26T21:01:48.971 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:01:48.970+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e0002cea0 con 0x7f6de406cce0 2024-04-26T21:01:49.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:49.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi064 2024-04-26T21:01:49.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi064 to 7456M 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:49.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:49.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:49.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:01:49.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:01:49.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:49 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:49.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi064 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi064 to 7456M 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T21:01:49.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:49 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:50.411 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:50 smithi064 ceph-mon[33404]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:01:50.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:50 smithi055 ceph-mon[25475]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:01:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:51 smithi055 ceph-mon[25475]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:51.525 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:51 smithi064 ceph-mon[33404]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:01:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/3344461344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]: dispatch 2024-04-26T21:01:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]: dispatch 2024-04-26T21:01:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]': finished 2024-04-26T21:01:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T21:01:53.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:53 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:01:53.559 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:53.559 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/3344461344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]: dispatch 2024-04-26T21:01:53.559 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]: dispatch 2024-04-26T21:01:53.559 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "67735946-26c0-4d63-a775-363b3cc0ccbf"}]': finished 2024-04-26T21:01:53.559 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T21:01:53.560 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:53 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:01:54.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:54 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/3947951683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:01:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:54 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/3947951683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T21:01:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:55 smithi064 ceph-mon[33404]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:55 smithi055 ceph-mon[25475]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:57 smithi064 ceph-mon[33404]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:57 smithi055 ceph-mon[25475]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:59.585 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:01:59 smithi055 ceph-mon[25475]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:01:59.614 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:01:59 smithi064 ceph-mon[33404]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:01 smithi064 ceph-mon[33404]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:01.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:01 smithi055 ceph-mon[25475]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:03.619 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:03 smithi064 ceph-mon[33404]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:03.619 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:03 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:02:03.619 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:03 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:03 smithi055 ceph-mon[25475]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:03 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:02:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:03 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:04.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:04 smithi064 ceph-mon[33404]: Deploying daemon osd.5 on smithi064 2024-04-26T21:02:04.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:04 smithi055 ceph-mon[25475]: Deploying daemon osd.5 on smithi064 2024-04-26T21:02:05.513 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:05 smithi064 ceph-mon[33404]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:05.656 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:05 smithi055 ceph-mon[25475]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:07.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:07 smithi064 ceph-mon[33404]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:07.533 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:07.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:07 smithi055 ceph-mon[25475]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:07.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:09.585 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:09 smithi055 ceph-mon[25475]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:09 smithi064 ceph-mon[33404]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:11.574 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:11 smithi064 ceph-mon[33404]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:11.575 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:11.575 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:11.575 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:11 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:11 smithi055 ceph-mon[25475]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:11 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:13.628 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:13 smithi064 ceph-mon[33404]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:13 smithi055 ceph-mon[25475]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:15 smithi064 ceph-mon[33404]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:15 smithi064 ceph-mon[33404]: from='osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:02:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:15 smithi064 ceph-mon[33404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:02:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:15 smithi055 ceph-mon[25475]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:15 smithi055 ceph-mon[25475]: from='osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:02:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:15 smithi055 ceph-mon[25475]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:02:16.279 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.277+0000 7f6df7e00700 1 -- 172.21.15.64:0/1667592651 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6e0002cea0 con 0x7f6de406cce0 2024-04-26T21:02:16.279 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 5 on host 'smithi064' 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 msgr2=0x7f6de406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 0x7f6de406f1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006fd0 tx=0x7f6dec008040 comp rx=0 tx=0).stop 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 msgr2=0x7f6e0019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6df00059d0 tx=0x7f6df000be20 comp rx=0 tx=0).stop 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 shutdown_connections 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6de406cce0 0x7f6de406f1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e00073940 0x7f6e0019cd60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:16.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 --2- 172.21.15.64:0/1667592651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e00074f10 0x7f6e0019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 >> 172.21.15.64:0/1667592651 conn(0x7f6e000fc1f0 msgr2=0x7f6e00102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 shutdown_connections 2024-04-26T21:02:16.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:16.280+0000 7f6e06000700 1 -- 172.21.15.64:0/1667592651 wait complete. 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:16.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:16 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:16 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:16.995 DEBUG:teuthology.orchestra.run.smithi064:osd.5> sudo journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T21:02:17.000 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-26T21:02:17.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T21:02:17.428 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: osdmap e39: 6 total, 5 up, 6 in 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:17.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:17 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: osdmap e39: 6 total, 5 up, 6 in 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:17.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:17 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: purged_snaps scrub starts 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: purged_snaps scrub ok 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] boot 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T21:02:18.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: purged_snaps scrub starts 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: purged_snaps scrub ok 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: osd.5 [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] boot 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T21:02:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:02:19.416 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:19 smithi055 ceph-mon[25475]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:19.416 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:19 smithi055 ceph-mon[25475]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T21:02:19.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:19 smithi064 ceph-mon[33404]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-04-26T21:02:19.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:19 smithi064 ceph-mon[33404]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T21:02:19.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.750+0000 7faaf6800700 1 -- 172.21.15.55:0/2212628769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 msgr2=0x7faaf01088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.750+0000 7faaf6800700 1 --2- 172.21.15.55:0/2212628769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf01088c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faad8009910 tx=0x7faad8009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 -- 172.21.15.55:0/2212628769 shutdown_connections 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 --2- 172.21.15.55:0/2212628769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf01088c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 --2- 172.21.15.55:0/2212628769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf0107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 -- 172.21.15.55:0/2212628769 >> 172.21.15.55:0/2212628769 conn(0x7faaf0076400 msgr2=0x7faaf0078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 -- 172.21.15.55:0/2212628769 shutdown_connections 2024-04-26T21:02:19.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.751+0000 7faaf6800700 1 -- 172.21.15.55:0/2212628769 wait complete. 2024-04-26T21:02:19.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.752+0000 7faaf6800700 1 Processor -- start 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.752+0000 7faaf6800700 1 -- start start 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.752+0000 7faaf6800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faaf6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faaf6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf019d7a0 con 0x7faaf0108460 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faaf6800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf019d8e0 con 0x7faaf0107260 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54142/0 (socket says 172.21.15.55:54142) 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 -- 172.21.15.55:0/3623470999 learned_addr learned my addr 172.21.15.55:0/3623470999 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faaef400700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:19.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 -- 172.21.15.55:0/3623470999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 msgr2=0x7faaf019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faae6a00700 1 -- 172.21.15.55:0/3623470999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80095f0 con 0x7faaf0108460 2024-04-26T21:02:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.753+0000 7faaef400700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:02:19.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faae6a00700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faad800bd70 tx=0x7faad800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad801d070 con 0x7faaf0108460 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faad8005dc0 con 0x7faaf0108460 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf01a2290 con 0x7faaf0108460 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad8021410 con 0x7faaf0108460 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.754+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf01a2800 con 0x7faaf0108460 2024-04-26T21:02:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.756+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0196de0 con 0x7faaf0108460 2024-04-26T21:02:19.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.757+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faad800f820 con 0x7faaf0108460 2024-04-26T21:02:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.758+0000 7faaecc00700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 0x7faad406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.758+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faad808d170 con 0x7faaf0108460 2024-04-26T21:02:19.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.758+0000 7faaef400700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 0x7faad406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:19.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.759+0000 7faaef400700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 0x7faad406f1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faae0005950 tx=0x7faae00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:19.764+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7faad805b310 con 0x7faaf0108460 2024-04-26T21:02:20.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.015+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7faaf004ebb0 con 0x7faaf0108460 2024-04-26T21:02:20.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.016+0000 7faaecc00700 1 -- 172.21.15.55:0/3623470999 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7faad805aea0 con 0x7faaf0108460 2024-04-26T21:02:20.016 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:02:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.018+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 msgr2=0x7faad406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.018+0000 7faaf6800700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 0x7faad406f1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faae0005950 tx=0x7faae00058e0 comp rx=0 tx=0).stop 2024-04-26T21:02:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 msgr2=0x7faaf019d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faad800bd70 tx=0x7faad800be50 comp rx=0 tx=0).stop 2024-04-26T21:02:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 shutdown_connections 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faad406ccf0 0x7faad406f1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaf0107260 0x7faaf019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 --2- 172.21.15.55:0/3623470999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faaf0108460 0x7faaf019d180 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 >> 172.21.15.55:0/3623470999 conn(0x7faaf0076400 msgr2=0x7faaf010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 shutdown_connections 2024-04-26T21:02:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:20.019+0000 7faaf6800700 1 -- 172.21.15.55:0/3623470999 wait complete. 2024-04-26T21:02:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:20 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3623470999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T21:02:20.865 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1714165337,"num_in_osds":6,"osd_in_since":1714165312,"num_remapped_pgs":0} 2024-04-26T21:02:20.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:02:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:20 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3623470999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T21:02:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:21 smithi064 ceph-mon[33404]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:21 smithi055 ceph-mon[25475]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:22.718 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:23.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 -- 172.21.15.55:0/982860374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 msgr2=0x7fa114103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 --2- 172.21.15.55:0/982860374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114103420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa104009910 tx=0x7fa104009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 -- 172.21.15.55:0/982860374 shutdown_connections 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 --2- 172.21.15.55:0/982860374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 0x7fa114107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 --2- 172.21.15.55:0/982860374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114103420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.483+0000 7fa11ae00700 1 -- 172.21.15.55:0/982860374 >> 172.21.15.55:0/982860374 conn(0x7fa1140fe8b0 msgr2=0x7fa114100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.484+0000 7fa11ae00700 1 -- 172.21.15.55:0/982860374 shutdown_connections 2024-04-26T21:02:23.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.484+0000 7fa11ae00700 1 -- 172.21.15.55:0/982860374 wait complete. 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.485+0000 7fa11ae00700 1 Processor -- start 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.485+0000 7fa11ae00700 1 -- start start 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa11ae00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa11ae00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 0x7fa1141992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa11ae00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114199930 con 0x7fa114103040 2024-04-26T21:02:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa11ae00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11419c550 con 0x7fa1141039f0 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54162/0 (socket says 172.21.15.55:54162) 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 -- 172.21.15.55:0/2223437843 learned_addr learned my addr 172.21.15.55:0/2223437843 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113400700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 0x7fa1141992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 -- 172.21.15.55:0/2223437843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 msgr2=0x7fa1141992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 0x7fa1141992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.486+0000 7fa113e00700 1 -- 172.21.15.55:0/2223437843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040095f0 con 0x7fa114103040 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa113e00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa1040092e0 tx=0x7fa10400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa10401d070 con 0x7fa114103040 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa10400f460 con 0x7fa114103040 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa104017630 con 0x7fa114103040 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11419c7d0 con 0x7fa114103040 2024-04-26T21:02:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.487+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11419cc70 con 0x7fa114103040 2024-04-26T21:02:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.489+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11410b3e0 con 0x7fa114103040 2024-04-26T21:02:23.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.490+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa10400f5d0 con 0x7fa114103040 2024-04-26T21:02:23.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.490+0000 7fa110c00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 0x7fa0f806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:23.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.491+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa10408d4c0 con 0x7fa114103040 2024-04-26T21:02:23.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.491+0000 7fa113400700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 0x7fa0f806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:23.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.492+0000 7fa113400700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 0x7fa0f806f1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa100005fd0 tx=0x7fa10000a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:23.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.496+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa104057b30 con 0x7fa114103040 2024-04-26T21:02:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.723+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa114199fe0 con 0x7fa114103040 2024-04-26T21:02:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.725+0000 7fa110c00700 1 -- 172.21.15.55:0/2223437843 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7fa10405b150 con 0x7fa114103040 2024-04-26T21:02:23.727 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:02:23.727 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:02:18.392242+0000","last_up_change":"2024-04-26T21:02:17.373655+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6803","nonce":2401927072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6805","nonce":2401927072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6809","nonce":2401927072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6807","nonce":2401927072}]},"public_addr":"172.21.15.55:6803/2401927072","cluster_addr":"172.21.15.55:6805/2401927072","heartbeat_back_addr":"172.21.15.55:6809/2401927072","heartbeat_front_addr":"172.21.15.55:6807/2401927072","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6811","nonce":1101456028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6813","nonce":1101456028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6817","nonce":1101456028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6815","nonce":1101456028}]},"public_addr":"172.21.15.55:6811/1101456028","cluster_addr":"172.21.15.55:6813/1101456028","heartbeat_back_addr":"172.21.15.55:6817/1101456028","heartbeat_front_addr":"172.21.15.55:6815/1101456028","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6819","nonce":1658533164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6821","nonce":1658533164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6825","nonce":1658533164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6823","nonce":1658533164}]},"public_addr":"172.21.15.55:6819/1658533164","cluster_addr":"172.21.15.55:6821/1658533164","heartbeat_back_addr":"172.21.15.55:6825/1658533164","heartbeat_front_addr":"172.21.15.55:6823/1658533164","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6801","nonce":2318626480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6803","nonce":2318626480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6807","nonce":2318626480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6805","nonce":2318626480}]},"public_addr":"172.21.15.64:6801/2318626480","cluster_addr":"172.21.15.64:6803/2318626480","heartbeat_back_addr":"172.21.15.64:6807/2318626480","heartbeat_front_addr":"172.21.15.64:6805/2318626480","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6809","nonce":1215616659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6811","nonce":1215616659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6815","nonce":1215616659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6813","nonce":1215616659}]},"public_addr":"172.21.15.64:6809/1215616659","cluster_addr":"172.21.15.64:6811/1215616659","heartbeat_back_addr":"172.21.15.64:6815/1215616659","heartbeat_front_addr":"172.21.15.64:6813/1215616659","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6817","nonce":3985789776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6819","nonce":3985789776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6823","nonce":3985789776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6821","nonce":3985789776}]},"public_addr":"172.21.15.64:6817/3985789776","cluster_addr":"172.21.15.64:6819/3985789776","heartbeat_back_addr":"172.21.15.64:6823/3985789776","heartbeat_front_addr":"172.21.15.64:6821/3985789776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:02:23.727 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:23.727 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:23.728 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 msgr2=0x7fa0f806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 0x7fa0f806f1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa100005fd0 tx=0x7fa10000a560 comp rx=0 tx=0).stop 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 msgr2=0x7fa114198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa1040092e0 tx=0x7fa10400be20 comp rx=0 tx=0).stop 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 shutdown_connections 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa0f806ccf0 0x7fa0f806f1b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa114103040 0x7fa114198d60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 --2- 172.21.15.55:0/2223437843 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1141039f0 0x7fa1141992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 >> 172.21.15.55:0/2223437843 conn(0x7fa1140fe8b0 msgr2=0x7fa1140ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 shutdown_connections 2024-04-26T21:02:23.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:23.728+0000 7fa11ae00700 1 -- 172.21.15.55:0/2223437843 wait complete. 2024-04-26T21:02:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:02:24.474 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:00:32.215135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:02:24.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T21:02:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:24 smithi055 ceph-mon[25475]: Detected new or changed devices on smithi064 2024-04-26T21:02:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:24 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi064 to 4971M 2024-04-26T21:02:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:24 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2223437843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:24.892 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:24 smithi064 ceph-mon[33404]: Detected new or changed devices on smithi064 2024-04-26T21:02:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:24 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi064 to 4971M 2024-04-26T21:02:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:24 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2223437843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:25 smithi055 ceph-mon[25475]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:25.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:25 smithi064 ceph-mon[33404]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:26.683 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:26 smithi055 ceph-mon[25475]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:26 smithi064 ceph-mon[33404]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.242+0000 7f5c22c00700 1 -- 172.21.15.55:0/587471685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073c30 msgr2=0x7f5c1c10ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.242+0000 7f5c22c00700 1 --2- 172.21.15.55:0/587471685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073c30 0x7f5c1c10ce30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009910 tx=0x7f5c08009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 -- 172.21.15.55:0/587471685 shutdown_connections 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 --2- 172.21.15.55:0/587471685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073c30 0x7f5c1c10ce30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 --2- 172.21.15.55:0/587471685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073310 0x7f5c1c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 -- 172.21.15.55:0/587471685 >> 172.21.15.55:0/587471685 conn(0x7f5c1c0fc660 msgr2=0x7f5c1c0fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 -- 172.21.15.55:0/587471685 shutdown_connections 2024-04-26T21:02:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.243+0000 7f5c22c00700 1 -- 172.21.15.55:0/587471685 wait complete. 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.244+0000 7f5c22c00700 1 Processor -- start 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.244+0000 7f5c22c00700 1 -- start start 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.244+0000 7f5c22c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.244+0000 7f5c22c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073c30 0x7f5c1c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.244+0000 7f5c22c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c19f4d0 con 0x7f5c1c073310 2024-04-26T21:02:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.245+0000 7f5c22c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c198ab0 con 0x7f5c1c073c30 2024-04-26T21:02:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.245+0000 7f5c1be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.245+0000 7f5c1be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46984/0 (socket says 172.21.15.55:46984) 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.245+0000 7f5c1be00700 1 -- 172.21.15.55:0/148774985 learned_addr learned my addr 172.21.15.55:0/148774985 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.245+0000 7f5c1b400700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073c30 0x7f5c1c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c1be00700 1 -- 172.21.15.55:0/148774985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073c30 msgr2=0x7f5c1c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c1be00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073c30 0x7f5c1c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c1be00700 1 -- 172.21.15.55:0/148774985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080095f0 con 0x7f5c1c073310 2024-04-26T21:02:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c1be00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00d8d0 tx=0x7f5c0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0c009940 con 0x7f5c1c073310 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c0c010460 con 0x7f5c1c073310 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c198d90 con 0x7f5c1c073310 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.246+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0c00f5f0 con 0x7f5c1c073310 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.247+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c1992e0 con 0x7f5c1c073310 2024-04-26T21:02:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.248+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c107740 con 0x7f5c1c073310 2024-04-26T21:02:27.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.249+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5c0c0105d0 con 0x7f5c1c073310 2024-04-26T21:02:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.250+0000 7f5c18c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 0x7f5c0006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.250+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5c0c08bfc0 con 0x7f5c1c073310 2024-04-26T21:02:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.251+0000 7f5c1b400700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 0x7f5c0006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.252+0000 7f5c1b400700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 0x7f5c0006f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c08005b40 tx=0x7f5c0801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.256+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5c0c0bfc50 con 0x7f5c1c073310 2024-04-26T21:02:27.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.480+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c1c199f70 con 0x7f5c1c073310 2024-04-26T21:02:27.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.481+0000 7f5c18c00700 1 -- 172.21.15.55:0/148774985 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c0c05a0c0 con 0x7f5c1c073310 2024-04-26T21:02:27.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.485+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 msgr2=0x7f5c0006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.485+0000 7f5c22c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 0x7f5c0006f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c08005b40 tx=0x7f5c0801a040 comp rx=0 tx=0).stop 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.485+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 msgr2=0x7f5c1c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.485+0000 7f5c22c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00d8d0 tx=0x7f5c0c00dc90 comp rx=0 tx=0).stop 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 shutdown_connections 2024-04-26T21:02:27.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5c0006ccf0 0x7f5c0006f1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c1c073310 0x7f5c1c19e970 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 --2- 172.21.15.55:0/148774985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c1c073c30 0x7f5c1c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:27.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 >> 172.21.15.55:0/148774985 conn(0x7f5c1c0fc660 msgr2=0x7f5c1c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:27.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 shutdown_connections 2024-04-26T21:02:27.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:27.486+0000 7f5c22c00700 1 -- 172.21.15.55:0/148774985 wait complete. 2024-04-26T21:02:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:27 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/148774985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:02:27.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:27 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/148774985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:02:28.418 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T21:02:28.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T21:02:28.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:28 smithi055 ceph-mon[25475]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:28 smithi064 ceph-mon[33404]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:30.726 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:30 smithi055 ceph-mon[25475]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:30.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:30 smithi064 ceph-mon[33404]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 -- 172.21.15.55:0/803971429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0101710 msgr2=0x7fe5b0103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/803971429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0101710 0x7fe5b0103b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009910 tx=0x7fe5a4009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 -- 172.21.15.55:0/803971429 shutdown_connections 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/803971429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0104040 0x7fe5b0106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/803971429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0101710 0x7fe5b0103b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 -- 172.21.15.55:0/803971429 >> 172.21.15.55:0/803971429 conn(0x7fe5b00fb0c0 msgr2=0x7fe5b00fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 -- 172.21.15.55:0/803971429 shutdown_connections 2024-04-26T21:02:31.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.108+0000 7fe5b7e00700 1 -- 172.21.15.55:0/803971429 wait complete. 2024-04-26T21:02:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.109+0000 7fe5b7e00700 1 Processor -- start 2024-04-26T21:02:31.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b7e00700 1 -- start start 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b7e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0101710 0x7fe5b0196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b7e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0197160 con 0x7fe5b0104040 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b7e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b01972a0 con 0x7fe5b0101710 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47000/0 (socket says 172.21.15.55:47000) 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b4a00700 1 -- 172.21.15.55:0/4057758324 learned_addr learned my addr 172.21.15.55:0/4057758324 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:31.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.110+0000 7fe5b5400700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0101710 0x7fe5b0196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.111+0000 7fe5b4a00700 1 -- 172.21.15.55:0/4057758324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0101710 msgr2=0x7fe5b0196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.111+0000 7fe5b4a00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0101710 0x7fe5b0196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.111+0000 7fe5b4a00700 1 -- 172.21.15.55:0/4057758324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40095f0 con 0x7fe5b0104040 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.111+0000 7fe5b4a00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d8d0 tx=0x7fe59c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.112+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59c0098a0 con 0x7fe5b0104040 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.112+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe59c010460 con 0x7fe5b0104040 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.112+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59c00f5f0 con 0x7fe5b0104040 2024-04-26T21:02:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.112+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b019bd00 con 0x7fe5b0104040 2024-04-26T21:02:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.112+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b019c2d0 con 0x7fe5b0104040 2024-04-26T21:02:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.113+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b004ebb0 con 0x7fe5b0104040 2024-04-26T21:02:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.114+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe59c009a00 con 0x7fe5b0104040 2024-04-26T21:02:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.116+0000 7fe5ae000700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 0x7fe59806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.116+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe59c08bd00 con 0x7fe5b0104040 2024-04-26T21:02:31.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.116+0000 7fe5b5400700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 0x7fe59806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:31.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.117+0000 7fe5b5400700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 0x7fe59806f1b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006010 tx=0x7fe5a4005180 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.121+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe59c08f030 con 0x7fe5b0104040 2024-04-26T21:02:31.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.435+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe5b01097a0 con 0x7fe5b0104040 2024-04-26T21:02:31.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.447+0000 7fe5ae000700 1 -- 172.21.15.55:0/4057758324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe59c059c90 con 0x7fe5b0104040 2024-04-26T21:02:31.449 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-26T21:02:31.449 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBnFixmSn4MGhAAU/GLcNcg6SjHoON7x1UNBg== 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 msgr2=0x7fe59806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 0x7fe59806f1b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006010 tx=0x7fe5a4005180 comp rx=0 tx=0).stop 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 msgr2=0x7fe5b0196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d8d0 tx=0x7fe59c00dbe0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 shutdown_connections 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fe59806ccf0 0x7fe59806f1b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5b0101710 0x7fe5b0196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 --2- 172.21.15.55:0/4057758324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0104040 0x7fe5b0196b40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 >> 172.21.15.55:0/4057758324 conn(0x7fe5b00fb0c0 msgr2=0x7fe5b00fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 shutdown_connections 2024-04-26T21:02:31.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:31.450+0000 7fe5b7e00700 1 -- 172.21.15.55:0/4057758324 wait complete. 2024-04-26T21:02:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:31 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4057758324' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:31 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4057758324' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:02:31.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:31 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4057758324' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:31.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:31 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4057758324' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:02:32.249 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T21:02:32.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T21:02:32.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T21:02:32.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T21:02:32.763 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi064/config 2024-04-26T21:02:32.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:32 smithi064 ceph-mon[33404]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:32 smithi055 ceph-mon[25475]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:34.762 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:34 smithi064 ceph-mon[33404]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:35.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:34 smithi055 ceph-mon[25475]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 -- 172.21.15.64:0/462090200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 msgr2=0x7fba38101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 --2- 172.21.15.64:0/462090200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38101030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba28009910 tx=0x7fba28009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 -- 172.21.15.64:0/462090200 shutdown_connections 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 --2- 172.21.15.64:0/462090200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 --2- 172.21.15.64:0/462090200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38101030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 -- 172.21.15.64:0/462090200 >> 172.21.15.64:0/462090200 conn(0x7fba380fc1f0 msgr2=0x7fba380fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 -- 172.21.15.64:0/462090200 shutdown_connections 2024-04-26T21:02:35.052 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.049+0000 7fba3e200700 1 -- 172.21.15.64:0/462090200 wait complete. 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 Processor -- start 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 -- start start 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba38199380 con 0x7fba38101e10 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba3e200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba381994c0 con 0x7fba38100c10 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba37400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba37400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46296/0 (socket says 172.21.15.64:46296) 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.051+0000 7fba37400700 1 -- 172.21.15.64:0/1928685391 learned_addr learned my addr 172.21.15.64:0/1928685391 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba36a00700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:35.054 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba37400700 1 -- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 msgr2=0x7fba38198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:35.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba37400700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba37400700 1 -- 172.21.15.64:0/1928685391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280095f0 con 0x7fba38100c10 2024-04-26T21:02:35.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba36a00700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:02:35.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.052+0000 7fba37400700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fba280059d0 tx=0x7fba2800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:35.055 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.053+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2801d070 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.053+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba28005dc0 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.053+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3819dec0 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.053+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba28021410 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.053+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3819e3b0 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.054+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba38106270 con 0x7fba38100c10 2024-04-26T21:02:35.056 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.055+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fba2800f840 con 0x7fba38100c10 2024-04-26T21:02:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.056+0000 7fba2fe00700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 0x7fba1c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.057+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fba2808d1f0 con 0x7fba38100c10 2024-04-26T21:02:35.058 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.057+0000 7fba36a00700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 0x7fba1c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:35.060 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.058+0000 7fba36a00700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 0x7fba1c06f1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba24005fd0 tx=0x7fba24005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:35.063 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.063+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fba2805b2f0 con 0x7fba38100c10 2024-04-26T21:02:35.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.377+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fba381099b0 con 0x7fba38100c10 2024-04-26T21:02:35.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.390+0000 7fba2fe00700 1 -- 172.21.15.64:0/1928685391 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7fba2805ae80 con 0x7fba38100c10 2024-04-26T21:02:35.391 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2024-04-26T21:02:35.391 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBrFixmt3u4FhAA6B9H5nfpe9380Rsbuc6vAw== 2024-04-26T21:02:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 msgr2=0x7fba1c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 0x7fba1c06f1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba24005fd0 tx=0x7fba24005ee0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 msgr2=0x7fba38198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fba280059d0 tx=0x7fba2800be20 comp rx=0 tx=0).stop 2024-04-26T21:02:35.394 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 shutdown_connections 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fba1c06cce0 0x7fba1c06f1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba38100c10 0x7fba38198820 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 --2- 172.21.15.64:0/1928685391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba38101e10 0x7fba38198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.392+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 >> 172.21.15.64:0/1928685391 conn(0x7fba380fc1f0 msgr2=0x7fba381033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.393+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 shutdown_connections 2024-04-26T21:02:35.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:02:35.393+0000 7fba3e200700 1 -- 172.21.15.64:0/1928685391 wait complete. 2024-04-26T21:02:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:35 smithi064 ceph-mon[33404]: from='client.? 172.21.15.64:0/1928685391' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:35 smithi064 ceph-mon[33404]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:35 smithi064 ceph-mon[33404]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:02:36.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.64:0/1928685391' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:36.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:35 smithi055 ceph-mon[25475]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T21:02:36.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:35 smithi055 ceph-mon[25475]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T21:02:36.417 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T21:02:36.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-26T21:02:36.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T21:02:36.561 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T21:02:36.561 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T21:02:36.562 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T21:02:36.977 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:37.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:37 smithi055 ceph-mon[25475]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:37.493 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:37 smithi064 ceph-mon[33404]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.074+0000 7f0a63200700 1 -- 172.21.15.55:0/1383966738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a640ff900 msgr2=0x7f0a640ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.074+0000 7f0a63200700 1 --2- 172.21.15.55:0/1383966738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a640ff900 0x7f0a640ffd80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009910 tx=0x7f0a50009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 -- 172.21.15.55:0/1383966738 shutdown_connections 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 --2- 172.21.15.55:0/1383966738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a640ff900 0x7f0a640ffd80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 --2- 172.21.15.55:0/1383966738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a64105900 0x7f0a64105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 -- 172.21.15.55:0/1383966738 >> 172.21.15.55:0/1383966738 conn(0x7f0a640fb3f0 msgr2=0x7f0a640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 -- 172.21.15.55:0/1383966738 shutdown_connections 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.075+0000 7f0a63200700 1 -- 172.21.15.55:0/1383966738 wait complete. 2024-04-26T21:02:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 Processor -- start 2024-04-26T21:02:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 -- start start 2024-04-26T21:02:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a640fc1a0 0x7f0a640fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640fdbb0 con 0x7f0a64105900 2024-04-26T21:02:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.076+0000 7f0a63200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641a2d20 con 0x7f0a640fc1a0 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43624/0 (socket says 172.21.15.55:43624) 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 -- 172.21.15.55:0/945037131 learned_addr learned my addr 172.21.15.55:0/945037131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61400700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a640fc1a0 0x7f0a640fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 -- 172.21.15.55:0/945037131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a640fc1a0 msgr2=0x7f0a640fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a640fc1a0 0x7f0a640fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.077+0000 7f0a61e00700 1 -- 172.21.15.55:0/945037131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500095f0 con 0x7f0a64105900 2024-04-26T21:02:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a61e00700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400d900 tx=0x7f0a5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a540041f0 con 0x7f0a64105900 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a54004cf0 con 0x7f0a64105900 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a641a2f20 con 0x7f0a64105900 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5400b750 con 0x7f0a64105900 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.078+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641a33e0 con 0x7f0a64105900 2024-04-26T21:02:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.079+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a64107f20 con 0x7f0a64105900 2024-04-26T21:02:39.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.081+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0a54004350 con 0x7f0a64105900 2024-04-26T21:02:39.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.081+0000 7f0a5aa00700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 0x7f0a4806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:39.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.081+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0a5408bff0 con 0x7f0a64105900 2024-04-26T21:02:39.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.082+0000 7f0a61400700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 0x7f0a4806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:39.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.082+0000 7f0a61400700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 0x7f0a4806f1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a5001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:39.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.087+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0a540bfc50 con 0x7f0a64105900 2024-04-26T21:02:39.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.372+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0a64104290 con 0x7f0a64105900 2024-04-26T21:02:39.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.382+0000 7f0a5aa00700 1 -- 172.21.15.55:0/945037131 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174009 (secure 0 0 0) 0x7f0a540bd7d0 con 0x7f0a64105900 2024-04-26T21:02:39.384 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:02:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.387+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 msgr2=0x7f0a4806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.387+0000 7f0a63200700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 0x7f0a4806f1b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a5001a040 comp rx=0 tx=0).stop 2024-04-26T21:02:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.387+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 msgr2=0x7f0a640fbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.387+0000 7f0a63200700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400d900 tx=0x7f0a5400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 shutdown_connections 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f0a4806ccf0 0x7f0a4806f1b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a64105900 0x7f0a640fbc60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 --2- 172.21.15.55:0/945037131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a640fc1a0 0x7f0a640fc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 >> 172.21.15.55:0/945037131 conn(0x7f0a640fb3f0 msgr2=0x7f0a64109e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 shutdown_connections 2024-04-26T21:02:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:39.388+0000 7f0a63200700 1 -- 172.21.15.55:0/945037131 wait complete. 2024-04-26T21:02:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:39 smithi064 ceph-mon[33404]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:39 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/945037131' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T21:02:39.753 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:39 smithi055 ceph-mon[25475]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:39.753 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:39 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/945037131' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T21:02:40.161 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi055.ybbowr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":912138010},{"type":"v1","addr":"172.21.15.55:6801","nonce":912138010}]},"active_addr":"172.21.15.55:6801/912138010","active_change":"2024-04-26T20:57:21.478865+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14242,"name":"smithi064.tchyje","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.55:8443/","prometheus":"http://172.21.15.55:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":3943565490}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":108673769}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2020032469}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2964479330}]}]} 2024-04-26T21:02:40.165 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T21:02:40.165 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T21:02:40.165 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:02:40.595 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:41.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:41 smithi064 ceph-mon[33404]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:41 smithi055 ceph-mon[25475]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 -- 172.21.15.55:0/1242957985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 msgr2=0x7fecfc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 --2- 172.21.15.55:0/1242957985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc107a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fece4009910 tx=0x7fece4009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 -- 172.21.15.55:0/1242957985 shutdown_connections 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 --2- 172.21.15.55:0/1242957985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc107a40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 --2- 172.21.15.55:0/1242957985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 0x7fecfc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 -- 172.21.15.55:0/1242957985 >> 172.21.15.55:0/1242957985 conn(0x7fecfc0fe8b0 msgr2=0x7fecfc100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 -- 172.21.15.55:0/1242957985 shutdown_connections 2024-04-26T21:02:42.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.734+0000 7fed00c00700 1 -- 172.21.15.55:0/1242957985 wait complete. 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.735+0000 7fed00c00700 1 Processor -- start 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.735+0000 7fed00c00700 1 -- start start 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fed00c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 0x7fecfc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fed00c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fed00c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc199a30 con 0x7fecfc1039f0 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fed00c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc19d700 con 0x7fecfc103040 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fecf3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fecf3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43638/0 (socket says 172.21.15.55:43638) 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fecf3e00700 1 -- 172.21.15.55:0/2570929508 learned_addr learned my addr 172.21.15.55:0/2570929508 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:42.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.736+0000 7fecf9e00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 0x7fecfc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf3e00700 1 -- 172.21.15.55:0/2570929508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 msgr2=0x7fecfc198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf3e00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 0x7fecfc198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf3e00700 1 -- 172.21.15.55:0/2570929508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40095f0 con 0x7fecfc1039f0 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf3e00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fece40092e0 tx=0x7fece400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece401d070 con 0x7fecfc1039f0 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fece400f460 con 0x7fecfc1039f0 2024-04-26T21:02:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc19d980 con 0x7fecfc1039f0 2024-04-26T21:02:42.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.737+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fece4017610 con 0x7fecfc1039f0 2024-04-26T21:02:42.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.738+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc19de70 con 0x7fecfc1039f0 2024-04-26T21:02:42.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.739+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc10b390 con 0x7fecfc1039f0 2024-04-26T21:02:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.740+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fece400f5d0 con 0x7fecfc1039f0 2024-04-26T21:02:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.740+0000 7fecf2a00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 0x7fecdc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.741+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fece408d480 con 0x7fecfc1039f0 2024-04-26T21:02:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.741+0000 7fecf9e00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 0x7fecdc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.741+0000 7fecf9e00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 0x7fecdc06f1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecec006fd0 tx=0x7fecec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:42.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.746+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fece4057af0 con 0x7fecfc1039f0 2024-04-26T21:02:42.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.973+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc19a120 con 0x7fecfc1039f0 2024-04-26T21:02:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.977+0000 7fecf2a00700 1 -- 172.21.15.55:0/2570929508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7fece405b110 con 0x7fecfc1039f0 2024-04-26T21:02:42.979 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:02:42.979 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:02:18.392242+0000","last_up_change":"2024-04-26T21:02:17.373655+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6803","nonce":2401927072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6805","nonce":2401927072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6809","nonce":2401927072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6807","nonce":2401927072}]},"public_addr":"172.21.15.55:6803/2401927072","cluster_addr":"172.21.15.55:6805/2401927072","heartbeat_back_addr":"172.21.15.55:6809/2401927072","heartbeat_front_addr":"172.21.15.55:6807/2401927072","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6811","nonce":1101456028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6813","nonce":1101456028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6817","nonce":1101456028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6815","nonce":1101456028}]},"public_addr":"172.21.15.55:6811/1101456028","cluster_addr":"172.21.15.55:6813/1101456028","heartbeat_back_addr":"172.21.15.55:6817/1101456028","heartbeat_front_addr":"172.21.15.55:6815/1101456028","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6819","nonce":1658533164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6821","nonce":1658533164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6825","nonce":1658533164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6823","nonce":1658533164}]},"public_addr":"172.21.15.55:6819/1658533164","cluster_addr":"172.21.15.55:6821/1658533164","heartbeat_back_addr":"172.21.15.55:6825/1658533164","heartbeat_front_addr":"172.21.15.55:6823/1658533164","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6801","nonce":2318626480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6803","nonce":2318626480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6807","nonce":2318626480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6805","nonce":2318626480}]},"public_addr":"172.21.15.64:6801/2318626480","cluster_addr":"172.21.15.64:6803/2318626480","heartbeat_back_addr":"172.21.15.64:6807/2318626480","heartbeat_front_addr":"172.21.15.64:6805/2318626480","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6809","nonce":1215616659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6811","nonce":1215616659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6815","nonce":1215616659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6813","nonce":1215616659}]},"public_addr":"172.21.15.64:6809/1215616659","cluster_addr":"172.21.15.64:6811/1215616659","heartbeat_back_addr":"172.21.15.64:6815/1215616659","heartbeat_front_addr":"172.21.15.64:6813/1215616659","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6817","nonce":3985789776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6819","nonce":3985789776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6823","nonce":3985789776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6821","nonce":3985789776}]},"public_addr":"172.21.15.64:6817/3985789776","cluster_addr":"172.21.15.64:6819/3985789776","heartbeat_back_addr":"172.21.15.64:6823/3985789776","heartbeat_front_addr":"172.21.15.64:6821/3985789776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:02:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 msgr2=0x7fecdc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 0x7fecdc06f1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecec006fd0 tx=0x7fecec008040 comp rx=0 tx=0).stop 2024-04-26T21:02:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 msgr2=0x7fecfc199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fece40092e0 tx=0x7fece400be20 comp rx=0 tx=0).stop 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 shutdown_connections 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fecdc06ccf0 0x7fecdc06f1b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecfc103040 0x7fecfc198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 --2- 172.21.15.55:0/2570929508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecfc1039f0 0x7fecfc199350 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.980+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 >> 172.21.15.55:0/2570929508 conn(0x7fecfc0fe8b0 msgr2=0x7fecfc0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.981+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 shutdown_connections 2024-04-26T21:02:42.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:42.981+0000 7fed00c00700 1 -- 172.21.15.55:0/2570929508 wait complete. 2024-04-26T21:02:43.688 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:43 smithi055 ceph-mon[25475]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:43.688 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:43 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2570929508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:43.756 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T21:02:43.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T21:02:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:43 smithi064 ceph-mon[33404]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:43 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2570929508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:44.186 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:45 smithi055 ceph-mon[25475]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:45 smithi064 ceph-mon[33404]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2830032286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0102e60 msgr2=0x7f6ba0103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2830032286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0102e60 0x7f6ba0103240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009910 tx=0x7f6b90009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2830032286 shutdown_connections 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2830032286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0103810 0x7f6ba0107860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2830032286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0102e60 0x7f6ba0103240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2830032286 >> 172.21.15.55:0/2830032286 conn(0x7f6ba00fe6d0 msgr2=0x7f6ba0100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2830032286 shutdown_connections 2024-04-26T21:02:46.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.364+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2830032286 wait complete. 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.365+0000 7f6ba5a00700 1 Processor -- start 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.365+0000 7f6ba5a00700 1 -- start start 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6ba5a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0102e60 0x7f6ba019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6ba5a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6ba5a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba019f500 con 0x7f6ba0103810 2024-04-26T21:02:46.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6ba5a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0198a70 con 0x7f6ba0102e60 2024-04-26T21:02:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46872/0 (socket says 172.21.15.55:46872) 2024-04-26T21:02:46.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9f400700 1 -- 172.21.15.55:0/2091043230 learned_addr learned my addr 172.21.15.55:0/2091043230 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9fe00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0102e60 0x7f6ba019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9f400700 1 -- 172.21.15.55:0/2091043230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0102e60 msgr2=0x7f6ba019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.366+0000 7f6b9f400700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0102e60 0x7f6ba019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6b9f400700 1 -- 172.21.15.55:0/2091043230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900095f0 con 0x7f6ba0103810 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6b9f400700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d900 tx=0x7f6b8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8c009900 con 0x7f6ba0103810 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8c010460 con 0x7f6ba0103810 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8c00f5f0 con 0x7f6ba0103810 2024-04-26T21:02:46.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba0198d50 con 0x7f6ba0103810 2024-04-26T21:02:46.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.367+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba01992a0 con 0x7f6ba0103810 2024-04-26T21:02:46.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.369+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba010b200 con 0x7f6ba0103810 2024-04-26T21:02:46.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.370+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6b8c0105d0 con 0x7f6ba0103810 2024-04-26T21:02:46.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.371+0000 7f6b9cc00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 0x7f6b8406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:46.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.371+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6b8c08bd30 con 0x7f6ba0103810 2024-04-26T21:02:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.371+0000 7f6b9fe00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 0x7f6b8406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:46.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.372+0000 7f6b9fe00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 0x7f6b8406f1b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000b5c0 tx=0x7f6b9001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:46.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.377+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6b8c059eb0 con 0x7f6ba0103810 2024-04-26T21:02:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.601+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba0104340 con 0x7f6ba0103810 2024-04-26T21:02:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.603+0000 7f6b9cc00700 1 -- 172.21.15.55:0/2091043230 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11310 (secure 0 0 0) 0x7f6b8c059a40 con 0x7f6ba0103810 2024-04-26T21:02:46.605 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:02:46.605 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":41,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:02:18.392242+0000","last_up_change":"2024-04-26T21:02:17.373655+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6803","nonce":2401927072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6805","nonce":2401927072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6809","nonce":2401927072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6807","nonce":2401927072}]},"public_addr":"172.21.15.55:6803/2401927072","cluster_addr":"172.21.15.55:6805/2401927072","heartbeat_back_addr":"172.21.15.55:6809/2401927072","heartbeat_front_addr":"172.21.15.55:6807/2401927072","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6811","nonce":1101456028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6813","nonce":1101456028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6817","nonce":1101456028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6815","nonce":1101456028}]},"public_addr":"172.21.15.55:6811/1101456028","cluster_addr":"172.21.15.55:6813/1101456028","heartbeat_back_addr":"172.21.15.55:6817/1101456028","heartbeat_front_addr":"172.21.15.55:6815/1101456028","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6819","nonce":1658533164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6821","nonce":1658533164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6825","nonce":1658533164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6823","nonce":1658533164}]},"public_addr":"172.21.15.55:6819/1658533164","cluster_addr":"172.21.15.55:6821/1658533164","heartbeat_back_addr":"172.21.15.55:6825/1658533164","heartbeat_front_addr":"172.21.15.55:6823/1658533164","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6801","nonce":2318626480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6803","nonce":2318626480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6807","nonce":2318626480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6805","nonce":2318626480}]},"public_addr":"172.21.15.64:6801/2318626480","cluster_addr":"172.21.15.64:6803/2318626480","heartbeat_back_addr":"172.21.15.64:6807/2318626480","heartbeat_front_addr":"172.21.15.64:6805/2318626480","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6809","nonce":1215616659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6811","nonce":1215616659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6815","nonce":1215616659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6813","nonce":1215616659}]},"public_addr":"172.21.15.64:6809/1215616659","cluster_addr":"172.21.15.64:6811/1215616659","heartbeat_back_addr":"172.21.15.64:6815/1215616659","heartbeat_front_addr":"172.21.15.64:6813/1215616659","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6817","nonce":3985789776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6819","nonce":3985789776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6823","nonce":3985789776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6821","nonce":3985789776}]},"public_addr":"172.21.15.64:6817/3985789776","cluster_addr":"172.21.15.64:6819/3985789776","heartbeat_back_addr":"172.21.15.64:6823/3985789776","heartbeat_front_addr":"172.21.15.64:6821/3985789776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 msgr2=0x7f6b8406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 0x7f6b8406f1b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000b5c0 tx=0x7f6b9001a040 comp rx=0 tx=0).stop 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 msgr2=0x7f6ba019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d900 tx=0x7f6b8c00dcc0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 shutdown_connections 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b8406ccf0 0x7f6b8406f1b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ba0102e60 0x7f6ba019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 --2- 172.21.15.55:0/2091043230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ba0103810 0x7f6ba019ee70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.606+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 >> 172.21.15.55:0/2091043230 conn(0x7f6ba00fe6d0 msgr2=0x7f6ba00feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.607+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 shutdown_connections 2024-04-26T21:02:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:46.607+0000 7f6ba5a00700 1 -- 172.21.15.55:0/2091043230 wait complete. 2024-04-26T21:02:47.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T21:02:47.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T21:02:47.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T21:02:47.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T21:02:47.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T21:02:47.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T21:02:47.620 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:47 smithi055 ceph-mon[25475]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:47.621 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:47 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2091043230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:47 smithi064 ceph-mon[33404]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:47 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2091043230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:02:47.928 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:48.026 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:48.026 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:48.256 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:48.278 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:02:49.666 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:49 smithi055 ceph-mon[25475]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:49.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:49 smithi064 ceph-mon[33404]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:51 smithi055 ceph-mon[25475]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:51.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:51 smithi064 ceph-mon[33404]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:52.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:02:53.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:53 smithi055 ceph-mon[25475]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:53.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:53 smithi064 ceph-mon[33404]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 -- 172.21.15.55:0/1816165368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 msgr2=0x7f905c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 --2- 172.21.15.55:0/1816165368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c1011f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9050009910 tx=0x7f9050009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 -- 172.21.15.55:0/1816165368 shutdown_connections 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 --2- 172.21.15.55:0/1816165368 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 0x7f905c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 --2- 172.21.15.55:0/1816165368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c1011f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 -- 172.21.15.55:0/1816165368 >> 172.21.15.55:0/1816165368 conn(0x7f905c0fc6e0 msgr2=0x7f905c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 -- 172.21.15.55:0/1816165368 shutdown_connections 2024-04-26T21:02:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.438+0000 7f9064400700 1 -- 172.21.15.55:0/1816165368 wait complete. 2024-04-26T21:02:54.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.439+0000 7f9064400700 1 Processor -- start 2024-04-26T21:02:54.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.439+0000 7f9064400700 1 -- start start 2024-04-26T21:02:54.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9064400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9064400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 0x7f905c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9064400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c199a10 con 0x7f905c100e10 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9064400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c19d6e0 con 0x7f905c1017c0 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46904/0 (socket says 172.21.15.55:46904) 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 -- 172.21.15.55:0/1675649546 learned_addr learned my addr 172.21.15.55:0/1675649546 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:54.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061000700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 0x7f905c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 -- 172.21.15.55:0/1675649546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 msgr2=0x7f905c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 0x7f905c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.440+0000 7f9061a00700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500095f0 con 0x7f905c100e10 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f9061a00700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9050006010 tx=0x7f905000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905001d070 con 0x7f905c100e10 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f905000f460 con 0x7f905c100e10 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c19d960 con 0x7f905c100e10 2024-04-26T21:02:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9050017630 con 0x7f905c100e10 2024-04-26T21:02:54.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.441+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c19de50 con 0x7f905c100e10 2024-04-26T21:02:54.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.442+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f905c10e150 con 0x7f905c100e10 2024-04-26T21:02:54.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.443+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f905000f5d0 con 0x7f905c100e10 2024-04-26T21:02:54.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.444+0000 7f905a000700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 0x7f904406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:54.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.444+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f905008d4e0 con 0x7f905c100e10 2024-04-26T21:02:54.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.445+0000 7f9061000700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 0x7f904406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:54.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.445+0000 7f905a000700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 0x7f9044074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:54.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.445+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90440754a0 con 0x7f90440729d0 2024-04-26T21:02:54.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.445+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f905008fab0 con 0x7f905c100e10 2024-04-26T21:02:54.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.445+0000 7f9062400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 0x7f9044074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:54.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.446+0000 7f9061000700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 0x7f904406f1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9048006fd0 tx=0x7f9048008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:54.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.446+0000 7f9062400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 0x7f9044074df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:54.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.447+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== osd.1 v2:172.21.15.55:6810/1101456028 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f90440754a0 con 0x7f90440729d0 2024-04-26T21:02:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.465+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 --> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f905c1022f0 con 0x7f90440729d0 2024-04-26T21:02:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.466+0000 7f905a000700 1 -- 172.21.15.55:0/1675649546 <== osd.1 v2:172.21.15.55:6810/1101456028 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f905c1022f0 con 0x7f90440729d0 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.466+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 msgr2=0x7f9044074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.466+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 0x7f9044074df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 msgr2=0x7f904406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 0x7f904406f1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9048006fd0 tx=0x7f9048008040 comp rx=0 tx=0).stop 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 msgr2=0x7f905c198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9050006010 tx=0x7f905000be20 comp rx=0 tx=0).stop 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 shutdown_connections 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6810/1101456028,v1:172.21.15.55:6811/1101456028] conn(0x7f90440729d0 0x7f9044074df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f904406ccf0 0x7f904406f1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f905c100e10 0x7f905c198df0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 --2- 172.21.15.55:0/1675649546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f905c1017c0 0x7f905c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 >> 172.21.15.55:0/1675649546 conn(0x7f905c0fc6e0 msgr2=0x7f905c074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 shutdown_connections 2024-04-26T21:02:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:54.467+0000 7f9064400700 1 -- 172.21.15.55:0/1675649546 wait complete. 2024-04-26T21:02:54.693 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:54 smithi055 ceph-mon[25475]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:54 smithi064 ceph-mon[33404]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.756+0000 7f15a1200700 1 -- 172.21.15.55:0/2396664034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c100e60 msgr2=0x7f159c101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.756+0000 7f15a1200700 1 --2- 172.21.15.55:0/2396664034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c100e60 0x7f159c101240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f158c009910 tx=0x7f158c009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 -- 172.21.15.55:0/2396664034 shutdown_connections 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 --2- 172.21.15.55:0/2396664034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c101810 0x7f159c105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 --2- 172.21.15.55:0/2396664034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c100e60 0x7f159c101240 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 -- 172.21.15.55:0/2396664034 >> 172.21.15.55:0/2396664034 conn(0x7f159c0fc6d0 msgr2=0x7f159c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 -- 172.21.15.55:0/2396664034 shutdown_connections 2024-04-26T21:02:55.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.757+0000 7f15a1200700 1 -- 172.21.15.55:0/2396664034 wait complete. 2024-04-26T21:02:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 Processor -- start 2024-04-26T21:02:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 -- start start 2024-04-26T21:02:55.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c100e60 0x7f159c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c199c20 con 0x7f159c101810 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.759+0000 7f15a1200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c199d60 con 0x7f159c100e60 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38808/0 (socket says 172.21.15.55:38808) 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 -- 172.21.15.55:0/579258452 learned_addr learned my addr 172.21.15.55:0/579258452 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:55.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599e00700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c100e60 0x7f159c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 -- 172.21.15.55:0/579258452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c100e60 msgr2=0x7f159c199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c100e60 0x7f159c199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.760+0000 7f1599400700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0095f0 con 0x7f159c101810 2024-04-26T21:02:55.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.761+0000 7f1599400700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f158800c960 tx=0x7f158800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.761+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1588007a70 con 0x7f159c101810 2024-04-26T21:02:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.761+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1588007bd0 con 0x7f159c101810 2024-04-26T21:02:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.761+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1588018630 con 0x7f159c101810 2024-04-26T21:02:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.762+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c19daf0 con 0x7f159c101810 2024-04-26T21:02:55.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.762+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c19e040 con 0x7f159c101810 2024-04-26T21:02:55.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.763+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f159c102340 con 0x7f159c101810 2024-04-26T21:02:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.765+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f158800f450 con 0x7f159c101810 2024-04-26T21:02:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.766+0000 7f1592a00700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 0x7f158006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.766+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f158808bea0 con 0x7f159c101810 2024-04-26T21:02:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.767+0000 7f1599e00700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 0x7f158006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.767+0000 7f1592a00700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 0x7f1580074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.767+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15800754e0 con 0x7f1580072a10 2024-04-26T21:02:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.767+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15880914f0 con 0x7f159c101810 2024-04-26T21:02:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.767+0000 7f159a800700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 0x7f1580074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.768+0000 7f1599e00700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 0x7f158006f1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.768+0000 7f159a800700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 0x7f1580074e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:55.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.769+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== osd.2 v2:172.21.15.55:6818/1658533164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f15800754e0 con 0x7f1580072a10 2024-04-26T21:02:55.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.786+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 --> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f159c10e070 con 0x7f1580072a10 2024-04-26T21:02:55.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.787+0000 7f1592a00700 1 -- 172.21.15.55:0/579258452 <== osd.2 v2:172.21.15.55:6818/1658533164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f159c10e070 con 0x7f1580072a10 2024-04-26T21:02:55.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.787+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 msgr2=0x7f1580074e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:55.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.787+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 0x7f1580074e30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 msgr2=0x7f158006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 0x7f158006f1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c01a040 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 msgr2=0x7f159c1995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f158800c960 tx=0x7f158800cc70 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 shutdown_connections 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6818/1658533164,v1:172.21.15.55:6819/1658533164] conn(0x7f1580072a10 0x7f1580074e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f158006cce0 0x7f158006f1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159c100e60 0x7f159c199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 --2- 172.21.15.55:0/579258452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f159c101810 0x7f159c1995d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 >> 172.21.15.55:0/579258452 conn(0x7f159c0fc6d0 msgr2=0x7f159c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:55.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 shutdown_connections 2024-04-26T21:02:55.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:55.788+0000 7f15a1200700 1 -- 172.21.15.55:0/579258452 wait complete. 2024-04-26T21:02:56.544 INFO:teuthology.orchestra.run.smithi055.stdout:60129542184 2024-04-26T21:02:56.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T21:02:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:56 smithi055 ceph-mon[25475]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:56.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:56 smithi064 ceph-mon[33404]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 -- 172.21.15.55:0/3387306151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6880ff090 msgr2=0x7ff6880ff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 --2- 172.21.15.55:0/3387306151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6880ff090 0x7ff6880ff510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff674009910 tx=0x7ff674009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 -- 172.21.15.55:0/3387306151 shutdown_connections 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 --2- 172.21.15.55:0/3387306151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6880ff090 0x7ff6880ff510 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 --2- 172.21.15.55:0/3387306151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff688105c70 0x7ff688106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 -- 172.21.15.55:0/3387306151 >> 172.21.15.55:0/3387306151 conn(0x7ff688075f00 msgr2=0x7ff6880fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 -- 172.21.15.55:0/3387306151 shutdown_connections 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.486+0000 7ff68f800700 1 -- 172.21.15.55:0/3387306151 wait complete. 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.487+0000 7ff68f800700 1 Processor -- start 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.487+0000 7ff68f800700 1 -- start start 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff68f800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6880ff090 0x7ff688198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff68f800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff68f800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff688199a00 con 0x7ff688105c70 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff68f800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68819d6d0 con 0x7ff6880ff090 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38846/0 (socket says 172.21.15.55:38846) 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 -- 172.21.15.55:0/2717625618 learned_addr learned my addr 172.21.15.55:0/2717625618 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff68ce00700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6880ff090 0x7ff688198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 -- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6880ff090 msgr2=0x7ff688198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6880ff090 0x7ff688198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.488+0000 7ff687e00700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740095f0 con 0x7ff688105c70 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff687e00700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff674006010 tx=0x7ff67400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff67401d070 con 0x7ff688105c70 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff67400f460 con 0x7ff688105c70 2024-04-26T21:02:58.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff674017630 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68819d950 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.489+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68819de40 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.490+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff68810e1c0 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.492+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff67400f5d0 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff685600700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 0x7ff67006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff67408d460 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff68ce00700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 0x7ff67006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff685600700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 0x7ff670074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6700754a0 con 0x7ff6700729d0 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.493+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff67408fa90 con 0x7ff688105c70 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.494+0000 7ff68d800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 0x7ff670074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.494+0000 7ff68ce00700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 0x7ff67006f1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67c005fd0 tx=0x7ff67c00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.495+0000 7ff68d800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 0x7ff670074df0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.497+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== osd.5 v2:172.21.15.64:6816/3985789776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ff6700754a0 con 0x7ff6700729d0 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.514+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 --> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff68819e3b0 con 0x7ff6700729d0 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.515+0000 7ff685600700 1 -- 172.21.15.55:0/2717625618 <== osd.5 v2:172.21.15.64:6816/3985789776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff68819e3b0 con 0x7ff6700729d0 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.515+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 msgr2=0x7ff670074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.515+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 0x7ff670074df0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 msgr2=0x7ff67006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 0x7ff67006f1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67c005fd0 tx=0x7ff67c00a560 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 msgr2=0x7ff688199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff674006010 tx=0x7ff67400be20 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 shutdown_connections 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:6816/3985789776,v1:172.21.15.64:6817/3985789776] conn(0x7ff6700729d0 0x7ff670074df0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff67006ccf0 0x7ff67006f1b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6880ff090 0x7ff688198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 --2- 172.21.15.55:0/2717625618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff688105c70 0x7ff688199320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 >> 172.21.15.55:0/2717625618 conn(0x7ff688075f00 msgr2=0x7ff688104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 shutdown_connections 2024-04-26T21:02:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.516+0000 7ff68f800700 1 -- 172.21.15.55:0/2717625618 wait complete. 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 -- 172.21.15.55:0/590749123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 msgr2=0x7f2320111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 --2- 172.21.15.55:0/590749123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f2320111520 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f230c009910 tx=0x7f230c009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 -- 172.21.15.55:0/590749123 shutdown_connections 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 --2- 172.21.15.55:0/590749123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f2320111520 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 --2- 172.21.15.55:0/590749123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 0x7f23200757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 -- 172.21.15.55:0/590749123 >> 172.21.15.55:0/590749123 conn(0x7f23200fe8d0 msgr2=0x7f2320100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 -- 172.21.15.55:0/590749123 shutdown_connections 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.603+0000 7f2328200700 1 -- 172.21.15.55:0/590749123 wait complete. 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.604+0000 7f2328200700 1 Processor -- start 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.604+0000 7f2328200700 1 -- start start 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2328200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 0x7f232019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2328200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2328200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232019dc70 con 0x7f2320075d30 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2328200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23201a1940 con 0x7f2320075410 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2324e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2324e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38870/0 (socket says 172.21.15.55:38870) 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2324e00700 1 -- 172.21.15.55:0/2011546621 learned_addr learned my addr 172.21.15.55:0/2011546621 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.605+0000 7f2325800700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 0x7f232019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f2324e00700 1 -- 172.21.15.55:0/2011546621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 msgr2=0x7f232019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f2324e00700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 0x7f232019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f2324e00700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0095f0 con 0x7f2320075d30 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f2324e00700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f230c006010 tx=0x7f230c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c01d070 con 0x7f2320075d30 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f230c00bea0 con 0x7f2320075d30 2024-04-26T21:02:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230c00fd70 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.606+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23201a1c20 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.607+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23201a2170 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.607+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2320114620 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.609+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f230c00f560 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.609+0000 7f231e000700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 0x7f230806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f230c08d030 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f2325800700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 0x7f230806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f231e000700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 0x7f2308074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23080754a0 con 0x7f23080729d0 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f230c08f700 con 0x7f2320075d30 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.610+0000 7f2326200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 0x7f2308074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.611+0000 7f2325800700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 0x7f230806f1b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2314005950 tx=0x7f23140058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.611+0000 7f2326200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 0x7f2308074df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.612+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== osd.0 v2:172.21.15.55:6802/2401927072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f23080754a0 con 0x7f23080729d0 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.630+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 --> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f23201a26c0 con 0x7f23080729d0 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f231e000700 1 -- 172.21.15.55:0/2011546621 <== osd.0 v2:172.21.15.55:6802/2401927072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f23201a26c0 con 0x7f23080729d0 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 msgr2=0x7f2308074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 0x7f2308074df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 msgr2=0x7f230806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 0x7f230806f1b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2314005950 tx=0x7f23140058e0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 msgr2=0x7f232019d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.631+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f230c006010 tx=0x7f230c0056a0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 shutdown_connections 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6802/2401927072,v1:172.21.15.55:6803/2401927072] conn(0x7f23080729d0 0x7f2308074df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f230806ccf0 0x7f230806f1b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2320075410 0x7f232019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 --2- 172.21.15.55:0/2011546621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2320075d30 0x7f232019d590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 >> 172.21.15.55:0/2011546621 conn(0x7f23200fe8d0 msgr2=0x7f23200ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 shutdown_connections 2024-04-26T21:02:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:57.632+0000 7f2328200700 1 -- 172.21.15.55:0/2011546621 wait complete. 2024-04-26T21:02:58.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 -- 172.21.15.55:0/3112070038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 msgr2=0x7fab6410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 --2- 172.21.15.55:0/3112070038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6410ab80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009910 tx=0x7fab4c009c20 comp rx=0 tx=0).stop 2024-04-26T21:02:58.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 -- 172.21.15.55:0/3112070038 shutdown_connections 2024-04-26T21:02:58.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 --2- 172.21.15.55:0/3112070038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6410ab80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 --2- 172.21.15.55:0/3112070038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 0x7fab641020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 -- 172.21.15.55:0/3112070038 >> 172.21.15.55:0/3112070038 conn(0x7fab640fb5e0 msgr2=0x7fab640fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 -- 172.21.15.55:0/3112070038 shutdown_connections 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.317+0000 7fab6a400700 1 -- 172.21.15.55:0/3112070038 wait complete. 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.318+0000 7fab6a400700 1 Processor -- start 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.318+0000 7fab6a400700 1 -- start start 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab6a400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 0x7fab6419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab6a400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab6a400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6419f5a0 con 0x7fab64102690 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab6a400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64198b80 con 0x7fab64101ce0 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38826/0 (socket says 172.21.15.55:38826) 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab5aa00700 1 -- 172.21.15.55:0/1576420533 learned_addr learned my addr 172.21.15.55:0/1576420533 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.319+0000 7fab63400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 0x7fab6419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab5aa00700 1 -- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 msgr2=0x7fab6419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab5aa00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 0x7fab6419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab5aa00700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0095f0 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab5aa00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0092e0 tx=0x7fab4c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4c01d070 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab4c005700 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab64198e00 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4c017400 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.320+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641992f0 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.321+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab6410e0b0 con 0x7fab64102690 2024-04-26T21:02:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.322+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fab4c003a60 con 0x7fab64102690 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.323+0000 7fab60c00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 0x7fab4806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.323+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fab4c08d6b0 con 0x7fab64102690 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab60c00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 0x7fab48074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab63400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 0x7fab4806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab48075490 con 0x7fab480729c0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab4c08db10 con 0x7fab64102690 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab63e00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 0x7fab48074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.324+0000 7fab63400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 0x7fab4806f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab54009d10 tx=0x7fab54009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.325+0000 7fab63e00700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 0x7fab48074de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.327+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== osd.3 v2:172.21.15.64:6800/2318626480 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fab48075490 con 0x7fab480729c0 2024-04-26T21:02:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.345+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 --> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab64199810 con 0x7fab480729c0 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab60c00700 1 -- 172.21.15.55:0/1576420533 <== osd.3 v2:172.21.15.64:6800/2318626480 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fab64199810 con 0x7fab480729c0 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 msgr2=0x7fab48074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 0x7fab48074de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 msgr2=0x7fab4806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 0x7fab4806f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab54009d10 tx=0x7fab54009040 comp rx=0 tx=0).stop 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 msgr2=0x7fab6419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0092e0 tx=0x7fab4c00be20 comp rx=0 tx=0).stop 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 shutdown_connections 2024-04-26T21:02:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.346+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:6800/2318626480,v1:172.21.15.64:6801/2318626480] conn(0x7fab480729c0 0x7fab48074de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fab4806cce0 0x7fab4806f1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab64101ce0 0x7fab6419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 --2- 172.21.15.55:0/1576420533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab64102690 0x7fab6419ef80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 >> 172.21.15.55:0/1576420533 conn(0x7fab640fb5e0 msgr2=0x7fab6410a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 shutdown_connections 2024-04-26T21:02:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:02:56.347+0000 7fab6a400700 1 -- 172.21.15.55:0/1576420533 wait complete. 2024-04-26T21:02:58.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:02:58 smithi064 ceph-mon[33404]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:02:58 smithi055 ceph-mon[25475]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:02:59.268 INFO:teuthology.orchestra.run.smithi055.stdout:81604378656 2024-04-26T21:02:59.268 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T21:02:59.892 INFO:teuthology.orchestra.run.smithi055.stdout:171798691849 2024-04-26T21:02:59.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3570038919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 msgr2=0x7fc4c8107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3570038919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c8107820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009910 tx=0x7fc4bc009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3570038919 shutdown_connections 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3570038919 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3570038919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c8107820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.651+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3570038919 >> 172.21.15.55:0/3570038919 conn(0x7fc4c8076a10 msgr2=0x7fc4c8078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.652+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3570038919 shutdown_connections 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.652+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3570038919 wait complete. 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 Processor -- start 2024-04-26T21:03:00.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 -- start start 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c819dd50 con 0x7fc4c8107440 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.653+0000 7fc4cfc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81a19d0 con 0x7fc4c8107df0 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38880/0 (socket says 172.21.15.55:38880) 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 -- 172.21.15.55:0/3328853013 learned_addr learned my addr 172.21.15.55:0/3328853013 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4c7e00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 -- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 msgr2=0x7fc4c819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:00.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0095f0 con 0x7fc4c8107440 2024-04-26T21:03:00.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4c7e00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:03:00.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.654+0000 7fc4cd200700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc006010 tx=0x7fc4bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:00.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.655+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4bc01d070 con 0x7fc4c8107440 2024-04-26T21:03:00.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.655+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4bc00f460 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.655+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4bc017630 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.655+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c81a1c50 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.655+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c81a2140 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.656+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4c8114700 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.657+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc4bc00f5d0 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.659+0000 7fc4c5600700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 0x7fc4b006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.659+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc4bc08d340 con 0x7fc4c8107440 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.659+0000 7fc4c7e00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 0x7fc4b006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.659+0000 7fc4c5600700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 0x7fc4b0074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.659+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4b00754a0 con 0x7fc4b00729d0 2024-04-26T21:03:00.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.660+0000 7fc4c7e00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 0x7fc4b006f1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4005fd0 tx=0x7fc4b4005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.660+0000 7fc4cdc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 0x7fc4b0074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.661+0000 7fc4cdc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 0x7fc4b0074df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.661+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4bc057b90 con 0x7fc4c8107440 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.663+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== osd.4 v2:172.21.15.64:6808/1215616659 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc4b00754a0 con 0x7fc4b00729d0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.681+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 --> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4c8108920 con 0x7fc4b00729d0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.682+0000 7fc4c5600700 1 -- 172.21.15.55:0/3328853013 <== osd.4 v2:172.21.15.64:6808/1215616659 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc4c8108920 con 0x7fc4b00729d0 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.682+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 msgr2=0x7fc4b0074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.682+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 0x7fc4b0074df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 msgr2=0x7fc4b006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 0x7fc4b006f1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4005fd0 tx=0x7fc4b4005dc0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 msgr2=0x7fc4c819d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc006010 tx=0x7fc4bc00be20 comp rx=0 tx=0).stop 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 shutdown_connections 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc4b006ccf0 0x7fc4b006f1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c8107440 0x7fc4c819d130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:6808/1215616659,v1:172.21.15.64:6809/1215616659] conn(0x7fc4b00729d0 0x7fc4b0074df0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 --2- 172.21.15.55:0/3328853013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8107df0 0x7fc4c819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 >> 172.21.15.55:0/3328853013 conn(0x7fc4c8076a10 msgr2=0x7fc4c8076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 shutdown_connections 2024-04-26T21:03:00.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:00.683+0000 7fc4cfc00700 1 -- 172.21.15.55:0/3328853013 wait complete. 2024-04-26T21:03:00.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:00 smithi055 ceph-mon[25475]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:01.079 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:00 smithi064 ceph-mon[33404]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:01.363 INFO:teuthology.orchestra.run.smithi055.stdout:38654705711 2024-04-26T21:03:01.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T21:03:01.848 INFO:teuthology.orchestra.run.smithi055.stdout:150323855378 2024-04-26T21:03:01.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T21:03:02.376 INFO:teuthology.orchestra.run.smithi055.stdout:111669149720 2024-04-26T21:03:02.376 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T21:03:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:02.466 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:02.466 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:02.967 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:02 smithi055 ceph-mon[25475]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:03.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:02 smithi064 ceph-mon[33404]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:04.787 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:04 smithi055 ceph-mon[25475]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:05.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:04 smithi064 ceph-mon[33404]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:07.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:06 smithi055 ceph-mon[25475]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:07.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:06 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:06 smithi064 ceph-mon[33404]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:06 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 -- 172.21.15.55:0/918040668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c100e20 msgr2=0x7f364c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 --2- 172.21.15.55:0/918040668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c100e20 0x7f364c101200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3640009910 tx=0x7f3640009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 -- 172.21.15.55:0/918040668 shutdown_connections 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 --2- 172.21.15.55:0/918040668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c1017d0 0x7f364c105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 --2- 172.21.15.55:0/918040668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c100e20 0x7f364c101200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 -- 172.21.15.55:0/918040668 >> 172.21.15.55:0/918040668 conn(0x7f364c0fc6d0 msgr2=0x7f364c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:08.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 -- 172.21.15.55:0/918040668 shutdown_connections 2024-04-26T21:03:08.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.377+0000 7f3654400700 1 -- 172.21.15.55:0/918040668 wait complete. 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.378+0000 7f3654400700 1 Processor -- start 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.378+0000 7f3654400700 1 -- start start 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3654400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c100e20 0x7f364c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3654400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3654400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c19d3f0 con 0x7f364c1017d0 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3654400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c1969d0 con 0x7f364c100e20 2024-04-26T21:03:08.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37664/0 (socket says 172.21.15.55:37664) 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 -- 172.21.15.55:0/4148585432 learned_addr learned my addr 172.21.15.55:0/4148585432 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651a00700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c100e20 0x7f364c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 -- 172.21.15.55:0/4148585432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c100e20 msgr2=0x7f364c19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c100e20 0x7f364c19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.379+0000 7f3651000700 1 -- 172.21.15.55:0/4148585432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400095f0 con 0x7f364c1017d0 2024-04-26T21:03:08.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f3651000700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f363800e8f0 tx=0x7f363800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3638009790 con 0x7f364c1017d0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3638004cf0 con 0x7f364c1017d0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c196cb0 con 0x7f364c1017d0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3638005690 con 0x7f364c1017d0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.380+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c197200 con 0x7f364c1017d0 2024-04-26T21:03:08.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.381+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c1091c0 con 0x7f364c1017d0 2024-04-26T21:03:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.382+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3638004750 con 0x7f364c1017d0 2024-04-26T21:03:08.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.383+0000 7f364a000700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 0x7f363406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.384+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3638014070 con 0x7f364c1017d0 2024-04-26T21:03:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.384+0000 7f3651a00700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 0x7f363406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:08.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.384+0000 7f3651a00700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 0x7f363406f1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f364000b760 tx=0x7f3640009f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:08.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.389+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f363805a4b0 con 0x7f364c1017d0 2024-04-26T21:03:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.615+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f364c102300 con 0x7f364c1017d0 2024-04-26T21:03:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.616+0000 7f364a000700 1 -- 172.21.15.55:0/4148585432 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f363805a040 con 0x7f364c1017d0 2024-04-26T21:03:08.617 INFO:teuthology.orchestra.run.smithi055.stdout:38654705712 2024-04-26T21:03:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 msgr2=0x7f363406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 0x7f363406f1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f364000b760 tx=0x7f3640009f90 comp rx=0 tx=0).stop 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 msgr2=0x7f364c19cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f363800e8f0 tx=0x7f363800ecb0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 shutdown_connections 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f363406ccf0 0x7f363406f1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f364c100e20 0x7f364c19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 --2- 172.21.15.55:0/4148585432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f364c1017d0 0x7f364c19cdd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 >> 172.21.15.55:0/4148585432 conn(0x7f364c0fc6d0 msgr2=0x7f364c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.619+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 shutdown_connections 2024-04-26T21:03:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:08.620+0000 7f3654400700 1 -- 172.21.15.55:0/4148585432 wait complete. 2024-04-26T21:03:08.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:08 smithi055 ceph-mon[25475]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:08.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:08 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4148585432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T21:03:09.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:08 smithi064 ceph-mon[33404]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:09.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:08 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4148585432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T21:03:09.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705711 got 38654705712 for osd.0 2024-04-26T21:03:09.589 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:11.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:10 smithi055 ceph-mon[25475]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:11.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:10 smithi064 ceph-mon[33404]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:11.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 -- 172.21.15.55:0/743473345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 msgr2=0x7f5f4810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:11.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 --2- 172.21.15.55:0/743473345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f4810ac20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009910 tx=0x7f5f34009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 -- 172.21.15.55:0/743473345 shutdown_connections 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 --2- 172.21.15.55:0/743473345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f4810ac20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 --2- 172.21.15.55:0/743473345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 0x7f5f481021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.220+0000 7f5f4f600700 1 -- 172.21.15.55:0/743473345 >> 172.21.15.55:0/743473345 conn(0x7f5f480fb5e0 msgr2=0x7f5f480fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.221+0000 7f5f4f600700 1 -- 172.21.15.55:0/743473345 shutdown_connections 2024-04-26T21:03:11.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.221+0000 7f5f4f600700 1 -- 172.21.15.55:0/743473345 wait complete. 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 Processor -- start 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 -- start start 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 0x7f5f48198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48199850 con 0x7f5f48102730 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.222+0000 7f5f4f600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481999c0 con 0x7f5f48101e10 2024-04-26T21:03:11.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:11.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37696/0 (socket says 172.21.15.55:37696) 2024-04-26T21:03:11.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 -- 172.21.15.55:0/3894825786 learned_addr learned my addr 172.21.15.55:0/3894825786 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:11.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f4cc00700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 0x7f5f48198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 -- 172.21.15.55:0/3894825786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 msgr2=0x7f5f48198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 0x7f5f48198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.223+0000 7f5f47e00700 1 -- 172.21.15.55:0/3894825786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340095f0 con 0x7f5f48102730 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f47e00700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400bd70 tx=0x7f5f3400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f3401d070 con 0x7f5f48102730 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4819c640 con 0x7f5f48102730 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f3400f460 con 0x7f5f48102730 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f34017630 con 0x7f5f48102730 2024-04-26T21:03:11.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.224+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4819cb30 con 0x7f5f48102730 2024-04-26T21:03:11.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.225+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48069690 con 0x7f5f48102730 2024-04-26T21:03:11.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.226+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5f3400f5d0 con 0x7f5f48102730 2024-04-26T21:03:11.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.227+0000 7f5f45600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 0x7f5f3006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:11.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.227+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5f3408d3f0 con 0x7f5f48102730 2024-04-26T21:03:11.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.227+0000 7f5f4cc00700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 0x7f5f3006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:11.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.228+0000 7f5f4cc00700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 0x7f5f3006f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c005ea0 tx=0x7f5f3c005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.233+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5f34057a60 con 0x7f5f48102730 2024-04-26T21:03:11.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.471+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5f4810de50 con 0x7f5f48102730 2024-04-26T21:03:11.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.472+0000 7f5f45600700 1 -- 172.21.15.55:0/3894825786 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f34005740 con 0x7f5f48102730 2024-04-26T21:03:11.472 INFO:teuthology.orchestra.run.smithi055.stdout:150323855380 2024-04-26T21:03:11.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 msgr2=0x7f5f3006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:11.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 0x7f5f3006f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c005ea0 tx=0x7f5f3c005e30 comp rx=0 tx=0).stop 2024-04-26T21:03:11.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 msgr2=0x7f5f48199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:11.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400bd70 tx=0x7f5f3400be50 comp rx=0 tx=0).stop 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 shutdown_connections 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f5f3006cce0 0x7f5f3006f1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f48101e10 0x7f5f48198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 --2- 172.21.15.55:0/3894825786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f48102730 0x7f5f48199250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 >> 172.21.15.55:0/3894825786 conn(0x7f5f480fb5e0 msgr2=0x7f5f4810a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 shutdown_connections 2024-04-26T21:03:11.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:11.475+0000 7f5f4f600700 1 -- 172.21.15.55:0/3894825786 wait complete. 2024-04-26T21:03:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:11 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3894825786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T21:03:12.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:11 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3894825786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T21:03:12.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 -- 172.21.15.55:0/27840533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 msgr2=0x7fbc2c10cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 --2- 172.21.15.55:0/27840533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c10cf30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009910 tx=0x7fbc18009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 -- 172.21.15.55:0/27840533 shutdown_connections 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 --2- 172.21.15.55:0/27840533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c10cf30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 --2- 172.21.15.55:0/27840533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 -- 172.21.15.55:0/27840533 >> 172.21.15.55:0/27840533 conn(0x7fbc2c0fc6e0 msgr2=0x7fbc2c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 -- 172.21.15.55:0/27840533 shutdown_connections 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.417+0000 7fbc33600700 1 -- 172.21.15.55:0/27840533 wait complete. 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.418+0000 7fbc33600700 1 Processor -- start 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.418+0000 7fbc33600700 1 -- start start 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc33600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:12.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc33600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc33600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c1998c0 con 0x7fbc2c073b20 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc33600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c19c530 con 0x7fbc2c073200 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37746/0 (socket says 172.21.15.55:37746) 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 -- 172.21.15.55:0/2329326707 learned_addr learned my addr 172.21.15.55:0/2329326707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc30c00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 -- 172.21.15.55:0/2329326707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 msgr2=0x7fbc2c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.419+0000 7fbc2be00700 1 -- 172.21.15.55:0/2329326707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180095f0 con 0x7fbc2c073b20 2024-04-26T21:03:12.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc30c00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc2be00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc18006010 tx=0x7fbc1800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc1801d070 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc180056e0 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c19c7b0 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c19cca0 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.420+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc18017400 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.421+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c074940 con 0x7fbc2c073b20 2024-04-26T21:03:12.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.423+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc1800f6f0 con 0x7fbc2c073b20 2024-04-26T21:03:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.424+0000 7fbc29600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 0x7fbc1406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.424+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbc1808d3a0 con 0x7fbc2c073b20 2024-04-26T21:03:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.424+0000 7fbc30c00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 0x7fbc1406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:12.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.425+0000 7fbc30c00700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 0x7fbc1406f1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc20005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:12.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.429+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fbc18057a10 con 0x7fbc2c073b20 2024-04-26T21:03:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.663+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbc2c04ebb0 con 0x7fbc2c073b20 2024-04-26T21:03:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.664+0000 7fbc29600700 1 -- 172.21.15.55:0/2329326707 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc1805b030 con 0x7fbc2c073b20 2024-04-26T21:03:12.665 INFO:teuthology.orchestra.run.smithi055.stdout:171798691852 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 msgr2=0x7fbc1406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 0x7fbc1406f1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc20005ee0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 msgr2=0x7fbc2c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc18006010 tx=0x7fbc1800be20 comp rx=0 tx=0).stop 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 shutdown_connections 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fbc1406cce0 0x7fbc1406f1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc2c073200 0x7fbc2c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 --2- 172.21.15.55:0/2329326707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc2c073b20 0x7fbc2c199230 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 >> 172.21.15.55:0/2329326707 conn(0x7fbc2c0fc6e0 msgr2=0x7fbc2c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.667+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 shutdown_connections 2024-04-26T21:03:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.668+0000 7fbc33600700 1 -- 172.21.15.55:0/2329326707 wait complete. 2024-04-26T21:03:12.873 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:12 smithi055 ceph-mon[25475]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:12.873 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:12 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2830458916' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T21:03:12.873 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:12 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2329326707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T21:03:13.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855378 got 150323855380 for osd.4 2024-04-26T21:03:13.019 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:13.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 -- 172.21.15.55:0/2006658527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 msgr2=0x7f5898101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:13.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 --2- 172.21.15.55:0/2006658527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898101200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5888009910 tx=0x7f5888009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 -- 172.21.15.55:0/2006658527 shutdown_connections 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 --2- 172.21.15.55:0/2006658527 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 0x7f5898105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 --2- 172.21.15.55:0/2006658527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898101200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 -- 172.21.15.55:0/2006658527 >> 172.21.15.55:0/2006658527 conn(0x7f58980fc6d0 msgr2=0x7f58980feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.292+0000 7f589ee00700 1 -- 172.21.15.55:0/2006658527 shutdown_connections 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.293+0000 7f589ee00700 1 -- 172.21.15.55:0/2006658527 wait complete. 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 Processor -- start 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 -- start start 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 0x7f5898199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981998e0 con 0x7f5898100e20 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f589ee00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589819c550 con 0x7f58981017d0 2024-04-26T21:03:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.294+0000 7f5897e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37722/0 (socket says 172.21.15.55:37722) 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 -- 172.21.15.55:0/2830458916 learned_addr learned my addr 172.21.15.55:0/2830458916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897400700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 0x7f5898199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 -- 172.21.15.55:0/2830458916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 msgr2=0x7f5898199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 0x7f5898199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 -- 172.21.15.55:0/2830458916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880095f0 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.295+0000 7f5897e00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58880092e0 tx=0x7f588800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.296+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588801d070 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.296+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58880056e0 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.296+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589819c7d0 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.296+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588800fe80 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.296+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589819ccc0 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.297+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898102300 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.298+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f588800f6f0 con 0x7f5898100e20 2024-04-26T21:03:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.299+0000 7f5894c00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 0x7f587c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.299+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f588808d260 con 0x7f5898100e20 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.299+0000 7f5897400700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 0x7f587c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.300+0000 7f5897400700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 0x7f587c06f1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5884005950 tx=0x7f58840058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.304+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f58880579f0 con 0x7f5898100e20 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.538+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f589810ddf0 con 0x7f5898100e20 2024-04-26T21:03:13.041 INFO:teuthology.orchestra.run.smithi055.stdout:81604378659 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.539+0000 7f5894c00700 1 -- 172.21.15.55:0/2830458916 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f588805b010 con 0x7f5898100e20 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 msgr2=0x7f587c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 0x7f587c06f1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5884005950 tx=0x7f58840058e0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 msgr2=0x7f5898198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58880092e0 tx=0x7f588800be20 comp rx=0 tx=0).stop 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 shutdown_connections 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f587c06ccf0 0x7f587c06f1b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5898100e20 0x7f5898198d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 --2- 172.21.15.55:0/2830458916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58981017d0 0x7f5898199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.541+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 >> 172.21.15.55:0/2830458916 conn(0x7f58980fc6d0 msgr2=0x7f5898074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.542+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 shutdown_connections 2024-04-26T21:03:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:12.542+0000 7f589ee00700 1 -- 172.21.15.55:0/2830458916 wait complete. 2024-04-26T21:03:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:12 smithi064 ceph-mon[33404]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:12 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2830458916' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T21:03:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:12 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2329326707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T21:03:14.358 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378656 got 81604378659 for osd.2 2024-04-26T21:03:14.358 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 -- 172.21.15.55:0/3233544212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 msgr2=0x7f9220103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 --2- 172.21.15.55:0/3233544212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220103410 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9214009910 tx=0x7f9214009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 -- 172.21.15.55:0/3233544212 shutdown_connections 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 --2- 172.21.15.55:0/3233544212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 0x7f9220107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 --2- 172.21.15.55:0/3233544212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220103410 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 -- 172.21.15.55:0/3233544212 >> 172.21.15.55:0/3233544212 conn(0x7f92200fe8e0 msgr2=0x7f9220100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 -- 172.21.15.55:0/3233544212 shutdown_connections 2024-04-26T21:03:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.871+0000 7f9227e00700 1 -- 172.21.15.55:0/3233544212 wait complete. 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.872+0000 7f9227e00700 1 Processor -- start 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9227e00700 1 -- start start 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9227e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9227e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 0x7f9220199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9227e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220199aa0 con 0x7f9220103030 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9227e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922019e6b0 con 0x7f92201039e0 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9225400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9225400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37774/0 (socket says 172.21.15.55:37774) 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.873+0000 7f9225400700 1 -- 172.21.15.55:0/3187172392 learned_addr learned my addr 172.21.15.55:0/3187172392 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9224a00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 0x7f9220199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9225400700 1 -- 172.21.15.55:0/3187172392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 msgr2=0x7f9220199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9225400700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 0x7f9220199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9225400700 1 -- 172.21.15.55:0/3187172392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140095f0 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9225400700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9214006010 tx=0x7f921400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921401d070 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f921400f460 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.874+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922019e930 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.875+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9214017630 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.875+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922019ee20 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.876+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922010b3d0 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.877+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f921400f5d0 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.878+0000 7f921e000700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 0x7f920806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.878+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f921408d400 con 0x7f9220103030 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.879+0000 7f9224a00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 0x7f920806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.879+0000 7f9224a00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 0x7f920806f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f920c005fd0 tx=0x7f920c00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:13.884+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9214057bb0 con 0x7f9220103030 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stdout:60129542188 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.116+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f922004ebb0 con 0x7f9220103030 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.116+0000 7f921e000700 1 -- 172.21.15.55:0/3187172392 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f921405b1d0 con 0x7f9220103030 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 msgr2=0x7f920806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 0x7f920806f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f920c005fd0 tx=0x7f920c00a560 comp rx=0 tx=0).stop 2024-04-26T21:03:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 msgr2=0x7f9220198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9214006010 tx=0x7f921400be20 comp rx=0 tx=0).stop 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 shutdown_connections 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f920806ccf0 0x7f920806f1b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9220103030 0x7f9220198ed0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 --2- 172.21.15.55:0/3187172392 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92201039e0 0x7f9220199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.119+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 >> 172.21.15.55:0/3187172392 conn(0x7f92200fe8e0 msgr2=0x7f92200ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.120+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 shutdown_connections 2024-04-26T21:03:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:14.120+0000 7f9227e00700 1 -- 172.21.15.55:0/3187172392 wait complete. 2024-04-26T21:03:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:14 smithi055 ceph-mon[25475]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:14 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3187172392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T21:03:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:14 smithi064 ceph-mon[33404]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:14 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3187172392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T21:03:15.160 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542184 got 60129542188 for osd.1 2024-04-26T21:03:15.160 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:16.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691852 for osd.5 2024-04-26T21:03:16.036 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.633+0000 7fce34400700 1 -- 172.21.15.55:0/3825040010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 msgr2=0x7fce2c105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.633+0000 7fce34400700 1 --2- 172.21.15.55:0/3825040010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c105810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fce18009910 tx=0x7fce18009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 -- 172.21.15.55:0/3825040010 shutdown_connections 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 --2- 172.21.15.55:0/3825040010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c105810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 --2- 172.21.15.55:0/3825040010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 0x7fce2c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 -- 172.21.15.55:0/3825040010 >> 172.21.15.55:0/3825040010 conn(0x7fce2c0fc6e0 msgr2=0x7fce2c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 -- 172.21.15.55:0/3825040010 shutdown_connections 2024-04-26T21:03:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.634+0000 7fce34400700 1 -- 172.21.15.55:0/3825040010 wait complete. 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.635+0000 7fce34400700 1 Processor -- start 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce34400700 1 -- start start 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce34400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 0x7fce2c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce34400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce34400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c199b10 con 0x7fce2c1017c0 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce34400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c19d790 con 0x7fce2c100e10 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.636+0000 7fce31000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33410/0 (socket says 172.21.15.55:33410) 2024-04-26T21:03:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 -- 172.21.15.55:0/3931748975 learned_addr learned my addr 172.21.15.55:0/3931748975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31a00700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 0x7fce2c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:16.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 -- 172.21.15.55:0/3931748975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 msgr2=0x7fce2c198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 0x7fce2c198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 -- 172.21.15.55:0/3931748975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180095f0 con 0x7fce2c1017c0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.637+0000 7fce31000700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce18005b40 tx=0x7fce1800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.638+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1801d070 con 0x7fce2c1017c0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.638+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce1800f460 con 0x7fce2c1017c0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.638+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c19da10 con 0x7fce2c1017c0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.638+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18005720 con 0x7fce2c1017c0 2024-04-26T21:03:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.638+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c19df00 con 0x7fce2c1017c0 2024-04-26T21:03:16.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.640+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c1022f0 con 0x7fce2c1017c0 2024-04-26T21:03:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.641+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fce18003a60 con 0x7fce2c1017c0 2024-04-26T21:03:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.641+0000 7fce2a000700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 0x7fce1406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.642+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fce1808d2a0 con 0x7fce2c1017c0 2024-04-26T21:03:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.642+0000 7fce31a00700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 0x7fce1406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:16.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.643+0000 7fce31a00700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 0x7fce1406f1b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce20009a10 tx=0x7fce20009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:16.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.647+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fce18057990 con 0x7fce2c1017c0 2024-04-26T21:03:16.873 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:16 smithi055 ceph-mon[25475]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.871+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce2c10de30 con 0x7fce2c1017c0 2024-04-26T21:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.872+0000 7fce2a000700 1 -- 172.21.15.55:0/3931748975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce1805afb0 con 0x7fce2c1017c0 2024-04-26T21:03:16.874 INFO:teuthology.orchestra.run.smithi055.stdout:111669149724 2024-04-26T21:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 msgr2=0x7fce1406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 0x7fce1406f1b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce20009a10 tx=0x7fce20009190 comp rx=0 tx=0).stop 2024-04-26T21:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 msgr2=0x7fce2c199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce18005b40 tx=0x7fce1800bd70 comp rx=0 tx=0).stop 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 shutdown_connections 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fce1406ccf0 0x7fce1406f1b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce2c100e10 0x7fce2c198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 --2- 172.21.15.55:0/3931748975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce2c1017c0 0x7fce2c199430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.876+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 >> 172.21.15.55:0/3931748975 conn(0x7fce2c0fc6e0 msgr2=0x7fce2c074520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.877+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 shutdown_connections 2024-04-26T21:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:16.877+0000 7fce34400700 1 -- 172.21.15.55:0/3931748975 wait complete. 2024-04-26T21:03:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:16 smithi064 ceph-mon[33404]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:17.762 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149720 got 111669149724 for osd.3 2024-04-26T21:03:17.762 DEBUG:teuthology.parallel:result is None 2024-04-26T21:03:17.762 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T21:03:17.763 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T21:03:17.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:17 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3931748975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T21:03:18.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:17 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3931748975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T21:03:18.182 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:18 smithi055 ceph-mon[25475]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:19.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:18 smithi064 ceph-mon[33404]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 -- 172.21.15.55:0/2448800052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 msgr2=0x7ff9540736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 --2- 172.21.15.55:0/2448800052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff9540736f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b0a0 tx=0x7ff94400b3b0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 -- 172.21.15.55:0/2448800052 shutdown_connections 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 --2- 172.21.15.55:0/2448800052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 --2- 172.21.15.55:0/2448800052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff9540736f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 -- 172.21.15.55:0/2448800052 >> 172.21.15.55:0/2448800052 conn(0x7ff9540fc520 msgr2=0x7ff9540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 -- 172.21.15.55:0/2448800052 shutdown_connections 2024-04-26T21:03:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.408+0000 7ff953e00700 1 -- 172.21.15.55:0/2448800052 wait complete. 2024-04-26T21:03:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.409+0000 7ff953e00700 1 Processor -- start 2024-04-26T21:03:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.409+0000 7ff953e00700 1 -- start start 2024-04-26T21:03:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff953e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff953e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff953e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95419f450 con 0x7ff954073310 2024-04-26T21:03:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff953e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954198a30 con 0x7ff954073c30 2024-04-26T21:03:20.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff952a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff952a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33424/0 (socket says 172.21.15.55:33424) 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff952a00700 1 -- 172.21.15.55:0/2658223003 learned_addr learned my addr 172.21.15.55:0/2658223003 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff94a000700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.410+0000 7ff952a00700 1 -- 172.21.15.55:0/2658223003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 msgr2=0x7ff95419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff952a00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff952a00700 1 -- 172.21.15.55:0/2658223003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009d00 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff94a000700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff952a00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b070 tx=0x7ff944003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94400e040 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff944004040 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.411+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff954198cb0 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.412+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94401d6b0 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.412+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9541991a0 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.413+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9541076b0 con 0x7ff954073310 2024-04-26T21:03:20.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.414+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff9440046b0 con 0x7ff954073310 2024-04-26T21:03:20.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.415+0000 7ff958a00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 0x7ff93806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:20.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.415+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff94408d630 con 0x7ff954073310 2024-04-26T21:03:20.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.415+0000 7ff94a000700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 0x7ff93806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:20.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.416+0000 7ff94a000700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 0x7ff93806f1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005950 tx=0x7ff93c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:20.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.420+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff94405b730 con 0x7ff954073310 2024-04-26T21:03:20.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.640+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff95410fe50 con 0x7ff93806ccf0 2024-04-26T21:03:20.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.642+0000 7ff958a00700 1 -- 172.21.15.55:0/2658223003 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27119 (secure 0 0 0) 0x7ff95410fe50 con 0x7ff93806ccf0 2024-04-26T21:03:20.644 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:03:20.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 msgr2=0x7ff93806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 0x7ff93806f1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005950 tx=0x7ff93c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 msgr2=0x7ff95419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b070 tx=0x7ff944003ce0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 shutdown_connections 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff93806ccf0 0x7ff93806f1b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff954073310 0x7ff95419e8f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 --2- 172.21.15.55:0/2658223003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff954073c30 0x7ff95419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 >> 172.21.15.55:0/2658223003 conn(0x7ff9540fc520 msgr2=0x7ff954105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.645+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 shutdown_connections 2024-04-26T21:03:20.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:20.646+0000 7ff953e00700 1 -- 172.21.15.55:0/2658223003 wait complete. 2024-04-26T21:03:20.648 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-26T21:03:20.936 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:20 smithi055 ceph-mon[25475]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:20 smithi064 ceph-mon[33404]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:21.528 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T21:03:19.590072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182452,"kb_used_data":3920,"kb_used_omap":9,"kb_used_meta":178422,"kb_avail":562288460,"statfs":{"total":575970213888,"available":575783383040,"internally_reserved":0,"allocated":4014080,"data_stored":2633253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":182704806},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003604"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T21:02:17.384893+0000","last_change":"2024-04-26T21:01:41.174796+0000","last_active":"2024-04-26T21:02:17.384893+0000","last_peered":"2024-04-26T21:02:17.384893+0000","last_clean":"2024-04-26T21:02:17.384893+0000","last_became_active":"2024-04-26T21:01:41.174245+0000","last_became_peered":"2024-04-26T21:01:41.174245+0000","last_unstale":"2024-04-26T21:02:17.384893+0000","last_undegraded":"2024-04-26T21:02:17.384893+0000","last_fullsized":"2024-04-26T21:02:17.384893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:00:32.265427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:00:32.265427+0000","last_clean_scrub_stamp":"2024-04-26T21:00:32.265427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:33.704180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":372736,"data_stored":143803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31488,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713664,"statfs":{"total":95995035648,"available":95962791936,"internally_reserved":0,"allocated":372736,"data_stored":143803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.589},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.004}]},{"osd":1,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.131},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.2829999999999999}]},{"osd":2,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.341}]},{"osd":3,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.2},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.391}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149725,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93600000000000005,"15min":0.94399999999999995},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1859999999999999,"5min":1.601,"15min":1.601},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0309999999999999,"15min":1.0369999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.95299999999999996}]},{"osd":1,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.999,"15min":0.97899999999999998},"min":{"1min":0.78400000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.476,"5min":1.512,"15min":1.512},"last":0.87},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.004,"15min":1.006},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.034}]},{"osd":2,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.80200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.109,"15min":1.095},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5680000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.248}]},{"osd":4,"last update":"Fri Apr 26 21:02:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.137},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31480,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713672,"statfs":{"total":95995035648,"available":95962800128,"internally_reserved":0,"allocated":368640,"data_stored":143134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89100000000000001}]},{"osd":1,"last update":"Fri Apr 26 21:02:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91500000000000004,"15min":0.89100000000000001},"min":{"1min":0.70999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Apr 26 21:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":7.3029999999999999,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Apr 26 21:02:43 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.212}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 21:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.47299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1020000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.123},{"interface":"front","average":{"1min":0.875,"5min":0.80100000000000005,"15min":0.74199999999999999},"min":{"1min":0.60799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.196,"5min":2.698,"15min":2.698},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Apr 26 21:02:34 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.96399999999999997,"15min":0.94199999999999995},"min":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.996,"15min":0.98799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.623,"15min":1.623},"last":1.3029999999999999}]},{"osd":3,"last update":"Fri Apr 26 21:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.095,"15min":1.097},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2789999999999999,"5min":1.446,"15min":1.446},"last":1.363},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.196,"15min":1.196},"min":{"1min":0.86499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.409}]},{"osd":4,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.46},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.054}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.81399999999999995,"15min":0.77700000000000002},"min":{"1min":0.69899999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.244,"5min":1.256,"15min":1.256},"last":0.436},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.86199999999999999,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.26,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Apr 26 21:02:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.097,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.008,"15min":1},"min":{"1min":0.623,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Apr 26 21:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0649999999999999,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.369,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Apr 26 21:02:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:03:21.529 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T21:03:21.954 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:22.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:21 smithi055 ceph-mon[25475]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:03:22.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:21 smithi064 ceph-mon[33404]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:03:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:21 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:22 smithi064 ceph-mon[33404]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:23.134 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:22 smithi055 ceph-mon[25475]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:23.983 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:23 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:24.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:23 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 -- 172.21.15.55:0/3437572033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 msgr2=0x7ff5a0102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3437572033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a0102140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff594009910 tx=0x7ff594009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 -- 172.21.15.55:0/3437572033 shutdown_connections 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3437572033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 0x7ff5a010ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3437572033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a0102140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.192+0000 7ff5a8000700 1 -- 172.21.15.55:0/3437572033 >> 172.21.15.55:0/3437572033 conn(0x7ff5a0076740 msgr2=0x7ff5a00fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.193+0000 7ff5a8000700 1 -- 172.21.15.55:0/3437572033 shutdown_connections 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.193+0000 7ff5a8000700 1 -- 172.21.15.55:0/3437572033 wait complete. 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.194+0000 7ff5a8000700 1 Processor -- start 2024-04-26T21:03:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.194+0000 7ff5a8000700 1 -- start start 2024-04-26T21:03:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a8000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a8000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 0x7ff5a019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a8000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a019d3a0 con 0x7ff5a0101d60 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a8000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0196980 con 0x7ff5a0102680 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33440/0 (socket says 172.21.15.55:33440) 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a5600700 1 -- 172.21.15.55:0/3165208878 learned_addr learned my addr 172.21.15.55:0/3165208878 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.195+0000 7ff5a4c00700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 0x7ff5a019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff5a5600700 1 -- 172.21.15.55:0/3165208878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 msgr2=0x7ff5a019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff5a5600700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 0x7ff5a019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff5a5600700 1 -- 172.21.15.55:0/3165208878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940095f0 con 0x7ff5a0101d60 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff5a5600700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff5940092e0 tx=0x7ff59400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59401d070 con 0x7ff5a0101d60 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5940056e0 con 0x7ff5a0101d60 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.196+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0196c00 con 0x7ff5a0101d60 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.197+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59400fe10 con 0x7ff5a0101d60 2024-04-26T21:03:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.197+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01970f0 con 0x7ff5a0101d60 2024-04-26T21:03:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.198+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0105480 con 0x7ff5a0101d60 2024-04-26T21:03:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.199+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff59400f680 con 0x7ff5a0101d60 2024-04-26T21:03:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.200+0000 7ff59e000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 0x7ff58806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.200+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff59408d2d0 con 0x7ff5a0101d60 2024-04-26T21:03:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.200+0000 7ff5a4c00700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 0x7ff58806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:24.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.201+0000 7ff5a4c00700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 0x7ff58806f1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0197b40 tx=0x7ff58c00b360 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:24.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.205+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff59405b450 con 0x7ff5a0101d60 2024-04-26T21:03:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.435+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5a010dde0 con 0x7ff58806ccf0 2024-04-26T21:03:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.439+0000 7ff59e000700 1 -- 172.21.15.55:0/3165208878 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+31128 (secure 0 0 0) 0x7ff5a010dde0 con 0x7ff58806ccf0 2024-04-26T21:03:24.441 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:03:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 msgr2=0x7ff58806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 0x7ff58806f1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0197b40 tx=0x7ff58c00b360 comp rx=0 tx=0).stop 2024-04-26T21:03:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 msgr2=0x7ff5a019c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff5940092e0 tx=0x7ff59400bd70 comp rx=0 tx=0).stop 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 shutdown_connections 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff58806ccf0 0x7ff58806f1b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5a0101d60 0x7ff5a019c840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 --2- 172.21.15.55:0/3165208878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5a0102680 0x7ff5a019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 >> 172.21.15.55:0/3165208878 conn(0x7ff5a0076740 msgr2=0x7ff5a0103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 shutdown_connections 2024-04-26T21:03:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:24.442+0000 7ff5a8000700 1 -- 172.21.15.55:0/3165208878 wait complete. 2024-04-26T21:03:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-26T21:03:25.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:24 smithi064 ceph-mon[33404]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:25.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:24 smithi064 ceph-mon[33404]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:03:25.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:25.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:25.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:24 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:24 smithi055 ceph-mon[25475]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:24 smithi055 ceph-mon[25475]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T21:03:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:24 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:25.361 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-26T21:03:23.590987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":182452,"kb_used_data":3920,"kb_used_omap":9,"kb_used_meta":178422,"kb_avail":562288460,"statfs":{"total":575970213888,"available":575783383040,"internally_reserved":0,"allocated":4014080,"data_stored":2633253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":182704806},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T21:02:17.384893+0000","last_change":"2024-04-26T21:01:41.174796+0000","last_active":"2024-04-26T21:02:17.384893+0000","last_peered":"2024-04-26T21:02:17.384893+0000","last_clean":"2024-04-26T21:02:17.384893+0000","last_became_active":"2024-04-26T21:01:41.174245+0000","last_became_peered":"2024-04-26T21:01:41.174245+0000","last_unstale":"2024-04-26T21:02:17.384893+0000","last_undegraded":"2024-04-26T21:02:17.384893+0000","last_fullsized":"2024-04-26T21:02:17.384893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:00:32.265427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:00:32.265427+0000","last_clean_scrub_stamp":"2024-04-26T21:00:32.265427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:33.704180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":372736,"data_stored":143803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:03:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.155},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.107}]},{"osd":1,"last update":"Fri Apr 26 21:03:20 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.88100000000000001}]},{"osd":2,"last update":"Fri Apr 26 21:03:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.361},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.085}]},{"osd":3,"last update":"Fri Apr 26 21:03:20 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.2889999999999999}]},{"osd":4,"last update":"Fri Apr 26 21:03:20 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.454}]}]},{"osd":4,"up_from":35,"seq":150323855383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31488,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713664,"statfs":{"total":95995035648,"available":95962791936,"internally_reserved":0,"allocated":372736,"data_stored":143803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.145},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.262}]},{"osd":1,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.325}]},{"osd":2,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.409},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0840000000000001}]},{"osd":3,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1910000000000001}]},{"osd":5,"last update":"Fri Apr 26 21:03:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.464}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93600000000000005,"15min":0.94399999999999995},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1859999999999999,"5min":1.601,"15min":1.601},"last":1.151},{"interface":"front","average":{"1min":0.999,"5min":1.0309999999999999,"15min":1.0369999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.3,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.999,"15min":0.97899999999999998},"min":{"1min":0.78400000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.476,"5min":1.512,"15min":1.512},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.004,"15min":1.006},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0309999999999999}]},{"osd":2,"last update":"Fri Apr 26 21:03:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.048,"15min":1.04},"min":{"1min":0.80200000000000005,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.091},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.109,"15min":1.095},"min":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5680000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.429}]},{"osd":4,"last update":"Fri Apr 26 21:02:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.196},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.321}]},{"osd":5,"last update":"Fri Apr 26 21:03:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.248}]}]},{"osd":2,"up_from":19,"seq":81604378662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31480,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713672,"statfs":{"total":95995035648,"available":95962800128,"internally_reserved":0,"allocated":368640,"data_stored":143134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.94199999999999995}]},{"osd":1,"last update":"Fri Apr 26 21:02:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.91500000000000004,"15min":0.89100000000000001},"min":{"1min":0.70999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Apr 26 21:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.506},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":7.3029999999999999,"5min":7.3029999999999999,"15min":7.3029999999999999},"last":1.2130000000000001}]},{"osd":4,"last update":"Fri Apr 26 21:02:43 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.4059999999999999}]},{"osd":5,"last update":"Fri Apr 26 21:03:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.379},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.5549999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 21:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.47299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1020000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.80100000000000005,"15min":0.74199999999999999},"min":{"1min":0.60799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.196,"5min":2.698,"15min":2.698},"last":0.82699999999999996}]},{"osd":2,"last update":"Fri Apr 26 21:02:34 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.96399999999999997,"15min":0.94199999999999995},"min":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.996,"15min":0.98799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.623,"15min":1.623},"last":1.002}]},{"osd":3,"last update":"Fri Apr 26 21:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.095,"15min":1.097},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2789999999999999,"5min":1.446,"15min":1.446},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.196,"15min":1.196},"min":{"1min":0.86499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2629999999999999}]},{"osd":4,"last update":"Fri Apr 26 21:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Apr 26 21:03:18 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":1.379},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.431}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":966656,"data_stored":734171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 21:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.81399999999999995,"15min":0.77700000000000002},"min":{"1min":0.69899999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.244,"5min":1.256,"15min":1.256},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.86199999999999999,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.26,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.361}]},{"osd":2,"last update":"Fri Apr 26 21:02:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.097,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.073},{"interface":"front","average":{"1min":1.052,"5min":1.008,"15min":1},"min":{"1min":0.623,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.26}]},{"osd":3,"last update":"Fri Apr 26 21:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.653},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0649999999999999,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.369,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.2}]},{"osd":4,"last update":"Fri Apr 26 21:02:42 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.4339999999999999}]},{"osd":5,"last update":"Fri Apr 26 21:03:19 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.226}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:03:25.362 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T21:03:25.362 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T21:03:25.362 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T21:03:25.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T21:03:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:27.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:26 smithi064 ceph-mon[33404]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:27.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:26 smithi055 ceph-mon[25475]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 -- 172.21.15.55:0/1935578311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075d30 msgr2=0x7f650c111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 --2- 172.21.15.55:0/1935578311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075d30 0x7f650c111530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009910 tx=0x7f64f8009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 -- 172.21.15.55:0/1935578311 shutdown_connections 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 --2- 172.21.15.55:0/1935578311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075d30 0x7f650c111530 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 --2- 172.21.15.55:0/1935578311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075410 0x7f650c0757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 -- 172.21.15.55:0/1935578311 >> 172.21.15.55:0/1935578311 conn(0x7f650c0fe8c0 msgr2=0x7f650c100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 -- 172.21.15.55:0/1935578311 shutdown_connections 2024-04-26T21:03:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.095+0000 7f6514200700 1 -- 172.21.15.55:0/1935578311 wait complete. 2024-04-26T21:03:28.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.096+0000 7f6514200700 1 Processor -- start 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6514200700 1 -- start start 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6514200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6514200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 0x7f650c19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6514200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c19dcc0 con 0x7f650c075410 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6514200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c1a1990 con 0x7f650c075d30 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6511800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6511800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59122/0 (socket says 172.21.15.55:59122) 2024-04-26T21:03:28.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.097+0000 7f6511800700 1 -- 172.21.15.55:0/1730147225 learned_addr learned my addr 172.21.15.55:0/1730147225 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6510e00700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 0x7f650c19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6511800700 1 -- 172.21.15.55:0/1730147225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 msgr2=0x7f650c19d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6511800700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 0x7f650c19d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6511800700 1 -- 172.21.15.55:0/1730147225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80095f0 con 0x7f650c075410 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6510e00700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 0x7f650c19d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:03:28.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f6511800700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f650000d8d0 tx=0x7f650000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6500009940 con 0x7f650c075410 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6500010460 con 0x7f650c075410 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.098+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f650000f5f0 con 0x7f650c075410 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.099+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c1a1c70 con 0x7f650c075410 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.099+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c1a21c0 con 0x7f650c075410 2024-04-26T21:03:28.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.100+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c10eca0 con 0x7f650c075410 2024-04-26T21:03:28.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.101+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f65000105d0 con 0x7f650c075410 2024-04-26T21:03:28.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.102+0000 7f650a000700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 0x7f64f406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:28.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.102+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f650008bef0 con 0x7f650c075410 2024-04-26T21:03:28.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.102+0000 7f6510e00700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 0x7f64f406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:28.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.103+0000 7f6510e00700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 0x7f64f406f1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64f8006010 tx=0x7f64f800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:28.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.107+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f65000565e0 con 0x7f650c075410 2024-04-26T21:03:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.382+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f650c076b50 con 0x7f650c075410 2024-04-26T21:03:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.383+0000 7f650a000700 1 -- 172.21.15.55:0/1730147225 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6500016040 con 0x7f650c075410 2024-04-26T21:03:28.384 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:03:28.384 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 msgr2=0x7f64f406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 0x7f64f406f1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64f8006010 tx=0x7f64f800b540 comp rx=0 tx=0).stop 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 msgr2=0x7f650c19d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f650000d8d0 tx=0x7f650000dc90 comp rx=0 tx=0).stop 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 shutdown_connections 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f64f406cce0 0x7f64f406f1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c075410 0x7f650c19d0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 --2- 172.21.15.55:0/1730147225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c075d30 0x7f650c19d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 >> 172.21.15.55:0/1730147225 conn(0x7f650c0fe8c0 msgr2=0x7f650c078010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 shutdown_connections 2024-04-26T21:03:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:28.386+0000 7f6514200700 1 -- 172.21.15.55:0/1730147225 wait complete. 2024-04-26T21:03:29.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:28 smithi064 ceph-mon[33404]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:29.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:28 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1730147225' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T21:03:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:28 smithi055 ceph-mon[25475]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:28 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1730147225' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T21:03:29.389 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T21:03:29.389 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T21:03:29.389 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:03:29.399 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-04-26T21:03:29.400 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:03:29.438 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:03:29.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-26T21:03:29.861 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:31.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:30 smithi055 ceph-mon[25475]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:31.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:30 smithi064 ceph-mon[33404]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 -- 172.21.15.55:0/77650912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 msgr2=0x7f09081038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 --2- 172.21.15.55:0/77650912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f09081038f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 -- 172.21.15.55:0/77650912 shutdown_connections 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 --2- 172.21.15.55:0/77650912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 0x7f0908106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 --2- 172.21.15.55:0/77650912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f09081038f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.429+0000 7f0907e00700 1 -- 172.21.15.55:0/77650912 >> 172.21.15.55:0/77650912 conn(0x7f09080faef0 msgr2=0x7f09080fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.430+0000 7f0907e00700 1 -- 172.21.15.55:0/77650912 shutdown_connections 2024-04-26T21:03:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.430+0000 7f0907e00700 1 -- 172.21.15.55:0/77650912 wait complete. 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 Processor -- start 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 -- start start 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 0x7f0908198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908199160 con 0x7f0908101500 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.431+0000 7f0907e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09081992a0 con 0x7f0908103e30 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59130/0 (socket says 172.21.15.55:59130) 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 -- 172.21.15.55:0/1818631414 learned_addr learned my addr 172.21.15.55:0/1818631414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906000700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 0x7f0908198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 -- 172.21.15.55:0/1818631414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 msgr2=0x7f0908198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 0x7f0908198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 -- 172.21.15.55:0/1818631414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80095f0 con 0x7f0908101500 2024-04-26T21:03:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.432+0000 7f0906a00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08f8005b40 tx=0x7f08f800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.433+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f801d070 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.433+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08f80050d0 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.433+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f80226a0 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.433+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090819dca0 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.433+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090819e190 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.434+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080fcae0 con 0x7f0908101500 2024-04-26T21:03:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.435+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f08f8003680 con 0x7f0908101500 2024-04-26T21:03:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.436+0000 7f08ff400700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 0x7f08ec06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.436+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f08f808d480 con 0x7f0908101500 2024-04-26T21:03:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.437+0000 7f0906000700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 0x7f08ec06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.437+0000 7f0906000700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 0x7f08ec06f1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009bf0 tx=0x7f08f4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.441+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f08f805b600 con 0x7f0908101500 2024-04-26T21:03:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.664+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f090804f400 con 0x7f0908101500 2024-04-26T21:03:32.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.675+0000 7f08ff400700 1 -- 172.21.15.55:0/1818631414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v24)=0 v24) v1 ==== 143+0+0 (secure 0 0 0) 0x7f090804f400 con 0x7f0908101500 2024-04-26T21:03:32.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.678+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 msgr2=0x7f08ec06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:32.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.678+0000 7f0907e00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 0x7f08ec06f1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009bf0 tx=0x7f08f4009260 comp rx=0 tx=0).stop 2024-04-26T21:03:32.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.678+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 msgr2=0x7f0908198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:32.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.678+0000 7f0907e00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08f8005b40 tx=0x7f08f800f740 comp rx=0 tx=0).stop 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 shutdown_connections 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f08ec06ccf0 0x7f08ec06f1b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0908101500 0x7f0908198600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 --2- 172.21.15.55:0/1818631414 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0908103e30 0x7f0908198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 >> 172.21.15.55:0/1818631414 conn(0x7f09080faef0 msgr2=0x7f0908100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 shutdown_connections 2024-04-26T21:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:32.679+0000 7f0907e00700 1 -- 172.21.15.55:0/1818631414 wait complete. 2024-04-26T21:03:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1818631414' entity='client.admin' 2024-04-26T21:03:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:33.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:33.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:32 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:33.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:33.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1818631414' entity='client.admin' 2024-04-26T21:03:33.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:33.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:33.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:33.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:32 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:33.451 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:03:33.461 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-26T21:03:33.461 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:03:33.529 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:03:33.529 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T21:03:33.962 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:35.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:34 smithi055 ceph-mon[25475]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:34 smithi064 ceph-mon[33404]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 -- 172.21.15.55:0/2720802057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 msgr2=0x7fa7140fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 --2- 172.21.15.55:0/2720802057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa7140fff30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa704009910 tx=0x7fa704009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 -- 172.21.15.55:0/2720802057 shutdown_connections 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 --2- 172.21.15.55:0/2720802057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 0x7fa714101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 --2- 172.21.15.55:0/2720802057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa7140fff30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 -- 172.21.15.55:0/2720802057 >> 172.21.15.55:0/2720802057 conn(0x7fa7140fb0b0 msgr2=0x7fa7140fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.318+0000 7fa71b200700 1 -- 172.21.15.55:0/2720802057 shutdown_connections 2024-04-26T21:03:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.319+0000 7fa71b200700 1 -- 172.21.15.55:0/2720802057 wait complete. 2024-04-26T21:03:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 Processor -- start 2024-04-26T21:03:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 -- start start 2024-04-26T21:03:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 0x7fa714198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714199310 con 0x7fa7140ffb10 2024-04-26T21:03:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.320+0000 7fa71b200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714199450 con 0x7fa714100d10 2024-04-26T21:03:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52478/0 (socket says 172.21.15.55:52478) 2024-04-26T21:03:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 -- 172.21.15.55:0/1281479983 learned_addr learned my addr 172.21.15.55:0/1281479983 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713400700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 0x7fa714198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 -- 172.21.15.55:0/1281479983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 msgr2=0x7fa714198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 0x7fa714198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.321+0000 7fa713e00700 1 -- 172.21.15.55:0/1281479983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040095f0 con 0x7fa7140ffb10 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa713e00700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa70400bd70 tx=0x7fa70400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70401d070 con 0x7fa7140ffb10 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa70400f460 con 0x7fa7140ffb10 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71419de60 con 0x7fa7140ffb10 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa704021620 con 0x7fa7140ffb10 2024-04-26T21:03:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.322+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71419e300 con 0x7fa7140ffb10 2024-04-26T21:03:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.324+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa714105170 con 0x7fa7140ffb10 2024-04-26T21:03:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.325+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa70400fa70 con 0x7fa7140ffb10 2024-04-26T21:03:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.326+0000 7fa710c00700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 0x7fa6f806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.326+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa70408d230 con 0x7fa7140ffb10 2024-04-26T21:03:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.326+0000 7fa713400700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 0x7fa6f806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:36.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.327+0000 7fa713400700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 0x7fa6f806f1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa700005ea0 tx=0x7fa700005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.331+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa70405b3d0 con 0x7fa7140ffb10 2024-04-26T21:03:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.580+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa71402ceb0 con 0x7fa6f806ccf0 2024-04-26T21:03:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.582+0000 7fa710c00700 1 -- 172.21.15.55:0/1281479983 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa71402ceb0 con 0x7fa6f806ccf0 2024-04-26T21:03:36.583 INFO:teuthology.orchestra.run.smithi055.stdout:Backend: cephadm 2024-04-26T21:03:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:Available: Yes 2024-04-26T21:03:36.584 INFO:teuthology.orchestra.run.smithi055.stdout:Paused: No 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 msgr2=0x7fa6f806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 0x7fa6f806f1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa700005ea0 tx=0x7fa700005e30 comp rx=0 tx=0).stop 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 msgr2=0x7fa714198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa70400bd70 tx=0x7fa70400be50 comp rx=0 tx=0).stop 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 shutdown_connections 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fa6f806ccf0 0x7fa6f806f1b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7140ffb10 0x7fa714198840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 --2- 172.21.15.55:0/1281479983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa714100d10 0x7fa714198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 >> 172.21.15.55:0/1281479983 conn(0x7fa7140fb0b0 msgr2=0x7fa7141022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.585+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 shutdown_connections 2024-04-26T21:03:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:36.586+0000 7fa71b200700 1 -- 172.21.15.55:0/1281479983 wait complete. 2024-04-26T21:03:37.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:36 smithi064 ceph-mon[33404]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:37.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:36 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:37.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:36 smithi055 ceph-mon[25475]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:36 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:37.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T21:03:37.821 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:37.974 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:37 smithi055 ceph-mon[25475]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:38.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:37 smithi064 ceph-mon[33404]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:39.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:38 smithi064 ceph-mon[33404]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:38 smithi055 ceph-mon[25475]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 -- 172.21.15.55:0/1606467388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab14103ef0 msgr2=0x7fab141062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 --2- 172.21.15.55:0/1606467388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab14103ef0 0x7fab141062e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fab00009910 tx=0x7fab00009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 -- 172.21.15.55:0/1606467388 shutdown_connections 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 --2- 172.21.15.55:0/1606467388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab14103ef0 0x7fab141062e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 --2- 172.21.15.55:0/1606467388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab141015c0 0x7fab141039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 -- 172.21.15.55:0/1606467388 >> 172.21.15.55:0/1606467388 conn(0x7fab140faf10 msgr2=0x7fab140fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 -- 172.21.15.55:0/1606467388 shutdown_connections 2024-04-26T21:03:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.188+0000 7fab19600700 1 -- 172.21.15.55:0/1606467388 wait complete. 2024-04-26T21:03:40.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.189+0000 7fab19600700 1 Processor -- start 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.189+0000 7fab19600700 1 -- start start 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab19600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab19600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 0x7fab14198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab19600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141991b0 con 0x7fab141015c0 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab19600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141992f0 con 0x7fab14103ef0 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52504/0 (socket says 172.21.15.55:52504) 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 -- 172.21.15.55:0/4281856722 learned_addr learned my addr 172.21.15.55:0/4281856722 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13400700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 0x7fab14198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 -- 172.21.15.55:0/4281856722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 msgr2=0x7fab14198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:40.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 0x7fab14198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13e00700 1 -- 172.21.15.55:0/4281856722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000095f0 con 0x7fab141015c0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.190+0000 7fab13400700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 0x7fab14198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab13e00700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab0400e920 tx=0x7fab0400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab04009790 con 0x7fab141015c0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab0400cba0 con 0x7fab141015c0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab04018650 con 0x7fab141015c0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1419dd50 con 0x7fab141015c0 2024-04-26T21:03:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.191+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1419e2c0 con 0x7fab141015c0 2024-04-26T21:03:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.192+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab140fcae0 con 0x7fab141015c0 2024-04-26T21:03:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.194+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fab0400cd10 con 0x7fab141015c0 2024-04-26T21:03:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.195+0000 7fab10c00700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 0x7faaf806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.195+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fab04014070 con 0x7fab141015c0 2024-04-26T21:03:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.195+0000 7fab13400700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 0x7faaf806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.196+0000 7fab13400700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 0x7faaf806f1b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab00006010 tx=0x7fab00009f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.199+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fab04052c50 con 0x7fab141015c0 2024-04-26T21:03:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.435+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab1402ceb0 con 0x7faaf806ccf0 2024-04-26T21:03:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.446+0000 7fab10c00700 1 -- 172.21.15.55:0/4281856722 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3100 (secure 0 0 0) 0x7fab1402ceb0 con 0x7faaf806ccf0 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (5m) 2m ago 7m 13.7M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (7m) 2m ago 7m 7117k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (6m) 83s ago 6m 7017k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (7m) 2m ago 7m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (5m) 83s ago 5m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (4m) 2m ago 6m 74.8M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:9283,8765,8443 running (9m) 2m ago 9m 491M - 18.2.2-1258-g7d2137f0 79c5878083fb 89ad350ca25b 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (5m) 83s ago 5m 451M - 18.2.2-1258-g7d2137f0 79c5878083fb 1bdb258baa6c 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (9m) 2m ago 9m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:03:40.448 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (5m) 83s ago 5m 32.1M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (7m) 2m ago 7m 7596k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (5m) 83s ago 5m 7713k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (4m) 2m ago 4m 46.8M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (3m) 2m ago 3m 47.4M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (3m) 2m ago 3m 45.5M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (2m) 83s ago 2m 41.0M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (2m) 83s ago 2m 45.8M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (89s) 83s ago 89s 11.4M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:03:40.449 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (4m) 2m ago 6m 40.3M - 2.43.0 a07b618ecd1d cf3fa4166949 2024-04-26T21:03:40.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.448+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 msgr2=0x7faaf806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:40.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.448+0000 7fab19600700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 0x7faaf806f1b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab00006010 tx=0x7fab00009f90 comp rx=0 tx=0).stop 2024-04-26T21:03:40.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.448+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 msgr2=0x7fab14198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:40.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.448+0000 7fab19600700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab0400e920 tx=0x7fab0400ece0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 shutdown_connections 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7faaf806ccf0 0x7faaf806f1b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab141015c0 0x7fab14198650 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 --2- 172.21.15.55:0/4281856722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fab14103ef0 0x7fab14198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 >> 172.21.15.55:0/4281856722 conn(0x7fab140faf10 msgr2=0x7fab14100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 shutdown_connections 2024-04-26T21:03:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:40.449+0000 7fab19600700 1 -- 172.21.15.55:0/4281856722 wait complete. 2024-04-26T21:03:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:40 smithi064 ceph-mon[33404]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:40 smithi064 ceph-mon[33404]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:41.196 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:40 smithi055 ceph-mon[25475]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:41.196 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:40 smithi055 ceph-mon[25475]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:41.267 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T21:03:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:42 smithi055 ceph-mon[25475]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:43.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:42 smithi064 ceph-mon[33404]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:44.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.138+0000 7f7f60000700 1 -- 172.21.15.55:0/1545089435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 msgr2=0x7f7f581088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:44.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.138+0000 7f7f60000700 1 --2- 172.21.15.55:0/1545089435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f581088c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009910 tx=0x7f7f44009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 -- 172.21.15.55:0/1545089435 shutdown_connections 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 --2- 172.21.15.55:0/1545089435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f581088c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 --2- 172.21.15.55:0/1545089435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 0x7f7f58107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 -- 172.21.15.55:0/1545089435 >> 172.21.15.55:0/1545089435 conn(0x7f7f58076400 msgr2=0x7f7f58078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 -- 172.21.15.55:0/1545089435 shutdown_connections 2024-04-26T21:03:44.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.139+0000 7f7f60000700 1 -- 172.21.15.55:0/1545089435 wait complete. 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 Processor -- start 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 -- start start 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 0x7f7f5819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819d710 con 0x7f7f58108460 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.140+0000 7f7f60000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819d850 con 0x7f7f58107260 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:44.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52526/0 (socket says 172.21.15.55:52526) 2024-04-26T21:03:44.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 -- 172.21.15.55:0/3859594255 learned_addr learned my addr 172.21.15.55:0/3859594255 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:44.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5d600700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 0x7f7f5819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:44.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 -- 172.21.15.55:0/3859594255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 msgr2=0x7f7f5819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 0x7f7f5819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 -- 172.21.15.55:0/3859594255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440095f0 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.141+0000 7f7f5cc00700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f44006010 tx=0x7f7f4400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.142+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4401d070 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.142+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f4400f460 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.142+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f44021640 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.142+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f581a2210 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.142+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581a2700 con 0x7f7f58108460 2024-04-26T21:03:44.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.143+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f58196de0 con 0x7f7f58108460 2024-04-26T21:03:44.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.144+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7f4400fab0 con 0x7f7f58108460 2024-04-26T21:03:44.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.145+0000 7f7f56000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 0x7f7f4006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:44.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.145+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7f4408d2a0 con 0x7f7f58108460 2024-04-26T21:03:44.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.146+0000 7f7f5d600700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 0x7f7f4006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:44.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.146+0000 7f7f5d600700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 0x7f7f4006f1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c005fd0 tx=0x7f7f4c005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.151+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f7f4405b420 con 0x7f7f58108460 2024-04-26T21:03:44.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.384+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f5802cde0 con 0x7f7f4006cce0 2024-04-26T21:03:44.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.390+0000 7f7f56000700 1 -- 172.21.15.55:0/3859594255 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1290 (secure 0 0 0) 0x7f7f5802cde0 con 0x7f7f4006cce0 2024-04-26T21:03:44.392 INFO:teuthology.orchestra.run.smithi055.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T21:03:44.392 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager ?:9093,9094 1/1 2m ago 8m count:1 2024-04-26T21:03:44.392 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter 2/2 2m ago 8m * 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:crash 2/2 2m ago 8m * 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:grafana ?:3000 1/1 2m ago 8m count:1 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:mgr 2/2 2m ago 8m count:2 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:mon 2/2 2m ago 7m smithi055:172.21.15.55=smithi055;smithi064:172.21.15.64=smithi064;count:2 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter ?:9100 2/2 2m ago 8m * 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:osd 6 2m ago - 2024-04-26T21:03:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus ?:9095 1/1 2m ago 8m count:1 2024-04-26T21:03:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 msgr2=0x7f7f4006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 0x7f7f4006f1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c005fd0 tx=0x7f7f4c005e50 comp rx=0 tx=0).stop 2024-04-26T21:03:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 msgr2=0x7f7f5819d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7f44006010 tx=0x7f7f4400be20 comp rx=0 tx=0).stop 2024-04-26T21:03:44.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 shutdown_connections 2024-04-26T21:03:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f7f4006cce0 0x7f7f4006f1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f58107260 0x7f7f5819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 --2- 172.21.15.55:0/3859594255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f58108460 0x7f7f5819d180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:44.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.394+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 >> 172.21.15.55:0/3859594255 conn(0x7f7f58076400 msgr2=0x7f7f5810ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.395+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 shutdown_connections 2024-04-26T21:03:44.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:44.395+0000 7f7f60000700 1 -- 172.21.15.55:0/3859594255 wait complete. 2024-04-26T21:03:45.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:44 smithi064 ceph-mon[33404]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:45.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:44 smithi064 ceph-mon[33404]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:45.218 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:44 smithi055 ceph-mon[25475]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:45.218 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:44 smithi055 ceph-mon[25475]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:45.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T21:03:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:47.092 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:46 smithi055 ceph-mon[25475]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:47.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:46 smithi064 ceph-mon[33404]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 -- 172.21.15.55:0/126547233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6780100d90 msgr2=0x7f67801011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 --2- 172.21.15.55:0/126547233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6780100d90 0x7f67801011f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f676c009910 tx=0x7f676c009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 -- 172.21.15.55:0/126547233 shutdown_connections 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 --2- 172.21.15.55:0/126547233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6780100d90 0x7f67801011f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 --2- 172.21.15.55:0/126547233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67800ffb90 0x7f67800fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 -- 172.21.15.55:0/126547233 >> 172.21.15.55:0/126547233 conn(0x7f67800fb110 msgr2=0x7f67800fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 -- 172.21.15.55:0/126547233 shutdown_connections 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.980+0000 7f6788000700 1 -- 172.21.15.55:0/126547233 wait complete. 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.982+0000 7f6788000700 1 Processor -- start 2024-04-26T21:03:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.982+0000 7f6788000700 1 -- start start 2024-04-26T21:03:47.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6788000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6788000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 0x7f6780196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6788000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780197200 con 0x7f67800ffb90 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6788000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780197340 con 0x7f6780100d90 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36756/0 (socket says 172.21.15.55:36756) 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 -- 172.21.15.55:0/2641883802 learned_addr learned my addr 172.21.15.55:0/2641883802 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6784c00700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 0x7f6780196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 -- 172.21.15.55:0/2641883802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 msgr2=0x7f6780196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 0x7f6780196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6785600700 1 -- 172.21.15.55:0/2641883802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0095f0 con 0x7f67800ffb90 2024-04-26T21:03:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.983+0000 7f6784c00700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 0x7f6780196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:03:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.984+0000 7f6785600700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f677400c8f0 tx=0x7f677400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.984+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6774007a70 con 0x7f67800ffb90 2024-04-26T21:03:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.984+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6774007bd0 con 0x7f67800ffb90 2024-04-26T21:03:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.984+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678019bda0 con 0x7f67800ffb90 2024-04-26T21:03:47.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.984+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6774018630 con 0x7f67800ffb90 2024-04-26T21:03:47.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.985+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678019c260 con 0x7f67800ffb90 2024-04-26T21:03:47.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.986+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678004ebb0 con 0x7f67800ffb90 2024-04-26T21:03:47.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.987+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f677400f450 con 0x7f67800ffb90 2024-04-26T21:03:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.988+0000 7f677e000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 0x7f676806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.988+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f677408bfe0 con 0x7f67800ffb90 2024-04-26T21:03:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.988+0000 7f6784c00700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 0x7f676806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:47.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.989+0000 7f6784c00700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 0x7f676806f1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b5c0 tx=0x7f676c005180 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:47.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:47.993+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f677405a230 con 0x7f67800ffb90 2024-04-26T21:03:48.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.228+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6780068d00 con 0x7f676806ccf0 2024-04-26T21:03:48.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.232+0000 7f677e000700 1 -- 172.21.15.55:0/2641883802 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f6780068d00 con 0x7f676806ccf0 2024-04-26T21:03:48.234 INFO:teuthology.orchestra.run.smithi055.stdout:HOST ADDR LABELS STATUS 2024-04-26T21:03:48.234 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055 172.21.15.55 2024-04-26T21:03:48.234 INFO:teuthology.orchestra.run.smithi055.stdout:smithi064 172.21.15.64 2024-04-26T21:03:48.234 INFO:teuthology.orchestra.run.smithi055.stdout:2 hosts in cluster 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 msgr2=0x7f676806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 0x7f676806f1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b5c0 tx=0x7f676c005180 comp rx=0 tx=0).stop 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 msgr2=0x7f67801966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f677400c8f0 tx=0x7f677400ccb0 comp rx=0 tx=0).stop 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 shutdown_connections 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f676806ccf0 0x7f676806f1b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67800ffb90 0x7f67801966a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 --2- 172.21.15.55:0/2641883802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6780100d90 0x7f6780196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:48.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.235+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 >> 172.21.15.55:0/2641883802 conn(0x7f67800fb110 msgr2=0x7f67800685f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:48.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.236+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 shutdown_connections 2024-04-26T21:03:48.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:48.236+0000 7f6788000700 1 -- 172.21.15.55:0/2641883802 wait complete. 2024-04-26T21:03:49.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T21:03:49.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:48 smithi064 ceph-mon[33404]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:49.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:48 smithi064 ceph-mon[33404]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:49.223 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:48 smithi055 ceph-mon[25475]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:49.223 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:48 smithi055 ceph-mon[25475]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:49.559 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:51.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:50 smithi064 ceph-mon[33404]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:51.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:50 smithi055 ceph-mon[25475]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 -- 172.21.15.55:0/1292667365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 msgr2=0x7f74e8075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 --2- 172.21.15.55:0/1292667365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e8075cb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009910 tx=0x7f74d8009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 -- 172.21.15.55:0/1292667365 shutdown_connections 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 --2- 172.21.15.55:0/1292667365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 0x7f74e8076f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 --2- 172.21.15.55:0/1292667365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e8075cb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 -- 172.21.15.55:0/1292667365 >> 172.21.15.55:0/1292667365 conn(0x7f74e80fe3e0 msgr2=0x7f74e8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 -- 172.21.15.55:0/1292667365 shutdown_connections 2024-04-26T21:03:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.853+0000 7f74ed800700 1 -- 172.21.15.55:0/1292667365 wait complete. 2024-04-26T21:03:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.854+0000 7f74ed800700 1 Processor -- start 2024-04-26T21:03:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74ed800700 1 -- start start 2024-04-26T21:03:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74ed800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74ed800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 0x7f74e819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74ed800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e819d7a0 con 0x7f74e8075890 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74ed800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e819d8e0 con 0x7f74e8076ae0 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74e6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74e6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36774/0 (socket says 172.21.15.55:36774) 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.855+0000 7f74e6a00700 1 -- 172.21.15.55:0/2193400551 learned_addr learned my addr 172.21.15.55:0/2193400551 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74e6000700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 0x7f74e819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74e6a00700 1 -- 172.21.15.55:0/2193400551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 msgr2=0x7f74e819d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74e6a00700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 0x7f74e819d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74e6a00700 1 -- 172.21.15.55:0/2193400551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80095f0 con 0x7f74e8075890 2024-04-26T21:03:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74e6a00700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74d800bd70 tx=0x7f74d800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.856+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d801d070 con 0x7f74e8075890 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.857+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74d8005dc0 con 0x7f74e8075890 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.857+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e81a2290 con 0x7f74e8075890 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.857+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d8021410 con 0x7f74e8075890 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.857+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e81a2800 con 0x7f74e8075890 2024-04-26T21:03:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.858+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e8196db0 con 0x7f74e8075890 2024-04-26T21:03:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.859+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f74d800f820 con 0x7f74e8075890 2024-04-26T21:03:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.860+0000 7f74df400700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 0x7f74cc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.860+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f74d808d1b0 con 0x7f74e8075890 2024-04-26T21:03:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.860+0000 7f74e6000700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 0x7f74cc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.861+0000 7f74e6000700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 0x7f74cc06f1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74d4005950 tx=0x7f74d40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:51.865+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f74d805b330 con 0x7f74e8075890 2024-04-26T21:03:52.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.107+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f74e802cde0 con 0x7f74cc06ccf0 2024-04-26T21:03:52.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.110+0000 7f74df400700 1 -- 172.21.15.55:0/2193400551 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f74e802cde0 con 0x7f74cc06ccf0 2024-04-26T21:03:52.110 INFO:teuthology.orchestra.run.smithi055.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T21:03:52.110 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102VS4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-04-26T21:03:52.110 INFO:teuthology.orchestra.run.smithi055.stdout:smithi064 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT534400C2400BGN 372G No 89s ago Has a FileSystem, LVM detected 2024-04-26T21:03:52.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.112+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 msgr2=0x7f74cc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:52.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.112+0000 7f74ed800700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 0x7f74cc06f1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74d4005950 tx=0x7f74d40058e0 comp rx=0 tx=0).stop 2024-04-26T21:03:52.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.112+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 msgr2=0x7f74e819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:52.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.112+0000 7f74ed800700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74d800bd70 tx=0x7f74d800be50 comp rx=0 tx=0).stop 2024-04-26T21:03:52.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 shutdown_connections 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f74cc06ccf0 0x7f74cc06f1b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e8075890 0x7f74e819cc40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 --2- 172.21.15.55:0/2193400551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74e8076ae0 0x7f74e819d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 >> 172.21.15.55:0/2193400551 conn(0x7f74e80fe3e0 msgr2=0x7f74e810d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 shutdown_connections 2024-04-26T21:03:52.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:52.113+0000 7f74ed800700 1 -- 172.21.15.55:0/2193400551 wait complete. 2024-04-26T21:03:52.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:03:53.050 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:52 smithi055 ceph-mon[25475]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:53.050 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:52 smithi055 ceph-mon[25475]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:53.054 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:03:53.066 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:03:53.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-26T21:03:53.280 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:52 smithi064 ceph-mon[33404]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:53.280 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:52 smithi064 ceph-mon[33404]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:03:55.248 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:54 smithi055 ceph-mon[25475]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:54 smithi064 ceph-mon[33404]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:55.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 -- 172.21.15.55:0/2251366199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a0103fd0 msgr2=0x7f32a01063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:55.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 --2- 172.21.15.55:0/2251366199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a0103fd0 0x7f32a01063c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3288009910 tx=0x7f3288009c20 comp rx=0 tx=0).stop 2024-04-26T21:03:55.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 -- 172.21.15.55:0/2251366199 shutdown_connections 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 --2- 172.21.15.55:0/2251366199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a0103fd0 0x7f32a01063c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 --2- 172.21.15.55:0/2251366199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a01016a0 0x7f32a0103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 -- 172.21.15.55:0/2251366199 >> 172.21.15.55:0/2251366199 conn(0x7f32a00fb0b0 msgr2=0x7f32a00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 -- 172.21.15.55:0/2251366199 shutdown_connections 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.764+0000 7f32a6800700 1 -- 172.21.15.55:0/2251366199 wait complete. 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.765+0000 7f32a6800700 1 Processor -- start 2024-04-26T21:03:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.765+0000 7f32a6800700 1 -- start start 2024-04-26T21:03:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f32a6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f32a6800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a0103fd0 0x7f32a0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f32a6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a01992e0 con 0x7f32a01016a0 2024-04-26T21:03:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f32a6800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0199420 con 0x7f32a0103fd0 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f329f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f329f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55976/0 (socket says 172.21.15.55:55976) 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f329f400700 1 -- 172.21.15.55:0/1852728104 learned_addr learned my addr 172.21.15.55:0/1852728104 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f3297e00700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a0103fd0 0x7f32a0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.766+0000 7f329f400700 1 -- 172.21.15.55:0/1852728104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a0103fd0 msgr2=0x7f32a0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329f400700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a0103fd0 0x7f32a0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329f400700 1 -- 172.21.15.55:0/1852728104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880095f0 con 0x7f32a01016a0 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329f400700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f329000c930 tx=0x7f329000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3290007ad0 con 0x7f32a01016a0 2024-04-26T21:03:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3290007c30 con 0x7f32a01016a0 2024-04-26T21:03:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a019de90 con 0x7f32a01016a0 2024-04-26T21:03:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.767+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3290018610 con 0x7f32a01016a0 2024-04-26T21:03:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.768+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a019e3d0 con 0x7f32a01016a0 2024-04-26T21:03:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.769+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a004ebb0 con 0x7f32a01016a0 2024-04-26T21:03:55.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.770+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f329000f450 con 0x7f32a01016a0 2024-04-26T21:03:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.771+0000 7f329cc00700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 0x7f328406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.771+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f329008c110 con 0x7f32a01016a0 2024-04-26T21:03:55.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.771+0000 7f3297e00700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 0x7f328406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:55.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.772+0000 7f3297e00700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 0x7f328406f1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32880051c0 tx=0x7f328800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:55.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:55.775+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f329005a290 con 0x7f32a01016a0 2024-04-26T21:03:56.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:56.033+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f32a00ffee0 con 0x7f328406ccf0 2024-04-26T21:03:57.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:56 smithi055 ceph-mon[25475]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:57.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:56 smithi055 ceph-mon[25475]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:57.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:56 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-26T21:03:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:56 smithi064 ceph-mon[33404]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:56 smithi064 ceph-mon[33404]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:03:57.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:56 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-26T21:03:58.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.022+0000 7f329cc00700 1 -- 172.21.15.55:0/1852728104 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f32a00ffee0 con 0x7f328406ccf0 2024-04-26T21:03:58.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 msgr2=0x7f328406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:58.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 0x7f328406f1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32880051c0 tx=0x7f328800b540 comp rx=0 tx=0).stop 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 msgr2=0x7f32a0198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f329000c930 tx=0x7f329000ccf0 comp rx=0 tx=0).stop 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 shutdown_connections 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f328406ccf0 0x7f328406f1b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32a01016a0 0x7f32a0198810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 --2- 172.21.15.55:0/1852728104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32a0103fd0 0x7f32a0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 >> 172.21.15.55:0/1852728104 conn(0x7f32a00fb0b0 msgr2=0x7f32a00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 shutdown_connections 2024-04-26T21:03:58.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:03:58.026+0000 7f32a6800700 1 -- 172.21.15.55:0/1852728104 wait complete. 2024-04-26T21:03:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-26T21:03:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:57 smithi055 ceph-mon[25475]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T21:03:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:57 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:03:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:57 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[25471]: 2024-04-26T21:03:57.989+0000 7fc866e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:03:58.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:57 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-26T21:03:58.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:57 smithi064 ceph-mon[33404]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T21:03:58.394 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:57 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:03:59.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: pgmap v228: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: osdmap e44: 6 total, 6 up, 6 in 2024-04-26T21:03:59.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: fsmap cephfs:0 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: Saving service mds.cephfs spec with placement count:4 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:59.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:03:58 smithi055 ceph-mon[25475]: Deploying daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:03:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: pgmap v228: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:03:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: osdmap e44: 6 total, 6 up, 6 in 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: fsmap cephfs:0 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: Saving service mds.cephfs spec with placement count:4 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:59.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:03:59.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:03:59.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:03:59.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:59.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:03:58 smithi064 ceph-mon[33404]: Deploying daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:04:00.311 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:00 smithi064 ceph-mon[33404]: osdmap e45: 6 total, 6 up, 6 in 2024-04-26T21:04:00.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:00 smithi055 ceph-mon[25475]: osdmap e45: 6 total, 6 up, 6 in 2024-04-26T21:04:00.565 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:01.316 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:01 smithi055 ceph-mon[25475]: pgmap v232: 65 pgs: 6 creating+activating, 13 creating+peering, 25 unknown, 21 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:04:01.316 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:01 smithi055 ceph-mon[25475]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T21:04:01.316 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:01 smithi055 ceph-mon[25475]: osdmap e46: 6 total, 6 up, 6 in 2024-04-26T21:04:01.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:01 smithi064 ceph-mon[33404]: pgmap v232: 65 pgs: 6 creating+activating, 13 creating+peering, 25 unknown, 21 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:04:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:01 smithi064 ceph-mon[33404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T21:04:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:01 smithi064 ceph-mon[33404]: osdmap e46: 6 total, 6 up, 6 in 2024-04-26T21:04:03.076 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:03 smithi055 ceph-mon[25475]: pgmap v234: 65 pgs: 6 creating+activating, 13 creating+peering, 25 unknown, 21 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:04:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.363+0000 7fb6c9e00700 1 -- 172.21.15.55:0/3357155759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 msgr2=0x7fb6c4100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.363+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/3357155759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4100e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009910 tx=0x7fb6b8009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 -- 172.21.15.55:0/3357155759 shutdown_connections 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/3357155759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/3357155759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4100e90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 -- 172.21.15.55:0/3357155759 >> 172.21.15.55:0/3357155759 conn(0x7fb6c40fc050 msgr2=0x7fb6c40fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 -- 172.21.15.55:0/3357155759 shutdown_connections 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.364+0000 7fb6c9e00700 1 -- 172.21.15.55:0/3357155759 wait complete. 2024-04-26T21:04:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.365+0000 7fb6c9e00700 1 Processor -- start 2024-04-26T21:04:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c9e00700 1 -- start start 2024-04-26T21:04:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c9e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c9e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c41991f0 con 0x7fb6c4100a70 2024-04-26T21:04:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c9e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4199330 con 0x7fb6c4101c70 2024-04-26T21:04:03.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c8a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:03.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.366+0000 7fb6c3e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:36012/0 (socket says 172.21.15.55:36012) 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c8a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56010/0 (socket says 172.21.15.55:56010) 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 -- 172.21.15.55:0/1393435714 learned_addr learned my addr 172.21.15.55:0/1393435714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 -- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 msgr2=0x7fb6c4198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 -- 172.21.15.55:0/1393435714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80095f0 con 0x7fb6c4101c70 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c8a00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:04:03.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.367+0000 7fb6c3e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d8d0 tx=0x7fb6b000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.368+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b00098a0 con 0x7fb6c4101c70 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.368+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c419dd90 con 0x7fb6c4101c70 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.368+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6b0010460 con 0x7fb6c4101c70 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.368+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b000f5f0 con 0x7fb6c4101c70 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.368+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c419e330 con 0x7fb6c4101c70 2024-04-26T21:04:03.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.369+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c4106640 con 0x7fb6c4101c70 2024-04-26T21:04:03.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.370+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb6b0009a00 con 0x7fb6c4101c70 2024-04-26T21:04:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.371+0000 7fb6c1600700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 0x7fb6ac06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.371+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb6b008c190 con 0x7fb6c4101c70 2024-04-26T21:04:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.371+0000 7fb6c8a00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 0x7fb6ac06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.372+0000 7fb6c8a00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 0x7fb6ac06f1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b5c0 tx=0x7fb6b8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:03.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.380+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb6b0059f50 con 0x7fb6c4101c70 2024-04-26T21:04:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:03 smithi064 ceph-mon[33404]: pgmap v234: 65 pgs: 6 creating+activating, 13 creating+peering, 25 unknown, 21 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:04:03.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.656+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6c404f450 con 0x7fb6c4101c70 2024-04-26T21:04:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.658+0000 7fb6c1600700 1 -- 172.21.15.55:0/1393435714 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1285 (secure 0 0 0) 0x7fb6b0059ae0 con 0x7fb6c4101c70 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:e4 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 4 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:03.032720+0000 2024-04-26T21:04:03.661 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:04:03.662 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 0 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:creating seq 1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:03.663 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 msgr2=0x7fb6ac06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 0x7fb6ac06f1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800b5c0 tx=0x7fb6b8005960 comp rx=0 tx=0).stop 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 msgr2=0x7fb6c4198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d8d0 tx=0x7fb6b000dbe0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 shutdown_connections 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6ac06cce0 0x7fb6ac06f1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c4100a70 0x7fb6c4198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 --2- 172.21.15.55:0/1393435714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c4101c70 0x7fb6c4198bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 >> 172.21.15.55:0/1393435714 conn(0x7fb6c40fc050 msgr2=0x7fb6c4073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 shutdown_connections 2024-04-26T21:04:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:03.662+0000 7fb6c9e00700 1 -- 172.21.15.55:0/1393435714 wait complete. 2024-04-26T21:04:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 4 2024-04-26T21:04:04.304 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:boot 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: daemon mds.cephfs.smithi055.coveew assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: Cluster is now healthy 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: fsmap cephfs:0 1 up:standby 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:creating} 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: daemon mds.cephfs.smithi055.coveew is now active in filesystem cephfs as rank 0 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:04.305 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:04.306 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:04.306 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: Deploying daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:04:04.306 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:04 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1393435714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:boot 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: daemon mds.cephfs.smithi055.coveew assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: Cluster is now healthy 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: fsmap cephfs:0 1 up:standby 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:creating} 2024-04-26T21:04:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: daemon mds.cephfs.smithi055.coveew is now active in filesystem cephfs as rank 0 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: Deploying daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:04:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:04 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1393435714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:04:04.654 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:04:04.668 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:04:04.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-26T21:04:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:05.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:05 smithi055 ceph-mon[25475]: pgmap v235: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 545 B/s wr, 1 op/s 2024-04-26T21:04:05.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:05 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:active 2024-04-26T21:04:05.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:05 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2024-04-26T21:04:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:05 smithi064 ceph-mon[33404]: pgmap v235: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 545 B/s wr, 1 op/s 2024-04-26T21:04:05.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:05 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:active 2024-04-26T21:04:05.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:05 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2024-04-26T21:04:07.132 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:07 smithi055 ceph-mon[25475]: pgmap v236: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 404 B/s wr, 1 op/s 2024-04-26T21:04:07.133 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:07 smithi064 ceph-mon[33404]: pgmap v236: 65 pgs: 65 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 404 B/s wr, 1 op/s 2024-04-26T21:04:07.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.414+0000 7f9185a00700 1 -- 172.21.15.55:0/2583069959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 msgr2=0x7f9180107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.414+0000 7f9185a00700 1 --2- 172.21.15.55:0/2583069959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f9180107680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9170009910 tx=0x7f9170009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 -- 172.21.15.55:0/2583069959 shutdown_connections 2024-04-26T21:04:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 --2- 172.21.15.55:0/2583069959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 0x7f91801088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 --2- 172.21.15.55:0/2583069959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f9180107680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 -- 172.21.15.55:0/2583069959 >> 172.21.15.55:0/2583069959 conn(0x7f9180076400 msgr2=0x7f9180078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 -- 172.21.15.55:0/2583069959 shutdown_connections 2024-04-26T21:04:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.415+0000 7f9185a00700 1 -- 172.21.15.55:0/2583069959 wait complete. 2024-04-26T21:04:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 Processor -- start 2024-04-26T21:04:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 -- start start 2024-04-26T21:04:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 0x7f918019d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019d7f0 con 0x7f9180107260 2024-04-26T21:04:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.416+0000 7f9185a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91801a21b0 con 0x7f9180108460 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35730/0 (socket says 172.21.15.55:35730) 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 -- 172.21.15.55:0/190856195 learned_addr learned my addr 172.21.15.55:0/190856195 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917e000700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 0x7f918019d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 -- 172.21.15.55:0/190856195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 msgr2=0x7f918019d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 0x7f918019d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.417+0000 7f917ea00700 1 -- 172.21.15.55:0/190856195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700095f0 con 0x7f9180107260 2024-04-26T21:04:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f917ea00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f917000bd70 tx=0x7f917000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f917001d070 con 0x7f9180107260 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9170005dc0 con 0x7f9180107260 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91801a2350 con 0x7f9180107260 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9170021410 con 0x7f9180107260 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.418+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91801a2890 con 0x7f9180107260 2024-04-26T21:04:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.419+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9180196de0 con 0x7f9180107260 2024-04-26T21:04:07.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.420+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f917000f820 con 0x7f9180107260 2024-04-26T21:04:07.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.421+0000 7f9177400700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 0x7f916406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:07.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.421+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f917008d3c0 con 0x7f9180107260 2024-04-26T21:04:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.422+0000 7f917e000700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 0x7f916406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.422+0000 7f917e000700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 0x7f916406f1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f916c005950 tx=0x7f916c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.427+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9170057810 con 0x7f9180107260 2024-04-26T21:04:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:07.719+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f918010fdc0 con 0x7f9180107260 2024-04-26T21:04:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.064+0000 7f9177400700 1 -- 172.21.15.55:0/190856195 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f917005ae30 con 0x7f9180107260 2024-04-26T21:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.067+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 msgr2=0x7f916406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.067+0000 7f9185a00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 0x7f916406f1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f916c005950 tx=0x7f916c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.067+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 msgr2=0x7f918019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.067+0000 7f9185a00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f917000bd70 tx=0x7f917000be50 comp rx=0 tx=0).stop 2024-04-26T21:04:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 shutdown_connections 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f916406ccf0 0x7f916406f1b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9180107260 0x7f918019cc90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 --2- 172.21.15.55:0/190856195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9180108460 0x7f918019d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 >> 172.21.15.55:0/190856195 conn(0x7f9180076400 msgr2=0x7f918010ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 shutdown_connections 2024-04-26T21:04:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:08.068+0000 7f9185a00700 1 -- 172.21.15.55:0/190856195 wait complete. 2024-04-26T21:04:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: Deploying daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/190856195' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] up:boot 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/190856195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:04:08.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:08 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: Deploying daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/190856195' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] up:boot 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/190856195' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:04:08.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:08 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby 2024-04-26T21:04:09.025 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:04:09.035 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:04:09.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-26T21:04:09.585 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:09 smithi055 ceph-mon[25475]: pgmap v237: 65 pgs: 65 active+clean; 578 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 714 B/s wr, 4 op/s 2024-04-26T21:04:09.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:09 smithi064 ceph-mon[33404]: pgmap v237: 65 pgs: 65 active+clean; 578 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 714 B/s wr, 4 op/s 2024-04-26T21:04:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:10.622 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:10 smithi055 ceph-mon[25475]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T21:04:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:10 smithi064 ceph-mon[33404]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T21:04:12.831 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:12 smithi055 ceph-mon[25475]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:04:12.831 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:12 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:12 smithi064 ceph-mon[33404]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:04:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:12 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:13.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 -- 172.21.15.55:0/3204354336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8103fb0 msgr2=0x7f82c8104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 --2- 172.21.15.55:0/3204354336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8103fb0 0x7f82c8104430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009910 tx=0x7f82b4009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 -- 172.21.15.55:0/3204354336 shutdown_connections 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 --2- 172.21.15.55:0/3204354336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8103fb0 0x7f82c8104430 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 --2- 172.21.15.55:0/3204354336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8102e50 0x7f82c8103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 -- 172.21.15.55:0/3204354336 >> 172.21.15.55:0/3204354336 conn(0x7f82c80fe3f0 msgr2=0x7f82c8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 -- 172.21.15.55:0/3204354336 shutdown_connections 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.209+0000 7f82cd400700 1 -- 172.21.15.55:0/3204354336 wait complete. 2024-04-26T21:04:13.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.210+0000 7f82cd400700 1 Processor -- start 2024-04-26T21:04:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.210+0000 7f82cd400700 1 -- start start 2024-04-26T21:04:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82cd400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82cd400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8103fb0 0x7f82c8198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82cd400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81993b0 con 0x7f82c8102e50 2024-04-26T21:04:13.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82cd400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81994f0 con 0x7f82c8103fb0 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82c6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82c6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35758/0 (socket says 172.21.15.55:35758) 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82c6800700 1 -- 172.21.15.55:0/2461557278 learned_addr learned my addr 172.21.15.55:0/2461557278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.211+0000 7f82c5e00700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8103fb0 0x7f82c8198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.212+0000 7f82c6800700 1 -- 172.21.15.55:0/2461557278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8103fb0 msgr2=0x7f82c8198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:13.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.212+0000 7f82c6800700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8103fb0 0x7f82c8198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.212+0000 7f82c6800700 1 -- 172.21.15.55:0/2461557278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40095f0 con 0x7f82c8102e50 2024-04-26T21:04:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.212+0000 7f82c6800700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e920 tx=0x7f82b800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.212+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b800c9d0 con 0x7f82c8102e50 2024-04-26T21:04:13.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.213+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82b8010430 con 0x7f82c8102e50 2024-04-26T21:04:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.213+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c819df00 con 0x7f82c8102e50 2024-04-26T21:04:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.213+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b8018630 con 0x7f82c8102e50 2024-04-26T21:04:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.213+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c819e440 con 0x7f82c8102e50 2024-04-26T21:04:13.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.214+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c8192950 con 0x7f82c8102e50 2024-04-26T21:04:13.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.215+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f82b80105a0 con 0x7f82c8102e50 2024-04-26T21:04:13.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.216+0000 7f82bf400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 0x7f82ac06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:13.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.216+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f82b8014070 con 0x7f82c8102e50 2024-04-26T21:04:13.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.216+0000 7f82c5e00700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 0x7f82ac06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:13.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.217+0000 7f82c5e00700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 0x7f82ac06f1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82b400b6f0 tx=0x7f82b4005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:13.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.221+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f82b8052c50 con 0x7f82c8102e50 2024-04-26T21:04:13.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.497+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f82c804ec00 con 0x7f82c8102e50 2024-04-26T21:04:13.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.646+0000 7f82bf400700 1 -- 172.21.15.55:0/2461557278 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7f82b805a390 con 0x7f82c8102e50 2024-04-26T21:04:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 msgr2=0x7f82ac06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 0x7f82ac06f1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82b400b6f0 tx=0x7f82b4005fb0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 msgr2=0x7f82c8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e920 tx=0x7f82b800ec30 comp rx=0 tx=0).stop 2024-04-26T21:04:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 shutdown_connections 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f82ac06cce0 0x7f82ac06f1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c8102e50 0x7f82c8198850 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 --2- 172.21.15.55:0/2461557278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82c8103fb0 0x7f82c8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 >> 172.21.15.55:0/2461557278 conn(0x7f82c80fe3f0 msgr2=0x7f82c81075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.650+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 shutdown_connections 2024-04-26T21:04:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:13.651+0000 7f82cd400700 1 -- 172.21.15.55:0/2461557278 wait complete. 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: Deploying daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2461557278' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:boot 2024-04-26T21:04:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2461557278' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T21:04:14.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2 up:standby 2024-04-26T21:04:14.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:04:14.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:14 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T21:04:14.499 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.499 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.499 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: Deploying daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2461557278' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:boot 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2461557278' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2 up:standby 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:04:14.500 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:14 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T21:04:14.544 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:04:14.554 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:04:14.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-26T21:04:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:15.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:15 smithi064 ceph-mon[33404]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:04:15.494 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:15 smithi055 ceph-mon[25475]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T21:04:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.345+0000 7f611be00700 1 -- 172.21.15.55:0/4120995550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 msgr2=0x7f611c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.345+0000 7f611be00700 1 --2- 172.21.15.55:0/4120995550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c073370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f610c009910 tx=0x7f610c009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 -- 172.21.15.55:0/4120995550 shutdown_connections 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 --2- 172.21.15.55:0/4120995550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 --2- 172.21.15.55:0/4120995550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c073370 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 -- 172.21.15.55:0/4120995550 >> 172.21.15.55:0/4120995550 conn(0x7f611c0fc050 msgr2=0x7f611c0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 -- 172.21.15.55:0/4120995550 shutdown_connections 2024-04-26T21:04:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.346+0000 7f611be00700 1 -- 172.21.15.55:0/4120995550 wait complete. 2024-04-26T21:04:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 Processor -- start 2024-04-26T21:04:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 -- start start 2024-04-26T21:04:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1991d0 con 0x7f611c074f10 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.347+0000 7f611be00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c199310 con 0x7f611c073940 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54012/0 (socket says 172.21.15.55:54012) 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 -- 172.21.15.55:0/2266093897 learned_addr learned my addr 172.21.15.55:0/2266093897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611aa00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 -- 172.21.15.55:0/2266093897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 msgr2=0x7f611c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611a000700 1 -- 172.21.15.55:0/2266093897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0095f0 con 0x7f611c074f10 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.348+0000 7f611aa00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f611a000700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f610800c8f0 tx=0x7f610800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6108007a70 con 0x7f611c074f10 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c19dd70 con 0x7f611c074f10 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6108007bd0 con 0x7f611c074f10 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6108018630 con 0x7f611c074f10 2024-04-26T21:04:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.349+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c19e340 con 0x7f611c074f10 2024-04-26T21:04:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.351+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c192800 con 0x7f611c074f10 2024-04-26T21:04:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.352+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f610800f450 con 0x7f611c074f10 2024-04-26T21:04:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.353+0000 7f6113400700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 0x7f610006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.354+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f610808c340 con 0x7f611c074f10 2024-04-26T21:04:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.354+0000 7f611aa00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 0x7f610006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.354+0000 7f611aa00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 0x7f610006f1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:17.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.359+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f610805a230 con 0x7f611c074f10 2024-04-26T21:04:17.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:17 smithi064 ceph-mon[33404]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 2 op/s 2024-04-26T21:04:17.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:17 smithi055 ceph-mon[25475]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 2 op/s 2024-04-26T21:04:17.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:17.640+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f611c04f450 con 0x7f611c074f10 2024-04-26T21:04:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.279+0000 7f6113400700 1 -- 172.21.15.55:0/2266093897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6108059dc0 con 0x7f611c074f10 2024-04-26T21:04:18.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.282+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 msgr2=0x7f610006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:18.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.282+0000 7f611be00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 0x7f610006f1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f610c006010 tx=0x7f610c00b540 comp rx=0 tx=0).stop 2024-04-26T21:04:18.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.282+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 msgr2=0x7f611c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f610800c8f0 tx=0x7f610800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 shutdown_connections 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f610006ccf0 0x7f610006f1b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f611c073940 0x7f611c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 --2- 172.21.15.55:0/2266093897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f611c074f10 0x7f611c198bb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 >> 172.21.15.55:0/2266093897 conn(0x7f611c0fc050 msgr2=0x7f611c106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.283+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 shutdown_connections 2024-04-26T21:04:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:18.284+0000 7f611be00700 1 -- 172.21.15.55:0/2266093897 wait complete. 2024-04-26T21:04:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:inline data disabled 2024-04-26T21:04:18.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:boot 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:18.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:18 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2266093897' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-26T21:04:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:boot 2024-04-26T21:04:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:04:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:18.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:18.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:18 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2266093897' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-26T21:04:19.216 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:04:19.227 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:04:19.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:04:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:19 smithi055 ceph-mon[25475]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 938 B/s wr, 3 op/s 2024-04-26T21:04:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:19 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2266093897' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-26T21:04:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:19 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:19.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:19 smithi064 ceph-mon[33404]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 938 B/s wr, 3 op/s 2024-04-26T21:04:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:19 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2266093897' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-26T21:04:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:19 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:20.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:20 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:active 2024-04-26T21:04:20.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:20 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] up:standby-replay 2024-04-26T21:04:20.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:20 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:20.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:20 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] up:active 2024-04-26T21:04:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:20 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] up:standby-replay 2024-04-26T21:04:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:20 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:21 smithi064 ceph-mon[33404]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 1 op/s 2024-04-26T21:04:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:21 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:21.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:21 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:21 smithi055 ceph-mon[25475]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 682 B/s wr, 1 op/s 2024-04-26T21:04:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:21.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:21 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:22 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:standby 2024-04-26T21:04:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:22 smithi055 ceph-mon[25475]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:standby 2024-04-26T21:04:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:22 smithi055 ceph-mon[25475]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:22.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:22 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:standby 2024-04-26T21:04:22.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:22 smithi064 ceph-mon[33404]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:standby 2024-04-26T21:04:22.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:22 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:04:22.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:22.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 -- 172.21.15.55:0/2318634622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 msgr2=0x7fcf3c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 --2- 172.21.15.55:0/2318634622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c1063d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009910 tx=0x7fcf28009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 -- 172.21.15.55:0/2318634622 shutdown_connections 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 --2- 172.21.15.55:0/2318634622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c1063d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 --2- 172.21.15.55:0/2318634622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 0x7fcf3c103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 -- 172.21.15.55:0/2318634622 >> 172.21.15.55:0/2318634622 conn(0x7fcf3c0fb0c0 msgr2=0x7fcf3c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 -- 172.21.15.55:0/2318634622 shutdown_connections 2024-04-26T21:04:22.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.796+0000 7fcf42200700 1 -- 172.21.15.55:0/2318634622 wait complete. 2024-04-26T21:04:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.797+0000 7fcf42200700 1 Processor -- start 2024-04-26T21:04:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.797+0000 7fcf42200700 1 -- start start 2024-04-26T21:04:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf42200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 0x7fcf3c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:22.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf42200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf42200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c1993f0 con 0x7fcf3c103fe0 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf42200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c199530 con 0x7fcf3c1016b0 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54022/0 (socket says 172.21.15.55:54022) 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3aa00700 1 -- 172.21.15.55:0/734553467 learned_addr learned my addr 172.21.15.55:0/734553467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:22.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3b400700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 0x7fcf3c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3aa00700 1 -- 172.21.15.55:0/734553467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 msgr2=0x7fcf3c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.798+0000 7fcf3aa00700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 0x7fcf3c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf3aa00700 1 -- 172.21.15.55:0/734553467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280095f0 con 0x7fcf3c103fe0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf3aa00700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800bd70 tx=0x7fcf2800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2801d070 con 0x7fcf3c103fe0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf2800f460 con 0x7fcf3c103fe0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c19dee0 con 0x7fcf3c103fe0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf28021620 con 0x7fcf3c103fe0 2024-04-26T21:04:22.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.799+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c19e420 con 0x7fcf3c103fe0 2024-04-26T21:04:22.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.801+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0fcc90 con 0x7fcf3c103fe0 2024-04-26T21:04:22.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.802+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcf2800fa70 con 0x7fcf3c103fe0 2024-04-26T21:04:22.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.804+0000 7fcf33e00700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 0x7fcf2006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:22.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.804+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcf2808d690 con 0x7fcf3c103fe0 2024-04-26T21:04:22.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.804+0000 7fcf3b400700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 0x7fcf2006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.805+0000 7fcf3b400700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 0x7fcf2006f1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005fd0 tx=0x7fcf2c00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:22.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:22.808+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fcf2805b450 con 0x7fcf3c103fe0 2024-04-26T21:04:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.108+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf3c04ebb0 con 0x7fcf3c103fe0 2024-04-26T21:04:23.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.110+0000 7fcf33e00700 1 -- 172.21.15.55:0/734553467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1870 (secure 0 0 0) 0x7fcf2805afe0 con 0x7fcf3c103fe0 2024-04-26T21:04:23.111 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:04:23.112 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:04:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:04:23.114 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:04:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.112+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 msgr2=0x7fcf2006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 0x7fcf2006f1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005fd0 tx=0x7fcf2c00a560 comp rx=0 tx=0).stop 2024-04-26T21:04:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 msgr2=0x7fcf3c198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800bd70 tx=0x7fcf2800be50 comp rx=0 tx=0).stop 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 shutdown_connections 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcf2006ccf0 0x7fcf2006f1b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf3c1016b0 0x7fcf3c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 --2- 172.21.15.55:0/734553467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c103fe0 0x7fcf3c198dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 >> 172.21.15.55:0/734553467 conn(0x7fcf3c0fb0c0 msgr2=0x7fcf3c1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 shutdown_connections 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:23.113+0000 7fcf42200700 1 -- 172.21.15.55:0/734553467 wait complete. 2024-04-26T21:04:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:04:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:23 smithi055 ceph-mon[25475]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:04:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:23 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/734553467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:04:23.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:23 smithi064 ceph-mon[33404]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:04:23.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:23 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/734553467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:04:24.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-26T21:04:25.351 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:25.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:25 smithi064 ceph-mon[33404]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T21:04:25.709 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:25 smithi055 ceph-mon[25475]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T21:04:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:27 smithi064 ceph-mon[33404]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T21:04:27.670 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:27 smithi055 ceph-mon[25475]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T21:04:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 -- 172.21.15.55:0/544434089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 msgr2=0x7fef640fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 --2- 172.21.15.55:0/544434089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef640fffb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef54009910 tx=0x7fef54009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 -- 172.21.15.55:0/544434089 shutdown_connections 2024-04-26T21:04:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 --2- 172.21.15.55:0/544434089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 0x7fef641011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 --2- 172.21.15.55:0/544434089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef640fffb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 -- 172.21.15.55:0/544434089 >> 172.21.15.55:0/544434089 conn(0x7fef640fb110 msgr2=0x7fef640fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 -- 172.21.15.55:0/544434089 shutdown_connections 2024-04-26T21:04:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.060+0000 7fef69c00700 1 -- 172.21.15.55:0/544434089 wait complete. 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.061+0000 7fef69c00700 1 Processor -- start 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.061+0000 7fef69c00700 1 -- start start 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef69c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef69c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 0x7fef64197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef69c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64194500 con 0x7fef640ffb90 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef69c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64194640 con 0x7fef64100d90 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef62a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef62a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40184/0 (socket says 172.21.15.55:40184) 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef62a00700 1 -- 172.21.15.55:0/2074444360 learned_addr learned my addr 172.21.15.55:0/2074444360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.062+0000 7fef62000700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 0x7fef64197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef62a00700 1 -- 172.21.15.55:0/2074444360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 msgr2=0x7fef64197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef62a00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 0x7fef64197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef62a00700 1 -- 172.21.15.55:0/2074444360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540095f0 con 0x7fef640ffb90 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef62a00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d480 tx=0x7fef540049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef54005dc0 con 0x7fef640ffb90 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.063+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef540044e0 con 0x7fef640ffb90 2024-04-26T21:04:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.064+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef54003ea0 con 0x7fef640ffb90 2024-04-26T21:04:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.064+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef641948c0 con 0x7fef640ffb90 2024-04-26T21:04:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.064+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef64194e10 con 0x7fef640ffb90 2024-04-26T21:04:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.065+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6418e600 con 0x7fef640ffb90 2024-04-26T21:04:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.066+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fef54003910 con 0x7fef640ffb90 2024-04-26T21:04:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.067+0000 7fef5b400700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 0x7fef4806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.067+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fef5408dbe0 con 0x7fef640ffb90 2024-04-26T21:04:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.067+0000 7fef62000700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 0x7fef4806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.068+0000 7fef62000700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 0x7fef4806f1b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef50009bf0 tx=0x7fef50009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.072+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fef5405ba20 con 0x7fef640ffb90 2024-04-26T21:04:28.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.373+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef641078c0 con 0x7fef640ffb90 2024-04-26T21:04:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.375+0000 7fef5b400700 1 -- 172.21.15.55:0/2074444360 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4828 (secure 0 0 0) 0x7fef641078c0 con 0x7fef640ffb90 2024-04-26T21:04:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.378+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 msgr2=0x7fef4806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.378+0000 7fef69c00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 0x7fef4806f1b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef50009bf0 tx=0x7fef50009260 comp rx=0 tx=0).stop 2024-04-26T21:04:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.378+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 msgr2=0x7fef641979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.378+0000 7fef69c00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d480 tx=0x7fef540049b0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 shutdown_connections 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fef4806ccf0 0x7fef4806f1b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef640ffb90 0x7fef641979c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 --2- 172.21.15.55:0/2074444360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef64100d90 0x7fef64197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 >> 172.21.15.55:0/2074444360 conn(0x7fef640fb110 msgr2=0x7fef641043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 shutdown_connections 2024-04-26T21:04:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:28.379+0000 7fef69c00700 1 -- 172.21.15.55:0/2074444360 wait complete. 2024-04-26T21:04:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:04:28.398 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:04:29.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-26T21:04:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:29 smithi055 ceph-mon[25475]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-26T21:04:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:29 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2074444360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:04:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:29 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:29 smithi064 ceph-mon[33404]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-26T21:04:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:29 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2074444360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:04:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:29 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:29.726 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:30.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:30.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:30.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:30 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:30.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:30 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:30.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:30 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:30.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:30 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:30 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:31.470 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:31 smithi055 ceph-mon[25475]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:04:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:31 smithi064 ceph-mon[33404]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:04:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.052+0000 7f89a2600700 1 -- 172.21.15.55:0/930103035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c107260 msgr2=0x7f899c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.052+0000 7f89a2600700 1 --2- 172.21.15.55:0/930103035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c107260 0x7f899c107680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f898c009910 tx=0x7f898c009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.052+0000 7f89a2600700 1 -- 172.21.15.55:0/930103035 shutdown_connections 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.052+0000 7f89a2600700 1 --2- 172.21.15.55:0/930103035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c108460 0x7f899c1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.052+0000 7f89a2600700 1 --2- 172.21.15.55:0/930103035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c107260 0x7f899c107680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.053+0000 7f89a2600700 1 -- 172.21.15.55:0/930103035 >> 172.21.15.55:0/930103035 conn(0x7f899c076400 msgr2=0x7f899c078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.053+0000 7f89a2600700 1 -- 172.21.15.55:0/930103035 shutdown_connections 2024-04-26T21:04:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.053+0000 7f89a2600700 1 -- 172.21.15.55:0/930103035 wait complete. 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 Processor -- start 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 -- start start 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c107260 0x7f899c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19d7d0 con 0x7f899c108460 2024-04-26T21:04:32.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f89a2600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19d910 con 0x7f899c107260 2024-04-26T21:04:32.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f899aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:32.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f899aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40212/0 (socket says 172.21.15.55:40212) 2024-04-26T21:04:32.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.054+0000 7f899aa00700 1 -- 172.21.15.55:0/314640752 learned_addr learned my addr 172.21.15.55:0/314640752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:32.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.055+0000 7f899b400700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c107260 0x7f899c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:32.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.055+0000 7f899aa00700 1 -- 172.21.15.55:0/314640752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c107260 msgr2=0x7f899c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.055+0000 7f899aa00700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c107260 0x7f899c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.055+0000 7f899aa00700 1 -- 172.21.15.55:0/314640752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0095f0 con 0x7f899c108460 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.055+0000 7f899aa00700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f898400d8d0 tx=0x7f898400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.056+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89840098a0 con 0x7f899c108460 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.056+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8984010460 con 0x7f899c108460 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.056+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898400f5f0 con 0x7f899c108460 2024-04-26T21:04:32.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.056+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c1a2320 con 0x7f899c108460 2024-04-26T21:04:32.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.056+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c1a28f0 con 0x7f899c108460 2024-04-26T21:04:32.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.057+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c196de0 con 0x7f899c108460 2024-04-26T21:04:32.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.058+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8984009a00 con 0x7f899c108460 2024-04-26T21:04:32.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.059+0000 7f8993e00700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 0x7f898006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:32.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.059+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f898408c110 con 0x7f899c108460 2024-04-26T21:04:32.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.059+0000 7f899b400700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 0x7f898006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:32.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.060+0000 7f899b400700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 0x7f898006f1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b5c0 tx=0x7f898c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:32.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.064+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f8984059f50 con 0x7f899c108460 2024-04-26T21:04:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.390+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f899c10fdc0 con 0x7f899c108460 2024-04-26T21:04:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.391+0000 7f8993e00700 1 -- 172.21.15.55:0/314640752 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+98 (secure 0 0 0) 0x7f8984059ae0 con 0x7f899c108460 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 msgr2=0x7f898006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 0x7f898006f1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b5c0 tx=0x7f898c005960 comp rx=0 tx=0).stop 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 msgr2=0x7f899c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f898400d8d0 tx=0x7f898400dbe0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 shutdown_connections 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f898006cce0 0x7f898006f1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f899c107260 0x7f899c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 --2- 172.21.15.55:0/314640752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899c108460 0x7f899c19d1b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.394+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 >> 172.21.15.55:0/314640752 conn(0x7f899c076400 msgr2=0x7f899c10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:32.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.395+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 shutdown_connections 2024-04-26T21:04:32.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:32.395+0000 7f89a2600700 1 -- 172.21.15.55:0/314640752 wait complete. 2024-04-26T21:04:32.412 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:04:32.745 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:32 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/314640752' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-26T21:04:32.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:32 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/314640752' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-26T21:04:33.584 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-26T21:04:33.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:04:33.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:33 smithi055 ceph-mon[25475]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 -- 172.21.15.55:0/1245684628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 msgr2=0x7f1cc8105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/1245684628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc8105890 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40098b0 tx=0x7f1cb402bcd0 comp rx=0 tx=0).stop 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 -- 172.21.15.55:0/1245684628 shutdown_connections 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/1245684628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc8105890 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/1245684628 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 0x7f1cc8102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 -- 172.21.15.55:0/1245684628 >> 172.21.15.55:0/1245684628 conn(0x7f1cc80fa580 msgr2=0x7f1cc80fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.824+0000 7f1ccfc00640 1 -- 172.21.15.55:0/1245684628 shutdown_connections 2024-04-26T21:04:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.825+0000 7f1ccfc00640 1 -- 172.21.15.55:0/1245684628 wait complete. 2024-04-26T21:04:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.826+0000 7f1ccfc00640 1 Processor -- start 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.826+0000 7f1ccfc00640 1 -- start start 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1ccfc00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 0x7f1cc8100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1ccfc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1ccfc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8100a10 con 0x7f1cc81034a0 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1ccfc00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80ff090 con 0x7f1cc8100b70 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1cc7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1cc7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40232/0 (socket says 172.21.15.55:40232) 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1cc7e00640 1 -- 172.21.15.55:0/771505578 learned_addr learned my addr 172.21.15.55:0/771505578 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1ccd200640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 0x7f1cc8100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1cc7e00640 1 -- 172.21.15.55:0/771505578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 msgr2=0x7f1cc8100440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.827+0000 7f1cc7e00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 0x7f1cc8100440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1cc7e00640 1 -- 172.21.15.55:0/771505578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009560 con 0x7f1cc81034a0 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1cc7e00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1cb402c950 tx=0x7f1cb402c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb4004520 con 0x7f1cc81034a0 2024-04-26T21:04:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cb4003ab0 con 0x7f1cc81034a0 2024-04-26T21:04:33.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80ff310 con 0x7f1cc81034a0 2024-04-26T21:04:33.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb4005630 con 0x7f1cc81034a0 2024-04-26T21:04:33.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.828+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc80ff890 con 0x7f1cc81034a0 2024-04-26T21:04:33.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.830+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc8108cf0 con 0x7f1cc81034a0 2024-04-26T21:04:33.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.831+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1cb4004ed0 con 0x7f1cc81034a0 2024-04-26T21:04:33.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.832+0000 7f1cc5600640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 0x7f1cb006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:33.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.832+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1cb40ae4b0 con 0x7f1cc81034a0 2024-04-26T21:04:33.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.832+0000 7f1ccd200640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 0x7f1cb006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:33.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.833+0000 7f1ccd200640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 0x7f1cb006f0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009b60 tx=0x7f1cbc005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:33.837+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1cb4078880 con 0x7f1cc81034a0 2024-04-26T21:04:33.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:33 smithi064 ceph-mon[33404]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:34.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.071+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc8108f30 con 0x7f1cc81034a0 2024-04-26T21:04:34.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.073+0000 7f1cc5600640 1 -- 172.21.15.55:0/771505578 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14983 (secure 0 0 0) 0x7f1cb407bea0 con 0x7f1cc81034a0 2024-04-26T21:04:34.075 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:34.075 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:04:00.007486+0000","last_up_change":"2024-04-26T21:02:17.373655+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:03:56.593833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:03:57.521866+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6803","nonce":2401927072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6805","nonce":2401927072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6809","nonce":2401927072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2401927072},{"type":"v1","addr":"172.21.15.55:6807","nonce":2401927072}]},"public_addr":"172.21.15.55:6803/2401927072","cluster_addr":"172.21.15.55:6805/2401927072","heartbeat_back_addr":"172.21.15.55:6809/2401927072","heartbeat_front_addr":"172.21.15.55:6807/2401927072","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6811","nonce":1101456028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6813","nonce":1101456028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6817","nonce":1101456028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":1101456028},{"type":"v1","addr":"172.21.15.55:6815","nonce":1101456028}]},"public_addr":"172.21.15.55:6811/1101456028","cluster_addr":"172.21.15.55:6813/1101456028","heartbeat_back_addr":"172.21.15.55:6817/1101456028","heartbeat_front_addr":"172.21.15.55:6815/1101456028","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6819","nonce":1658533164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6821","nonce":1658533164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6825","nonce":1658533164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1658533164},{"type":"v1","addr":"172.21.15.55:6823","nonce":1658533164}]},"public_addr":"172.21.15.55:6819/1658533164","cluster_addr":"172.21.15.55:6821/1658533164","heartbeat_back_addr":"172.21.15.55:6825/1658533164","heartbeat_front_addr":"172.21.15.55:6823/1658533164","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6801","nonce":2318626480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6803","nonce":2318626480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6807","nonce":2318626480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2318626480},{"type":"v1","addr":"172.21.15.64:6805","nonce":2318626480}]},"public_addr":"172.21.15.64:6801/2318626480","cluster_addr":"172.21.15.64:6803/2318626480","heartbeat_back_addr":"172.21.15.64:6807/2318626480","heartbeat_front_addr":"172.21.15.64:6805/2318626480","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6809","nonce":1215616659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6811","nonce":1215616659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6815","nonce":1215616659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1215616659},{"type":"v1","addr":"172.21.15.64:6813","nonce":1215616659}]},"public_addr":"172.21.15.64:6809/1215616659","cluster_addr":"172.21.15.64:6811/1215616659","heartbeat_back_addr":"172.21.15.64:6815/1215616659","heartbeat_front_addr":"172.21.15.64:6813/1215616659","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6817","nonce":3985789776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6819","nonce":3985789776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6823","nonce":3985789776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3985789776},{"type":"v1","addr":"172.21.15.64:6821","nonce":3985789776}]},"public_addr":"172.21.15.64:6817/3985789776","cluster_addr":"172.21.15.64:6819/3985789776","heartbeat_back_addr":"172.21.15.64:6823/3985789776","heartbeat_front_addr":"172.21.15.64:6821/3985789776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:04:34.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 msgr2=0x7f1cb006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 0x7f1cb006f0b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009b60 tx=0x7f1cbc005f90 comp rx=0 tx=0).stop 2024-04-26T21:04:34.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 msgr2=0x7f1cc80feb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1cb402c950 tx=0x7f1cb402c740 comp rx=0 tx=0).stop 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 shutdown_connections 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f1cb006cbf0 0x7f1cb006f0b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cc81034a0 0x7f1cc80feb20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 --2- 172.21.15.55:0/771505578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cc8100b70 0x7f1cc8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 >> 172.21.15.55:0/771505578 conn(0x7f1cc80fa580 msgr2=0x7f1cc80fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.076+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 shutdown_connections 2024-04-26T21:04:34.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.077+0000 7f1ccfc00640 1 -- 172.21.15.55:0/771505578 wait complete. 2024-04-26T21:04:34.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:00:32.215135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:03:56.593833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:03:57.521866+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:04:34.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:04:34.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 -- 172.21.15.55:0/2656694263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704103530 msgr2=0x7fd704105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 --2- 172.21.15.55:0/2656694263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704103530 0x7fd704105920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009880 tx=0x7fd6ec02bce0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 -- 172.21.15.55:0/2656694263 shutdown_connections 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 --2- 172.21.15.55:0/2656694263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704103530 0x7fd704105920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 --2- 172.21.15.55:0/2656694263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704100c00 0x7fd704102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 -- 172.21.15.55:0/2656694263 >> 172.21.15.55:0/2656694263 conn(0x7fd7040fa550 msgr2=0x7fd7040fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 -- 172.21.15.55:0/2656694263 shutdown_connections 2024-04-26T21:04:34.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.309+0000 7fd70aa00640 1 -- 172.21.15.55:0/2656694263 wait complete. 2024-04-26T21:04:34.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 Processor -- start 2024-04-26T21:04:34.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 -- start start 2024-04-26T21:04:34.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704103530 0x7fd704198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704198960 con 0x7fd704100c00 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.310+0000 7fd70aa00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704198ad0 con 0x7fd704103530 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40254/0 (socket says 172.21.15.55:40254) 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 -- 172.21.15.55:0/175523417 learned_addr learned my addr 172.21.15.55:0/175523417 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd6fbe00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704103530 0x7fd704198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 -- 172.21.15.55:0/175523417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704103530 msgr2=0x7fd704198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704103530 0x7fd704198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.311+0000 7fd703e00640 1 -- 172.21.15.55:0/175523417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009560 con 0x7fd704100c00 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd703e00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d6f0 tx=0x7fd6f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6f4009a30 con 0x7fd704100c00 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70419d510 con 0x7fd704100c00 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6f40054e0 con 0x7fd704100c00 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6f4010460 con 0x7fd704100c00 2024-04-26T21:04:34.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.312+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70419dac0 con 0x7fd704100c00 2024-04-26T21:04:34.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.313+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704108cd0 con 0x7fd704100c00 2024-04-26T21:04:34.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.314+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd6f4009b90 con 0x7fd704100c00 2024-04-26T21:04:34.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.316+0000 7fd701600640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 0x7fd6e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.316+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd6f408bd50 con 0x7fd704100c00 2024-04-26T21:04:34.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.316+0000 7fd6fbe00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 0x7fd6e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.317+0000 7fd6fbe00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 0x7fd6e806f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec02efd0 tx=0x7fd6ec02cf90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:34.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.321+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd6f40561d0 con 0x7fd704100c00 2024-04-26T21:04:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.530+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd70419dce0 con 0x7fd704100c00 2024-04-26T21:04:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.532+0000 7fd701600640 1 -- 172.21.15.55:0/175523417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6f40597f0 con 0x7fd704100c00 2024-04-26T21:04:34.533 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 msgr2=0x7fd6e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 0x7fd6e806f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec02efd0 tx=0x7fd6ec02cf90 comp rx=0 tx=0).stop 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 msgr2=0x7fd704197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d6f0 tx=0x7fd6f400dbb0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 shutdown_connections 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd6e806cc50 0x7fd6e806f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd704103530 0x7fd704198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 --2- 172.21.15.55:0/175523417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd704100c00 0x7fd704197e50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.534+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 >> 172.21.15.55:0/175523417 conn(0x7fd7040fa550 msgr2=0x7fd7040ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.535+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 shutdown_connections 2024-04-26T21:04:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.535+0000 7fd70aa00640 1 -- 172.21.15.55:0/175523417 wait complete. 2024-04-26T21:04:34.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:04:34.624 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:34.625 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:34 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:34.625 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:34 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/771505578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 -- 172.21.15.55:0/1056840498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 msgr2=0x7fcfd00732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/1056840498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd00732d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009880 tx=0x7fcfb802bce0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 -- 172.21.15.55:0/1056840498 shutdown_connections 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/1056840498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd00732d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/1056840498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 -- 172.21.15.55:0/1056840498 >> 172.21.15.55:0/1056840498 conn(0x7fcfd00fb480 msgr2=0x7fcfd00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:34.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.770+0000 7fcfd4a00640 1 -- 172.21.15.55:0/1056840498 shutdown_connections 2024-04-26T21:04:34.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.771+0000 7fcfd4a00640 1 -- 172.21.15.55:0/1056840498 wait complete. 2024-04-26T21:04:34.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.772+0000 7fcfd4a00640 1 Processor -- start 2024-04-26T21:04:34.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.772+0000 7fcfd4a00640 1 -- start start 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.772+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.772+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.772+0000 7fcfd4a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0198710 con 0x7fcfd0072e50 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfd4a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0198880 con 0x7fcfd0074430 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40278/0 (socket says 172.21.15.55:40278) 2024-04-26T21:04:34.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 -- 172.21.15.55:0/476790252 learned_addr learned my addr 172.21.15.55:0/476790252 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfc7e00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 -- 172.21.15.55:0/476790252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 msgr2=0x7fcfd0198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfcf400640 1 -- 172.21.15.55:0/476790252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009560 con 0x7fcfd0072e50 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.773+0000 7fcfc7e00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfcf400640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d6f0 tx=0x7fcfc000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc0009a30 con 0x7fcfd0072e50 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfc00054e0 con 0x7fcfd0072e50 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd019d2c0 con 0x7fcfd0072e50 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc0010460 con 0x7fcfd0072e50 2024-04-26T21:04:34.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.774+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd019d8a0 con 0x7fcfd0072e50 2024-04-26T21:04:34.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.775+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0191c80 con 0x7fcfd0072e50 2024-04-26T21:04:34.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.777+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcfc0009b90 con 0x7fcfd0072e50 2024-04-26T21:04:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.778+0000 7fcfccc00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 0x7fcfb406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.778+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcfc008bea0 con 0x7fcfd0072e50 2024-04-26T21:04:34.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.778+0000 7fcfc7e00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 0x7fcfb406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:34.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.779+0000 7fcfc7e00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 0x7fcfb406f120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8036040 tx=0x7fcfb802cf90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:34.784+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fcfc00561d0 con 0x7fcfd0072e50 2024-04-26T21:04:34.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:34 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:34.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:34 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:34.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:34 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/771505578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:04:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.044+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fcfd010acf0 con 0x7fcfd0072e50 2024-04-26T21:04:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.045+0000 7fcfccc00640 1 -- 172.21.15.55:0/476790252 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcfc00597f0 con 0x7fcfd0072e50 2024-04-26T21:04:35.047 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 msgr2=0x7fcfb406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 0x7fcfb406f120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8036040 tx=0x7fcfb802cf90 comp rx=0 tx=0).stop 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 msgr2=0x7fcfd0197c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000d6f0 tx=0x7fcfc000dbb0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 shutdown_connections 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fcfb406cc60 0x7fcfb406f120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcfd0074430 0x7fcfd0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 --2- 172.21.15.55:0/476790252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd0072e50 0x7fcfd0197c00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.048+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 >> 172.21.15.55:0/476790252 conn(0x7fcfd00fb480 msgr2=0x7fcfd01061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.049+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 shutdown_connections 2024-04-26T21:04:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.049+0000 7fcfd4a00640 1 -- 172.21.15.55:0/476790252 wait complete. 2024-04-26T21:04:35.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 -- 172.21.15.55:0/1488939825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 msgr2=0x7fd25c0feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 --2- 172.21.15.55:0/1488939825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c0feb90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009880 tx=0x7fd24c02bce0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 -- 172.21.15.55:0/1488939825 shutdown_connections 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 --2- 172.21.15.55:0/1488939825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 0x7fd25c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 --2- 172.21.15.55:0/1488939825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c0feb90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.284+0000 7fd25be00640 1 -- 172.21.15.55:0/1488939825 >> 172.21.15.55:0/1488939825 conn(0x7fd25c0fa370 msgr2=0x7fd25c0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.285+0000 7fd25be00640 1 -- 172.21.15.55:0/1488939825 shutdown_connections 2024-04-26T21:04:35.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.285+0000 7fd25be00640 1 -- 172.21.15.55:0/1488939825 wait complete. 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 Processor -- start 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 -- start start 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 0x7fd25c104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c100d60 con 0x7fd25c0fe770 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25be00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c100ea0 con 0x7fd25c0ff0d0 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60128/0 (socket says 172.21.15.55:60128) 2024-04-26T21:04:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.286+0000 7fd25aa00640 1 -- 172.21.15.55:0/4241203996 learned_addr learned my addr 172.21.15.55:0/4241203996 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.287+0000 7fd25a000640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 0x7fd25c104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.287+0000 7fd25aa00640 1 -- 172.21.15.55:0/4241203996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 msgr2=0x7fd25c104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.287+0000 7fd25aa00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 0x7fd25c104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.287+0000 7fd25aa00640 1 -- 172.21.15.55:0/4241203996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009560 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.287+0000 7fd25aa00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd24c036040 tx=0x7fd24c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.288+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd24c0035f0 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.288+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd24c003c10 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.288+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd24c034440 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.288+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c101120 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.288+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c101650 con 0x7fd25c0fe770 2024-04-26T21:04:35.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.289+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c101980 con 0x7fd25c0fe770 2024-04-26T21:04:35.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.290+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd24c004ff0 con 0x7fd25c0fe770 2024-04-26T21:04:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.291+0000 7fd260a00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 0x7fd24006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.292+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd24c0ae680 con 0x7fd25c0fe770 2024-04-26T21:04:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.292+0000 7fd25a000640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 0x7fd24006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.293+0000 7fd25a000640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 0x7fd24006f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd248005fd0 tx=0x7fd248005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.297+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd24c078a50 con 0x7fd25c0fe770 2024-04-26T21:04:35.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.504+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd25c191c70 con 0x7fd25c0fe770 2024-04-26T21:04:35.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.505+0000 7fd260a00640 1 -- 172.21.15.55:0/4241203996 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd24c07c070 con 0x7fd25c0fe770 2024-04-26T21:04:35.506 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:04:35.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 msgr2=0x7fd24006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 0x7fd24006f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd248005fd0 tx=0x7fd248005850 comp rx=0 tx=0).stop 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 msgr2=0x7fd25c104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd24c036040 tx=0x7fd24c004040 comp rx=0 tx=0).stop 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 shutdown_connections 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd24006cc50 0x7fd24006f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd25c0ff0d0 0x7fd25c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 --2- 172.21.15.55:0/4241203996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c0fe770 0x7fd25c104250 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.507+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 >> 172.21.15.55:0/4241203996 conn(0x7fd25c0fa370 msgr2=0x7fd25c1071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:35.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.508+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 shutdown_connections 2024-04-26T21:04:35.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.508+0000 7fd25be00640 1 -- 172.21.15.55:0/4241203996 wait complete. 2024-04-26T21:04:35.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:04:35.599 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:35 smithi055 ceph-mon[25475]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:35.600 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/175523417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:04:35.600 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/476790252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:04:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.740+0000 7f77a7200640 1 -- 172.21.15.55:0/20477276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 msgr2=0x7f77a81014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.740+0000 7f77a7200640 1 --2- 172.21.15.55:0/20477276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81014c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7794009880 tx=0x7f779402bce0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 -- 172.21.15.55:0/20477276 shutdown_connections 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 --2- 172.21.15.55:0/20477276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81014c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 --2- 172.21.15.55:0/20477276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 0x7f77a8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 -- 172.21.15.55:0/20477276 >> 172.21.15.55:0/20477276 conn(0x7f77a80fb420 msgr2=0x7f77a80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 -- 172.21.15.55:0/20477276 shutdown_connections 2024-04-26T21:04:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.741+0000 7f77a7200640 1 -- 172.21.15.55:0/20477276 wait complete. 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 Processor -- start 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 -- start start 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 0x7f77a8197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a81986c0 con 0x7f77a8101040 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8198830 con 0x7f77a80ffe60 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.742+0000 7f77a5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60154/0 (socket says 172.21.15.55:60154) 2024-04-26T21:04:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5400640 1 -- 172.21.15.55:0/324661116 learned_addr learned my addr 172.21.15.55:0/324661116 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5e00640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 0x7f77a8197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5400640 1 -- 172.21.15.55:0/324661116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 msgr2=0x7f77a8197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5400640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 0x7f77a8197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5400640 1 -- 172.21.15.55:0/324661116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009560 con 0x7f77a8101040 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.743+0000 7f77a5400640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f779402efd0 tx=0x7f7794004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.744+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77940037c0 con 0x7f77a8101040 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.744+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7794003de0 con 0x7f77a8101040 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.744+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7794034440 con 0x7f77a8101040 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.744+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a819d210 con 0x7f77a8101040 2024-04-26T21:04:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.744+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a819d790 con 0x7f77a8101040 2024-04-26T21:04:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.745+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8105540 con 0x7f77a8101040 2024-04-26T21:04:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.746+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7794004ff0 con 0x7f77a8101040 2024-04-26T21:04:35.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.747+0000 7f779ea00640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 0x7f778c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:35.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.747+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f77940ae6d0 con 0x7f77a8101040 2024-04-26T21:04:35.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.747+0000 7f77a5e00640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 0x7f778c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:35.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.748+0000 7f77a5e00640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 0x7f778c06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7798005fd0 tx=0x7f7798005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:35.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:35.752+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f7794078a80 con 0x7f77a8101040 2024-04-26T21:04:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:35 smithi064 ceph-mon[33404]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:35 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/175523417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:04:35.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:35 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/476790252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:04:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.002+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a8108a10 con 0x7f77a8101040 2024-04-26T21:04:36.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.004+0000 7f779ea00640 1 -- 172.21.15.55:0/324661116 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4828 (secure 0 0 0) 0x7f779407c0a0 con 0x7f77a8101040 2024-04-26T21:04:36.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:04:36.005 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:04:19.278071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14466":{"gid":14466,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6827/2158832788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2158832788},{"type":"v1","addr":"172.21.15.55:6827","nonce":2158832788}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi064.ukvnjs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":4,"addr":"172.21.15.64:6825/1419129911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1419129911},{"type":"v1","addr":"172.21.15.64:6825","nonce":1419129911}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-26T21:04:36.006 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:04:36.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 msgr2=0x7f778c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:36.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 0x7f778c06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7798005fd0 tx=0x7f7798005850 comp rx=0 tx=0).stop 2024-04-26T21:04:36.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 msgr2=0x7f77a81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:36.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f779402efd0 tx=0x7f7794004270 comp rx=0 tx=0).stop 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 shutdown_connections 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f778c06cc50 0x7f778c06f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77a8101040 0x7f77a81980f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 --2- 172.21.15.55:0/324661116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a80ffe60 0x7f77a8197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 >> 172.21.15.55:0/324661116 conn(0x7f77a80fb420 msgr2=0x7f77a8102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 shutdown_connections 2024-04-26T21:04:36.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:36.007+0000 7f77a7200640 1 -- 172.21.15.55:0/324661116 wait complete. 2024-04-26T21:04:36.026 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 1, 'flags': 50} 2024-04-26T21:04:36.026 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T21:04:36.054 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T21:04:36.054 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-26T21:04:36.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:36.055 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-26T21:04:36.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:36.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-26T21:04:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-26T21:04:36.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:04:36.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:36.186 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-04-26T21:04:36.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:36.251 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-04-26T21:04:36.348 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-04-26T21:04:36.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:04:36.353 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-26T21:04:36.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:04:36.353 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:36.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T21:04:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:36 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4241203996' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:04:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:36 smithi064 ceph-mon[33404]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:36 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/324661116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:04:36.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:36 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4241203996' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:04:36.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:36 smithi055 ceph-mon[25475]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:36.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:36 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/324661116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:04:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:37.531 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:37.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:38 smithi055 ceph-mon[25475]: pgmap v252: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:38 smithi064 ceph-mon[33404]: pgmap v252: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.810+0000 7f50b2a00700 1 -- 172.21.15.55:0/514015482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac100a20 msgr2=0x7f50ac100ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.810+0000 7f50b2a00700 1 --2- 172.21.15.55:0/514015482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac100a20 0x7f50ac100ea0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5098009910 tx=0x7f5098009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 -- 172.21.15.55:0/514015482 shutdown_connections 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 --2- 172.21.15.55:0/514015482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac100a20 0x7f50ac100ea0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 --2- 172.21.15.55:0/514015482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac106a20 0x7f50ac106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 -- 172.21.15.55:0/514015482 >> 172.21.15.55:0/514015482 conn(0x7f50ac0fc530 msgr2=0x7f50ac0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 -- 172.21.15.55:0/514015482 shutdown_connections 2024-04-26T21:04:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.811+0000 7f50b2a00700 1 -- 172.21.15.55:0/514015482 wait complete. 2024-04-26T21:04:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 Processor -- start 2024-04-26T21:04:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 -- start start 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac100a20 0x7f50ac19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac19f3e0 con 0x7f50ac106a20 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.812+0000 7f50b2a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac198a10 con 0x7f50ac100a20 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60184/0 (socket says 172.21.15.55:60184) 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 -- 172.21.15.55:0/9775825 learned_addr learned my addr 172.21.15.55:0/9775825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b1600700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac100a20 0x7f50ac19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 -- 172.21.15.55:0/9775825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac100a20 msgr2=0x7f50ac19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac100a20 0x7f50ac19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.813+0000 7f50b0c00700 1 -- 172.21.15.55:0/9775825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980095f0 con 0x7f50ac106a20 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50b0c00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50980092e0 tx=0x7f509800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f509801d070 con 0x7f50ac106a20 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50980056e0 con 0x7f50ac106a20 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac198c90 con 0x7f50ac106a20 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f509800fe80 con 0x7f50ac106a20 2024-04-26T21:04:39.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.814+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac199180 con 0x7f50ac106a20 2024-04-26T21:04:39.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.816+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac104cd0 con 0x7f50ac106a20 2024-04-26T21:04:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.817+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f509800f6f0 con 0x7f50ac106a20 2024-04-26T21:04:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.818+0000 7f50aa000700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 0x7f509406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.818+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f509808d5a0 con 0x7f50ac106a20 2024-04-26T21:04:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.818+0000 7f50b1600700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 0x7f509406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.819+0000 7f50b1600700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 0x7f509406f1b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50a0005950 tx=0x7f50a00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:39.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:39.823+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f509805b480 con 0x7f50ac106a20 2024-04-26T21:04:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.107+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50ac102160 con 0x7f50ac106a20 2024-04-26T21:04:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.108+0000 7f50aa000700 1 -- 172.21.15.55:0/9775825 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f509805b010 con 0x7f50ac106a20 2024-04-26T21:04:40.110 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-26T21:04:40.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 msgr2=0x7f509406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 0x7f509406f1b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50a0005950 tx=0x7f50a00058e0 comp rx=0 tx=0).stop 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 msgr2=0x7f50ac19edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f50980092e0 tx=0x7f509800be20 comp rx=0 tx=0).stop 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 shutdown_connections 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f509406ccf0 0x7f509406f1b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f50ac100a20 0x7f50ac19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 --2- 172.21.15.55:0/9775825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50ac106a20 0x7f50ac19edc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 >> 172.21.15.55:0/9775825 conn(0x7f50ac0fc530 msgr2=0x7f50ac0733d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 shutdown_connections 2024-04-26T21:04:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:40.111+0000 7f50b2a00700 1 -- 172.21.15.55:0/9775825 wait complete. 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:04:40.952 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:04:40.953 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:04:40.953 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:04:40.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:40.953 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-26T21:04:41.009 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:04:41.010 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42002sec preferred_lft 42002sec 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:41.011 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-26T21:04:41.012 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:04:41.012 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:41.012 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-26T21:04:41.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:04:41.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-04-26T21:04:41.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-04-26T21:04:41.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:04:41.013 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-26T21:04:41.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: pgmap v253: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:40 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/9775825' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:04:41.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: pgmap v253: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:04:41.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:40 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/9775825' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:04:41.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:41.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:41.535 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:04:41.606 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-26T21:04:41.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:41.610 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-26T21:04:41.664 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-26T21:04:41.664 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:04:41.664 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T21:04:41.664 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T21:04:41.664 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:04:41.664 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:41.664 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-26T21:04:41.665 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T21:04:41.665 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T21:04:41.665 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T21:04:41.665 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-26T21:04:41.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:42.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:42.493 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-26T21:04:42.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:42.540 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-26T21:04:42.641 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:42.641 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-26T21:04:42.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:04:42.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T21:04:42.642 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-26T21:04:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:42.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:42.838 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T21:04:42.838 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:42.838 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-26T21:04:42.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T21:04:42.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:04:42.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T21:04:42.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T21:04:42.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T21:04:42.839 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-26T21:04:42.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:43.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:43 smithi055 ceph-mon[25475]: pgmap v254: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:43.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:43.148 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:43.148 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-26T21:04:43.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-26T21:04:43.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:04:43.148 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-26T21:04:43.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:43.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:04:43.359 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:43.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:43 smithi064 ceph-mon[33404]: pgmap v254: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:43.410 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:04:43.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:04:43.411 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:43.460 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T21:04:43.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:43.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T21:04:43.617 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T21:04:43.617 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T21:04:43.617 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-26T21:04:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T21:04:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T21:04:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-26T21:04:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300" 2024-04-26T21:04:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300" 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789" 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789:/ 2024-04-26T21:04:44.387 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbc85ba0-040e-11ef-bc93-c7b262605968" will pass to kernel 2024-04-26T21:04:44.393 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T21:04:44.394 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:04:44.394 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:04:44.394 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:04:44.394 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:04:44.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:04:44.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:44.399 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:44.489 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:44.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:44.628 INFO:teuthology.orchestra.run.smithi055.stdout:client24327 2024-04-26T21:04:44.628 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T21:04:44.628 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:04:44.685 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:44.830 INFO:teuthology.orchestra.run.smithi055.stdout:client24327 2024-04-26T21:04:44.830 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:44.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:44.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:44.968 INFO:teuthology.orchestra.run.smithi055.stdout:client24327 2024-04-26T21:04:44.969 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968.client24327/status') 2024-04-26T21:04:45.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:45.128 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.24327 (3)172.21.15.55:0/4142426881 2024-04-26T21:04:45.128 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-04-26T21:04:45.128 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-04-26T21:04:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-04-26T21:04:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:71 bytes copied, 8.541e-05 s, 831 kB/s 2024-04-26T21:04:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:45.146 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-26T21:04:45.146 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:04:45.146 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:45.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T21:04:45.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:45 smithi064 ceph-mon[33404]: pgmap v255: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:45.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:45 smithi055 ceph-mon[25475]: pgmap v255: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:45.594 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:47.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:47 smithi064 ceph-mon[33404]: pgmap v256: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:47.434 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:47 smithi055 ceph-mon[25475]: pgmap v256: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:04:47.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 -- 172.21.15.55:0/3353723525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 msgr2=0x7f81c410be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 --2- 172.21.15.55:0/3353723525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c410be40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009910 tx=0x7f81ac009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 -- 172.21.15.55:0/3353723525 shutdown_connections 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 --2- 172.21.15.55:0/3353723525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c410be40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 --2- 172.21.15.55:0/3353723525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 0x7f81c4107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 -- 172.21.15.55:0/3353723525 >> 172.21.15.55:0/3353723525 conn(0x7f81c4076a10 msgr2=0x7f81c4078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 -- 172.21.15.55:0/3353723525 shutdown_connections 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.931+0000 7f81cae00700 1 -- 172.21.15.55:0/3353723525 wait complete. 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 Processor -- start 2024-04-26T21:04:47.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 -- start start 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 0x7f81c419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c419dd30 con 0x7f81c4107df0 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.933+0000 7f81cae00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41a1a00 con 0x7f81c4107440 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39226/0 (socket says 172.21.15.55:39226) 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 -- 172.21.15.55:0/272849909 learned_addr learned my addr 172.21.15.55:0/272849909 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81bbe00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 0x7f81c419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 -- 172.21.15.55:0/272849909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 msgr2=0x7f81c419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 0x7f81c419d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:47.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.934+0000 7f81c3e00700 1 -- 172.21.15.55:0/272849909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0095f0 con 0x7f81c4107df0 2024-04-26T21:04:47.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81c3e00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005b40 tx=0x7f81ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:47.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac01d070 con 0x7f81c4107df0 2024-04-26T21:04:47.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81ac00f460 con 0x7f81c4107df0 2024-04-26T21:04:47.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac017630 con 0x7f81c4107df0 2024-04-26T21:04:47.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c41a1c80 con 0x7f81c4107df0 2024-04-26T21:04:47.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.935+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c41a2170 con 0x7f81c4107df0 2024-04-26T21:04:47.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.936+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c410f840 con 0x7f81c4107df0 2024-04-26T21:04:47.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.937+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f81ac003a60 con 0x7f81c4107df0 2024-04-26T21:04:47.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.938+0000 7f81c1600700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 0x7f81a806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:47.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.938+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f81ac08d790 con 0x7f81c4107df0 2024-04-26T21:04:47.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.939+0000 7f81bbe00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 0x7f81a806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:47.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.939+0000 7f81bbe00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 0x7f81a806f1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b400a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:47.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:47.943+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f81ac057ac0 con 0x7f81c4107df0 2024-04-26T21:04:48.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.219+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81c4108920 con 0x7f81c4107df0 2024-04-26T21:04:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.220+0000 7f81c1600700 1 -- 172.21.15.55:0/272849909 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f81ac05b0e0 con 0x7f81c4107df0 2024-04-26T21:04:48.220 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-26T21:04:48.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 msgr2=0x7f81a806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 0x7f81a806f1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b400a560 comp rx=0 tx=0).stop 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 msgr2=0x7f81c419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005b40 tx=0x7f81ac00be20 comp rx=0 tx=0).stop 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 shutdown_connections 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f81a806ccf0 0x7f81a806f1b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c4107440 0x7f81c419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 --2- 172.21.15.55:0/272849909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81c4107df0 0x7f81c419d650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 >> 172.21.15.55:0/272849909 conn(0x7f81c4076a10 msgr2=0x7f81c4076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 shutdown_connections 2024-04-26T21:04:48.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:48.223+0000 7f81cae00700 1 -- 172.21.15.55:0/272849909 wait complete. 2024-04-26T21:04:49.034 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:04:49.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:04:49.035 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:04:49.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:49.035 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-04-26T21:04:49.099 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:04:49.099 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:04:49.099 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:04:49.099 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:49.099 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42008sec preferred_lft 42008sec 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-04-26T21:04:49.100 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:04:49.101 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:04:49.101 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-04-26T21:04:49.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:49.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:49 smithi055 ceph-mon[25475]: pgmap v257: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:04:49.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:49 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/272849909' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:04:49.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:49 smithi064 ceph-mon[33404]: pgmap v257: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:04:49.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:49 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/272849909' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T21:04:49.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:49.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:49.613 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:04:49.683 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-04-26T21:04:49.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:49.687 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-04-26T21:04:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-04-26T21:04:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:04:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:04:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:04:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:04:49.737 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:49.738 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-04-26T21:04:49.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:04:49.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:04:49.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:04:49.738 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-04-26T21:04:49.831 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:50.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:50.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:50.502 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-04-26T21:04:50.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:50.550 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-04-26T21:04:50.640 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:50.640 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-04-26T21:04:50.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:04:50.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T21:04:50.640 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-04-26T21:04:50.738 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:50.814 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:50.823 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T21:04:50.823 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:50.823 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-04-26T21:04:50.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T21:04:50.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:04:50.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T21:04:50.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T21:04:50.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T21:04:50.824 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-04-26T21:04:50.920 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:51.120 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:51.128 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:04:51.128 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-04-26T21:04:51.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-04-26T21:04:51.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:04:51.129 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-04-26T21:04:51.215 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:51.287 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:51 smithi064 ceph-mon[33404]: pgmap v258: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:04:51.312 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:51.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:04:51.321 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:51.364 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:04:51.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:04:51.364 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:51.458 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T21:04:51.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:51.458 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T21:04:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:51 smithi055 ceph-mon[25475]: pgmap v258: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:04:51.582 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T21:04:51.582 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T21:04:51.582 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-04-26T21:04:52.283 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T21:04:52.283 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T21:04:52.283 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-04-26T21:04:52.284 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300" 2024-04-26T21:04:52.284 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T21:04:52.327 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300" 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789" 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789:/ 2024-04-26T21:04:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fbc85ba0-040e-11ef-bc93-c7b262605968" will pass to kernel 2024-04-26T21:04:52.335 INFO:teuthology.orchestra.run.smithi064.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-26T21:04:52.335 INFO:teuthology.orchestra.run.smithi064.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:04:52.335 INFO:teuthology.orchestra.run.smithi064.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:04:52.335 INFO:teuthology.orchestra.run.smithi064.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:04:52.335 INFO:teuthology.orchestra.run.smithi064.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:04:52.337 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:52.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:04:52.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:04:52.341 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:52.430 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:04:52.542 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:52.549 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:52.558 INFO:teuthology.orchestra.run.smithi064.stdout:client24331 2024-04-26T21:04:52.559 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T21:04:52.559 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:04:52.610 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:52.770 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:52.776 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:52.786 INFO:teuthology.orchestra.run.smithi064.stdout:client24331 2024-04-26T21:04:52.786 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:04:52.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:04:52.895 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:52.905 INFO:teuthology.orchestra.run.smithi064.stdout:client24331 2024-04-26T21:04:52.905 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968.client24331/status') 2024-04-26T21:04:53.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:04:53.044 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.24331 (3)192.168.0.1:0/813456795 2024-04-26T21:04:53.044 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2024-04-26T21:04:53.044 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2024-04-26T21:04:53.045 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2024-04-26T21:04:53.045 INFO:teuthology.orchestra.run.smithi064.stderr:69 bytes copied, 8.7132e-05 s, 792 kB/s 2024-04-26T21:04:53.047 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-26T21:04:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:04:53.058 INFO:teuthology.run_tasks:Running task print... 2024-04-26T21:04:53.069 INFO:teuthology.task.print:**** done client 2024-04-26T21:04:53.069 INFO:teuthology.run_tasks:Running task parallel... 2024-04-26T21:04:53.096 INFO:teuthology.task.parallel:starting parallel... 2024-04-26T21:04:53.096 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-26T21:04:53.097 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:04:53.097 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:04:53.097 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-26T21:04:53.098 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-26T21:04:53.098 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-26T21:04:53.101 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:04:53.102 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T21:04:53.102 INFO:tasks.workunit:timeout=3h 2024-04-26T21:04:53.102 INFO:tasks.workunit:cleanup=True 2024-04-26T21:04:53.102 DEBUG:teuthology.orchestra.run.smithi055:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T21:04:53.159 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 9bh/155d Inode: 1 Links: 2 2024-04-26T21:04:53.159 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:04:53.160 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T21:04:53.160 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T21:04:53.160 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-26 21:04:03.044742955 +0000 2024-04-26T21:04:53.160 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-26 21:04:44.482192406 +0000 2024-04-26T21:04:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-26 21:04:03.044742955 +0000 2024-04-26T21:04:53.160 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T21:04:53.160 DEBUG:teuthology.orchestra.run.smithi055:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T21:04:53.172 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:53 smithi055 ceph-mon[25475]: pgmap v259: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:04:53.249 DEBUG:teuthology.orchestra.run.smithi064:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:53.311 INFO:teuthology.orchestra.run.smithi064.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:53.311 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 7ah/122d Inode: 1 Links: 3 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-26 21:04:53.236020805 +0000 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-26 21:04:53.236020805 +0000 2024-04-26T21:04:53.312 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-26 21:04:03.044742955 +0000 2024-04-26T21:04:53.312 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-26T21:04:53.312 DEBUG:teuthology.orchestra.run.smithi064:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-26T21:04:53.388 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:53 smithi064 ceph-mon[33404]: pgmap v259: 65 pgs: 65 active+clean; 579 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:04:53.413 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:04:53.414 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:04:53.460 INFO:tasks.workunit.client.0.smithi055.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T21:04:53.472 INFO:tasks.workunit.client.1.smithi064.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-26T21:04:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:55 smithi055 ceph-mon[25475]: pgmap v260: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:04:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:55 smithi064 ceph-mon[33404]: pgmap v260: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 -- 172.21.15.55:0/2145042902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84103fa0 msgr2=0x7f6b84104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/2145042902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84103fa0 0x7f6b84104420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009910 tx=0x7f6b70009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 -- 172.21.15.55:0/2145042902 shutdown_connections 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/2145042902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84103fa0 0x7f6b84104420 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/2145042902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84102e40 0x7f6b84103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 -- 172.21.15.55:0/2145042902 >> 172.21.15.55:0/2145042902 conn(0x7f6b840fe3e0 msgr2=0x7f6b84100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 -- 172.21.15.55:0/2145042902 shutdown_connections 2024-04-26T21:04:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.875+0000 7f6b8aa00700 1 -- 172.21.15.55:0/2145042902 wait complete. 2024-04-26T21:04:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.877+0000 7f6b8aa00700 1 Processor -- start 2024-04-26T21:04:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.877+0000 7f6b8aa00700 1 -- start start 2024-04-26T21:04:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b8aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b8aa00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 0x7f6b84198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b8aa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841993a0 con 0x7f6b84102e40 2024-04-26T21:04:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b8aa00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841994e0 con 0x7f6b84103fa0 2024-04-26T21:04:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b83e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b83e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39418/0 (socket says 172.21.15.55:39418) 2024-04-26T21:04:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.878+0000 7f6b83e00700 1 -- 172.21.15.55:0/362243606 learned_addr learned my addr 172.21.15.55:0/362243606 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83400700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 0x7f6b84198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83e00700 1 -- 172.21.15.55:0/362243606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 msgr2=0x7f6b84198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83e00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 0x7f6b84198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83e00700 1 -- 172.21.15.55:0/362243606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700095f0 con 0x7f6b84102e40 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83400700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 0x7f6b84198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b83e00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d8d0 tx=0x7f6b7400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b74009940 con 0x7f6b84102e40 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b74010460 con 0x7f6b84102e40 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8419def0 con 0x7f6b84102e40 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.879+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7400f5f0 con 0x7f6b84102e40 2024-04-26T21:04:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.880+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8419e430 con 0x7f6b84102e40 2024-04-26T21:04:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.881+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b84192940 con 0x7f6b84102e40 2024-04-26T21:04:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.882+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6b740105d0 con 0x7f6b84102e40 2024-04-26T21:04:55.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.883+0000 7f6b80c00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 0x7f6b6806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:55.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.883+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6b7408c2f0 con 0x7f6b84102e40 2024-04-26T21:04:55.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.883+0000 7f6b83400700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 0x7f6b6806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:55.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.884+0000 7f6b83400700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 0x7f6b6806f1b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000b5c0 tx=0x7f6b70005160 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:55.889+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6b7405a0f0 con 0x7f6b84102e40 2024-04-26T21:04:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.117+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6b8410b920 con 0x7f6b84102e40 2024-04-26T21:04:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.118+0000 7f6b80c00700 1 -- 172.21.15.55:0/362243606 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v25)=0 v25) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6b74059c80 con 0x7f6b84102e40 2024-04-26T21:04:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 msgr2=0x7f6b6806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 0x7f6b6806f1b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000b5c0 tx=0x7f6b70005160 comp rx=0 tx=0).stop 2024-04-26T21:04:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 msgr2=0x7f6b84198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d8d0 tx=0x7f6b7400dc90 comp rx=0 tx=0).stop 2024-04-26T21:04:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 shutdown_connections 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f6b6806ccf0 0x7f6b6806f1b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b84102e40 0x7f6b84198840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 --2- 172.21.15.55:0/362243606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b84103fa0 0x7f6b84198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 >> 172.21.15.55:0/362243606 conn(0x7f6b840fe3e0 msgr2=0x7f6b841075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 shutdown_connections 2024-04-26T21:04:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:56.121+0000 7f6b8aa00700 1 -- 172.21.15.55:0/362243606 wait complete. 2024-04-26T21:04:57.071 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-26T21:04:57.179 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:57 smithi055 ceph-mon[25475]: pgmap v261: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:04:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:57 smithi064 ceph-mon[33404]: pgmap v261: 65 pgs: 65 active+clean; 580 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:04:57.532 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:04:59.356 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:04:59 smithi055 ceph-mon[25475]: pgmap v262: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 853 B/s wr, 3 op/s 2024-04-26T21:04:59.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:04:59 smithi064 ceph-mon[33404]: pgmap v262: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 853 B/s wr, 3 op/s 2024-04-26T21:04:59.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.940+0000 7fd686000700 1 -- 172.21.15.55:0/3517747494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680104050 msgr2=0x7fd680106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:59.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.940+0000 7fd686000700 1 --2- 172.21.15.55:0/3517747494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680104050 0x7fd680106440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009910 tx=0x7fd66c009c20 comp rx=0 tx=0).stop 2024-04-26T21:04:59.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 -- 172.21.15.55:0/3517747494 shutdown_connections 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 --2- 172.21.15.55:0/3517747494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680104050 0x7fd680106440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 --2- 172.21.15.55:0/3517747494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680101720 0x7fd680103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 -- 172.21.15.55:0/3517747494 >> 172.21.15.55:0/3517747494 conn(0x7fd6800fb110 msgr2=0x7fd6800fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 -- 172.21.15.55:0/3517747494 shutdown_connections 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.941+0000 7fd686000700 1 -- 172.21.15.55:0/3517747494 wait complete. 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.942+0000 7fd686000700 1 Processor -- start 2024-04-26T21:04:59.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.942+0000 7fd686000700 1 -- start start 2024-04-26T21:04:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd686000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd686000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680104050 0x7fd680198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd686000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680199430 con 0x7fd680101720 2024-04-26T21:04:59.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd686000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680199570 con 0x7fd680104050 2024-04-26T21:04:59.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd67f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:59.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd67f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39444/0 (socket says 172.21.15.55:39444) 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.943+0000 7fd67f400700 1 -- 172.21.15.55:0/3637106320 learned_addr learned my addr 172.21.15.55:0/3637106320 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.944+0000 7fd67ea00700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680104050 0x7fd680198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.944+0000 7fd67f400700 1 -- 172.21.15.55:0/3637106320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680104050 msgr2=0x7fd680198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.944+0000 7fd67f400700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680104050 0x7fd680198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.944+0000 7fd67f400700 1 -- 172.21.15.55:0/3637106320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0095f0 con 0x7fd680101720 2024-04-26T21:04:59.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.944+0000 7fd67f400700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ba50 tx=0x7fd67000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:59.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.945+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd67000ca00 con 0x7fd680101720 2024-04-26T21:04:59.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.945+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68019dfd0 con 0x7fd680101720 2024-04-26T21:04:59.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.945+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd67000cb60 con 0x7fd680101720 2024-04-26T21:04:59.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.945+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6700075a0 con 0x7fd680101720 2024-04-26T21:04:59.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.945+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68019e510 con 0x7fd680101720 2024-04-26T21:04:59.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.947+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6800fcd00 con 0x7fd680101720 2024-04-26T21:04:59.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.947+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd67000ccd0 con 0x7fd680101720 2024-04-26T21:04:59.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.948+0000 7fd677e00700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 0x7fd66406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:04:59.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.948+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd670006e40 con 0x7fd680101720 2024-04-26T21:04:59.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.949+0000 7fd67ea00700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 0x7fd66406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:04:59.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.950+0000 7fd67ea00700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 0x7fd66406f1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c00b580 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:04:59.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:04:59.953+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd670059940 con 0x7fd680101720 2024-04-26T21:05:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.179+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd68004ebb0 con 0x7fd680101720 2024-04-26T21:05:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.180+0000 7fd677e00700 1 -- 172.21.15.55:0/3637106320 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v25)=0 v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd6700190e0 con 0x7fd680101720 2024-04-26T21:05:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.182+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 msgr2=0x7fd66406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.182+0000 7fd686000700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 0x7fd66406f1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c00b580 comp rx=0 tx=0).stop 2024-04-26T21:05:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.182+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 msgr2=0x7fd6801988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.182+0000 7fd686000700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ba50 tx=0x7fd67000be10 comp rx=0 tx=0).stop 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 shutdown_connections 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fd66406cce0 0x7fd66406f1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd680101720 0x7fd6801988d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 --2- 172.21.15.55:0/3637106320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd680104050 0x7fd680198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 >> 172.21.15.55:0/3637106320 conn(0x7fd6800fb110 msgr2=0x7fd680100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 shutdown_connections 2024-04-26T21:05:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:00.183+0000 7fd686000700 1 -- 172.21.15.55:0/3637106320 wait complete. 2024-04-26T21:05:01.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-26T21:05:01.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:01 smithi064 ceph-mon[33404]: pgmap v263: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-26T21:05:01.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:01 smithi055 ceph-mon[25475]: pgmap v263: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-26T21:05:01.526 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:05:03.366 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:03 smithi055 ceph-mon[25475]: pgmap v264: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-26T21:05:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:03 smithi064 ceph-mon[33404]: pgmap v264: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-26T21:05:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 -- 172.21.15.55:0/2417725424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8101e10 msgr2=0x7fc5b8102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 --2- 172.21.15.55:0/2417725424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8101e10 0x7fc5b8102270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009910 tx=0x7fc5a4009c20 comp rx=0 tx=0).stop 2024-04-26T21:05:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 -- 172.21.15.55:0/2417725424 shutdown_connections 2024-04-26T21:05:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 --2- 172.21.15.55:0/2417725424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8101e10 0x7fc5b8102270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 --2- 172.21.15.55:0/2417725424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 0x7fc5b8101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 -- 172.21.15.55:0/2417725424 >> 172.21.15.55:0/2417725424 conn(0x7fc5b80fc1f0 msgr2=0x7fc5b80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:05:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 -- 172.21.15.55:0/2417725424 shutdown_connections 2024-04-26T21:05:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.940+0000 7fc5bf800700 1 -- 172.21.15.55:0/2417725424 wait complete. 2024-04-26T21:05:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.941+0000 7fc5bf800700 1 Processor -- start 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.941+0000 7fc5bf800700 1 -- start start 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5bf800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 0x7fc5b8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5bf800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5bf800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8197210 con 0x7fc5b8196d90 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5bf800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8197380 con 0x7fc5b8100c10 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39470/0 (socket says 172.21.15.55:39470) 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5b7e00700 1 -- 172.21.15.55:0/3011134595 learned_addr learned my addr 172.21.15.55:0/3011134595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.942+0000 7fc5bce00700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 0x7fc5b8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b7e00700 1 -- 172.21.15.55:0/3011134595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 msgr2=0x7fc5b8196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:03.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b7e00700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 0x7fc5b8196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b7e00700 1 -- 172.21.15.55:0/3011134595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40095f0 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b7e00700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000c00 tx=0x7fc5a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a401d070 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a400f460 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a4021620 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b819c2f0 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.943+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b819c790 con 0x7fc5b8196d90 2024-04-26T21:05:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.944+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b804ebb0 con 0x7fc5b8196d90 2024-04-26T21:05:03.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.946+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc5a400f5d0 con 0x7fc5b8196d90 2024-04-26T21:05:03.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.947+0000 7fc5b5600700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 0x7fc5a006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:03.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.947+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc5a408d550 con 0x7fc5b8196d90 2024-04-26T21:05:03.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.947+0000 7fc5bce00700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 0x7fc5a006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:03.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.948+0000 7fc5bce00700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 0x7fc5a006f1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac005fd0 tx=0x7fc5ac005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:05:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:03.952+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc5a405b310 con 0x7fc5b8196d90 2024-04-26T21:05:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.177+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fc5b819c9b0 con 0x7fc5b8196d90 2024-04-26T21:05:04.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.177+0000 7fc5b5600700 1 -- 172.21.15.55:0/3011134595 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v25)=0 v25) v1 ==== 135+0+0 (secure 0 0 0) 0x7fc5a405aea0 con 0x7fc5b8196d90 2024-04-26T21:05:04.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.180+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 msgr2=0x7fc5a006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:04.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.180+0000 7fc5bf800700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 0x7fc5a006f1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac005fd0 tx=0x7fc5ac005e50 comp rx=0 tx=0).stop 2024-04-26T21:05:04.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.180+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 msgr2=0x7fc5b819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:04.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.180+0000 7fc5bf800700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000c00 tx=0x7fc5a400be20 comp rx=0 tx=0).stop 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 shutdown_connections 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fc5a006ccf0 0x7fc5a006f1b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5b8100c10 0x7fc5b8196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 --2- 172.21.15.55:0/3011134595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5b8196d90 0x7fc5b819bdb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 >> 172.21.15.55:0/3011134595 conn(0x7fc5b80fc1f0 msgr2=0x7fc5b8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 shutdown_connections 2024-04-26T21:05:04.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:04.181+0000 7fc5bf800700 1 -- 172.21.15.55:0/3011134595 wait complete. 2024-04-26T21:05:04.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-04-26T21:05:05.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:05 smithi055 ceph-mon[25475]: pgmap v265: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-26T21:05:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:05 smithi064 ceph-mon[33404]: pgmap v265: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-26T21:05:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:05:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:07 smithi064 ceph-mon[33404]: pgmap v266: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-26T21:05:07.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:07.435 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:07 smithi055 ceph-mon[25475]: pgmap v266: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-26T21:05:07.435 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 -- 172.21.15.55:0/3809515413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd64104110 msgr2=0x7efd64106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 --2- 172.21.15.55:0/3809515413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd64104110 0x7efd64106500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd50009910 tx=0x7efd50009c20 comp rx=0 tx=0).stop 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 -- 172.21.15.55:0/3809515413 shutdown_connections 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 --2- 172.21.15.55:0/3809515413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd64104110 0x7efd64106500 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 --2- 172.21.15.55:0/3809515413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd641017e0 0x7efd64103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 -- 172.21.15.55:0/3809515413 >> 172.21.15.55:0/3809515413 conn(0x7efd640fb110 msgr2=0x7efd640fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 -- 172.21.15.55:0/3809515413 shutdown_connections 2024-04-26T21:05:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.773+0000 7efd6b600700 1 -- 172.21.15.55:0/3809515413 wait complete. 2024-04-26T21:05:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.774+0000 7efd6b600700 1 Processor -- start 2024-04-26T21:05:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd6b600700 1 -- start start 2024-04-26T21:05:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd6b600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd6b600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd64104110 0x7efd64198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd6b600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64199490 con 0x7efd641017e0 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd6b600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd641995d0 con 0x7efd64104110 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd68c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd68c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52264/0 (socket says 172.21.15.55:52264) 2024-04-26T21:05:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.775+0000 7efd68c00700 1 -- 172.21.15.55:0/2055410120 learned_addr learned my addr 172.21.15.55:0/2055410120 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:05:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd63e00700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd64104110 0x7efd64198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd68c00700 1 -- 172.21.15.55:0/2055410120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd64104110 msgr2=0x7efd64198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd68c00700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd64104110 0x7efd64198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd68c00700 1 -- 172.21.15.55:0/2055410120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500095f0 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd68c00700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b4b0 tx=0x7efd5800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd58011800 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd58011e20 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6419dfd0 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.776+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5800f2e0 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.777+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6419e570 con 0x7efd641017e0 2024-04-26T21:05:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.778+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6404ebb0 con 0x7efd641017e0 2024-04-26T21:05:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.779+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd58010380 con 0x7efd641017e0 2024-04-26T21:05:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.780+0000 7efd61600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 0x7efd4c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:05:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.780+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7efd5808bd00 con 0x7efd641017e0 2024-04-26T21:05:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.781+0000 7efd63e00700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 0x7efd4c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:05:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.781+0000 7efd63e00700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 0x7efd4c06f1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd500051c0 tx=0x7efd5000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:05:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:07.785+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7efd5808f030 con 0x7efd641017e0 2024-04-26T21:05:08.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:08.036+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7efd640fff80 con 0x7efd4c06ccf0 2024-04-26T21:05:09.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:09 smithi064 ceph-mon[33404]: pgmap v267: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-26T21:05:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:09 smithi064 ceph-mon[33404]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:05:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:09 smithi055 ceph-mon[25475]: pgmap v267: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-26T21:05:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:09 smithi055 ceph-mon[25475]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:05:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:11 smithi064 ceph-mon[33404]: pgmap v268: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:11 smithi055 ceph-mon[25475]: pgmap v268: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:13.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:13 smithi064 ceph-mon[33404]: pgmap v269: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:13 smithi055 ceph-mon[25475]: pgmap v269: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:15 smithi055 ceph-mon[25475]: pgmap v270: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:15 smithi064 ceph-mon[33404]: pgmap v270: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:17.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:17 smithi055 ceph-mon[25475]: pgmap v271: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:17.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:17 smithi064 ceph-mon[33404]: pgmap v271: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:19 smithi055 ceph-mon[25475]: pgmap v272: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:19.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:19 smithi064 ceph-mon[33404]: pgmap v272: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:21 smithi055 ceph-mon[25475]: pgmap v273: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:21 smithi064 ceph-mon[33404]: pgmap v273: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:22.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:23 smithi055 ceph-mon[25475]: pgmap v274: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:23.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:23 smithi064 ceph-mon[33404]: pgmap v274: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:25 smithi055 ceph-mon[25475]: pgmap v275: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:25.615 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:25 smithi064 ceph-mon[33404]: pgmap v275: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:27 smithi055 ceph-mon[25475]: pgmap v276: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:27 smithi064 ceph-mon[33404]: pgmap v276: 65 pgs: 65 active+clean; 584 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:29 smithi055 ceph-mon[25475]: pgmap v277: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:05:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:29 smithi064 ceph-mon[33404]: pgmap v277: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:05:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:31 smithi055 ceph-mon[25475]: pgmap v278: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:31 smithi064 ceph-mon[33404]: pgmap v278: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:33 smithi064 ceph-mon[33404]: pgmap v279: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:33 smithi055 ceph-mon[25475]: pgmap v279: 65 pgs: 65 active+clean; 586 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:35 smithi064 ceph-mon[33404]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-26T21:05:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:35 smithi055 ceph-mon[25475]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-26T21:05:37.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:37 smithi055 ceph-mon[25475]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-26T21:05:37.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:37 smithi064 ceph-mon[33404]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-26T21:05:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:39.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:39 smithi055 ceph-mon[25475]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-26T21:05:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:39 smithi064 ceph-mon[33404]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-04-26T21:05:41.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:41 smithi064 ceph-mon[33404]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-04-26T21:05:41.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:41 smithi055 ceph-mon[25475]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 426 B/s wr, 2 op/s 2024-04-26T21:05:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:43.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:43 smithi064 ceph-mon[33404]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:43.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:43 smithi055 ceph-mon[25475]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-04-26T21:05:45.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:45 smithi064 ceph-mon[33404]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:05:45.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:45 smithi055 ceph-mon[25475]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:05:47.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:47 smithi064 ceph-mon[33404]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:47 smithi055 ceph-mon[25475]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:49.585 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:49 smithi055 ceph-mon[25475]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:05:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:49 smithi064 ceph-mon[33404]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:05:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:51 smithi064 ceph-mon[33404]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:51.719 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:51 smithi055 ceph-mon[25475]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:05:51.720 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:51.720 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:52.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:05:52.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:52.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:52.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:53 smithi064 ceph-mon[33404]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:05:53.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:53 smithi055 ceph-mon[25475]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:05:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:55 smithi064 ceph-mon[33404]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:55 smithi055 ceph-mon[25475]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:57 smithi064 ceph-mon[33404]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:05:57.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:57 smithi055 ceph-mon[25475]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:05:57.836 INFO:teuthology.orchestra.run.smithi055.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:05:57.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.834+0000 7efd61600700 1 -- 172.21.15.55:0/2055410120 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7efd640fff80 con 0x7efd4c06ccf0 2024-04-26T21:05:57.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.837+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 msgr2=0x7efd4c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:57.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.837+0000 7efd6b600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 0x7efd4c06f1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd500051c0 tx=0x7efd5000b540 comp rx=0 tx=0).stop 2024-04-26T21:05:57.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.837+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 msgr2=0x7efd64198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:05:57.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.837+0000 7efd6b600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd5800b4b0 tx=0x7efd5800b870 comp rx=0 tx=0).stop 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 shutdown_connections 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7efd4c06ccf0 0x7efd4c06f1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd641017e0 0x7efd64198930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 --2- 172.21.15.55:0/2055410120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd64104110 0x7efd64198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 >> 172.21.15.55:0/2055410120 conn(0x7efd640fb110 msgr2=0x7efd640ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 shutdown_connections 2024-04-26T21:05:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:05:57.838+0000 7efd6b600700 1 -- 172.21.15.55:0/2055410120 wait complete. 2024-04-26T21:05:58.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-04-26T21:05:58.933 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:58.933 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:58.934 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:05:58 smithi055 ceph-mon[25475]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:05:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:05:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:59.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:59.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:59.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:05:59.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:05:58 smithi064 ceph-mon[33404]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:05:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:06:01.119 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:00 smithi055 ceph-mon[25475]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:01.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:00 smithi064 ceph-mon[33404]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:02.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:02.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (unknown) 2024-04-26T21:06:02.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:06:02.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:02.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:02.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:02 smithi055 ceph-mon[25475]: Upgrade: Need to upgrade myself (mgr.smithi055.ybbowr) 2024-04-26T21:06:02.284 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:02.284 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (unknown) 2024-04-26T21:06:02.285 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:06:02.285 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:02.285 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:02.285 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:02 smithi064 ceph-mon[33404]: Upgrade: Need to upgrade myself (mgr.smithi055.ybbowr) 2024-04-26T21:06:02.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 -- 172.21.15.55:0/134930032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 msgr2=0x7f33c4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 --2- 172.21.15.55:0/134930032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c4103b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009910 tx=0x7f33b4009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 -- 172.21.15.55:0/134930032 shutdown_connections 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 --2- 172.21.15.55:0/134930032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c4106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 --2- 172.21.15.55:0/134930032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c4103b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 -- 172.21.15.55:0/134930032 >> 172.21.15.55:0/134930032 conn(0x7f33c40fb110 msgr2=0x7f33c40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 -- 172.21.15.55:0/134930032 shutdown_connections 2024-04-26T21:06:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.800+0000 7f33c8e00700 1 -- 172.21.15.55:0/134930032 wait complete. 2024-04-26T21:06:02.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.801+0000 7f33c8e00700 1 Processor -- start 2024-04-26T21:06:02.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.802+0000 7f33c8e00700 1 -- start start 2024-04-26T21:06:02.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.802+0000 7f33c8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.802+0000 7f33c8e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.802+0000 7f33c8e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c419d7e0 con 0x7f33c4101720 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.802+0000 7f33c8e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c41a21a0 con 0x7f33c4104050 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57558/0 (socket says 172.21.15.55:57558) 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1e00700 1 -- 172.21.15.55:0/2568330683 learned_addr learned my addr 172.21.15.55:0/2568330683 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:49426/0 (socket says 172.21.15.55:49426) 2024-04-26T21:06:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.803+0000 7f33c1400700 1 -- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 msgr2=0x7f33c419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.804+0000 7f33c1400700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.804+0000 7f33c1400700 1 -- 172.21.15.55:0/2568330683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40095f0 con 0x7f33c4104050 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.804+0000 7f33c1e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.804+0000 7f33c1400700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33b000e970 tx=0x7f33b000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.804+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b000c9d0 con 0x7f33c4104050 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.805+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c41a23a0 con 0x7f33c4104050 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.805+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c41a28c0 con 0x7f33c4104050 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.805+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33b0010430 con 0x7f33c4104050 2024-04-26T21:06:02.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.805+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b0018630 con 0x7f33c4104050 2024-04-26T21:06:02.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.806+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40052f0 con 0x7f33c4104050 2024-04-26T21:06:02.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.808+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f33b000cb30 con 0x7f33c4104050 2024-04-26T21:06:02.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.809+0000 7f33baa00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 0x7f33a806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:02.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.809+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f33b0014070 con 0x7f33c4104050 2024-04-26T21:06:02.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.809+0000 7f33c1e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 0x7f33a806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:02.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.810+0000 7f33c1e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 0x7f33a806f1b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009fd0 tx=0x7f33b4005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:02.821+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f33b0056ca0 con 0x7f33c4104050 2024-04-26T21:06:03.085 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:03 smithi055 ceph-mon[25475]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:03.085 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:03 smithi055 ceph-mon[25475]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 on smithi064 2024-04-26T21:06:03.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.295+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33a4000bc0 con 0x7f33a806ccf0 2024-04-26T21:06:03.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.297+0000 7f33baa00700 1 -- 172.21.15.55:0/2568330683 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f33a4000bc0 con 0x7f33a806ccf0 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 msgr2=0x7f33a806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 0x7f33a806f1b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009fd0 tx=0x7f33b4005fb0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 msgr2=0x7f33c419d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33b000e970 tx=0x7f33b000ec80 comp rx=0 tx=0).stop 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 shutdown_connections 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f33a806ccf0 0x7f33a806f1b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33c4101720 0x7f33c419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 --2- 172.21.15.55:0/2568330683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33c4104050 0x7f33c419d1c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.300+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 >> 172.21.15.55:0/2568330683 conn(0x7f33c40fb110 msgr2=0x7f33c4101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:03.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.301+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 shutdown_connections 2024-04-26T21:06:03.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.301+0000 7f33c8e00700 1 -- 172.21.15.55:0/2568330683 wait complete. 2024-04-26T21:06:03.325 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:06:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:03 smithi064 ceph-mon[33404]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:03 smithi064 ceph-mon[33404]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 on smithi064 2024-04-26T21:06:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 -- 172.21.15.55:0/573815951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0101720 msgr2=0x7fb6c0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/573815951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0101720 0x7fb6c0103b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009910 tx=0x7fb6b4009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 -- 172.21.15.55:0/573815951 shutdown_connections 2024-04-26T21:06:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/573815951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0104050 0x7fb6c0106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/573815951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0101720 0x7fb6c0103b10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.534+0000 7fb6c7a00700 1 -- 172.21.15.55:0/573815951 >> 172.21.15.55:0/573815951 conn(0x7fb6c00fb110 msgr2=0x7fb6c00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.535+0000 7fb6c7a00700 1 -- 172.21.15.55:0/573815951 shutdown_connections 2024-04-26T21:06:03.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.535+0000 7fb6c7a00700 1 -- 172.21.15.55:0/573815951 wait complete. 2024-04-26T21:06:03.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.536+0000 7fb6c7a00700 1 Processor -- start 2024-04-26T21:06:03.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.537+0000 7fb6c7a00700 1 -- start start 2024-04-26T21:06:03.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.537+0000 7fb6c7a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:03.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.537+0000 7fb6c7a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 0x7fb6c0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:03.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.537+0000 7fb6c7a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0199380 con 0x7fb6c0104050 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.537+0000 7fb6c7a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c01994c0 con 0x7fb6c0101720 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6bfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 0x7fb6c0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:49452/0 (socket says 172.21.15.55:49452) 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 -- 172.21.15.55:0/1156560263 learned_addr learned my addr 172.21.15.55:0/1156560263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6bfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 0x7fb6c0198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57582/0 (socket says 172.21.15.55:57582) 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 -- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 msgr2=0x7fb6c0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:03.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 0x7fb6c0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.538+0000 7fb6c5000700 1 -- 172.21.15.55:0/1156560263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40095f0 con 0x7fb6c0101720 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.539+0000 7fb6c5000700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400b650 tx=0x7fb6b4005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.539+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b401d070 con 0x7fb6c0101720 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.539+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6b40052a0 con 0x7fb6c0101720 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.539+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b4017400 con 0x7fb6c0101720 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.539+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c019dec0 con 0x7fb6c0101720 2024-04-26T21:06:03.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.540+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c019e330 con 0x7fb6c0101720 2024-04-26T21:06:03.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.541+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a0005320 con 0x7fb6c0101720 2024-04-26T21:06:03.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.543+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb6b400f850 con 0x7fb6c0101720 2024-04-26T21:06:03.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.544+0000 7fb6bd600700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 0x7fb6a806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.544+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb6b408d5b0 con 0x7fb6c0101720 2024-04-26T21:06:03.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.545+0000 7fb6bfe00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 0x7fb6a806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:03.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.546+0000 7fb6bfe00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 0x7fb6a806f1b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009c60 tx=0x7fb6ac009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:03.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:03.552+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb6b405b3f0 con 0x7fb6c0101720 2024-04-26T21:06:04.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.025+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6a0000bf0 con 0x7fb6a806ccf0 2024-04-26T21:06:04.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.026+0000 7fb6bd600700 1 -- 172.21.15.55:0/1156560263 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb6a0000bf0 con 0x7fb6a806ccf0 2024-04-26T21:06:04.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 msgr2=0x7fb6a806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 0x7fb6a806f1b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009c60 tx=0x7fb6ac009260 comp rx=0 tx=0).stop 2024-04-26T21:06:04.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 msgr2=0x7fb6c0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400b650 tx=0x7fb6b4005f00 comp rx=0 tx=0).stop 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 shutdown_connections 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb6a806ccf0 0x7fb6a806f1b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6c0101720 0x7fb6c0198820 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400b650 tx=0x7fb6b4005f00 comp rx=0 tx=0).stop 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 --2- 172.21.15.55:0/1156560263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c0104050 0x7fb6c0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 >> 172.21.15.55:0/1156560263 conn(0x7fb6c00fb110 msgr2=0x7fb6c0100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 shutdown_connections 2024-04-26T21:06:04.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.030+0000 7fb6c7a00700 1 -- 172.21.15.55:0/1156560263 wait complete. 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 -- 172.21.15.55:0/2461375441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620102e40 msgr2=0x7f6620103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 --2- 172.21.15.55:0/2461375441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620102e40 0x7f6620103260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6610009910 tx=0x7f6610009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 -- 172.21.15.55:0/2461375441 shutdown_connections 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 --2- 172.21.15.55:0/2461375441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620103fa0 0x7f6620104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 --2- 172.21.15.55:0/2461375441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620102e40 0x7f6620103260 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.255+0000 7f6625200700 1 -- 172.21.15.55:0/2461375441 >> 172.21.15.55:0/2461375441 conn(0x7f66200fe3e0 msgr2=0x7f6620100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.256+0000 7f6625200700 1 -- 172.21.15.55:0/2461375441 shutdown_connections 2024-04-26T21:06:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.256+0000 7f6625200700 1 -- 172.21.15.55:0/2461375441 wait complete. 2024-04-26T21:06:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.257+0000 7f6625200700 1 Processor -- start 2024-04-26T21:06:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.257+0000 7f6625200700 1 -- start start 2024-04-26T21:06:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f6625200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620102e40 0x7f6620198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f6625200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f6625200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620199360 con 0x7f6620103fa0 2024-04-26T21:06:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f6625200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66201994a0 con 0x7f6620102e40 2024-04-26T21:06:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f661d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f661d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57600/0 (socket says 172.21.15.55:57600) 2024-04-26T21:06:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f661d400700 1 -- 172.21.15.55:0/3400956492 learned_addr learned my addr 172.21.15.55:0/3400956492 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.258+0000 7f661de00700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620102e40 0x7f6620198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.259+0000 7f661d400700 1 -- 172.21.15.55:0/3400956492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620102e40 msgr2=0x7f6620198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.259+0000 7f661d400700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620102e40 0x7f6620198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.259+0000 7f661d400700 1 -- 172.21.15.55:0/3400956492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100095f0 con 0x7f6620103fa0 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.259+0000 7f661d400700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c8a0 tx=0x7f660c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.260+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c0078e0 con 0x7f6620103fa0 2024-04-26T21:06:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.260+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f660c00f450 con 0x7f6620103fa0 2024-04-26T21:06:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.260+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c00e5e0 con 0x7f6620103fa0 2024-04-26T21:06:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.261+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662019df00 con 0x7f6620103fa0 2024-04-26T21:06:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.261+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662019e4a0 con 0x7f6620103fa0 2024-04-26T21:06:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.262+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6620192940 con 0x7f6620103fa0 2024-04-26T21:06:04.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.264+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f660c00f5c0 con 0x7f6620103fa0 2024-04-26T21:06:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.265+0000 7f6616a00700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 0x7f660406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.265+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f660c08baa0 con 0x7f6620103fa0 2024-04-26T21:06:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.265+0000 7f661de00700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 0x7f660406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.266+0000 7f661de00700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 0x7f660406f1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6610005090 tx=0x7f6610005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:04.276 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:04 smithi055 ceph-mon[25475]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:04.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.275+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f660c059a20 con 0x7f6620103fa0 2024-04-26T21:06:04.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:04 smithi064 ceph-mon[33404]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:04.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.671+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f662002ce50 con 0x7f660406cce0 2024-04-26T21:06:04.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.692+0000 7f6616a00700 1 -- 172.21.15.55:0/3400956492 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3864 (secure 0 0 0) 0x7f662002ce50 con 0x7f660406cce0 2024-04-26T21:06:04.694 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (7m) 84s ago 9m 13.3M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (9m) 84s ago 9m 7541k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (8m) 91s ago 8m 7486k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (9m) 84s ago 9m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (8m) 91s ago 8m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (7m) 84s ago 9m 73.0M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (2m) 84s ago 2m 14.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (112s) 84s ago 111s 11.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (118s) 91s ago 117s 13.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (108s) 91s ago 107s 11.6M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:9283,8765,8443 running (11m) 84s ago 11m 499M - 18.2.2-1258-g7d2137f0 79c5878083fb 89ad350ca25b 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (8m) 91s ago 8m 452M - 18.2.2-1258-g7d2137f0 79c5878083fb 1bdb258baa6c 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (11m) 84s ago 11m 44.3M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:06:04.695 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (8m) 91s ago 8m 35.5M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (9m) 84s ago 9m 7986k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (8m) 91s ago 8m 8128k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (7m) 84s ago 7m 53.2M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (6m) 84s ago 6m 53.1M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (5m) 84s ago 5m 50.9M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (5m) 91s ago 5m 45.1M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (4m) 91s ago 4m 50.1M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (3m) 91s ago 3m 41.2M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:06:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (7m) 84s ago 8m 50.3M - 2.43.0 a07b618ecd1d cf3fa4166949 2024-04-26T21:06:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.696+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 msgr2=0x7f660406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.696+0000 7f6625200700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 0x7f660406f1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6610005090 tx=0x7f6610005960 comp rx=0 tx=0).stop 2024-04-26T21:06:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.696+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 msgr2=0x7f6620198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.696+0000 7f6625200700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c8a0 tx=0x7f660c00cbb0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 shutdown_connections 2024-04-26T21:06:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f660406cce0 0x7f660406f1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6620102e40 0x7f6620198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 --2- 172.21.15.55:0/3400956492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6620103fa0 0x7f6620198d40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 >> 172.21.15.55:0/3400956492 conn(0x7f66200fe3e0 msgr2=0x7f6620107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:04.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 shutdown_connections 2024-04-26T21:06:04.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.697+0000 7f6625200700 1 -- 172.21.15.55:0/3400956492 wait complete. 2024-04-26T21:06:04.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.925+0000 7f3393e00700 1 -- 172.21.15.55:0/1304504505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 msgr2=0x7f3394100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.925+0000 7f3393e00700 1 --2- 172.21.15.55:0/1304504505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394100e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3384009910 tx=0x7f3384009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.926+0000 7f3393e00700 1 -- 172.21.15.55:0/1304504505 shutdown_connections 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.926+0000 7f3393e00700 1 --2- 172.21.15.55:0/1304504505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f33941020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.926+0000 7f3393e00700 1 --2- 172.21.15.55:0/1304504505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394100e90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.926+0000 7f3393e00700 1 -- 172.21.15.55:0/1304504505 >> 172.21.15.55:0/1304504505 conn(0x7f33940fc050 msgr2=0x7f33940fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.927+0000 7f3393e00700 1 -- 172.21.15.55:0/1304504505 shutdown_connections 2024-04-26T21:06:04.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.927+0000 7f3393e00700 1 -- 172.21.15.55:0/1304504505 wait complete. 2024-04-26T21:06:04.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.928+0000 7f3393e00700 1 Processor -- start 2024-04-26T21:06:04.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.928+0000 7f3393e00700 1 -- start start 2024-04-26T21:06:04.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3393e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3393e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3393e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941991f0 con 0x7f3394100a70 2024-04-26T21:06:04.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3393e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394199330 con 0x7f3394101c70 2024-04-26T21:06:04.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3392000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3392000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:37280/0 (socket says 172.21.15.55:37280) 2024-04-26T21:06:04.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3392000700 1 -- 172.21.15.55:0/583611767 learned_addr learned my addr 172.21.15.55:0/583611767 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:04.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.929+0000 7f3392a00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.930+0000 7f3392000700 1 -- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 msgr2=0x7f3394198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:04.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.930+0000 7f3392000700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:04.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.930+0000 7f3392000700 1 -- 172.21.15.55:0/583611767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840095f0 con 0x7f3394101c70 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.930+0000 7f3392a00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.930+0000 7f3392000700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f338000e920 tx=0x7f338000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.931+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338000c7c0 con 0x7f3394101c70 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.931+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f338000cde0 con 0x7f3394101c70 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.931+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338001d340 con 0x7f3394101c70 2024-04-26T21:06:04.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.931+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339418eeb0 con 0x7f3394101c70 2024-04-26T21:06:04.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.931+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339418f420 con 0x7f3394101c70 2024-04-26T21:06:04.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.934+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394106640 con 0x7f3394101c70 2024-04-26T21:06:04.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.935+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f338001f440 con 0x7f3394101c70 2024-04-26T21:06:04.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.936+0000 7f3398a00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 0x7f337806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:04.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.936+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f33800949e0 con 0x7f3394101c70 2024-04-26T21:06:04.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.937+0000 7f3392a00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 0x7f337806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:04.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.938+0000 7f3392a00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 0x7f337806f1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f338400b800 tx=0x7f3384005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:04.946+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f33800628d0 con 0x7f3394101c70 2024-04-26T21:06:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:05 smithi055 ceph-mon[25475]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:05 smithi055 ceph-mon[25475]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.292+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f339404f400 con 0x7f3394101c70 2024-04-26T21:06:05.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.293+0000 7f3398a00700 1 -- 172.21.15.55:0/583611767 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f3380062460 con 0x7f3394101c70 2024-04-26T21:06:05.294 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:06:05.294 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:06:05.294 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:06:05.294 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 14 2024-04-26T21:06:05.295 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:06:05.296 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 msgr2=0x7f337806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 0x7f337806f1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f338400b800 tx=0x7f3384005940 comp rx=0 tx=0).stop 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 msgr2=0x7f3394198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f338000e920 tx=0x7f338000ece0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 shutdown_connections 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f337806cce0 0x7f337806f1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3394100a70 0x7f3394198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 --2- 172.21.15.55:0/583611767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3394101c70 0x7f3394198bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.295+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 >> 172.21.15.55:0/583611767 conn(0x7f33940fc050 msgr2=0x7f3394073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:05.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.296+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 shutdown_connections 2024-04-26T21:06:05.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.296+0000 7f3393e00700 1 -- 172.21.15.55:0/583611767 wait complete. 2024-04-26T21:06:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:05 smithi064 ceph-mon[33404]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:05 smithi064 ceph-mon[33404]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:05.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 -- 172.21.15.55:0/747965657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 msgr2=0x7f034c101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 --2- 172.21.15.55:0/747965657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c101940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f033c009910 tx=0x7f033c009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 -- 172.21.15.55:0/747965657 shutdown_connections 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 --2- 172.21.15.55:0/747965657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 --2- 172.21.15.55:0/747965657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c101940 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.450+0000 7f0351c00700 1 -- 172.21.15.55:0/747965657 >> 172.21.15.55:0/747965657 conn(0x7f034c0fb110 msgr2=0x7f034c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.451+0000 7f0351c00700 1 -- 172.21.15.55:0/747965657 shutdown_connections 2024-04-26T21:06:05.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.451+0000 7f0351c00700 1 -- 172.21.15.55:0/747965657 wait complete. 2024-04-26T21:06:05.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.452+0000 7f0351c00700 1 Processor -- start 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.452+0000 7f0351c00700 1 -- start start 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f0351c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f0351c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f0351c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c19d7c0 con 0x7f034c0ff510 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f0351c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1a2180 con 0x7f034c101e80 2024-04-26T21:06:05.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f034aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:05.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f034a000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:05.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f034aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38538/0 (socket says 172.21.15.55:38538) 2024-04-26T21:06:05.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.453+0000 7f034aa00700 1 -- 172.21.15.55:0/1534748116 learned_addr learned my addr 172.21.15.55:0/1534748116 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:05.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.454+0000 7f034a000700 1 -- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 msgr2=0x7f034c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.454+0000 7f034a000700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.454+0000 7f034a000700 1 -- 172.21.15.55:0/1534748116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0095f0 con 0x7f034c101e80 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.454+0000 7f034aa00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.455+0000 7f034a000700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c19d1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f033800e970 tx=0x7f033800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.455+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033800c9d0 con 0x7f034c101e80 2024-04-26T21:06:05.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.455+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0338010430 con 0x7f034c101e80 2024-04-26T21:06:05.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.455+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0338018650 con 0x7f034c101e80 2024-04-26T21:06:05.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.455+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c1a2380 con 0x7f034c101e80 2024-04-26T21:06:05.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.456+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c1a28a0 con 0x7f034c101e80 2024-04-26T21:06:05.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.457+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c04ebb0 con 0x7f034c101e80 2024-04-26T21:06:05.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.459+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f03380105a0 con 0x7f034c101e80 2024-04-26T21:06:05.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.460+0000 7f0343400700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 0x7f033006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:05.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.460+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0338014070 con 0x7f034c101e80 2024-04-26T21:06:05.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.460+0000 7f034aa00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 0x7f033006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:05.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.462+0000 7f034aa00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 0x7f033006f1b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f033c00b6f0 tx=0x7f033c005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.473+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0338056830 con 0x7f034c101e80 2024-04-26T21:06:05.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.928+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f034c103df0 con 0x7f033006ccf0 2024-04-26T21:06:05.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.930+0000 7f0343400700 1 -- 172.21.15.55:0/1534748116 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f034c103df0 con 0x7f033006ccf0 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [], 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "0/2 daemons upgraded", 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 image on host smithi064", 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:06:05.932 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:06:05.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 msgr2=0x7f033006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 0x7f033006f1b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f033c00b6f0 tx=0x7f033c005a90 comp rx=0 tx=0).stop 2024-04-26T21:06:05.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 msgr2=0x7f034c19d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c19d1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f033800e970 tx=0x7f033800ec80 comp rx=0 tx=0).stop 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 shutdown_connections 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f033006ccf0 0x7f033006f1b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f034c0ff510 0x7f034c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 --2- 172.21.15.55:0/1534748116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f034c101e80 0x7f034c19d1a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.933+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 >> 172.21.15.55:0/1534748116 conn(0x7f034c0fb110 msgr2=0x7f034c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.934+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 shutdown_connections 2024-04-26T21:06:05.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:05.934+0000 7f0351c00700 1 -- 172.21.15.55:0/1534748116 wait complete. 2024-04-26T21:06:06.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:06 smithi055 ceph-mon[25475]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:06.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:06 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/583611767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:06:06.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:06 smithi064 ceph-mon[33404]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:06.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:06 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/583611767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:06:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:07 smithi055 ceph-mon[25475]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:07 smithi055 ceph-mon[25475]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:07.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:07 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:07 smithi064 ceph-mon[33404]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:07 smithi064 ceph-mon[33404]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:07 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:09.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:09 smithi064 ceph-mon[33404]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:09.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:09 smithi055 ceph-mon[25475]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:11 smithi064 ceph-mon[33404]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:11.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:11 smithi055 ceph-mon[25475]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:13.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:13 smithi064 ceph-mon[33404]: pgmap v299: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:13.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:13 smithi055 ceph-mon[25475]: pgmap v299: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:15.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:15 smithi064 ceph-mon[33404]: pgmap v300: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:15.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:15 smithi055 ceph-mon[25475]: pgmap v300: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:17.130 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:17 smithi064 ceph-mon[33404]: pgmap v301: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:17.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:17 smithi055 ceph-mon[25475]: pgmap v301: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:19.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:19 smithi064 ceph-mon[33404]: pgmap v302: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:19.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:19 smithi055 ceph-mon[25475]: pgmap v302: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:21 smithi064 ceph-mon[33404]: pgmap v303: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:21.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:21 smithi055 ceph-mon[25475]: pgmap v303: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:22.155 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:22 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:22 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:23 smithi055 ceph-mon[25475]: pgmap v304: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:23.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:23 smithi064 ceph-mon[33404]: pgmap v304: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:06:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:25 smithi055 ceph-mon[25475]: pgmap v305: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:25.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:25 smithi064 ceph-mon[33404]: pgmap v305: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:27.089 INFO:tasks.workunit.client.0.smithi055.stderr:Updating files: 59% (7263/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 96% (11886/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T21:06:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:27 smithi055 ceph-mon[25475]: pgmap v306: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:27 smithi064 ceph-mon[33404]: pgmap v306: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:27.683 INFO:tasks.workunit.client.0.smithi055.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T21:06:27.683 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.683 INFO:tasks.workunit.client.0.smithi055.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T21:06:27.683 INFO:tasks.workunit.client.0.smithi055.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T21:06:27.683 INFO:tasks.workunit.client.0.smithi055.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr: git switch -c 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.684 INFO:tasks.workunit.client.0.smithi055.stderr:Or undo this operation with: 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr: git switch - 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-04-26T21:06:27.685 INFO:tasks.workunit.client.0.smithi055.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T21:06:27.699 DEBUG:teuthology.orchestra.run.smithi055:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T21:06:27.762 INFO:tasks.workunit.client.0.smithi055.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T21:06:27.770 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:06:27.770 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T21:06:28.608 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T21:06:28.751 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T21:06:28.843 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T21:06:28.851 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:06:28.851 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T21:06:28.939 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T21:06:28.949 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T21:06:28.949 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T21:06:29.004 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T21:06:29.007 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T21:06:29.007 DEBUG:teuthology.orchestra.run.smithi055:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T21:06:29.089 INFO:tasks.workunit.client.0.smithi055.stderr:+ mkdir -p fsstress 2024-04-26T21:06:29.095 INFO:tasks.workunit.client.0.smithi055.stderr:+ pushd fsstress 2024-04-26T21:06:29.095 INFO:tasks.workunit.client.0.smithi055.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:06:29.095 INFO:tasks.workunit.client.0.smithi055.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T21:06:29.344 INFO:tasks.workunit.client.1.smithi064.stderr:Updating files: 50% (6182/12271) Updating files: 51% (6259/12271) Updating files: 52% (6381/12271) Updating files: 53% (6504/12271) Updating files: 54% (6627/12271) Updating files: 55% (6750/12271) Updating files: 56% (6872/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 79% (9778/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T21:06:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:29 smithi055 ceph-mon[25475]: pgmap v307: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:29 smithi064 ceph-mon[33404]: pgmap v307: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:29.717 INFO:tasks.workunit.client.0.smithi055.stderr:+ tar xzf ltp-full.tgz 2024-04-26T21:06:30.161 INFO:tasks.workunit.client.1.smithi064.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T21:06:30.161 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.161 INFO:tasks.workunit.client.1.smithi064.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T21:06:30.161 INFO:tasks.workunit.client.1.smithi064.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: git switch -c 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:Or undo this operation with: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: git switch - 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr: 2024-04-26T21:06:30.162 INFO:tasks.workunit.client.1.smithi064.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T21:06:30.176 DEBUG:teuthology.orchestra.run.smithi064:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-26T21:06:30.244 INFO:tasks.workunit.client.1.smithi064.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T21:06:30.250 INFO:tasks.workunit.client.1.smithi064.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T21:06:30.250 INFO:tasks.workunit.client.1.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T21:06:31.117 INFO:tasks.workunit.client.1.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T21:06:31.410 INFO:tasks.workunit.client.1.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T21:06:31.458 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:31 smithi064 ceph-mon[33404]: pgmap v308: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:31 smithi055 ceph-mon[25475]: pgmap v308: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:31.512 INFO:tasks.workunit.client.1.smithi064.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T21:06:31.518 INFO:tasks.workunit.client.1.smithi064.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T21:06:31.519 INFO:tasks.workunit.client.1.smithi064.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T21:06:31.611 INFO:tasks.workunit.client.1.smithi064.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T21:06:31.623 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T21:06:31.623 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-26T21:06:31.673 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-26T21:06:31.674 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T21:06:31.674 DEBUG:teuthology.orchestra.run.smithi064:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-26T21:06:31.790 INFO:tasks.workunit.client.1.smithi064.stderr:+ mkdir -p fsstress 2024-04-26T21:06:31.796 INFO:tasks.workunit.client.1.smithi064.stderr:+ pushd fsstress 2024-04-26T21:06:31.796 INFO:tasks.workunit.client.1.smithi064.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:06:31.796 INFO:tasks.workunit.client.1.smithi064.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T21:06:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:33 smithi055 ceph-mon[25475]: pgmap v309: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:33 smithi064 ceph-mon[33404]: pgmap v309: 65 pgs: 65 active+clean; 588 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:06:34.018 INFO:tasks.workunit.client.1.smithi064.stderr:+ tar xzf ltp-full.tgz 2024-04-26T21:06:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:35 smithi055 ceph-mon[25475]: pgmap v310: 65 pgs: 65 active+clean; 5.8 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 452 KiB/s wr, 3 op/s 2024-04-26T21:06:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:35 smithi064 ceph-mon[33404]: pgmap v310: 65 pgs: 65 active+clean; 5.8 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 452 KiB/s wr, 3 op/s 2024-04-26T21:06:36.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.133+0000 7ffaafc00700 1 -- 172.21.15.55:0/1279660623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 msgr2=0x7ffaa81064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.133+0000 7ffaafc00700 1 --2- 172.21.15.55:0/1279660623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa81064e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009910 tx=0x7ffa94009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:36.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 -- 172.21.15.55:0/1279660623 shutdown_connections 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 --2- 172.21.15.55:0/1279660623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa81064e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 --2- 172.21.15.55:0/1279660623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 0x7ffaa8103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 -- 172.21.15.55:0/1279660623 >> 172.21.15.55:0/1279660623 conn(0x7ffaa80fb110 msgr2=0x7ffaa80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 -- 172.21.15.55:0/1279660623 shutdown_connections 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.134+0000 7ffaafc00700 1 -- 172.21.15.55:0/1279660623 wait complete. 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 Processor -- start 2024-04-26T21:06:36.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 -- start start 2024-04-26T21:06:36.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 0x7ffaa8196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa81971c0 con 0x7ffaa81040f0 2024-04-26T21:06:36.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.135+0000 7ffaafc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8197300 con 0x7ffaa81017c0 2024-04-26T21:06:36.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53366/0 (socket says 172.21.15.55:53366) 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 -- 172.21.15.55:0/3835746669 learned_addr learned my addr 172.21.15.55:0/3835746669 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaad200700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 0x7ffaa8196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 -- 172.21.15.55:0/3835746669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 msgr2=0x7ffaa8196660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 0x7ffaa8196660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.136+0000 7ffaa7e00700 1 -- 172.21.15.55:0/3835746669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940095f0 con 0x7ffaa81040f0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaa7e00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa9400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9401d070 con 0x7ffaa81040f0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa819bd00 con 0x7ffaa81040f0 2024-04-26T21:06:36.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa9400f460 con 0x7ffaa81040f0 2024-04-26T21:06:36.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa94021640 con 0x7ffaa81040f0 2024-04-26T21:06:36.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.137+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa819c1f0 con 0x7ffaa81040f0 2024-04-26T21:06:36.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.139+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa804ebb0 con 0x7ffaa81040f0 2024-04-26T21:06:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.140+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa9400fab0 con 0x7ffaa81040f0 2024-04-26T21:06:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.141+0000 7ffaa5600700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 0x7ffa9006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.141+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ffa9408d450 con 0x7ffaa81040f0 2024-04-26T21:06:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.141+0000 7ffaad200700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 0x7ffa9006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.142+0000 7ffaad200700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 0x7ffa9006f1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005950 tx=0x7ffa9c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:36.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.150+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ffa9405b330 con 0x7ffaa81040f0 2024-04-26T21:06:36.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.473+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaa8104ab0 con 0x7ffa9006cce0 2024-04-26T21:06:36.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.476+0000 7ffaa5600700 1 -- 172.21.15.55:0/3835746669 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ffaa8104ab0 con 0x7ffa9006cce0 2024-04-26T21:06:36.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 msgr2=0x7ffa9006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 0x7ffa9006f1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005950 tx=0x7ffa9c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 msgr2=0x7ffaa8196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa9400be20 comp rx=0 tx=0).stop 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 shutdown_connections 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ffa9006cce0 0x7ffa9006f1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffaa81017c0 0x7ffaa8196660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 --2- 172.21.15.55:0/3835746669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa81040f0 0x7ffaa8196ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.480+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 >> 172.21.15.55:0/3835746669 conn(0x7ffaa80fb110 msgr2=0x7ffaa80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.481+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 shutdown_connections 2024-04-26T21:06:36.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.481+0000 7ffaafc00700 1 -- 172.21.15.55:0/3835746669 wait complete. 2024-04-26T21:06:36.507 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:06:36.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.686+0000 7ff3e9000700 1 -- 172.21.15.55:0/744834786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4103fa0 msgr2=0x7ff3e4104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.686+0000 7ff3e9000700 1 --2- 172.21.15.55:0/744834786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4104420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009910 tx=0x7ff3d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 -- 172.21.15.55:0/744834786 shutdown_connections 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 --2- 172.21.15.55:0/744834786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4104420 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 --2- 172.21.15.55:0/744834786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4102e40 0x7ff3e4103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 -- 172.21.15.55:0/744834786 >> 172.21.15.55:0/744834786 conn(0x7ff3e40fe3e0 msgr2=0x7ff3e4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 -- 172.21.15.55:0/744834786 shutdown_connections 2024-04-26T21:06:36.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.687+0000 7ff3e9000700 1 -- 172.21.15.55:0/744834786 wait complete. 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.688+0000 7ff3e9000700 1 Processor -- start 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.688+0000 7ff3e9000700 1 -- start start 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e9000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e9000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e9000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4199380 con 0x7ff3e4102e40 2024-04-26T21:06:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e9000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e41994c0 con 0x7ff3e4103fa0 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53388/0 (socket says 172.21.15.55:53388) 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e1e00700 1 -- 172.21.15.55:0/1936054022 learned_addr learned my addr 172.21.15.55:0/1936054022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.689+0000 7ff3e1400700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.690+0000 7ff3e1e00700 1 -- 172.21.15.55:0/1936054022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4103fa0 msgr2=0x7ff3e4198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.690+0000 7ff3e1e00700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.690+0000 7ff3e1e00700 1 -- 172.21.15.55:0/1936054022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00095f0 con 0x7ff3e4102e40 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.690+0000 7ff3e1e00700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d8d0 tx=0x7ff3d400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.691+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3d40098a0 con 0x7ff3e4102e40 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.691+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3d4010460 con 0x7ff3e4102e40 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.691+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3d400f5f0 con 0x7ff3e4102e40 2024-04-26T21:06:36.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.691+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e419df20 con 0x7ff3e4102e40 2024-04-26T21:06:36.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.691+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e419e460 con 0x7ff3e4102e40 2024-04-26T21:06:36.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.692+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e4192940 con 0x7ff3e4102e40 2024-04-26T21:06:36.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.695+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff3d4009a00 con 0x7ff3e4102e40 2024-04-26T21:06:36.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.696+0000 7ff3daa00700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 0x7ff3c806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:36.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.696+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff3d408c0b0 con 0x7ff3e4102e40 2024-04-26T21:06:36.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.696+0000 7ff3e1400700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 0x7ff3c806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:36.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.697+0000 7ff3e1400700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 0x7ff3c806f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0005090 tx=0x7ff3d0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.702+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff3d4059ef0 con 0x7ff3e4102e40 2024-04-26T21:06:36.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.974+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3e402cf70 con 0x7ff3c806cce0 2024-04-26T21:06:36.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.976+0000 7ff3daa00700 1 -- 172.21.15.55:0/1936054022 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff3e402cf70 con 0x7ff3c806cce0 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.980+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 msgr2=0x7ff3c806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.980+0000 7ff3e9000700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 0x7ff3c806f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0005090 tx=0x7ff3d0005960 comp rx=0 tx=0).stop 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.980+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 msgr2=0x7ff3e4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.980+0000 7ff3e9000700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d8d0 tx=0x7ff3d400dbe0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 shutdown_connections 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7ff3c806cce0 0x7ff3c806f1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3e4102e40 0x7ff3e4198820 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 --2- 172.21.15.55:0/1936054022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3e4103fa0 0x7ff3e4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 >> 172.21.15.55:0/1936054022 conn(0x7ff3e40fe3e0 msgr2=0x7ff3e4107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 shutdown_connections 2024-04-26T21:06:36.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:36.981+0000 7ff3e9000700 1 -- 172.21.15.55:0/1936054022 wait complete. 2024-04-26T21:06:37.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 -- 172.21.15.55:0/2374628694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 msgr2=0x7f3a08107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 --2- 172.21.15.55:0/2374628694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08107680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009910 tx=0x7f39f8009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 -- 172.21.15.55:0/2374628694 shutdown_connections 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 --2- 172.21.15.55:0/2374628694 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a081088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 --2- 172.21.15.55:0/2374628694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08107680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 -- 172.21.15.55:0/2374628694 >> 172.21.15.55:0/2374628694 conn(0x7f3a08076400 msgr2=0x7f3a08078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:37.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 -- 172.21.15.55:0/2374628694 shutdown_connections 2024-04-26T21:06:37.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.157+0000 7f3a0e400700 1 -- 172.21.15.55:0/2374628694 wait complete. 2024-04-26T21:06:37.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 Processor -- start 2024-04-26T21:06:37.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 -- start start 2024-04-26T21:06:37.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a080724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08072ac0 con 0x7f3a08107260 2024-04-26T21:06:37.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.159+0000 7f3a0e400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081aa980 con 0x7f3a08108460 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53408/0 (socket says 172.21.15.55:53408) 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 -- 172.21.15.55:0/240050935 learned_addr learned my addr 172.21.15.55:0/240050935 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a06a00700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a080724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 -- 172.21.15.55:0/240050935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 msgr2=0x7f3a080724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a080724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a07400700 1 -- 172.21.15.55:0/240050935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f80095f0 con 0x7f3a08107260 2024-04-26T21:06:37.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.160+0000 7f3a06a00700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a080724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.161+0000 7f3a07400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f39f800bd70 tx=0x7f39f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.161+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f801d070 con 0x7f3a08107260 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.161+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39f8005dc0 con 0x7f3a08107260 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.161+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f8021410 con 0x7f3a08107260 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.161+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a081aab20 con 0x7f3a08107260 2024-04-26T21:06:37.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.162+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081ab040 con 0x7f3a08107260 2024-04-26T21:06:37.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.163+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0806c0a0 con 0x7f3a08107260 2024-04-26T21:06:37.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.165+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f39f800f820 con 0x7f3a08107260 2024-04-26T21:06:37.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.167+0000 7f39ffe00700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 0x7f39ec06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.167+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f39f808d8c0 con 0x7f3a08107260 2024-04-26T21:06:37.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.168+0000 7f3a06a00700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 0x7f39ec06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.169+0000 7f3a06a00700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 0x7f39ec06f1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:37.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.173+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f39f805b780 con 0x7f3a08107260 2024-04-26T21:06:37.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:37 smithi055 ceph-mon[25475]: pgmap v311: 65 pgs: 65 active+clean; 5.8 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 300 KiB/s rd, 452 KiB/s wr, 3 op/s 2024-04-26T21:06:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:37 smithi055 ceph-mon[25475]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:37 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:37.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.557+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a0802ceb0 con 0x7f39ec06ccf0 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.570+0000 7f39ffe00700 1 -- 172.21.15.55:0/240050935 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3a0802ceb0 con 0x7f39ec06ccf0 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (8m) 117s ago 10m 13.3M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (10m) 117s ago 10m 7541k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (8m) 2m ago 8m 7486k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:06:37.572 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (10m) 117s ago 10m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (8m) 2m ago 8m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (7m) 117s ago 9m 73.0M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (2m) 117s ago 2m 14.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (2m) 117s ago 2m 11.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (2m) 2m ago 2m 13.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (2m) 2m ago 2m 11.6M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:9283,8765,8443 running (11m) 117s ago 11m 499M - 18.2.2-1258-g7d2137f0 79c5878083fb 89ad350ca25b 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (8m) 2m ago 8m 452M - 18.2.2-1258-g7d2137f0 79c5878083fb 1bdb258baa6c 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (12m) 117s ago 12m 44.3M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (8m) 2m ago 8m 35.5M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (10m) 117s ago 10m 7986k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (8m) 2m ago 8m 8128k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:06:37.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (7m) 117s ago 7m 53.2M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (6m) 117s ago 6m 53.1M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (6m) 117s ago 6m 50.9M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (5m) 2m ago 5m 45.1M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (5m) 2m ago 5m 50.1M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (4m) 2m ago 4m 41.2M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:06:37.574 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (7m) 117s ago 9m 50.3M - 2.43.0 a07b618ecd1d cf3fa4166949 2024-04-26T21:06:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.573+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 msgr2=0x7f39ec06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.573+0000 7f3a0e400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 0x7f39ec06f1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4005ee0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.573+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 msgr2=0x7f3a08071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.573+0000 7f3a0e400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f39f800bd70 tx=0x7f39f800be50 comp rx=0 tx=0).stop 2024-04-26T21:06:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 shutdown_connections 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f39ec06ccf0 0x7f39ec06f1b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a08107260 0x7f3a08071f60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 --2- 172.21.15.55:0/240050935 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a08108460 0x7f3a080724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 >> 172.21.15.55:0/240050935 conn(0x7f3a08076400 msgr2=0x7f3a0810ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 shutdown_connections 2024-04-26T21:06:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.574+0000 7f3a0e400700 1 -- 172.21.15.55:0/240050935 wait complete. 2024-04-26T21:06:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:37 smithi064 ceph-mon[33404]: pgmap v311: 65 pgs: 65 active+clean; 5.8 MiB data, 194 MiB used, 536 GiB / 536 GiB avail; 300 KiB/s rd, 452 KiB/s wr, 3 op/s 2024-04-26T21:06:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:37 smithi064 ceph-mon[33404]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:37 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.739+0000 7f11e0600700 1 -- 172.21.15.55:0/905915533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 msgr2=0x7f11d8102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.739+0000 7f11e0600700 1 --2- 172.21.15.55:0/905915533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8102270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009910 tx=0x7f11c4009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 -- 172.21.15.55:0/905915533 shutdown_connections 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 --2- 172.21.15.55:0/905915533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8102270 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 --2- 172.21.15.55:0/905915533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 -- 172.21.15.55:0/905915533 >> 172.21.15.55:0/905915533 conn(0x7f11d80fc1f0 msgr2=0x7f11d80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 -- 172.21.15.55:0/905915533 shutdown_connections 2024-04-26T21:06:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.740+0000 7f11e0600700 1 -- 172.21.15.55:0/905915533 wait complete. 2024-04-26T21:06:37.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.741+0000 7f11e0600700 1 Processor -- start 2024-04-26T21:06:37.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.742+0000 7f11e0600700 1 -- start start 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.742+0000 7f11e0600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.742+0000 7f11e0600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.742+0000 7f11e0600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8199380 con 0x7f11d8101e10 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.742+0000 7f11e0600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81994c0 con 0x7f11d8100c10 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:40040/0 (socket says 172.21.15.55:40040) 2024-04-26T21:06:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 -- 172.21.15.55:0/1418022806 learned_addr learned my addr 172.21.15.55:0/1418022806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11dd200700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 -- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 msgr2=0x7f11d8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.743+0000 7f11ddc00700 1 -- 172.21.15.55:0/1418022806 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40095f0 con 0x7f11d8100c10 2024-04-26T21:06:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.744+0000 7f11ddc00700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00d900 tx=0x7f11cc00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.744+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc0041f0 con 0x7f11d8100c10 2024-04-26T21:06:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.744+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11cc004350 con 0x7f11d8100c10 2024-04-26T21:06:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.745+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d819ded0 con 0x7f11d8100c10 2024-04-26T21:06:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.745+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc003cf0 con 0x7f11d8100c10 2024-04-26T21:06:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.745+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d819e410 con 0x7f11d8100c10 2024-04-26T21:06:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.746+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d8106310 con 0x7f11d8100c10 2024-04-26T21:06:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.748+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f11cc009730 con 0x7f11d8100c10 2024-04-26T21:06:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.749+0000 7f11d6000700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 0x7f11c006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.750+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f11cc08c110 con 0x7f11d8100c10 2024-04-26T21:06:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.750+0000 7f11dd200700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 0x7f11c006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.751+0000 7f11dd200700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 0x7f11c006f1b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c4005180 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:37.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:37.763+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f11cc059fd0 con 0x7f11d8100c10 2024-04-26T21:06:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.152+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f11d81097f0 con 0x7f11d8100c10 2024-04-26T21:06:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.154+0000 7f11d6000700 1 -- 172.21.15.55:0/1418022806 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f11cc059b60 con 0x7f11d8100c10 2024-04-26T21:06:38.155 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:06:38.155 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:06:38.155 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:06:38.155 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:06:38.156 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 14 2024-04-26T21:06:38.157 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:06:38.157 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:06:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 msgr2=0x7f11c006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 0x7f11c006f1b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c4005180 comp rx=0 tx=0).stop 2024-04-26T21:06:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 msgr2=0x7f11d8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00d900 tx=0x7f11cc00dc10 comp rx=0 tx=0).stop 2024-04-26T21:06:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 shutdown_connections 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7f11c006ccf0 0x7f11c006f1b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d8100c10 0x7f11d8198820 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 --2- 172.21.15.55:0/1418022806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d8101e10 0x7f11d8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.156+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 >> 172.21.15.55:0/1418022806 conn(0x7f11d80fc1f0 msgr2=0x7f11d8103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.157+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 shutdown_connections 2024-04-26T21:06:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.157+0000 7f11e0600700 1 -- 172.21.15.55:0/1418022806 wait complete. 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 -- 172.21.15.55:0/1980892468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 msgr2=0x7fb8601002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 --2- 172.21.15.55:0/1980892468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb8601002f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009910 tx=0x7fb84c009c20 comp rx=0 tx=0).stop 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 -- 172.21.15.55:0/1980892468 shutdown_connections 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 --2- 172.21.15.55:0/1980892468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb8601002f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 --2- 172.21.15.55:0/1980892468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 0x7fb8600ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.315+0000 7fb868400700 1 -- 172.21.15.55:0/1980892468 >> 172.21.15.55:0/1980892468 conn(0x7fb8600fb110 msgr2=0x7fb8600fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:38.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.316+0000 7fb868400700 1 -- 172.21.15.55:0/1980892468 shutdown_connections 2024-04-26T21:06:38.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.316+0000 7fb868400700 1 -- 172.21.15.55:0/1980892468 wait complete. 2024-04-26T21:06:38.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.317+0000 7fb868400700 1 Processor -- start 2024-04-26T21:06:38.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.318+0000 7fb868400700 1 -- start start 2024-04-26T21:06:38.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.318+0000 7fb868400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 0x7fb860198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:38.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.318+0000 7fb868400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.318+0000 7fb868400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860199330 con 0x7fb8600ffe70 2024-04-26T21:06:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.318+0000 7fb868400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860199470 con 0x7fb8600ff510 2024-04-26T21:06:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53448/0 (socket says 172.21.15.55:53448) 2024-04-26T21:06:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 -- 172.21.15.55:0/2539989370 learned_addr learned my addr 172.21.15.55:0/2539989370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865a00700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 0x7fb860198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 -- 172.21.15.55:0/2539989370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 msgr2=0x7fb860198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 0x7fb860198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 -- 172.21.15.55:0/2539989370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c0095f0 con 0x7fb8600ffe70 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.319+0000 7fb865000700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00bd70 tx=0x7fb84c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.320+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84c01d070 con 0x7fb8600ffe70 2024-04-26T21:06:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.320+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb84c00f460 con 0x7fb8600ffe70 2024-04-26T21:06:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.320+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86019de80 con 0x7fb8600ffe70 2024-04-26T21:06:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.320+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86019e340 con 0x7fb8600ffe70 2024-04-26T21:06:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.320+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84c021620 con 0x7fb8600ffe70 2024-04-26T21:06:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.321+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860192a00 con 0x7fb8600ffe70 2024-04-26T21:06:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.323+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb84c00fa70 con 0x7fb8600ffe70 2024-04-26T21:06:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.324+0000 7fb85e000700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 0x7fb84806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:06:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.324+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb84c08d580 con 0x7fb8600ffe70 2024-04-26T21:06:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.325+0000 7fb865a00700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 0x7fb84806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:06:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.325+0000 7fb865a00700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 0x7fb84806f1b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb854005ea0 tx=0x7fb854005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:06:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.329+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb84c05b3c0 con 0x7fb8600ffe70 2024-04-26T21:06:38.484 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:38 smithi064 ceph-mon[33404]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:38.485 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:38 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1418022806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:06:38.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:38 smithi055 ceph-mon[25475]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:38.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:38 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1418022806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:06:38.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.633+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 --> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb86002cea0 con 0x7fb84806ccf0 2024-04-26T21:06:38.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.635+0000 7fb85e000700 1 -- 172.21.15.55:0/2539989370 <== mgr.14217 v2:172.21.15.55:6800/912138010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb86002cea0 con 0x7fb84806ccf0 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [], 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "0/2 daemons upgraded", 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 image on host smithi064", 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:06:38.637 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 msgr2=0x7fb84806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 0x7fb84806f1b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb854005ea0 tx=0x7fb854005e30 comp rx=0 tx=0).stop 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 msgr2=0x7fb860198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00bd70 tx=0x7fb84c00be50 comp rx=0 tx=0).stop 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 shutdown_connections 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:6800/912138010,v1:172.21.15.55:6801/912138010] conn(0x7fb84806ccf0 0x7fb84806f1b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8600ff510 0x7fb860198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 --2- 172.21.15.55:0/2539989370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8600ffe70 0x7fb860198da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:06:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.638+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 >> 172.21.15.55:0/2539989370 conn(0x7fb8600fb110 msgr2=0x7fb860107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:06:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.639+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 shutdown_connections 2024-04-26T21:06:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:06:38.639+0000 7fb868400700 1 -- 172.21.15.55:0/2539989370 wait complete. 2024-04-26T21:06:39.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:39 smithi055 ceph-mon[25475]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:39.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:39 smithi055 ceph-mon[25475]: pgmap v312: 65 pgs: 65 active+clean; 17 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 536 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-04-26T21:06:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:39 smithi064 ceph-mon[33404]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:39 smithi064 ceph-mon[33404]: pgmap v312: 65 pgs: 65 active+clean; 17 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 536 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-04-26T21:06:40.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:40 smithi055 ceph-mon[25475]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:40.642 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:40 smithi064 ceph-mon[33404]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:06:41.368 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:41 smithi064 ceph-mon[33404]: pgmap v313: 65 pgs: 65 active+clean; 38 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 774 KiB/s rd, 3.2 MiB/s wr, 190 op/s 2024-04-26T21:06:41.368 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:41.368 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:06:41.368 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:06:41.368 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:41 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:41 smithi055 ceph-mon[25475]: pgmap v313: 65 pgs: 65 active+clean; 38 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 774 KiB/s rd, 3.2 MiB/s wr, 190 op/s 2024-04-26T21:06:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:06:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:06:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:41 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:42 smithi055 ceph-mon[25475]: Upgrade: Updating mgr.smithi064.tchyje 2024-04-26T21:06:42.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:42 smithi055 ceph-mon[25475]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:06:42.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:42 smithi064 ceph-mon[33404]: Upgrade: Updating mgr.smithi064.tchyje 2024-04-26T21:06:42.530 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:42 smithi064 ceph-mon[33404]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:06:43.254 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:43 smithi064 ceph-mon[33404]: pgmap v314: 65 pgs: 65 active+clean; 38 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 774 KiB/s rd, 3.2 MiB/s wr, 190 op/s 2024-04-26T21:06:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:43 smithi055 ceph-mon[25475]: pgmap v314: 65 pgs: 65 active+clean; 38 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 774 KiB/s rd, 3.2 MiB/s wr, 190 op/s 2024-04-26T21:06:45.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:45 smithi064 ceph-mon[33404]: pgmap v315: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 212 op/s 2024-04-26T21:06:45.590 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:45 smithi055 ceph-mon[25475]: pgmap v315: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 212 op/s 2024-04-26T21:06:47.538 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:47 smithi064 ceph-mon[33404]: pgmap v316: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-04-26T21:06:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:47 smithi055 ceph-mon[25475]: pgmap v316: 65 pgs: 65 active+clean; 47 MiB data, 344 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-04-26T21:06:48.795 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:48.795 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:48.795 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:48 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:48.795 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:48 smithi064 ceph-mon[33404]: pgmap v317: 65 pgs: 65 active+clean; 54 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2024-04-26T21:06:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:48 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:48 smithi055 ceph-mon[25475]: pgmap v317: 65 pgs: 65 active+clean; 54 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 281 op/s 2024-04-26T21:06:50.891 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:50 smithi064 ceph-mon[33404]: pgmap v318: 65 pgs: 65 active+clean; 60 MiB data, 399 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 258 op/s 2024-04-26T21:06:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:50 smithi055 ceph-mon[25475]: pgmap v318: 65 pgs: 65 active+clean; 60 MiB data, 399 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 258 op/s 2024-04-26T21:06:51.859 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:51 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:52.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:51 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:06:53.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:52 smithi064 ceph-mon[33404]: pgmap v319: 65 pgs: 65 active+clean; 60 MiB data, 399 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 156 op/s 2024-04-26T21:06:53.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:53.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:52 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:53.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:52 smithi055 ceph-mon[25475]: pgmap v319: 65 pgs: 65 active+clean; 60 MiB data, 399 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 156 op/s 2024-04-26T21:06:53.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:53.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:52 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:54.974 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:54 smithi064 ceph-mon[33404]: pgmap v320: 65 pgs: 65 active+clean; 73 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-04-26T21:06:54.975 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:54 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:54.975 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:54 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:54 smithi055 ceph-mon[25475]: pgmap v320: 65 pgs: 65 active+clean; 73 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-04-26T21:06:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:54 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:54 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:06:57.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:56 smithi064 ceph-mon[33404]: pgmap v321: 65 pgs: 65 active+clean; 73 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 1021 KiB/s rd, 2.2 MiB/s wr, 215 op/s 2024-04-26T21:06:57.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:56 smithi055 ceph-mon[25475]: pgmap v321: 65 pgs: 65 active+clean; 73 MiB data, 431 MiB used, 536 GiB / 536 GiB avail; 1021 KiB/s rd, 2.2 MiB/s wr, 215 op/s 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:06:57.943 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:57 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:06:58.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:57 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:06:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:58 smithi064 ceph-mon[33404]: pgmap v322: 65 pgs: 65 active+clean; 81 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 287 op/s 2024-04-26T21:06:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:06:58 smithi064 ceph-mon[33404]: mgrmap e20: smithi055.ybbowr(active, since 9m), standbys: smithi064.tchyje 2024-04-26T21:06:59.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:58 smithi055 ceph-mon[25475]: pgmap v322: 65 pgs: 65 active+clean; 81 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 287 op/s 2024-04-26T21:06:59.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:06:58 smithi055 ceph-mon[25475]: mgrmap e20: smithi055.ybbowr(active, since 9m), standbys: smithi064.tchyje 2024-04-26T21:07:00.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr fail", "who": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: Activating manager daemon smithi064.tchyje 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:07:00.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "mgr fail", "who": "smithi055.ybbowr"}]': finished 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: mgrmap e21: smithi064.tchyje(active, starting, since 0.0161173s) 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:07:00.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: Manager daemon smithi064.tchyje is now available 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.tchyje/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:07:00.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.tchyje/trash_purge_schedule"}]: dispatch 2024-04-26T21:07:00.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr fail", "who": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: Activating manager daemon smithi064.tchyje 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: osdmap e47: 6 total, 6 up, 6 in 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.14217 172.21.15.55:0/2387346511' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "mgr fail", "who": "smithi055.ybbowr"}]': finished 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: mgrmap e21: smithi064.tchyje(active, starting, since 0.0161173s) 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:07:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:07:00.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: Manager daemon smithi064.tchyje is now available 2024-04-26T21:07:00.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:00.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:00.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.tchyje/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:07:00.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi064.tchyje/trash_purge_schedule"}]: dispatch 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: [26/Apr/2024:21:07:00] ENGINE Bus STARTING 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: Deploying cephadm binary to smithi064 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: [26/Apr/2024:21:07:00] ENGINE Serving on http://172.21.15.64:8765 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: Deploying cephadm binary to smithi055 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: [26/Apr/2024:21:07:00] ENGINE Serving on https://172.21.15.64:7150 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: [26/Apr/2024:21:07:00] ENGINE Bus STARTED 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: mgrmap e22: smithi064.tchyje(active, since 1.01786s) 2024-04-26T21:07:02.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:01 smithi064 ceph-mon[33404]: pgmap v3: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:02.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: [26/Apr/2024:21:07:00] ENGINE Bus STARTING 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: Deploying cephadm binary to smithi064 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: [26/Apr/2024:21:07:00] ENGINE Serving on http://172.21.15.64:8765 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: Deploying cephadm binary to smithi055 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: [26/Apr/2024:21:07:00] ENGINE Serving on https://172.21.15.64:7150 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: [26/Apr/2024:21:07:00] ENGINE Bus STARTED 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: mgrmap e22: smithi064.tchyje(active, since 1.01786s) 2024-04-26T21:07:02.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:01 smithi055 ceph-mon[25475]: pgmap v3: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:03.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:02 smithi064 ceph-mon[33404]: pgmap v4: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:03.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:02 smithi064 ceph-mon[33404]: mgrmap e23: smithi064.tchyje(active, since 2s) 2024-04-26T21:07:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:02 smithi055 ceph-mon[25475]: pgmap v4: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:02 smithi055 ceph-mon[25475]: mgrmap e23: smithi064.tchyje(active, since 2s) 2024-04-26T21:07:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:04 smithi055 ceph-mon[25475]: pgmap v5: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:04 smithi055 ceph-mon[25475]: mgrmap e24: smithi064.tchyje(active, since 4s) 2024-04-26T21:07:05.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:04 smithi064 ceph-mon[33404]: pgmap v5: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:05.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:04 smithi064 ceph-mon[33404]: mgrmap e24: smithi064.tchyje(active, since 4s) 2024-04-26T21:07:07.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:06 smithi055 ceph-mon[25475]: pgmap v6: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:06 smithi064 ceph-mon[33404]: pgmap v6: 65 pgs: 65 active+clean; 85 MiB data, 489 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:07:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.874+0000 7fb5dc000700 1 -- 172.21.15.55:0/2578031682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 msgr2=0x7fb5d4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:08.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.874+0000 7fb5dc000700 1 --2- 172.21.15.55:0/2578031682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4103b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009870 tx=0x7fb5c8009b80 comp rx=0 tx=0).stop 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.875+0000 7fb5dc000700 1 -- 172.21.15.55:0/2578031682 shutdown_connections 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.875+0000 7fb5dc000700 1 --2- 172.21.15.55:0/2578031682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.875+0000 7fb5dc000700 1 --2- 172.21.15.55:0/2578031682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4103b10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.875+0000 7fb5dc000700 1 -- 172.21.15.55:0/2578031682 >> 172.21.15.55:0/2578031682 conn(0x7fb5d40fb110 msgr2=0x7fb5d40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.876+0000 7fb5dc000700 1 -- 172.21.15.55:0/2578031682 shutdown_connections 2024-04-26T21:07:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.876+0000 7fb5dc000700 1 -- 172.21.15.55:0/2578031682 wait complete. 2024-04-26T21:07:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 Processor -- start 2024-04-26T21:07:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 -- start start 2024-04-26T21:07:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4192e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d418f440 con 0x7fb5d4101720 2024-04-26T21:07:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.877+0000 7fb5dc000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d418f580 con 0x7fb5d4104050 2024-04-26T21:07:08.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.878+0000 7fb5d9600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:08.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.878+0000 7fb5d8c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4192e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:08.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.878+0000 7fb5d9600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51700/0 (socket says 172.21.15.55:51700) 2024-04-26T21:07:08.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.878+0000 7fb5d9600700 1 -- 172.21.15.55:0/3397074824 learned_addr learned my addr 172.21.15.55:0/3397074824 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d9600700 1 -- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 msgr2=0x7fb5d4192e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d9600700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4192e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d9600700 1 -- 172.21.15.55:0/3397074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009520 con 0x7fb5d4101720 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d8c00700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4192e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d9600700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009230 tx=0x7fb5c800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c801c070 con 0x7fb5d4101720 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5c800b4e0 con 0x7fb5d4101720 2024-04-26T21:07:08.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.879+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c8022de0 con 0x7fb5d4101720 2024-04-26T21:07:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.880+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d418f800 con 0x7fb5d4101720 2024-04-26T21:07:08.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.881+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d418fcc0 con 0x7fb5d4101720 2024-04-26T21:07:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.882+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 46705+0+0 (secure 0 0 0) 0x7fb5c8020070 con 0x7fb5d4101720 2024-04-26T21:07:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.883+0000 7fb5d2000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 0x7fb5bc03bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:08.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.883+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fb5c804edb0 con 0x7fb5d4101720 2024-04-26T21:07:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.883+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d40fcd00 con 0x7fb5d4101720 2024-04-26T21:07:08.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.884+0000 7fb5d8c00700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 0x7fb5bc03bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:08.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.885+0000 7fb5d8c00700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 0x7fb5bc03bd80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0005fd0 tx=0x7fb5c0009310 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:08.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:08.890+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fb5c8027070 con 0x7fb5d4101720 2024-04-26T21:07:08.988 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:08 smithi055 ceph-mon[25475]: pgmap v7: 65 pgs: 65 active+clean; 96 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 959 KiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-04-26T21:07:09.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:08 smithi064 ceph-mon[33404]: pgmap v7: 65 pgs: 65 active+clean; 96 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 959 KiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-04-26T21:07:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.209+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d41099f0 con 0x7fb5bc0398c0 2024-04-26T21:07:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.212+0000 7fb5d2000700 1 -- 172.21.15.55:0/3397074824 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb5d41099f0 con 0x7fb5bc0398c0 2024-04-26T21:07:09.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.215+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 msgr2=0x7fb5bc03bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.215+0000 7fb5dc000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 0x7fb5bc03bd80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0005fd0 tx=0x7fb5c0009310 comp rx=0 tx=0).stop 2024-04-26T21:07:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.215+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 msgr2=0x7fb5d4192920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.215+0000 7fb5dc000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009230 tx=0x7fb5c800f740 comp rx=0 tx=0).stop 2024-04-26T21:07:09.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.216+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 shutdown_connections 2024-04-26T21:07:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.216+0000 7fb5dc000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fb5bc0398c0 0x7fb5bc03bd80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.216+0000 7fb5dc000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5d4101720 0x7fb5d4192920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.216+0000 7fb5dc000700 1 --2- 172.21.15.55:0/3397074824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5d4104050 0x7fb5d4192e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.216+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 >> 172.21.15.55:0/3397074824 conn(0x7fb5d40fb110 msgr2=0x7fb5d4101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.217+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 shutdown_connections 2024-04-26T21:07:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.217+0000 7fb5dc000700 1 -- 172.21.15.55:0/3397074824 wait complete. 2024-04-26T21:07:09.240 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:07:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 -- 172.21.15.55:0/1075143323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 msgr2=0x7f88a4101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 --2- 172.21.15.55:0/1075143323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a4101030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8898009910 tx=0x7f8898009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:09.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 -- 172.21.15.55:0/1075143323 shutdown_connections 2024-04-26T21:07:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 --2- 172.21.15.55:0/1075143323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88a4101e10 0x7f88a4102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 --2- 172.21.15.55:0/1075143323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a4101030 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.393+0000 7f88ab600700 1 -- 172.21.15.55:0/1075143323 >> 172.21.15.55:0/1075143323 conn(0x7f88a40fc1f0 msgr2=0x7f88a40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:09.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.394+0000 7f88ab600700 1 -- 172.21.15.55:0/1075143323 shutdown_connections 2024-04-26T21:07:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.394+0000 7f88ab600700 1 -- 172.21.15.55:0/1075143323 wait complete. 2024-04-26T21:07:09.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.395+0000 7f88ab600700 1 Processor -- start 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.395+0000 7f88ab600700 1 -- start start 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.395+0000 7f88ab600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.395+0000 7f88ab600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88a4101e10 0x7f88a419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.396+0000 7f88ab600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a419d7d0 con 0x7f88a4100c10 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.396+0000 7f88ab600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a419d910 con 0x7f88a4101e10 2024-04-26T21:07:09.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.396+0000 7f88a8c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.396+0000 7f88a8c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51726/0 (socket says 172.21.15.55:51726) 2024-04-26T21:07:09.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.396+0000 7f88a8c00700 1 -- 172.21.15.55:0/3108744028 learned_addr learned my addr 172.21.15.55:0/3108744028 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:09.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.397+0000 7f88a8c00700 1 -- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88a4101e10 msgr2=0x7f88a419d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.397+0000 7f88a8c00700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88a4101e10 0x7f88a419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.397+0000 7f88a8c00700 1 -- 172.21.15.55:0/3108744028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980095f0 con 0x7f88a4100c10 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.397+0000 7f88a8c00700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f889800bd70 tx=0x7f889800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.398+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889801d070 con 0x7f88a4100c10 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.398+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8898005dc0 con 0x7f88a4100c10 2024-04-26T21:07:09.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.398+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a406aa40 con 0x7f88a4100c10 2024-04-26T21:07:09.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.398+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a406afb0 con 0x7f88a4100c10 2024-04-26T21:07:09.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.399+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889802b440 con 0x7f88a4100c10 2024-04-26T21:07:09.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.400+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4109680 con 0x7f88a4100c10 2024-04-26T21:07:09.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.401+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 46705+0+0 (secure 0 0 0) 0x7f889800f820 con 0x7f88a4100c10 2024-04-26T21:07:09.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.401+0000 7f88a1600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 0x7f888c03bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.402+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f88980142b0 con 0x7f88a4100c10 2024-04-26T21:07:09.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.402+0000 7f88a3e00700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 0x7f888c03bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:09.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.404+0000 7f88a3e00700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 0x7f888c03bd80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8890005950 tx=0x7f88900058e0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.411+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8898026030 con 0x7f88a4100c10 2024-04-26T21:07:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.779+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88a402ce50 con 0x7f888c0398c0 2024-04-26T21:07:09.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.782+0000 7f88a1600700 1 -- 172.21.15.55:0/3108744028 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f88a402ce50 con 0x7f888c0398c0 2024-04-26T21:07:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 msgr2=0x7f888c03bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 0x7f888c03bd80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8890005950 tx=0x7f88900058e0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 msgr2=0x7f88a419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f889800bd70 tx=0x7f889800be50 comp rx=0 tx=0).stop 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 shutdown_connections 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f888c0398c0 0x7f888c03bd80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4100c10 0x7f88a419cc70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 --2- 172.21.15.55:0/3108744028 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88a4101e10 0x7f88a419d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 >> 172.21.15.55:0/3108744028 conn(0x7f88a40fc1f0 msgr2=0x7f88a4105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.785+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 shutdown_connections 2024-04-26T21:07:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.786+0000 7f88ab600700 1 -- 172.21.15.55:0/3108744028 wait complete. 2024-04-26T21:07:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.980+0000 7fc855000700 1 -- 172.21.15.55:0/2620670322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850101e10 msgr2=0x7fc850102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.980+0000 7fc855000700 1 --2- 172.21.15.55:0/2620670322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850101e10 0x7fc850102270 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009910 tx=0x7fc83c009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.981+0000 7fc855000700 1 -- 172.21.15.55:0/2620670322 shutdown_connections 2024-04-26T21:07:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.981+0000 7fc855000700 1 --2- 172.21.15.55:0/2620670322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850101e10 0x7fc850102270 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.981+0000 7fc855000700 1 --2- 172.21.15.55:0/2620670322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850100c10 0x7fc850101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.981+0000 7fc855000700 1 -- 172.21.15.55:0/2620670322 >> 172.21.15.55:0/2620670322 conn(0x7fc8500fc1f0 msgr2=0x7fc8500fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:09.984 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:09 smithi055 ceph-mon[25475]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:09.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.982+0000 7fc855000700 1 -- 172.21.15.55:0/2620670322 shutdown_connections 2024-04-26T21:07:09.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.982+0000 7fc855000700 1 -- 172.21.15.55:0/2620670322 wait complete. 2024-04-26T21:07:09.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.983+0000 7fc855000700 1 Processor -- start 2024-04-26T21:07:09.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc855000700 1 -- start start 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc855000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc855000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850101e10 0x7fc8500732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc855000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc850073810 con 0x7fc850100c10 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc855000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc850073950 con 0x7fc850101e10 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc84de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc84de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51748/0 (socket says 172.21.15.55:51748) 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc84de00700 1 -- 172.21.15.55:0/3056720794 learned_addr learned my addr 172.21.15.55:0/3056720794 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.984+0000 7fc84d400700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850101e10 0x7fc8500732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.985+0000 7fc84de00700 1 -- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850101e10 msgr2=0x7fc8500732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.985+0000 7fc84de00700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850101e10 0x7fc8500732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.985+0000 7fc84de00700 1 -- 172.21.15.55:0/3056720794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0095f0 con 0x7fc850100c10 2024-04-26T21:07:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.985+0000 7fc84de00700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc84000d900 tx=0x7fc84000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.986+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8400041f0 con 0x7fc850100c10 2024-04-26T21:07:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.987+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc840004350 con 0x7fc850100c10 2024-04-26T21:07:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.987+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc840003cf0 con 0x7fc850100c10 2024-04-26T21:07:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.987+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc850073c30 con 0x7fc850100c10 2024-04-26T21:07:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.988+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85019e660 con 0x7fc850100c10 2024-04-26T21:07:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.988+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 46705+0+0 (secure 0 0 0) 0x7fc840009730 con 0x7fc850100c10 2024-04-26T21:07:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.989+0000 7fc846a00700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 0x7fc83403bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.989+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850190790 con 0x7fc850100c10 2024-04-26T21:07:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.989+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fc84004cf30 con 0x7fc850100c10 2024-04-26T21:07:09.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.989+0000 7fc84d400700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 0x7fc83403bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:09.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.990+0000 7fc84d400700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 0x7fc83403bdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006010 tx=0x7fc83c005180 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:09.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:09.995+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fc840052060 con 0x7fc850100c10 2024-04-26T21:07:10.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:09 smithi064 ceph-mon[33404]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.402+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc85002ce50 con 0x7fc834039910 2024-04-26T21:07:10.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.442+0000 7fc846a00700 1 -- 172.21.15.55:0/3056720794 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc85002ce50 con 0x7fc834039910 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (8m) 2m ago 10m 13.3M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (11m) 2m ago 11m 7541k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (9m) 18s ago 9m 7662k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (10m) 2m ago 10m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (9m) 18s ago 9m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (8m) 2m ago 10m 73.0M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (3m) 2m ago 3m 14.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (2m) 2m ago 2m 11.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (3m) 18s ago 3m 46.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:07:10.444 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (2m) 18s ago 2m 12.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:9283,8765,8443 running (12m) 2m ago 12m 499M - 18.2.2-1258-g7d2137f0 79c5878083fb 89ad350ca25b 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (23s) 18s ago 9m 57.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a10bf33fff03 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (12m) 2m ago 12m 44.3M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (9m) 18s ago 9m 35.3M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (10m) 2m ago 10m 7986k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (9m) 18s ago 9m 7834k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (8m) 2m ago 8m 53.2M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (7m) 2m ago 7m 53.1M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (6m) 2m ago 6m 50.9M 3948M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (6m) 18s ago 6m 77.9M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (5m) 18s ago 5m 80.0M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (4m) 18s ago 4m 71.1M 4971M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:07:10.445 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (8m) 2m ago 9m 50.3M - 2.43.0 a07b618ecd1d cf3fa4166949 2024-04-26T21:07:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 msgr2=0x7fc83403bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 0x7fc83403bdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006010 tx=0x7fc83c005180 comp rx=0 tx=0).stop 2024-04-26T21:07:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 msgr2=0x7fc850074be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc84000d900 tx=0x7fc84000dc10 comp rx=0 tx=0).stop 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 shutdown_connections 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fc834039910 0x7fc83403bdd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850100c10 0x7fc850074be0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 --2- 172.21.15.55:0/3056720794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc850101e10 0x7fc8500732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.446+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 >> 172.21.15.55:0/3056720794 conn(0x7fc8500fc1f0 msgr2=0x7fc850105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.447+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 shutdown_connections 2024-04-26T21:07:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.447+0000 7fc855000700 1 -- 172.21.15.55:0/3056720794 wait complete. 2024-04-26T21:07:10.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 -- 172.21.15.55:0/82048698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0076ae0 msgr2=0x7f1cd0076f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 --2- 172.21.15.55:0/82048698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0076ae0 0x7f1cd0076f60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc009b80 comp rx=0 tx=0).stop 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 -- 172.21.15.55:0/82048698 shutdown_connections 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 --2- 172.21.15.55:0/82048698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0076ae0 0x7f1cd0076f60 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc009b80 comp rx=0 tx=0).stop 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 --2- 172.21.15.55:0/82048698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd0075890 0x7f1cd0075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.623+0000 7f1cd6400700 1 -- 172.21.15.55:0/82048698 >> 172.21.15.55:0/82048698 conn(0x7f1cd00fe3e0 msgr2=0x7f1cd0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.624+0000 7f1cd6400700 1 -- 172.21.15.55:0/82048698 shutdown_connections 2024-04-26T21:07:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.624+0000 7f1cd6400700 1 -- 172.21.15.55:0/82048698 wait complete. 2024-04-26T21:07:10.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 Processor -- start 2024-04-26T21:07:10.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 -- start start 2024-04-26T21:07:10.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd019d450 0x7f1cd01a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd019d960 con 0x7f1cd0075890 2024-04-26T21:07:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.626+0000 7f1cd6400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd019dad0 con 0x7f1cd019d450 2024-04-26T21:07:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51768/0 (socket says 172.21.15.55:51768) 2024-04-26T21:07:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccf400700 1 -- 172.21.15.55:0/3138039827 learned_addr learned my addr 172.21.15.55:0/3138039827 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccea00700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd019d450 0x7f1cd01a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccf400700 1 -- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd019d450 msgr2=0x7f1cd01a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.627+0000 7f1ccf400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd019d450 0x7f1cd01a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1ccf400700 1 -- 172.21.15.55:0/3138039827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009520 con 0x7f1cd0075890 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1ccf400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000e940 tx=0x7f1cc000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cc000eee0 con 0x7f1cd0075890 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cc0004cf0 con 0x7f1cd0075890 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cc0005650 con 0x7f1cd0075890 2024-04-26T21:07:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.628+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd01a2950 con 0x7f1cd0075890 2024-04-26T21:07:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.630+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 46705+0+0 (secure 0 0 0) 0x7f1cc0004830 con 0x7f1cd0075890 2024-04-26T21:07:10.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.630+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd01a2ed0 con 0x7f1cd0075890 2024-04-26T21:07:10.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.631+0000 7f1cc7e00700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 0x7f1cb403be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:10.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.631+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f1cc0014070 con 0x7f1cd0075890 2024-04-26T21:07:10.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.632+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd0196db0 con 0x7f1cd0075890 2024-04-26T21:07:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.633+0000 7f1ccea00700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 0x7f1cb403be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.635+0000 7f1ccea00700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 0x7f1cb403be20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009230 tx=0x7f1cbc019040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:10.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:10.639+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f1cc0010430 con 0x7f1cd0075890 2024-04-26T21:07:11.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:10 smithi055 ceph-mon[25475]: pgmap v8: 65 pgs: 65 active+clean; 96 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 746 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-04-26T21:07:11.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:10 smithi055 ceph-mon[25475]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:11.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:10 smithi064 ceph-mon[33404]: pgmap v8: 65 pgs: 65 active+clean; 96 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 746 KiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-04-26T21:07:11.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:10 smithi064 ceph-mon[33404]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.166+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1cd010fdc0 con 0x7f1cd0075890 2024-04-26T21:07:11.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.168+0000 7f1cc7e00700 1 -- 172.21.15.55:0/3138039827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f1cc001e2b0 con 0x7f1cd0075890 2024-04-26T21:07:11.169 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:07:11.169 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:07:11.169 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:07:11.169 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:07:11.170 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 msgr2=0x7f1cb403be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 0x7f1cb403be20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009230 tx=0x7f1cbc019040 comp rx=0 tx=0).stop 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 msgr2=0x7f1cd019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000e940 tx=0x7f1cc000ed00 comp rx=0 tx=0).stop 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 shutdown_connections 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f1cb4039960 0x7f1cb403be20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd0075890 0x7f1cd019cf10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 --2- 172.21.15.55:0/3138039827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cd019d450 0x7f1cd01a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.171+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 >> 172.21.15.55:0/3138039827 conn(0x7f1cd00fe3e0 msgr2=0x7f1cd010d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.172+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 shutdown_connections 2024-04-26T21:07:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.172+0000 7f1cd6400700 1 -- 172.21.15.55:0/3138039827 wait complete. 2024-04-26T21:07:11.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.390+0000 7f6cefa00700 1 -- 172.21.15.55:0/3345507753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8104090 msgr2=0x7f6ce8106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.390+0000 7f6cefa00700 1 --2- 172.21.15.55:0/3345507753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8104090 0x7f6ce8106480 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009910 tx=0x7f6cd4009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:11.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.391+0000 7f6cefa00700 1 -- 172.21.15.55:0/3345507753 shutdown_connections 2024-04-26T21:07:11.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.391+0000 7f6cefa00700 1 --2- 172.21.15.55:0/3345507753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8104090 0x7f6ce8106480 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.391+0000 7f6cefa00700 1 --2- 172.21.15.55:0/3345507753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8101760 0x7f6ce8103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.391+0000 7f6cefa00700 1 -- 172.21.15.55:0/3345507753 >> 172.21.15.55:0/3345507753 conn(0x7f6ce80fb110 msgr2=0x7f6ce80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:11.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.391+0000 7f6cefa00700 1 -- 172.21.15.55:0/3345507753 shutdown_connections 2024-04-26T21:07:11.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.392+0000 7f6cefa00700 1 -- 172.21.15.55:0/3345507753 wait complete. 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 Processor -- start 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 -- start start 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8104090 0x7f6ce80ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ffc50 con 0x7f6ce8101760 2024-04-26T21:07:11.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.393+0000 7f6cefa00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ffd90 con 0x7f6ce8104090 2024-04-26T21:07:11.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:11.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51792/0 (socket says 172.21.15.55:51792) 2024-04-26T21:07:11.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 -- 172.21.15.55:0/2362953567 learned_addr learned my addr 172.21.15.55:0/2362953567 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:11.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ce7e00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8104090 0x7f6ce80ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:11.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 -- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8104090 msgr2=0x7f6ce80ff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8104090 0x7f6ce80ff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.394+0000 7f6ced000700 1 -- 172.21.15.55:0/2362953567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40095f0 con 0x7f6ce8101760 2024-04-26T21:07:11.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6ced000700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00e940 tx=0x7f6cdc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:11.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cdc0097b0 con 0x7f6ce8101760 2024-04-26T21:07:11.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cdc004cf0 con 0x7f6ce8101760 2024-04-26T21:07:11.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cdc005700 con 0x7f6ce8101760 2024-04-26T21:07:11.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce8100070 con 0x7f6ce8101760 2024-04-26T21:07:11.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.395+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce8100570 con 0x7f6ce8101760 2024-04-26T21:07:11.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.397+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce804ebb0 con 0x7f6ce8101760 2024-04-26T21:07:11.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.397+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 24) v1 ==== 46705+0+0 (secure 0 0 0) 0x7f6cdc004750 con 0x7f6ce8101760 2024-04-26T21:07:11.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.397+0000 7f6ce5600700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 0x7f6cd003bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:11.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.397+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f6cdc014070 con 0x7f6ce8101760 2024-04-26T21:07:11.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.398+0000 7f6ce7e00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 0x7f6cd003bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:11.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.399+0000 7f6ce7e00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 0x7f6cd003bd80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4006010 tx=0x7f6cd4009f70 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:11.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.408+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f6cdc01f340 con 0x7f6ce8101760 2024-04-26T21:07:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.764+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ce8104a70 con 0x7f6cd00398c0 2024-04-26T21:07:11.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.766+0000 7f6ce5600700 1 -- 172.21.15.55:0/2362953567 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6ce8104a70 con 0x7f6cd00398c0 2024-04-26T21:07:11.768 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:07:11.768 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [], 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "1/2 daemons upgraded", 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:07:11.769 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:07:11.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.770+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 msgr2=0x7f6cd003bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.770+0000 7f6cefa00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 0x7f6cd003bd80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4006010 tx=0x7f6cd4009f70 comp rx=0 tx=0).stop 2024-04-26T21:07:11.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.770+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 msgr2=0x7f6ce8101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:11.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.770+0000 7f6cefa00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00e940 tx=0x7f6cdc00ed00 comp rx=0 tx=0).stop 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 shutdown_connections 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6cd00398c0 0x7f6cd003bd80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ce8101760 0x7f6ce8101070 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 --2- 172.21.15.55:0/2362953567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ce8104090 0x7f6ce80ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 >> 172.21.15.55:0/2362953567 conn(0x7f6ce80fb110 msgr2=0x7f6ce80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 shutdown_connections 2024-04-26T21:07:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:11.771+0000 7f6cefa00700 1 -- 172.21.15.55:0/2362953567 wait complete. 2024-04-26T21:07:12.154 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:11 smithi055 ceph-mon[25475]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:12.154 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:11 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3138039827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:07:12.154 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:11 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:12.154 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:11 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:12.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:11 smithi064 ceph-mon[33404]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:12.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:11 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3138039827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:07:12.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:11 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:12.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:11 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: pgmap v9: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 409 op/s 2024-04-26T21:07:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: Standby manager daemon smithi055.ybbowr started 2024-04-26T21:07:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/crt"}]: dispatch 2024-04-26T21:07:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:07:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/key"}]: dispatch 2024-04-26T21:07:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:12 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: pgmap v9: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 409 op/s 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: Standby manager daemon smithi055.ybbowr started 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/crt"}]: dispatch 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/key"}]: dispatch 2024-04-26T21:07:13.235 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:12 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2618467875' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:07:14.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:13 smithi064 ceph-mon[33404]: mgrmap e25: smithi064.tchyje(active, since 13s), standbys: smithi055.ybbowr 2024-04-26T21:07:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:13 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:07:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:13 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:13 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:13 smithi055 ceph-mon[25475]: mgrmap e25: smithi064.tchyje(active, since 13s), standbys: smithi055.ybbowr 2024-04-26T21:07:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:13 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:07:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:13 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:14.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:13 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:14 smithi064 ceph-mon[33404]: pgmap v10: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 375 op/s 2024-04-26T21:07:15.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:14 smithi055 ceph-mon[25475]: pgmap v10: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 375 op/s 2024-04-26T21:07:15.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:15 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:16.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:15 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:16 smithi064 ceph-mon[33404]: pgmap v11: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 375 op/s 2024-04-26T21:07:17.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:16 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:17.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:16 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:16 smithi055 ceph-mon[25475]: pgmap v11: 65 pgs: 65 active+clean; 123 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 375 op/s 2024-04-26T21:07:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:16 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:16 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: pgmap v12: 65 pgs: 65 active+clean; 131 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 381 op/s 2024-04-26T21:07:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:18 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: pgmap v12: 65 pgs: 65 active+clean; 131 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 381 op/s 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:18 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi055 to 1218M 2024-04-26T21:07:20.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:20.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:19 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:20.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi055 to 1218M 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:19 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: Adjusting osd_memory_target on smithi064 to 2240M 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: pgmap v13: 65 pgs: 65 active+clean; 131 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 301 op/s 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:07:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:20 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:07:21.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: Adjusting osd_memory_target on smithi064 to 2240M 2024-04-26T21:07:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:07:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:07:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: pgmap v13: 65 pgs: 65 active+clean; 131 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 301 op/s 2024-04-26T21:07:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:07:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:20 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:07:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:21 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:07:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:21 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:07:22.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:21 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:07:22.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:21 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:07:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:07:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:07:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: pgmap v14: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 436 op/s 2024-04-26T21:07:23.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:23 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: pgmap v14: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 436 op/s 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:23 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:24.477 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:24 smithi055 ceph-mon[25475]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T21:07:24.478 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:24 smithi055 ceph-mon[25475]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T21:07:24.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:24 smithi064 ceph-mon[33404]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T21:07:24.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:24 smithi064 ceph-mon[33404]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T21:07:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:25 smithi055 ceph-mon[25475]: pgmap v15: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T21:07:25.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:25 smithi064 ceph-mon[33404]: pgmap v15: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T21:07:27.459 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:27 smithi055 ceph-mon[25475]: pgmap v16: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T21:07:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:27 smithi064 ceph-mon[33404]: pgmap v16: 65 pgs: 65 active+clean; 148 MiB data, 700 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 141 op/s 2024-04-26T21:07:29.498 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:29 smithi055 ceph-mon[25475]: pgmap v17: 65 pgs: 65 active+clean; 165 MiB data, 768 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 214 op/s 2024-04-26T21:07:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:29 smithi064 ceph-mon[33404]: pgmap v17: 65 pgs: 65 active+clean; 165 MiB data, 768 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 214 op/s 2024-04-26T21:07:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:30 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:30.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:30 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:31 smithi064 ceph-mon[33404]: pgmap v18: 65 pgs: 65 active+clean; 165 MiB data, 768 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 207 op/s 2024-04-26T21:07:31.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:31 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:31.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:31 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:31.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:31 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:07:31.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:31 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:31 smithi055 ceph-mon[25475]: pgmap v18: 65 pgs: 65 active+clean; 165 MiB data, 768 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 207 op/s 2024-04-26T21:07:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:31 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:31 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:31 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:07:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:31 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:32.332 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:32 smithi055 ceph-mon[25475]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:07:32.333 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:32 smithi055 ceph-mon[25475]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:07:32.333 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:32 smithi055 ceph-mon[25475]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:07:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:32 smithi064 ceph-mon[33404]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:07:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:32 smithi064 ceph-mon[33404]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:07:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:32 smithi064 ceph-mon[33404]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:07:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:33 smithi064 ceph-mon[33404]: pgmap v19: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 481 op/s 2024-04-26T21:07:33.722 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:33 smithi055 ceph-mon[25475]: pgmap v19: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 481 op/s 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: pgmap v20: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 346 op/s 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: Upgrade: Updating mgr.smithi055.ybbowr 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:34.960 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:34 smithi055 ceph-mon[25475]: Deploying daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T21:07:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: pgmap v20: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 346 op/s 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: Upgrade: Updating mgr.smithi055.ybbowr 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:34 smithi064 ceph-mon[33404]: Deploying daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T21:07:36.844 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:36 smithi055 ceph-mon[25475]: pgmap v21: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 346 op/s 2024-04-26T21:07:37.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:36 smithi064 ceph-mon[33404]: pgmap v21: 65 pgs: 65 active+clean; 181 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 346 op/s 2024-04-26T21:07:39.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:38 smithi055 ceph-mon[25475]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 917 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 466 op/s 2024-04-26T21:07:39.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:38 smithi064 ceph-mon[33404]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 917 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 466 op/s 2024-04-26T21:07:40.237 INFO:tasks.workunit.client.0.smithi055.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T21:07:40.245 INFO:tasks.workunit.client.0.smithi055.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:07:40.245 INFO:tasks.workunit.client.0.smithi055.stderr:+ make 2024-04-26T21:07:40.906 INFO:tasks.workunit.client.0.smithi055.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T21:07:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:40 smithi064 ceph-mon[33404]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 917 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-04-26T21:07:41.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:40 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:41.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:40 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:41.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:40 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:41.250 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:40 smithi055 ceph-mon[25475]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 917 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-04-26T21:07:41.250 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:40 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:41.250 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:40 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:41.250 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:40 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:42.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 -- 172.21.15.55:0/3738659108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34108420 msgr2=0x7f2f341088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3738659108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34108420 0x7f2f341088a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009910 tx=0x7f2f20009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 -- 172.21.15.55:0/3738659108 shutdown_connections 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3738659108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34108420 0x7f2f341088a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3738659108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34072c30 0x7f2f34107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 -- 172.21.15.55:0/3738659108 >> 172.21.15.55:0/3738659108 conn(0x7f2f3406dca0 msgr2=0x7f2f340700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 -- 172.21.15.55:0/3738659108 shutdown_connections 2024-04-26T21:07:42.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.036+0000 7f2f33e00700 1 -- 172.21.15.55:0/3738659108 wait complete. 2024-04-26T21:07:42.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.039+0000 7f2f33e00700 1 Processor -- start 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.039+0000 7f2f33e00700 1 -- start start 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.040+0000 7f2f33e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34072c30 0x7f2f341a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f33e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f33e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341a1790 con 0x7f2f34108420 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f33e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341a18d0 con 0x7f2f34072c30 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f32000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f32000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35824/0 (socket says 172.21.15.55:35824) 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f32000700 1 -- 172.21.15.55:0/3411274074 learned_addr learned my addr 172.21.15.55:0/3411274074 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.041+0000 7f2f32a00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34072c30 0x7f2f341a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.042+0000 7f2f32000700 1 -- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34072c30 msgr2=0x7f2f341a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.042+0000 7f2f32000700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34072c30 0x7f2f341a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.042+0000 7f2f32000700 1 -- 172.21.15.55:0/3411274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200095f0 con 0x7f2f34108420 2024-04-26T21:07:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.043+0000 7f2f32000700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000be00 tx=0x7f2f2000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.045+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2001d070 con 0x7f2f34108420 2024-04-26T21:07:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.045+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f20022470 con 0x7f2f34108420 2024-04-26T21:07:42.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.045+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2000f690 con 0x7f2f34108420 2024-04-26T21:07:42.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.047+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f341a62d0 con 0x7f2f34108420 2024-04-26T21:07:42.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.047+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f341a6810 con 0x7f2f34108420 2024-04-26T21:07:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.049+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3419aff0 con 0x7f2f34108420 2024-04-26T21:07:42.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.053+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 91830+0+0 (secure 0 0 0) 0x7f2f20004be0 con 0x7f2f34108420 2024-04-26T21:07:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.054+0000 7f2f2b400700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 0x7f2f18070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.054+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f2f2008f3a0 con 0x7f2f34108420 2024-04-26T21:07:42.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.055+0000 7f2f32a00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 0x7f2f18070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.056+0000 7f2f32a00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 0x7f2f18070220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c005950 tx=0x7f2f2c0058e0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:42.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.057+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f2f2005c200 con 0x7f2f34108420 2024-04-26T21:07:42.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.401+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3402ceb0 con 0x7f2f1806dd60 2024-04-26T21:07:42.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.405+0000 7f2f2b400700 1 -- 172.21.15.55:0/3411274074 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f2f3402ceb0 con 0x7f2f1806dd60 2024-04-26T21:07:42.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.407+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 msgr2=0x7f2f18070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.407+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 0x7f2f18070220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c005950 tx=0x7f2f2c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.407+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 msgr2=0x7f2f341a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.407+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000be00 tx=0x7f2f2000bee0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 shutdown_connections 2024-04-26T21:07:42.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f2f1806dd60 0x7f2f18070220 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f34072c30 0x7f2f341a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 --2- 172.21.15.55:0/3411274074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f34108420 0x7f2f341a1170 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 >> 172.21.15.55:0/3411274074 conn(0x7f2f3406dca0 msgr2=0x7f2f3410dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:42.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 shutdown_connections 2024-04-26T21:07:42.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.408+0000 7f2f33e00700 1 -- 172.21.15.55:0/3411274074 wait complete. 2024-04-26T21:07:42.426 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 -- 172.21.15.55:0/3457778095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 msgr2=0x7fd944102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 --2- 172.21.15.55:0/3457778095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944102270 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd930009910 tx=0x7fd930009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 -- 172.21.15.55:0/3457778095 shutdown_connections 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 --2- 172.21.15.55:0/3457778095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944102270 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 --2- 172.21.15.55:0/3457778095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 -- 172.21.15.55:0/3457778095 >> 172.21.15.55:0/3457778095 conn(0x7fd9440fc1f0 msgr2=0x7fd9440fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:42.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 -- 172.21.15.55:0/3457778095 shutdown_connections 2024-04-26T21:07:42.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.572+0000 7fd94a000700 1 -- 172.21.15.55:0/3457778095 wait complete. 2024-04-26T21:07:42.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 Processor -- start 2024-04-26T21:07:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 -- start start 2024-04-26T21:07:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944194430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944194f90 con 0x7fd944101e10 2024-04-26T21:07:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd94a000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9441950d0 con 0x7fd944100c10 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.574+0000 7fd942a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35842/0 (socket says 172.21.15.55:35842) 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 -- 172.21.15.55:0/2710480752 learned_addr learned my addr 172.21.15.55:0/2710480752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd943400700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944194430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 -- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 msgr2=0x7fd944194430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944194430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 -- 172.21.15.55:0/2710480752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9300095f0 con 0x7fd944101e10 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd943400700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944194430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:07:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.575+0000 7fd942a00700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd93000bd70 tx=0x7fd93000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.576+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93001d070 con 0x7fd944101e10 2024-04-26T21:07:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.576+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd930005dc0 con 0x7fd944101e10 2024-04-26T21:07:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.576+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd930021410 con 0x7fd944101e10 2024-04-26T21:07:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.576+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd944199a80 con 0x7fd944101e10 2024-04-26T21:07:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.576+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd944199ff0 con 0x7fd944101e10 2024-04-26T21:07:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.578+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9441067e0 con 0x7fd944101e10 2024-04-26T21:07:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.580+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 91830+0+0 (secure 0 0 0) 0x7fd93000f820 con 0x7fd944101e10 2024-04-26T21:07:42.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.581+0000 7fd93be00700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 0x7fd928070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:42.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.581+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fd93008ea10 con 0x7fd944101e10 2024-04-26T21:07:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.581+0000 7fd943400700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 0x7fd928070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:42.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.583+0000 7fd943400700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 0x7fd928070100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd934005fd0 tx=0x7fd934005f00 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:42.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:42.588+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fd93005b740 con 0x7fd944101e10 2024-04-26T21:07:43.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.010+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd94402ceb0 con 0x7fd92806dc40 2024-04-26T21:07:43.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.012+0000 7fd93be00700 1 -- 172.21.15.55:0/2710480752 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fd94402ceb0 con 0x7fd92806dc40 2024-04-26T21:07:43.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.015+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 msgr2=0x7fd928070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.015+0000 7fd94a000700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 0x7fd928070100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd934005fd0 tx=0x7fd934005f00 comp rx=0 tx=0).stop 2024-04-26T21:07:43.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.015+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 msgr2=0x7fd944194970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.015+0000 7fd94a000700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd93000bd70 tx=0x7fd93000be50 comp rx=0 tx=0).stop 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 shutdown_connections 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fd92806dc40 0x7fd928070100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd944100c10 0x7fd944194430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 --2- 172.21.15.55:0/2710480752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd944101e10 0x7fd944194970 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 >> 172.21.15.55:0/2710480752 conn(0x7fd9440fc1f0 msgr2=0x7fd944073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:43.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 shutdown_connections 2024-04-26T21:07:43.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.016+0000 7fd94a000700 1 -- 172.21.15.55:0/2710480752 wait complete. 2024-04-26T21:07:43.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.240+0000 7f6e63200700 1 -- 172.21.15.55:0/355895763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 msgr2=0x7f6e5c0732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.240+0000 7f6e63200700 1 --2- 172.21.15.55:0/355895763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c0732f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009910 tx=0x7f6e4c009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 -- 172.21.15.55:0/355895763 shutdown_connections 2024-04-26T21:07:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 --2- 172.21.15.55:0/355895763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 0x7f6e5c073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 --2- 172.21.15.55:0/355895763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c0732f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 -- 172.21.15.55:0/355895763 >> 172.21.15.55:0/355895763 conn(0x7f6e5c0fc1f0 msgr2=0x7f6e5c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:43.243 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:42 smithi055 ceph-mon[25475]: pgmap v24: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-04-26T21:07:43.243 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:42 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:43.243 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:42 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:43.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 -- 172.21.15.55:0/355895763 shutdown_connections 2024-04-26T21:07:43.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.241+0000 7f6e63200700 1 -- 172.21.15.55:0/355895763 wait complete. 2024-04-26T21:07:43.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.242+0000 7f6e63200700 1 Processor -- start 2024-04-26T21:07:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.242+0000 7f6e63200700 1 -- start start 2024-04-26T21:07:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e63200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 0x7f6e5c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e63200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e63200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c199370 con 0x7f6e5c074e90 2024-04-26T21:07:43.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e63200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c1994b0 con 0x7f6e5c0738c0 2024-04-26T21:07:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e5b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e5b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35852/0 (socket says 172.21.15.55:35852) 2024-04-26T21:07:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.243+0000 7f6e5b400700 1 -- 172.21.15.55:0/2342878204 learned_addr learned my addr 172.21.15.55:0/2342878204 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:43.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.244+0000 7f6e5be00700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 0x7f6e5c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.244+0000 7f6e5b400700 1 -- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 msgr2=0x7f6e5c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.244+0000 7f6e5b400700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 0x7f6e5c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.244+0000 7f6e5b400700 1 -- 172.21.15.55:0/2342878204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0095f0 con 0x7f6e5c074e90 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.244+0000 7f6e5b400700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800c8a0 tx=0x7f6e4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.245+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4800cea0 con 0x7f6e5c074e90 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.245+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e48004830 con 0x7f6e5c074e90 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.245+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c19dec0 con 0x7f6e5c074e90 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.245+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e480055b0 con 0x7f6e5c074e90 2024-04-26T21:07:43.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.245+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c19e460 con 0x7f6e5c074e90 2024-04-26T21:07:43.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.246+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c192980 con 0x7f6e5c074e90 2024-04-26T21:07:43.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.248+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 91830+0+0 (secure 0 0 0) 0x7f6e480049a0 con 0x7f6e5c074e90 2024-04-26T21:07:43.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.249+0000 7f6e58c00700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 0x7f6e40070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.249+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f6e4808d460 con 0x7f6e5c074e90 2024-04-26T21:07:43.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.250+0000 7f6e5be00700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 0x7f6e40070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.251+0000 7f6e5be00700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 0x7f6e40070150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0051c0 tx=0x7f6e4c00b540 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:43.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.257+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f6e4805a190 con 0x7f6e5c074e90 2024-04-26T21:07:43.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:42 smithi064 ceph-mon[33404]: pgmap v24: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-04-26T21:07:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:42 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:42 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:07:43.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.536+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e5c02ce80 con 0x7f6e4006dc90 2024-04-26T21:07:43.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.569+0000 7f6e58c00700 1 -- 172.21.15.55:0/2342878204 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6e5c02ce80 con 0x7f6e4006dc90 2024-04-26T21:07:43.571 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:07:43.571 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (9m) 26s ago 11m 13.5M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:07:43.571 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (11m) 26s ago 11m 7843k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:07:43.571 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (10m) 31s ago 10m 7688k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (11m) 26s ago 11m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (9m) 31s ago 9m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (8m) 26s ago 10m 75.2M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (3m) 26s ago 3m 107M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (3m) 26s ago 3m 13.4M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (3m) 31s ago 3m 66.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (3m) 31s ago 3m 13.4M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 starting - - - - 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (56s) 31s ago 9m 491M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a10bf33fff03 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (13m) 26s ago 13m 49.8M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (9m) 31s ago 9m 39.0M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (11m) 26s ago 11m 8036k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (9m) 31s ago 9m 8078k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:07:43.572 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (8m) 26s ago 8m 103M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (7m) 26s ago 7m 109M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (7m) 26s ago 7m 91.5M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (6m) 31s ago 6m 105M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (6m) 31s ago 6m 98.9M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (5m) 31s ago 5m 94.1M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:07:43.573 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 starting - - - - 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 msgr2=0x7f6e40070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 0x7f6e40070150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0051c0 tx=0x7f6e4c00b540 comp rx=0 tx=0).stop 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 msgr2=0x7f6e5c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800c8a0 tx=0x7f6e4800cc60 comp rx=0 tx=0).stop 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 shutdown_connections 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f6e4006dc90 0x7f6e40070150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c0738c0 0x7f6e5c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 --2- 172.21.15.55:0/2342878204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e5c074e90 0x7f6e5c198d50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 >> 172.21.15.55:0/2342878204 conn(0x7f6e5c0fc1f0 msgr2=0x7f6e5c106e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 shutdown_connections 2024-04-26T21:07:43.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.572+0000 7f6e63200700 1 -- 172.21.15.55:0/2342878204 wait complete. 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 -- 172.21.15.55:0/1303356677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 msgr2=0x7fdad8104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 --2- 172.21.15.55:0/1303356677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad8104310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009910 tx=0x7fdac4009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 -- 172.21.15.55:0/1303356677 shutdown_connections 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 --2- 172.21.15.55:0/1303356677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad8104310 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 --2- 172.21.15.55:0/1303356677 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 0x7fdad8101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 -- 172.21.15.55:0/1303356677 >> 172.21.15.55:0/1303356677 conn(0x7fdad80fb110 msgr2=0x7fdad80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 -- 172.21.15.55:0/1303356677 shutdown_connections 2024-04-26T21:07:43.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.736+0000 7fdadd600700 1 -- 172.21.15.55:0/1303356677 wait complete. 2024-04-26T21:07:43.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 Processor -- start 2024-04-26T21:07:43.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 -- start start 2024-04-26T21:07:43.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 0x7fdad819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad819d760 con 0x7fdad8101e80 2024-04-26T21:07:43.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.738+0000 7fdadd600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad819d8d0 con 0x7fdad80ff510 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.739+0000 7fdad6000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.739+0000 7fdad6000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35864/0 (socket says 172.21.15.55:35864) 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.739+0000 7fdad6000700 1 -- 172.21.15.55:0/2367515859 learned_addr learned my addr 172.21.15.55:0/2367515859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.740+0000 7fdad6a00700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 0x7fdad819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.740+0000 7fdad6000700 1 -- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 msgr2=0x7fdad819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.740+0000 7fdad6000700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 0x7fdad819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:43.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.740+0000 7fdad6000700 1 -- 172.21.15.55:0/2367515859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40095f0 con 0x7fdad8101e80 2024-04-26T21:07:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.740+0000 7fdad6000700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdac400bd70 tx=0x7fdac400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.741+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac401d070 con 0x7fdad8101e80 2024-04-26T21:07:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.741+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdac400f460 con 0x7fdad8101e80 2024-04-26T21:07:43.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.741+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac4021640 con 0x7fdad8101e80 2024-04-26T21:07:43.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.741+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad81a2270 con 0x7fdad8101e80 2024-04-26T21:07:43.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.741+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad81a2700 con 0x7fdad8101e80 2024-04-26T21:07:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.745+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad804ebb0 con 0x7fdad8101e80 2024-04-26T21:07:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.745+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 91830+0+0 (secure 0 0 0) 0x7fdac402b440 con 0x7fdad8101e80 2024-04-26T21:07:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.747+0000 7fdacf400700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 0x7fdabc070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.747+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fdac408ee60 con 0x7fdad8101e80 2024-04-26T21:07:43.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.748+0000 7fdad6a00700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 0x7fdabc070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.749+0000 7fdad6a00700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 0x7fdabc070140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005ea0 tx=0x7fdac8005e30 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:43.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:43.752+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fdac4058df0 con 0x7fdad8101e80 2024-04-26T21:07:44.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.124+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdad8110020 con 0x7fdad8101e80 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.124+0000 7fdacf400700 1 -- 172.21.15.55:0/2367515859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fdac405c4b0 con 0x7fdad8101e80 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:07:44.126 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 1, 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 13, 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:07:44.127 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 msgr2=0x7fdabc070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 0x7fdabc070140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005ea0 tx=0x7fdac8005e30 comp rx=0 tx=0).stop 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 msgr2=0x7fdad819d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdac400bd70 tx=0x7fdac400be50 comp rx=0 tx=0).stop 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 shutdown_connections 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7fdabc06dc80 0x7fdabc070140 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad80ff510 0x7fdad819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 --2- 172.21.15.55:0/2367515859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad8101e80 0x7fdad819d1d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 >> 172.21.15.55:0/2367515859 conn(0x7fdad80fb110 msgr2=0x7fdad80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.127+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 shutdown_connections 2024-04-26T21:07:44.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.128+0000 7fdadd600700 1 -- 172.21.15.55:0/2367515859 wait complete. 2024-04-26T21:07:44.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:43 smithi064 ceph-mon[33404]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:44.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:43 smithi064 ceph-mon[33404]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:44.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:43 smithi055 ceph-mon[25475]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:44.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:43 smithi055 ceph-mon[25475]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 -- 172.21.15.55:0/2422696619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c103e30 msgr2=0x7f385c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 --2- 172.21.15.55:0/2422696619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c103e30 0x7f385c106220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3848009910 tx=0x7f3848009c20 comp rx=0 tx=0).stop 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 -- 172.21.15.55:0/2422696619 shutdown_connections 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 --2- 172.21.15.55:0/2422696619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c103e30 0x7f385c106220 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 --2- 172.21.15.55:0/2422696619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c101500 0x7f385c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 -- 172.21.15.55:0/2422696619 >> 172.21.15.55:0/2422696619 conn(0x7f385c0faef0 msgr2=0x7f385c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 -- 172.21.15.55:0/2422696619 shutdown_connections 2024-04-26T21:07:44.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.302+0000 7f3861c00700 1 -- 172.21.15.55:0/2422696619 wait complete. 2024-04-26T21:07:44.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.303+0000 7f3861c00700 1 Processor -- start 2024-04-26T21:07:44.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f3861c00700 1 -- start start 2024-04-26T21:07:44.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f3861c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:44.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f3861c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 0x7f385c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f3861c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c199180 con 0x7f385c101500 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f3861c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c1992c0 con 0x7f385c103e30 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f385be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f385be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35878/0 (socket says 172.21.15.55:35878) 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.304+0000 7f385be00700 1 -- 172.21.15.55:0/2391215951 learned_addr learned my addr 172.21.15.55:0/2391215951 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385b400700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 0x7f385c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385be00700 1 -- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 msgr2=0x7f385c198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385be00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 0x7f385c198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385be00700 1 -- 172.21.15.55:0/2391215951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38480095f0 con 0x7f385c101500 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385b400700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 0x7f385c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:07:44.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.305+0000 7f385be00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f384c00d8d0 tx=0x7f384c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.306+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384c009940 con 0x7f385c101500 2024-04-26T21:07:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.306+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c19dd20 con 0x7f385c101500 2024-04-26T21:07:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.306+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c19e290 con 0x7f385c101500 2024-04-26T21:07:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.306+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f384c010460 con 0x7f385c101500 2024-04-26T21:07:44.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.306+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384c00f5f0 con 0x7f385c101500 2024-04-26T21:07:44.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.308+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c005320 con 0x7f385c101500 2024-04-26T21:07:44.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.310+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 91830+0+0 (secure 0 0 0) 0x7f384c010ad0 con 0x7f385c101500 2024-04-26T21:07:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.311+0000 7f3858c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 0x7f3840070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:07:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.311+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f384c095350 con 0x7f385c101500 2024-04-26T21:07:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.312+0000 7f385b400700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 0x7f3840070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:07:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.313+0000 7f385b400700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 0x7f3840070100 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f384800b5c0 tx=0x7f3848005180 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:07:44.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.316+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f384c092060 con 0x7f385c101500 2024-04-26T21:07:44.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.680+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f383c000bf0 con 0x7f384006dc40 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.684+0000 7f3858c00700 1 -- 172.21.15.55:0/2391215951 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f383c000bf0 con 0x7f384006dc40 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [], 2024-04-26T21:07:44.685 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "", 2024-04-26T21:07:44.686 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mgr daemons", 2024-04-26T21:07:44.686 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:07:44.686 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:07:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 msgr2=0x7f3840070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 0x7f3840070100 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f384800b5c0 tx=0x7f3848005180 comp rx=0 tx=0).stop 2024-04-26T21:07:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 msgr2=0x7f385c198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:07:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f384c00d8d0 tx=0x7f384c00dc90 comp rx=0 tx=0).stop 2024-04-26T21:07:44.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 shutdown_connections 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f384006dc40 0x7f3840070100 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385c101500 0x7f385c198620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 --2- 172.21.15.55:0/2391215951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f385c103e30 0x7f385c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 >> 172.21.15.55:0/2391215951 conn(0x7f385c0faef0 msgr2=0x7f385c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 shutdown_connections 2024-04-26T21:07:44.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:07:44.688+0000 7f3861c00700 1 -- 172.21.15.55:0/2391215951 wait complete. 2024-04-26T21:07:44.951 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:44 smithi055 ceph-mon[25475]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:44.952 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:44 smithi055 ceph-mon[25475]: pgmap v25: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 146 op/s 2024-04-26T21:07:44.952 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:44 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2367515859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:07:44.952 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:44 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:45.224 INFO:tasks.workunit.client.1.smithi064.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T21:07:45.224 INFO:tasks.workunit.client.1.smithi064.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:07:45.224 INFO:tasks.workunit.client.1.smithi064.stderr:+ make 2024-04-26T21:07:45.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:44 smithi064 ceph-mon[33404]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:45.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:44 smithi064 ceph-mon[33404]: pgmap v25: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 146 op/s 2024-04-26T21:07:45.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:44 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2367515859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:07:45.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:44 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:07:45.709 INFO:tasks.workunit.client.1.smithi064.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T21:07:46.153 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:45 smithi055 ceph-mon[25475]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:46.181 INFO:tasks.workunit.client.1.smithi064.stderr:++ readlink -f fsstress 2024-04-26T21:07:46.183 INFO:tasks.workunit.client.1.smithi064.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T21:07:46.183 INFO:tasks.workunit.client.1.smithi064.stderr:+ popd 2024-04-26T21:07:46.184 INFO:tasks.workunit.client.1.smithi064.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:07:46.184 INFO:tasks.workunit.client.1.smithi064.stderr:+ popd 2024-04-26T21:07:46.184 INFO:tasks.workunit.client.1.smithi064.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-26T21:07:46.185 INFO:tasks.workunit.client.1.smithi064.stderr:++ mktemp -d -p . 2024-04-26T21:07:46.193 INFO:tasks.workunit.client.1.smithi064.stderr:+ T=./tmp.014p80PyRj 2024-04-26T21:07:46.193 INFO:tasks.workunit.client.1.smithi064.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.014p80PyRj -l 1 -n 1000 -p 10 -v 2024-04-26T21:07:46.199 INFO:tasks.workunit.client.1.smithi064.stdout:seed = 1714363185 2024-04-26T21:07:46.206 INFO:tasks.workunit.client.1.smithi064.stdout:0/0: chown . 25027 1 2024-04-26T21:07:46.206 INFO:tasks.workunit.client.1.smithi064.stdout:0/1: dwrite - no filename 2024-04-26T21:07:46.206 INFO:tasks.workunit.client.1.smithi064.stdout:0/2: unlink - no file 2024-04-26T21:07:46.207 INFO:tasks.workunit.client.1.smithi064.stdout:0/3: write - no filename 2024-04-26T21:07:46.207 INFO:tasks.workunit.client.1.smithi064.stdout:0/4: getdents . 0 2024-04-26T21:07:46.207 INFO:tasks.workunit.client.1.smithi064.stdout:0/5: getdents . 0 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/0: rename - no filename 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/1: stat - no entries 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/2: readlink - no filename 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/3: dread - no filename 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/4: truncate - no filename 2024-04-26T21:07:46.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/5: chown . 5768 1 2024-04-26T21:07:46.209 INFO:tasks.workunit.client.1.smithi064.stdout:0/6: symlink l0 0 2024-04-26T21:07:46.209 INFO:tasks.workunit.client.1.smithi064.stdout:0/7: dread - no filename 2024-04-26T21:07:46.209 INFO:tasks.workunit.client.1.smithi064.stdout:0/8: dread - no filename 2024-04-26T21:07:46.209 INFO:tasks.workunit.client.1.smithi064.stdout:0/9: read - no filename 2024-04-26T21:07:46.210 INFO:tasks.workunit.client.1.smithi064.stdout:1/0: rename - no filename 2024-04-26T21:07:46.211 INFO:tasks.workunit.client.1.smithi064.stdout:1/1: write - no filename 2024-04-26T21:07:46.211 INFO:tasks.workunit.client.1.smithi064.stdout:1/2: chown . 6157113 1 2024-04-26T21:07:46.211 INFO:tasks.workunit.client.1.smithi064.stdout:1/3: dread - no filename 2024-04-26T21:07:46.212 INFO:tasks.workunit.client.1.smithi064.stdout:7/6: symlink l0 0 2024-04-26T21:07:46.214 INFO:tasks.workunit.client.1.smithi064.stdout:0/10: rename l0 to l1 0 2024-04-26T21:07:46.214 INFO:tasks.workunit.client.1.smithi064.stdout:0/11: truncate - no filename 2024-04-26T21:07:46.215 INFO:tasks.workunit.client.1.smithi064.stdout:0/12: write - no filename 2024-04-26T21:07:46.216 INFO:tasks.workunit.client.1.smithi064.stdout:2/0: dread - no filename 2024-04-26T21:07:46.216 INFO:tasks.workunit.client.1.smithi064.stdout:2/1: write - no filename 2024-04-26T21:07:46.216 INFO:tasks.workunit.client.1.smithi064.stdout:2/2: chown . 4922863 1 2024-04-26T21:07:46.216 INFO:tasks.workunit.client.1.smithi064.stdout:2/3: stat - no entries 2024-04-26T21:07:46.216 INFO:tasks.workunit.client.1.smithi064.stdout:1/4: mkdir d0 0 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/5: truncate - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/6: chown d0 10939474 1 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/7: write - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/8: dread - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/9: chown d0 0 1 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/10: dread - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/11: dread - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/12: write - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/13: dwrite - no filename 2024-04-26T21:07:46.217 INFO:tasks.workunit.client.1.smithi064.stdout:1/14: dread - no filename 2024-04-26T21:07:46.218 INFO:tasks.workunit.client.1.smithi064.stdout:7/7: rename l0 to l1 0 2024-04-26T21:07:46.219 INFO:tasks.workunit.client.1.smithi064.stdout:7/8: dread - no filename 2024-04-26T21:07:46.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/0: rename - no filename 2024-04-26T21:07:46.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/1: dread - no filename 2024-04-26T21:07:46.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/2: dwrite - no filename 2024-04-26T21:07:46.222 INFO:tasks.workunit.client.1.smithi064.stdout:2/4: mknod c0 0 2024-04-26T21:07:46.222 INFO:tasks.workunit.client.1.smithi064.stdout:2/5: dwrite - no filename 2024-04-26T21:07:46.222 INFO:tasks.workunit.client.1.smithi064.stdout:2/6: chown c0 13 1 2024-04-26T21:07:46.222 INFO:tasks.workunit.client.1.smithi064.stdout:2/7: dread - no filename 2024-04-26T21:07:46.222 INFO:tasks.workunit.client.1.smithi064.stdout:2/8: dread - no filename 2024-04-26T21:07:46.223 INFO:tasks.workunit.client.1.smithi064.stdout:1/15: creat d0/f1 x:0 0 0 2024-04-26T21:07:46.223 INFO:tasks.workunit.client.1.smithi064.stdout:1/16: creat d0/f2 x:0 0 0 2024-04-26T21:07:46.223 INFO:tasks.workunit.client.1.smithi064.stdout:1/17: stat d0/f1 0 2024-04-26T21:07:46.225 INFO:tasks.workunit.client.1.smithi064.stdout:7/9: creat f2 x:0 0 0 2024-04-26T21:07:46.225 INFO:tasks.workunit.client.1.smithi064.stdout:7/10: readlink l1 0 2024-04-26T21:07:46.225 INFO:tasks.workunit.client.1.smithi064.stdout:7/11: write f2 [664119,45776] 0 2024-04-26T21:07:46.225 INFO:tasks.workunit.client.1.smithi064.stdout:7/12: creat f3 x:0 0 0 2024-04-26T21:07:46.227 INFO:tasks.workunit.client.1.smithi064.stdout:4/0: write - no filename 2024-04-26T21:07:46.227 INFO:tasks.workunit.client.1.smithi064.stdout:4/1: truncate - no filename 2024-04-26T21:07:46.227 INFO:tasks.workunit.client.1.smithi064.stdout:4/2: dwrite - no filename 2024-04-26T21:07:46.227 INFO:tasks.workunit.client.1.smithi064.stdout:4/3: chown . 377325 1 2024-04-26T21:07:46.228 INFO:tasks.workunit.client.1.smithi064.stdout:4/4: write - no filename 2024-04-26T21:07:46.228 INFO:tasks.workunit.client.1.smithi064.stdout:4/5: rename - no filename 2024-04-26T21:07:46.228 INFO:tasks.workunit.client.1.smithi064.stdout:4/6: fdatasync - no filename 2024-04-26T21:07:46.228 INFO:tasks.workunit.client.1.smithi064.stdout:4/7: unlink - no file 2024-04-26T21:07:46.229 INFO:tasks.workunit.client.1.smithi064.stdout:3/3: mknod c0 0 2024-04-26T21:07:46.234 INFO:tasks.workunit.client.1.smithi064.stdout:2/9: unlink c0 0 2024-04-26T21:07:46.245 INFO:tasks.workunit.client.1.smithi064.stdout:7/13: symlink l4 0 2024-04-26T21:07:46.252 INFO:tasks.workunit.client.1.smithi064.stdout:0/13: rename l1 to l2 0 2024-04-26T21:07:46.254 INFO:tasks.workunit.client.1.smithi064.stdout:4/8: mkdir d0 0 2024-04-26T21:07:46.254 INFO:tasks.workunit.client.1.smithi064.stdout:4/9: getdents d0 0 2024-04-26T21:07:46.258 INFO:tasks.workunit.client.1.smithi064.stdout:3/4: mkdir d1 0 2024-04-26T21:07:46.258 INFO:tasks.workunit.client.1.smithi064.stdout:3/5: dwrite - no filename 2024-04-26T21:07:46.261 INFO:tasks.workunit.client.1.smithi064.stdout:2/10: symlink l1 0 2024-04-26T21:07:46.266 INFO:tasks.workunit.client.1.smithi064.stdout:1/18: rename d0/f2 to d0/f3 0 2024-04-26T21:07:46.274 INFO:tasks.workunit.client.1.smithi064.stdout:5/0: creat f0 x:0 0 0 2024-04-26T21:07:46.274 INFO:tasks.workunit.client.1.smithi064.stdout:5/1: dread - f0 zero size 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/0: chown . 330651 1 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/1: dread - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/2: write - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/3: dwrite - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/4: write - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/5: write - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:5/2: write f0 [381081,38416] 0 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:6/6: write - no filename 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:0/14: stat l2 0 2024-04-26T21:07:46.275 INFO:tasks.workunit.client.1.smithi064.stdout:0/15: dwrite - no filename 2024-04-26T21:07:46.276 INFO:tasks.workunit.client.1.smithi064.stdout:0/16: truncate - no filename 2024-04-26T21:07:46.276 INFO:tasks.workunit.client.1.smithi064.stdout:3/6: symlink d1/l2 0 2024-04-26T21:07:46.276 INFO:tasks.workunit.client.1.smithi064.stdout:3/7: dwrite - no filename 2024-04-26T21:07:46.277 INFO:tasks.workunit.client.1.smithi064.stdout:4/10: creat d0/f1 x:0 0 0 2024-04-26T21:07:46.291 INFO:tasks.workunit.client.1.smithi064.stdout:3/8: rename d1/l2 to d1/l3 0 2024-04-26T21:07:46.292 INFO:tasks.workunit.client.1.smithi064.stdout:3/9: truncate - no filename 2024-04-26T21:07:46.292 INFO:tasks.workunit.client.1.smithi064.stdout:0/17: creat f3 x:0 0 0 2024-04-26T21:07:46.292 INFO:tasks.workunit.client.1.smithi064.stdout:3/10: rename d1 to d1/d4 22 2024-04-26T21:07:46.293 INFO:tasks.workunit.client.1.smithi064.stdout:0/18: fdatasync f3 0 2024-04-26T21:07:46.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/11: mkdir d0/d2 0 2024-04-26T21:07:46.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/12: rename d0 to d0/d2/d3 22 2024-04-26T21:07:46.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/13: truncate d0/f1 248305 0 2024-04-26T21:07:46.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/14: fdatasync d0/f1 0 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/0: rmdir - no directory 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/1: chown . 46 1 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/2: link - no file 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/3: rename - no filename 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/4: dwrite - no filename 2024-04-26T21:07:46.300 INFO:tasks.workunit.client.1.smithi064.stdout:8/5: read - no filename 2024-04-26T21:07:46.304 INFO:tasks.workunit.client.1.smithi064.stdout:0/19: unlink f3 0 2024-04-26T21:07:46.305 INFO:tasks.workunit.client.1.smithi064.stdout:4/15: mknod d0/d2/c4 0 2024-04-26T21:07:46.306 INFO:tasks.workunit.client.1.smithi064.stdout:3/11: symlink d1/l5 0 2024-04-26T21:07:46.306 INFO:tasks.workunit.client.1.smithi064.stdout:3/12: truncate - no filename 2024-04-26T21:07:46.307 INFO:tasks.workunit.client.1.smithi064.stdout:9/0: dread - no filename 2024-04-26T21:07:46.308 INFO:tasks.workunit.client.1.smithi064.stdout:8/6: symlink l0 0 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/20: symlink l4 0 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/21: write - no filename 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/22: write - no filename 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/23: readlink l4 0 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/24: rmdir - no directory 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/25: dwrite - no filename 2024-04-26T21:07:46.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/26: dwrite - no filename 2024-04-26T21:07:46.310 INFO:tasks.workunit.client.1.smithi064.stdout:0/27: fsync - no filename 2024-04-26T21:07:46.310 INFO:tasks.workunit.client.1.smithi064.stdout:0/28: dwrite - no filename 2024-04-26T21:07:46.310 INFO:tasks.workunit.client.1.smithi064.stdout:0/29: creat f5 x:0 0 0 2024-04-26T21:07:46.311 INFO:tasks.workunit.client.1.smithi064.stdout:3/13: unlink c0 0 2024-04-26T21:07:46.311 INFO:tasks.workunit.client.1.smithi064.stdout:3/14: write - no filename 2024-04-26T21:07:46.313 INFO:tasks.workunit.client.1.smithi064.stdout:9/1: mkdir d0 0 2024-04-26T21:07:46.314 INFO:tasks.workunit.client.1.smithi064.stdout:8/7: link l0 l1 0 2024-04-26T21:07:46.314 INFO:tasks.workunit.client.1.smithi064.stdout:8/8: dread - no filename 2024-04-26T21:07:46.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/2: mkdir d0/d1 0 2024-04-26T21:07:46.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/3: readlink - no filename 2024-04-26T21:07:46.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/4: dread - no filename 2024-04-26T21:07:46.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/5: symlink d0/l2 0 2024-04-26T21:07:46.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/6: rename d0 to d0/d1/d3 22 2024-04-26T21:07:46.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/7: truncate - no filename 2024-04-26T21:07:46.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/8: dread - no filename 2024-04-26T21:07:46.321 INFO:tasks.workunit.client.1.smithi064.stdout:8/9: creat f2 x:0 0 0 2024-04-26T21:07:46.328 INFO:tasks.workunit.client.1.smithi064.stdout:7/14: dread f2 [0,4194304] 0 2024-04-26T21:07:46.332 INFO:tasks.workunit.client.1.smithi064.stdout:9/9: mkdir d0/d4 0 2024-04-26T21:07:46.337 INFO:tasks.workunit.client.1.smithi064.stdout:8/10: rename f2 to f3 0 2024-04-26T21:07:46.337 INFO:tasks.workunit.client.1.smithi064.stdout:8/11: creat f4 x:0 0 0 2024-04-26T21:07:46.338 INFO:tasks.workunit.client.1.smithi064.stdout:8/12: write f3 [298810,124637] 0 2024-04-26T21:07:46.380 INFO:tasks.workunit.client.1.smithi064.stdout:5/3: read f0 [83705,119509] 0 2024-04-26T21:07:46.380 INFO:tasks.workunit.client.1.smithi064.stdout:5/4: chown f0 1355396 1 2024-04-26T21:07:46.380 INFO:tasks.workunit.client.1.smithi064.stdout:5/5: truncate f0 483888 0 2024-04-26T21:07:46.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:45 smithi064 ceph-mon[33404]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:07:46.607 INFO:tasks.workunit.client.1.smithi064.stdout:1/19: getdents d0 0 2024-04-26T21:07:46.607 INFO:tasks.workunit.client.1.smithi064.stdout:1/20: dread - d0/f1 zero size 2024-04-26T21:07:46.609 INFO:tasks.workunit.client.1.smithi064.stdout:4/16: fsync d0/f1 0 2024-04-26T21:07:46.882 INFO:tasks.workunit.client.1.smithi064.stdout:0/30: fsync f5 0 2024-04-26T21:07:46.882 INFO:tasks.workunit.client.1.smithi064.stdout:0/31: truncate f5 784994 0 2024-04-26T21:07:46.887 INFO:tasks.workunit.client.1.smithi064.stdout:9/10: getdents d0 0 2024-04-26T21:07:46.887 INFO:tasks.workunit.client.1.smithi064.stdout:9/11: truncate - no filename 2024-04-26T21:07:46.891 INFO:tasks.workunit.client.1.smithi064.stdout:8/13: fsync f3 0 2024-04-26T21:07:46.891 INFO:tasks.workunit.client.1.smithi064.stdout:8/14: truncate f4 287679 0 2024-04-26T21:07:46.950 INFO:tasks.workunit.client.1.smithi064.stdout:1/21: dwrite d0/f3 [0,4194304] 0 2024-04-26T21:07:46.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/22: write d0/f3 [1727572,85009] 0 2024-04-26T21:07:46.996 INFO:tasks.workunit.client.1.smithi064.stdout:7/15: dwrite f2 [0,4194304] 0 2024-04-26T21:07:46.997 INFO:tasks.workunit.client.1.smithi064.stdout:7/16: creat f5 x:0 0 0 2024-04-26T21:07:46.997 INFO:tasks.workunit.client.1.smithi064.stdout:7/17: read - f5 zero size 2024-04-26T21:07:47.018 INFO:tasks.workunit.client.1.smithi064.stdout:5/6: dwrite f0 [0,4194304] 0 2024-04-26T21:07:47.169 INFO:tasks.workunit.client.1.smithi064.stdout:4/17: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:07:47.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:46 smithi055 ceph-mon[25475]: pgmap v26: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 146 op/s 2024-04-26T21:07:47.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:46 smithi064 ceph-mon[33404]: pgmap v26: 65 pgs: 65 active+clean; 208 MiB data, 945 MiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 146 op/s 2024-04-26T21:07:47.469 INFO:tasks.workunit.client.1.smithi064.stdout:0/32: symlink l6 0 2024-04-26T21:07:47.472 INFO:tasks.workunit.client.1.smithi064.stdout:9/12: creat d0/d4/f5 x:0 0 0 2024-04-26T21:07:47.472 INFO:tasks.workunit.client.1.smithi064.stdout:9/13: fdatasync d0/d4/f5 0 2024-04-26T21:07:47.473 INFO:tasks.workunit.client.1.smithi064.stdout:8/15: mkdir d5 0 2024-04-26T21:07:47.473 INFO:tasks.workunit.client.1.smithi064.stdout:8/16: stat f4 0 2024-04-26T21:07:47.473 INFO:tasks.workunit.client.1.smithi064.stdout:0/33: read f5 [239727,31652] 0 2024-04-26T21:07:47.474 INFO:tasks.workunit.client.1.smithi064.stdout:0/34: write f5 [851916,111472] 0 2024-04-26T21:07:47.474 INFO:tasks.workunit.client.1.smithi064.stdout:0/35: chown f5 2724 1 2024-04-26T21:07:47.474 INFO:tasks.workunit.client.1.smithi064.stdout:0/36: creat f7 x:0 0 0 2024-04-26T21:07:47.651 INFO:tasks.workunit.client.1.smithi064.stdout:7/18: mkdir d6 0 2024-04-26T21:07:47.734 INFO:tasks.workunit.client.1.smithi064.stdout:7/19: dwrite f3 [0,4194304] 0 2024-04-26T21:07:47.765 INFO:tasks.workunit.client.1.smithi064.stdout:7/20: dread f3 [0,4194304] 0 2024-04-26T21:07:49.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:48 smithi064 ceph-mon[33404]: pgmap v27: 65 pgs: 65 active+clean; 234 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 344 op/s 2024-04-26T21:07:49.214 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:48 smithi055 ceph-mon[25475]: pgmap v27: 65 pgs: 65 active+clean; 234 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 344 op/s 2024-04-26T21:07:51.001 INFO:tasks.workunit.client.1.smithi064.stdout:9/14: rename d0/l2 to d0/l6 0 2024-04-26T21:07:51.003 INFO:tasks.workunit.client.1.smithi064.stdout:8/17: rmdir d5 0 2024-04-26T21:07:51.012 INFO:tasks.workunit.client.1.smithi064.stdout:1/23: truncate d0/f3 2722364 0 2024-04-26T21:07:51.016 INFO:tasks.workunit.client.1.smithi064.stdout:5/7: getdents . 0 2024-04-26T21:07:51.019 INFO:tasks.workunit.client.1.smithi064.stdout:7/21: symlink d6/l7 0 2024-04-26T21:07:51.019 INFO:tasks.workunit.client.1.smithi064.stdout:7/22: readlink l1 0 2024-04-26T21:07:51.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/18: rmdir d0 39 2024-04-26T21:07:51.065 INFO:tasks.workunit.client.1.smithi064.stdout:9/15: unlink d0/d4/f5 0 2024-04-26T21:07:51.067 INFO:tasks.workunit.client.1.smithi064.stdout:8/18: mknod c6 0 2024-04-26T21:07:51.068 INFO:tasks.workunit.client.1.smithi064.stdout:7/23: symlink d6/l8 0 2024-04-26T21:07:51.072 INFO:tasks.workunit.client.1.smithi064.stdout:4/19: rename d0/d2 to d0/d5 0 2024-04-26T21:07:51.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/16: rename d0/d1 to d0/d4/d7 0 2024-04-26T21:07:51.075 INFO:tasks.workunit.client.1.smithi064.stdout:7/24: mkdir d6/d9 0 2024-04-26T21:07:51.075 INFO:tasks.workunit.client.1.smithi064.stdout:7/25: stat d6/l8 0 2024-04-26T21:07:51.079 INFO:tasks.workunit.client.1.smithi064.stdout:4/20: unlink d0/f1 0 2024-04-26T21:07:51.081 INFO:tasks.workunit.client.1.smithi064.stdout:9/17: symlink d0/l8 0 2024-04-26T21:07:51.081 INFO:tasks.workunit.client.1.smithi064.stdout:9/18: dread - no filename 2024-04-26T21:07:51.081 INFO:tasks.workunit.client.1.smithi064.stdout:9/19: fdatasync - no filename 2024-04-26T21:07:51.085 INFO:tasks.workunit.client.1.smithi064.stdout:7/26: symlink d6/la 0 2024-04-26T21:07:51.085 INFO:tasks.workunit.client.1.smithi064.stdout:7/27: truncate f5 775730 0 2024-04-26T21:07:51.086 INFO:tasks.workunit.client.1.smithi064.stdout:5/8: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.088 INFO:tasks.workunit.client.1.smithi064.stdout:9/20: creat d0/d4/d7/f9 x:0 0 0 2024-04-26T21:07:51.092 INFO:tasks.workunit.client.1.smithi064.stdout:9/21: mkdir d0/d4/da 0 2024-04-26T21:07:51.092 INFO:tasks.workunit.client.1.smithi064.stdout:9/22: dread - d0/d4/d7/f9 zero size 2024-04-26T21:07:51.092 INFO:tasks.workunit.client.1.smithi064.stdout:9/23: fdatasync d0/d4/d7/f9 0 2024-04-26T21:07:51.092 INFO:tasks.workunit.client.1.smithi064.stdout:9/24: write d0/d4/d7/f9 [713221,104916] 0 2024-04-26T21:07:51.092 INFO:tasks.workunit.client.1.smithi064.stdout:9/25: readlink d0/l6 0 2024-04-26T21:07:51.094 INFO:tasks.workunit.client.1.smithi064.stdout:9/26: mknod d0/cb 0 2024-04-26T21:07:51.100 INFO:tasks.workunit.client.1.smithi064.stdout:1/24: dwrite d0/f1 [0,4194304] 0 2024-04-26T21:07:51.103 INFO:tasks.workunit.client.1.smithi064.stdout:9/27: link d0/d4/d7/f9 d0/d4/da/fc 0 2024-04-26T21:07:51.103 INFO:tasks.workunit.client.1.smithi064.stdout:9/28: read d0/d4/d7/f9 [782921,9401] 0 2024-04-26T21:07:51.105 INFO:tasks.workunit.client.1.smithi064.stdout:5/9: dread f0 [0,4194304] 0 2024-04-26T21:07:51.108 INFO:tasks.workunit.client.1.smithi064.stdout:9/29: creat d0/d4/d7/fd x:0 0 0 2024-04-26T21:07:51.116 INFO:tasks.workunit.client.1.smithi064.stdout:5/10: read f0 [2838851,18027] 0 2024-04-26T21:07:51.116 INFO:tasks.workunit.client.1.smithi064.stdout:5/11: chown f0 15 1 2024-04-26T21:07:51.116 INFO:tasks.workunit.client.1.smithi064.stdout:5/12: fdatasync f0 0 2024-04-26T21:07:51.116 INFO:tasks.workunit.client.1.smithi064.stdout:5/13: rmdir - no directory 2024-04-26T21:07:51.118 INFO:tasks.workunit.client.1.smithi064.stdout:5/14: creat f1 x:0 0 0 2024-04-26T21:07:51.118 INFO:tasks.workunit.client.1.smithi064.stdout:5/15: fsync f0 0 2024-04-26T21:07:51.134 INFO:tasks.workunit.client.1.smithi064.stdout:7/28: dwrite f5 [0,4194304] 0 2024-04-26T21:07:51.135 INFO:tasks.workunit.client.1.smithi064.stdout:7/29: fdatasync f5 0 2024-04-26T21:07:51.135 INFO:tasks.workunit.client.1.smithi064.stdout:7/30: chown d6/la 197810928 1 2024-04-26T21:07:51.137 INFO:tasks.workunit.client.1.smithi064.stdout:8/19: dwrite f3 [0,4194304] 0 2024-04-26T21:07:51.137 INFO:tasks.workunit.client.1.smithi064.stdout:8/20: fsync f3 0 2024-04-26T21:07:51.145 INFO:tasks.workunit.client.1.smithi064.stdout:8/21: link l1 l7 0 2024-04-26T21:07:51.151 INFO:tasks.workunit.client.1.smithi064.stdout:7/31: dread f3 [0,4194304] 0 2024-04-26T21:07:51.151 INFO:tasks.workunit.client.1.smithi064.stdout:7/32: chown l4 2 1 2024-04-26T21:07:51.154 INFO:tasks.workunit.client.1.smithi064.stdout:7/33: mkdir d6/db 0 2024-04-26T21:07:51.165 INFO:tasks.workunit.client.1.smithi064.stdout:7/34: read f3 [2342820,120717] 0 2024-04-26T21:07:51.167 INFO:tasks.workunit.client.1.smithi064.stdout:7/35: link l1 d6/db/lc 0 2024-04-26T21:07:51.169 INFO:tasks.workunit.client.1.smithi064.stdout:7/36: creat d6/d9/fd x:0 0 0 2024-04-26T21:07:51.203 INFO:tasks.workunit.client.1.smithi064.stdout:8/22: dwrite f3 [0,4194304] 0 2024-04-26T21:07:51.203 INFO:tasks.workunit.client.1.smithi064.stdout:8/23: write f4 [409405,127121] 0 2024-04-26T21:07:51.203 INFO:tasks.workunit.client.1.smithi064.stdout:8/24: write f4 [946386,76295] 0 2024-04-26T21:07:51.205 INFO:tasks.workunit.client.1.smithi064.stdout:8/25: mknod c8 0 2024-04-26T21:07:51.206 INFO:tasks.workunit.client.1.smithi064.stdout:8/26: chown f4 692 1 2024-04-26T21:07:51.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:50 smithi055 ceph-mon[25475]: pgmap v28: 65 pgs: 65 active+clean; 234 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-04-26T21:07:51.393 INFO:tasks.workunit.client.1.smithi064.stdout:0/37: getdents . 0 2024-04-26T21:07:51.398 INFO:tasks.workunit.client.1.smithi064.stdout:0/38: rename f7 to f8 0 2024-04-26T21:07:51.400 INFO:tasks.workunit.client.1.smithi064.stdout:2/11: sync 2024-04-26T21:07:51.400 INFO:tasks.workunit.client.1.smithi064.stdout:6/7: sync 2024-04-26T21:07:51.400 INFO:tasks.workunit.client.1.smithi064.stdout:6/8: dwrite - no filename 2024-04-26T21:07:51.400 INFO:tasks.workunit.client.1.smithi064.stdout:6/9: dwrite - no filename 2024-04-26T21:07:51.402 INFO:tasks.workunit.client.1.smithi064.stdout:3/15: sync 2024-04-26T21:07:51.402 INFO:tasks.workunit.client.1.smithi064.stdout:3/16: stat d1/l5 0 2024-04-26T21:07:51.405 INFO:tasks.workunit.client.1.smithi064.stdout:2/12: link l1 l2 0 2024-04-26T21:07:51.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:50 smithi064 ceph-mon[33404]: pgmap v28: 65 pgs: 65 active+clean; 234 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-04-26T21:07:51.408 INFO:tasks.workunit.client.1.smithi064.stdout:6/10: creat f0 x:0 0 0 2024-04-26T21:07:51.408 INFO:tasks.workunit.client.1.smithi064.stdout:6/11: stat f0 0 2024-04-26T21:07:51.413 INFO:tasks.workunit.client.1.smithi064.stdout:3/17: creat d1/f6 x:0 0 0 2024-04-26T21:07:51.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/13: symlink l3 0 2024-04-26T21:07:51.419 INFO:tasks.workunit.client.1.smithi064.stdout:2/14: mknod c4 0 2024-04-26T21:07:51.419 INFO:tasks.workunit.client.1.smithi064.stdout:2/15: dwrite - no filename 2024-04-26T21:07:51.421 INFO:tasks.workunit.client.1.smithi064.stdout:2/16: mknod c5 0 2024-04-26T21:07:51.426 INFO:tasks.workunit.client.1.smithi064.stdout:2/17: link l2 l6 0 2024-04-26T21:07:51.428 INFO:tasks.workunit.client.1.smithi064.stdout:2/18: mknod c7 0 2024-04-26T21:07:51.431 INFO:tasks.workunit.client.1.smithi064.stdout:2/19: creat f8 x:0 0 0 2024-04-26T21:07:51.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/20: mknod c9 0 2024-04-26T21:07:51.439 INFO:tasks.workunit.client.1.smithi064.stdout:2/21: mknod ca 0 2024-04-26T21:07:51.439 INFO:tasks.workunit.client.1.smithi064.stdout:2/22: write f8 [434532,120359] 0 2024-04-26T21:07:51.441 INFO:tasks.workunit.client.1.smithi064.stdout:2/23: symlink lb 0 2024-04-26T21:07:51.442 INFO:tasks.workunit.client.1.smithi064.stdout:2/24: write f8 [1107196,124506] 0 2024-04-26T21:07:51.446 INFO:tasks.workunit.client.1.smithi064.stdout:4/21: getdents d0 0 2024-04-26T21:07:51.446 INFO:tasks.workunit.client.1.smithi064.stdout:4/22: write - no filename 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/23: symlink d0/d5/l6 0 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/24: dread - no filename 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/25: getdents d0 0 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/26: stat d0/d5 0 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/27: write - no filename 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/28: write - no filename 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/29: dread - no filename 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/30: chown d0/d5/c4 224 1 2024-04-26T21:07:51.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/31: stat d0/d5 0 2024-04-26T21:07:51.452 INFO:tasks.workunit.client.1.smithi064.stdout:4/32: symlink d0/d5/l7 0 2024-04-26T21:07:51.455 INFO:tasks.workunit.client.1.smithi064.stdout:9/30: truncate d0/d4/d7/f9 171722 0 2024-04-26T21:07:51.455 INFO:tasks.workunit.client.1.smithi064.stdout:9/31: write d0/d4/d7/fd [783125,93730] 0 2024-04-26T21:07:51.457 INFO:tasks.workunit.client.1.smithi064.stdout:9/32: mknod d0/d4/da/ce 0 2024-04-26T21:07:51.459 INFO:tasks.workunit.client.0.smithi055.stderr:++ readlink -f fsstress 2024-04-26T21:07:51.459 INFO:tasks.workunit.client.1.smithi064.stdout:7/37: getdents d6/db 0 2024-04-26T21:07:51.459 INFO:tasks.workunit.client.1.smithi064.stdout:7/38: write d6/d9/fd [368652,33154] 0 2024-04-26T21:07:51.460 INFO:tasks.workunit.client.1.smithi064.stdout:9/33: mkdir d0/d4/d7/df 0 2024-04-26T21:07:51.462 INFO:tasks.workunit.client.1.smithi064.stdout:7/39: getdents d6 0 2024-04-26T21:07:51.462 INFO:tasks.workunit.client.0.smithi055.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T21:07:51.462 INFO:tasks.workunit.client.0.smithi055.stderr:+ popd 2024-04-26T21:07:51.463 INFO:tasks.workunit.client.0.smithi055.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:07:51.463 INFO:tasks.workunit.client.0.smithi055.stderr:+ popd 2024-04-26T21:07:51.463 INFO:tasks.workunit.client.0.smithi055.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T21:07:51.463 INFO:tasks.workunit.client.0.smithi055.stderr:++ mktemp -d -p . 2024-04-26T21:07:51.466 INFO:tasks.workunit.client.1.smithi064.stdout:9/34: rmdir d0/d4/d7 39 2024-04-26T21:07:51.466 INFO:tasks.workunit.client.1.smithi064.stdout:7/40: rmdir d6/db 39 2024-04-26T21:07:51.466 INFO:tasks.workunit.client.1.smithi064.stdout:8/27: truncate f3 4025501 0 2024-04-26T21:07:51.466 INFO:tasks.workunit.client.1.smithi064.stdout:8/28: creat f9 x:0 0 0 2024-04-26T21:07:51.469 INFO:tasks.workunit.client.0.smithi055.stderr:+ T=./tmp.fPUBazQAcz 2024-04-26T21:07:51.469 INFO:tasks.workunit.client.0.smithi055.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.fPUBazQAcz -l 1 -n 1000 -p 10 -v 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.1.smithi064.stdout:0/39: rename f8 to f9 0 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.1.smithi064.stdout:0/40: dread - f9 zero size 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.1.smithi064.stdout:1/25: dwrite d0/f3 [0,4194304] 0 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.1.smithi064.stdout:1/26: chown d0/f1 0 1 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.1.smithi064.stdout:1/27: stat d0/f1 0 2024-04-26T21:07:51.472 INFO:tasks.workunit.client.0.smithi055.stdout:seed = 1714102912 2024-04-26T21:07:51.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/28: rename d0/f1 to d0/f4 0 2024-04-26T21:07:51.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/29: chown d0 12495 1 2024-04-26T21:07:51.474 INFO:tasks.workunit.client.1.smithi064.stdout:1/30: chown d0 3 1 2024-04-26T21:07:51.474 INFO:tasks.workunit.client.1.smithi064.stdout:1/31: chown d0 3118631 1 2024-04-26T21:07:51.477 INFO:tasks.workunit.client.0.smithi055.stdout:0/0: read - no filename 2024-04-26T21:07:51.477 INFO:tasks.workunit.client.0.smithi055.stdout:0/1: getdents . 0 2024-04-26T21:07:51.478 INFO:tasks.workunit.client.1.smithi064.stdout:2/25: write f8 [551301,66134] 0 2024-04-26T21:07:51.479 INFO:tasks.workunit.client.0.smithi055.stdout:0/2: creat f0 x:0 0 0 2024-04-26T21:07:51.479 INFO:tasks.workunit.client.0.smithi055.stdout:0/3: fdatasync f0 0 2024-04-26T21:07:51.479 INFO:tasks.workunit.client.0.smithi055.stdout:0/4: creat f1 x:0 0 0 2024-04-26T21:07:51.479 INFO:tasks.workunit.client.0.smithi055.stdout:0/5: creat f2 x:0 0 0 2024-04-26T21:07:51.481 INFO:tasks.workunit.client.1.smithi064.stdout:6/12: getdents . 0 2024-04-26T21:07:51.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/13: fsync f0 0 2024-04-26T21:07:51.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/14: truncate f0 418157 0 2024-04-26T21:07:51.482 INFO:tasks.workunit.client.0.smithi055.stdout:1/0: creat f0 x:0 0 0 2024-04-26T21:07:51.482 INFO:tasks.workunit.client.0.smithi055.stdout:1/1: chown f0 41728 1 2024-04-26T21:07:51.482 INFO:tasks.workunit.client.0.smithi055.stdout:1/2: chown f0 6260 1 2024-04-26T21:07:51.483 INFO:tasks.workunit.client.1.smithi064.stdout:8/29: dread f4 [0,4194304] 0 2024-04-26T21:07:51.490 INFO:tasks.workunit.client.0.smithi055.stdout:0/6: symlink l3 0 2024-04-26T21:07:51.492 INFO:tasks.workunit.client.1.smithi064.stdout:2/26: rename c7 to cc 0 2024-04-26T21:07:51.494 INFO:tasks.workunit.client.0.smithi055.stdout:3/0: fsync - no filename 2024-04-26T21:07:51.494 INFO:tasks.workunit.client.0.smithi055.stdout:3/1: write - no filename 2024-04-26T21:07:51.494 INFO:tasks.workunit.client.0.smithi055.stdout:3/2: stat - no entries 2024-04-26T21:07:51.494 INFO:tasks.workunit.client.0.smithi055.stdout:3/3: unlink - no file 2024-04-26T21:07:51.494 INFO:tasks.workunit.client.0.smithi055.stdout:3/4: unlink - no file 2024-04-26T21:07:51.496 INFO:tasks.workunit.client.1.smithi064.stdout:6/15: mknod c1 0 2024-04-26T21:07:51.496 INFO:tasks.workunit.client.0.smithi055.stdout:2/0: mknod c0 0 2024-04-26T21:07:51.496 INFO:tasks.workunit.client.0.smithi055.stdout:2/1: dread - no filename 2024-04-26T21:07:51.499 INFO:tasks.workunit.client.0.smithi055.stdout:0/7: link l3 l4 0 2024-04-26T21:07:51.499 INFO:tasks.workunit.client.0.smithi055.stdout:0/8: rmdir - no directory 2024-04-26T21:07:51.499 INFO:tasks.workunit.client.0.smithi055.stdout:0/9: readlink l4 0 2024-04-26T21:07:51.500 INFO:tasks.workunit.client.1.smithi064.stdout:1/32: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:51.503 INFO:tasks.workunit.client.0.smithi055.stdout:3/5: mkdir d0 0 2024-04-26T21:07:51.506 INFO:tasks.workunit.client.0.smithi055.stdout:2/2: rename c0 to c1 0 2024-04-26T21:07:51.507 INFO:tasks.workunit.client.0.smithi055.stdout:2/3: dread - no filename 2024-04-26T21:07:51.509 INFO:tasks.workunit.client.0.smithi055.stdout:0/10: link l4 l5 0 2024-04-26T21:07:51.513 INFO:tasks.workunit.client.0.smithi055.stdout:5/0: link - no file 2024-04-26T21:07:51.513 INFO:tasks.workunit.client.0.smithi055.stdout:5/1: readlink - no filename 2024-04-26T21:07:51.513 INFO:tasks.workunit.client.0.smithi055.stdout:5/2: dwrite - no filename 2024-04-26T21:07:51.518 INFO:tasks.workunit.client.1.smithi064.stdout:3/18: dwrite d1/f6 [0,4194304] 0 2024-04-26T21:07:51.520 INFO:tasks.workunit.client.0.smithi055.stdout:4/0: mknod c0 0 2024-04-26T21:07:51.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/6: mkdir d0/d1 0 2024-04-26T21:07:51.521 INFO:tasks.workunit.client.1.smithi064.stdout:1/33: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:51.522 INFO:tasks.workunit.client.0.smithi055.stdout:2/4: creat f2 x:0 0 0 2024-04-26T21:07:51.522 INFO:tasks.workunit.client.0.smithi055.stdout:2/5: chown f2 1759634 1 2024-04-26T21:07:51.522 INFO:tasks.workunit.client.0.smithi055.stdout:2/6: stat f2 0 2024-04-26T21:07:51.523 INFO:tasks.workunit.client.0.smithi055.stdout:0/11: rename f0 to f6 0 2024-04-26T21:07:51.526 INFO:tasks.workunit.client.1.smithi064.stdout:6/16: rename c1 to c2 0 2024-04-26T21:07:51.529 INFO:tasks.workunit.client.0.smithi055.stdout:5/3: creat f0 x:0 0 0 2024-04-26T21:07:51.529 INFO:tasks.workunit.client.0.smithi055.stdout:5/4: creat f1 x:0 0 0 2024-04-26T21:07:51.530 INFO:tasks.workunit.client.0.smithi055.stdout:3/7: symlink d0/d1/l2 0 2024-04-26T21:07:51.535 INFO:tasks.workunit.client.0.smithi055.stdout:0/12: symlink l7 0 2024-04-26T21:07:51.535 INFO:tasks.workunit.client.0.smithi055.stdout:0/13: creat f8 x:0 0 0 2024-04-26T21:07:51.535 INFO:tasks.workunit.client.0.smithi055.stdout:0/14: read - f8 zero size 2024-04-26T21:07:51.538 INFO:tasks.workunit.client.1.smithi064.stdout:1/34: creat d0/f5 x:0 0 0 2024-04-26T21:07:51.539 INFO:tasks.workunit.client.0.smithi055.stdout:6/0: write - no filename 2024-04-26T21:07:51.539 INFO:tasks.workunit.client.0.smithi055.stdout:6/1: chown . 5 1 2024-04-26T21:07:51.539 INFO:tasks.workunit.client.0.smithi055.stdout:6/2: dread - no filename 2024-04-26T21:07:51.539 INFO:tasks.workunit.client.0.smithi055.stdout:6/3: dread - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:6/4: stat - no entries 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:6/5: fsync - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:6/6: unlink - no file 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:6/7: rename - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:6/8: truncate - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/0: truncate - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/1: unlink - no file 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/2: link - no file 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/3: dwrite - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/4: write - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/5: truncate - no filename 2024-04-26T21:07:51.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/6: fsync - no filename 2024-04-26T21:07:51.541 INFO:tasks.workunit.client.0.smithi055.stdout:1/3: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.541 INFO:tasks.workunit.client.0.smithi055.stdout:1/4: fsync f0 0 2024-04-26T21:07:51.541 INFO:tasks.workunit.client.0.smithi055.stdout:1/5: creat f1 x:0 0 0 2024-04-26T21:07:51.541 INFO:tasks.workunit.client.0.smithi055.stdout:1/6: stat f0 0 2024-04-26T21:07:51.542 INFO:tasks.workunit.client.1.smithi064.stdout:8/30: rename f3 to fa 0 2024-04-26T21:07:51.543 INFO:tasks.workunit.client.1.smithi064.stdout:6/17: write f0 [991075,59567] 0 2024-04-26T21:07:51.543 INFO:tasks.workunit.client.0.smithi055.stdout:3/8: creat d0/d1/f3 x:0 0 0 2024-04-26T21:07:51.543 INFO:tasks.workunit.client.0.smithi055.stdout:3/9: truncate d0/d1/f3 678640 0 2024-04-26T21:07:51.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/31: mknod cb 0 2024-04-26T21:07:51.545 INFO:tasks.workunit.client.1.smithi064.stdout:6/18: read f0 [719480,51431] 0 2024-04-26T21:07:51.545 INFO:tasks.workunit.client.0.smithi055.stdout:0/15: mkdir d9 0 2024-04-26T21:07:51.545 INFO:tasks.workunit.client.0.smithi055.stdout:0/16: chown l3 6 1 2024-04-26T21:07:51.545 INFO:tasks.workunit.client.0.smithi055.stdout:0/17: dread - f8 zero size 2024-04-26T21:07:51.550 INFO:tasks.workunit.client.1.smithi064.stdout:8/32: symlink lc 0 2024-04-26T21:07:51.550 INFO:tasks.workunit.client.1.smithi064.stdout:8/33: fsync f4 0 2024-04-26T21:07:51.550 INFO:tasks.workunit.client.1.smithi064.stdout:6/19: symlink l3 0 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:6/9: creat f0 x:0 0 0 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:6/10: creat f1 x:0 0 0 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:6/11: write f0 [482167,105582] 0 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:8/0: dread - no filename 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:8/1: stat - no entries 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:8/2: stat - no entries 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:8/3: rmdir - no directory 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:1/7: symlink l2 0 2024-04-26T21:07:51.551 INFO:tasks.workunit.client.0.smithi055.stdout:1/8: read - f1 zero size 2024-04-26T21:07:51.552 INFO:tasks.workunit.client.0.smithi055.stdout:1/9: rmdir - no directory 2024-04-26T21:07:51.552 INFO:tasks.workunit.client.0.smithi055.stdout:5/5: unlink f1 0 2024-04-26T21:07:51.552 INFO:tasks.workunit.client.0.smithi055.stdout:5/6: creat f2 x:0 0 0 2024-04-26T21:07:51.552 INFO:tasks.workunit.client.0.smithi055.stdout:3/10: mkdir d0/d4 0 2024-04-26T21:07:51.553 INFO:tasks.workunit.client.0.smithi055.stdout:6/12: mknod c2 0 2024-04-26T21:07:51.554 INFO:tasks.workunit.client.0.smithi055.stdout:6/13: write f1 [288270,109056] 0 2024-04-26T21:07:51.554 INFO:tasks.workunit.client.0.smithi055.stdout:6/14: stat c2 0 2024-04-26T21:07:51.554 INFO:tasks.workunit.client.1.smithi064.stdout:3/19: dread d1/f6 [0,4194304] 0 2024-04-26T21:07:51.555 INFO:tasks.workunit.client.0.smithi055.stdout:8/4: mknod c0 0 2024-04-26T21:07:51.555 INFO:tasks.workunit.client.0.smithi055.stdout:9/0: link - no file 2024-04-26T21:07:51.555 INFO:tasks.workunit.client.0.smithi055.stdout:9/1: dwrite - no filename 2024-04-26T21:07:51.555 INFO:tasks.workunit.client.0.smithi055.stdout:9/2: unlink - no file 2024-04-26T21:07:51.557 INFO:tasks.workunit.client.0.smithi055.stdout:1/10: rename l2 to l3 0 2024-04-26T21:07:51.558 INFO:tasks.workunit.client.0.smithi055.stdout:3/11: write d0/d1/f3 [631123,118717] 0 2024-04-26T21:07:51.559 INFO:tasks.workunit.client.0.smithi055.stdout:8/5: creat f1 x:0 0 0 2024-04-26T21:07:51.559 INFO:tasks.workunit.client.0.smithi055.stdout:8/6: creat f2 x:0 0 0 2024-04-26T21:07:51.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/3: mknod c0 0 2024-04-26T21:07:51.563 INFO:tasks.workunit.client.0.smithi055.stdout:3/12: mkdir d0/d4/d5 0 2024-04-26T21:07:51.565 INFO:tasks.workunit.client.1.smithi064.stdout:9/35: dwrite d0/d4/d7/fd [0,4194304] 0 2024-04-26T21:07:51.565 INFO:tasks.workunit.client.0.smithi055.stdout:2/7: rename c1 to c3 0 2024-04-26T21:07:51.566 INFO:tasks.workunit.client.0.smithi055.stdout:8/7: mkdir d3 0 2024-04-26T21:07:51.568 INFO:tasks.workunit.client.0.smithi055.stdout:9/4: creat f1 x:0 0 0 2024-04-26T21:07:51.568 INFO:tasks.workunit.client.0.smithi055.stdout:9/5: truncate f1 811046 0 2024-04-26T21:07:51.573 INFO:tasks.workunit.client.0.smithi055.stdout:3/13: rename d0/d1/f3 to d0/d4/d5/f6 0 2024-04-26T21:07:51.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/8: stat c3 0 2024-04-26T21:07:51.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/9: write f2 [321329,82932] 0 2024-04-26T21:07:51.578 INFO:tasks.workunit.client.0.smithi055.stdout:8/8: mknod d3/c4 0 2024-04-26T21:07:51.580 INFO:tasks.workunit.client.0.smithi055.stdout:2/10: mkdir d4 0 2024-04-26T21:07:51.580 INFO:tasks.workunit.client.0.smithi055.stdout:2/11: chown c3 26854712 1 2024-04-26T21:07:51.581 INFO:tasks.workunit.client.0.smithi055.stdout:8/9: creat d3/f5 x:0 0 0 2024-04-26T21:07:51.583 INFO:tasks.workunit.client.0.smithi055.stdout:0/18: link f6 d9/fa 0 2024-04-26T21:07:51.584 INFO:tasks.workunit.client.0.smithi055.stdout:8/10: mknod d3/c6 0 2024-04-26T21:07:51.585 INFO:tasks.workunit.client.0.smithi055.stdout:0/19: rename l4 to d9/lb 0 2024-04-26T21:07:51.587 INFO:tasks.workunit.client.0.smithi055.stdout:8/11: mknod d3/c7 0 2024-04-26T21:07:51.587 INFO:tasks.workunit.client.0.smithi055.stdout:8/12: truncate f2 328154 0 2024-04-26T21:07:51.592 INFO:tasks.workunit.client.1.smithi064.stdout:5/16: sync 2024-04-26T21:07:51.612 INFO:tasks.workunit.client.0.smithi055.stdout:2/12: fsync f2 0 2024-04-26T21:07:51.616 INFO:tasks.workunit.client.0.smithi055.stdout:1/11: link l3 l4 0 2024-04-26T21:07:51.620 INFO:tasks.workunit.client.1.smithi064.stdout:9/36: dread d0/d4/d7/fd [0,4194304] 0 2024-04-26T21:07:51.628 INFO:tasks.workunit.client.0.smithi055.stdout:8/13: getdents d3 0 2024-04-26T21:07:51.629 INFO:tasks.workunit.client.1.smithi064.stdout:9/37: symlink d0/d4/d7/df/l10 0 2024-04-26T21:07:51.634 INFO:tasks.workunit.client.1.smithi064.stdout:1/35: dwrite d0/f4 [0,4194304] 0 2024-04-26T21:07:51.669 INFO:tasks.workunit.client.1.smithi064.stdout:1/36: write d0/f4 [1535405,97465] 0 2024-04-26T21:07:51.671 INFO:tasks.workunit.client.1.smithi064.stdout:1/37: rmdir d0 39 2024-04-26T21:07:51.672 INFO:tasks.workunit.client.1.smithi064.stdout:1/38: mkdir d0/d6 0 2024-04-26T21:07:51.673 INFO:tasks.workunit.client.1.smithi064.stdout:1/39: write d0/f5 [81866,91478] 0 2024-04-26T21:07:51.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/40: mknod d0/c7 0 2024-04-26T21:07:51.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/41: readlink - no filename 2024-04-26T21:07:51.675 INFO:tasks.workunit.client.1.smithi064.stdout:1/42: symlink d0/l8 0 2024-04-26T21:07:51.682 INFO:tasks.workunit.client.0.smithi055.stdout:0/20: dwrite f6 [0,4194304] 0 2024-04-26T21:07:51.685 INFO:tasks.workunit.client.0.smithi055.stdout:0/21: mkdir d9/dc 0 2024-04-26T21:07:51.709 INFO:tasks.workunit.client.0.smithi055.stdout:0/22: dread d9/fa [0,4194304] 0 2024-04-26T21:07:51.709 INFO:tasks.workunit.client.0.smithi055.stdout:0/23: getdents d9/dc 0 2024-04-26T21:07:51.709 INFO:tasks.workunit.client.0.smithi055.stdout:0/24: fdatasync f8 0 2024-04-26T21:07:51.711 INFO:tasks.workunit.client.0.smithi055.stdout:0/25: rename f2 to d9/fd 0 2024-04-26T21:07:51.719 INFO:tasks.workunit.client.0.smithi055.stdout:0/26: rename d9/fd to d9/fe 0 2024-04-26T21:07:51.719 INFO:tasks.workunit.client.0.smithi055.stdout:0/27: fdatasync f6 0 2024-04-26T21:07:51.721 INFO:tasks.workunit.client.0.smithi055.stdout:0/28: symlink d9/lf 0 2024-04-26T21:07:51.721 INFO:tasks.workunit.client.0.smithi055.stdout:0/29: readlink d9/lf 0 2024-04-26T21:07:51.729 INFO:tasks.workunit.client.0.smithi055.stdout:0/30: rename d9/fe to d9/dc/f10 0 2024-04-26T21:07:51.729 INFO:tasks.workunit.client.0.smithi055.stdout:0/31: chown d9/dc/f10 120374 1 2024-04-26T21:07:51.732 INFO:tasks.workunit.client.0.smithi055.stdout:0/32: mkdir d9/d11 0 2024-04-26T21:07:51.735 INFO:tasks.workunit.client.0.smithi055.stdout:0/33: unlink l7 0 2024-04-26T21:07:51.735 INFO:tasks.workunit.client.0.smithi055.stdout:0/34: fdatasync f8 0 2024-04-26T21:07:51.738 INFO:tasks.workunit.client.0.smithi055.stdout:0/35: unlink f1 0 2024-04-26T21:07:51.741 INFO:tasks.workunit.client.0.smithi055.stdout:0/36: rename f6 to d9/dc/f12 0 2024-04-26T21:07:51.805 INFO:tasks.workunit.client.1.smithi064.stdout:0/41: dwrite f9 [0,4194304] 0 2024-04-26T21:07:51.809 INFO:tasks.workunit.client.0.smithi055.stdout:9/6: write f1 [381509,130485] 0 2024-04-26T21:07:51.809 INFO:tasks.workunit.client.0.smithi055.stdout:9/7: write f1 [175799,84807] 0 2024-04-26T21:07:51.819 INFO:tasks.workunit.client.1.smithi064.stdout:2/27: dwrite f8 [0,4194304] 0 2024-04-26T21:07:51.823 INFO:tasks.workunit.client.0.smithi055.stdout:5/7: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.823 INFO:tasks.workunit.client.0.smithi055.stdout:5/8: dread - f2 zero size 2024-04-26T21:07:51.830 INFO:tasks.workunit.client.1.smithi064.stdout:0/42: unlink f9 0 2024-04-26T21:07:51.830 INFO:tasks.workunit.client.1.smithi064.stdout:2/28: symlink ld 0 2024-04-26T21:07:51.832 INFO:tasks.workunit.client.0.smithi055.stdout:5/9: link f0 f3 0 2024-04-26T21:07:51.833 INFO:tasks.workunit.client.1.smithi064.stdout:2/29: chown cc 332419518 1 2024-04-26T21:07:51.843 INFO:tasks.workunit.client.0.smithi055.stdout:9/8: dread f1 [0,4194304] 0 2024-04-26T21:07:51.844 INFO:tasks.workunit.client.0.smithi055.stdout:1/12: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.844 INFO:tasks.workunit.client.0.smithi055.stdout:1/13: chown l3 44196 1 2024-04-26T21:07:51.846 INFO:tasks.workunit.client.0.smithi055.stdout:1/14: stat l3 0 2024-04-26T21:07:51.857 INFO:tasks.workunit.client.1.smithi064.stdout:2/30: dread f8 [0,4194304] 0 2024-04-26T21:07:51.857 INFO:tasks.workunit.client.1.smithi064.stdout:3/20: dwrite d1/f6 [0,4194304] 0 2024-04-26T21:07:51.857 INFO:tasks.workunit.client.0.smithi055.stdout:1/15: link l4 l5 0 2024-04-26T21:07:51.857 INFO:tasks.workunit.client.0.smithi055.stdout:9/9: dread f1 [0,4194304] 0 2024-04-26T21:07:51.857 INFO:tasks.workunit.client.0.smithi055.stdout:9/10: write f1 [1184425,16082] 0 2024-04-26T21:07:51.858 INFO:tasks.workunit.client.0.smithi055.stdout:9/11: mkdir d2 0 2024-04-26T21:07:51.858 INFO:tasks.workunit.client.1.smithi064.stdout:0/43: getdents . 0 2024-04-26T21:07:51.858 INFO:tasks.workunit.client.1.smithi064.stdout:0/44: chown l2 1031 1 2024-04-26T21:07:51.860 INFO:tasks.workunit.client.0.smithi055.stdout:5/10: write f3 [2923916,78614] 0 2024-04-26T21:07:51.860 INFO:tasks.workunit.client.1.smithi064.stdout:3/21: symlink d1/l7 0 2024-04-26T21:07:51.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/31: truncate f8 3710595 0 2024-04-26T21:07:51.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/32: creat fe x:0 0 0 2024-04-26T21:07:51.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/33: write fe [14985,20579] 0 2024-04-26T21:07:51.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/22: stat d1/l3 0 2024-04-26T21:07:51.863 INFO:tasks.workunit.client.0.smithi055.stdout:0/37: dwrite d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:51.865 INFO:tasks.workunit.client.1.smithi064.stdout:2/34: mknod cf 0 2024-04-26T21:07:51.866 INFO:tasks.workunit.client.1.smithi064.stdout:8/34: dwrite f9 [0,4194304] 0 2024-04-26T21:07:51.867 INFO:tasks.workunit.client.1.smithi064.stdout:5/17: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.867 INFO:tasks.workunit.client.1.smithi064.stdout:5/18: rmdir - no directory 2024-04-26T21:07:51.867 INFO:tasks.workunit.client.1.smithi064.stdout:5/19: creat f2 x:0 0 0 2024-04-26T21:07:51.868 INFO:tasks.workunit.client.0.smithi055.stdout:9/12: fsync f1 0 2024-04-26T21:07:51.869 INFO:tasks.workunit.client.0.smithi055.stdout:2/13: dwrite f2 [0,4194304] 0 2024-04-26T21:07:51.869 INFO:tasks.workunit.client.0.smithi055.stdout:5/11: mkdir d4 0 2024-04-26T21:07:51.870 INFO:tasks.workunit.client.1.smithi064.stdout:9/38: dwrite d0/d4/d7/f9 [0,4194304] 0 2024-04-26T21:07:51.870 INFO:tasks.workunit.client.0.smithi055.stdout:3/14: dwrite d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:51.871 INFO:tasks.workunit.client.1.smithi064.stdout:6/20: dwrite f0 [0,4194304] 0 2024-04-26T21:07:51.877 INFO:tasks.workunit.client.1.smithi064.stdout:2/35: symlink l10 0 2024-04-26T21:07:51.877 INFO:tasks.workunit.client.1.smithi064.stdout:2/36: stat c4 0 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/16: read f0 [2438954,97026] 0 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/17: write f1 [200356,32709] 0 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/18: chown l4 13946 1 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/19: fsync f0 0 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/20: creat f6 x:0 0 0 2024-04-26T21:07:51.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/21: write f0 [4550050,44982] 0 2024-04-26T21:07:51.880 INFO:tasks.workunit.client.0.smithi055.stdout:2/14: creat d4/f5 x:0 0 0 2024-04-26T21:07:51.880 INFO:tasks.workunit.client.0.smithi055.stdout:2/15: dread - d4/f5 zero size 2024-04-26T21:07:51.883 INFO:tasks.workunit.client.0.smithi055.stdout:9/13: dread f1 [0,4194304] 0 2024-04-26T21:07:51.887 INFO:tasks.workunit.client.1.smithi064.stdout:8/35: mknod cd 0 2024-04-26T21:07:51.890 INFO:tasks.workunit.client.0.smithi055.stdout:3/15: link d0/d4/d5/f6 d0/f7 0 2024-04-26T21:07:51.892 INFO:tasks.workunit.client.1.smithi064.stdout:3/23: truncate d1/f6 3741753 0 2024-04-26T21:07:51.893 INFO:tasks.workunit.client.1.smithi064.stdout:3/24: creat d1/f8 x:0 0 0 2024-04-26T21:07:51.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/22: mkdir d7 0 2024-04-26T21:07:51.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/23: chown f1 5 1 2024-04-26T21:07:51.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/24: truncate f6 138127 0 2024-04-26T21:07:51.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/25: truncate f6 591531 0 2024-04-26T21:07:51.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/26: write f6 [1006941,8010] 0 2024-04-26T21:07:51.903 INFO:tasks.workunit.client.0.smithi055.stdout:2/16: symlink d4/l6 0 2024-04-26T21:07:51.907 INFO:tasks.workunit.client.0.smithi055.stdout:1/27: rmdir d7 0 2024-04-26T21:07:51.917 INFO:tasks.workunit.client.0.smithi055.stdout:3/16: write d0/d4/d5/f6 [1766142,11837] 0 2024-04-26T21:07:51.917 INFO:tasks.workunit.client.0.smithi055.stdout:3/17: write d0/f7 [390713,32445] 0 2024-04-26T21:07:51.918 INFO:tasks.workunit.client.0.smithi055.stdout:3/18: stat d0/d4/d5/f6 0 2024-04-26T21:07:51.918 INFO:tasks.workunit.client.0.smithi055.stdout:3/19: rename d0/d1 to d0/d1/d8 22 2024-04-26T21:07:51.918 INFO:tasks.workunit.client.0.smithi055.stdout:3/20: write d0/d4/d5/f6 [4809251,82347] 0 2024-04-26T21:07:51.938 INFO:tasks.workunit.client.0.smithi055.stdout:3/21: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:51.990 INFO:tasks.workunit.client.0.smithi055.stdout:2/17: symlink d4/l7 0 2024-04-26T21:07:51.991 INFO:tasks.workunit.client.0.smithi055.stdout:2/18: fdatasync f2 0 2024-04-26T21:07:51.991 INFO:tasks.workunit.client.0.smithi055.stdout:2/19: truncate d4/f5 600264 0 2024-04-26T21:07:51.991 INFO:tasks.workunit.client.0.smithi055.stdout:1/28: mkdir d8 0 2024-04-26T21:07:51.993 INFO:tasks.workunit.client.0.smithi055.stdout:3/22: dwrite d0/f7 [0,4194304] 0 2024-04-26T21:07:51.996 INFO:tasks.workunit.client.1.smithi064.stdout:2/37: rename c5 to c11 0 2024-04-26T21:07:51.996 INFO:tasks.workunit.client.1.smithi064.stdout:9/39: creat d0/d4/d7/f11 x:0 0 0 2024-04-26T21:07:51.997 INFO:tasks.workunit.client.1.smithi064.stdout:3/25: link d1/l3 d1/l9 0 2024-04-26T21:07:51.997 INFO:tasks.workunit.client.1.smithi064.stdout:3/26: dread - d1/f8 zero size 2024-04-26T21:07:51.999 INFO:tasks.workunit.client.0.smithi055.stdout:0/38: dwrite d9/fa [4194304,4194304] 0 2024-04-26T21:07:52.002 INFO:tasks.workunit.client.1.smithi064.stdout:5/20: link f2 f3 0 2024-04-26T21:07:52.002 INFO:tasks.workunit.client.1.smithi064.stdout:9/40: link d0/d4/d7/fd d0/f12 0 2024-04-26T21:07:52.003 INFO:tasks.workunit.client.1.smithi064.stdout:9/41: chown d0/d4/d7/f9 104413 1 2024-04-26T21:07:52.003 INFO:tasks.workunit.client.1.smithi064.stdout:3/27: mkdir d1/da 0 2024-04-26T21:07:52.004 INFO:tasks.workunit.client.1.smithi064.stdout:0/45: dwrite f5 [0,4194304] 0 2024-04-26T21:07:52.004 INFO:tasks.workunit.client.1.smithi064.stdout:0/46: stat l2 0 2024-04-26T21:07:52.007 INFO:tasks.workunit.client.1.smithi064.stdout:8/36: dwrite f9 [0,4194304] 0 2024-04-26T21:07:52.007 INFO:tasks.workunit.client.1.smithi064.stdout:8/37: readlink lc 0 2024-04-26T21:07:52.007 INFO:tasks.workunit.client.1.smithi064.stdout:8/38: chown l1 8366498 1 2024-04-26T21:07:52.012 INFO:tasks.workunit.client.1.smithi064.stdout:5/21: symlink l4 0 2024-04-26T21:07:52.012 INFO:tasks.workunit.client.1.smithi064.stdout:5/22: fdatasync f1 0 2024-04-26T21:07:52.013 INFO:tasks.workunit.client.1.smithi064.stdout:5/23: readlink l4 0 2024-04-26T21:07:52.013 INFO:tasks.workunit.client.1.smithi064.stdout:5/24: truncate f3 565898 0 2024-04-26T21:07:52.013 INFO:tasks.workunit.client.1.smithi064.stdout:0/47: mknod ca 0 2024-04-26T21:07:52.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/41: sync 2024-04-26T21:07:52.021 INFO:tasks.workunit.client.1.smithi064.stdout:4/33: sync 2024-04-26T21:07:52.021 INFO:tasks.workunit.client.1.smithi064.stdout:1/43: sync 2024-04-26T21:07:52.021 INFO:tasks.workunit.client.1.smithi064.stdout:1/44: write d0/f3 [4925933,83970] 0 2024-04-26T21:07:52.022 INFO:tasks.workunit.client.1.smithi064.stdout:2/38: write f8 [205749,11692] 0 2024-04-26T21:07:52.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/20: dread f2 [0,4194304] 0 2024-04-26T21:07:52.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/21: truncate d4/f5 1549973 0 2024-04-26T21:07:52.023 INFO:tasks.workunit.client.1.smithi064.stdout:5/25: dread f2 [0,4194304] 0 2024-04-26T21:07:52.024 INFO:tasks.workunit.client.0.smithi055.stdout:3/23: read d0/f7 [2095713,85922] 0 2024-04-26T21:07:52.024 INFO:tasks.workunit.client.1.smithi064.stdout:4/34: mknod d0/c8 0 2024-04-26T21:07:52.024 INFO:tasks.workunit.client.1.smithi064.stdout:4/35: write - no filename 2024-04-26T21:07:52.024 INFO:tasks.workunit.client.0.smithi055.stdout:9/14: dwrite f1 [0,4194304] 0 2024-04-26T21:07:52.025 INFO:tasks.workunit.client.1.smithi064.stdout:5/26: rename f2 to f5 0 2024-04-26T21:07:52.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/27: write f3 [155175,90430] 0 2024-04-26T21:07:52.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/28: fsync f1 0 2024-04-26T21:07:52.027 INFO:tasks.workunit.client.0.smithi055.stdout:0/39: write d9/dc/f12 [491078,129002] 0 2024-04-26T21:07:52.027 INFO:tasks.workunit.client.1.smithi064.stdout:4/36: link d0/d5/c4 d0/c9 0 2024-04-26T21:07:52.027 INFO:tasks.workunit.client.1.smithi064.stdout:4/37: chown d0/d5 351602761 1 2024-04-26T21:07:52.031 INFO:tasks.workunit.client.1.smithi064.stdout:5/29: link f0 f6 0 2024-04-26T21:07:52.031 INFO:tasks.workunit.client.0.smithi055.stdout:3/24: mknod d0/d1/c9 0 2024-04-26T21:07:52.031 INFO:tasks.workunit.client.0.smithi055.stdout:5/12: truncate f3 1262611 0 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:1/45: dread d0/f5 [0,4194304] 0 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:1/46: chown d0/f3 0 1 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:4/38: mkdir d0/d5/da 0 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:4/39: write - no filename 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:4/40: chown d0/d5 0 1 2024-04-26T21:07:52.032 INFO:tasks.workunit.client.1.smithi064.stdout:4/41: dwrite - no filename 2024-04-26T21:07:52.033 INFO:tasks.workunit.client.1.smithi064.stdout:4/42: read - no filename 2024-04-26T21:07:52.033 INFO:tasks.workunit.client.1.smithi064.stdout:2/39: dread fe [0,4194304] 0 2024-04-26T21:07:52.034 INFO:tasks.workunit.client.1.smithi064.stdout:6/21: sync 2024-04-26T21:07:52.036 INFO:tasks.workunit.client.1.smithi064.stdout:7/42: dread d6/d9/fd [0,4194304] 0 2024-04-26T21:07:52.037 INFO:tasks.workunit.client.1.smithi064.stdout:7/43: fsync f3 0 2024-04-26T21:07:52.038 INFO:tasks.workunit.client.1.smithi064.stdout:1/47: mknod d0/d6/c9 0 2024-04-26T21:07:52.038 INFO:tasks.workunit.client.1.smithi064.stdout:1/48: chown d0/f5 1414 1 2024-04-26T21:07:52.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/39: write fa [642587,60503] 0 2024-04-26T21:07:52.040 INFO:tasks.workunit.client.1.smithi064.stdout:4/43: link d0/c9 d0/d5/cb 0 2024-04-26T21:07:52.041 INFO:tasks.workunit.client.1.smithi064.stdout:4/44: dread - no filename 2024-04-26T21:07:52.042 INFO:tasks.workunit.client.1.smithi064.stdout:2/40: mkdir d12 0 2024-04-26T21:07:52.043 INFO:tasks.workunit.client.1.smithi064.stdout:2/41: rename d12 to d12/d13 22 2024-04-26T21:07:52.045 INFO:tasks.workunit.client.0.smithi055.stdout:1/29: dread f0 [0,4194304] 0 2024-04-26T21:07:52.046 INFO:tasks.workunit.client.0.smithi055.stdout:1/30: write f6 [1550165,38670] 0 2024-04-26T21:07:52.046 INFO:tasks.workunit.client.0.smithi055.stdout:1/31: read f0 [3748719,9832] 0 2024-04-26T21:07:52.046 INFO:tasks.workunit.client.1.smithi064.stdout:6/22: truncate f0 3180982 0 2024-04-26T21:07:52.051 INFO:tasks.workunit.client.0.smithi055.stdout:5/13: link f3 d4/f5 0 2024-04-26T21:07:52.051 INFO:tasks.workunit.client.0.smithi055.stdout:5/14: write f2 [877147,32759] 0 2024-04-26T21:07:52.051 INFO:tasks.workunit.client.0.smithi055.stdout:5/15: write f2 [1418058,9867] 0 2024-04-26T21:07:52.052 INFO:tasks.workunit.client.1.smithi064.stdout:7/44: rename d6 to d6/db/de 22 2024-04-26T21:07:52.052 INFO:tasks.workunit.client.1.smithi064.stdout:2/42: dread fe [0,4194304] 0 2024-04-26T21:07:52.053 INFO:tasks.workunit.client.1.smithi064.stdout:1/49: mknod d0/ca 0 2024-04-26T21:07:52.053 INFO:tasks.workunit.client.1.smithi064.stdout:8/40: link l0 le 0 2024-04-26T21:07:52.055 INFO:tasks.workunit.client.1.smithi064.stdout:4/45: mkdir d0/d5/dc 0 2024-04-26T21:07:52.055 INFO:tasks.workunit.client.0.smithi055.stdout:1/32: mknod d8/c9 0 2024-04-26T21:07:52.055 INFO:tasks.workunit.client.1.smithi064.stdout:6/23: stat c2 0 2024-04-26T21:07:52.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/43: link l1 d12/l14 0 2024-04-26T21:07:52.060 INFO:tasks.workunit.client.0.smithi055.stdout:2/22: dread f2 [0,4194304] 0 2024-04-26T21:07:52.060 INFO:tasks.workunit.client.0.smithi055.stdout:2/23: rename d4 to d4/d8 22 2024-04-26T21:07:52.060 INFO:tasks.workunit.client.1.smithi064.stdout:1/50: mknod d0/d6/cb 0 2024-04-26T21:07:52.060 INFO:tasks.workunit.client.1.smithi064.stdout:1/51: stat d0/c7 0 2024-04-26T21:07:52.060 INFO:tasks.workunit.client.1.smithi064.stdout:4/46: mknod d0/d5/da/cd 0 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/47: chown d0/d5 3665 1 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/48: write - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/49: dread - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/50: fdatasync - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/51: write - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/52: dwrite - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/53: dwrite - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/54: dread - no filename 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/55: chown d0/d5/da 462942 1 2024-04-26T21:07:52.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/56: read - no filename 2024-04-26T21:07:52.064 INFO:tasks.workunit.client.1.smithi064.stdout:4/57: rename d0/d5/dc to d0/d5/da/de 0 2024-04-26T21:07:52.064 INFO:tasks.workunit.client.0.smithi055.stdout:2/24: mknod d4/c9 0 2024-04-26T21:07:52.066 INFO:tasks.workunit.client.1.smithi064.stdout:8/41: dread f4 [0,4194304] 0 2024-04-26T21:07:52.068 INFO:tasks.workunit.client.1.smithi064.stdout:6/24: mkdir d4 0 2024-04-26T21:07:52.068 INFO:tasks.workunit.client.1.smithi064.stdout:4/58: creat d0/ff x:0 0 0 2024-04-26T21:07:52.068 INFO:tasks.workunit.client.1.smithi064.stdout:2/44: dread fe [0,4194304] 0 2024-04-26T21:07:52.070 INFO:tasks.workunit.client.1.smithi064.stdout:9/42: write d0/d4/d7/fd [876562,30432] 0 2024-04-26T21:07:52.070 INFO:tasks.workunit.client.1.smithi064.stdout:9/43: chown d0/d4/d7 1484835 1 2024-04-26T21:07:52.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/44: write d0/d4/d7/fd [4146868,118432] 0 2024-04-26T21:07:52.073 INFO:tasks.workunit.client.0.smithi055.stdout:5/16: fsync f2 0 2024-04-26T21:07:52.074 INFO:tasks.workunit.client.1.smithi064.stdout:8/42: unlink lc 0 2024-04-26T21:07:52.074 INFO:tasks.workunit.client.1.smithi064.stdout:8/43: creat ff x:0 0 0 2024-04-26T21:07:52.075 INFO:tasks.workunit.client.0.smithi055.stdout:0/40: write d9/dc/f12 [5062249,102783] 0 2024-04-26T21:07:52.075 INFO:tasks.workunit.client.0.smithi055.stdout:0/41: chown d9/d11 9329 1 2024-04-26T21:07:52.077 INFO:tasks.workunit.client.1.smithi064.stdout:2/45: mknod d12/c15 0 2024-04-26T21:07:52.078 INFO:tasks.workunit.client.1.smithi064.stdout:9/45: symlink d0/d4/da/l13 0 2024-04-26T21:07:52.082 INFO:tasks.workunit.client.0.smithi055.stdout:5/17: rename f3 to d4/f6 0 2024-04-26T21:07:52.084 INFO:tasks.workunit.client.1.smithi064.stdout:8/44: mkdir d10 0 2024-04-26T21:07:52.089 INFO:tasks.workunit.client.1.smithi064.stdout:2/46: unlink f8 0 2024-04-26T21:07:52.089 INFO:tasks.workunit.client.1.smithi064.stdout:9/46: truncate d0/d4/d7/f9 3711270 0 2024-04-26T21:07:52.089 INFO:tasks.workunit.client.1.smithi064.stdout:8/45: rename l0 to d10/l11 0 2024-04-26T21:07:52.090 INFO:tasks.workunit.client.0.smithi055.stdout:2/25: dread f2 [0,4194304] 0 2024-04-26T21:07:52.096 INFO:tasks.workunit.client.1.smithi064.stdout:8/46: rename f9 to d10/f12 0 2024-04-26T21:07:52.096 INFO:tasks.workunit.client.1.smithi064.stdout:9/47: creat d0/d4/da/f14 x:0 0 0 2024-04-26T21:07:52.098 INFO:tasks.workunit.client.0.smithi055.stdout:2/26: rename d4/l6 to d4/la 0 2024-04-26T21:07:52.100 INFO:tasks.workunit.client.0.smithi055.stdout:2/27: mkdir d4/db 0 2024-04-26T21:07:52.108 INFO:tasks.workunit.client.0.smithi055.stdout:5/18: dread d4/f6 [0,4194304] 0 2024-04-26T21:07:52.108 INFO:tasks.workunit.client.0.smithi055.stdout:5/19: stat f2 0 2024-04-26T21:07:52.108 INFO:tasks.workunit.client.1.smithi064.stdout:0/48: dwrite f5 [0,4194304] 0 2024-04-26T21:07:52.108 INFO:tasks.workunit.client.1.smithi064.stdout:7/45: dread f2 [0,4194304] 0 2024-04-26T21:07:52.111 INFO:tasks.workunit.client.0.smithi055.stdout:5/20: creat d4/f7 x:0 0 0 2024-04-26T21:07:52.111 INFO:tasks.workunit.client.0.smithi055.stdout:3/25: dwrite d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:52.111 INFO:tasks.workunit.client.0.smithi055.stdout:5/21: write d4/f5 [1288145,43350] 0 2024-04-26T21:07:52.111 INFO:tasks.workunit.client.0.smithi055.stdout:5/22: truncate d4/f6 2070366 0 2024-04-26T21:07:52.111 INFO:tasks.workunit.client.0.smithi055.stdout:5/23: stat f2 0 2024-04-26T21:07:52.114 INFO:tasks.workunit.client.1.smithi064.stdout:5/30: dwrite f5 [0,4194304] 0 2024-04-26T21:07:52.114 INFO:tasks.workunit.client.1.smithi064.stdout:5/31: fsync f5 0 2024-04-26T21:07:52.118 INFO:tasks.workunit.client.1.smithi064.stdout:0/49: creat fb x:0 0 0 2024-04-26T21:07:52.118 INFO:tasks.workunit.client.1.smithi064.stdout:0/50: read - fb zero size 2024-04-26T21:07:52.119 INFO:tasks.workunit.client.1.smithi064.stdout:0/51: dread - fb zero size 2024-04-26T21:07:52.122 INFO:tasks.workunit.client.1.smithi064.stdout:4/59: getdents d0/d5 0 2024-04-26T21:07:52.122 INFO:tasks.workunit.client.1.smithi064.stdout:4/60: read - d0/ff zero size 2024-04-26T21:07:52.131 INFO:tasks.workunit.client.1.smithi064.stdout:0/52: link f5 fc 0 2024-04-26T21:07:52.131 INFO:tasks.workunit.client.1.smithi064.stdout:0/53: chown l6 74265783 1 2024-04-26T21:07:52.133 INFO:tasks.workunit.client.1.smithi064.stdout:4/61: mkdir d0/d5/da/d10 0 2024-04-26T21:07:52.142 INFO:tasks.workunit.client.1.smithi064.stdout:8/47: dread d10/f12 [0,4194304] 0 2024-04-26T21:07:52.147 INFO:tasks.workunit.client.0.smithi055.stdout:9/15: dwrite f1 [4194304,4194304] 0 2024-04-26T21:07:52.147 INFO:tasks.workunit.client.0.smithi055.stdout:9/16: rename d2 to d2/d3 22 2024-04-26T21:07:52.147 INFO:tasks.workunit.client.0.smithi055.stdout:0/42: dread d9/dc/f12 [4194304,4194304] 0 2024-04-26T21:07:52.148 INFO:tasks.workunit.client.0.smithi055.stdout:9/17: creat d2/f4 x:0 0 0 2024-04-26T21:07:52.148 INFO:tasks.workunit.client.0.smithi055.stdout:9/18: chown d2 1649629 1 2024-04-26T21:07:52.148 INFO:tasks.workunit.client.0.smithi055.stdout:0/43: mknod d9/d11/c13 0 2024-04-26T21:07:52.150 INFO:tasks.workunit.client.1.smithi064.stdout:8/48: getdents d10 0 2024-04-26T21:07:52.152 INFO:tasks.workunit.client.0.smithi055.stdout:9/19: link c0 d2/c5 0 2024-04-26T21:07:52.152 INFO:tasks.workunit.client.0.smithi055.stdout:9/20: write d2/f4 [721038,50816] 0 2024-04-26T21:07:52.153 INFO:tasks.workunit.client.1.smithi064.stdout:5/32: dread f6 [0,4194304] 0 2024-04-26T21:07:52.153 INFO:tasks.workunit.client.1.smithi064.stdout:5/33: rmdir - no directory 2024-04-26T21:07:52.154 INFO:tasks.workunit.client.1.smithi064.stdout:5/34: stat f5 0 2024-04-26T21:07:52.154 INFO:tasks.workunit.client.1.smithi064.stdout:3/28: dwrite d1/f6 [0,4194304] 0 2024-04-26T21:07:52.154 INFO:tasks.workunit.client.0.smithi055.stdout:0/44: link l3 d9/l14 0 2024-04-26T21:07:52.155 INFO:tasks.workunit.client.0.smithi055.stdout:0/45: write d9/fa [9104826,67041] 0 2024-04-26T21:07:52.159 INFO:tasks.workunit.client.1.smithi064.stdout:9/48: write d0/d4/da/fc [453916,28540] 0 2024-04-26T21:07:52.160 INFO:tasks.workunit.client.0.smithi055.stdout:3/26: write d0/f7 [419590,120766] 0 2024-04-26T21:07:52.160 INFO:tasks.workunit.client.0.smithi055.stdout:0/46: symlink d9/d11/l15 0 2024-04-26T21:07:52.162 INFO:tasks.workunit.client.1.smithi064.stdout:5/35: truncate f5 1221103 0 2024-04-26T21:07:52.165 INFO:tasks.workunit.client.0.smithi055.stdout:2/28: dwrite f2 [0,4194304] 0 2024-04-26T21:07:52.169 INFO:tasks.workunit.client.1.smithi064.stdout:1/52: dwrite d0/f3 [0,4194304] 0 2024-04-26T21:07:52.169 INFO:tasks.workunit.client.1.smithi064.stdout:1/53: chown d0/d6/cb 20788461 1 2024-04-26T21:07:52.171 INFO:tasks.workunit.client.1.smithi064.stdout:1/54: mknod d0/cc 0 2024-04-26T21:07:52.173 INFO:tasks.workunit.client.1.smithi064.stdout:8/49: write d10/f12 [2616385,65311] 0 2024-04-26T21:07:52.177 INFO:tasks.workunit.client.1.smithi064.stdout:3/29: dread d1/f6 [0,4194304] 0 2024-04-26T21:07:52.180 INFO:tasks.workunit.client.1.smithi064.stdout:1/55: mkdir d0/d6/dd 0 2024-04-26T21:07:52.183 INFO:tasks.workunit.client.1.smithi064.stdout:8/50: mknod d10/c13 0 2024-04-26T21:07:52.186 INFO:tasks.workunit.client.1.smithi064.stdout:8/51: rename d10/c13 to d10/c14 0 2024-04-26T21:07:52.187 INFO:tasks.workunit.client.1.smithi064.stdout:8/52: chown le 1 1 2024-04-26T21:07:52.190 INFO:tasks.workunit.client.1.smithi064.stdout:8/53: rename d10/l11 to d10/l15 0 2024-04-26T21:07:52.190 INFO:tasks.workunit.client.1.smithi064.stdout:8/54: chown l1 386372020 1 2024-04-26T21:07:52.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/21: dread f1 [4194304,4194304] 0 2024-04-26T21:07:52.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/22: creat d2/f6 x:0 0 0 2024-04-26T21:07:52.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/23: write d2/f6 [623474,111302] 0 2024-04-26T21:07:52.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/24: readlink - no filename 2024-04-26T21:07:52.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/25: chown d2/f6 125 1 2024-04-26T21:07:52.192 INFO:tasks.workunit.client.1.smithi064.stdout:4/62: dwrite d0/ff [0,4194304] 0 2024-04-26T21:07:52.200 INFO:tasks.workunit.client.0.smithi055.stdout:9/26: mknod d2/c7 0 2024-04-26T21:07:52.200 INFO:tasks.workunit.client.0.smithi055.stdout:9/27: write d2/f4 [1816109,36290] 0 2024-04-26T21:07:52.200 INFO:tasks.workunit.client.0.smithi055.stdout:2/29: write f2 [625160,64946] 0 2024-04-26T21:07:52.200 INFO:tasks.workunit.client.0.smithi055.stdout:0/47: write d9/dc/f10 [1808797,75249] 0 2024-04-26T21:07:52.205 INFO:tasks.workunit.client.0.smithi055.stdout:2/30: unlink d4/l7 0 2024-04-26T21:07:52.208 INFO:tasks.workunit.client.1.smithi064.stdout:9/49: truncate d0/d4/d7/f9 322713 0 2024-04-26T21:07:52.208 INFO:tasks.workunit.client.0.smithi055.stdout:3/27: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:52.211 INFO:tasks.workunit.client.0.smithi055.stdout:5/24: dwrite d4/f7 [0,4194304] 0 2024-04-26T21:07:52.211 INFO:tasks.workunit.client.0.smithi055.stdout:5/25: creat d4/f8 x:0 0 0 2024-04-26T21:07:52.212 INFO:tasks.workunit.client.1.smithi064.stdout:4/63: getdents d0 0 2024-04-26T21:07:52.212 INFO:tasks.workunit.client.1.smithi064.stdout:5/36: write f5 [1046709,97561] 0 2024-04-26T21:07:52.212 INFO:tasks.workunit.client.1.smithi064.stdout:5/37: truncate f1 611323 0 2024-04-26T21:07:52.212 INFO:tasks.workunit.client.0.smithi055.stdout:0/48: mknod d9/c16 0 2024-04-26T21:07:52.216 INFO:tasks.workunit.client.1.smithi064.stdout:6/25: dwrite f0 [0,4194304] 0 2024-04-26T21:07:52.216 INFO:tasks.workunit.client.1.smithi064.stdout:6/26: readlink l3 0 2024-04-26T21:07:52.217 INFO:tasks.workunit.client.1.smithi064.stdout:8/55: rename d10/l15 to d10/l16 0 2024-04-26T21:07:52.217 INFO:tasks.workunit.client.1.smithi064.stdout:8/56: readlink d10/l16 0 2024-04-26T21:07:52.217 INFO:tasks.workunit.client.1.smithi064.stdout:8/57: chown l7 1 1 2024-04-26T21:07:52.219 INFO:tasks.workunit.client.0.smithi055.stdout:3/28: mkdir d0/da 0 2024-04-26T21:07:52.220 INFO:tasks.workunit.client.1.smithi064.stdout:7/46: dwrite f3 [0,4194304] 0 2024-04-26T21:07:52.220 INFO:tasks.workunit.client.1.smithi064.stdout:1/56: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:52.222 INFO:tasks.workunit.client.0.smithi055.stdout:9/28: rmdir d2 39 2024-04-26T21:07:52.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/50: fsync d0/d4/da/fc 0 2024-04-26T21:07:52.229 INFO:tasks.workunit.client.0.smithi055.stdout:3/29: mknod d0/d4/d5/cb 0 2024-04-26T21:07:52.230 INFO:tasks.workunit.client.0.smithi055.stdout:9/29: rmdir d2 39 2024-04-26T21:07:52.232 INFO:tasks.workunit.client.0.smithi055.stdout:9/30: creat d2/f8 x:0 0 0 2024-04-26T21:07:52.234 INFO:tasks.workunit.client.1.smithi064.stdout:5/38: dread f0 [0,4194304] 0 2024-04-26T21:07:52.234 INFO:tasks.workunit.client.0.smithi055.stdout:9/31: symlink d2/l9 0 2024-04-26T21:07:52.234 INFO:tasks.workunit.client.0.smithi055.stdout:9/32: readlink d2/l9 0 2024-04-26T21:07:52.235 INFO:tasks.workunit.client.0.smithi055.stdout:9/33: symlink d2/la 0 2024-04-26T21:07:52.245 INFO:tasks.workunit.client.1.smithi064.stdout:4/64: read d0/ff [3159279,109255] 0 2024-04-26T21:07:52.247 INFO:tasks.workunit.client.1.smithi064.stdout:9/51: dread d0/d4/da/fc [0,4194304] 0 2024-04-26T21:07:52.247 INFO:tasks.workunit.client.1.smithi064.stdout:9/52: fdatasync d0/d4/d7/f9 0 2024-04-26T21:07:52.250 INFO:tasks.workunit.client.0.smithi055.stdout:9/34: link d2/l9 d2/lb 0 2024-04-26T21:07:52.259 INFO:tasks.workunit.client.0.smithi055.stdout:9/35: unlink d2/f6 0 2024-04-26T21:07:52.261 INFO:tasks.workunit.client.1.smithi064.stdout:9/53: mkdir d0/d4/d15 0 2024-04-26T21:07:52.261 INFO:tasks.workunit.client.1.smithi064.stdout:4/65: truncate d0/ff 3210621 0 2024-04-26T21:07:52.262 INFO:tasks.workunit.client.1.smithi064.stdout:6/27: truncate f0 4062236 0 2024-04-26T21:07:52.262 INFO:tasks.workunit.client.1.smithi064.stdout:6/28: chown c2 0 1 2024-04-26T21:07:52.262 INFO:tasks.workunit.client.1.smithi064.stdout:5/39: dread f3 [0,4194304] 0 2024-04-26T21:07:52.267 INFO:tasks.workunit.client.1.smithi064.stdout:5/40: write f1 [242645,83645] 0 2024-04-26T21:07:52.267 INFO:tasks.workunit.client.1.smithi064.stdout:5/41: truncate f0 4260286 0 2024-04-26T21:07:52.267 INFO:tasks.workunit.client.1.smithi064.stdout:5/42: stat f6 0 2024-04-26T21:07:52.267 INFO:tasks.workunit.client.1.smithi064.stdout:5/43: write f1 [1547948,3526] 0 2024-04-26T21:07:52.268 INFO:tasks.workunit.client.1.smithi064.stdout:9/54: symlink d0/d4/l16 0 2024-04-26T21:07:52.272 INFO:tasks.workunit.client.0.smithi055.stdout:5/26: dread d4/f7 [0,4194304] 0 2024-04-26T21:07:52.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/44: rename f1 to f7 0 2024-04-26T21:07:52.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/45: rmdir - no directory 2024-04-26T21:07:52.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/46: creat f8 x:0 0 0 2024-04-26T21:07:52.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/47: chown f8 0 1 2024-04-26T21:07:52.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/48: creat f9 x:0 0 0 2024-04-26T21:07:52.274 INFO:tasks.workunit.client.1.smithi064.stdout:9/55: mknod d0/d4/d7/df/c17 0 2024-04-26T21:07:52.275 INFO:tasks.workunit.client.0.smithi055.stdout:5/27: link d4/f8 d4/f9 0 2024-04-26T21:07:52.281 INFO:tasks.workunit.client.1.smithi064.stdout:1/57: write d0/f3 [2586663,75193] 0 2024-04-26T21:07:52.281 INFO:tasks.workunit.client.1.smithi064.stdout:3/30: dwrite d1/f8 [0,4194304] 0 2024-04-26T21:07:52.282 INFO:tasks.workunit.client.0.smithi055.stdout:5/28: symlink d4/la 0 2024-04-26T21:07:52.291 INFO:tasks.workunit.client.0.smithi055.stdout:3/30: dwrite d0/f7 [4194304,4194304] 0 2024-04-26T21:07:52.293 INFO:tasks.workunit.client.0.smithi055.stdout:5/29: unlink d4/f5 0 2024-04-26T21:07:52.294 INFO:tasks.workunit.client.0.smithi055.stdout:5/30: creat d4/fb x:0 0 0 2024-04-26T21:07:52.294 INFO:tasks.workunit.client.0.smithi055.stdout:5/31: chown d4/la 29980597 1 2024-04-26T21:07:52.294 INFO:tasks.workunit.client.0.smithi055.stdout:5/32: write f2 [2372970,65564] 0 2024-04-26T21:07:52.303 INFO:tasks.workunit.client.1.smithi064.stdout:3/31: write d1/f8 [201386,46685] 0 2024-04-26T21:07:52.304 INFO:tasks.workunit.client.0.smithi055.stdout:5/33: rename d4/f7 to d4/fc 0 2024-04-26T21:07:52.305 INFO:tasks.workunit.client.1.smithi064.stdout:7/47: dwrite d6/d9/fd [0,4194304] 0 2024-04-26T21:07:52.309 INFO:tasks.workunit.client.0.smithi055.stdout:5/34: link f2 d4/fd 0 2024-04-26T21:07:52.312 INFO:tasks.workunit.client.1.smithi064.stdout:4/66: link d0/ff d0/f11 0 2024-04-26T21:07:52.316 INFO:tasks.workunit.client.1.smithi064.stdout:3/32: fsync d1/f8 0 2024-04-26T21:07:52.316 INFO:tasks.workunit.client.1.smithi064.stdout:6/29: read f0 [3494018,119738] 0 2024-04-26T21:07:52.327 INFO:tasks.workunit.client.1.smithi064.stdout:7/48: write f3 [1812464,67298] 0 2024-04-26T21:07:52.328 INFO:tasks.workunit.client.1.smithi064.stdout:6/30: link c2 d4/c5 0 2024-04-26T21:07:52.328 INFO:tasks.workunit.client.0.smithi055.stdout:0/49: dwrite f8 [0,4194304] 0 2024-04-26T21:07:52.330 INFO:tasks.workunit.client.1.smithi064.stdout:3/33: creat d1/da/fb x:0 0 0 2024-04-26T21:07:52.333 INFO:tasks.workunit.client.1.smithi064.stdout:1/58: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:52.334 INFO:tasks.workunit.client.1.smithi064.stdout:8/58: dwrite f4 [0,4194304] 0 2024-04-26T21:07:52.334 INFO:tasks.workunit.client.0.smithi055.stdout:2/31: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:07:52.336 INFO:tasks.workunit.client.0.smithi055.stdout:0/50: mkdir d9/dc/d17 0 2024-04-26T21:07:52.339 INFO:tasks.workunit.client.1.smithi064.stdout:1/59: mkdir d0/d6/dd/de 0 2024-04-26T21:07:52.339 INFO:tasks.workunit.client.1.smithi064.stdout:1/60: write d0/f5 [311283,50471] 0 2024-04-26T21:07:52.339 INFO:tasks.workunit.client.1.smithi064.stdout:1/61: stat d0/cc 0 2024-04-26T21:07:52.339 INFO:tasks.workunit.client.1.smithi064.stdout:1/62: chown d0/f4 124536 1 2024-04-26T21:07:52.344 INFO:tasks.workunit.client.1.smithi064.stdout:5/49: link f7 fa 0 2024-04-26T21:07:52.348 INFO:tasks.workunit.client.0.smithi055.stdout:5/35: fsync d4/f8 0 2024-04-26T21:07:52.348 INFO:tasks.workunit.client.0.smithi055.stdout:5/36: fdatasync d4/f6 0 2024-04-26T21:07:52.348 INFO:tasks.workunit.client.0.smithi055.stdout:5/37: stat d4/fb 0 2024-04-26T21:07:52.348 INFO:tasks.workunit.client.0.smithi055.stdout:5/38: dread - d4/fb zero size 2024-04-26T21:07:52.352 INFO:tasks.workunit.client.0.smithi055.stdout:2/32: mkdir d4/dc 0 2024-04-26T21:07:52.352 INFO:tasks.workunit.client.0.smithi055.stdout:2/33: chown d4/la 1453448037 1 2024-04-26T21:07:52.354 INFO:tasks.workunit.client.1.smithi064.stdout:9/56: rmdir d0/d4 39 2024-04-26T21:07:52.354 INFO:tasks.workunit.client.1.smithi064.stdout:8/59: mknod d10/c17 0 2024-04-26T21:07:52.354 INFO:tasks.workunit.client.1.smithi064.stdout:3/34: dread d1/f6 [0,4194304] 0 2024-04-26T21:07:52.354 INFO:tasks.workunit.client.1.smithi064.stdout:1/63: creat d0/d6/ff x:0 0 0 2024-04-26T21:07:52.354 INFO:tasks.workunit.client.1.smithi064.stdout:1/64: truncate d0/f4 4377256 0 2024-04-26T21:07:52.355 INFO:tasks.workunit.client.0.smithi055.stdout:5/39: mknod d4/ce 0 2024-04-26T21:07:52.356 INFO:tasks.workunit.client.1.smithi064.stdout:8/60: symlink d10/l18 0 2024-04-26T21:07:52.358 INFO:tasks.workunit.client.1.smithi064.stdout:9/57: dread d0/d4/da/fc [0,4194304] 0 2024-04-26T21:07:52.359 INFO:tasks.workunit.client.1.smithi064.stdout:3/35: link d1/f8 d1/fc 0 2024-04-26T21:07:52.359 INFO:tasks.workunit.client.0.smithi055.stdout:0/51: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:52.362 INFO:tasks.workunit.client.0.smithi055.stdout:3/31: dwrite d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:52.363 INFO:tasks.workunit.client.1.smithi064.stdout:9/58: creat d0/f18 x:0 0 0 2024-04-26T21:07:52.363 INFO:tasks.workunit.client.1.smithi064.stdout:9/59: rename d0/d4 to d0/d4/d7/d19 22 2024-04-26T21:07:52.363 INFO:tasks.workunit.client.1.smithi064.stdout:9/60: fdatasync d0/d4/d7/fd 0 2024-04-26T21:07:52.368 INFO:tasks.workunit.client.0.smithi055.stdout:3/32: symlink d0/d4/d5/lc 0 2024-04-26T21:07:52.368 INFO:tasks.workunit.client.1.smithi064.stdout:3/36: symlink d1/ld 0 2024-04-26T21:07:52.368 INFO:tasks.workunit.client.1.smithi064.stdout:7/49: write d6/d9/fd [3080122,51015] 0 2024-04-26T21:07:52.381 INFO:tasks.workunit.client.1.smithi064.stdout:4/67: truncate d0/f11 118544 0 2024-04-26T21:07:52.381 INFO:tasks.workunit.client.1.smithi064.stdout:4/68: fdatasync d0/ff 0 2024-04-26T21:07:52.382 INFO:tasks.workunit.client.1.smithi064.stdout:2/47: sync 2024-04-26T21:07:52.382 INFO:tasks.workunit.client.1.smithi064.stdout:0/54: sync 2024-04-26T21:07:52.382 INFO:tasks.workunit.client.1.smithi064.stdout:2/48: fdatasync fe 0 2024-04-26T21:07:52.383 INFO:tasks.workunit.client.0.smithi055.stdout:2/34: truncate d4/f5 3424463 0 2024-04-26T21:07:52.384 INFO:tasks.workunit.client.1.smithi064.stdout:1/65: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:52.384 INFO:tasks.workunit.client.1.smithi064.stdout:1/66: dread - d0/d6/ff zero size 2024-04-26T21:07:52.384 INFO:tasks.workunit.client.1.smithi064.stdout:1/67: stat d0 0 2024-04-26T21:07:52.386 INFO:tasks.workunit.client.1.smithi064.stdout:6/31: dwrite f0 [0,4194304] 0 2024-04-26T21:07:52.387 INFO:tasks.workunit.client.1.smithi064.stdout:0/55: mkdir dd 0 2024-04-26T21:07:52.387 INFO:tasks.workunit.client.1.smithi064.stdout:0/56: dread - fb zero size 2024-04-26T21:07:52.388 INFO:tasks.workunit.client.0.smithi055.stdout:2/35: creat d4/dc/fd x:0 0 0 2024-04-26T21:07:52.390 INFO:tasks.workunit.client.1.smithi064.stdout:1/68: creat d0/f10 x:0 0 0 2024-04-26T21:07:52.390 INFO:tasks.workunit.client.1.smithi064.stdout:1/69: fsync d0/f4 0 2024-04-26T21:07:52.391 INFO:tasks.workunit.client.1.smithi064.stdout:2/49: dread fe [0,4194304] 0 2024-04-26T21:07:52.391 INFO:tasks.workunit.client.1.smithi064.stdout:2/50: truncate fe 606817 0 2024-04-26T21:07:52.391 INFO:tasks.workunit.client.0.smithi055.stdout:5/40: getdents d4 0 2024-04-26T21:07:52.392 INFO:tasks.workunit.client.0.smithi055.stdout:5/41: readlink d4/la 0 2024-04-26T21:07:52.393 INFO:tasks.workunit.client.0.smithi055.stdout:2/36: symlink d4/le 0 2024-04-26T21:07:52.397 INFO:tasks.workunit.client.1.smithi064.stdout:6/32: mknod d4/c6 0 2024-04-26T21:07:52.397 INFO:tasks.workunit.client.1.smithi064.stdout:0/57: mknod dd/ce 0 2024-04-26T21:07:52.397 INFO:tasks.workunit.client.0.smithi055.stdout:5/42: mkdir d4/df 0 2024-04-26T21:07:52.397 INFO:tasks.workunit.client.0.smithi055.stdout:5/43: fsync d4/f8 0 2024-04-26T21:07:52.403 INFO:tasks.workunit.client.0.smithi055.stdout:2/37: link f2 d4/ff 0 2024-04-26T21:07:52.404 INFO:tasks.workunit.client.1.smithi064.stdout:2/51: dread fe [0,4194304] 0 2024-04-26T21:07:52.407 INFO:tasks.workunit.client.1.smithi064.stdout:1/70: mkdir d0/d6/d11 0 2024-04-26T21:07:52.407 INFO:tasks.workunit.client.1.smithi064.stdout:1/71: creat d0/f12 x:0 0 0 2024-04-26T21:07:52.407 INFO:tasks.workunit.client.1.smithi064.stdout:1/72: chown d0/d6/dd/de 90238397 1 2024-04-26T21:07:52.409 INFO:tasks.workunit.client.1.smithi064.stdout:6/33: mkdir d4/d7 0 2024-04-26T21:07:52.411 INFO:tasks.workunit.client.0.smithi055.stdout:5/44: creat d4/f10 x:0 0 0 2024-04-26T21:07:52.411 INFO:tasks.workunit.client.0.smithi055.stdout:5/45: stat d4/la 0 2024-04-26T21:07:52.411 INFO:tasks.workunit.client.0.smithi055.stdout:2/38: mknod d4/c10 0 2024-04-26T21:07:52.413 INFO:tasks.workunit.client.1.smithi064.stdout:2/52: mkdir d12/d16 0 2024-04-26T21:07:52.413 INFO:tasks.workunit.client.1.smithi064.stdout:2/53: read fe [119565,28870] 0 2024-04-26T21:07:52.416 INFO:tasks.workunit.client.1.smithi064.stdout:6/34: unlink c2 0 2024-04-26T21:07:52.418 INFO:tasks.workunit.client.1.smithi064.stdout:6/35: rename d4/c5 to d4/c8 0 2024-04-26T21:07:52.426 INFO:tasks.workunit.client.1.smithi064.stdout:9/61: dwrite d0/d4/d7/f11 [0,4194304] 0 2024-04-26T21:07:52.426 INFO:tasks.workunit.client.1.smithi064.stdout:3/37: dread d1/f6 [0,4194304] 0 2024-04-26T21:07:52.439 INFO:tasks.workunit.client.0.smithi055.stdout:3/33: dwrite d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:52.440 INFO:tasks.workunit.client.1.smithi064.stdout:4/69: dread d0/ff [0,4194304] 0 2024-04-26T21:07:52.442 INFO:tasks.workunit.client.0.smithi055.stdout:3/34: rmdir d0/da 0 2024-04-26T21:07:52.444 INFO:tasks.workunit.client.0.smithi055.stdout:3/35: symlink d0/d4/ld 0 2024-04-26T21:07:52.447 INFO:tasks.workunit.client.1.smithi064.stdout:1/73: fsync d0/f5 0 2024-04-26T21:07:52.447 INFO:tasks.workunit.client.1.smithi064.stdout:1/74: fsync d0/f4 0 2024-04-26T21:07:52.448 INFO:tasks.workunit.client.1.smithi064.stdout:5/50: dwrite f7 [0,4194304] 0 2024-04-26T21:07:52.448 INFO:tasks.workunit.client.1.smithi064.stdout:5/51: rmdir - no directory 2024-04-26T21:07:52.449 INFO:tasks.workunit.client.1.smithi064.stdout:4/70: dread d0/ff [0,4194304] 0 2024-04-26T21:07:52.453 INFO:tasks.workunit.client.1.smithi064.stdout:8/61: dwrite ff [0,4194304] 0 2024-04-26T21:07:52.456 INFO:tasks.workunit.client.1.smithi064.stdout:5/52: rename f6 to fb 0 2024-04-26T21:07:52.460 INFO:tasks.workunit.client.0.smithi055.stdout:0/52: dwrite f8 [0,4194304] 0 2024-04-26T21:07:52.460 INFO:tasks.workunit.client.0.smithi055.stdout:0/53: chown d9/c16 30975773 1 2024-04-26T21:07:52.460 INFO:tasks.workunit.client.0.smithi055.stdout:0/54: chown d9/fa 4 1 2024-04-26T21:07:52.463 INFO:tasks.workunit.client.0.smithi055.stdout:0/55: truncate d9/dc/f10 43713 0 2024-04-26T21:07:52.466 INFO:tasks.workunit.client.0.smithi055.stdout:0/56: rename d9/lf to d9/dc/d17/l18 0 2024-04-26T21:07:52.468 INFO:tasks.workunit.client.1.smithi064.stdout:4/71: creat d0/d5/da/f12 x:0 0 0 2024-04-26T21:07:52.468 INFO:tasks.workunit.client.1.smithi064.stdout:4/72: fdatasync d0/ff 0 2024-04-26T21:07:52.468 INFO:tasks.workunit.client.1.smithi064.stdout:4/73: write d0/ff [1090736,4507] 0 2024-04-26T21:07:52.469 INFO:tasks.workunit.client.0.smithi055.stdout:0/57: write d9/dc/f12 [8487480,42429] 0 2024-04-26T21:07:52.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/62: dread d10/f12 [0,4194304] 0 2024-04-26T21:07:52.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/63: rename cb to d10/c19 0 2024-04-26T21:07:52.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/64: chown d10/c17 0 1 2024-04-26T21:07:52.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/65: write fa [2923339,81634] 0 2024-04-26T21:07:52.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/66: fdatasync f4 0 2024-04-26T21:07:52.477 INFO:tasks.workunit.client.1.smithi064.stdout:6/36: dread f0 [0,4194304] 0 2024-04-26T21:07:52.478 INFO:tasks.workunit.client.1.smithi064.stdout:2/54: dwrite fe [0,4194304] 0 2024-04-26T21:07:52.489 INFO:tasks.workunit.client.1.smithi064.stdout:7/50: dwrite f3 [4194304,4194304] 0 2024-04-26T21:07:52.494 INFO:tasks.workunit.client.1.smithi064.stdout:2/55: link l2 d12/l17 0 2024-04-26T21:07:52.496 INFO:tasks.workunit.client.0.smithi055.stdout:0/58: dread f8 [0,4194304] 0 2024-04-26T21:07:52.498 INFO:tasks.workunit.client.1.smithi064.stdout:4/74: dread d0/ff [0,4194304] 0 2024-04-26T21:07:52.505 INFO:tasks.workunit.client.1.smithi064.stdout:2/56: mknod d12/c18 0 2024-04-26T21:07:52.505 INFO:tasks.workunit.client.0.smithi055.stdout:3/36: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:52.508 INFO:tasks.workunit.client.0.smithi055.stdout:0/59: write d9/dc/f10 [848711,115112] 0 2024-04-26T21:07:52.511 INFO:tasks.workunit.client.1.smithi064.stdout:1/75: dwrite d0/f10 [0,4194304] 0 2024-04-26T21:07:52.511 INFO:tasks.workunit.client.1.smithi064.stdout:1/76: fdatasync d0/f5 0 2024-04-26T21:07:52.519 INFO:tasks.workunit.client.1.smithi064.stdout:8/67: link d10/c19 d10/c1a 0 2024-04-26T21:07:52.519 INFO:tasks.workunit.client.1.smithi064.stdout:9/62: dwrite d0/d4/d7/f9 [0,4194304] 0 2024-04-26T21:07:52.534 INFO:tasks.workunit.client.1.smithi064.stdout:1/77: rename d0/f5 to d0/f13 0 2024-04-26T21:07:52.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/68: write ff [987930,68827] 0 2024-04-26T21:07:52.548 INFO:tasks.workunit.client.1.smithi064.stdout:5/53: dwrite fb [0,4194304] 0 2024-04-26T21:07:52.548 INFO:tasks.workunit.client.1.smithi064.stdout:5/54: creat fc x:0 0 0 2024-04-26T21:07:52.553 INFO:tasks.workunit.client.0.smithi055.stdout:2/39: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:07:52.553 INFO:tasks.workunit.client.0.smithi055.stdout:2/40: read d4/ff [2880559,19217] 0 2024-04-26T21:07:52.553 INFO:tasks.workunit.client.0.smithi055.stdout:5/46: dwrite d4/fd [0,4194304] 0 2024-04-26T21:07:52.554 INFO:tasks.workunit.client.1.smithi064.stdout:7/51: dwrite f2 [0,4194304] 0 2024-04-26T21:07:52.555 INFO:tasks.workunit.client.1.smithi064.stdout:1/78: dread d0/f4 [0,4194304] 0 2024-04-26T21:07:52.567 INFO:tasks.workunit.client.1.smithi064.stdout:5/55: write f7 [603784,107545] 0 2024-04-26T21:07:52.567 INFO:tasks.workunit.client.1.smithi064.stdout:5/56: truncate fc 828229 0 2024-04-26T21:07:52.589 INFO:tasks.workunit.client.1.smithi064.stdout:7/52: dwrite f5 [0,4194304] 0 2024-04-26T21:07:52.604 INFO:tasks.workunit.client.0.smithi055.stdout:2/41: dwrite f2 [0,4194304] 0 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/42: dread d4/f5 [0,4194304] 0 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/43: chown d4/le 965 1 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/44: chown d4/ff 1171997 1 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/45: write d4/ff [4393349,83390] 0 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/46: fsync d4/dc/fd 0 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/47: creat d4/dc/f11 x:0 0 0 2024-04-26T21:07:52.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/48: chown f2 2020 1 2024-04-26T21:07:52.620 INFO:tasks.workunit.client.0.smithi055.stdout:2/49: creat d4/dc/f12 x:0 0 0 2024-04-26T21:07:52.650 INFO:tasks.workunit.client.0.smithi055.stdout:2/50: dread f2 [0,4194304] 0 2024-04-26T21:07:52.650 INFO:tasks.workunit.client.1.smithi064.stdout:2/57: truncate fe 930361 0 2024-04-26T21:07:52.657 INFO:tasks.workunit.client.1.smithi064.stdout:8/69: creat d10/f1b x:0 0 0 2024-04-26T21:07:52.681 INFO:tasks.workunit.client.1.smithi064.stdout:5/57: mkdir dd 0 2024-04-26T21:07:52.682 INFO:tasks.workunit.client.1.smithi064.stdout:7/53: rmdir d6/db 39 2024-04-26T21:07:52.684 INFO:tasks.workunit.client.1.smithi064.stdout:4/75: rename d0/d5/da to d0/d5/d13 0 2024-04-26T21:07:52.686 INFO:tasks.workunit.client.1.smithi064.stdout:9/63: truncate d0/d4/d7/f9 2445606 0 2024-04-26T21:07:52.690 INFO:tasks.workunit.client.1.smithi064.stdout:2/58: unlink c9 0 2024-04-26T21:07:52.690 INFO:tasks.workunit.client.1.smithi064.stdout:2/59: fsync fe 0 2024-04-26T21:07:52.692 INFO:tasks.workunit.client.1.smithi064.stdout:8/70: symlink d10/l1c 0 2024-04-26T21:07:52.694 INFO:tasks.workunit.client.1.smithi064.stdout:1/79: unlink d0/f10 0 2024-04-26T21:07:52.695 INFO:tasks.workunit.client.1.smithi064.stdout:1/80: write d0/f4 [1782012,118009] 0 2024-04-26T21:07:52.695 INFO:tasks.workunit.client.1.smithi064.stdout:1/81: read d0/f4 [2720272,76548] 0 2024-04-26T21:07:52.696 INFO:tasks.workunit.client.1.smithi064.stdout:4/76: mkdir d0/d14 0 2024-04-26T21:07:52.696 INFO:tasks.workunit.client.1.smithi064.stdout:4/77: stat d0/d5/d13/f12 0 2024-04-26T21:07:52.697 INFO:tasks.workunit.client.1.smithi064.stdout:8/71: mkdir d10/d1d 0 2024-04-26T21:07:52.697 INFO:tasks.workunit.client.1.smithi064.stdout:8/72: stat fa 0 2024-04-26T21:07:52.699 INFO:tasks.workunit.client.1.smithi064.stdout:5/58: dread f3 [0,4194304] 0 2024-04-26T21:07:52.699 INFO:tasks.workunit.client.1.smithi064.stdout:5/59: chown fc 64 1 2024-04-26T21:07:52.702 INFO:tasks.workunit.client.1.smithi064.stdout:1/82: mknod d0/d6/c14 0 2024-04-26T21:07:52.702 INFO:tasks.workunit.client.1.smithi064.stdout:6/37: sync 2024-04-26T21:07:52.702 INFO:tasks.workunit.client.1.smithi064.stdout:0/58: sync 2024-04-26T21:07:52.702 INFO:tasks.workunit.client.1.smithi064.stdout:1/83: creat d0/f15 x:0 0 0 2024-04-26T21:07:52.704 INFO:tasks.workunit.client.1.smithi064.stdout:3/38: sync 2024-04-26T21:07:52.705 INFO:tasks.workunit.client.1.smithi064.stdout:4/78: mknod d0/d5/c15 0 2024-04-26T21:07:52.705 INFO:tasks.workunit.client.1.smithi064.stdout:8/73: creat d10/d1d/f1e x:0 0 0 2024-04-26T21:07:52.705 INFO:tasks.workunit.client.1.smithi064.stdout:8/74: dread - d10/f1b zero size 2024-04-26T21:07:52.705 INFO:tasks.workunit.client.1.smithi064.stdout:5/60: creat dd/fe x:0 0 0 2024-04-26T21:07:52.705 INFO:tasks.workunit.client.1.smithi064.stdout:8/75: creat d10/f1f x:0 0 0 2024-04-26T21:07:52.707 INFO:tasks.workunit.client.1.smithi064.stdout:0/59: truncate fc 1985056 0 2024-04-26T21:07:52.707 INFO:tasks.workunit.client.1.smithi064.stdout:0/60: chown fc 0 1 2024-04-26T21:07:52.709 INFO:tasks.workunit.client.1.smithi064.stdout:1/84: mknod d0/d6/dd/de/c16 0 2024-04-26T21:07:52.713 INFO:tasks.workunit.client.1.smithi064.stdout:3/39: rename d1/l9 to d1/le 0 2024-04-26T21:07:52.713 INFO:tasks.workunit.client.1.smithi064.stdout:4/79: creat d0/d5/d13/f16 x:0 0 0 2024-04-26T21:07:52.713 INFO:tasks.workunit.client.1.smithi064.stdout:3/40: creat d1/ff x:0 0 0 2024-04-26T21:07:52.713 INFO:tasks.workunit.client.1.smithi064.stdout:3/41: chown d1/f8 59782 1 2024-04-26T21:07:52.714 INFO:tasks.workunit.client.1.smithi064.stdout:4/80: write d0/ff [48114,58176] 0 2024-04-26T21:07:52.714 INFO:tasks.workunit.client.1.smithi064.stdout:3/42: creat d1/da/f10 x:0 0 0 2024-04-26T21:07:52.717 INFO:tasks.workunit.client.1.smithi064.stdout:5/61: truncate f0 4235968 0 2024-04-26T21:07:52.720 INFO:tasks.workunit.client.1.smithi064.stdout:9/64: write d0/d4/d7/f11 [1826958,65278] 0 2024-04-26T21:07:52.721 INFO:tasks.workunit.client.1.smithi064.stdout:8/76: symlink d10/l20 0 2024-04-26T21:07:52.721 INFO:tasks.workunit.client.1.smithi064.stdout:8/77: fdatasync d10/d1d/f1e 0 2024-04-26T21:07:52.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/61: creat dd/ff x:0 0 0 2024-04-26T21:07:52.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/62: chown fc 1389313 1 2024-04-26T21:07:52.725 INFO:tasks.workunit.client.1.smithi064.stdout:0/63: dread - dd/ff zero size 2024-04-26T21:07:52.725 INFO:tasks.workunit.client.1.smithi064.stdout:0/64: write fb [422096,119492] 0 2024-04-26T21:07:52.725 INFO:tasks.workunit.client.1.smithi064.stdout:1/85: mknod d0/d6/c17 0 2024-04-26T21:07:52.733 INFO:tasks.workunit.client.1.smithi064.stdout:3/43: link d1/f8 d1/f11 0 2024-04-26T21:07:52.735 INFO:tasks.workunit.client.1.smithi064.stdout:4/81: mkdir d0/d5/d13/de/d17 0 2024-04-26T21:07:52.735 INFO:tasks.workunit.client.1.smithi064.stdout:4/82: write d0/d5/d13/f16 [152384,5861] 0 2024-04-26T21:07:52.739 INFO:tasks.workunit.client.1.smithi064.stdout:9/65: symlink d0/d4/da/l1a 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:8/78: symlink d10/l21 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/83: write d0/ff [685039,93628] 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:8/79: dread - d10/f1f zero size 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:8/80: write ff [1798098,45960] 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:8/81: dread - d10/d1d/f1e zero size 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/84: creat d0/d5/d13/f18 x:0 0 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/85: stat d0/d5/d13/f12 0 2024-04-26T21:07:52.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/86: creat d0/d5/d13/f19 x:0 0 0 2024-04-26T21:07:52.748 INFO:tasks.workunit.client.1.smithi064.stdout:1/86: creat d0/d6/d11/f18 x:0 0 0 2024-04-26T21:07:52.754 INFO:tasks.workunit.client.1.smithi064.stdout:3/44: unlink d1/l7 0 2024-04-26T21:07:52.758 INFO:tasks.workunit.client.1.smithi064.stdout:9/66: read d0/d4/d7/f9 [1243330,88430] 0 2024-04-26T21:07:52.761 INFO:tasks.workunit.client.1.smithi064.stdout:8/82: mknod d10/d1d/c22 0 2024-04-26T21:07:52.768 INFO:tasks.workunit.client.1.smithi064.stdout:0/65: read f5 [1948151,110468] 0 2024-04-26T21:07:52.772 INFO:tasks.workunit.client.1.smithi064.stdout:9/67: creat d0/d4/d7/df/f1b x:0 0 0 2024-04-26T21:07:52.773 INFO:tasks.workunit.client.1.smithi064.stdout:0/66: mkdir dd/d10 0 2024-04-26T21:07:52.774 INFO:tasks.workunit.client.1.smithi064.stdout:0/67: read fc [912928,124055] 0 2024-04-26T21:07:52.776 INFO:tasks.workunit.client.1.smithi064.stdout:0/68: read fb [134322,118318] 0 2024-04-26T21:07:52.778 INFO:tasks.workunit.client.1.smithi064.stdout:4/87: rename d0/d5/d13/f18 to d0/f1a 0 2024-04-26T21:07:52.783 INFO:tasks.workunit.client.1.smithi064.stdout:9/68: link d0/l6 d0/d4/da/l1c 0 2024-04-26T21:07:52.783 INFO:tasks.workunit.client.1.smithi064.stdout:9/69: write d0/f18 [236791,31707] 0 2024-04-26T21:07:52.783 INFO:tasks.workunit.client.1.smithi064.stdout:9/70: write d0/f18 [475837,43286] 0 2024-04-26T21:07:52.785 INFO:tasks.workunit.client.1.smithi064.stdout:0/69: truncate f5 397137 0 2024-04-26T21:07:52.787 INFO:tasks.workunit.client.1.smithi064.stdout:3/45: getdents d1/da 0 2024-04-26T21:07:52.792 INFO:tasks.workunit.client.1.smithi064.stdout:0/70: mknod dd/d10/c11 0 2024-04-26T21:07:52.793 INFO:tasks.workunit.client.1.smithi064.stdout:0/71: creat dd/f12 x:0 0 0 2024-04-26T21:07:52.807 INFO:tasks.workunit.client.1.smithi064.stdout:0/72: fsync fb 0 2024-04-26T21:07:52.808 INFO:tasks.workunit.client.1.smithi064.stdout:3/46: mkdir d1/d12 0 2024-04-26T21:07:52.808 INFO:tasks.workunit.client.1.smithi064.stdout:3/47: stat d1/ld 0 2024-04-26T21:07:52.808 INFO:tasks.workunit.client.1.smithi064.stdout:3/48: dread - d1/da/f10 zero size 2024-04-26T21:07:52.823 INFO:tasks.workunit.client.1.smithi064.stdout:5/62: dwrite f5 [0,4194304] 0 2024-04-26T21:07:52.824 INFO:tasks.workunit.client.1.smithi064.stdout:5/63: creat dd/ff x:0 0 0 2024-04-26T21:07:52.824 INFO:tasks.workunit.client.1.smithi064.stdout:5/64: write f7 [3279036,48678] 0 2024-04-26T21:07:52.855 INFO:tasks.workunit.client.1.smithi064.stdout:4/88: dwrite d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:52.879 INFO:tasks.workunit.client.1.smithi064.stdout:7/54: dwrite f3 [0,4194304] 0 2024-04-26T21:07:52.879 INFO:tasks.workunit.client.1.smithi064.stdout:6/38: dwrite f0 [4194304,4194304] 0 2024-04-26T21:07:52.881 INFO:tasks.workunit.client.1.smithi064.stdout:2/60: dwrite fe [0,4194304] 0 2024-04-26T21:07:52.881 INFO:tasks.workunit.client.1.smithi064.stdout:5/65: dwrite f9 [0,4194304] 0 2024-04-26T21:07:52.881 INFO:tasks.workunit.client.1.smithi064.stdout:5/66: creat dd/f10 x:0 0 0 2024-04-26T21:07:52.885 INFO:tasks.workunit.client.1.smithi064.stdout:8/83: dwrite ff [0,4194304] 0 2024-04-26T21:07:52.885 INFO:tasks.workunit.client.1.smithi064.stdout:8/84: chown d10/l16 1 1 2024-04-26T21:07:52.885 INFO:tasks.workunit.client.1.smithi064.stdout:8/85: dread - d10/f1f zero size 2024-04-26T21:07:52.891 INFO:tasks.workunit.client.1.smithi064.stdout:2/61: creat d12/d16/f19 x:0 0 0 2024-04-26T21:07:52.894 INFO:tasks.workunit.client.1.smithi064.stdout:9/71: fsync d0/f18 0 2024-04-26T21:07:52.894 INFO:tasks.workunit.client.1.smithi064.stdout:3/49: dread d1/f11 [0,4194304] 0 2024-04-26T21:07:52.895 INFO:tasks.workunit.client.1.smithi064.stdout:5/67: unlink l4 0 2024-04-26T21:07:52.895 INFO:tasks.workunit.client.1.smithi064.stdout:5/68: write f3 [4937895,21185] 0 2024-04-26T21:07:52.895 INFO:tasks.workunit.client.1.smithi064.stdout:5/69: fdatasync f9 0 2024-04-26T21:07:52.902 INFO:tasks.workunit.client.1.smithi064.stdout:7/55: symlink d6/lf 0 2024-04-26T21:07:52.903 INFO:tasks.workunit.client.1.smithi064.stdout:6/39: read f0 [7598957,54369] 0 2024-04-26T21:07:52.903 INFO:tasks.workunit.client.1.smithi064.stdout:4/89: write d0/d5/d13/f12 [4567318,116236] 0 2024-04-26T21:07:52.903 INFO:tasks.workunit.client.1.smithi064.stdout:1/87: dwrite d0/f3 [4194304,4194304] 0 2024-04-26T21:07:52.905 INFO:tasks.workunit.client.1.smithi064.stdout:2/62: unlink l3 0 2024-04-26T21:07:52.908 INFO:tasks.workunit.client.1.smithi064.stdout:8/86: dread ff [0,4194304] 0 2024-04-26T21:07:52.911 INFO:tasks.workunit.client.1.smithi064.stdout:9/72: symlink d0/d4/l1d 0 2024-04-26T21:07:52.912 INFO:tasks.workunit.client.1.smithi064.stdout:3/50: link d1/ff d1/da/f13 0 2024-04-26T21:07:52.912 INFO:tasks.workunit.client.1.smithi064.stdout:3/51: read - d1/da/f10 zero size 2024-04-26T21:07:52.926 INFO:tasks.workunit.client.1.smithi064.stdout:4/90: creat d0/d5/d13/de/f1b x:0 0 0 2024-04-26T21:07:52.928 INFO:tasks.workunit.client.1.smithi064.stdout:1/88: rename d0/f4 to d0/d6/f19 0 2024-04-26T21:07:52.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/63: mkdir d12/d1a 0 2024-04-26T21:07:52.931 INFO:tasks.workunit.client.1.smithi064.stdout:8/87: mknod d10/d1d/c23 0 2024-04-26T21:07:52.932 INFO:tasks.workunit.client.1.smithi064.stdout:8/88: truncate ff 4842593 0 2024-04-26T21:07:52.933 INFO:tasks.workunit.client.1.smithi064.stdout:3/52: mkdir d1/d14 0 2024-04-26T21:07:52.933 INFO:tasks.workunit.client.1.smithi064.stdout:3/53: truncate d1/f8 4966448 0 2024-04-26T21:07:52.934 INFO:tasks.workunit.client.1.smithi064.stdout:3/54: chown d1/ld 5899244 1 2024-04-26T21:07:52.934 INFO:tasks.workunit.client.1.smithi064.stdout:3/55: chown d1/f11 166 1 2024-04-26T21:07:52.938 INFO:tasks.workunit.client.1.smithi064.stdout:4/91: rmdir d0/d5 39 2024-04-26T21:07:52.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/89: getdents d0/d6/dd/de 0 2024-04-26T21:07:52.942 INFO:tasks.workunit.client.1.smithi064.stdout:2/64: mknod d12/c1b 0 2024-04-26T21:07:52.942 INFO:tasks.workunit.client.1.smithi064.stdout:2/65: readlink d12/l17 0 2024-04-26T21:07:52.946 INFO:tasks.workunit.client.1.smithi064.stdout:3/56: symlink d1/d12/l15 0 2024-04-26T21:07:52.947 INFO:tasks.workunit.client.1.smithi064.stdout:7/56: rename d6/la to d6/l10 0 2024-04-26T21:07:52.950 INFO:tasks.workunit.client.1.smithi064.stdout:2/66: link d12/l14 d12/d16/l1c 0 2024-04-26T21:07:52.952 INFO:tasks.workunit.client.1.smithi064.stdout:3/57: link d1/ld d1/d12/l16 0 2024-04-26T21:07:52.953 INFO:tasks.workunit.client.1.smithi064.stdout:6/40: truncate f0 1088884 0 2024-04-26T21:07:52.957 INFO:tasks.workunit.client.1.smithi064.stdout:2/67: rename l2 to d12/l1d 0 2024-04-26T21:07:52.958 INFO:tasks.workunit.client.1.smithi064.stdout:5/70: dwrite fa [0,4194304] 0 2024-04-26T21:07:52.958 INFO:tasks.workunit.client.1.smithi064.stdout:9/73: dwrite d0/d4/da/f14 [0,4194304] 0 2024-04-26T21:07:52.961 INFO:tasks.workunit.client.1.smithi064.stdout:7/57: rmdir d6/d9 39 2024-04-26T21:07:52.968 INFO:tasks.workunit.client.1.smithi064.stdout:5/71: rename f8 to dd/f11 0 2024-04-26T21:07:52.969 INFO:tasks.workunit.client.1.smithi064.stdout:1/90: dread d0/f3 [4194304,4194304] 0 2024-04-26T21:07:52.971 INFO:tasks.workunit.client.1.smithi064.stdout:9/74: truncate d0/f12 37768 0 2024-04-26T21:07:52.971 INFO:tasks.workunit.client.1.smithi064.stdout:7/58: creat d6/d9/f11 x:0 0 0 2024-04-26T21:07:52.988 INFO:tasks.workunit.client.1.smithi064.stdout:5/72: mkdir dd/d12 0 2024-04-26T21:07:52.990 INFO:tasks.workunit.client.1.smithi064.stdout:5/73: stat dd/fe 0 2024-04-26T21:07:52.991 INFO:tasks.workunit.client.1.smithi064.stdout:8/89: dwrite f4 [4194304,4194304] 0 2024-04-26T21:07:52.993 INFO:tasks.workunit.client.1.smithi064.stdout:6/41: unlink f0 0 2024-04-26T21:07:52.996 INFO:tasks.workunit.client.1.smithi064.stdout:9/75: symlink d0/d4/d7/l1e 0 2024-04-26T21:07:52.996 INFO:tasks.workunit.client.1.smithi064.stdout:9/76: chown d0/d4/d7 7807 1 2024-04-26T21:07:52.998 INFO:tasks.workunit.client.1.smithi064.stdout:6/42: rmdir d4 39 2024-04-26T21:07:52.998 INFO:tasks.workunit.client.1.smithi064.stdout:6/43: write - no filename 2024-04-26T21:07:52.998 INFO:tasks.workunit.client.1.smithi064.stdout:6/44: truncate - no filename 2024-04-26T21:07:52.998 INFO:tasks.workunit.client.1.smithi064.stdout:6/45: write - no filename 2024-04-26T21:07:53.002 INFO:tasks.workunit.client.1.smithi064.stdout:9/77: symlink d0/d4/d7/l1f 0 2024-04-26T21:07:53.006 INFO:tasks.workunit.client.1.smithi064.stdout:6/46: mknod d4/d7/c9 0 2024-04-26T21:07:53.006 INFO:tasks.workunit.client.1.smithi064.stdout:6/47: write - no filename 2024-04-26T21:07:53.006 INFO:tasks.workunit.client.1.smithi064.stdout:6/48: fdatasync - no filename 2024-04-26T21:07:53.006 INFO:tasks.workunit.client.1.smithi064.stdout:6/49: dwrite - no filename 2024-04-26T21:07:53.008 INFO:tasks.workunit.client.1.smithi064.stdout:2/68: dread fe [0,4194304] 0 2024-04-26T21:07:53.012 INFO:tasks.workunit.client.1.smithi064.stdout:2/69: symlink d12/d1a/l1e 0 2024-04-26T21:07:53.013 INFO:tasks.workunit.client.1.smithi064.stdout:2/70: dread - d12/d16/f19 zero size 2024-04-26T21:07:53.013 INFO:tasks.workunit.client.1.smithi064.stdout:6/50: symlink d4/la 0 2024-04-26T21:07:53.015 INFO:tasks.workunit.client.1.smithi064.stdout:2/71: symlink d12/d1a/l1f 0 2024-04-26T21:07:53.015 INFO:tasks.workunit.client.1.smithi064.stdout:2/72: write fe [4286073,67071] 0 2024-04-26T21:07:53.016 INFO:tasks.workunit.client.1.smithi064.stdout:2/73: write d12/d16/f19 [774974,6512] 0 2024-04-26T21:07:53.017 INFO:tasks.workunit.client.1.smithi064.stdout:6/51: creat d4/fb x:0 0 0 2024-04-26T21:07:53.017 INFO:tasks.workunit.client.1.smithi064.stdout:6/52: dread - d4/fb zero size 2024-04-26T21:07:53.024 INFO:tasks.workunit.client.1.smithi064.stdout:0/73: sync 2024-04-26T21:07:53.035 INFO:tasks.workunit.client.1.smithi064.stdout:0/74: rmdir dd/d10 39 2024-04-26T21:07:53.039 INFO:tasks.workunit.client.1.smithi064.stdout:1/91: dwrite d0/f13 [0,4194304] 0 2024-04-26T21:07:53.039 INFO:tasks.workunit.client.1.smithi064.stdout:1/92: write d0/d6/f19 [2888712,42273] 0 2024-04-26T21:07:53.041 INFO:tasks.workunit.client.1.smithi064.stdout:3/58: dwrite d1/f11 [4194304,4194304] 0 2024-04-26T21:07:53.051 INFO:tasks.workunit.client.1.smithi064.stdout:2/74: dread fe [0,4194304] 0 2024-04-26T21:07:53.051 INFO:tasks.workunit.client.1.smithi064.stdout:1/93: symlink d0/d6/dd/l1a 0 2024-04-26T21:07:53.055 INFO:tasks.workunit.client.1.smithi064.stdout:3/59: symlink d1/da/l17 0 2024-04-26T21:07:53.055 INFO:tasks.workunit.client.1.smithi064.stdout:3/60: fdatasync d1/ff 0 2024-04-26T21:07:53.055 INFO:tasks.workunit.client.1.smithi064.stdout:3/61: read d1/fc [1596966,62142] 0 2024-04-26T21:07:53.055 INFO:tasks.workunit.client.1.smithi064.stdout:3/62: write d1/f11 [634225,10820] 0 2024-04-26T21:07:53.061 INFO:tasks.workunit.client.1.smithi064.stdout:1/94: creat d0/d6/dd/de/f1b x:0 0 0 2024-04-26T21:07:53.083 INFO:tasks.workunit.client.1.smithi064.stdout:1/95: dread d0/d6/f19 [0,4194304] 0 2024-04-26T21:07:53.083 INFO:tasks.workunit.client.1.smithi064.stdout:1/96: fdatasync d0/f3 0 2024-04-26T21:07:53.088 INFO:tasks.workunit.client.1.smithi064.stdout:4/92: dwrite d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:53.089 INFO:tasks.workunit.client.1.smithi064.stdout:4/93: write d0/ff [1606227,97487] 0 2024-04-26T21:07:53.089 INFO:tasks.workunit.client.1.smithi064.stdout:4/94: dread - d0/d5/d13/f19 zero size 2024-04-26T21:07:53.089 INFO:tasks.workunit.client.1.smithi064.stdout:4/95: chown d0/d5/d13/de/f1b 409 1 2024-04-26T21:07:53.092 INFO:tasks.workunit.client.1.smithi064.stdout:4/96: symlink d0/d5/d13/d10/l1c 0 2024-04-26T21:07:53.100 INFO:tasks.workunit.client.1.smithi064.stdout:7/59: dwrite d6/d9/f11 [0,4194304] 0 2024-04-26T21:07:53.100 INFO:tasks.workunit.client.1.smithi064.stdout:5/74: dwrite dd/fe [0,4194304] 0 2024-04-26T21:07:53.100 INFO:tasks.workunit.client.1.smithi064.stdout:5/75: creat dd/f13 x:0 0 0 2024-04-26T21:07:53.101 INFO:tasks.workunit.client.1.smithi064.stdout:4/97: rename d0/d5/d13/de to d0/d1d 0 2024-04-26T21:07:53.102 INFO:tasks.workunit.client.1.smithi064.stdout:4/98: read d0/d5/d13/f16 [106944,65332] 0 2024-04-26T21:07:53.107 INFO:tasks.workunit.client.1.smithi064.stdout:9/78: dwrite d0/d4/d7/f9 [0,4194304] 0 2024-04-26T21:07:53.108 INFO:tasks.workunit.client.1.smithi064.stdout:9/79: write d0/d4/d7/fd [447954,92183] 0 2024-04-26T21:07:53.109 INFO:tasks.workunit.client.1.smithi064.stdout:7/60: stat l1 0 2024-04-26T21:07:53.110 INFO:tasks.workunit.client.1.smithi064.stdout:6/53: dwrite d4/fb [0,4194304] 0 2024-04-26T21:07:53.117 INFO:tasks.workunit.client.1.smithi064.stdout:6/54: symlink d4/lc 0 2024-04-26T21:07:53.120 INFO:tasks.workunit.client.1.smithi064.stdout:6/55: creat d4/d7/fd x:0 0 0 2024-04-26T21:07:53.120 INFO:tasks.workunit.client.1.smithi064.stdout:6/56: creat d4/d7/fe x:0 0 0 2024-04-26T21:07:53.120 INFO:tasks.workunit.client.1.smithi064.stdout:6/57: chown d4/la 3480 1 2024-04-26T21:07:53.120 INFO:tasks.workunit.client.1.smithi064.stdout:6/58: truncate d4/d7/fd 972921 0 2024-04-26T21:07:53.131 INFO:tasks.workunit.client.1.smithi064.stdout:8/90: dwrite ff [4194304,4194304] 0 2024-04-26T21:07:53.146 INFO:tasks.workunit.client.1.smithi064.stdout:1/97: dwrite d0/f13 [0,4194304] 0 2024-04-26T21:07:53.166 INFO:tasks.workunit.client.1.smithi064.stdout:5/76: write fb [598263,78982] 0 2024-04-26T21:07:53.166 INFO:tasks.workunit.client.1.smithi064.stdout:3/63: dwrite d1/f8 [4194304,4194304] 0 2024-04-26T21:07:53.166 INFO:tasks.workunit.client.1.smithi064.stdout:3/64: stat d1/da/fb 0 2024-04-26T21:07:53.166 INFO:tasks.workunit.client.1.smithi064.stdout:3/65: write d1/fc [9058090,28919] 0 2024-04-26T21:07:53.179 INFO:tasks.workunit.client.1.smithi064.stdout:6/59: rename d4/lc to d4/lf 0 2024-04-26T21:07:53.179 INFO:tasks.workunit.client.1.smithi064.stdout:6/60: chown d4/fb 10264296 1 2024-04-26T21:07:53.182 INFO:tasks.workunit.client.1.smithi064.stdout:2/75: dwrite d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.183 INFO:tasks.workunit.client.1.smithi064.stdout:7/61: write f3 [7372530,107442] 0 2024-04-26T21:07:53.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/77: mknod dd/d12/c14 0 2024-04-26T21:07:53.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/78: stat f7 0 2024-04-26T21:07:53.187 INFO:tasks.workunit.client.1.smithi064.stdout:3/66: symlink d1/da/l18 0 2024-04-26T21:07:53.194 INFO:tasks.workunit.client.1.smithi064.stdout:2/76: link cf d12/c20 0 2024-04-26T21:07:53.194 INFO:tasks.workunit.client.1.smithi064.stdout:4/99: dwrite d0/f1a [0,4194304] 0 2024-04-26T21:07:53.194 INFO:tasks.workunit.client.1.smithi064.stdout:8/91: dwrite d10/f1f [0,4194304] 0 2024-04-26T21:07:53.196 INFO:tasks.workunit.client.1.smithi064.stdout:1/98: rmdir d0/d6/dd/de 39 2024-04-26T21:07:53.196 INFO:tasks.workunit.client.1.smithi064.stdout:1/99: fsync d0/f12 0 2024-04-26T21:07:53.196 INFO:tasks.workunit.client.1.smithi064.stdout:1/100: fsync d0/d6/ff 0 2024-04-26T21:07:53.197 INFO:tasks.workunit.client.1.smithi064.stdout:3/67: mkdir d1/d19 0 2024-04-26T21:07:53.197 INFO:tasks.workunit.client.1.smithi064.stdout:3/68: dread - d1/da/f10 zero size 2024-04-26T21:07:53.223 INFO:tasks.workunit.client.1.smithi064.stdout:9/80: dwrite d0/f12 [0,4194304] 0 2024-04-26T21:07:53.223 INFO:tasks.workunit.client.1.smithi064.stdout:2/77: dread d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.231 INFO:tasks.workunit.client.1.smithi064.stdout:5/79: dwrite f7 [4194304,4194304] 0 2024-04-26T21:07:53.232 INFO:tasks.workunit.client.1.smithi064.stdout:7/62: mkdir d6/d12 0 2024-04-26T21:07:53.232 INFO:tasks.workunit.client.1.smithi064.stdout:7/63: fdatasync f2 0 2024-04-26T21:07:53.232 INFO:tasks.workunit.client.1.smithi064.stdout:7/64: chown d6/db/lc 60 1 2024-04-26T21:07:53.233 INFO:tasks.workunit.client.1.smithi064.stdout:1/101: symlink d0/d6/dd/l1c 0 2024-04-26T21:07:53.236 INFO:tasks.workunit.client.1.smithi064.stdout:3/69: link d1/da/fb d1/f1a 0 2024-04-26T21:07:53.236 INFO:tasks.workunit.client.1.smithi064.stdout:3/70: creat d1/f1b x:0 0 0 2024-04-26T21:07:53.236 INFO:tasks.workunit.client.1.smithi064.stdout:3/71: chown d1/d19 5616 1 2024-04-26T21:07:53.237 INFO:tasks.workunit.client.1.smithi064.stdout:2/78: dread d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.239 INFO:tasks.workunit.client.1.smithi064.stdout:6/61: rename d4/c8 to d4/c10 0 2024-04-26T21:07:53.239 INFO:tasks.workunit.client.1.smithi064.stdout:6/62: chown d4/d7/c9 26441 1 2024-04-26T21:07:53.241 INFO:tasks.workunit.client.1.smithi064.stdout:4/100: truncate d0/d5/d13/f12 2702609 0 2024-04-26T21:07:53.243 INFO:tasks.workunit.client.1.smithi064.stdout:8/92: truncate f4 1624450 0 2024-04-26T21:07:53.250 INFO:tasks.workunit.client.1.smithi064.stdout:5/80: rename dd/fe to dd/f15 0 2024-04-26T21:07:53.252 INFO:tasks.workunit.client.1.smithi064.stdout:7/65: truncate f2 2673183 0 2024-04-26T21:07:53.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 7.8 MiB/s wr, 417 op/s 2024-04-26T21:07:53.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: Standby manager daemon smithi055.ybbowr restarted 2024-04-26T21:07:53.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: Standby manager daemon smithi055.ybbowr started 2024-04-26T21:07:53.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/crt"}]: dispatch 2024-04-26T21:07:53.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:07:53.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/key"}]: dispatch 2024-04-26T21:07:53.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:52 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:07:53.256 INFO:tasks.workunit.client.1.smithi064.stdout:1/102: link d0/d6/dd/de/f1b d0/d6/d11/f1d 0 2024-04-26T21:07:53.257 INFO:tasks.workunit.client.1.smithi064.stdout:9/81: dwrite d0/d4/da/f14 [4194304,4194304] 0 2024-04-26T21:07:53.263 INFO:tasks.workunit.client.1.smithi064.stdout:4/101: mknod d0/d5/c1e 0 2024-04-26T21:07:53.268 INFO:tasks.workunit.client.1.smithi064.stdout:9/82: creat d0/d4/d7/f20 x:0 0 0 2024-04-26T21:07:53.272 INFO:tasks.workunit.client.1.smithi064.stdout:6/63: getdents d4/d7 0 2024-04-26T21:07:53.274 INFO:tasks.workunit.client.1.smithi064.stdout:4/102: creat d0/d1d/d17/f1f x:0 0 0 2024-04-26T21:07:53.278 INFO:tasks.workunit.client.1.smithi064.stdout:8/93: getdents d10/d1d 0 2024-04-26T21:07:53.281 INFO:tasks.workunit.client.1.smithi064.stdout:6/64: symlink d4/d7/l11 0 2024-04-26T21:07:53.283 INFO:tasks.workunit.client.1.smithi064.stdout:6/65: write d4/d7/fd [988592,40485] 0 2024-04-26T21:07:53.283 INFO:tasks.workunit.client.1.smithi064.stdout:4/103: symlink d0/d5/d13/l20 0 2024-04-26T21:07:53.287 INFO:tasks.workunit.client.1.smithi064.stdout:4/104: mkdir d0/d1d/d21 0 2024-04-26T21:07:53.293 INFO:tasks.workunit.client.1.smithi064.stdout:1/103: dread d0/f3 [4194304,4194304] 0 2024-04-26T21:07:53.293 INFO:tasks.workunit.client.1.smithi064.stdout:1/104: write d0/d6/d11/f1d [794543,71118] 0 2024-04-26T21:07:53.311 INFO:tasks.workunit.client.1.smithi064.stdout:2/79: dwrite fe [0,4194304] 0 2024-04-26T21:07:53.313 INFO:tasks.workunit.client.1.smithi064.stdout:5/81: dwrite dd/f11 [0,4194304] 0 2024-04-26T21:07:53.313 INFO:tasks.workunit.client.1.smithi064.stdout:5/82: chown fa 2 1 2024-04-26T21:07:53.319 INFO:tasks.workunit.client.1.smithi064.stdout:0/75: sync 2024-04-26T21:07:53.320 INFO:tasks.workunit.client.1.smithi064.stdout:3/72: truncate d1/fc 3047152 0 2024-04-26T21:07:53.324 INFO:tasks.workunit.client.1.smithi064.stdout:2/80: mknod d12/d1a/c21 0 2024-04-26T21:07:53.336 INFO:tasks.workunit.client.1.smithi064.stdout:3/73: fsync d1/da/fb 0 2024-04-26T21:07:53.336 INFO:tasks.workunit.client.1.smithi064.stdout:5/83: dread f5 [0,4194304] 0 2024-04-26T21:07:53.336 INFO:tasks.workunit.client.1.smithi064.stdout:4/105: dwrite d0/d5/d13/f16 [0,4194304] 0 2024-04-26T21:07:53.345 INFO:tasks.workunit.client.1.smithi064.stdout:3/74: rmdir d1/da 39 2024-04-26T21:07:53.345 INFO:tasks.workunit.client.1.smithi064.stdout:3/75: read - d1/f1a zero size 2024-04-26T21:07:53.346 INFO:tasks.workunit.client.1.smithi064.stdout:4/106: getdents d0 0 2024-04-26T21:07:53.348 INFO:tasks.workunit.client.1.smithi064.stdout:9/83: dwrite d0/d4/d7/df/f1b [0,4194304] 0 2024-04-26T21:07:53.348 INFO:tasks.workunit.client.1.smithi064.stdout:2/81: write fe [2017425,122835] 0 2024-04-26T21:07:53.350 INFO:tasks.workunit.client.1.smithi064.stdout:3/76: creat d1/d14/f1c x:0 0 0 2024-04-26T21:07:53.350 INFO:tasks.workunit.client.1.smithi064.stdout:3/77: chown d1/d12 529986105 1 2024-04-26T21:07:53.350 INFO:tasks.workunit.client.1.smithi064.stdout:3/78: dread - d1/ff zero size 2024-04-26T21:07:53.350 INFO:tasks.workunit.client.1.smithi064.stdout:3/79: chown d1/da/l18 1131529803 1 2024-04-26T21:07:53.360 INFO:tasks.workunit.client.1.smithi064.stdout:1/105: rename d0/d6/dd/de to d0/d6/d11/d1e 0 2024-04-26T21:07:53.360 INFO:tasks.workunit.client.1.smithi064.stdout:1/106: creat d0/f1f x:0 0 0 2024-04-26T21:07:53.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/82: mkdir d12/d22 0 2024-04-26T21:07:53.362 INFO:tasks.workunit.client.1.smithi064.stdout:5/84: dread dd/f11 [0,4194304] 0 2024-04-26T21:07:53.362 INFO:tasks.workunit.client.1.smithi064.stdout:5/85: creat dd/f16 x:0 0 0 2024-04-26T21:07:53.368 INFO:tasks.workunit.client.1.smithi064.stdout:6/66: dwrite d4/d7/fd [0,4194304] 0 2024-04-26T21:07:53.368 INFO:tasks.workunit.client.1.smithi064.stdout:6/67: write d4/d7/fe [700647,94530] 0 2024-04-26T21:07:53.372 INFO:tasks.workunit.client.1.smithi064.stdout:4/107: dread d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:53.373 INFO:tasks.workunit.client.1.smithi064.stdout:3/80: symlink d1/d12/l1d 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:7/66: dread f2 [0,4194304] 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/107: link d0/d6/f19 d0/d6/d11/d1e/f20 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/108: write d0/d6/ff [92473,74012] 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/109: read d0/d6/ff [59147,55199] 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/110: readlink d0/d6/dd/l1c 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/111: chown d0/d6/d11/d1e 11 1 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:2/83: write d12/d16/f19 [1624317,16726] 0 2024-04-26T21:07:53.378 INFO:tasks.workunit.client.1.smithi064.stdout:2/84: write fe [3420312,79366] 0 2024-04-26T21:07:53.379 INFO:tasks.workunit.client.1.smithi064.stdout:0/76: rename ca to dd/c13 0 2024-04-26T21:07:53.379 INFO:tasks.workunit.client.1.smithi064.stdout:0/77: write fc [385711,128269] 0 2024-04-26T21:07:53.383 INFO:tasks.workunit.client.1.smithi064.stdout:5/86: mknod dd/d12/c17 0 2024-04-26T21:07:53.384 INFO:tasks.workunit.client.1.smithi064.stdout:4/108: symlink d0/l22 0 2024-04-26T21:07:53.389 INFO:tasks.workunit.client.1.smithi064.stdout:3/81: unlink d1/d12/l1d 0 2024-04-26T21:07:53.389 INFO:tasks.workunit.client.1.smithi064.stdout:3/82: readlink d1/d12/l15 0 2024-04-26T21:07:53.389 INFO:tasks.workunit.client.1.smithi064.stdout:3/83: write d1/f1a [5500,118894] 0 2024-04-26T21:07:53.389 INFO:tasks.workunit.client.1.smithi064.stdout:1/112: creat d0/d6/d11/d1e/f21 x:0 0 0 2024-04-26T21:07:53.390 INFO:tasks.workunit.client.1.smithi064.stdout:6/68: write d4/fb [2605420,17890] 0 2024-04-26T21:07:53.391 INFO:tasks.workunit.client.1.smithi064.stdout:9/84: rename d0/d4/d7/df/l10 to d0/d4/da/l21 0 2024-04-26T21:07:53.391 INFO:tasks.workunit.client.1.smithi064.stdout:9/85: fsync d0/f12 0 2024-04-26T21:07:53.393 INFO:tasks.workunit.client.1.smithi064.stdout:6/69: mkdir d4/d7/d12 0 2024-04-26T21:07:53.398 INFO:tasks.workunit.client.1.smithi064.stdout:7/67: dread f3 [4194304,4194304] 0 2024-04-26T21:07:53.398 INFO:tasks.workunit.client.1.smithi064.stdout:7/68: write d6/d9/fd [164330,12123] 0 2024-04-26T21:07:53.398 INFO:tasks.workunit.client.1.smithi064.stdout:7/69: write d6/d9/fd [4872441,22565] 0 2024-04-26T21:07:53.400 INFO:tasks.workunit.client.1.smithi064.stdout:0/78: dread f5 [0,4194304] 0 2024-04-26T21:07:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: pgmap v29: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 7.8 MiB/s wr, 417 op/s 2024-04-26T21:07:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: Standby manager daemon smithi055.ybbowr restarted 2024-04-26T21:07:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: Standby manager daemon smithi055.ybbowr started 2024-04-26T21:07:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/crt"}]: dispatch 2024-04-26T21:07:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:07:53.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi055.ybbowr/key"}]: dispatch 2024-04-26T21:07:53.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:52 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:07:53.417 INFO:tasks.workunit.client.1.smithi064.stdout:7/70: symlink d6/d12/l13 0 2024-04-26T21:07:53.417 INFO:tasks.workunit.client.1.smithi064.stdout:1/113: dread d0/f3 [0,4194304] 0 2024-04-26T21:07:53.421 INFO:tasks.workunit.client.1.smithi064.stdout:7/71: symlink d6/d9/l14 0 2024-04-26T21:07:53.427 INFO:tasks.workunit.client.1.smithi064.stdout:1/114: dread d0/d6/f19 [0,4194304] 0 2024-04-26T21:07:53.428 INFO:tasks.workunit.client.1.smithi064.stdout:1/115: chown d0/f15 237777 1 2024-04-26T21:07:53.428 INFO:tasks.workunit.client.1.smithi064.stdout:1/116: dread - d0/f12 zero size 2024-04-26T21:07:53.428 INFO:tasks.workunit.client.1.smithi064.stdout:7/72: mkdir d6/d15 0 2024-04-26T21:07:53.431 INFO:tasks.workunit.client.1.smithi064.stdout:2/85: dread d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.432 INFO:tasks.workunit.client.1.smithi064.stdout:2/86: write d12/d16/f19 [4315643,68248] 0 2024-04-26T21:07:53.432 INFO:tasks.workunit.client.1.smithi064.stdout:2/87: chown d12/d16 0 1 2024-04-26T21:07:53.434 INFO:tasks.workunit.client.1.smithi064.stdout:1/117: unlink d0/f13 0 2024-04-26T21:07:53.438 INFO:tasks.workunit.client.1.smithi064.stdout:7/73: symlink d6/db/l16 0 2024-04-26T21:07:53.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/87: dread fa [0,4194304] 0 2024-04-26T21:07:53.439 INFO:tasks.workunit.client.1.smithi064.stdout:2/88: mknod d12/d1a/c23 0 2024-04-26T21:07:53.444 INFO:tasks.workunit.client.1.smithi064.stdout:1/118: mkdir d0/d22 0 2024-04-26T21:07:53.445 INFO:tasks.workunit.client.1.smithi064.stdout:5/88: mkdir dd/d12/d18 0 2024-04-26T21:07:53.447 INFO:tasks.workunit.client.1.smithi064.stdout:4/109: dwrite d0/d1d/f1b [0,4194304] 0 2024-04-26T21:07:53.447 INFO:tasks.workunit.client.1.smithi064.stdout:4/110: fdatasync d0/d5/d13/f19 0 2024-04-26T21:07:53.447 INFO:tasks.workunit.client.1.smithi064.stdout:4/111: chown d0/d5/d13/f16 11259864 1 2024-04-26T21:07:53.447 INFO:tasks.workunit.client.1.smithi064.stdout:2/89: rmdir d12/d22 0 2024-04-26T21:07:53.456 INFO:tasks.workunit.client.1.smithi064.stdout:3/84: dwrite d1/da/f13 [0,4194304] 0 2024-04-26T21:07:53.457 INFO:tasks.workunit.client.1.smithi064.stdout:0/79: dwrite dd/f12 [0,4194304] 0 2024-04-26T21:07:53.459 INFO:tasks.workunit.client.1.smithi064.stdout:7/74: write f2 [1441949,127085] 0 2024-04-26T21:07:53.460 INFO:tasks.workunit.client.1.smithi064.stdout:4/112: link d0/d5/d13/cd d0/c23 0 2024-04-26T21:07:53.460 INFO:tasks.workunit.client.1.smithi064.stdout:2/90: unlink ca 0 2024-04-26T21:07:53.462 INFO:tasks.workunit.client.1.smithi064.stdout:3/85: fsync d1/da/fb 0 2024-04-26T21:07:53.462 INFO:tasks.workunit.client.1.smithi064.stdout:3/86: stat d1 0 2024-04-26T21:07:53.467 INFO:tasks.workunit.client.1.smithi064.stdout:9/86: dwrite d0/d4/d7/fd [4194304,4194304] 0 2024-04-26T21:07:53.467 INFO:tasks.workunit.client.1.smithi064.stdout:5/89: dread f7 [0,4194304] 0 2024-04-26T21:07:53.468 INFO:tasks.workunit.client.1.smithi064.stdout:5/90: readlink - no filename 2024-04-26T21:07:53.470 INFO:tasks.workunit.client.1.smithi064.stdout:7/75: mknod d6/d9/c17 0 2024-04-26T21:07:53.473 INFO:tasks.workunit.client.1.smithi064.stdout:2/91: creat d12/f24 x:0 0 0 2024-04-26T21:07:53.477 INFO:tasks.workunit.client.1.smithi064.stdout:3/87: creat d1/d12/f1e x:0 0 0 2024-04-26T21:07:53.477 INFO:tasks.workunit.client.1.smithi064.stdout:3/88: fsync d1/fc 0 2024-04-26T21:07:53.477 INFO:tasks.workunit.client.1.smithi064.stdout:0/80: dread dd/f12 [0,4194304] 0 2024-04-26T21:07:53.477 INFO:tasks.workunit.client.1.smithi064.stdout:4/113: write d0/d5/d13/f12 [2572717,96994] 0 2024-04-26T21:07:53.478 INFO:tasks.workunit.client.1.smithi064.stdout:4/114: read - d0/d5/d13/f19 zero size 2024-04-26T21:07:53.480 INFO:tasks.workunit.client.1.smithi064.stdout:9/87: creat d0/d4/da/f22 x:0 0 0 2024-04-26T21:07:53.481 INFO:tasks.workunit.client.1.smithi064.stdout:1/119: getdents d0/d6/d11/d1e 0 2024-04-26T21:07:53.482 INFO:tasks.workunit.client.1.smithi064.stdout:1/120: chown d0/cc 3497232 1 2024-04-26T21:07:53.483 INFO:tasks.workunit.client.1.smithi064.stdout:2/92: mknod d12/d16/c25 0 2024-04-26T21:07:53.483 INFO:tasks.workunit.client.1.smithi064.stdout:2/93: chown d12/d1a/c23 3317856 1 2024-04-26T21:07:53.483 INFO:tasks.workunit.client.1.smithi064.stdout:2/94: stat d12 0 2024-04-26T21:07:53.485 INFO:tasks.workunit.client.1.smithi064.stdout:4/115: mknod d0/d1d/c24 0 2024-04-26T21:07:53.485 INFO:tasks.workunit.client.1.smithi064.stdout:4/116: write d0/d5/d13/f12 [1606037,112096] 0 2024-04-26T21:07:53.487 INFO:tasks.workunit.client.1.smithi064.stdout:5/91: dread dd/f15 [0,4194304] 0 2024-04-26T21:07:53.487 INFO:tasks.workunit.client.1.smithi064.stdout:5/92: chown fa 985 1 2024-04-26T21:07:53.487 INFO:tasks.workunit.client.1.smithi064.stdout:3/89: dread d1/fc [0,4194304] 0 2024-04-26T21:07:53.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/81: dread fc [0,4194304] 0 2024-04-26T21:07:53.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/82: creat dd/f14 x:0 0 0 2024-04-26T21:07:53.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/83: truncate f5 1500261 0 2024-04-26T21:07:53.489 INFO:tasks.workunit.client.1.smithi064.stdout:9/88: getdents d0/d4 0 2024-04-26T21:07:53.489 INFO:tasks.workunit.client.1.smithi064.stdout:9/89: stat d0/d4/d7/f20 0 2024-04-26T21:07:53.489 INFO:tasks.workunit.client.1.smithi064.stdout:1/121: rename d0/f15 to d0/d6/d11/f23 0 2024-04-26T21:07:53.496 INFO:tasks.workunit.client.1.smithi064.stdout:5/93: unlink dd/f15 0 2024-04-26T21:07:53.496 INFO:tasks.workunit.client.1.smithi064.stdout:5/94: chown fa 198981870 1 2024-04-26T21:07:53.498 INFO:tasks.workunit.client.1.smithi064.stdout:0/84: getdents dd/d10 0 2024-04-26T21:07:53.498 INFO:tasks.workunit.client.1.smithi064.stdout:0/85: chown dd/d10 1124919 1 2024-04-26T21:07:53.498 INFO:tasks.workunit.client.1.smithi064.stdout:0/86: chown dd/ce 3849 1 2024-04-26T21:07:53.498 INFO:tasks.workunit.client.1.smithi064.stdout:0/87: creat dd/f15 x:0 0 0 2024-04-26T21:07:53.499 INFO:tasks.workunit.client.1.smithi064.stdout:1/122: symlink d0/l24 0 2024-04-26T21:07:53.499 INFO:tasks.workunit.client.1.smithi064.stdout:1/123: dread - d0/d6/d11/f23 zero size 2024-04-26T21:07:53.499 INFO:tasks.workunit.client.1.smithi064.stdout:6/70: write d4/d7/fd [4888706,4238] 0 2024-04-26T21:07:53.499 INFO:tasks.workunit.client.1.smithi064.stdout:6/71: chown d4/d7/fe 78 1 2024-04-26T21:07:53.500 INFO:tasks.workunit.client.1.smithi064.stdout:2/95: truncate fe 3894841 0 2024-04-26T21:07:53.500 INFO:tasks.workunit.client.1.smithi064.stdout:2/96: write d12/d16/f19 [1316289,4375] 0 2024-04-26T21:07:53.505 INFO:tasks.workunit.client.1.smithi064.stdout:8/94: sync 2024-04-26T21:07:53.505 INFO:tasks.workunit.client.1.smithi064.stdout:0/88: creat dd/d10/f16 x:0 0 0 2024-04-26T21:07:53.505 INFO:tasks.workunit.client.1.smithi064.stdout:0/89: dread - dd/f14 zero size 2024-04-26T21:07:53.508 INFO:tasks.workunit.client.1.smithi064.stdout:6/72: fdatasync d4/fb 0 2024-04-26T21:07:53.509 INFO:tasks.workunit.client.1.smithi064.stdout:1/124: mknod d0/d22/c25 0 2024-04-26T21:07:53.510 INFO:tasks.workunit.client.1.smithi064.stdout:1/125: chown d0 583491 1 2024-04-26T21:07:53.510 INFO:tasks.workunit.client.1.smithi064.stdout:1/126: truncate d0/d6/f19 5412820 0 2024-04-26T21:07:53.517 INFO:tasks.workunit.client.1.smithi064.stdout:1/127: mknod d0/c26 0 2024-04-26T21:07:53.517 INFO:tasks.workunit.client.1.smithi064.stdout:1/128: dread - d0/d6/d11/f18 zero size 2024-04-26T21:07:53.520 INFO:tasks.workunit.client.1.smithi064.stdout:6/73: symlink d4/l13 0 2024-04-26T21:07:53.527 INFO:tasks.workunit.client.1.smithi064.stdout:9/90: read d0/d4/d7/f9 [3709004,90462] 0 2024-04-26T21:07:53.527 INFO:tasks.workunit.client.1.smithi064.stdout:9/91: dread - d0/d4/d7/f20 zero size 2024-04-26T21:07:53.527 INFO:tasks.workunit.client.1.smithi064.stdout:6/74: creat d4/d7/d12/f14 x:0 0 0 2024-04-26T21:07:53.528 INFO:tasks.workunit.client.1.smithi064.stdout:6/75: truncate d4/d7/fe 1102636 0 2024-04-26T21:07:53.528 INFO:tasks.workunit.client.1.smithi064.stdout:2/97: dread d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.528 INFO:tasks.workunit.client.1.smithi064.stdout:2/98: chown d12/d1a/c23 62160 1 2024-04-26T21:07:53.529 INFO:tasks.workunit.client.1.smithi064.stdout:6/76: write d4/d7/fe [922688,32507] 0 2024-04-26T21:07:53.532 INFO:tasks.workunit.client.1.smithi064.stdout:2/99: rename d12/l17 to d12/l26 0 2024-04-26T21:07:53.532 INFO:tasks.workunit.client.1.smithi064.stdout:2/100: stat d12/d1a/c21 0 2024-04-26T21:07:53.532 INFO:tasks.workunit.client.1.smithi064.stdout:2/101: write d12/f24 [917769,16194] 0 2024-04-26T21:07:53.534 INFO:tasks.workunit.client.1.smithi064.stdout:8/95: dread d10/f1f [0,4194304] 0 2024-04-26T21:07:53.534 INFO:tasks.workunit.client.1.smithi064.stdout:8/96: creat d10/f24 x:0 0 0 2024-04-26T21:07:53.537 INFO:tasks.workunit.client.1.smithi064.stdout:2/102: rename l6 to d12/d1a/l27 0 2024-04-26T21:07:53.537 INFO:tasks.workunit.client.1.smithi064.stdout:6/77: symlink d4/l15 0 2024-04-26T21:07:53.540 INFO:tasks.workunit.client.1.smithi064.stdout:8/97: rmdir d10/d1d 39 2024-04-26T21:07:53.543 INFO:tasks.workunit.client.1.smithi064.stdout:2/103: mkdir d12/d28 0 2024-04-26T21:07:53.543 INFO:tasks.workunit.client.1.smithi064.stdout:4/117: dwrite d0/f1a [0,4194304] 0 2024-04-26T21:07:53.545 INFO:tasks.workunit.client.1.smithi064.stdout:3/90: dwrite d1/f8 [0,4194304] 0 2024-04-26T21:07:53.546 INFO:tasks.workunit.client.1.smithi064.stdout:2/104: write d12/f24 [154774,13840] 0 2024-04-26T21:07:53.546 INFO:tasks.workunit.client.1.smithi064.stdout:8/98: mkdir d10/d1d/d25 0 2024-04-26T21:07:53.547 INFO:tasks.workunit.client.1.smithi064.stdout:3/91: creat d1/d12/f1f x:0 0 0 2024-04-26T21:07:53.554 INFO:tasks.workunit.client.1.smithi064.stdout:8/99: rename d10/l21 to d10/d1d/l26 0 2024-04-26T21:07:53.556 INFO:tasks.workunit.client.1.smithi064.stdout:9/92: write d0/d4/d7/df/f1b [2396687,13724] 0 2024-04-26T21:07:53.557 INFO:tasks.workunit.client.1.smithi064.stdout:3/92: creat d1/da/f20 x:0 0 0 2024-04-26T21:07:53.558 INFO:tasks.workunit.client.1.smithi064.stdout:3/93: stat d1/f1b 0 2024-04-26T21:07:53.559 INFO:tasks.workunit.client.1.smithi064.stdout:7/76: getdents d6/d9 0 2024-04-26T21:07:53.571 INFO:tasks.workunit.client.1.smithi064.stdout:3/94: rmdir d1/d19 0 2024-04-26T21:07:53.571 INFO:tasks.workunit.client.1.smithi064.stdout:0/90: dwrite fb [0,4194304] 0 2024-04-26T21:07:53.571 INFO:tasks.workunit.client.1.smithi064.stdout:7/77: rmdir d6/d12 39 2024-04-26T21:07:53.571 INFO:tasks.workunit.client.1.smithi064.stdout:7/78: fsync f3 0 2024-04-26T21:07:53.573 INFO:tasks.workunit.client.1.smithi064.stdout:5/95: dwrite f7 [8388608,4194304] 0 2024-04-26T21:07:53.581 INFO:tasks.workunit.client.1.smithi064.stdout:8/100: write ff [1552449,112494] 0 2024-04-26T21:07:53.582 INFO:tasks.workunit.client.1.smithi064.stdout:8/101: dread - d10/f24 zero size 2024-04-26T21:07:53.582 INFO:tasks.workunit.client.1.smithi064.stdout:8/102: getdents d10/d1d/d25 0 2024-04-26T21:07:53.583 INFO:tasks.workunit.client.1.smithi064.stdout:0/91: dread f5 [0,4194304] 0 2024-04-26T21:07:53.587 INFO:tasks.workunit.client.1.smithi064.stdout:0/92: link l4 dd/d10/l17 0 2024-04-26T21:07:53.600 INFO:tasks.workunit.client.1.smithi064.stdout:6/78: rmdir d4/d7/d12 39 2024-04-26T21:07:53.607 INFO:tasks.workunit.client.1.smithi064.stdout:2/105: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:53.610 INFO:tasks.workunit.client.1.smithi064.stdout:4/118: dwrite d0/d1d/d17/f1f [0,4194304] 0 2024-04-26T21:07:53.610 INFO:tasks.workunit.client.1.smithi064.stdout:4/119: chown d0/d1d 3 1 2024-04-26T21:07:53.618 INFO:tasks.workunit.client.1.smithi064.stdout:4/120: truncate d0/f11 463063 0 2024-04-26T21:07:53.619 INFO:tasks.workunit.client.1.smithi064.stdout:4/121: creat d0/d1d/d17/f25 x:0 0 0 2024-04-26T21:07:53.620 INFO:tasks.workunit.client.1.smithi064.stdout:5/96: dread f9 [0,4194304] 0 2024-04-26T21:07:53.622 INFO:tasks.workunit.client.1.smithi064.stdout:7/79: dwrite f5 [0,4194304] 0 2024-04-26T21:07:53.629 INFO:tasks.workunit.client.1.smithi064.stdout:3/95: read d1/f11 [1857772,844] 0 2024-04-26T21:07:53.630 INFO:tasks.workunit.client.1.smithi064.stdout:5/97: symlink dd/d12/l19 0 2024-04-26T21:07:53.631 INFO:tasks.workunit.client.1.smithi064.stdout:8/103: getdents d10/d1d 0 2024-04-26T21:07:53.631 INFO:tasks.workunit.client.1.smithi064.stdout:7/80: mknod d6/db/c18 0 2024-04-26T21:07:53.632 INFO:tasks.workunit.client.1.smithi064.stdout:1/129: dwrite d0/d6/f19 [0,4194304] 0 2024-04-26T21:07:53.639 INFO:tasks.workunit.client.1.smithi064.stdout:3/96: unlink d1/l5 0 2024-04-26T21:07:53.639 INFO:tasks.workunit.client.1.smithi064.stdout:5/98: mkdir dd/d12/d18/d1a 0 2024-04-26T21:07:53.639 INFO:tasks.workunit.client.1.smithi064.stdout:8/104: link c6 d10/d1d/c27 0 2024-04-26T21:07:53.640 INFO:tasks.workunit.client.1.smithi064.stdout:7/81: rename f2 to d6/d9/f19 0 2024-04-26T21:07:53.641 INFO:tasks.workunit.client.1.smithi064.stdout:9/93: dwrite d0/d4/da/fc [4194304,4194304] 0 2024-04-26T21:07:53.641 INFO:tasks.workunit.client.1.smithi064.stdout:0/93: dwrite dd/d10/f16 [0,4194304] 0 2024-04-26T21:07:53.642 INFO:tasks.workunit.client.1.smithi064.stdout:1/130: mkdir d0/d6/d11/d1e/d27 0 2024-04-26T21:07:53.642 INFO:tasks.workunit.client.1.smithi064.stdout:1/131: stat d0/d6/d11/f23 0 2024-04-26T21:07:53.643 INFO:tasks.workunit.client.1.smithi064.stdout:5/99: mkdir dd/d12/d18/d1a/d1b 0 2024-04-26T21:07:53.645 INFO:tasks.workunit.client.1.smithi064.stdout:7/82: creat d6/d9/f1a x:0 0 0 2024-04-26T21:07:53.651 INFO:tasks.workunit.client.1.smithi064.stdout:9/94: creat d0/d4/d15/f23 x:0 0 0 2024-04-26T21:07:53.652 INFO:tasks.workunit.client.1.smithi064.stdout:9/95: fsync d0/d4/da/fc 0 2024-04-26T21:07:53.652 INFO:tasks.workunit.client.1.smithi064.stdout:9/96: write d0/d4/d7/df/f1b [2426969,62070] 0 2024-04-26T21:07:53.654 INFO:tasks.workunit.client.1.smithi064.stdout:1/132: mknod d0/d6/d11/d1e/c28 0 2024-04-26T21:07:53.657 INFO:tasks.workunit.client.1.smithi064.stdout:5/100: rename dd/d12/l19 to dd/d12/d18/l1c 0 2024-04-26T21:07:53.657 INFO:tasks.workunit.client.1.smithi064.stdout:5/101: dread - dd/f16 zero size 2024-04-26T21:07:53.657 INFO:tasks.workunit.client.1.smithi064.stdout:5/102: read - dd/ff zero size 2024-04-26T21:07:53.658 INFO:tasks.workunit.client.1.smithi064.stdout:7/83: mknod d6/d15/c1b 0 2024-04-26T21:07:53.667 INFO:tasks.workunit.client.1.smithi064.stdout:1/133: rmdir d0/d6/dd 39 2024-04-26T21:07:53.669 INFO:tasks.workunit.client.1.smithi064.stdout:7/84: mkdir d6/d15/d1c 0 2024-04-26T21:07:53.669 INFO:tasks.workunit.client.1.smithi064.stdout:7/85: chown l1 1968 1 2024-04-26T21:07:53.671 INFO:tasks.workunit.client.1.smithi064.stdout:9/97: rmdir d0/d4/d7/df 39 2024-04-26T21:07:53.673 INFO:tasks.workunit.client.1.smithi064.stdout:1/134: mkdir d0/d6/d29 0 2024-04-26T21:07:53.673 INFO:tasks.workunit.client.1.smithi064.stdout:1/135: write d0/d6/d11/f1d [1207214,25310] 0 2024-04-26T21:07:53.673 INFO:tasks.workunit.client.1.smithi064.stdout:6/79: dwrite d4/d7/fd [0,4194304] 0 2024-04-26T21:07:53.674 INFO:tasks.workunit.client.1.smithi064.stdout:5/103: dread f9 [0,4194304] 0 2024-04-26T21:07:53.674 INFO:tasks.workunit.client.1.smithi064.stdout:5/104: readlink dd/d12/d18/l1c 0 2024-04-26T21:07:53.676 INFO:tasks.workunit.client.1.smithi064.stdout:9/98: creat d0/d4/f24 x:0 0 0 2024-04-26T21:07:53.676 INFO:tasks.workunit.client.1.smithi064.stdout:9/99: fsync d0/f18 0 2024-04-26T21:07:53.677 INFO:tasks.workunit.client.1.smithi064.stdout:1/136: mkdir d0/d6/d11/d1e/d2a 0 2024-04-26T21:07:53.678 INFO:tasks.workunit.client.1.smithi064.stdout:6/80: stat d4/c10 0 2024-04-26T21:07:53.679 INFO:tasks.workunit.client.1.smithi064.stdout:6/81: truncate d4/d7/d12/f14 530522 0 2024-04-26T21:07:53.679 INFO:tasks.workunit.client.1.smithi064.stdout:6/82: chown d4/d7 199073296 1 2024-04-26T21:07:53.679 INFO:tasks.workunit.client.1.smithi064.stdout:6/83: readlink d4/l15 0 2024-04-26T21:07:53.682 INFO:tasks.workunit.client.1.smithi064.stdout:9/100: rename d0/d4/d7/l1e to d0/d4/d15/l25 0 2024-04-26T21:07:53.682 INFO:tasks.workunit.client.1.smithi064.stdout:8/105: dread f4 [0,4194304] 0 2024-04-26T21:07:53.683 INFO:tasks.workunit.client.1.smithi064.stdout:6/84: creat d4/f16 x:0 0 0 2024-04-26T21:07:53.684 INFO:tasks.workunit.client.1.smithi064.stdout:9/101: truncate d0/d4/da/f14 2601225 0 2024-04-26T21:07:53.685 INFO:tasks.workunit.client.1.smithi064.stdout:5/105: dread f5 [4194304,4194304] 0 2024-04-26T21:07:53.685 INFO:tasks.workunit.client.1.smithi064.stdout:5/106: fdatasync dd/f10 0 2024-04-26T21:07:53.686 INFO:tasks.workunit.client.1.smithi064.stdout:8/106: rename d10/l1c to d10/l28 0 2024-04-26T21:07:53.695 INFO:tasks.workunit.client.1.smithi064.stdout:2/106: truncate d12/f24 612424 0 2024-04-26T21:07:53.695 INFO:tasks.workunit.client.1.smithi064.stdout:2/107: write fe [4287281,43017] 0 2024-04-26T21:07:53.695 INFO:tasks.workunit.client.1.smithi064.stdout:2/108: fdatasync d12/d16/f19 0 2024-04-26T21:07:53.696 INFO:tasks.workunit.client.1.smithi064.stdout:3/97: dwrite d1/d12/f1e [0,4194304] 0 2024-04-26T21:07:53.696 INFO:tasks.workunit.client.1.smithi064.stdout:3/98: creat d1/da/f21 x:0 0 0 2024-04-26T21:07:53.698 INFO:tasks.workunit.client.1.smithi064.stdout:5/107: rename f5 to dd/d12/d18/f1d 0 2024-04-26T21:07:53.698 INFO:tasks.workunit.client.1.smithi064.stdout:5/108: creat dd/f1e x:0 0 0 2024-04-26T21:07:53.699 INFO:tasks.workunit.client.1.smithi064.stdout:4/122: dread d0/f11 [0,4194304] 0 2024-04-26T21:07:53.700 INFO:tasks.workunit.client.1.smithi064.stdout:1/137: dread d0/d6/d11/f1d [0,4194304] 0 2024-04-26T21:07:53.709 INFO:tasks.workunit.client.1.smithi064.stdout:3/99: unlink d1/d12/f1e 0 2024-04-26T21:07:53.716 INFO:tasks.workunit.client.1.smithi064.stdout:5/109: mkdir dd/d12/d18/d1a/d1f 0 2024-04-26T21:07:53.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/123: link d0/d5/l6 d0/d1d/l26 0 2024-04-26T21:07:53.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/124: stat d0/d5/c15 0 2024-04-26T21:07:53.730 INFO:tasks.workunit.client.1.smithi064.stdout:7/86: fsync d6/d9/f1a 0 2024-04-26T21:07:53.731 INFO:tasks.workunit.client.1.smithi064.stdout:0/94: truncate dd/d10/f16 49688 0 2024-04-26T21:07:53.731 INFO:tasks.workunit.client.1.smithi064.stdout:0/95: write fc [2216143,37605] 0 2024-04-26T21:07:53.740 INFO:tasks.workunit.client.1.smithi064.stdout:4/125: dread d0/d1d/f1b [0,4194304] 0 2024-04-26T21:07:53.751 INFO:tasks.workunit.client.1.smithi064.stdout:7/87: link d6/db/c18 d6/d12/c1d 0 2024-04-26T21:07:53.755 INFO:tasks.workunit.client.1.smithi064.stdout:0/96: mkdir dd/d10/d18 0 2024-04-26T21:07:53.756 INFO:tasks.workunit.client.1.smithi064.stdout:6/85: rmdir d4 39 2024-04-26T21:07:53.758 INFO:tasks.workunit.client.1.smithi064.stdout:4/126: symlink d0/d14/l27 0 2024-04-26T21:07:53.764 INFO:tasks.workunit.client.1.smithi064.stdout:0/97: creat dd/d10/d18/f19 x:0 0 0 2024-04-26T21:07:53.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/127: getdents d0 0 2024-04-26T21:07:53.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/128: chown d0/d5/l6 15918 1 2024-04-26T21:07:53.778 INFO:tasks.workunit.client.1.smithi064.stdout:9/102: truncate d0/d4/d7/fd 6599827 0 2024-04-26T21:07:53.778 INFO:tasks.workunit.client.1.smithi064.stdout:9/103: fdatasync d0/d4/da/fc 0 2024-04-26T21:07:53.778 INFO:tasks.workunit.client.1.smithi064.stdout:1/138: dwrite d0/d6/d11/d1e/f1b [0,4194304] 0 2024-04-26T21:07:53.778 INFO:tasks.workunit.client.1.smithi064.stdout:9/104: write d0/d4/d15/f23 [403633,38495] 0 2024-04-26T21:07:53.779 INFO:tasks.workunit.client.1.smithi064.stdout:2/109: dwrite d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:53.779 INFO:tasks.workunit.client.1.smithi064.stdout:9/105: write d0/d4/d7/f11 [429707,50120] 0 2024-04-26T21:07:53.779 INFO:tasks.workunit.client.1.smithi064.stdout:1/139: write d0/f12 [200481,96877] 0 2024-04-26T21:07:53.779 INFO:tasks.workunit.client.1.smithi064.stdout:1/140: stat d0/d6/d11/d1e/c28 0 2024-04-26T21:07:53.780 INFO:tasks.workunit.client.1.smithi064.stdout:5/110: dwrite dd/f16 [0,4194304] 0 2024-04-26T21:07:53.783 INFO:tasks.workunit.client.1.smithi064.stdout:6/86: dread d4/d7/fe [0,4194304] 0 2024-04-26T21:07:53.786 INFO:tasks.workunit.client.1.smithi064.stdout:1/141: creat d0/d22/f2b x:0 0 0 2024-04-26T21:07:53.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/129: write d0/f1a [1627669,78747] 0 2024-04-26T21:07:53.792 INFO:tasks.workunit.client.1.smithi064.stdout:5/111: mkdir dd/d12/d18/d1a/d1f/d20 0 2024-04-26T21:07:53.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/87: mknod d4/d7/c17 0 2024-04-26T21:07:53.796 INFO:tasks.workunit.client.1.smithi064.stdout:2/110: dread fe [0,4194304] 0 2024-04-26T21:07:53.798 INFO:tasks.workunit.client.1.smithi064.stdout:1/142: mkdir d0/d6/d11/d2c 0 2024-04-26T21:07:53.799 INFO:tasks.workunit.client.1.smithi064.stdout:1/143: chown d0/d6/cb 0 1 2024-04-26T21:07:53.799 INFO:tasks.workunit.client.1.smithi064.stdout:1/144: chown d0/d6/d11/d1e/d27 5 1 2024-04-26T21:07:53.800 INFO:tasks.workunit.client.1.smithi064.stdout:4/130: mknod d0/c28 0 2024-04-26T21:07:53.800 INFO:tasks.workunit.client.1.smithi064.stdout:4/131: write d0/d5/d13/f12 [1638015,668] 0 2024-04-26T21:07:53.806 INFO:tasks.workunit.client.1.smithi064.stdout:9/106: rename d0/d4/d15 to d0/d4/da/d26 0 2024-04-26T21:07:53.806 INFO:tasks.workunit.client.1.smithi064.stdout:6/88: creat d4/d7/d12/f18 x:0 0 0 2024-04-26T21:07:53.810 INFO:tasks.workunit.client.1.smithi064.stdout:1/145: creat d0/d6/d11/d1e/d27/f2d x:0 0 0 2024-04-26T21:07:53.810 INFO:tasks.workunit.client.1.smithi064.stdout:1/146: chown d0/d6/dd/l1a 566096 1 2024-04-26T21:07:53.812 INFO:tasks.workunit.client.1.smithi064.stdout:9/107: dread d0/f18 [0,4194304] 0 2024-04-26T21:07:53.813 INFO:tasks.workunit.client.1.smithi064.stdout:4/132: symlink d0/d14/l29 0 2024-04-26T21:07:53.816 INFO:tasks.workunit.client.1.smithi064.stdout:7/88: write d6/d9/f11 [2715925,70836] 0 2024-04-26T21:07:53.816 INFO:tasks.workunit.client.1.smithi064.stdout:3/100: dwrite d1/da/fb [0,4194304] 0 2024-04-26T21:07:53.821 INFO:tasks.workunit.client.1.smithi064.stdout:5/112: rename dd/d12/d18/l1c to dd/d12/d18/d1a/d1b/l21 0 2024-04-26T21:07:53.823 INFO:tasks.workunit.client.1.smithi064.stdout:1/147: mknod d0/d6/c2e 0 2024-04-26T21:07:53.825 INFO:tasks.workunit.client.1.smithi064.stdout:4/133: mkdir d0/d5/d2a 0 2024-04-26T21:07:53.825 INFO:tasks.workunit.client.1.smithi064.stdout:4/134: dread - d0/d5/d13/f19 zero size 2024-04-26T21:07:53.828 INFO:tasks.workunit.client.1.smithi064.stdout:0/98: dwrite f5 [0,4194304] 0 2024-04-26T21:07:53.828 INFO:tasks.workunit.client.1.smithi064.stdout:0/99: fsync dd/f14 0 2024-04-26T21:07:53.835 INFO:tasks.workunit.client.1.smithi064.stdout:5/113: read dd/f16 [2789363,117732] 0 2024-04-26T21:07:53.835 INFO:tasks.workunit.client.1.smithi064.stdout:5/114: fdatasync dd/f13 0 2024-04-26T21:07:53.836 INFO:tasks.workunit.client.1.smithi064.stdout:5/115: write dd/ff [498474,84980] 0 2024-04-26T21:07:53.836 INFO:tasks.workunit.client.1.smithi064.stdout:5/116: chown dd/f11 1971319572 1 2024-04-26T21:07:53.841 INFO:tasks.workunit.client.1.smithi064.stdout:0/100: dread fc [0,4194304] 0 2024-04-26T21:07:53.841 INFO:tasks.workunit.client.1.smithi064.stdout:0/101: dread - dd/f15 zero size 2024-04-26T21:07:53.841 INFO:tasks.workunit.client.1.smithi064.stdout:0/102: write fc [5057720,13794] 0 2024-04-26T21:07:53.843 INFO:tasks.workunit.client.1.smithi064.stdout:1/148: truncate d0/d6/f19 1949476 0 2024-04-26T21:07:53.844 INFO:tasks.workunit.client.1.smithi064.stdout:1/149: creat d0/d6/d11/d1e/d27/f2f x:0 0 0 2024-04-26T21:07:53.844 INFO:tasks.workunit.client.1.smithi064.stdout:1/150: chown d0/d6/ff 476 1 2024-04-26T21:07:53.845 INFO:tasks.workunit.client.1.smithi064.stdout:7/89: mknod d6/c1e 0 2024-04-26T21:07:53.872 INFO:tasks.workunit.client.1.smithi064.stdout:7/90: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:07:53.873 INFO:tasks.workunit.client.1.smithi064.stdout:7/91: write d6/d9/f11 [3003782,70803] 0 2024-04-26T21:07:53.873 INFO:tasks.workunit.client.1.smithi064.stdout:7/92: write d6/d9/fd [454200,95406] 0 2024-04-26T21:07:53.878 INFO:tasks.workunit.client.1.smithi064.stdout:0/103: write fc [2410632,70883] 0 2024-04-26T21:07:53.878 INFO:tasks.workunit.client.1.smithi064.stdout:7/93: mkdir d6/db/d1f 0 2024-04-26T21:07:53.878 INFO:tasks.workunit.client.1.smithi064.stdout:9/108: write d0/f12 [421103,124782] 0 2024-04-26T21:07:53.878 INFO:tasks.workunit.client.1.smithi064.stdout:9/109: write d0/d4/d7/f20 [604569,85541] 0 2024-04-26T21:07:53.879 INFO:tasks.workunit.client.1.smithi064.stdout:5/117: dwrite f0 [0,4194304] 0 2024-04-26T21:07:53.880 INFO:tasks.workunit.client.1.smithi064.stdout:9/110: mkdir d0/d4/da/d27 0 2024-04-26T21:07:53.887 INFO:tasks.workunit.client.1.smithi064.stdout:9/111: unlink d0/d4/l16 0 2024-04-26T21:07:53.887 INFO:tasks.workunit.client.1.smithi064.stdout:9/112: dread - d0/d4/da/f22 zero size 2024-04-26T21:07:53.892 INFO:tasks.workunit.client.1.smithi064.stdout:0/104: write fb [1115700,112580] 0 2024-04-26T21:07:53.892 INFO:tasks.workunit.client.1.smithi064.stdout:0/105: chown dd 1272791 1 2024-04-26T21:07:53.893 INFO:tasks.workunit.client.1.smithi064.stdout:0/106: write dd/f15 [368292,129395] 0 2024-04-26T21:07:53.897 INFO:tasks.workunit.client.1.smithi064.stdout:5/118: write f0 [1037152,101442] 0 2024-04-26T21:07:53.897 INFO:tasks.workunit.client.1.smithi064.stdout:5/119: chown fb 18939 1 2024-04-26T21:07:53.901 INFO:tasks.workunit.client.1.smithi064.stdout:8/107: sync 2024-04-26T21:07:53.901 INFO:tasks.workunit.client.1.smithi064.stdout:9/113: write d0/f12 [5992959,34431] 0 2024-04-26T21:07:53.903 INFO:tasks.workunit.client.1.smithi064.stdout:1/151: dwrite d0/f3 [4194304,4194304] 0 2024-04-26T21:07:53.903 INFO:tasks.workunit.client.1.smithi064.stdout:1/152: fsync d0/f1f 0 2024-04-26T21:07:53.904 INFO:tasks.workunit.client.1.smithi064.stdout:1/153: creat d0/d22/f30 x:0 0 0 2024-04-26T21:07:53.904 INFO:tasks.workunit.client.1.smithi064.stdout:9/114: fdatasync d0/d4/d7/fd 0 2024-04-26T21:07:53.906 INFO:tasks.workunit.client.1.smithi064.stdout:5/120: creat dd/d12/d18/d1a/d1f/d20/f22 x:0 0 0 2024-04-26T21:07:53.906 INFO:tasks.workunit.client.1.smithi064.stdout:5/121: readlink dd/d12/d18/d1a/d1b/l21 0 2024-04-26T21:07:53.907 INFO:tasks.workunit.client.1.smithi064.stdout:0/107: rmdir dd/d10 39 2024-04-26T21:07:53.914 INFO:tasks.workunit.client.1.smithi064.stdout:8/108: creat d10/d1d/f29 x:0 0 0 2024-04-26T21:07:53.914 INFO:tasks.workunit.client.1.smithi064.stdout:8/109: write d10/d1d/f29 [371277,52325] 0 2024-04-26T21:07:53.920 INFO:tasks.workunit.client.1.smithi064.stdout:5/122: dread dd/f16 [0,4194304] 0 2024-04-26T21:07:53.920 INFO:tasks.workunit.client.1.smithi064.stdout:5/123: read dd/f16 [3658659,72636] 0 2024-04-26T21:07:53.920 INFO:tasks.workunit.client.1.smithi064.stdout:5/124: truncate f7 13152795 0 2024-04-26T21:07:53.921 INFO:tasks.workunit.client.1.smithi064.stdout:1/154: dread d0/d6/d11/f1d [0,4194304] 0 2024-04-26T21:07:53.928 INFO:tasks.workunit.client.1.smithi064.stdout:9/115: mkdir d0/d4/d28 0 2024-04-26T21:07:53.930 INFO:tasks.workunit.client.1.smithi064.stdout:0/108: mkdir dd/d10/d1a 0 2024-04-26T21:07:53.933 INFO:tasks.workunit.client.1.smithi064.stdout:1/155: dread d0/d6/d11/d1e/f1b [0,4194304] 0 2024-04-26T21:07:53.952 INFO:tasks.workunit.client.1.smithi064.stdout:0/109: symlink dd/l1b 0 2024-04-26T21:07:53.953 INFO:tasks.workunit.client.1.smithi064.stdout:1/156: mkdir d0/d6/d29/d31 0 2024-04-26T21:07:53.957 INFO:tasks.workunit.client.1.smithi064.stdout:0/110: mkdir dd/d1c 0 2024-04-26T21:07:53.959 INFO:tasks.workunit.client.1.smithi064.stdout:1/157: symlink d0/d6/d11/d1e/l32 0 2024-04-26T21:07:53.960 INFO:tasks.workunit.client.1.smithi064.stdout:1/158: write d0/d6/ff [747387,46858] 0 2024-04-26T21:07:53.960 INFO:tasks.workunit.client.1.smithi064.stdout:1/159: write d0/d6/d11/d1e/d27/f2f [14950,11091] 0 2024-04-26T21:07:53.960 INFO:tasks.workunit.client.1.smithi064.stdout:1/160: dread - d0/d6/d11/f18 zero size 2024-04-26T21:07:53.961 INFO:tasks.workunit.client.1.smithi064.stdout:7/94: truncate d6/d9/fd 3996964 0 2024-04-26T21:07:53.962 INFO:tasks.workunit.client.1.smithi064.stdout:5/125: dwrite fa [4194304,4194304] 0 2024-04-26T21:07:53.962 INFO:tasks.workunit.client.1.smithi064.stdout:5/126: readlink dd/d12/d18/d1a/d1b/l21 0 2024-04-26T21:07:53.962 INFO:tasks.workunit.client.1.smithi064.stdout:5/127: write f7 [13370466,128802] 0 2024-04-26T21:07:53.964 INFO:tasks.workunit.client.1.smithi064.stdout:1/161: mknod d0/d22/c33 0 2024-04-26T21:07:53.967 INFO:tasks.workunit.client.1.smithi064.stdout:5/128: mknod dd/d12/d18/c23 0 2024-04-26T21:07:53.968 INFO:tasks.workunit.client.1.smithi064.stdout:9/116: dwrite d0/d4/d7/f9 [8388608,4194304] 0 2024-04-26T21:07:53.968 INFO:tasks.workunit.client.1.smithi064.stdout:9/117: dread - d0/d4/da/f22 zero size 2024-04-26T21:07:53.968 INFO:tasks.workunit.client.1.smithi064.stdout:9/118: creat d0/d4/da/f29 x:0 0 0 2024-04-26T21:07:53.977 INFO:tasks.workunit.client.1.smithi064.stdout:5/129: unlink dd/ff 0 2024-04-26T21:07:53.978 INFO:tasks.workunit.client.1.smithi064.stdout:5/130: chown fc 55 1 2024-04-26T21:07:53.978 INFO:tasks.workunit.client.1.smithi064.stdout:5/131: truncate dd/f1e 314740 0 2024-04-26T21:07:53.978 INFO:tasks.workunit.client.1.smithi064.stdout:5/132: chown dd/d12/c14 1173807 1 2024-04-26T21:07:53.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/119: unlink d0/d4/da/f22 0 2024-04-26T21:07:53.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/120: chown d0/d4/d7/df 102439482 1 2024-04-26T21:07:53.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/121: chown d0/d4/da/d26/f23 361850223 1 2024-04-26T21:07:53.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/122: truncate d0/d4/da/f14 2712109 0 2024-04-26T21:07:53.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/123: write d0/d4/da/d26/f23 [1105399,9057] 0 2024-04-26T21:07:53.988 INFO:tasks.workunit.client.1.smithi064.stdout:5/133: creat dd/d12/d18/d1a/d1f/f24 x:0 0 0 2024-04-26T21:07:53.991 INFO:tasks.workunit.client.1.smithi064.stdout:9/124: link d0/d4/d7/f20 d0/d4/f2a 0 2024-04-26T21:07:53.995 INFO:tasks.workunit.client.1.smithi064.stdout:9/125: symlink d0/d4/d7/df/l2b 0 2024-04-26T21:07:53.995 INFO:tasks.workunit.client.1.smithi064.stdout:9/126: write d0/d4/f24 [781313,45354] 0 2024-04-26T21:07:53.995 INFO:tasks.workunit.client.1.smithi064.stdout:5/134: getdents dd/d12/d18/d1a 0 2024-04-26T21:07:53.997 INFO:tasks.workunit.client.1.smithi064.stdout:9/127: read d0/d4/f24 [686166,34686] 0 2024-04-26T21:07:53.998 INFO:tasks.workunit.client.1.smithi064.stdout:0/111: dwrite dd/d10/f16 [0,4194304] 0 2024-04-26T21:07:53.999 INFO:tasks.workunit.client.1.smithi064.stdout:5/135: mkdir dd/d12/d18/d25 0 2024-04-26T21:07:54.000 INFO:tasks.workunit.client.1.smithi064.stdout:8/110: fsync d10/d1d/f29 0 2024-04-26T21:07:54.003 INFO:tasks.workunit.client.1.smithi064.stdout:0/112: mkdir dd/d1c/d1d 0 2024-04-26T21:07:54.010 INFO:tasks.workunit.client.1.smithi064.stdout:5/136: rename dd/d12/c14 to dd/d12/d18/d25/c26 0 2024-04-26T21:07:54.018 INFO:tasks.workunit.client.1.smithi064.stdout:8/111: unlink d10/l18 0 2024-04-26T21:07:54.018 INFO:tasks.workunit.client.1.smithi064.stdout:8/112: dread - d10/f24 zero size 2024-04-26T21:07:54.018 INFO:tasks.workunit.client.1.smithi064.stdout:8/113: fdatasync d10/f12 0 2024-04-26T21:07:54.022 INFO:tasks.workunit.client.1.smithi064.stdout:1/162: dwrite d0/d6/d11/f23 [0,4194304] 0 2024-04-26T21:07:54.023 INFO:tasks.workunit.client.1.smithi064.stdout:1/163: fdatasync d0/d6/d11/d1e/d27/f2d 0 2024-04-26T21:07:54.023 INFO:tasks.workunit.client.1.smithi064.stdout:5/137: rename f7 to dd/d12/d18/d1a/d1f/d20/f27 0 2024-04-26T21:07:54.023 INFO:tasks.workunit.client.1.smithi064.stdout:5/138: readlink dd/d12/d18/d1a/d1b/l21 0 2024-04-26T21:07:54.034 INFO:tasks.workunit.client.1.smithi064.stdout:1/164: mkdir d0/d6/d11/d1e/d2a/d34 0 2024-04-26T21:07:54.034 INFO:tasks.workunit.client.1.smithi064.stdout:1/165: creat d0/d6/d11/f35 x:0 0 0 2024-04-26T21:07:54.040 INFO:tasks.workunit.client.1.smithi064.stdout:4/135: sync 2024-04-26T21:07:54.041 INFO:tasks.workunit.client.1.smithi064.stdout:8/114: dread ff [0,4194304] 0 2024-04-26T21:07:54.041 INFO:tasks.workunit.client.1.smithi064.stdout:2/111: sync 2024-04-26T21:07:54.041 INFO:tasks.workunit.client.1.smithi064.stdout:3/101: sync 2024-04-26T21:07:54.042 INFO:tasks.workunit.client.1.smithi064.stdout:6/89: sync 2024-04-26T21:07:54.042 INFO:tasks.workunit.client.1.smithi064.stdout:6/90: fdatasync d4/d7/fe 0 2024-04-26T21:07:54.044 INFO:tasks.workunit.client.1.smithi064.stdout:1/166: creat d0/d6/d11/d1e/d2a/d34/f36 x:0 0 0 2024-04-26T21:07:54.052 INFO:tasks.workunit.client.1.smithi064.stdout:9/128: dwrite d0/d4/d7/f11 [0,4194304] 0 2024-04-26T21:07:54.053 INFO:tasks.workunit.client.1.smithi064.stdout:9/129: fdatasync d0/d4/da/f14 0 2024-04-26T21:07:54.053 INFO:tasks.workunit.client.1.smithi064.stdout:9/130: chown d0/d4/l1d 7 1 2024-04-26T21:07:54.054 INFO:tasks.workunit.client.1.smithi064.stdout:4/136: creat d0/d5/d13/d10/f2b x:0 0 0 2024-04-26T21:07:54.055 INFO:tasks.workunit.client.1.smithi064.stdout:2/112: mkdir d12/d16/d29 0 2024-04-26T21:07:54.055 INFO:tasks.workunit.client.1.smithi064.stdout:2/113: chown d12/c20 0 1 2024-04-26T21:07:54.057 INFO:tasks.workunit.client.1.smithi064.stdout:3/102: mkdir d1/da/d22 0 2024-04-26T21:07:54.057 INFO:tasks.workunit.client.1.smithi064.stdout:3/103: readlink d1/da/l18 0 2024-04-26T21:07:54.059 INFO:tasks.workunit.client.1.smithi064.stdout:8/115: symlink d10/l2a 0 2024-04-26T21:07:54.059 INFO:tasks.workunit.client.1.smithi064.stdout:8/116: getdents d10/d1d/d25 0 2024-04-26T21:07:54.059 INFO:tasks.workunit.client.1.smithi064.stdout:8/117: write d10/f1b [889505,18648] 0 2024-04-26T21:07:54.062 INFO:tasks.workunit.client.1.smithi064.stdout:7/95: dread d6/d9/fd [0,4194304] 0 2024-04-26T21:07:54.062 INFO:tasks.workunit.client.1.smithi064.stdout:7/96: write d6/d9/f1a [139067,93011] 0 2024-04-26T21:07:54.062 INFO:tasks.workunit.client.1.smithi064.stdout:6/91: link d4/la d4/d7/l19 0 2024-04-26T21:07:54.063 INFO:tasks.workunit.client.1.smithi064.stdout:9/131: dread d0/f18 [0,4194304] 0 2024-04-26T21:07:54.063 INFO:tasks.workunit.client.1.smithi064.stdout:1/167: truncate d0/f12 167030 0 2024-04-26T21:07:54.065 INFO:tasks.workunit.client.1.smithi064.stdout:7/97: mknod d6/db/c20 0 2024-04-26T21:07:54.067 INFO:tasks.workunit.client.1.smithi064.stdout:6/92: mknod d4/d7/c1a 0 2024-04-26T21:07:54.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/132: creat d0/d4/d7/df/f2c x:0 0 0 2024-04-26T21:07:54.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/133: getdents d0/d4/d28 0 2024-04-26T21:07:54.072 INFO:tasks.workunit.client.1.smithi064.stdout:1/168: mknod d0/d6/d29/d31/c37 0 2024-04-26T21:07:54.074 INFO:tasks.workunit.client.1.smithi064.stdout:4/137: dread d0/d1d/f1b [0,4194304] 0 2024-04-26T21:07:54.075 INFO:tasks.workunit.client.1.smithi064.stdout:9/134: rmdir d0/d4/da/d27 0 2024-04-26T21:07:54.075 INFO:tasks.workunit.client.1.smithi064.stdout:6/93: write d4/d7/fd [4531344,17735] 0 2024-04-26T21:07:54.075 INFO:tasks.workunit.client.1.smithi064.stdout:6/94: truncate d4/d7/d12/f18 536123 0 2024-04-26T21:07:54.077 INFO:tasks.workunit.client.1.smithi064.stdout:4/138: unlink d0/d5/d13/d10/l1c 0 2024-04-26T21:07:54.079 INFO:tasks.workunit.client.1.smithi064.stdout:9/135: link d0/d4/d7/f20 d0/d4/d28/f2d 0 2024-04-26T21:07:54.085 INFO:tasks.workunit.client.1.smithi064.stdout:5/139: fsync dd/d12/d18/d1a/d1f/d20/f27 0 2024-04-26T21:07:54.097 INFO:tasks.workunit.client.1.smithi064.stdout:4/139: dread d0/f1a [0,4194304] 0 2024-04-26T21:07:54.097 INFO:tasks.workunit.client.1.smithi064.stdout:4/140: dread - d0/d5/d13/d10/f2b zero size 2024-04-26T21:07:54.097 INFO:tasks.workunit.client.1.smithi064.stdout:3/104: dread d1/ff [0,4194304] 0 2024-04-26T21:07:54.101 INFO:tasks.workunit.client.1.smithi064.stdout:4/141: rename d0/d5/d13/f16 to d0/d1d/d17/f2c 0 2024-04-26T21:07:54.101 INFO:tasks.workunit.client.1.smithi064.stdout:4/142: dread - d0/d5/d13/d10/f2b zero size 2024-04-26T21:07:54.104 INFO:tasks.workunit.client.1.smithi064.stdout:3/105: symlink d1/d14/l23 0 2024-04-26T21:07:54.104 INFO:tasks.workunit.client.1.smithi064.stdout:3/106: creat d1/da/f24 x:0 0 0 2024-04-26T21:07:54.108 INFO:tasks.workunit.client.1.smithi064.stdout:4/143: mknod d0/d1d/d21/c2d 0 2024-04-26T21:07:54.108 INFO:tasks.workunit.client.1.smithi064.stdout:2/114: dwrite d12/d16/f19 [0,4194304] 0 2024-04-26T21:07:54.109 INFO:tasks.workunit.client.1.smithi064.stdout:2/115: chown fe 29654 1 2024-04-26T21:07:54.114 INFO:tasks.workunit.client.1.smithi064.stdout:9/136: truncate d0/d4/da/f14 704237 0 2024-04-26T21:07:54.114 INFO:tasks.workunit.client.1.smithi064.stdout:9/137: creat d0/d4/d7/f2e x:0 0 0 2024-04-26T21:07:54.115 INFO:tasks.workunit.client.1.smithi064.stdout:4/144: creat d0/d1d/f2e x:0 0 0 2024-04-26T21:07:54.116 INFO:tasks.workunit.client.1.smithi064.stdout:4/145: write d0/d5/d13/f19 [229497,32058] 0 2024-04-26T21:07:54.116 INFO:tasks.workunit.client.1.smithi064.stdout:4/146: read d0/d5/d13/f12 [1749769,64422] 0 2024-04-26T21:07:54.116 INFO:tasks.workunit.client.1.smithi064.stdout:2/116: mkdir d12/d1a/d2a 0 2024-04-26T21:07:54.118 INFO:tasks.workunit.client.1.smithi064.stdout:9/138: write d0/d4/d7/f20 [466490,42655] 0 2024-04-26T21:07:54.118 INFO:tasks.workunit.client.1.smithi064.stdout:9/139: read d0/d4/d28/f2d [73924,57318] 0 2024-04-26T21:07:54.118 INFO:tasks.workunit.client.1.smithi064.stdout:9/140: stat d0/d4 0 2024-04-26T21:07:54.118 INFO:tasks.workunit.client.1.smithi064.stdout:9/141: creat d0/d4/d7/f2f x:0 0 0 2024-04-26T21:07:54.121 INFO:tasks.workunit.client.1.smithi064.stdout:4/147: mkdir d0/d2f 0 2024-04-26T21:07:54.123 INFO:tasks.workunit.client.1.smithi064.stdout:2/117: creat d12/d1a/f2b x:0 0 0 2024-04-26T21:07:54.123 INFO:tasks.workunit.client.1.smithi064.stdout:2/118: chown d12/c20 119158708 1 2024-04-26T21:07:54.127 INFO:tasks.workunit.client.1.smithi064.stdout:9/142: creat d0/d4/d28/f30 x:0 0 0 2024-04-26T21:07:54.135 INFO:tasks.workunit.client.1.smithi064.stdout:2/119: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:54.141 INFO:tasks.workunit.client.1.smithi064.stdout:5/140: dwrite f3 [4194304,4194304] 0 2024-04-26T21:07:54.141 INFO:tasks.workunit.client.1.smithi064.stdout:5/141: chown dd/d12/d18/f1d 78 1 2024-04-26T21:07:54.144 INFO:tasks.workunit.client.1.smithi064.stdout:4/148: dread d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:54.144 INFO:tasks.workunit.client.1.smithi064.stdout:4/149: read d0/d5/d13/f12 [1015337,90439] 0 2024-04-26T21:07:54.146 INFO:tasks.workunit.client.1.smithi064.stdout:5/142: mknod dd/d12/d18/c28 0 2024-04-26T21:07:54.147 INFO:tasks.workunit.client.1.smithi064.stdout:5/143: write dd/f10 [1028375,14588] 0 2024-04-26T21:07:54.148 INFO:tasks.workunit.client.1.smithi064.stdout:2/120: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:54.148 INFO:tasks.workunit.client.1.smithi064.stdout:2/121: truncate d12/d16/f19 5239379 0 2024-04-26T21:07:54.148 INFO:tasks.workunit.client.1.smithi064.stdout:9/143: read d0/f18 [169140,79195] 0 2024-04-26T21:07:54.148 INFO:tasks.workunit.client.1.smithi064.stdout:9/144: stat d0/d4/f24 0 2024-04-26T21:07:54.150 INFO:tasks.workunit.client.1.smithi064.stdout:5/144: link dd/d12/d18/d1a/d1f/f24 dd/d12/d18/d1a/d1b/f29 0 2024-04-26T21:07:54.150 INFO:tasks.workunit.client.1.smithi064.stdout:5/145: write dd/d12/d18/d1a/d1f/d20/f22 [198448,119986] 0 2024-04-26T21:07:54.150 INFO:tasks.workunit.client.1.smithi064.stdout:5/146: chown dd/f11 3079791 1 2024-04-26T21:07:54.151 INFO:tasks.workunit.client.1.smithi064.stdout:9/145: unlink d0/d4/d7/df/f1b 0 2024-04-26T21:07:54.154 INFO:tasks.workunit.client.1.smithi064.stdout:9/146: mkdir d0/d4/da/d31 0 2024-04-26T21:07:54.157 INFO:tasks.workunit.client.1.smithi064.stdout:6/95: dwrite d4/fb [0,4194304] 0 2024-04-26T21:07:54.162 INFO:tasks.workunit.client.1.smithi064.stdout:6/96: symlink d4/d7/l1b 0 2024-04-26T21:07:54.162 INFO:tasks.workunit.client.1.smithi064.stdout:6/97: truncate d4/d7/fe 2144757 0 2024-04-26T21:07:54.163 INFO:tasks.workunit.client.1.smithi064.stdout:6/98: chown d4/la 150586210 1 2024-04-26T21:07:54.163 INFO:tasks.workunit.client.1.smithi064.stdout:6/99: chown d4/d7/c17 484 1 2024-04-26T21:07:54.164 INFO:tasks.workunit.client.1.smithi064.stdout:4/150: write d0/d1d/d17/f1f [539478,54365] 0 2024-04-26T21:07:54.170 INFO:tasks.workunit.client.1.smithi064.stdout:6/100: unlink d4/fb 0 2024-04-26T21:07:54.171 INFO:tasks.workunit.client.1.smithi064.stdout:6/101: write d4/f16 [42198,42314] 0 2024-04-26T21:07:54.171 INFO:tasks.workunit.client.1.smithi064.stdout:6/102: truncate d4/d7/d12/f18 1216230 0 2024-04-26T21:07:54.172 INFO:tasks.workunit.client.1.smithi064.stdout:6/103: read d4/d7/d12/f18 [134174,34695] 0 2024-04-26T21:07:54.174 INFO:tasks.workunit.client.1.smithi064.stdout:2/122: dwrite d12/f24 [0,4194304] 0 2024-04-26T21:07:54.174 INFO:tasks.workunit.client.1.smithi064.stdout:2/123: chown d12/d1a/f2b 3586406 1 2024-04-26T21:07:54.187 INFO:tasks.workunit.client.1.smithi064.stdout:3/107: dwrite d1/f11 [0,4194304] 0 2024-04-26T21:07:54.188 INFO:tasks.workunit.client.1.smithi064.stdout:4/151: unlink d0/d5/c15 0 2024-04-26T21:07:54.188 INFO:tasks.workunit.client.1.smithi064.stdout:9/147: getdents d0/d4/d7 0 2024-04-26T21:07:54.190 INFO:tasks.workunit.client.1.smithi064.stdout:6/104: mknod d4/d7/d12/c1c 0 2024-04-26T21:07:54.195 INFO:tasks.workunit.client.1.smithi064.stdout:2/124: dread fe [0,4194304] 0 2024-04-26T21:07:54.202 INFO:tasks.workunit.client.1.smithi064.stdout:5/147: dwrite dd/d12/d18/d1a/d1b/f29 [0,4194304] 0 2024-04-26T21:07:54.202 INFO:tasks.workunit.client.1.smithi064.stdout:5/148: creat dd/f2a x:0 0 0 2024-04-26T21:07:54.202 INFO:tasks.workunit.client.1.smithi064.stdout:5/149: truncate dd/f13 911298 0 2024-04-26T21:07:54.204 INFO:tasks.workunit.client.1.smithi064.stdout:3/108: creat d1/da/d22/f25 x:0 0 0 2024-04-26T21:07:54.206 INFO:tasks.workunit.client.1.smithi064.stdout:4/152: rename d0/d1d/d17/f1f to d0/d2f/f30 0 2024-04-26T21:07:54.206 INFO:tasks.workunit.client.1.smithi064.stdout:4/153: write d0/d5/d13/f12 [826899,56878] 0 2024-04-26T21:07:54.208 INFO:tasks.workunit.client.1.smithi064.stdout:9/148: link d0/d4/f24 d0/d4/d7/df/f32 0 2024-04-26T21:07:54.209 INFO:tasks.workunit.client.1.smithi064.stdout:6/105: mknod d4/d7/d12/c1d 0 2024-04-26T21:07:54.216 INFO:tasks.workunit.client.1.smithi064.stdout:2/125: write d12/f24 [2458896,123010] 0 2024-04-26T21:07:54.225 INFO:tasks.workunit.client.1.smithi064.stdout:5/150: creat dd/d12/d18/f2b x:0 0 0 2024-04-26T21:07:54.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/149: link d0/d4/d7/f20 d0/d4/d7/f33 0 2024-04-26T21:07:54.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/150: stat d0/d4/d7/df/f32 0 2024-04-26T21:07:54.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/151: write d0/d4/d7/fd [3202368,9405] 0 2024-04-26T21:07:54.232 INFO:tasks.workunit.client.1.smithi064.stdout:2/126: dread fe [0,4194304] 0 2024-04-26T21:07:54.236 INFO:tasks.workunit.client.1.smithi064.stdout:4/154: dread d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:54.237 INFO:tasks.workunit.client.1.smithi064.stdout:5/151: rename fc to dd/d12/d18/d1a/d1b/f2c 0 2024-04-26T21:07:54.240 INFO:tasks.workunit.client.1.smithi064.stdout:4/155: mknod d0/d2f/c31 0 2024-04-26T21:07:54.242 INFO:tasks.workunit.client.1.smithi064.stdout:5/152: truncate fb 3085681 0 2024-04-26T21:07:54.242 INFO:tasks.workunit.client.1.smithi064.stdout:5/153: dread - dd/f2a zero size 2024-04-26T21:07:54.244 INFO:tasks.workunit.client.1.smithi064.stdout:4/156: mknod d0/d1d/d17/c32 0 2024-04-26T21:07:54.246 INFO:tasks.workunit.client.1.smithi064.stdout:4/157: mkdir d0/d5/d13/d33 0 2024-04-26T21:07:54.246 INFO:tasks.workunit.client.1.smithi064.stdout:4/158: write d0/d2f/f30 [4546253,31476] 0 2024-04-26T21:07:54.248 INFO:tasks.workunit.client.1.smithi064.stdout:9/152: write d0/d4/d7/f11 [2060108,27897] 0 2024-04-26T21:07:54.248 INFO:tasks.workunit.client.1.smithi064.stdout:9/153: write d0/d4/d7/f11 [1981060,75048] 0 2024-04-26T21:07:54.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:53 smithi055 ceph-mon[25475]: mgrmap e26: smithi064.tchyje(active, since 53s), standbys: smithi055.ybbowr 2024-04-26T21:07:54.274 INFO:tasks.workunit.client.1.smithi064.stdout:0/113: sync 2024-04-26T21:07:54.274 INFO:tasks.workunit.client.1.smithi064.stdout:0/114: chown f5 7 1 2024-04-26T21:07:54.274 INFO:tasks.workunit.client.1.smithi064.stdout:0/115: stat dd/ff 0 2024-04-26T21:07:54.274 INFO:tasks.workunit.client.1.smithi064.stdout:0/116: truncate dd/d10/d18/f19 883371 0 2024-04-26T21:07:54.274 INFO:tasks.workunit.client.1.smithi064.stdout:0/117: write dd/ff [882670,50428] 0 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:7/98: sync 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:8/118: sync 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:1/169: sync 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:7/99: chown f3 48717 1 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:8/119: fdatasync d10/d1d/f29 0 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:8/120: fdatasync f4 0 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:7/100: write f3 [5870341,51408] 0 2024-04-26T21:07:54.275 INFO:tasks.workunit.client.1.smithi064.stdout:0/118: truncate f5 3675377 0 2024-04-26T21:07:54.278 INFO:tasks.workunit.client.1.smithi064.stdout:7/101: symlink d6/d15/l21 0 2024-04-26T21:07:54.279 INFO:tasks.workunit.client.1.smithi064.stdout:7/102: write f3 [8285518,49461] 0 2024-04-26T21:07:54.280 INFO:tasks.workunit.client.1.smithi064.stdout:3/109: dwrite d1/d14/f1c [0,4194304] 0 2024-04-26T21:07:54.280 INFO:tasks.workunit.client.1.smithi064.stdout:3/110: chown d1/f1a 1 1 2024-04-26T21:07:54.284 INFO:tasks.workunit.client.1.smithi064.stdout:7/103: mknod d6/db/d1f/c22 0 2024-04-26T21:07:54.287 INFO:tasks.workunit.client.1.smithi064.stdout:2/127: dwrite fe [0,4194304] 0 2024-04-26T21:07:54.294 INFO:tasks.workunit.client.1.smithi064.stdout:7/104: unlink d6/d9/fd 0 2024-04-26T21:07:54.296 INFO:tasks.workunit.client.1.smithi064.stdout:2/128: unlink fe 0 2024-04-26T21:07:54.301 INFO:tasks.workunit.client.1.smithi064.stdout:7/105: symlink d6/d12/l23 0 2024-04-26T21:07:54.301 INFO:tasks.workunit.client.1.smithi064.stdout:7/106: chown d6/db/c20 32161684 1 2024-04-26T21:07:54.304 INFO:tasks.workunit.client.1.smithi064.stdout:7/107: creat d6/f24 x:0 0 0 2024-04-26T21:07:54.305 INFO:tasks.workunit.client.1.smithi064.stdout:3/111: dread d1/da/fb [0,4194304] 0 2024-04-26T21:07:54.307 INFO:tasks.workunit.client.1.smithi064.stdout:5/154: dwrite dd/f1e [0,4194304] 0 2024-04-26T21:07:54.307 INFO:tasks.workunit.client.1.smithi064.stdout:5/155: creat dd/d12/d18/d1a/d1f/d20/f2d x:0 0 0 2024-04-26T21:07:54.307 INFO:tasks.workunit.client.1.smithi064.stdout:5/156: chown dd 2042557 1 2024-04-26T21:07:54.311 INFO:tasks.workunit.client.1.smithi064.stdout:3/112: mkdir d1/da/d22/d26 0 2024-04-26T21:07:54.316 INFO:tasks.workunit.client.1.smithi064.stdout:9/154: dwrite d0/f12 [0,4194304] 0 2024-04-26T21:07:54.316 INFO:tasks.workunit.client.1.smithi064.stdout:9/155: truncate d0/f18 1112290 0 2024-04-26T21:07:54.316 INFO:tasks.workunit.client.1.smithi064.stdout:9/156: read d0/d4/d7/df/f32 [222015,1294] 0 2024-04-26T21:07:54.316 INFO:tasks.workunit.client.1.smithi064.stdout:9/157: write d0/d4/d7/f9 [177011,71362] 0 2024-04-26T21:07:54.316 INFO:tasks.workunit.client.1.smithi064.stdout:4/159: getdents d0/d5/d13 0 2024-04-26T21:07:54.322 INFO:tasks.workunit.client.1.smithi064.stdout:2/129: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:54.322 INFO:tasks.workunit.client.1.smithi064.stdout:2/130: fsync d12/f24 0 2024-04-26T21:07:54.322 INFO:tasks.workunit.client.1.smithi064.stdout:2/131: creat d12/d1a/f2c x:0 0 0 2024-04-26T21:07:54.323 INFO:tasks.workunit.client.1.smithi064.stdout:2/132: fsync d12/d1a/f2b 0 2024-04-26T21:07:54.323 INFO:tasks.workunit.client.1.smithi064.stdout:2/133: truncate d12/d1a/f2c 243700 0 2024-04-26T21:07:54.324 INFO:tasks.workunit.client.1.smithi064.stdout:5/157: link f3 dd/d12/f2e 0 2024-04-26T21:07:54.324 INFO:tasks.workunit.client.1.smithi064.stdout:5/158: read fb [1425458,105294] 0 2024-04-26T21:07:54.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/121: dwrite ff [0,4194304] 0 2024-04-26T21:07:54.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/122: getdents d10/d1d/d25 0 2024-04-26T21:07:54.332 INFO:tasks.workunit.client.1.smithi064.stdout:9/158: mkdir d0/d4/da/d31/d34 0 2024-04-26T21:07:54.339 INFO:tasks.workunit.client.1.smithi064.stdout:7/108: getdents d6/d15 0 2024-04-26T21:07:54.339 INFO:tasks.workunit.client.1.smithi064.stdout:7/109: chown f3 161582559 1 2024-04-26T21:07:54.341 INFO:tasks.workunit.client.1.smithi064.stdout:3/113: getdents d1/d12 0 2024-04-26T21:07:54.345 INFO:tasks.workunit.client.1.smithi064.stdout:4/160: getdents d0/d5 0 2024-04-26T21:07:54.346 INFO:tasks.workunit.client.1.smithi064.stdout:7/110: rename d6/d9/f19 to d6/d15/d1c/f25 0 2024-04-26T21:07:54.346 INFO:tasks.workunit.client.1.smithi064.stdout:7/111: write d6/f24 [496456,5213] 0 2024-04-26T21:07:54.348 INFO:tasks.workunit.client.1.smithi064.stdout:9/159: dread d0/d4/da/fc [4194304,4194304] 0 2024-04-26T21:07:54.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/161: creat d0/f34 x:0 0 0 2024-04-26T21:07:54.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/162: chown d0/d2f/c31 3298691 1 2024-04-26T21:07:54.361 INFO:tasks.workunit.client.1.smithi064.stdout:3/114: write d1/da/f13 [3074634,85196] 0 2024-04-26T21:07:54.364 INFO:tasks.workunit.client.1.smithi064.stdout:2/134: dwrite d12/d1a/f2c [0,4194304] 0 2024-04-26T21:07:54.367 INFO:tasks.workunit.client.1.smithi064.stdout:9/160: dread d0/d4/da/fc [4194304,4194304] 0 2024-04-26T21:07:54.367 INFO:tasks.workunit.client.1.smithi064.stdout:9/161: write d0/d4/f24 [1618349,84509] 0 2024-04-26T21:07:54.384 INFO:tasks.workunit.client.1.smithi064.stdout:2/135: creat d12/d16/d29/f2d x:0 0 0 2024-04-26T21:07:54.386 INFO:tasks.workunit.client.1.smithi064.stdout:9/162: mknod d0/d4/da/d31/d34/c35 0 2024-04-26T21:07:54.390 INFO:tasks.workunit.client.1.smithi064.stdout:9/163: symlink d0/d4/l36 0 2024-04-26T21:07:54.392 INFO:tasks.workunit.client.1.smithi064.stdout:4/163: dwrite d0/d1d/d17/f2c [0,4194304] 0 2024-04-26T21:07:54.396 INFO:tasks.workunit.client.1.smithi064.stdout:4/164: symlink d0/d5/d13/d33/l35 0 2024-04-26T21:07:54.401 INFO:tasks.workunit.client.1.smithi064.stdout:2/136: dread d12/d1a/f2c [0,4194304] 0 2024-04-26T21:07:54.403 INFO:tasks.workunit.client.1.smithi064.stdout:4/165: creat d0/d5/d13/f36 x:0 0 0 2024-04-26T21:07:54.403 INFO:tasks.workunit.client.1.smithi064.stdout:4/166: write d0/f11 [759035,50408] 0 2024-04-26T21:07:54.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:53 smithi064 ceph-mon[33404]: mgrmap e26: smithi064.tchyje(active, since 53s), standbys: smithi055.ybbowr 2024-04-26T21:07:54.412 INFO:tasks.workunit.client.1.smithi064.stdout:2/137: write d12/d1a/f2c [765827,34318] 0 2024-04-26T21:07:54.431 INFO:tasks.workunit.client.1.smithi064.stdout:0/119: truncate fc 1359405 0 2024-04-26T21:07:54.433 INFO:tasks.workunit.client.1.smithi064.stdout:9/164: dwrite d0/d4/da/f29 [0,4194304] 0 2024-04-26T21:07:54.438 INFO:tasks.workunit.client.1.smithi064.stdout:9/165: mknod d0/d4/da/c37 0 2024-04-26T21:07:54.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/166: unlink d0/d4/da/ce 0 2024-04-26T21:07:54.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/167: write d0/f12 [6267414,125756] 0 2024-04-26T21:07:54.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/168: fdatasync d0/d4/da/d26/f23 0 2024-04-26T21:07:54.445 INFO:tasks.workunit.client.1.smithi064.stdout:9/169: mknod d0/d4/da/c38 0 2024-04-26T21:07:54.447 INFO:tasks.workunit.client.1.smithi064.stdout:9/170: mkdir d0/d39 0 2024-04-26T21:07:54.453 INFO:tasks.workunit.client.1.smithi064.stdout:2/138: dwrite d12/d16/f19 [4194304,4194304] 0 2024-04-26T21:07:54.453 INFO:tasks.workunit.client.1.smithi064.stdout:2/139: write d12/f24 [4796393,66591] 0 2024-04-26T21:07:54.453 INFO:tasks.workunit.client.1.smithi064.stdout:2/140: truncate d12/d16/f19 8828943 0 2024-04-26T21:07:54.456 INFO:tasks.workunit.client.1.smithi064.stdout:9/171: dread d0/d4/d7/f20 [0,4194304] 0 2024-04-26T21:07:54.456 INFO:tasks.workunit.client.1.smithi064.stdout:9/172: creat d0/d4/d7/df/f3a x:0 0 0 2024-04-26T21:07:54.457 INFO:tasks.workunit.client.1.smithi064.stdout:2/141: mknod d12/c2e 0 2024-04-26T21:07:54.457 INFO:tasks.workunit.client.1.smithi064.stdout:9/173: write d0/f18 [1086026,111074] 0 2024-04-26T21:07:54.457 INFO:tasks.workunit.client.1.smithi064.stdout:9/174: creat d0/f3b x:0 0 0 2024-04-26T21:07:54.464 INFO:tasks.workunit.client.1.smithi064.stdout:2/142: fdatasync d12/d1a/f2c 0 2024-04-26T21:07:54.464 INFO:tasks.workunit.client.1.smithi064.stdout:2/143: write d12/d1a/f2c [3810075,87750] 0 2024-04-26T21:07:54.477 INFO:tasks.workunit.client.1.smithi064.stdout:7/112: dwrite d6/f24 [0,4194304] 0 2024-04-26T21:07:54.481 INFO:tasks.workunit.client.1.smithi064.stdout:0/120: write fc [653478,67881] 0 2024-04-26T21:07:54.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/106: sync 2024-04-26T21:07:54.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/107: chown d4/d7 0 1 2024-04-26T21:07:54.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/108: stat d4/d7/d12/c1c 0 2024-04-26T21:07:54.490 INFO:tasks.workunit.client.1.smithi064.stdout:2/144: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:54.502 INFO:tasks.workunit.client.1.smithi064.stdout:0/121: dread dd/d10/f16 [0,4194304] 0 2024-04-26T21:07:54.503 INFO:tasks.workunit.client.1.smithi064.stdout:0/122: stat fc 0 2024-04-26T21:07:54.503 INFO:tasks.workunit.client.1.smithi064.stdout:0/123: fdatasync dd/f12 0 2024-04-26T21:07:54.503 INFO:tasks.workunit.client.1.smithi064.stdout:2/145: unlink c11 0 2024-04-26T21:07:54.506 INFO:tasks.workunit.client.1.smithi064.stdout:0/124: rename dd/l1b to dd/d1c/l1e 0 2024-04-26T21:07:54.508 INFO:tasks.workunit.client.1.smithi064.stdout:2/146: mkdir d12/d16/d2f 0 2024-04-26T21:07:54.508 INFO:tasks.workunit.client.1.smithi064.stdout:2/147: chown d12/f24 12 1 2024-04-26T21:07:54.513 INFO:tasks.workunit.client.1.smithi064.stdout:2/148: symlink d12/d28/l30 0 2024-04-26T21:07:54.513 INFO:tasks.workunit.client.1.smithi064.stdout:2/149: readlink d12/l14 0 2024-04-26T21:07:54.513 INFO:tasks.workunit.client.1.smithi064.stdout:2/150: stat d12/f24 0 2024-04-26T21:07:54.516 INFO:tasks.workunit.client.1.smithi064.stdout:2/151: mknod d12/d16/c31 0 2024-04-26T21:07:54.516 INFO:tasks.workunit.client.1.smithi064.stdout:2/152: fsync d12/d1a/f2c 0 2024-04-26T21:07:54.519 INFO:tasks.workunit.client.1.smithi064.stdout:2/153: creat d12/d16/d2f/f32 x:0 0 0 2024-04-26T21:07:54.525 INFO:tasks.workunit.client.1.smithi064.stdout:0/125: dread dd/ff [0,4194304] 0 2024-04-26T21:07:54.530 INFO:tasks.workunit.client.1.smithi064.stdout:2/154: creat d12/d28/f33 x:0 0 0 2024-04-26T21:07:54.530 INFO:tasks.workunit.client.1.smithi064.stdout:4/167: dread d0/f1a [0,4194304] 0 2024-04-26T21:07:54.530 INFO:tasks.workunit.client.1.smithi064.stdout:3/115: dwrite d1/d14/f1c [0,4194304] 0 2024-04-26T21:07:54.530 INFO:tasks.workunit.client.1.smithi064.stdout:3/116: fsync d1/da/f20 0 2024-04-26T21:07:54.530 INFO:tasks.workunit.client.1.smithi064.stdout:0/126: creat dd/d1c/f1f x:0 0 0 2024-04-26T21:07:54.535 INFO:tasks.workunit.client.1.smithi064.stdout:6/109: dwrite d4/d7/fd [0,4194304] 0 2024-04-26T21:07:54.535 INFO:tasks.workunit.client.1.smithi064.stdout:6/110: fsync d4/d7/fd 0 2024-04-26T21:07:54.540 INFO:tasks.workunit.client.1.smithi064.stdout:2/155: rmdir d12/d1a/d2a 0 2024-04-26T21:07:54.542 INFO:tasks.workunit.client.1.smithi064.stdout:4/168: mknod d0/d5/d13/d33/c37 0 2024-04-26T21:07:54.544 INFO:tasks.workunit.client.1.smithi064.stdout:9/175: dwrite d0/d4/da/fc [0,4194304] 0 2024-04-26T21:07:54.547 INFO:tasks.workunit.client.1.smithi064.stdout:0/127: rmdir dd/d10/d18 39 2024-04-26T21:07:54.548 INFO:tasks.workunit.client.1.smithi064.stdout:2/156: unlink l10 0 2024-04-26T21:07:54.550 INFO:tasks.workunit.client.1.smithi064.stdout:3/117: dread d1/d14/f1c [0,4194304] 0 2024-04-26T21:07:54.550 INFO:tasks.workunit.client.1.smithi064.stdout:3/118: dread - d1/da/f21 zero size 2024-04-26T21:07:54.551 INFO:tasks.workunit.client.1.smithi064.stdout:4/169: link d0/d5/l7 d0/d2f/l38 0 2024-04-26T21:07:54.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/37: mkdir d0/de 0 2024-04-26T21:07:54.560 INFO:tasks.workunit.client.0.smithi055.stdout:0/60: mkdir d9/dc/d19 0 2024-04-26T21:07:54.562 INFO:tasks.workunit.client.1.smithi064.stdout:0/128: symlink dd/d1c/l20 0 2024-04-26T21:07:54.562 INFO:tasks.workunit.client.1.smithi064.stdout:2/157: unlink l1 0 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:0/129: chown l4 142486514 1 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:2/158: chown d12/d16 3 1 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:0/130: fdatasync dd/f12 0 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:2/159: creat d12/f34 x:0 0 0 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:2/160: dread - d12/d16/d29/f2d zero size 2024-04-26T21:07:54.563 INFO:tasks.workunit.client.1.smithi064.stdout:2/161: write d12/f34 [850368,36141] 0 2024-04-26T21:07:54.565 INFO:tasks.workunit.client.1.smithi064.stdout:4/170: dread d0/f11 [0,4194304] 0 2024-04-26T21:07:54.566 INFO:tasks.workunit.client.1.smithi064.stdout:3/119: write d1/d14/f1c [544180,93357] 0 2024-04-26T21:07:54.572 INFO:tasks.workunit.client.1.smithi064.stdout:6/111: dwrite d4/d7/fd [4194304,4194304] 0 2024-04-26T21:07:54.572 INFO:tasks.workunit.client.1.smithi064.stdout:4/171: creat d0/d5/d13/d33/f39 x:0 0 0 2024-04-26T21:07:54.576 INFO:tasks.workunit.client.1.smithi064.stdout:3/120: mkdir d1/d27 0 2024-04-26T21:07:54.576 INFO:tasks.workunit.client.1.smithi064.stdout:3/121: fsync d1/f6 0 2024-04-26T21:07:54.578 INFO:tasks.workunit.client.1.smithi064.stdout:6/112: mkdir d4/d7/d12/d1e 0 2024-04-26T21:07:54.581 INFO:tasks.workunit.client.1.smithi064.stdout:4/172: creat d0/d1d/d21/f3a x:0 0 0 2024-04-26T21:07:54.581 INFO:tasks.workunit.client.1.smithi064.stdout:4/173: readlink d0/d5/l7 0 2024-04-26T21:07:54.583 INFO:tasks.workunit.client.1.smithi064.stdout:3/122: symlink d1/da/d22/d26/l28 0 2024-04-26T21:07:54.583 INFO:tasks.workunit.client.1.smithi064.stdout:3/123: fsync d1/fc 0 2024-04-26T21:07:54.583 INFO:tasks.workunit.client.1.smithi064.stdout:3/124: dread - d1/d12/f1f zero size 2024-04-26T21:07:54.583 INFO:tasks.workunit.client.1.smithi064.stdout:6/113: read d4/f16 [39040,87389] 0 2024-04-26T21:07:54.584 INFO:tasks.workunit.client.1.smithi064.stdout:2/162: dread d12/d1a/f2c [0,4194304] 0 2024-04-26T21:07:54.584 INFO:tasks.workunit.client.1.smithi064.stdout:2/163: creat d12/d28/f35 x:0 0 0 2024-04-26T21:07:54.584 INFO:tasks.workunit.client.1.smithi064.stdout:2/164: truncate d12/d1a/f2b 1003573 0 2024-04-26T21:07:54.587 INFO:tasks.workunit.client.0.smithi055.stdout:0/61: mknod d9/d11/c1a 0 2024-04-26T21:07:54.588 INFO:tasks.workunit.client.1.smithi064.stdout:3/125: mkdir d1/d27/d29 0 2024-04-26T21:07:54.591 INFO:tasks.workunit.client.1.smithi064.stdout:6/114: creat d4/d7/f1f x:0 0 0 2024-04-26T21:07:54.595 INFO:tasks.workunit.client.1.smithi064.stdout:3/126: mknod d1/d14/c2a 0 2024-04-26T21:07:54.597 INFO:tasks.workunit.client.1.smithi064.stdout:3/127: symlink d1/d14/l2b 0 2024-04-26T21:07:54.599 INFO:tasks.workunit.client.1.smithi064.stdout:3/128: truncate d1/f1a 1987080 0 2024-04-26T21:07:54.600 INFO:tasks.workunit.client.1.smithi064.stdout:0/131: fsync dd/d1c/f1f 0 2024-04-26T21:07:54.600 INFO:tasks.workunit.client.1.smithi064.stdout:4/174: dread d0/f1a [0,4194304] 0 2024-04-26T21:07:54.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/170: sync 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:1/171: readlink d0/d6/d11/d1e/l32 0 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:1/172: creat d0/d22/f38 x:0 0 0 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:0/132: mkdir dd/d21 0 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:0/133: readlink l4 0 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:1/173: dread - d0/d6/d11/d1e/d27/f2d zero size 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:1/174: chown d0/d6/d11/d2c 7790 1 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:5/159: sync 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:8/123: sync 2024-04-26T21:07:54.602 INFO:tasks.workunit.client.1.smithi064.stdout:1/175: truncate d0/f12 989851 0 2024-04-26T21:07:54.603 INFO:tasks.workunit.client.1.smithi064.stdout:8/124: rename d10/d1d/d25 to d10/d1d/d2b 0 2024-04-26T21:07:54.604 INFO:tasks.workunit.client.1.smithi064.stdout:0/134: mkdir dd/d10/d18/d22 0 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/176: mknod d0/d6/d11/d2c/c39 0 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/177: fsync d0/d6/d11/d1e/d27/f2d 0 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/178: chown d0/d6/cb 6316045 1 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/179: creat d0/d6/d11/d1e/d2a/d34/f3a x:0 0 0 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/180: read - d0/d6/d11/d1e/d2a/d34/f36 zero size 2024-04-26T21:07:54.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/181: dread - d0/f1f zero size 2024-04-26T21:07:54.607 INFO:tasks.workunit.client.1.smithi064.stdout:5/160: rename fa to dd/d12/d18/f2f 0 2024-04-26T21:07:54.609 INFO:tasks.workunit.client.1.smithi064.stdout:0/135: mknod dd/d10/d18/c23 0 2024-04-26T21:07:54.610 INFO:tasks.workunit.client.1.smithi064.stdout:9/176: dwrite d0/d4/d7/f9 [4194304,4194304] 0 2024-04-26T21:07:54.614 INFO:tasks.workunit.client.1.smithi064.stdout:1/182: truncate d0/d6/f19 1090480 0 2024-04-26T21:07:54.616 INFO:tasks.workunit.client.1.smithi064.stdout:5/161: symlink dd/d12/d18/d1a/l30 0 2024-04-26T21:07:54.618 INFO:tasks.workunit.client.1.smithi064.stdout:0/136: symlink dd/d10/d1a/l24 0 2024-04-26T21:07:54.620 INFO:tasks.workunit.client.1.smithi064.stdout:3/129: dread d1/f11 [0,4194304] 0 2024-04-26T21:07:54.625 INFO:tasks.workunit.client.0.smithi055.stdout:3/38: getdents d0 0 2024-04-26T21:07:54.626 INFO:tasks.workunit.client.0.smithi055.stdout:3/39: creat d0/d4/ff x:0 0 0 2024-04-26T21:07:54.631 INFO:tasks.workunit.client.1.smithi064.stdout:1/183: symlink d0/d6/l3b 0 2024-04-26T21:07:54.631 INFO:tasks.workunit.client.1.smithi064.stdout:1/184: chown d0/cc 33 1 2024-04-26T21:07:54.632 INFO:tasks.workunit.client.0.smithi055.stdout:3/40: link d0/d1/l2 d0/d1/l10 0 2024-04-26T21:07:54.632 INFO:tasks.workunit.client.1.smithi064.stdout:1/185: creat d0/d22/f3c x:0 0 0 2024-04-26T21:07:54.632 INFO:tasks.workunit.client.1.smithi064.stdout:0/137: rmdir dd/d10/d18/d22 0 2024-04-26T21:07:54.635 INFO:tasks.workunit.client.0.smithi055.stdout:3/41: mknod d0/d4/c11 0 2024-04-26T21:07:54.641 INFO:tasks.workunit.client.0.smithi055.stdout:4/1: sync 2024-04-26T21:07:54.641 INFO:tasks.workunit.client.0.smithi055.stdout:2/51: sync 2024-04-26T21:07:54.641 INFO:tasks.workunit.client.0.smithi055.stdout:4/2: write - no filename 2024-04-26T21:07:54.642 INFO:tasks.workunit.client.0.smithi055.stdout:8/14: sync 2024-04-26T21:07:54.642 INFO:tasks.workunit.client.0.smithi055.stdout:6/15: sync 2024-04-26T21:07:54.642 INFO:tasks.workunit.client.0.smithi055.stdout:7/7: sync 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:7/8: chown . 20 1 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:6/16: write f1 [1079214,8627] 0 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:1/33: sync 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:9/36: sync 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:9/37: chown d2/l9 18 1 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:9/38: truncate d2/f8 765322 0 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:3/42: creat d0/f12 x:0 0 0 2024-04-26T21:07:54.643 INFO:tasks.workunit.client.0.smithi055.stdout:4/3: mknod c1 0 2024-04-26T21:07:54.645 INFO:tasks.workunit.client.0.smithi055.stdout:2/52: mknod d4/dc/c13 0 2024-04-26T21:07:54.645 INFO:tasks.workunit.client.0.smithi055.stdout:2/53: write d4/dc/fd [517261,107581] 0 2024-04-26T21:07:54.646 INFO:tasks.workunit.client.1.smithi064.stdout:0/138: link l2 dd/d10/d1a/l25 0 2024-04-26T21:07:54.648 INFO:tasks.workunit.client.0.smithi055.stdout:8/15: rename d3/c4 to d3/c8 0 2024-04-26T21:07:54.650 INFO:tasks.workunit.client.0.smithi055.stdout:7/9: creat f0 x:0 0 0 2024-04-26T21:07:54.650 INFO:tasks.workunit.client.0.smithi055.stdout:7/10: creat f1 x:0 0 0 2024-04-26T21:07:54.652 INFO:tasks.workunit.client.0.smithi055.stdout:6/17: mkdir d3 0 2024-04-26T21:07:54.655 INFO:tasks.workunit.client.0.smithi055.stdout:1/34: unlink f0 0 2024-04-26T21:07:54.655 INFO:tasks.workunit.client.0.smithi055.stdout:9/39: stat c0 0 2024-04-26T21:07:54.658 INFO:tasks.workunit.client.1.smithi064.stdout:2/165: dwrite d12/f24 [0,4194304] 0 2024-04-26T21:07:54.658 INFO:tasks.workunit.client.0.smithi055.stdout:3/43: mkdir d0/d1/d13 0 2024-04-26T21:07:54.658 INFO:tasks.workunit.client.0.smithi055.stdout:3/44: creat d0/d1/f14 x:0 0 0 2024-04-26T21:07:54.658 INFO:tasks.workunit.client.0.smithi055.stdout:3/45: truncate d0/f12 139587 0 2024-04-26T21:07:54.659 INFO:tasks.workunit.client.0.smithi055.stdout:3/46: creat d0/d4/f15 x:0 0 0 2024-04-26T21:07:54.662 INFO:tasks.workunit.client.0.smithi055.stdout:5/47: dwrite d4/f6 [0,4194304] 0 2024-04-26T21:07:54.664 INFO:tasks.workunit.client.0.smithi055.stdout:4/4: mknod c2 0 2024-04-26T21:07:54.671 INFO:tasks.workunit.client.0.smithi055.stdout:1/35: mknod d8/ca 0 2024-04-26T21:07:54.675 INFO:tasks.workunit.client.0.smithi055.stdout:9/40: link d2/l9 d2/lc 0 2024-04-26T21:07:54.681 INFO:tasks.workunit.client.0.smithi055.stdout:5/48: link d4/fb d4/f11 0 2024-04-26T21:07:54.682 INFO:tasks.workunit.client.0.smithi055.stdout:5/49: write d4/f11 [1037663,64404] 0 2024-04-26T21:07:54.688 INFO:tasks.workunit.client.0.smithi055.stdout:1/36: link d8/ca d8/cb 0 2024-04-26T21:07:54.688 INFO:tasks.workunit.client.0.smithi055.stdout:9/41: symlink d2/ld 0 2024-04-26T21:07:54.689 INFO:tasks.workunit.client.0.smithi055.stdout:1/37: symlink d8/lc 0 2024-04-26T21:07:54.716 INFO:tasks.workunit.client.0.smithi055.stdout:3/47: dread d0/f7 [4194304,4194304] 0 2024-04-26T21:07:54.720 INFO:tasks.workunit.client.0.smithi055.stdout:9/42: dread d2/f8 [0,4194304] 0 2024-04-26T21:07:54.720 INFO:tasks.workunit.client.0.smithi055.stdout:1/38: dread f6 [0,4194304] 0 2024-04-26T21:07:54.725 INFO:tasks.workunit.client.1.smithi064.stdout:9/177: dwrite d0/f12 [0,4194304] 0 2024-04-26T21:07:54.729 INFO:tasks.workunit.client.0.smithi055.stdout:1/39: truncate f6 192702 0 2024-04-26T21:07:54.729 INFO:tasks.workunit.client.0.smithi055.stdout:1/40: write f1 [798502,66684] 0 2024-04-26T21:07:54.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/48: dread d0/f12 [0,4194304] 0 2024-04-26T21:07:54.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/49: getdents d0/de 0 2024-04-26T21:07:54.735 INFO:tasks.workunit.client.1.smithi064.stdout:4/175: dwrite d0/d5/d13/f19 [0,4194304] 0 2024-04-26T21:07:54.735 INFO:tasks.workunit.client.1.smithi064.stdout:4/176: read - d0/d1d/d17/f25 zero size 2024-04-26T21:07:54.738 INFO:tasks.workunit.client.0.smithi055.stdout:0/62: dwrite d9/dc/f12 [0,4194304] 0 2024-04-26T21:07:54.739 INFO:tasks.workunit.client.1.smithi064.stdout:6/115: dwrite d4/d7/d12/f18 [0,4194304] 0 2024-04-26T21:07:54.739 INFO:tasks.workunit.client.1.smithi064.stdout:6/116: fsync d4/d7/d12/f14 0 2024-04-26T21:07:54.739 INFO:tasks.workunit.client.1.smithi064.stdout:3/130: dwrite d1/f1b [0,4194304] 0 2024-04-26T21:07:54.741 INFO:tasks.workunit.client.1.smithi064.stdout:2/166: rename d12/l14 to d12/d1a/l36 0 2024-04-26T21:07:54.742 INFO:tasks.workunit.client.1.smithi064.stdout:1/186: dwrite d0/d6/d11/f23 [0,4194304] 0 2024-04-26T21:07:54.742 INFO:tasks.workunit.client.1.smithi064.stdout:1/187: dread - d0/f1f zero size 2024-04-26T21:07:54.743 INFO:tasks.workunit.client.1.smithi064.stdout:8/125: dwrite d10/f1f [0,4194304] 0 2024-04-26T21:07:54.744 INFO:tasks.workunit.client.1.smithi064.stdout:6/117: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:54.745 INFO:tasks.workunit.client.0.smithi055.stdout:3/50: mkdir d0/d4/d16 0 2024-04-26T21:07:54.745 INFO:tasks.workunit.client.0.smithi055.stdout:2/54: rmdir d4/dc 39 2024-04-26T21:07:54.746 INFO:tasks.workunit.client.0.smithi055.stdout:1/41: read f1 [424249,8004] 0 2024-04-26T21:07:54.749 INFO:tasks.workunit.client.1.smithi064.stdout:5/162: dwrite dd/d12/d18/d1a/d1f/f24 [0,4194304] 0 2024-04-26T21:07:54.755 INFO:tasks.workunit.client.0.smithi055.stdout:4/5: getdents . 0 2024-04-26T21:07:54.755 INFO:tasks.workunit.client.0.smithi055.stdout:4/6: fdatasync - no filename 2024-04-26T21:07:54.755 INFO:tasks.workunit.client.0.smithi055.stdout:4/7: fsync - no filename 2024-04-26T21:07:54.757 INFO:tasks.workunit.client.0.smithi055.stdout:6/18: dwrite f1 [0,4194304] 0 2024-04-26T21:07:54.760 INFO:tasks.workunit.client.0.smithi055.stdout:7/11: getdents . 0 2024-04-26T21:07:54.761 INFO:tasks.workunit.client.0.smithi055.stdout:7/12: write f1 [497822,3470] 0 2024-04-26T21:07:54.766 INFO:tasks.workunit.client.0.smithi055.stdout:0/63: dread d9/fa [0,4194304] 0 2024-04-26T21:07:54.767 INFO:tasks.workunit.client.0.smithi055.stdout:1/42: symlink d8/ld 0 2024-04-26T21:07:54.768 INFO:tasks.workunit.client.0.smithi055.stdout:8/16: dwrite f1 [0,4194304] 0 2024-04-26T21:07:54.768 INFO:tasks.workunit.client.0.smithi055.stdout:8/17: stat c0 0 2024-04-26T21:07:54.768 INFO:tasks.workunit.client.0.smithi055.stdout:8/18: stat d3/f5 0 2024-04-26T21:07:54.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/8: symlink l3 0 2024-04-26T21:07:54.769 INFO:tasks.workunit.client.0.smithi055.stdout:9/43: dwrite f1 [4194304,4194304] 0 2024-04-26T21:07:54.770 INFO:tasks.workunit.client.0.smithi055.stdout:3/51: dread d0/f12 [0,4194304] 0 2024-04-26T21:07:54.770 INFO:tasks.workunit.client.0.smithi055.stdout:3/52: chown d0/d4/d5/cb 485109081 1 2024-04-26T21:07:54.779 INFO:tasks.workunit.client.0.smithi055.stdout:6/19: symlink d3/l4 0 2024-04-26T21:07:54.779 INFO:tasks.workunit.client.0.smithi055.stdout:6/20: stat d3/l4 0 2024-04-26T21:07:54.780 INFO:tasks.workunit.client.1.smithi064.stdout:0/139: dwrite fc [0,4194304] 0 2024-04-26T21:07:54.780 INFO:tasks.workunit.client.1.smithi064.stdout:6/118: dread d4/f16 [0,4194304] 0 2024-04-26T21:07:54.784 INFO:tasks.workunit.client.0.smithi055.stdout:0/64: read f8 [1558922,117491] 0 2024-04-26T21:07:54.788 INFO:tasks.workunit.client.0.smithi055.stdout:7/13: creat f2 x:0 0 0 2024-04-26T21:07:54.788 INFO:tasks.workunit.client.0.smithi055.stdout:3/53: write d0/d4/d5/f6 [5158572,27725] 0 2024-04-26T21:07:54.790 INFO:tasks.workunit.client.0.smithi055.stdout:9/44: dread d2/f8 [0,4194304] 0 2024-04-26T21:07:54.791 INFO:tasks.workunit.client.1.smithi064.stdout:0/140: write dd/f15 [179756,46103] 0 2024-04-26T21:07:54.791 INFO:tasks.workunit.client.1.smithi064.stdout:0/141: write dd/f15 [1168241,83948] 0 2024-04-26T21:07:54.791 INFO:tasks.workunit.client.1.smithi064.stdout:6/119: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:54.791 INFO:tasks.workunit.client.1.smithi064.stdout:6/120: write d4/d7/fe [2500962,78675] 0 2024-04-26T21:07:54.791 INFO:tasks.workunit.client.1.smithi064.stdout:6/121: readlink d4/d7/l19 0 2024-04-26T21:07:54.796 INFO:tasks.workunit.client.0.smithi055.stdout:1/43: rmdir d8 39 2024-04-26T21:07:54.798 INFO:tasks.workunit.client.0.smithi055.stdout:8/19: mkdir d3/d9 0 2024-04-26T21:07:54.801 INFO:tasks.workunit.client.0.smithi055.stdout:6/21: link f0 d3/f5 0 2024-04-26T21:07:54.801 INFO:tasks.workunit.client.0.smithi055.stdout:6/22: stat d3/l4 0 2024-04-26T21:07:54.804 INFO:tasks.workunit.client.0.smithi055.stdout:0/65: dread f8 [0,4194304] 0 2024-04-26T21:07:54.807 INFO:tasks.workunit.client.0.smithi055.stdout:3/54: rename d0/d4/ff to d0/de/f17 0 2024-04-26T21:07:54.809 INFO:tasks.workunit.client.0.smithi055.stdout:6/23: write f0 [112126,119370] 0 2024-04-26T21:07:54.811 INFO:tasks.workunit.client.1.smithi064.stdout:1/188: mknod d0/d6/d11/d1e/d27/c3d 0 2024-04-26T21:07:54.811 INFO:tasks.workunit.client.1.smithi064.stdout:1/189: write d0/d22/f30 [883005,124087] 0 2024-04-26T21:07:54.815 INFO:tasks.workunit.client.0.smithi055.stdout:9/45: unlink d2/lc 0 2024-04-26T21:07:54.815 INFO:tasks.workunit.client.0.smithi055.stdout:9/46: fdatasync d2/f8 0 2024-04-26T21:07:54.816 INFO:tasks.workunit.client.0.smithi055.stdout:2/55: dwrite d4/ff [0,4194304] 0 2024-04-26T21:07:54.816 INFO:tasks.workunit.client.1.smithi064.stdout:0/142: write dd/d10/f16 [905151,3040] 0 2024-04-26T21:07:54.816 INFO:tasks.workunit.client.1.smithi064.stdout:0/143: chown dd/d10 1 1 2024-04-26T21:07:54.817 INFO:tasks.workunit.client.0.smithi055.stdout:1/44: rename d8/c9 to d8/ce 0 2024-04-26T21:07:54.819 INFO:tasks.workunit.client.1.smithi064.stdout:5/163: getdents dd/d12/d18/d1a 0 2024-04-26T21:07:54.820 INFO:tasks.workunit.client.1.smithi064.stdout:5/164: creat dd/d12/d18/d1a/d1f/d20/f31 x:0 0 0 2024-04-26T21:07:54.821 INFO:tasks.workunit.client.0.smithi055.stdout:8/20: mknod d3/ca 0 2024-04-26T21:07:54.825 INFO:tasks.workunit.client.1.smithi064.stdout:8/126: dwrite d10/f1b [0,4194304] 0 2024-04-26T21:07:54.825 INFO:tasks.workunit.client.1.smithi064.stdout:7/113: sync 2024-04-26T21:07:54.826 INFO:tasks.workunit.client.1.smithi064.stdout:2/167: dread d12/f24 [0,4194304] 0 2024-04-26T21:07:54.828 INFO:tasks.workunit.client.0.smithi055.stdout:3/55: unlink d0/f7 0 2024-04-26T21:07:54.830 INFO:tasks.workunit.client.1.smithi064.stdout:3/131: getdents d1/d14 0 2024-04-26T21:07:54.832 INFO:tasks.workunit.client.0.smithi055.stdout:7/14: dwrite f0 [0,4194304] 0 2024-04-26T21:07:54.833 INFO:tasks.workunit.client.0.smithi055.stdout:0/66: rename l5 to d9/dc/d17/l1b 0 2024-04-26T21:07:54.836 INFO:tasks.workunit.client.0.smithi055.stdout:6/24: symlink d3/l6 0 2024-04-26T21:07:54.839 INFO:tasks.workunit.client.1.smithi064.stdout:6/122: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:07:54.839 INFO:tasks.workunit.client.1.smithi064.stdout:6/123: fsync d4/d7/f1f 0 2024-04-26T21:07:54.840 INFO:tasks.workunit.client.0.smithi055.stdout:2/56: mkdir d4/d14 0 2024-04-26T21:07:54.841 INFO:tasks.workunit.client.1.smithi064.stdout:5/165: truncate dd/d12/d18/f2f 4832897 0 2024-04-26T21:07:54.841 INFO:tasks.workunit.client.1.smithi064.stdout:5/166: fsync dd/d12/f2e 0 2024-04-26T21:07:54.843 INFO:tasks.workunit.client.0.smithi055.stdout:1/45: rmdir d8 39 2024-04-26T21:07:54.851 INFO:tasks.workunit.client.0.smithi055.stdout:8/21: symlink d3/lb 0 2024-04-26T21:07:54.852 INFO:tasks.workunit.client.1.smithi064.stdout:8/127: truncate fa 72963 0 2024-04-26T21:07:54.853 INFO:tasks.workunit.client.1.smithi064.stdout:2/168: truncate d12/d1a/f2b 793009 0 2024-04-26T21:07:54.857 INFO:tasks.workunit.client.1.smithi064.stdout:3/132: mkdir d1/d27/d2c 0 2024-04-26T21:07:54.858 INFO:tasks.workunit.client.0.smithi055.stdout:0/67: unlink d9/c16 0 2024-04-26T21:07:54.858 INFO:tasks.workunit.client.0.smithi055.stdout:0/68: stat d9/fa 0 2024-04-26T21:07:54.858 INFO:tasks.workunit.client.0.smithi055.stdout:7/15: unlink f2 0 2024-04-26T21:07:54.858 INFO:tasks.workunit.client.1.smithi064.stdout:6/124: dread d4/d7/fe [0,4194304] 0 2024-04-26T21:07:54.861 INFO:tasks.workunit.client.0.smithi055.stdout:6/25: creat d3/f7 x:0 0 0 2024-04-26T21:07:54.862 INFO:tasks.workunit.client.0.smithi055.stdout:6/26: write d3/f7 [232342,41356] 0 2024-04-26T21:07:54.864 INFO:tasks.workunit.client.1.smithi064.stdout:5/167: mkdir dd/d12/d18/d25/d32 0 2024-04-26T21:07:54.864 INFO:tasks.workunit.client.1.smithi064.stdout:5/168: dread - dd/d12/d18/d1a/d1f/d20/f2d zero size 2024-04-26T21:07:54.866 INFO:tasks.workunit.client.0.smithi055.stdout:9/47: rmdir d2 39 2024-04-26T21:07:54.866 INFO:tasks.workunit.client.0.smithi055.stdout:9/48: fsync f1 0 2024-04-26T21:07:54.867 INFO:tasks.workunit.client.1.smithi064.stdout:0/144: dwrite dd/f15 [0,4194304] 0 2024-04-26T21:07:54.869 INFO:tasks.workunit.client.1.smithi064.stdout:7/114: dwrite f3 [0,4194304] 0 2024-04-26T21:07:54.871 INFO:tasks.workunit.client.0.smithi055.stdout:0/69: mkdir d9/dc/d1c 0 2024-04-26T21:07:54.872 INFO:tasks.workunit.client.0.smithi055.stdout:2/57: write d4/f5 [3382009,70166] 0 2024-04-26T21:07:54.873 INFO:tasks.workunit.client.1.smithi064.stdout:3/133: dread d1/ff [0,4194304] 0 2024-04-26T21:07:54.875 INFO:tasks.workunit.client.0.smithi055.stdout:7/16: rename f0 to f3 0 2024-04-26T21:07:54.880 INFO:tasks.workunit.client.1.smithi064.stdout:5/169: mkdir dd/d12/d18/d33 0 2024-04-26T21:07:54.883 INFO:tasks.workunit.client.0.smithi055.stdout:6/27: rename c2 to d3/c8 0 2024-04-26T21:07:54.883 INFO:tasks.workunit.client.0.smithi055.stdout:6/28: readlink d3/l6 0 2024-04-26T21:07:54.883 INFO:tasks.workunit.client.0.smithi055.stdout:0/70: rename d9/dc/d17 to d9/dc/d17/d1d 22 2024-04-26T21:07:54.883 INFO:tasks.workunit.client.0.smithi055.stdout:6/29: creat d3/f9 x:0 0 0 2024-04-26T21:07:54.885 INFO:tasks.workunit.client.1.smithi064.stdout:0/145: symlink dd/d21/l26 0 2024-04-26T21:07:54.885 INFO:tasks.workunit.client.1.smithi064.stdout:0/146: dread - dd/d1c/f1f zero size 2024-04-26T21:07:54.895 INFO:tasks.workunit.client.0.smithi055.stdout:9/49: creat d2/fe x:0 0 0 2024-04-26T21:07:54.895 INFO:tasks.workunit.client.0.smithi055.stdout:9/50: rename d2 to d2/df 22 2024-04-26T21:07:54.896 INFO:tasks.workunit.client.0.smithi055.stdout:9/51: creat d2/f10 x:0 0 0 2024-04-26T21:07:54.900 INFO:tasks.workunit.client.0.smithi055.stdout:7/17: symlink l4 0 2024-04-26T21:07:54.903 INFO:tasks.workunit.client.0.smithi055.stdout:0/71: dread d9/dc/f12 [0,4194304] 0 2024-04-26T21:07:54.903 INFO:tasks.workunit.client.0.smithi055.stdout:1/46: dwrite f1 [0,4194304] 0 2024-04-26T21:07:54.904 INFO:tasks.workunit.client.1.smithi064.stdout:1/190: truncate d0/d22/f30 557182 0 2024-04-26T21:07:54.904 INFO:tasks.workunit.client.1.smithi064.stdout:1/191: write d0/d6/d11/d1e/f21 [828168,57995] 0 2024-04-26T21:07:54.904 INFO:tasks.workunit.client.1.smithi064.stdout:1/192: readlink d0/l8 0 2024-04-26T21:07:54.908 INFO:tasks.workunit.client.0.smithi055.stdout:2/58: dread d4/f5 [0,4194304] 0 2024-04-26T21:07:54.913 INFO:tasks.workunit.client.0.smithi055.stdout:8/22: dwrite f2 [0,4194304] 0 2024-04-26T21:07:54.920 INFO:tasks.workunit.client.0.smithi055.stdout:9/52: mkdir d2/d11 0 2024-04-26T21:07:54.925 INFO:tasks.workunit.client.0.smithi055.stdout:6/30: rename d3/c8 to d3/ca 0 2024-04-26T21:07:54.925 INFO:tasks.workunit.client.1.smithi064.stdout:6/125: mknod d4/c20 0 2024-04-26T21:07:54.929 INFO:tasks.workunit.client.1.smithi064.stdout:3/134: rename d1/da/d22/f25 to d1/da/f2d 0 2024-04-26T21:07:54.932 INFO:tasks.workunit.client.0.smithi055.stdout:8/23: write f1 [3168755,267] 0 2024-04-26T21:07:54.935 INFO:tasks.workunit.client.1.smithi064.stdout:5/170: mknod dd/d12/d18/d33/c34 0 2024-04-26T21:07:54.940 INFO:tasks.workunit.client.0.smithi055.stdout:0/72: creat d9/dc/d17/f1e x:0 0 0 2024-04-26T21:07:54.940 INFO:tasks.workunit.client.0.smithi055.stdout:0/73: write d9/dc/f10 [950717,124882] 0 2024-04-26T21:07:54.941 INFO:tasks.workunit.client.1.smithi064.stdout:0/147: creat dd/d10/f27 x:0 0 0 2024-04-26T21:07:54.942 INFO:tasks.workunit.client.1.smithi064.stdout:0/148: readlink dd/d1c/l20 0 2024-04-26T21:07:54.942 INFO:tasks.workunit.client.1.smithi064.stdout:0/149: chown dd/d10/c11 5234915 1 2024-04-26T21:07:54.943 INFO:tasks.workunit.client.0.smithi055.stdout:1/47: mkdir d8/df 0 2024-04-26T21:07:54.943 INFO:tasks.workunit.client.1.smithi064.stdout:3/135: write d1/fc [1182646,15274] 0 2024-04-26T21:07:54.943 INFO:tasks.workunit.client.1.smithi064.stdout:3/136: read - d1/da/f24 zero size 2024-04-26T21:07:54.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/59: creat d4/db/f15 x:0 0 0 2024-04-26T21:07:54.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/60: write d4/db/f15 [906123,210] 0 2024-04-26T21:07:54.951 INFO:tasks.workunit.client.1.smithi064.stdout:8/128: rmdir d10/d1d/d2b 0 2024-04-26T21:07:54.959 INFO:tasks.workunit.client.1.smithi064.stdout:2/169: link d12/d16/d29/f2d d12/d28/f37 0 2024-04-26T21:07:54.962 INFO:tasks.workunit.client.1.smithi064.stdout:6/126: symlink d4/d7/d12/d1e/l21 0 2024-04-26T21:07:54.965 INFO:tasks.workunit.client.0.smithi055.stdout:8/24: symlink d3/lc 0 2024-04-26T21:07:54.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/74: mknod d9/d11/c1f 0 2024-04-26T21:07:54.968 INFO:tasks.workunit.client.1.smithi064.stdout:5/171: creat dd/d12/d18/d25/f35 x:0 0 0 2024-04-26T21:07:54.970 INFO:tasks.workunit.client.1.smithi064.stdout:0/150: symlink dd/d21/l28 0 2024-04-26T21:07:54.970 INFO:tasks.workunit.client.1.smithi064.stdout:0/151: chown dd/d21/l26 3163234 1 2024-04-26T21:07:54.972 INFO:tasks.workunit.client.0.smithi055.stdout:7/18: dwrite f1 [0,4194304] 0 2024-04-26T21:07:54.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/75: rename d9/d11/c1f to d9/c20 0 2024-04-26T21:07:54.974 INFO:tasks.workunit.client.0.smithi055.stdout:0/76: write d9/dc/d17/f1e [431848,128759] 0 2024-04-26T21:07:54.974 INFO:tasks.workunit.client.1.smithi064.stdout:3/137: unlink d1/da/f20 0 2024-04-26T21:07:54.978 INFO:tasks.workunit.client.1.smithi064.stdout:9/178: sync 2024-04-26T21:07:54.978 INFO:tasks.workunit.client.1.smithi064.stdout:4/177: sync 2024-04-26T21:07:54.980 INFO:tasks.workunit.client.1.smithi064.stdout:1/193: getdents d0/d6 0 2024-04-26T21:07:54.980 INFO:tasks.workunit.client.1.smithi064.stdout:1/194: chown d0/d6/d11/d1e/d2a/d34/f3a 29 1 2024-04-26T21:07:54.980 INFO:tasks.workunit.client.1.smithi064.stdout:1/195: chown d0/c26 74763225 1 2024-04-26T21:07:54.980 INFO:tasks.workunit.client.1.smithi064.stdout:1/196: readlink d0/d6/d11/d1e/l32 0 2024-04-26T21:07:54.980 INFO:tasks.workunit.client.1.smithi064.stdout:6/127: dread d4/d7/fe [0,4194304] 0 2024-04-26T21:07:54.983 INFO:tasks.workunit.client.1.smithi064.stdout:8/129: symlink d10/d1d/l2c 0 2024-04-26T21:07:54.984 INFO:tasks.workunit.client.1.smithi064.stdout:8/130: creat d10/f2d x:0 0 0 2024-04-26T21:07:54.984 INFO:tasks.workunit.client.1.smithi064.stdout:8/131: chown cd 285 1 2024-04-26T21:07:54.989 INFO:tasks.workunit.client.1.smithi064.stdout:2/170: getdents d12 0 2024-04-26T21:07:54.989 INFO:tasks.workunit.client.1.smithi064.stdout:4/178: rmdir d0/d14 39 2024-04-26T21:07:54.990 INFO:tasks.workunit.client.1.smithi064.stdout:1/197: symlink d0/l3e 0 2024-04-26T21:07:54.992 INFO:tasks.workunit.client.1.smithi064.stdout:5/172: getdents dd/d12/d18 0 2024-04-26T21:07:54.995 INFO:tasks.workunit.client.1.smithi064.stdout:2/171: rename d12/d28/l30 to d12/d16/d2f/l38 0 2024-04-26T21:07:55.000 INFO:tasks.workunit.client.1.smithi064.stdout:4/179: mknod d0/d5/d13/c3b 0 2024-04-26T21:07:55.000 INFO:tasks.workunit.client.1.smithi064.stdout:4/180: chown d0 25454 1 2024-04-26T21:07:55.000 INFO:tasks.workunit.client.1.smithi064.stdout:1/198: getdents d0/d6/d29 0 2024-04-26T21:07:55.002 INFO:tasks.workunit.client.1.smithi064.stdout:3/138: read d1/f1b [2942811,64497] 0 2024-04-26T21:07:55.002 INFO:tasks.workunit.client.1.smithi064.stdout:3/139: creat d1/da/d22/f2e x:0 0 0 2024-04-26T21:07:55.002 INFO:tasks.workunit.client.1.smithi064.stdout:3/140: write d1/d14/f1c [1182617,119958] 0 2024-04-26T21:07:55.003 INFO:tasks.workunit.client.1.smithi064.stdout:6/128: symlink d4/l22 0 2024-04-26T21:07:55.006 INFO:tasks.workunit.client.1.smithi064.stdout:2/172: symlink d12/d16/l39 0 2024-04-26T21:07:55.008 INFO:tasks.workunit.client.1.smithi064.stdout:1/199: mknod d0/d6/c3f 0 2024-04-26T21:07:55.008 INFO:tasks.workunit.client.1.smithi064.stdout:1/200: fsync d0/f3 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:2/173: mkdir d12/d28/d3a 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/201: mknod d0/d6/d11/d1e/d2a/c40 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/202: chown d0/c26 189670064 1 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/203: fdatasync d0/d6/d11/f35 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/204: write d0/f12 [1931980,105546] 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/205: dread - d0/d6/d11/d1e/d2a/d34/f3a zero size 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/206: write d0/d6/d11/d1e/d2a/d34/f3a [580551,28777] 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/207: fsync d0/d22/f30 0 2024-04-26T21:07:55.014 INFO:tasks.workunit.client.1.smithi064.stdout:1/208: chown d0/ca 3903 1 2024-04-26T21:07:55.016 INFO:tasks.workunit.client.1.smithi064.stdout:1/209: symlink d0/d6/d11/d1e/d27/l41 0 2024-04-26T21:07:55.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/115: sync 2024-04-26T21:07:55.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/116: write d6/d9/f1a [253697,19454] 0 2024-04-26T21:07:55.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/117: chown d6/f24 1352784348 1 2024-04-26T21:07:55.021 INFO:tasks.workunit.client.1.smithi064.stdout:7/118: mkdir d6/d12/d26 0 2024-04-26T21:07:55.034 INFO:tasks.workunit.client.1.smithi064.stdout:5/173: dread dd/f10 [0,4194304] 0 2024-04-26T21:07:55.034 INFO:tasks.workunit.client.0.smithi055.stdout:8/25: write f2 [3527505,44673] 0 2024-04-26T21:07:55.034 INFO:tasks.workunit.client.0.smithi055.stdout:8/26: symlink d3/d9/ld 0 2024-04-26T21:07:55.038 INFO:tasks.workunit.client.1.smithi064.stdout:0/152: dwrite dd/ff [0,4194304] 0 2024-04-26T21:07:55.038 INFO:tasks.workunit.client.1.smithi064.stdout:0/153: truncate fc 4882025 0 2024-04-26T21:07:55.048 INFO:tasks.workunit.client.1.smithi064.stdout:3/141: fsync d1/da/d22/f2e 0 2024-04-26T21:07:55.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/19: read f1 [3701873,101077] 0 2024-04-26T21:07:55.052 INFO:tasks.workunit.client.1.smithi064.stdout:0/154: link dd/d10/f27 dd/d10/d18/f29 0 2024-04-26T21:07:55.053 INFO:tasks.workunit.client.1.smithi064.stdout:0/155: creat dd/f2a x:0 0 0 2024-04-26T21:07:55.055 INFO:tasks.workunit.client.0.smithi055.stdout:2/61: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:07:55.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/174: write d12/d1a/f2b [714790,38612] 0 2024-04-26T21:07:55.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/181: write d0/d1d/d17/f2c [1032822,41505] 0 2024-04-26T21:07:55.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/182: readlink d0/d14/l29 0 2024-04-26T21:07:55.062 INFO:tasks.workunit.client.0.smithi055.stdout:7/20: dread f1 [0,4194304] 0 2024-04-26T21:07:55.064 INFO:tasks.workunit.client.1.smithi064.stdout:9/179: dwrite d0/d4/d28/f2d [0,4194304] 0 2024-04-26T21:07:55.064 INFO:tasks.workunit.client.1.smithi064.stdout:9/180: chown d0/d4/d7/df 3 1 2024-04-26T21:07:55.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/156: symlink dd/d10/d18/l2b 0 2024-04-26T21:07:55.073 INFO:tasks.workunit.client.1.smithi064.stdout:7/119: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:55.075 INFO:tasks.workunit.client.0.smithi055.stdout:9/53: dwrite d2/fe [0,4194304] 0 2024-04-26T21:07:55.075 INFO:tasks.workunit.client.0.smithi055.stdout:9/54: read - d2/f10 zero size 2024-04-26T21:07:55.081 INFO:tasks.workunit.client.1.smithi064.stdout:2/175: getdents d12/d16/d29 0 2024-04-26T21:07:55.081 INFO:tasks.workunit.client.1.smithi064.stdout:0/157: unlink f5 0 2024-04-26T21:07:55.081 INFO:tasks.workunit.client.1.smithi064.stdout:1/210: write d0/d6/d11/d1e/f1b [844649,129810] 0 2024-04-26T21:07:55.081 INFO:tasks.workunit.client.1.smithi064.stdout:1/211: write d0/d6/f19 [1829877,2902] 0 2024-04-26T21:07:55.081 INFO:tasks.workunit.client.1.smithi064.stdout:6/129: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:07:55.083 INFO:tasks.workunit.client.0.smithi055.stdout:0/77: dwrite d9/fa [0,4194304] 0 2024-04-26T21:07:55.084 INFO:tasks.workunit.client.1.smithi064.stdout:7/120: rename d6/d9/c17 to d6/d15/c27 0 2024-04-26T21:07:55.085 INFO:tasks.workunit.client.0.smithi055.stdout:7/21: truncate f3 2008585 0 2024-04-26T21:07:55.085 INFO:tasks.workunit.client.0.smithi055.stdout:8/27: dread f2 [0,4194304] 0 2024-04-26T21:07:55.088 INFO:tasks.workunit.client.0.smithi055.stdout:9/55: rename d2/c7 to d2/d11/c12 0 2024-04-26T21:07:55.090 INFO:tasks.workunit.client.0.smithi055.stdout:0/78: creat d9/dc/d1c/f21 x:0 0 0 2024-04-26T21:07:55.094 INFO:tasks.workunit.client.1.smithi064.stdout:0/158: mknod dd/d10/d18/c2c 0 2024-04-26T21:07:55.096 INFO:tasks.workunit.client.0.smithi055.stdout:8/28: getdents d3/d9 0 2024-04-26T21:07:55.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/176: link d12/d16/c25 d12/d16/d2f/c3b 0 2024-04-26T21:07:55.113 INFO:tasks.workunit.client.0.smithi055.stdout:6/31: dwrite d3/f7 [0,4194304] 0 2024-04-26T21:07:55.113 INFO:tasks.workunit.client.0.smithi055.stdout:6/32: chown f0 0 1 2024-04-26T21:07:55.118 INFO:tasks.workunit.client.1.smithi064.stdout:9/181: write d0/d4/d7/f20 [5007694,64706] 0 2024-04-26T21:07:55.121 INFO:tasks.workunit.client.1.smithi064.stdout:7/121: creat d6/d15/f28 x:0 0 0 2024-04-26T21:07:55.121 INFO:tasks.workunit.client.1.smithi064.stdout:7/122: write d6/d15/d1c/f25 [3325682,82068] 0 2024-04-26T21:07:55.122 INFO:tasks.workunit.client.1.smithi064.stdout:7/123: write d6/d9/f11 [455515,87195] 0 2024-04-26T21:07:55.127 INFO:tasks.workunit.client.1.smithi064.stdout:6/130: write d4/d7/d12/f18 [785066,76979] 0 2024-04-26T21:07:55.127 INFO:tasks.workunit.client.1.smithi064.stdout:5/174: dwrite dd/f10 [0,4194304] 0 2024-04-26T21:07:55.132 INFO:tasks.workunit.client.1.smithi064.stdout:4/183: dwrite d0/f11 [0,4194304] 0 2024-04-26T21:07:55.137 INFO:tasks.workunit.client.1.smithi064.stdout:1/212: rmdir d0/d6/d11 39 2024-04-26T21:07:55.137 INFO:tasks.workunit.client.1.smithi064.stdout:1/213: write d0/d6/d11/d1e/f1b [1455296,52894] 0 2024-04-26T21:07:55.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/214: read d0/d6/d11/d1e/d2a/d34/f3a [433422,9908] 0 2024-04-26T21:07:55.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/215: fdatasync d0/d6/d11/d1e/f21 0 2024-04-26T21:07:55.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/216: fdatasync d0/d6/d11/d1e/d27/f2d 0 2024-04-26T21:07:55.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/217: chown d0/d22/f30 672 1 2024-04-26T21:07:55.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/218: write d0/d22/f38 [981099,18379] 0 2024-04-26T21:07:55.144 INFO:tasks.workunit.client.1.smithi064.stdout:2/177: dwrite d12/d28/f35 [0,4194304] 0 2024-04-26T21:07:55.144 INFO:tasks.workunit.client.1.smithi064.stdout:5/175: dread fb [0,4194304] 0 2024-04-26T21:07:55.144 INFO:tasks.workunit.client.1.smithi064.stdout:9/182: rename d0/f12 to d0/d4/da/d31/d34/f3c 0 2024-04-26T21:07:55.145 INFO:tasks.workunit.client.0.smithi055.stdout:2/62: dwrite d4/ff [0,4194304] 0 2024-04-26T21:07:55.149 INFO:tasks.workunit.client.0.smithi055.stdout:8/29: dread f2 [0,4194304] 0 2024-04-26T21:07:55.152 INFO:tasks.workunit.client.0.smithi055.stdout:0/79: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:55.156 INFO:tasks.workunit.client.1.smithi064.stdout:7/124: creat d6/db/f29 x:0 0 0 2024-04-26T21:07:55.158 INFO:tasks.workunit.client.0.smithi055.stdout:2/63: creat d4/dc/f16 x:0 0 0 2024-04-26T21:07:55.160 INFO:tasks.workunit.client.0.smithi055.stdout:8/30: creat d3/d9/fe x:0 0 0 2024-04-26T21:07:55.160 INFO:tasks.workunit.client.0.smithi055.stdout:8/31: write f1 [79742,103953] 0 2024-04-26T21:07:55.161 INFO:tasks.workunit.client.0.smithi055.stdout:8/32: dread - d3/d9/fe zero size 2024-04-26T21:07:55.163 INFO:tasks.workunit.client.0.smithi055.stdout:7/22: dwrite f1 [0,4194304] 0 2024-04-26T21:07:55.164 INFO:tasks.workunit.client.0.smithi055.stdout:0/80: symlink d9/dc/d19/l22 0 2024-04-26T21:07:55.169 INFO:tasks.workunit.client.0.smithi055.stdout:2/64: mkdir d4/d14/d17 0 2024-04-26T21:07:55.172 INFO:tasks.workunit.client.1.smithi064.stdout:0/159: dwrite dd/d1c/f1f [0,4194304] 0 2024-04-26T21:07:55.173 INFO:tasks.workunit.client.0.smithi055.stdout:6/33: dwrite f1 [0,4194304] 0 2024-04-26T21:07:55.175 INFO:tasks.workunit.client.0.smithi055.stdout:6/34: write d3/f5 [1478234,69856] 0 2024-04-26T21:07:55.176 INFO:tasks.workunit.client.0.smithi055.stdout:7/23: mkdir d5 0 2024-04-26T21:07:55.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/65: rename d4/dc/fd to d4/dc/f18 0 2024-04-26T21:07:55.184 INFO:tasks.workunit.client.0.smithi055.stdout:0/81: dread f8 [0,4194304] 0 2024-04-26T21:07:55.190 INFO:tasks.workunit.client.1.smithi064.stdout:1/219: creat d0/d6/d11/d1e/f42 x:0 0 0 2024-04-26T21:07:55.191 INFO:tasks.workunit.client.1.smithi064.stdout:1/220: write d0/d6/d11/d1e/f21 [1256073,85787] 0 2024-04-26T21:07:55.191 INFO:tasks.workunit.client.1.smithi064.stdout:1/221: creat d0/d6/d11/d1e/f43 x:0 0 0 2024-04-26T21:07:55.192 INFO:tasks.workunit.client.0.smithi055.stdout:0/82: mknod d9/d11/c23 0 2024-04-26T21:07:55.197 INFO:tasks.workunit.client.0.smithi055.stdout:0/83: creat d9/dc/d19/f24 x:0 0 0 2024-04-26T21:07:55.200 INFO:tasks.workunit.client.1.smithi064.stdout:2/178: truncate d12/d1a/f2c 90759 0 2024-04-26T21:07:55.200 INFO:tasks.workunit.client.1.smithi064.stdout:2/179: write d12/d28/f37 [850261,89294] 0 2024-04-26T21:07:55.202 INFO:tasks.workunit.client.1.smithi064.stdout:6/131: rename d4/d7/d12/c1c to d4/d7/d12/d1e/c23 0 2024-04-26T21:07:55.211 INFO:tasks.workunit.client.0.smithi055.stdout:7/24: dread f1 [0,4194304] 0 2024-04-26T21:07:55.212 INFO:tasks.workunit.client.1.smithi064.stdout:8/132: sync 2024-04-26T21:07:55.212 INFO:tasks.workunit.client.1.smithi064.stdout:8/133: chown l1 358462 1 2024-04-26T21:07:55.212 INFO:tasks.workunit.client.1.smithi064.stdout:9/183: creat d0/d39/f3d x:0 0 0 2024-04-26T21:07:55.213 INFO:tasks.workunit.client.1.smithi064.stdout:4/184: dwrite d0/d1d/d17/f2c [0,4194304] 0 2024-04-26T21:07:55.217 INFO:tasks.workunit.client.0.smithi055.stdout:0/84: rmdir d9/dc/d17 39 2024-04-26T21:07:55.217 INFO:tasks.workunit.client.0.smithi055.stdout:0/85: rename d9/dc/d1c to d9/dc/d1c/d25 22 2024-04-26T21:07:55.218 INFO:tasks.workunit.client.1.smithi064.stdout:8/134: dread fa [0,4194304] 0 2024-04-26T21:07:55.222 INFO:tasks.workunit.client.1.smithi064.stdout:7/125: dwrite d6/f24 [0,4194304] 0 2024-04-26T21:07:55.223 INFO:tasks.workunit.client.0.smithi055.stdout:7/25: mkdir d5/d6 0 2024-04-26T21:07:55.232 INFO:tasks.workunit.client.0.smithi055.stdout:7/26: creat d5/d6/f7 x:0 0 0 2024-04-26T21:07:55.232 INFO:tasks.workunit.client.0.smithi055.stdout:7/27: readlink l4 0 2024-04-26T21:07:55.232 INFO:tasks.workunit.client.0.smithi055.stdout:7/28: write f3 [3046986,123377] 0 2024-04-26T21:07:55.233 INFO:tasks.workunit.client.1.smithi064.stdout:0/160: dread - dd/d10/d18/f29 zero size 2024-04-26T21:07:55.239 INFO:tasks.workunit.client.1.smithi064.stdout:1/222: symlink d0/d22/l44 0 2024-04-26T21:07:55.239 INFO:tasks.workunit.client.1.smithi064.stdout:1/223: write d0/d6/f19 [2021436,23335] 0 2024-04-26T21:07:55.239 INFO:tasks.workunit.client.0.smithi055.stdout:2/66: dwrite d4/dc/f11 [0,4194304] 0 2024-04-26T21:07:55.243 INFO:tasks.workunit.client.0.smithi055.stdout:7/29: unlink f3 0 2024-04-26T21:07:55.243 INFO:tasks.workunit.client.0.smithi055.stdout:7/30: stat d5/d6/f7 0 2024-04-26T21:07:55.245 INFO:tasks.workunit.client.1.smithi064.stdout:5/176: rename dd/d12/d18/d1a/d1f/d20/f22 to dd/d12/d18/f36 0 2024-04-26T21:07:55.246 INFO:tasks.workunit.client.0.smithi055.stdout:8/33: dread f1 [0,4194304] 0 2024-04-26T21:07:55.248 INFO:tasks.workunit.client.1.smithi064.stdout:6/132: mknod d4/d7/c24 0 2024-04-26T21:07:55.252 INFO:tasks.workunit.client.1.smithi064.stdout:8/135: truncate f4 1188926 0 2024-04-26T21:07:55.252 INFO:tasks.workunit.client.1.smithi064.stdout:8/136: dread - d10/f24 zero size 2024-04-26T21:07:55.252 INFO:tasks.workunit.client.1.smithi064.stdout:8/137: readlink le 0 2024-04-26T21:07:55.253 INFO:tasks.workunit.client.0.smithi055.stdout:7/31: link d5/d6/f7 d5/d6/f8 0 2024-04-26T21:07:55.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:54 smithi055 ceph-mon[25475]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 390 op/s 2024-04-26T21:07:55.257 INFO:tasks.workunit.client.0.smithi055.stdout:6/35: dwrite d3/f7 [0,4194304] 0 2024-04-26T21:07:55.257 INFO:tasks.workunit.client.0.smithi055.stdout:8/34: link c0 d3/cf 0 2024-04-26T21:07:55.258 INFO:tasks.workunit.client.1.smithi064.stdout:7/126: unlink d6/db/d1f/c22 0 2024-04-26T21:07:55.260 INFO:tasks.workunit.client.1.smithi064.stdout:7/127: read d6/d9/f1a [79396,26981] 0 2024-04-26T21:07:55.260 INFO:tasks.workunit.client.1.smithi064.stdout:7/128: creat d6/db/f2a x:0 0 0 2024-04-26T21:07:55.260 INFO:tasks.workunit.client.1.smithi064.stdout:7/129: read - d6/db/f2a zero size 2024-04-26T21:07:55.260 INFO:tasks.workunit.client.1.smithi064.stdout:7/130: stat l4 0 2024-04-26T21:07:55.262 INFO:tasks.workunit.client.1.smithi064.stdout:9/184: truncate d0/d4/d28/f2d 4221752 0 2024-04-26T21:07:55.263 INFO:tasks.workunit.client.1.smithi064.stdout:9/185: write d0/d4/f24 [2067451,23797] 0 2024-04-26T21:07:55.263 INFO:tasks.workunit.client.1.smithi064.stdout:9/186: dread - d0/d4/d7/f2e zero size 2024-04-26T21:07:55.263 INFO:tasks.workunit.client.1.smithi064.stdout:9/187: creat d0/d39/f3e x:0 0 0 2024-04-26T21:07:55.264 INFO:tasks.workunit.client.0.smithi055.stdout:8/35: mknod d3/d9/c10 0 2024-04-26T21:07:55.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/36: fsync f0 0 2024-04-26T21:07:55.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/37: chown d3/f9 82495 1 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:0/161: unlink dd/d10/f27 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:2/180: fsync d12/d1a/f2c 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:1/224: symlink d0/l45 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:4/185: rename d0/c9 to d0/d5/d13/d33/c3c 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:4/186: getdents d0/d5 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:4/187: readlink d0/d14/l29 0 2024-04-26T21:07:55.271 INFO:tasks.workunit.client.1.smithi064.stdout:1/225: creat d0/d6/d11/d1e/f46 x:0 0 0 2024-04-26T21:07:55.272 INFO:tasks.workunit.client.1.smithi064.stdout:4/188: write d0/d5/d13/d33/f39 [281865,59253] 0 2024-04-26T21:07:55.272 INFO:tasks.workunit.client.1.smithi064.stdout:6/133: truncate d4/f16 113138 0 2024-04-26T21:07:55.272 INFO:tasks.workunit.client.0.smithi055.stdout:2/67: dread d4/ff [0,4194304] 0 2024-04-26T21:07:55.273 INFO:tasks.workunit.client.0.smithi055.stdout:8/36: unlink d3/lc 0 2024-04-26T21:07:55.273 INFO:tasks.workunit.client.0.smithi055.stdout:8/37: write d3/d9/fe [496253,111255] 0 2024-04-26T21:07:55.273 INFO:tasks.workunit.client.1.smithi064.stdout:8/138: symlink d10/l2e 0 2024-04-26T21:07:55.273 INFO:tasks.workunit.client.1.smithi064.stdout:3/142: sync 2024-04-26T21:07:55.277 INFO:tasks.workunit.client.0.smithi055.stdout:0/86: dwrite d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:55.279 INFO:tasks.workunit.client.0.smithi055.stdout:8/38: symlink d3/d9/l11 0 2024-04-26T21:07:55.279 INFO:tasks.workunit.client.0.smithi055.stdout:8/39: stat d3 0 2024-04-26T21:07:55.281 INFO:tasks.workunit.client.1.smithi064.stdout:7/131: mknod d6/d12/c2b 0 2024-04-26T21:07:55.284 INFO:tasks.workunit.client.0.smithi055.stdout:0/87: unlink d9/lb 0 2024-04-26T21:07:55.288 INFO:tasks.workunit.client.1.smithi064.stdout:9/188: link d0/d4/da/l1a d0/d4/d28/l3f 0 2024-04-26T21:07:55.288 INFO:tasks.workunit.client.1.smithi064.stdout:9/189: readlink d0/l6 0 2024-04-26T21:07:55.291 INFO:tasks.workunit.client.0.smithi055.stdout:0/88: fsync d9/dc/d17/f1e 0 2024-04-26T21:07:55.291 INFO:tasks.workunit.client.0.smithi055.stdout:0/89: chown d9/dc/d19/f24 0 1 2024-04-26T21:07:55.291 INFO:tasks.workunit.client.0.smithi055.stdout:0/90: write d9/dc/d19/f24 [830281,70800] 0 2024-04-26T21:07:55.291 INFO:tasks.workunit.client.0.smithi055.stdout:0/91: chown l3 0 1 2024-04-26T21:07:55.297 INFO:tasks.workunit.client.1.smithi064.stdout:2/181: symlink d12/d16/d2f/l3c 0 2024-04-26T21:07:55.297 INFO:tasks.workunit.client.1.smithi064.stdout:2/182: write d12/d28/f35 [4691249,39048] 0 2024-04-26T21:07:55.297 INFO:tasks.workunit.client.1.smithi064.stdout:2/183: chown d12/d16/d2f/l3c 43203799 1 2024-04-26T21:07:55.298 INFO:tasks.workunit.client.1.smithi064.stdout:8/139: dread d10/f1f [0,4194304] 0 2024-04-26T21:07:55.303 INFO:tasks.workunit.client.1.smithi064.stdout:4/189: unlink d0/d5/d13/f19 0 2024-04-26T21:07:55.303 INFO:tasks.workunit.client.1.smithi064.stdout:4/190: fdatasync d0/d1d/f2e 0 2024-04-26T21:07:55.317 INFO:tasks.workunit.client.1.smithi064.stdout:1/226: creat d0/d6/d11/d2c/f47 x:0 0 0 2024-04-26T21:07:55.317 INFO:tasks.workunit.client.1.smithi064.stdout:1/227: read d0/f3 [1528909,72622] 0 2024-04-26T21:07:55.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/190: rename d0/d4/da/d31/d34/f3c to d0/d4/d7/df/f40 0 2024-04-26T21:07:55.321 INFO:tasks.workunit.client.1.smithi064.stdout:3/143: truncate d1/f11 931917 0 2024-04-26T21:07:55.326 INFO:tasks.workunit.client.1.smithi064.stdout:0/162: truncate fb 580391 0 2024-04-26T21:07:55.328 INFO:tasks.workunit.client.1.smithi064.stdout:8/140: mkdir d10/d2f 0 2024-04-26T21:07:55.328 INFO:tasks.workunit.client.1.smithi064.stdout:8/141: chown d10/f24 5 1 2024-04-26T21:07:55.334 INFO:tasks.workunit.client.1.smithi064.stdout:1/228: truncate d0/d6/d11/d1e/f1b 2450539 0 2024-04-26T21:07:55.335 INFO:tasks.workunit.client.1.smithi064.stdout:1/229: chown d0/d6/d11/d1e/d27/f2d 276629 1 2024-04-26T21:07:55.335 INFO:tasks.workunit.client.1.smithi064.stdout:1/230: write d0/d6/d11/d1e/d27/f2f [901109,83471] 0 2024-04-26T21:07:55.335 INFO:tasks.workunit.client.1.smithi064.stdout:6/134: mknod d4/c25 0 2024-04-26T21:07:55.338 INFO:tasks.workunit.client.1.smithi064.stdout:7/132: dwrite f3 [0,4194304] 0 2024-04-26T21:07:55.343 INFO:tasks.workunit.client.1.smithi064.stdout:4/191: rename d0/f34 to d0/d5/d13/f3d 0 2024-04-26T21:07:55.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/144: dread d1/ff [0,4194304] 0 2024-04-26T21:07:55.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/145: creat d1/f2f x:0 0 0 2024-04-26T21:07:55.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/146: dread - d1/da/f10 zero size 2024-04-26T21:07:55.345 INFO:tasks.workunit.client.1.smithi064.stdout:1/231: mknod d0/d6/d11/d1e/d2a/d34/c48 0 2024-04-26T21:07:55.345 INFO:tasks.workunit.client.1.smithi064.stdout:1/232: write d0/d6/d11/d1e/f20 [2230807,109904] 0 2024-04-26T21:07:55.346 INFO:tasks.workunit.client.0.smithi055.stdout:7/32: dwrite d5/d6/f8 [0,4194304] 0 2024-04-26T21:07:55.347 INFO:tasks.workunit.client.1.smithi064.stdout:0/163: dread dd/d10/f16 [0,4194304] 0 2024-04-26T21:07:55.353 INFO:tasks.workunit.client.0.smithi055.stdout:2/68: dwrite d4/dc/f18 [0,4194304] 0 2024-04-26T21:07:55.356 INFO:tasks.workunit.client.1.smithi064.stdout:8/142: rename d10/f1f to d10/d1d/f30 0 2024-04-26T21:07:55.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/133: write f5 [3668798,91820] 0 2024-04-26T21:07:55.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/134: write d6/d9/f1a [743000,13914] 0 2024-04-26T21:07:55.361 INFO:tasks.workunit.client.1.smithi064.stdout:3/147: symlink d1/d27/d2c/l30 0 2024-04-26T21:07:55.361 INFO:tasks.workunit.client.1.smithi064.stdout:3/148: stat d1/d14/c2a 0 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/184: dwrite d12/d1a/f2c [0,4194304] 0 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/185: chown d12/d16/f19 8 1 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/186: readlink d12/d1a/l36 0 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/187: readlink d12/l26 0 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/188: creat d12/d28/f3d x:0 0 0 2024-04-26T21:07:55.362 INFO:tasks.workunit.client.1.smithi064.stdout:2/189: truncate d12/d28/f33 586517 0 2024-04-26T21:07:55.368 INFO:tasks.workunit.client.0.smithi055.stdout:0/92: dwrite d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:07:55.368 INFO:tasks.workunit.client.0.smithi055.stdout:0/93: write d9/dc/d19/f24 [1866099,122605] 0 2024-04-26T21:07:55.370 INFO:tasks.workunit.client.0.smithi055.stdout:0/94: creat d9/dc/d1c/f26 x:0 0 0 2024-04-26T21:07:55.370 INFO:tasks.workunit.client.1.smithi064.stdout:6/135: symlink d4/l26 0 2024-04-26T21:07:55.377 INFO:tasks.workunit.client.1.smithi064.stdout:8/143: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:07:55.378 INFO:tasks.workunit.client.0.smithi055.stdout:2/69: link d4/ff d4/d14/f19 0 2024-04-26T21:07:55.384 INFO:tasks.workunit.client.0.smithi055.stdout:6/38: dwrite f1 [4194304,4194304] 0 2024-04-26T21:07:55.398 INFO:tasks.workunit.client.1.smithi064.stdout:2/190: mkdir d12/d28/d3a/d3e 0 2024-04-26T21:07:55.400 INFO:tasks.workunit.client.0.smithi055.stdout:0/95: dread f8 [0,4194304] 0 2024-04-26T21:07:55.401 INFO:tasks.workunit.client.0.smithi055.stdout:2/70: dread d4/dc/f18 [0,4194304] 0 2024-04-26T21:07:55.402 INFO:tasks.workunit.client.0.smithi055.stdout:2/71: truncate d4/ff 4528647 0 2024-04-26T21:07:55.402 INFO:tasks.workunit.client.0.smithi055.stdout:2/72: chown d4/dc/f11 471 1 2024-04-26T21:07:55.403 INFO:tasks.workunit.client.1.smithi064.stdout:1/233: rmdir d0/d6/d11/d1e 39 2024-04-26T21:07:55.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:54 smithi064 ceph-mon[33404]: pgmap v30: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 390 op/s 2024-04-26T21:07:55.409 INFO:tasks.workunit.client.0.smithi055.stdout:6/39: mknod d3/cb 0 2024-04-26T21:07:55.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/135: rename d6/db/lc to d6/l2c 0 2024-04-26T21:07:55.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/136: dread - d6/db/f29 zero size 2024-04-26T21:07:55.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/137: creat d6/db/f2d x:0 0 0 2024-04-26T21:07:55.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/138: write d6/d15/d1c/f25 [541210,66677] 0 2024-04-26T21:07:55.415 INFO:tasks.workunit.client.0.smithi055.stdout:2/73: rename d4/le to d4/l1a 0 2024-04-26T21:07:55.415 INFO:tasks.workunit.client.0.smithi055.stdout:2/74: fdatasync d4/dc/f18 0 2024-04-26T21:07:55.415 INFO:tasks.workunit.client.0.smithi055.stdout:2/75: truncate d4/dc/f16 320558 0 2024-04-26T21:07:55.415 INFO:tasks.workunit.client.0.smithi055.stdout:2/76: chown d4/db/f15 1 1 2024-04-26T21:07:55.416 INFO:tasks.workunit.client.1.smithi064.stdout:9/191: dwrite d0/d4/d7/df/f32 [0,4194304] 0 2024-04-26T21:07:55.417 INFO:tasks.workunit.client.1.smithi064.stdout:4/192: dwrite d0/d1d/d17/f2c [4194304,4194304] 0 2024-04-26T21:07:55.417 INFO:tasks.workunit.client.1.smithi064.stdout:2/191: link d12/d28/f37 d12/d28/f3f 0 2024-04-26T21:07:55.421 INFO:tasks.workunit.client.1.smithi064.stdout:6/136: rmdir d4 39 2024-04-26T21:07:55.421 INFO:tasks.workunit.client.1.smithi064.stdout:6/137: chown d4/lf 14 1 2024-04-26T21:07:55.423 INFO:tasks.workunit.client.0.smithi055.stdout:7/33: dwrite f1 [0,4194304] 0 2024-04-26T21:07:55.427 INFO:tasks.workunit.client.0.smithi055.stdout:7/34: symlink d5/d6/l9 0 2024-04-26T21:07:55.428 INFO:tasks.workunit.client.1.smithi064.stdout:8/144: dwrite ff [0,4194304] 0 2024-04-26T21:07:55.428 INFO:tasks.workunit.client.1.smithi064.stdout:8/145: read - d10/d1d/f1e zero size 2024-04-26T21:07:55.433 INFO:tasks.workunit.client.0.smithi055.stdout:6/40: rmdir d3 39 2024-04-26T21:07:55.433 INFO:tasks.workunit.client.0.smithi055.stdout:6/41: fdatasync d3/f7 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:9/192: symlink d0/d4/d7/df/l41 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:4/193: mkdir d0/d5/d3e 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:9/193: read - d0/d4/d7/f2f zero size 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:2/192: symlink d12/d28/d3a/l40 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:4/194: write d0/d5/d13/f36 [1006964,103276] 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.1.smithi064.stdout:4/195: write d0/d2f/f30 [3427032,59101] 0 2024-04-26T21:07:55.436 INFO:tasks.workunit.client.0.smithi055.stdout:6/42: creat d3/fc x:0 0 0 2024-04-26T21:07:55.438 INFO:tasks.workunit.client.0.smithi055.stdout:6/43: mknod d3/cd 0 2024-04-26T21:07:55.438 INFO:tasks.workunit.client.0.smithi055.stdout:6/44: truncate d3/fc 222716 0 2024-04-26T21:07:55.438 INFO:tasks.workunit.client.0.smithi055.stdout:6/45: chown d3/f5 193658 1 2024-04-26T21:07:55.439 INFO:tasks.workunit.client.0.smithi055.stdout:6/46: mknod d3/ce 0 2024-04-26T21:07:55.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/194: symlink d0/d4/d28/l42 0 2024-04-26T21:07:55.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/195: chown d0/d4/da 7318267 1 2024-04-26T21:07:55.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/196: stat d0/cb 0 2024-04-26T21:07:55.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/197: read - d0/d39/f3d zero size 2024-04-26T21:07:55.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/198: rmdir d0/d4/da/d26 39 2024-04-26T21:07:55.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/199: write d0/d4/d7/f2f [749495,18908] 0 2024-04-26T21:07:55.446 INFO:tasks.workunit.client.1.smithi064.stdout:9/200: mknod d0/d4/c43 0 2024-04-26T21:07:55.446 INFO:tasks.workunit.client.1.smithi064.stdout:9/201: getdents d0/d4/da 0 2024-04-26T21:07:55.447 INFO:tasks.workunit.client.1.smithi064.stdout:9/202: fdatasync d0/f3b 0 2024-04-26T21:07:55.447 INFO:tasks.workunit.client.1.smithi064.stdout:9/203: write d0/f3b [783398,69094] 0 2024-04-26T21:07:55.447 INFO:tasks.workunit.client.1.smithi064.stdout:9/204: mknod d0/d39/c44 0 2024-04-26T21:07:55.447 INFO:tasks.workunit.client.0.smithi055.stdout:7/35: dread d5/d6/f7 [0,4194304] 0 2024-04-26T21:07:55.447 INFO:tasks.workunit.client.0.smithi055.stdout:7/36: mknod d5/d6/ca 0 2024-04-26T21:07:55.448 INFO:tasks.workunit.client.0.smithi055.stdout:7/37: mkdir d5/db 0 2024-04-26T21:07:55.449 INFO:tasks.workunit.client.1.smithi064.stdout:3/149: dwrite d1/da/f13 [0,4194304] 0 2024-04-26T21:07:55.460 INFO:tasks.workunit.client.1.smithi064.stdout:3/150: creat d1/d14/f31 x:0 0 0 2024-04-26T21:07:55.460 INFO:tasks.workunit.client.1.smithi064.stdout:3/151: truncate d1/d14/f31 791040 0 2024-04-26T21:07:55.461 INFO:tasks.workunit.client.1.smithi064.stdout:3/152: link d1/ld d1/d14/l32 0 2024-04-26T21:07:55.462 INFO:tasks.workunit.client.0.smithi055.stdout:7/38: read d5/d6/f7 [83650,36287] 0 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/39: chown d5/d6/l9 8382763 1 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/40: fsync d5/d6/f7 0 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/41: readlink d5/d6/l9 0 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/42: write d5/d6/f8 [2707783,105081] 0 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/43: chown l4 2065368 1 2024-04-26T21:07:55.463 INFO:tasks.workunit.client.1.smithi064.stdout:3/153: link d1/le d1/da/l33 0 2024-04-26T21:07:55.464 INFO:tasks.workunit.client.1.smithi064.stdout:3/154: rename d1/da to d1/da/d22/d26/d34 22 2024-04-26T21:07:55.466 INFO:tasks.workunit.client.1.smithi064.stdout:3/155: mkdir d1/da/d35 0 2024-04-26T21:07:55.475 INFO:tasks.workunit.client.0.smithi055.stdout:7/44: write f1 [3079370,35629] 0 2024-04-26T21:07:55.475 INFO:tasks.workunit.client.0.smithi055.stdout:7/45: chown d5 23065342 1 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/196: dwrite d0/d1d/d17/f25 [0,4194304] 0 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/197: truncate d0/d1d/f2e 1043380 0 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/198: chown d0/d5/d2a 1200539 1 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/199: fsync d0/d1d/d17/f25 0 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/200: chown d0/d1d/d21/c2d 1 1 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/201: chown d0/d5 0 1 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:4/202: creat d0/d5/d13/d10/f3f x:0 0 0 2024-04-26T21:07:55.479 INFO:tasks.workunit.client.1.smithi064.stdout:7/139: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:07:55.496 INFO:tasks.workunit.client.1.smithi064.stdout:4/203: dread d0/f11 [0,4194304] 0 2024-04-26T21:07:55.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/140: write f3 [523894,112277] 0 2024-04-26T21:07:55.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/141: readlink d6/l2c 0 2024-04-26T21:07:55.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/142: getdents d6/d12/d26 0 2024-04-26T21:07:55.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/143: chown d6/d12 3735 1 2024-04-26T21:07:55.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/144: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:55.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/145: dread - d6/d15/f28 zero size 2024-04-26T21:07:55.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/146: chown d6 68449 1 2024-04-26T21:07:55.514 INFO:tasks.workunit.client.1.smithi064.stdout:7/147: creat d6/d15/d1c/f2e x:0 0 0 2024-04-26T21:07:55.515 INFO:tasks.workunit.client.1.smithi064.stdout:3/156: read d1/ff [1816810,105165] 0 2024-04-26T21:07:55.526 INFO:tasks.workunit.client.1.smithi064.stdout:7/148: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/149: rename d6/d12/d26 to d6/d12/d2f 0 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/150: readlink l4 0 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/151: chown d6/f24 64 1 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/152: fdatasync d6/d15/f28 0 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/153: write d6/db/f29 [388998,21097] 0 2024-04-26T21:07:55.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/154: creat d6/d9/f30 x:0 0 0 2024-04-26T21:07:55.529 INFO:tasks.workunit.client.1.smithi064.stdout:7/155: creat d6/d12/d2f/f31 x:0 0 0 2024-04-26T21:07:55.561 INFO:tasks.workunit.client.1.smithi064.stdout:3/157: dwrite d1/d12/f1f [0,4194304] 0 2024-04-26T21:07:55.564 INFO:tasks.workunit.client.1.smithi064.stdout:3/158: truncate d1/da/fb 1189401 0 2024-04-26T21:07:55.564 INFO:tasks.workunit.client.1.smithi064.stdout:3/159: dread - d1/da/f10 zero size 2024-04-26T21:07:55.610 INFO:tasks.workunit.client.1.smithi064.stdout:3/160: dwrite d1/da/d22/f2e [0,4194304] 0 2024-04-26T21:07:55.610 INFO:tasks.workunit.client.1.smithi064.stdout:3/161: chown d1/ff 124064 1 2024-04-26T21:07:55.614 INFO:tasks.workunit.client.1.smithi064.stdout:3/162: creat d1/da/d35/f36 x:0 0 0 2024-04-26T21:07:55.622 INFO:tasks.workunit.client.0.smithi055.stdout:6/47: dread d3/fc [0,4194304] 0 2024-04-26T21:07:55.623 INFO:tasks.workunit.client.0.smithi055.stdout:6/48: write d3/f5 [495099,23089] 0 2024-04-26T21:07:55.623 INFO:tasks.workunit.client.0.smithi055.stdout:6/49: chown d3/ca 73 1 2024-04-26T21:07:55.623 INFO:tasks.workunit.client.0.smithi055.stdout:6/50: chown d3 1964 1 2024-04-26T21:07:55.624 INFO:tasks.workunit.client.1.smithi064.stdout:0/164: dwrite dd/d10/d18/f29 [0,4194304] 0 2024-04-26T21:07:55.636 INFO:tasks.workunit.client.0.smithi055.stdout:7/46: fdatasync d5/d6/f7 0 2024-04-26T21:07:55.637 INFO:tasks.workunit.client.1.smithi064.stdout:1/234: dwrite d0/d6/d11/f1d [0,4194304] 0 2024-04-26T21:07:55.637 INFO:tasks.workunit.client.1.smithi064.stdout:6/138: dwrite d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:55.638 INFO:tasks.workunit.client.1.smithi064.stdout:0/165: getdents dd/d10 0 2024-04-26T21:07:55.640 INFO:tasks.workunit.client.0.smithi055.stdout:7/47: creat d5/db/fc x:0 0 0 2024-04-26T21:07:55.640 INFO:tasks.workunit.client.0.smithi055.stdout:7/48: write d5/d6/f7 [5092266,32271] 0 2024-04-26T21:07:55.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/235: link d0/d6/c2e d0/d22/c49 0 2024-04-26T21:07:55.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/236: fdatasync d0/d6/d11/d1e/d27/f2d 0 2024-04-26T21:07:55.641 INFO:tasks.workunit.client.1.smithi064.stdout:6/139: getdents d4/d7/d12/d1e 0 2024-04-26T21:07:55.643 INFO:tasks.workunit.client.1.smithi064.stdout:3/163: dread d1/d12/f1f [0,4194304] 0 2024-04-26T21:07:55.643 INFO:tasks.workunit.client.1.smithi064.stdout:3/164: chown d1/da 2065430395 1 2024-04-26T21:07:55.652 INFO:tasks.workunit.client.1.smithi064.stdout:0/166: mknod dd/d1c/c2d 0 2024-04-26T21:07:55.652 INFO:tasks.workunit.client.1.smithi064.stdout:0/167: dread - dd/f2a zero size 2024-04-26T21:07:55.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/165: mkdir d1/da/d37 0 2024-04-26T21:07:55.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/166: stat d1/da/d37 0 2024-04-26T21:07:55.653 INFO:tasks.workunit.client.1.smithi064.stdout:5/177: sync 2024-04-26T21:07:55.654 INFO:tasks.workunit.client.1.smithi064.stdout:5/178: write dd/d12/d18/d25/f35 [984803,124265] 0 2024-04-26T21:07:55.658 INFO:tasks.workunit.client.1.smithi064.stdout:3/167: mkdir d1/d38 0 2024-04-26T21:07:55.660 INFO:tasks.workunit.client.1.smithi064.stdout:5/179: creat dd/d12/d18/d25/d32/f37 x:0 0 0 2024-04-26T21:07:55.660 INFO:tasks.workunit.client.1.smithi064.stdout:5/180: creat dd/d12/d18/d1a/d1f/d20/f38 x:0 0 0 2024-04-26T21:07:55.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/181: truncate dd/f16 3228481 0 2024-04-26T21:07:55.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/182: dread - dd/d12/d18/d1a/d1f/d20/f31 zero size 2024-04-26T21:07:55.668 INFO:tasks.workunit.client.0.smithi055.stdout:6/51: dread d3/f5 [0,4194304] 0 2024-04-26T21:07:55.668 INFO:tasks.workunit.client.0.smithi055.stdout:6/52: creat d3/ff x:0 0 0 2024-04-26T21:07:55.669 INFO:tasks.workunit.client.0.smithi055.stdout:6/53: creat d3/f10 x:0 0 0 2024-04-26T21:07:55.672 INFO:tasks.workunit.client.1.smithi064.stdout:5/183: link dd/d12/d18/f36 dd/d12/d18/f39 0 2024-04-26T21:07:55.673 INFO:tasks.workunit.client.1.smithi064.stdout:8/146: dwrite d10/f1b [0,4194304] 0 2024-04-26T21:07:55.681 INFO:tasks.workunit.client.1.smithi064.stdout:8/147: truncate f4 429274 0 2024-04-26T21:07:55.682 INFO:tasks.workunit.client.1.smithi064.stdout:3/168: fsync d1/da/d35/f36 0 2024-04-26T21:07:55.682 INFO:tasks.workunit.client.1.smithi064.stdout:3/169: chown d1/d27/d2c/l30 10 1 2024-04-26T21:07:55.682 INFO:tasks.workunit.client.1.smithi064.stdout:3/170: creat d1/da/f39 x:0 0 0 2024-04-26T21:07:55.689 INFO:tasks.workunit.client.1.smithi064.stdout:8/148: mkdir d10/d31 0 2024-04-26T21:07:55.691 INFO:tasks.workunit.client.1.smithi064.stdout:3/171: symlink d1/d12/l3a 0 2024-04-26T21:07:55.691 INFO:tasks.workunit.client.1.smithi064.stdout:3/172: read - d1/da/f39 zero size 2024-04-26T21:07:55.693 INFO:tasks.workunit.client.1.smithi064.stdout:3/173: creat d1/d14/f3b x:0 0 0 2024-04-26T21:07:55.696 INFO:tasks.workunit.client.0.smithi055.stdout:6/54: rmdir d3 39 2024-04-26T21:07:55.698 INFO:tasks.workunit.client.0.smithi055.stdout:6/55: link d3/fc d3/f11 0 2024-04-26T21:07:55.699 INFO:tasks.workunit.client.0.smithi055.stdout:6/56: rename d3/f10 to d3/f12 0 2024-04-26T21:07:55.699 INFO:tasks.workunit.client.0.smithi055.stdout:6/57: write d3/f5 [61877,50740] 0 2024-04-26T21:07:55.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/205: dwrite d0/d4/d7/f2f [0,4194304] 0 2024-04-26T21:07:55.701 INFO:tasks.workunit.client.0.smithi055.stdout:6/58: symlink d3/l13 0 2024-04-26T21:07:55.701 INFO:tasks.workunit.client.0.smithi055.stdout:6/59: stat d3/cd 0 2024-04-26T21:07:55.701 INFO:tasks.workunit.client.0.smithi055.stdout:6/60: truncate d3/ff 223353 0 2024-04-26T21:07:55.701 INFO:tasks.workunit.client.0.smithi055.stdout:6/61: chown d3/f7 76 1 2024-04-26T21:07:55.702 INFO:tasks.workunit.client.0.smithi055.stdout:6/62: readlink d3/l4 0 2024-04-26T21:07:55.703 INFO:tasks.workunit.client.0.smithi055.stdout:6/63: link d3/f11 d3/f14 0 2024-04-26T21:07:55.703 INFO:tasks.workunit.client.0.smithi055.stdout:6/64: write d3/f12 [949392,3885] 0 2024-04-26T21:07:55.703 INFO:tasks.workunit.client.0.smithi055.stdout:6/65: write d3/f12 [1629463,91175] 0 2024-04-26T21:07:55.704 INFO:tasks.workunit.client.0.smithi055.stdout:6/66: fsync d3/ff 0 2024-04-26T21:07:55.704 INFO:tasks.workunit.client.1.smithi064.stdout:5/184: dread dd/d12/d18/f2f [0,4194304] 0 2024-04-26T21:07:55.704 INFO:tasks.workunit.client.1.smithi064.stdout:9/206: write d0/d4/d7/fd [4514469,70938] 0 2024-04-26T21:07:55.705 INFO:tasks.workunit.client.1.smithi064.stdout:8/149: getdents d10 0 2024-04-26T21:07:55.710 INFO:tasks.workunit.client.1.smithi064.stdout:0/168: write dd/d10/d18/f19 [638520,58964] 0 2024-04-26T21:07:55.710 INFO:tasks.workunit.client.1.smithi064.stdout:0/169: truncate fb 800436 0 2024-04-26T21:07:55.713 INFO:tasks.workunit.client.0.smithi055.stdout:6/67: creat d3/f15 x:0 0 0 2024-04-26T21:07:55.714 INFO:tasks.workunit.client.1.smithi064.stdout:9/207: mkdir d0/d4/da/d26/d45 0 2024-04-26T21:07:55.714 INFO:tasks.workunit.client.1.smithi064.stdout:9/208: readlink d0/d4/d28/l3f 0 2024-04-26T21:07:55.715 INFO:tasks.workunit.client.1.smithi064.stdout:8/150: symlink d10/d1d/l32 0 2024-04-26T21:07:55.721 INFO:tasks.workunit.client.1.smithi064.stdout:5/185: rmdir dd 39 2024-04-26T21:07:55.724 INFO:tasks.workunit.client.0.smithi055.stdout:6/68: read f0 [1383423,110211] 0 2024-04-26T21:07:55.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/170: unlink fb 0 2024-04-26T21:07:55.727 INFO:tasks.workunit.client.1.smithi064.stdout:9/209: creat d0/d4/d7/f46 x:0 0 0 2024-04-26T21:07:55.727 INFO:tasks.workunit.client.1.smithi064.stdout:8/151: creat d10/d2f/f33 x:0 0 0 2024-04-26T21:07:55.730 INFO:tasks.workunit.client.1.smithi064.stdout:6/140: dwrite d4/d7/fe [0,4194304] 0 2024-04-26T21:07:55.730 INFO:tasks.workunit.client.1.smithi064.stdout:4/204: dwrite d0/d5/d13/f36 [0,4194304] 0 2024-04-26T21:07:55.738 INFO:tasks.workunit.client.1.smithi064.stdout:9/210: mkdir d0/d4/da/d26/d47 0 2024-04-26T21:07:55.740 INFO:tasks.workunit.client.0.smithi055.stdout:7/49: dwrite d5/d6/f8 [0,4194304] 0 2024-04-26T21:07:55.742 INFO:tasks.workunit.client.1.smithi064.stdout:1/237: dwrite d0/d6/d11/d1e/d27/f2d [0,4194304] 0 2024-04-26T21:07:55.744 INFO:tasks.workunit.client.0.smithi055.stdout:7/50: rename d5/d6/ca to d5/cd 0 2024-04-26T21:07:55.750 INFO:tasks.workunit.client.1.smithi064.stdout:3/174: dwrite d1/da/d35/f36 [0,4194304] 0 2024-04-26T21:07:55.750 INFO:tasks.workunit.client.1.smithi064.stdout:3/175: fsync d1/da/fb 0 2024-04-26T21:07:55.750 INFO:tasks.workunit.client.1.smithi064.stdout:3/176: write d1/f11 [1049947,97114] 0 2024-04-26T21:07:55.752 INFO:tasks.workunit.client.1.smithi064.stdout:6/141: link d4/d7/c9 d4/d7/d12/c27 0 2024-04-26T21:07:55.753 INFO:tasks.workunit.client.0.smithi055.stdout:6/69: getdents d3 0 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:4/205: link d0/c23 d0/d1d/d21/c40 0 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:9/211: symlink d0/d4/d7/df/l48 0 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:9/212: read - d0/d4/d7/df/f2c zero size 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:9/213: stat d0/d4/d7/df/l41 0 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:9/214: read d0/f18 [1169815,27727] 0 2024-04-26T21:07:55.756 INFO:tasks.workunit.client.1.smithi064.stdout:0/171: dread dd/f15 [0,4194304] 0 2024-04-26T21:07:55.764 INFO:tasks.workunit.client.0.smithi055.stdout:6/70: dread d3/fc [0,4194304] 0 2024-04-26T21:07:55.765 INFO:tasks.workunit.client.1.smithi064.stdout:3/177: symlink d1/da/d22/l3c 0 2024-04-26T21:07:55.765 INFO:tasks.workunit.client.1.smithi064.stdout:6/142: rmdir d4 39 2024-04-26T21:07:55.765 INFO:tasks.workunit.client.1.smithi064.stdout:9/215: creat d0/d4/da/d31/d34/f49 x:0 0 0 2024-04-26T21:07:55.765 INFO:tasks.workunit.client.1.smithi064.stdout:3/178: chown d1/da/d35/f36 8317521 1 2024-04-26T21:07:55.765 INFO:tasks.workunit.client.1.smithi064.stdout:9/216: creat d0/d4/d7/f4a x:0 0 0 2024-04-26T21:07:55.768 INFO:tasks.workunit.client.1.smithi064.stdout:0/172: link dd/f15 dd/d10/f2e 0 2024-04-26T21:07:55.772 INFO:tasks.workunit.client.1.smithi064.stdout:0/173: creat dd/d10/d1a/f2f x:0 0 0 2024-04-26T21:07:55.772 INFO:tasks.workunit.client.1.smithi064.stdout:7/156: sync 2024-04-26T21:07:55.772 INFO:tasks.workunit.client.1.smithi064.stdout:0/174: creat dd/f30 x:0 0 0 2024-04-26T21:07:55.772 INFO:tasks.workunit.client.1.smithi064.stdout:2/193: sync 2024-04-26T21:07:55.775 INFO:tasks.workunit.client.1.smithi064.stdout:2/194: mkdir d12/d41 0 2024-04-26T21:07:55.776 INFO:tasks.workunit.client.1.smithi064.stdout:2/195: creat d12/d1a/f42 x:0 0 0 2024-04-26T21:07:55.776 INFO:tasks.workunit.client.1.smithi064.stdout:2/196: stat d12 0 2024-04-26T21:07:55.776 INFO:tasks.workunit.client.1.smithi064.stdout:2/197: write d12/d28/f33 [1155188,29206] 0 2024-04-26T21:07:55.778 INFO:tasks.workunit.client.0.smithi055.stdout:6/71: dread f0 [0,4194304] 0 2024-04-26T21:07:55.779 INFO:tasks.workunit.client.0.smithi055.stdout:6/72: dread - d3/f15 zero size 2024-04-26T21:07:55.779 INFO:tasks.workunit.client.0.smithi055.stdout:6/73: truncate d3/f9 683932 0 2024-04-26T21:07:55.779 INFO:tasks.workunit.client.1.smithi064.stdout:7/157: link d6/l7 d6/d15/d1c/l32 0 2024-04-26T21:07:55.782 INFO:tasks.workunit.client.1.smithi064.stdout:7/158: getdents d6/db 0 2024-04-26T21:07:55.782 INFO:tasks.workunit.client.1.smithi064.stdout:7/159: stat d6/d9 0 2024-04-26T21:07:55.784 INFO:tasks.workunit.client.0.smithi055.stdout:6/74: dread d3/fc [0,4194304] 0 2024-04-26T21:07:55.784 INFO:tasks.workunit.client.0.smithi055.stdout:6/75: write d3/f9 [1374383,106184] 0 2024-04-26T21:07:55.784 INFO:tasks.workunit.client.1.smithi064.stdout:0/175: dread dd/d10/d18/f19 [0,4194304] 0 2024-04-26T21:07:55.784 INFO:tasks.workunit.client.1.smithi064.stdout:8/152: dwrite d10/d1d/f1e [0,4194304] 0 2024-04-26T21:07:55.784 INFO:tasks.workunit.client.1.smithi064.stdout:7/160: rename d6/d12/d2f to d6/d15/d33 0 2024-04-26T21:07:55.786 INFO:tasks.workunit.client.1.smithi064.stdout:0/176: chown l2 9351 1 2024-04-26T21:07:55.787 INFO:tasks.workunit.client.1.smithi064.stdout:7/161: mkdir d6/db/d34 0 2024-04-26T21:07:55.787 INFO:tasks.workunit.client.1.smithi064.stdout:6/143: write d4/d7/fe [669874,70250] 0 2024-04-26T21:07:55.788 INFO:tasks.workunit.client.1.smithi064.stdout:6/144: chown d4/d7/d12/d1e/l21 25221 1 2024-04-26T21:07:55.791 INFO:tasks.workunit.client.1.smithi064.stdout:0/177: mkdir dd/d10/d1a/d31 0 2024-04-26T21:07:55.792 INFO:tasks.workunit.client.1.smithi064.stdout:9/217: dread d0/d4/d28/f2d [0,4194304] 0 2024-04-26T21:07:55.792 INFO:tasks.workunit.client.1.smithi064.stdout:9/218: write d0/d4/d7/f2e [830213,108871] 0 2024-04-26T21:07:55.795 INFO:tasks.workunit.client.1.smithi064.stdout:9/219: getdents d0/d4/da/d26 0 2024-04-26T21:07:55.802 INFO:tasks.workunit.client.1.smithi064.stdout:1/238: dwrite d0/f12 [0,4194304] 0 2024-04-26T21:07:55.805 INFO:tasks.workunit.client.1.smithi064.stdout:9/220: dread d0/d4/da/d26/f23 [0,4194304] 0 2024-04-26T21:07:55.812 INFO:tasks.workunit.client.1.smithi064.stdout:1/239: dread d0/d22/f38 [0,4194304] 0 2024-04-26T21:07:55.812 INFO:tasks.workunit.client.1.smithi064.stdout:1/240: truncate d0/d22/f3c 493565 0 2024-04-26T21:07:55.827 INFO:tasks.workunit.client.0.smithi055.stdout:7/51: dwrite d5/db/fc [0,4194304] 0 2024-04-26T21:07:55.829 INFO:tasks.workunit.client.1.smithi064.stdout:9/221: dread d0/d4/f2a [0,4194304] 0 2024-04-26T21:07:55.829 INFO:tasks.workunit.client.0.smithi055.stdout:7/52: read f1 [3672519,23974] 0 2024-04-26T21:07:55.835 INFO:tasks.workunit.client.1.smithi064.stdout:8/153: read d10/d1d/f1e [4160616,96864] 0 2024-04-26T21:07:55.839 INFO:tasks.workunit.client.1.smithi064.stdout:8/154: mknod d10/d31/c34 0 2024-04-26T21:07:55.847 INFO:tasks.workunit.client.1.smithi064.stdout:6/145: write d4/d7/fd [5377745,44714] 0 2024-04-26T21:07:55.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/146: creat d4/f28 x:0 0 0 2024-04-26T21:07:55.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/147: write d4/f16 [613011,51530] 0 2024-04-26T21:07:55.855 INFO:tasks.workunit.client.0.smithi055.stdout:7/53: dread d5/d6/f8 [0,4194304] 0 2024-04-26T21:07:55.855 INFO:tasks.workunit.client.0.smithi055.stdout:7/54: chown d5 6 1 2024-04-26T21:07:55.857 INFO:tasks.workunit.client.1.smithi064.stdout:4/206: dwrite d0/d1d/d17/f25 [0,4194304] 0 2024-04-26T21:07:55.858 INFO:tasks.workunit.client.1.smithi064.stdout:4/207: mknod d0/d5/d2a/c41 0 2024-04-26T21:07:55.859 INFO:tasks.workunit.client.1.smithi064.stdout:4/208: chown d0/d5/d13/d10/f3f 53014 1 2024-04-26T21:07:55.862 INFO:tasks.workunit.client.0.smithi055.stdout:6/76: dwrite f0 [0,4194304] 0 2024-04-26T21:07:55.862 INFO:tasks.workunit.client.1.smithi064.stdout:4/209: rename d0/d5/d13/d10/f3f to d0/d5/d13/d33/f42 0 2024-04-26T21:07:55.866 INFO:tasks.workunit.client.1.smithi064.stdout:4/210: mknod d0/d5/d13/d10/c43 0 2024-04-26T21:07:55.867 INFO:tasks.workunit.client.1.smithi064.stdout:4/211: mkdir d0/d1d/d17/d44 0 2024-04-26T21:07:55.868 INFO:tasks.workunit.client.1.smithi064.stdout:4/212: mkdir d0/d1d/d17/d44/d45 0 2024-04-26T21:07:55.868 INFO:tasks.workunit.client.1.smithi064.stdout:4/213: fdatasync d0/d2f/f30 0 2024-04-26T21:07:55.869 INFO:tasks.workunit.client.1.smithi064.stdout:4/214: mknod d0/d5/d13/d10/c46 0 2024-04-26T21:07:55.876 INFO:tasks.workunit.client.1.smithi064.stdout:0/178: dwrite dd/d10/d1a/f2f [0,4194304] 0 2024-04-26T21:07:55.878 INFO:tasks.workunit.client.1.smithi064.stdout:0/179: mknod dd/c32 0 2024-04-26T21:07:55.878 INFO:tasks.workunit.client.1.smithi064.stdout:9/222: write d0/d4/da/fc [2906384,71324] 0 2024-04-26T21:07:55.878 INFO:tasks.workunit.client.1.smithi064.stdout:9/223: write d0/d4/d7/df/f40 [4503938,104093] 0 2024-04-26T21:07:55.882 INFO:tasks.workunit.client.1.smithi064.stdout:0/180: rename dd/d10/c11 to dd/d21/c33 0 2024-04-26T21:07:55.883 INFO:tasks.workunit.client.1.smithi064.stdout:1/241: dwrite d0/d6/d11/f1d [4194304,4194304] 0 2024-04-26T21:07:55.885 INFO:tasks.workunit.client.1.smithi064.stdout:0/181: mkdir dd/d34 0 2024-04-26T21:07:55.885 INFO:tasks.workunit.client.1.smithi064.stdout:0/182: chown dd/d10/l17 1300596172 1 2024-04-26T21:07:55.886 INFO:tasks.workunit.client.0.smithi055.stdout:6/77: truncate d3/f5 3377292 0 2024-04-26T21:07:55.887 INFO:tasks.workunit.client.1.smithi064.stdout:7/162: dwrite d6/f24 [0,4194304] 0 2024-04-26T21:07:55.896 INFO:tasks.workunit.client.0.smithi055.stdout:7/55: write d5/db/fc [2983686,76077] 0 2024-04-26T21:07:55.896 INFO:tasks.workunit.client.0.smithi055.stdout:7/56: write d5/db/fc [2548609,121948] 0 2024-04-26T21:07:55.899 INFO:tasks.workunit.client.0.smithi055.stdout:7/57: rename l4 to d5/db/le 0 2024-04-26T21:07:55.901 INFO:tasks.workunit.client.1.smithi064.stdout:1/242: truncate d0/d22/f3c 19166 0 2024-04-26T21:07:55.903 INFO:tasks.workunit.client.0.smithi055.stdout:6/78: truncate d3/fc 49760 0 2024-04-26T21:07:55.910 INFO:tasks.workunit.client.1.smithi064.stdout:1/243: mknod d0/d6/d11/d1e/d27/c4a 0 2024-04-26T21:07:55.910 INFO:tasks.workunit.client.1.smithi064.stdout:4/215: dread d0/d2f/f30 [0,4194304] 0 2024-04-26T21:07:55.910 INFO:tasks.workunit.client.1.smithi064.stdout:4/216: creat d0/d1d/d21/f47 x:0 0 0 2024-04-26T21:07:55.911 INFO:tasks.workunit.client.0.smithi055.stdout:6/79: rmdir d3 39 2024-04-26T21:07:55.920 INFO:tasks.workunit.client.0.smithi055.stdout:7/58: truncate d5/d6/f7 4575658 0 2024-04-26T21:07:55.921 INFO:tasks.workunit.client.0.smithi055.stdout:7/59: readlink d5/db/le 0 2024-04-26T21:07:55.923 INFO:tasks.workunit.client.0.smithi055.stdout:6/80: read f0 [192919,48725] 0 2024-04-26T21:07:55.923 INFO:tasks.workunit.client.1.smithi064.stdout:9/224: dwrite d0/d4/d7/df/f3a [0,4194304] 0 2024-04-26T21:07:55.923 INFO:tasks.workunit.client.0.smithi055.stdout:7/60: truncate f1 3047457 0 2024-04-26T21:07:55.926 INFO:tasks.workunit.client.0.smithi055.stdout:6/81: unlink d3/f7 0 2024-04-26T21:07:55.926 INFO:tasks.workunit.client.0.smithi055.stdout:6/82: write d3/f5 [1380338,3530] 0 2024-04-26T21:07:55.926 INFO:tasks.workunit.client.0.smithi055.stdout:6/83: fdatasync d3/ff 0 2024-04-26T21:07:55.929 INFO:tasks.workunit.client.0.smithi055.stdout:6/84: creat d3/f16 x:0 0 0 2024-04-26T21:07:55.931 INFO:tasks.workunit.client.0.smithi055.stdout:6/85: mkdir d3/d17 0 2024-04-26T21:07:55.931 INFO:tasks.workunit.client.0.smithi055.stdout:6/86: fsync d3/ff 0 2024-04-26T21:07:55.942 INFO:tasks.workunit.client.0.smithi055.stdout:6/87: dread d3/ff [0,4194304] 0 2024-04-26T21:07:55.945 INFO:tasks.workunit.client.1.smithi064.stdout:7/163: dwrite d6/d15/f28 [0,4194304] 0 2024-04-26T21:07:55.945 INFO:tasks.workunit.client.0.smithi055.stdout:6/88: dread d3/f11 [0,4194304] 0 2024-04-26T21:07:55.946 INFO:tasks.workunit.client.1.smithi064.stdout:7/164: fdatasync d6/f24 0 2024-04-26T21:07:55.946 INFO:tasks.workunit.client.1.smithi064.stdout:5/186: sync 2024-04-26T21:07:55.946 INFO:tasks.workunit.client.1.smithi064.stdout:5/187: fdatasync dd/d12/d18/f2f 0 2024-04-26T21:07:55.948 INFO:tasks.workunit.client.0.smithi055.stdout:6/89: creat d3/d17/f18 x:0 0 0 2024-04-26T21:07:55.949 INFO:tasks.workunit.client.0.smithi055.stdout:7/61: write d5/d6/f7 [2356994,41227] 0 2024-04-26T21:07:55.950 INFO:tasks.workunit.client.1.smithi064.stdout:7/165: mkdir d6/d15/d35 0 2024-04-26T21:07:55.950 INFO:tasks.workunit.client.1.smithi064.stdout:7/166: write d6/d15/d1c/f2e [343628,86735] 0 2024-04-26T21:07:55.951 INFO:tasks.workunit.client.1.smithi064.stdout:5/188: unlink f3 0 2024-04-26T21:07:55.951 INFO:tasks.workunit.client.1.smithi064.stdout:4/217: dread d0/d1d/f2e [0,4194304] 0 2024-04-26T21:07:55.952 INFO:tasks.workunit.client.0.smithi055.stdout:6/90: mkdir d3/d17/d19 0 2024-04-26T21:07:55.952 INFO:tasks.workunit.client.0.smithi055.stdout:6/91: truncate d3/f15 733226 0 2024-04-26T21:07:55.954 INFO:tasks.workunit.client.1.smithi064.stdout:7/167: rename d6/d15/f28 to d6/d9/f36 0 2024-04-26T21:07:55.955 INFO:tasks.workunit.client.1.smithi064.stdout:7/168: creat d6/d9/f37 x:0 0 0 2024-04-26T21:07:55.955 INFO:tasks.workunit.client.1.smithi064.stdout:1/244: dwrite d0/d6/d11/d1e/f43 [0,4194304] 0 2024-04-26T21:07:55.955 INFO:tasks.workunit.client.1.smithi064.stdout:7/169: readlink d6/db/l16 0 2024-04-26T21:07:55.958 INFO:tasks.workunit.client.0.smithi055.stdout:6/92: getdents d3 0 2024-04-26T21:07:55.958 INFO:tasks.workunit.client.0.smithi055.stdout:6/93: truncate d3/ff 1002067 0 2024-04-26T21:07:55.959 INFO:tasks.workunit.client.0.smithi055.stdout:6/94: read d3/f14 [39338,86470] 0 2024-04-26T21:07:55.959 INFO:tasks.workunit.client.0.smithi055.stdout:6/95: write d3/f16 [76512,61676] 0 2024-04-26T21:07:55.960 INFO:tasks.workunit.client.1.smithi064.stdout:7/170: mkdir d6/d9/d38 0 2024-04-26T21:07:55.963 INFO:tasks.workunit.client.1.smithi064.stdout:1/245: rmdir d0/d6/d11/d1e/d2a/d34 39 2024-04-26T21:07:55.966 INFO:tasks.workunit.client.0.smithi055.stdout:7/62: dread f1 [0,4194304] 0 2024-04-26T21:07:55.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/246: getdents d0/d6/d11/d1e 0 2024-04-26T21:07:55.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/247: truncate d0/d6/d11/d1e/f1b 9331046 0 2024-04-26T21:07:55.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/248: chown d0/d6/c2e 6199950 1 2024-04-26T21:07:55.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/249: chown d0/d6/c3f 4052 1 2024-04-26T21:07:55.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/250: truncate d0/d6/d11/d1e/f46 143670 0 2024-04-26T21:07:55.969 INFO:tasks.workunit.client.0.smithi055.stdout:7/63: unlink d5/d6/f8 0 2024-04-26T21:07:55.969 INFO:tasks.workunit.client.0.smithi055.stdout:7/64: truncate f1 3676749 0 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/218: dread d0/ff [0,4194304] 0 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/219: readlink d0/d5/d13/l20 0 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/220: write d0/d5/d13/d10/f2b [75435,42314] 0 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/221: creat d0/d1d/d21/f48 x:0 0 0 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/222: dread - d0/d1d/d21/f47 zero size 2024-04-26T21:07:55.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/223: readlink d0/d5/l6 0 2024-04-26T21:07:55.973 INFO:tasks.workunit.client.1.smithi064.stdout:4/224: truncate d0/d5/d13/f12 1586765 0 2024-04-26T21:07:55.973 INFO:tasks.workunit.client.1.smithi064.stdout:4/225: write d0/d5/d13/d10/f2b [900000,74173] 0 2024-04-26T21:07:55.976 INFO:tasks.workunit.client.1.smithi064.stdout:4/226: creat d0/d1d/f49 x:0 0 0 2024-04-26T21:07:55.976 INFO:tasks.workunit.client.1.smithi064.stdout:1/251: dread d0/d6/d11/d1e/d2a/d34/f3a [0,4194304] 0 2024-04-26T21:07:55.978 INFO:tasks.workunit.client.1.smithi064.stdout:1/252: truncate d0/d6/d11/d1e/d2a/d34/f3a 283925 0 2024-04-26T21:07:55.979 INFO:tasks.workunit.client.1.smithi064.stdout:1/253: fsync d0/d6/d11/d1e/f20 0 2024-04-26T21:07:55.992 INFO:tasks.workunit.client.0.smithi055.stdout:7/65: dread d5/db/fc [0,4194304] 0 2024-04-26T21:07:55.993 INFO:tasks.workunit.client.1.smithi064.stdout:7/171: write d6/d9/f36 [1676083,90267] 0 2024-04-26T21:07:55.993 INFO:tasks.workunit.client.1.smithi064.stdout:7/172: creat d6/d9/f39 x:0 0 0 2024-04-26T21:07:55.993 INFO:tasks.workunit.client.1.smithi064.stdout:7/173: chown d6/d9/f39 92 1 2024-04-26T21:07:55.995 INFO:tasks.workunit.client.1.smithi064.stdout:7/174: creat d6/d9/d38/f3a x:0 0 0 2024-04-26T21:07:55.996 INFO:tasks.workunit.client.1.smithi064.stdout:7/175: creat d6/d12/f3b x:0 0 0 2024-04-26T21:07:55.997 INFO:tasks.workunit.client.1.smithi064.stdout:7/176: write d6/d15/d1c/f2e [538768,119777] 0 2024-04-26T21:07:55.998 INFO:tasks.workunit.client.1.smithi064.stdout:7/177: mknod d6/db/c3c 0 2024-04-26T21:07:55.999 INFO:tasks.workunit.client.1.smithi064.stdout:4/227: write d0/d1d/d17/f25 [949569,75118] 0 2024-04-26T21:07:56.001 INFO:tasks.workunit.client.1.smithi064.stdout:4/228: symlink d0/d5/d2a/l4a 0 2024-04-26T21:07:56.001 INFO:tasks.workunit.client.1.smithi064.stdout:4/229: stat d0/d5/d13 0 2024-04-26T21:07:56.003 INFO:tasks.workunit.client.1.smithi064.stdout:4/230: creat d0/d5/d2a/f4b x:0 0 0 2024-04-26T21:07:56.003 INFO:tasks.workunit.client.1.smithi064.stdout:4/231: fsync d0/f1a 0 2024-04-26T21:07:56.004 INFO:tasks.workunit.client.1.smithi064.stdout:5/189: dwrite dd/d12/d18/f36 [0,4194304] 0 2024-04-26T21:07:56.004 INFO:tasks.workunit.client.0.smithi055.stdout:6/96: dwrite d3/f15 [0,4194304] 0 2024-04-26T21:07:56.008 INFO:tasks.workunit.client.0.smithi055.stdout:7/66: dread d5/db/fc [0,4194304] 0 2024-04-26T21:07:56.014 INFO:tasks.workunit.client.1.smithi064.stdout:5/190: symlink dd/d12/d18/d1a/l3a 0 2024-04-26T21:07:56.014 INFO:tasks.workunit.client.1.smithi064.stdout:7/178: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:56.017 INFO:tasks.workunit.client.1.smithi064.stdout:5/191: stat dd/d12/f2e 0 2024-04-26T21:07:56.019 INFO:tasks.workunit.client.0.smithi055.stdout:6/97: creat d3/d17/d19/f1a x:0 0 0 2024-04-26T21:07:56.020 INFO:tasks.workunit.client.0.smithi055.stdout:6/98: write d3/fc [555870,56329] 0 2024-04-26T21:07:56.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/179: mkdir d6/d9/d3d 0 2024-04-26T21:07:56.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/180: truncate d6/d12/f3b 719242 0 2024-04-26T21:07:56.024 INFO:tasks.workunit.client.1.smithi064.stdout:5/192: getdents dd 0 2024-04-26T21:07:56.024 INFO:tasks.workunit.client.1.smithi064.stdout:5/193: readlink dd/d12/d18/d1a/l30 0 2024-04-26T21:07:56.027 INFO:tasks.workunit.client.1.smithi064.stdout:7/181: mknod d6/db/c3e 0 2024-04-26T21:07:56.029 INFO:tasks.workunit.client.1.smithi064.stdout:3/179: sync 2024-04-26T21:07:56.029 INFO:tasks.workunit.client.1.smithi064.stdout:5/194: creat dd/d12/d18/d1a/d1f/d20/f3b x:0 0 0 2024-04-26T21:07:56.029 INFO:tasks.workunit.client.1.smithi064.stdout:5/195: readlink dd/d12/d18/d1a/l3a 0 2024-04-26T21:07:56.029 INFO:tasks.workunit.client.1.smithi064.stdout:3/180: write d1/da/f24 [114729,6334] 0 2024-04-26T21:07:56.033 INFO:tasks.workunit.client.1.smithi064.stdout:7/182: symlink d6/d15/d33/l3f 0 2024-04-26T21:07:56.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/181: unlink d1/d14/l32 0 2024-04-26T21:07:56.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/182: stat d1/d14/f1c 0 2024-04-26T21:07:56.035 INFO:tasks.workunit.client.1.smithi064.stdout:7/183: symlink d6/d9/d38/l40 0 2024-04-26T21:07:56.037 INFO:tasks.workunit.client.1.smithi064.stdout:3/183: link d1/f1a d1/d27/f3d 0 2024-04-26T21:07:56.039 INFO:tasks.workunit.client.1.smithi064.stdout:7/184: mkdir d6/db/d34/d41 0 2024-04-26T21:07:56.039 INFO:tasks.workunit.client.1.smithi064.stdout:7/185: fsync d6/d9/f30 0 2024-04-26T21:07:56.041 INFO:tasks.workunit.client.1.smithi064.stdout:7/186: write d6/d15/d1c/f2e [258809,14395] 0 2024-04-26T21:07:56.045 INFO:tasks.workunit.client.1.smithi064.stdout:4/232: dwrite d0/d5/d13/d33/f39 [0,4194304] 0 2024-04-26T21:07:56.045 INFO:tasks.workunit.client.1.smithi064.stdout:4/233: creat d0/d5/d13/d10/f4c x:0 0 0 2024-04-26T21:07:56.045 INFO:tasks.workunit.client.1.smithi064.stdout:4/234: chown d0/d5/d13/d33/f42 221731 1 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:8/40: sync 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:5/50: sync 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:3/56: sync 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:3/57: stat d0/d4/d5 0 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:3/58: readlink d0/d1/l2 0 2024-04-26T21:07:56.047 INFO:tasks.workunit.client.0.smithi055.stdout:3/59: dread - d0/d4/f15 zero size 2024-04-26T21:07:56.049 INFO:tasks.workunit.client.0.smithi055.stdout:4/9: sync 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:4/10: truncate - no filename 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:0/96: sync 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:9/56: sync 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:9/57: stat d2/c5 0 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:0/97: readlink d9/dc/d17/l18 0 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:0/98: chown d9/dc/d19/f24 12 1 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:2/77: sync 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:9/58: creat d2/f13 x:0 0 0 2024-04-26T21:07:56.050 INFO:tasks.workunit.client.0.smithi055.stdout:9/59: fsync d2/f10 0 2024-04-26T21:07:56.051 INFO:tasks.workunit.client.0.smithi055.stdout:1/48: sync 2024-04-26T21:07:56.051 INFO:tasks.workunit.client.0.smithi055.stdout:1/49: write f6 [1125180,74516] 0 2024-04-26T21:07:56.051 INFO:tasks.workunit.client.1.smithi064.stdout:7/187: dread d6/db/f29 [0,4194304] 0 2024-04-26T21:07:56.052 INFO:tasks.workunit.client.1.smithi064.stdout:7/188: stat d6/d9/f1a 0 2024-04-26T21:07:56.052 INFO:tasks.workunit.client.1.smithi064.stdout:7/189: creat d6/d9/d38/f42 x:0 0 0 2024-04-26T21:07:56.052 INFO:tasks.workunit.client.1.smithi064.stdout:5/196: write f9 [2082565,29064] 0 2024-04-26T21:07:56.055 INFO:tasks.workunit.client.0.smithi055.stdout:4/11: mkdir d4 0 2024-04-26T21:07:56.057 INFO:tasks.workunit.client.1.smithi064.stdout:3/184: dread d1/f1b [0,4194304] 0 2024-04-26T21:07:56.057 INFO:tasks.workunit.client.1.smithi064.stdout:3/185: creat d1/d14/f3e x:0 0 0 2024-04-26T21:07:56.059 INFO:tasks.workunit.client.0.smithi055.stdout:2/78: write d4/db/f15 [660558,91814] 0 2024-04-26T21:07:56.060 INFO:tasks.workunit.client.1.smithi064.stdout:4/235: unlink d0/d5/d13/d10/c43 0 2024-04-26T21:07:56.060 INFO:tasks.workunit.client.1.smithi064.stdout:4/236: chown d0/d5/d13/c3b 69382768 1 2024-04-26T21:07:56.062 INFO:tasks.workunit.client.0.smithi055.stdout:4/12: mknod d4/c5 0 2024-04-26T21:07:56.063 INFO:tasks.workunit.client.0.smithi055.stdout:1/50: creat d8/df/f10 x:0 0 0 2024-04-26T21:07:56.069 INFO:tasks.workunit.client.0.smithi055.stdout:2/79: mknod d4/d14/c1b 0 2024-04-26T21:07:56.070 INFO:tasks.workunit.client.1.smithi064.stdout:7/190: mkdir d6/d9/d3d/d43 0 2024-04-26T21:07:56.070 INFO:tasks.workunit.client.1.smithi064.stdout:7/191: write d6/d9/d38/f3a [666811,35672] 0 2024-04-26T21:07:56.070 INFO:tasks.workunit.client.1.smithi064.stdout:7/192: write d6/d9/f39 [574492,63437] 0 2024-04-26T21:07:56.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/193: truncate d6/d9/f30 760380 0 2024-04-26T21:07:56.071 INFO:tasks.workunit.client.1.smithi064.stdout:5/197: rename dd/d12/d18/d1a/d1f/d20/f27 to dd/d12/d18/d1a/d1b/f3c 0 2024-04-26T21:07:56.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/51: mkdir d8/df/d11 0 2024-04-26T21:07:56.074 INFO:tasks.workunit.client.0.smithi055.stdout:2/80: rename d4/dc/c13 to d4/d14/c1c 0 2024-04-26T21:07:56.075 INFO:tasks.workunit.client.0.smithi055.stdout:2/81: fsync d4/d14/f19 0 2024-04-26T21:07:56.075 INFO:tasks.workunit.client.0.smithi055.stdout:2/82: creat d4/dc/f1d x:0 0 0 2024-04-26T21:07:56.075 INFO:tasks.workunit.client.0.smithi055.stdout:0/99: dread d9/dc/f12 [4194304,4194304] 0 2024-04-26T21:07:56.077 INFO:tasks.workunit.client.1.smithi064.stdout:5/198: getdents dd/d12/d18/d25/d32 0 2024-04-26T21:07:56.079 INFO:tasks.workunit.client.0.smithi055.stdout:2/83: mkdir d4/d1e 0 2024-04-26T21:07:56.084 INFO:tasks.workunit.client.0.smithi055.stdout:2/84: getdents d4/db 0 2024-04-26T21:07:56.087 INFO:tasks.workunit.client.1.smithi064.stdout:7/194: rename d6/l8 to d6/db/d1f/l44 0 2024-04-26T21:07:56.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/41: dread d3/d9/fe [0,4194304] 0 2024-04-26T21:07:56.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/42: chown d3/ca 211 1 2024-04-26T21:07:56.092 INFO:tasks.workunit.client.0.smithi055.stdout:8/43: creat d3/f12 x:0 0 0 2024-04-26T21:07:56.095 INFO:tasks.workunit.client.0.smithi055.stdout:8/44: rename d3/d9/l11 to d3/d9/l13 0 2024-04-26T21:07:56.096 INFO:tasks.workunit.client.0.smithi055.stdout:7/67: dwrite d5/d6/f7 [0,4194304] 0 2024-04-26T21:07:56.096 INFO:tasks.workunit.client.0.smithi055.stdout:7/68: truncate f1 3786207 0 2024-04-26T21:07:56.096 INFO:tasks.workunit.client.0.smithi055.stdout:7/69: creat d5/d6/ff x:0 0 0 2024-04-26T21:07:56.096 INFO:tasks.workunit.client.0.smithi055.stdout:7/70: chown d5 12127536 1 2024-04-26T21:07:56.104 INFO:tasks.workunit.client.0.smithi055.stdout:6/99: dwrite d3/d17/f18 [0,4194304] 0 2024-04-26T21:07:56.104 INFO:tasks.workunit.client.0.smithi055.stdout:6/100: creat d3/d17/d19/f1b x:0 0 0 2024-04-26T21:07:56.105 INFO:tasks.workunit.client.0.smithi055.stdout:7/71: rename d5/d6/l9 to d5/db/l10 0 2024-04-26T21:07:56.105 INFO:tasks.workunit.client.0.smithi055.stdout:7/72: write d5/d6/f7 [5135833,9511] 0 2024-04-26T21:07:56.106 INFO:tasks.workunit.client.0.smithi055.stdout:7/73: write f1 [2017282,118747] 0 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:2/198: sync 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:8/155: sync 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:9/225: sync 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:6/148: sync 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:2/199: getdents d12/d41 0 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:9/226: dread - d0/d39/f3e zero size 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:2/200: readlink d12/d16/l39 0 2024-04-26T21:07:56.107 INFO:tasks.workunit.client.1.smithi064.stdout:9/227: fsync d0/d4/da/fc 0 2024-04-26T21:07:56.108 INFO:tasks.workunit.client.1.smithi064.stdout:6/149: write d4/f16 [650975,77868] 0 2024-04-26T21:07:56.108 INFO:tasks.workunit.client.1.smithi064.stdout:6/150: chown d4/c10 2054195 1 2024-04-26T21:07:56.109 INFO:tasks.workunit.client.1.smithi064.stdout:4/237: dwrite d0/ff [0,4194304] 0 2024-04-26T21:07:56.113 INFO:tasks.workunit.client.1.smithi064.stdout:0/183: sync 2024-04-26T21:07:56.114 INFO:tasks.workunit.client.1.smithi064.stdout:8/156: mknod d10/d1d/c35 0 2024-04-26T21:07:56.115 INFO:tasks.workunit.client.0.smithi055.stdout:4/13: getdents d4 0 2024-04-26T21:07:56.115 INFO:tasks.workunit.client.0.smithi055.stdout:4/14: getdents d4 0 2024-04-26T21:07:56.115 INFO:tasks.workunit.client.0.smithi055.stdout:4/15: truncate - no filename 2024-04-26T21:07:56.126 INFO:tasks.workunit.client.0.smithi055.stdout:7/74: mkdir d5/d11 0 2024-04-26T21:07:56.130 INFO:tasks.workunit.client.0.smithi055.stdout:6/101: dread d3/f15 [0,4194304] 0 2024-04-26T21:07:56.130 INFO:tasks.workunit.client.0.smithi055.stdout:4/16: symlink d4/l6 0 2024-04-26T21:07:56.130 INFO:tasks.workunit.client.0.smithi055.stdout:4/17: stat c1 0 2024-04-26T21:07:56.133 INFO:tasks.workunit.client.1.smithi064.stdout:9/228: link d0/d39/f3d d0/d4/da/d26/d47/f4b 0 2024-04-26T21:07:56.134 INFO:tasks.workunit.client.1.smithi064.stdout:6/151: mknod d4/d7/c29 0 2024-04-26T21:07:56.140 INFO:tasks.workunit.client.1.smithi064.stdout:4/238: rename d0/d1d/d17/c32 to d0/d2f/c4d 0 2024-04-26T21:07:56.140 INFO:tasks.workunit.client.1.smithi064.stdout:4/239: creat d0/d1d/d21/f4e x:0 0 0 2024-04-26T21:07:56.140 INFO:tasks.workunit.client.1.smithi064.stdout:4/240: truncate d0/d2f/f30 5102476 0 2024-04-26T21:07:56.140 INFO:tasks.workunit.client.1.smithi064.stdout:4/241: fdatasync d0/d2f/f30 0 2024-04-26T21:07:56.141 INFO:tasks.workunit.client.0.smithi055.stdout:4/18: rename d4/l6 to d4/l7 0 2024-04-26T21:07:56.143 INFO:tasks.workunit.client.1.smithi064.stdout:1/254: sync 2024-04-26T21:07:56.143 INFO:tasks.workunit.client.1.smithi064.stdout:1/255: creat d0/d6/d11/d2c/f4b x:0 0 0 2024-04-26T21:07:56.143 INFO:tasks.workunit.client.1.smithi064.stdout:5/199: dwrite dd/d12/d18/d1a/d1f/f24 [0,4194304] 0 2024-04-26T21:07:56.145 INFO:tasks.workunit.client.1.smithi064.stdout:3/186: dwrite d1/da/d22/f2e [4194304,4194304] 0 2024-04-26T21:07:56.145 INFO:tasks.workunit.client.1.smithi064.stdout:2/201: write d12/f24 [1390635,33702] 0 2024-04-26T21:07:56.148 INFO:tasks.workunit.client.1.smithi064.stdout:9/229: dread d0/f3b [0,4194304] 0 2024-04-26T21:07:56.148 INFO:tasks.workunit.client.1.smithi064.stdout:9/230: write d0/d4/da/d26/f23 [1815470,39538] 0 2024-04-26T21:07:56.149 INFO:tasks.workunit.client.0.smithi055.stdout:9/60: dwrite d2/f10 [0,4194304] 0 2024-04-26T21:07:56.156 INFO:tasks.workunit.client.1.smithi064.stdout:7/195: dwrite d6/db/f2d [0,4194304] 0 2024-04-26T21:07:56.156 INFO:tasks.workunit.client.1.smithi064.stdout:7/196: stat d6/d15/d1c/f2e 0 2024-04-26T21:07:56.156 INFO:tasks.workunit.client.1.smithi064.stdout:7/197: read f3 [4031807,69131] 0 2024-04-26T21:07:56.157 INFO:tasks.workunit.client.1.smithi064.stdout:1/256: write d0/d6/d11/d1e/f21 [423979,50449] 0 2024-04-26T21:07:56.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/60: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:56.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/61: dread - d0/de/f17 zero size 2024-04-26T21:07:56.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/62: chown d0/d4/d16 52516 1 2024-04-26T21:07:56.164 INFO:tasks.workunit.client.0.smithi055.stdout:5/51: dwrite f0 [0,4194304] 0 2024-04-26T21:07:56.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/63: write d0/d4/f15 [512023,121416] 0 2024-04-26T21:07:56.168 INFO:tasks.workunit.client.1.smithi064.stdout:5/200: mknod dd/d12/d18/d25/c3d 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.1.smithi064.stdout:4/242: getdents d0/d5/d13/d33 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.1.smithi064.stdout:3/187: symlink d1/da/l3f 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.1.smithi064.stdout:4/243: readlink d0/d5/d2a/l4a 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.1.smithi064.stdout:3/188: creat d1/da/d22/f40 x:0 0 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.1.smithi064.stdout:3/189: truncate d1/d14/f3e 99330 0 2024-04-26T21:07:56.176 INFO:tasks.workunit.client.0.smithi055.stdout:4/19: creat d4/f8 x:0 0 0 2024-04-26T21:07:56.177 INFO:tasks.workunit.client.0.smithi055.stdout:4/20: creat d4/f9 x:0 0 0 2024-04-26T21:07:56.181 INFO:tasks.workunit.client.0.smithi055.stdout:0/100: dwrite d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:56.182 INFO:tasks.workunit.client.0.smithi055.stdout:0/101: chown d9/d11/l15 32 1 2024-04-26T21:07:56.182 INFO:tasks.workunit.client.0.smithi055.stdout:7/75: dread d5/d6/f7 [0,4194304] 0 2024-04-26T21:07:56.184 INFO:tasks.workunit.client.0.smithi055.stdout:3/64: mkdir d0/d4/d16/d18 0 2024-04-26T21:07:56.184 INFO:tasks.workunit.client.0.smithi055.stdout:1/52: dread f6 [0,4194304] 0 2024-04-26T21:07:56.189 INFO:tasks.workunit.client.1.smithi064.stdout:0/184: dwrite dd/d10/d1a/f2f [0,4194304] 0 2024-04-26T21:07:56.190 INFO:tasks.workunit.client.0.smithi055.stdout:7/76: rename d5/d6/f7 to d5/f12 0 2024-04-26T21:07:56.191 INFO:tasks.workunit.client.1.smithi064.stdout:7/198: mkdir d6/d15/d1c/d45 0 2024-04-26T21:07:56.193 INFO:tasks.workunit.client.0.smithi055.stdout:5/52: read d4/f6 [3081013,116817] 0 2024-04-26T21:07:56.197 INFO:tasks.workunit.client.0.smithi055.stdout:7/77: symlink d5/d6/l13 0 2024-04-26T21:07:56.197 INFO:tasks.workunit.client.0.smithi055.stdout:7/78: creat d5/db/f14 x:0 0 0 2024-04-26T21:07:56.198 INFO:tasks.workunit.client.1.smithi064.stdout:1/257: unlink d0/d6/d11/d1e/d2a/d34/c48 0 2024-04-26T21:07:56.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/79: write d5/db/f14 [65204,115328] 0 2024-04-26T21:07:56.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/80: readlink d5/db/l10 0 2024-04-26T21:07:56.202 INFO:tasks.workunit.client.1.smithi064.stdout:5/201: symlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:07:56.204 INFO:tasks.workunit.client.1.smithi064.stdout:4/244: rename d0/d5/d13/d10/c46 to d0/d5/d3e/c4f 0 2024-04-26T21:07:56.204 INFO:tasks.workunit.client.0.smithi055.stdout:2/85: dwrite d4/db/f15 [0,4194304] 0 2024-04-26T21:07:56.208 INFO:tasks.workunit.client.1.smithi064.stdout:3/190: link d1/d12/l15 d1/d27/d29/l41 0 2024-04-26T21:07:56.218 INFO:tasks.workunit.client.0.smithi055.stdout:5/53: symlink d4/l12 0 2024-04-26T21:07:56.218 INFO:tasks.workunit.client.0.smithi055.stdout:5/54: chown d4/fd 9891 1 2024-04-26T21:07:56.218 INFO:tasks.workunit.client.0.smithi055.stdout:5/55: dread - d4/f10 zero size 2024-04-26T21:07:56.218 INFO:tasks.workunit.client.0.smithi055.stdout:5/56: dread - d4/f9 zero size 2024-04-26T21:07:56.218 INFO:tasks.workunit.client.0.smithi055.stdout:1/53: dread f1 [0,4194304] 0 2024-04-26T21:07:56.221 INFO:tasks.workunit.client.1.smithi064.stdout:9/231: rmdir d0/d4 39 2024-04-26T21:07:56.221 INFO:tasks.workunit.client.1.smithi064.stdout:9/232: write d0/d4/f24 [4246882,56861] 0 2024-04-26T21:07:56.222 INFO:tasks.workunit.client.1.smithi064.stdout:9/233: chown d0/d4/d7/l1f 1057231 1 2024-04-26T21:07:56.222 INFO:tasks.workunit.client.0.smithi055.stdout:2/86: mkdir d4/db/d1f 0 2024-04-26T21:07:56.222 INFO:tasks.workunit.client.0.smithi055.stdout:2/87: chown d4/d14/f19 484919940 1 2024-04-26T21:07:56.222 INFO:tasks.workunit.client.0.smithi055.stdout:5/57: mkdir d4/df/d13 0 2024-04-26T21:07:56.229 INFO:tasks.workunit.client.0.smithi055.stdout:2/88: creat d4/d14/f20 x:0 0 0 2024-04-26T21:07:56.229 INFO:tasks.workunit.client.0.smithi055.stdout:2/89: truncate d4/d14/f20 706708 0 2024-04-26T21:07:56.230 INFO:tasks.workunit.client.1.smithi064.stdout:0/185: truncate dd/ff 1094504 0 2024-04-26T21:07:56.230 INFO:tasks.workunit.client.1.smithi064.stdout:7/199: symlink d6/d15/d1c/l46 0 2024-04-26T21:07:56.230 INFO:tasks.workunit.client.1.smithi064.stdout:4/245: unlink d0/d1d/d21/c2d 0 2024-04-26T21:07:56.231 INFO:tasks.workunit.client.1.smithi064.stdout:7/200: write d6/d9/d38/f42 [600221,16509] 0 2024-04-26T21:07:56.231 INFO:tasks.workunit.client.1.smithi064.stdout:7/201: chown d6/d12/c2b 1 1 2024-04-26T21:07:56.235 INFO:tasks.workunit.client.0.smithi055.stdout:8/45: dwrite d3/f5 [0,4194304] 0 2024-04-26T21:07:56.242 INFO:tasks.workunit.client.1.smithi064.stdout:8/157: dwrite d10/f1b [0,4194304] 0 2024-04-26T21:07:56.242 INFO:tasks.workunit.client.1.smithi064.stdout:8/158: creat d10/d2f/f36 x:0 0 0 2024-04-26T21:07:56.242 INFO:tasks.workunit.client.1.smithi064.stdout:8/159: chown d10/f24 7590 1 2024-04-26T21:07:56.248 INFO:tasks.workunit.client.1.smithi064.stdout:9/234: rename d0/d4/d28/l3f to d0/d4/d28/l4c 0 2024-04-26T21:07:56.255 INFO:tasks.workunit.client.1.smithi064.stdout:7/202: creat d6/d15/d1c/d45/f47 x:0 0 0 2024-04-26T21:07:56.257 INFO:tasks.workunit.client.1.smithi064.stdout:8/160: symlink d10/d1d/l37 0 2024-04-26T21:07:56.258 INFO:tasks.workunit.client.0.smithi055.stdout:1/54: write f1 [3594147,7491] 0 2024-04-26T21:07:56.259 INFO:tasks.workunit.client.0.smithi055.stdout:1/55: truncate f1 4517799 0 2024-04-26T21:07:56.259 INFO:tasks.workunit.client.1.smithi064.stdout:9/235: mknod d0/d4/d7/c4d 0 2024-04-26T21:07:56.259 INFO:tasks.workunit.client.1.smithi064.stdout:9/236: readlink d0/d4/da/l1a 0 2024-04-26T21:07:56.259 INFO:tasks.workunit.client.1.smithi064.stdout:9/237: readlink d0/d4/da/l13 0 2024-04-26T21:07:56.263 INFO:tasks.workunit.client.0.smithi055.stdout:1/56: creat d8/f12 x:0 0 0 2024-04-26T21:07:56.266 INFO:tasks.workunit.client.0.smithi055.stdout:1/57: mknod d8/df/c13 0 2024-04-26T21:07:56.267 INFO:tasks.workunit.client.1.smithi064.stdout:8/161: mkdir d10/d1d/d38 0 2024-04-26T21:07:56.267 INFO:tasks.workunit.client.1.smithi064.stdout:8/162: fsync d10/f2d 0 2024-04-26T21:07:56.274 INFO:tasks.workunit.client.1.smithi064.stdout:4/246: write d0/d1d/f1b [3603616,123626] 0 2024-04-26T21:07:56.280 INFO:tasks.workunit.client.0.smithi055.stdout:0/102: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:07:56.280 INFO:tasks.workunit.client.0.smithi055.stdout:2/90: write d4/f5 [3032849,123185] 0 2024-04-26T21:07:56.280 INFO:tasks.workunit.client.0.smithi055.stdout:2/91: chown d4/c9 108590443 1 2024-04-26T21:07:56.280 INFO:tasks.workunit.client.0.smithi055.stdout:6/102: dwrite d3/f16 [0,4194304] 0 2024-04-26T21:07:56.282 INFO:tasks.workunit.client.0.smithi055.stdout:2/92: mkdir d4/dc/d21 0 2024-04-26T21:07:56.285 INFO:tasks.workunit.client.1.smithi064.stdout:3/191: dwrite d1/da/f10 [0,4194304] 0 2024-04-26T21:07:56.287 INFO:tasks.workunit.client.0.smithi055.stdout:4/21: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:07:56.288 INFO:tasks.workunit.client.1.smithi064.stdout:4/247: creat d0/d14/f50 x:0 0 0 2024-04-26T21:07:56.288 INFO:tasks.workunit.client.1.smithi064.stdout:4/248: dread - d0/d14/f50 zero size 2024-04-26T21:07:56.289 INFO:tasks.workunit.client.0.smithi055.stdout:8/46: dwrite d3/f5 [0,4194304] 0 2024-04-26T21:07:56.289 INFO:tasks.workunit.client.0.smithi055.stdout:8/47: dread - d3/f12 zero size 2024-04-26T21:07:56.289 INFO:tasks.workunit.client.0.smithi055.stdout:8/48: chown d3/f5 115585 1 2024-04-26T21:07:56.289 INFO:tasks.workunit.client.1.smithi064.stdout:4/249: fsync d0/f1a 0 2024-04-26T21:07:56.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/163: dread f4 [0,4194304] 0 2024-04-26T21:07:56.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/164: fdatasync f4 0 2024-04-26T21:07:56.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/165: stat d10/l28 0 2024-04-26T21:07:56.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/103: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:07:56.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/104: write d9/dc/d1c/f26 [419377,25660] 0 2024-04-26T21:07:56.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/105: dread - d9/dc/d1c/f21 zero size 2024-04-26T21:07:56.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/106: chown d9/dc/d1c/f26 0 1 2024-04-26T21:07:56.298 INFO:tasks.workunit.client.0.smithi055.stdout:9/61: dwrite d2/fe [0,4194304] 0 2024-04-26T21:07:56.307 INFO:tasks.workunit.client.1.smithi064.stdout:5/202: dwrite dd/d12/d18/d1a/d1f/f24 [4194304,4194304] 0 2024-04-26T21:07:56.307 INFO:tasks.workunit.client.1.smithi064.stdout:5/203: chown dd/d12/d18/d33/c34 4960298 1 2024-04-26T21:07:56.308 INFO:tasks.workunit.client.0.smithi055.stdout:6/103: symlink d3/d17/d19/l1c 0 2024-04-26T21:07:56.321 INFO:tasks.workunit.client.1.smithi064.stdout:4/250: rmdir d0/d5/d3e 39 2024-04-26T21:07:56.325 INFO:tasks.workunit.client.0.smithi055.stdout:0/107: write d9/fa [2428437,46514] 0 2024-04-26T21:07:56.329 INFO:tasks.workunit.client.1.smithi064.stdout:8/166: creat d10/d1d/d38/f39 x:0 0 0 2024-04-26T21:07:56.333 INFO:tasks.workunit.client.1.smithi064.stdout:5/204: creat dd/d12/f3f x:0 0 0 2024-04-26T21:07:56.340 INFO:tasks.workunit.client.0.smithi055.stdout:9/62: mkdir d2/d14 0 2024-04-26T21:07:56.340 INFO:tasks.workunit.client.0.smithi055.stdout:9/63: fdatasync d2/fe 0 2024-04-26T21:07:56.340 INFO:tasks.workunit.client.1.smithi064.stdout:8/167: dread d10/d1d/f29 [0,4194304] 0 2024-04-26T21:07:56.340 INFO:tasks.workunit.client.1.smithi064.stdout:8/168: chown le 1 1 2024-04-26T21:07:56.341 INFO:tasks.workunit.client.1.smithi064.stdout:8/169: write d10/d1d/f1e [2567933,76352] 0 2024-04-26T21:07:56.341 INFO:tasks.workunit.client.1.smithi064.stdout:8/170: creat d10/d2f/f3a x:0 0 0 2024-04-26T21:07:56.342 INFO:tasks.workunit.client.0.smithi055.stdout:6/104: unlink d3/f14 0 2024-04-26T21:07:56.342 INFO:tasks.workunit.client.0.smithi055.stdout:6/105: truncate d3/f9 1755706 0 2024-04-26T21:07:56.343 INFO:tasks.workunit.client.1.smithi064.stdout:3/192: rmdir d1/da/d35 39 2024-04-26T21:07:56.346 INFO:tasks.workunit.client.0.smithi055.stdout:0/108: mkdir d9/d27 0 2024-04-26T21:07:56.347 INFO:tasks.workunit.client.1.smithi064.stdout:1/258: dwrite d0/d6/d11/d1e/f21 [0,4194304] 0 2024-04-26T21:07:56.348 INFO:tasks.workunit.client.0.smithi055.stdout:1/58: dwrite f6 [0,4194304] 0 2024-04-26T21:07:56.348 INFO:tasks.workunit.client.0.smithi055.stdout:1/59: fdatasync f6 0 2024-04-26T21:07:56.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/251: link d0/d14/l27 d0/d14/l51 0 2024-04-26T21:07:56.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/252: chown d0/d5/d2a/l4a 1808356440 1 2024-04-26T21:07:56.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/253: write d0/d5/d13/d33/f42 [247085,3499] 0 2024-04-26T21:07:56.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/254: dread - d0/d5/d13/f3d zero size 2024-04-26T21:07:56.350 INFO:tasks.workunit.client.1.smithi064.stdout:7/203: dwrite f3 [0,4194304] 0 2024-04-26T21:07:56.350 INFO:tasks.workunit.client.1.smithi064.stdout:4/255: write d0/d5/d13/d10/f2b [1101379,98443] 0 2024-04-26T21:07:56.350 INFO:tasks.workunit.client.1.smithi064.stdout:7/204: fsync d6/d9/f37 0 2024-04-26T21:07:56.350 INFO:tasks.workunit.client.1.smithi064.stdout:4/256: fdatasync d0/d5/d2a/f4b 0 2024-04-26T21:07:56.350 INFO:tasks.workunit.client.1.smithi064.stdout:7/205: write d6/db/f2a [552252,88443] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:3/65: dwrite d0/d4/f15 [0,4194304] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:5/58: dwrite d4/fd [0,4194304] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:3/66: dread - d0/de/f17 zero size 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:3/67: creat d0/f19 x:0 0 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:7/81: dwrite f1 [0,4194304] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:4/22: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:7/82: write d5/db/f14 [68800,48950] 0 2024-04-26T21:07:56.351 INFO:tasks.workunit.client.0.smithi055.stdout:7/83: fdatasync d5/d6/ff 0 2024-04-26T21:07:56.354 INFO:tasks.workunit.client.1.smithi064.stdout:0/186: rename dd/ff to dd/d34/f35 0 2024-04-26T21:07:56.354 INFO:tasks.workunit.client.1.smithi064.stdout:0/187: chown dd/d21 27764748 1 2024-04-26T21:07:56.359 INFO:tasks.workunit.client.1.smithi064.stdout:0/188: read dd/d34/f35 [598355,49327] 0 2024-04-26T21:07:56.363 INFO:tasks.workunit.client.1.smithi064.stdout:3/193: dread d1/d14/f1c [0,4194304] 0 2024-04-26T21:07:56.364 INFO:tasks.workunit.client.1.smithi064.stdout:3/194: write d1/f6 [5035369,61745] 0 2024-04-26T21:07:56.364 INFO:tasks.workunit.client.0.smithi055.stdout:6/106: symlink d3/l1d 0 2024-04-26T21:07:56.364 INFO:tasks.workunit.client.0.smithi055.stdout:0/109: link d9/d11/c1a d9/d11/c28 0 2024-04-26T21:07:56.364 INFO:tasks.workunit.client.0.smithi055.stdout:0/110: fdatasync d9/dc/d19/f24 0 2024-04-26T21:07:56.368 INFO:tasks.workunit.client.0.smithi055.stdout:1/60: creat d8/df/d11/f14 x:0 0 0 2024-04-26T21:07:56.368 INFO:tasks.workunit.client.0.smithi055.stdout:1/61: write f1 [2192882,112688] 0 2024-04-26T21:07:56.369 INFO:tasks.workunit.client.0.smithi055.stdout:1/62: dread - d8/df/f10 zero size 2024-04-26T21:07:56.369 INFO:tasks.workunit.client.0.smithi055.stdout:1/63: readlink l3 0 2024-04-26T21:07:56.373 INFO:tasks.workunit.client.1.smithi064.stdout:1/259: creat d0/d6/d29/d31/f4c x:0 0 0 2024-04-26T21:07:56.375 INFO:tasks.workunit.client.0.smithi055.stdout:5/59: mknod d4/c14 0 2024-04-26T21:07:56.380 INFO:tasks.workunit.client.0.smithi055.stdout:2/93: truncate d4/f5 2175379 0 2024-04-26T21:07:56.380 INFO:tasks.workunit.client.1.smithi064.stdout:4/257: symlink d0/d5/l52 0 2024-04-26T21:07:56.383 INFO:tasks.workunit.client.1.smithi064.stdout:6/152: sync 2024-04-26T21:07:56.387 INFO:tasks.workunit.client.1.smithi064.stdout:9/238: rename d0/d4/d7/f11 to d0/d4/da/d26/f4e 0 2024-04-26T21:07:56.387 INFO:tasks.workunit.client.1.smithi064.stdout:7/206: rename d6/d15 to d6/d15/d1c/d45/d48 22 2024-04-26T21:07:56.387 INFO:tasks.workunit.client.1.smithi064.stdout:9/239: write d0/d4/d7/f4a [478230,35737] 0 2024-04-26T21:07:56.387 INFO:tasks.workunit.client.0.smithi055.stdout:4/23: mknod d4/ca 0 2024-04-26T21:07:56.387 INFO:tasks.workunit.client.0.smithi055.stdout:7/84: creat d5/f15 x:0 0 0 2024-04-26T21:07:56.389 INFO:tasks.workunit.client.1.smithi064.stdout:3/195: mknod d1/da/c42 0 2024-04-26T21:07:56.390 INFO:tasks.workunit.client.0.smithi055.stdout:6/107: rename d3/ff to d3/d17/d19/f1e 0 2024-04-26T21:07:56.391 INFO:tasks.workunit.client.1.smithi064.stdout:8/171: getdents d10/d1d/d38 0 2024-04-26T21:07:56.391 INFO:tasks.workunit.client.1.smithi064.stdout:8/172: write f4 [1393546,29380] 0 2024-04-26T21:07:56.393 INFO:tasks.workunit.client.1.smithi064.stdout:6/153: mknod d4/d7/d12/c2a 0 2024-04-26T21:07:56.394 INFO:tasks.workunit.client.0.smithi055.stdout:5/60: mkdir d4/d15 0 2024-04-26T21:07:56.394 INFO:tasks.workunit.client.0.smithi055.stdout:7/85: mknod d5/c16 0 2024-04-26T21:07:56.394 INFO:tasks.workunit.client.0.smithi055.stdout:3/68: dwrite d0/d4/f15 [0,4194304] 0 2024-04-26T21:07:56.395 INFO:tasks.workunit.client.1.smithi064.stdout:7/207: creat d6/db/d34/d41/f49 x:0 0 0 2024-04-26T21:07:56.400 INFO:tasks.workunit.client.1.smithi064.stdout:2/202: sync 2024-04-26T21:07:56.400 INFO:tasks.workunit.client.1.smithi064.stdout:2/203: chown d12/d1a/l1f 39106 1 2024-04-26T21:07:56.401 INFO:tasks.workunit.client.0.smithi055.stdout:0/111: dread f8 [0,4194304] 0 2024-04-26T21:07:56.401 INFO:tasks.workunit.client.0.smithi055.stdout:0/112: fdatasync d9/dc/d19/f24 0 2024-04-26T21:07:56.401 INFO:tasks.workunit.client.0.smithi055.stdout:6/108: write d3/f11 [1572000,57502] 0 2024-04-26T21:07:56.409 INFO:tasks.workunit.client.0.smithi055.stdout:3/69: mkdir d0/d1/d13/d1a 0 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/173: creat d10/d31/f3b x:0 0 0 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/174: fsync d10/f12 0 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/175: dread - d10/d2f/f36 zero size 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/176: fdatasync d10/d1d/f29 0 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/177: fsync d10/f1b 0 2024-04-26T21:07:56.414 INFO:tasks.workunit.client.1.smithi064.stdout:8/178: stat d10 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.1.smithi064.stdout:8/179: fdatasync d10/d1d/f29 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.1.smithi064.stdout:8/180: write d10/d2f/f3a [314861,43532] 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.1.smithi064.stdout:8/181: write d10/d2f/f33 [100837,22379] 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.1.smithi064.stdout:8/182: readlink d10/d1d/l32 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.0.smithi055.stdout:4/24: dread d4/f8 [0,4194304] 0 2024-04-26T21:07:56.415 INFO:tasks.workunit.client.0.smithi055.stdout:4/25: chown d4/c5 3672569 1 2024-04-26T21:07:56.419 INFO:tasks.workunit.client.1.smithi064.stdout:0/189: dwrite dd/d10/d18/f19 [0,4194304] 0 2024-04-26T21:07:56.419 INFO:tasks.workunit.client.1.smithi064.stdout:0/190: readlink dd/d10/d1a/l25 0 2024-04-26T21:07:56.419 INFO:tasks.workunit.client.0.smithi055.stdout:0/113: rename d9/dc/d1c/f21 to d9/dc/d1c/f29 0 2024-04-26T21:07:56.420 INFO:tasks.workunit.client.0.smithi055.stdout:0/114: write d9/dc/d1c/f29 [129801,106125] 0 2024-04-26T21:07:56.420 INFO:tasks.workunit.client.0.smithi055.stdout:0/115: fdatasync d9/dc/d19/f24 0 2024-04-26T21:07:56.420 INFO:tasks.workunit.client.1.smithi064.stdout:6/154: creat d4/d7/d12/d1e/f2b x:0 0 0 2024-04-26T21:07:56.420 INFO:tasks.workunit.client.1.smithi064.stdout:6/155: fsync d4/f28 0 2024-04-26T21:07:56.421 INFO:tasks.workunit.client.0.smithi055.stdout:6/109: rmdir d3 39 2024-04-26T21:07:56.424 INFO:tasks.workunit.client.1.smithi064.stdout:7/208: rmdir d6/d15/d35 0 2024-04-26T21:07:56.424 INFO:tasks.workunit.client.1.smithi064.stdout:7/209: readlink l1 0 2024-04-26T21:07:56.424 INFO:tasks.workunit.client.1.smithi064.stdout:7/210: chown d6/db/c20 4735262 1 2024-04-26T21:07:56.424 INFO:tasks.workunit.client.1.smithi064.stdout:7/211: write d6/d9/f1a [1053613,30314] 0 2024-04-26T21:07:56.424 INFO:tasks.workunit.client.1.smithi064.stdout:7/212: chown d6/d12/c2b 5 1 2024-04-26T21:07:56.426 INFO:tasks.workunit.client.0.smithi055.stdout:1/64: rename d8/df/d11/f14 to d8/f15 0 2024-04-26T21:07:56.427 INFO:tasks.workunit.client.0.smithi055.stdout:2/94: dread d4/f5 [0,4194304] 0 2024-04-26T21:07:56.431 INFO:tasks.workunit.client.1.smithi064.stdout:2/204: mkdir d12/d16/d29/d43 0 2024-04-26T21:07:56.437 INFO:tasks.workunit.client.0.smithi055.stdout:4/26: mknod d4/cb 0 2024-04-26T21:07:56.440 INFO:tasks.workunit.client.0.smithi055.stdout:0/116: getdents d9/d11 0 2024-04-26T21:07:56.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/240: rmdir d0 39 2024-04-26T21:07:56.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/241: chown d0/d4/da/f14 606 1 2024-04-26T21:07:56.444 INFO:tasks.workunit.client.1.smithi064.stdout:3/196: getdents d1 0 2024-04-26T21:07:56.446 INFO:tasks.workunit.client.0.smithi055.stdout:1/65: mknod d8/df/c16 0 2024-04-26T21:07:56.446 INFO:tasks.workunit.client.0.smithi055.stdout:1/66: write d8/f12 [16347,56693] 0 2024-04-26T21:07:56.446 INFO:tasks.workunit.client.0.smithi055.stdout:1/67: truncate d8/f12 891648 0 2024-04-26T21:07:56.448 INFO:tasks.workunit.client.1.smithi064.stdout:8/183: symlink d10/d1d/d38/l3c 0 2024-04-26T21:07:56.448 INFO:tasks.workunit.client.1.smithi064.stdout:8/184: creat d10/d1d/f3d x:0 0 0 2024-04-26T21:07:56.448 INFO:tasks.workunit.client.1.smithi064.stdout:8/185: chown d10/d31 15 1 2024-04-26T21:07:56.451 INFO:tasks.workunit.client.0.smithi055.stdout:3/70: rename d0/d4/f15 to d0/d1/d13/f1b 0 2024-04-26T21:07:56.453 INFO:tasks.workunit.client.0.smithi055.stdout:6/110: getdents d3 0 2024-04-26T21:07:56.457 INFO:tasks.workunit.client.0.smithi055.stdout:1/68: mkdir d8/d17 0 2024-04-26T21:07:56.459 INFO:tasks.workunit.client.1.smithi064.stdout:0/191: link dd/f12 dd/d21/f36 0 2024-04-26T21:07:56.460 INFO:tasks.workunit.client.0.smithi055.stdout:0/117: rename d9/c20 to d9/dc/d1c/c2a 0 2024-04-26T21:07:56.463 INFO:tasks.workunit.client.1.smithi064.stdout:6/156: creat d4/d7/f2c x:0 0 0 2024-04-26T21:07:56.465 INFO:tasks.workunit.client.0.smithi055.stdout:9/64: dwrite d2/f8 [0,4194304] 0 2024-04-26T21:07:56.466 INFO:tasks.workunit.client.1.smithi064.stdout:7/213: symlink d6/d9/d3d/d43/l4a 0 2024-04-26T21:07:56.468 INFO:tasks.workunit.client.1.smithi064.stdout:4/258: dwrite d0/ff [0,4194304] 0 2024-04-26T21:07:56.470 INFO:tasks.workunit.client.1.smithi064.stdout:2/205: rename d12/d1a/l1f to d12/d41/l44 0 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:9/242: rmdir d0/d4/d28 39 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/186: symlink d10/d31/l3e 0 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/187: chown d10/d2f/f36 1 1 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/188: readlink d10/l2a 0 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/189: write d10/d1d/f30 [5139734,42887] 0 2024-04-26T21:07:56.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/190: write d10/d1d/f3d [338256,29621] 0 2024-04-26T21:07:56.481 INFO:tasks.workunit.client.1.smithi064.stdout:7/214: mknod d6/db/d1f/c4b 0 2024-04-26T21:07:56.481 INFO:tasks.workunit.client.1.smithi064.stdout:6/157: rename d4/d7/c24 to d4/d7/c2d 0 2024-04-26T21:07:56.482 INFO:tasks.workunit.client.1.smithi064.stdout:7/215: write d6/d9/f37 [306589,26201] 0 2024-04-26T21:07:56.483 INFO:tasks.workunit.client.0.smithi055.stdout:0/118: dread d9/fa [8388608,4194304] 0 2024-04-26T21:07:56.489 INFO:tasks.workunit.client.0.smithi055.stdout:9/65: write d2/f8 [1532039,48308] 0 2024-04-26T21:07:56.490 INFO:tasks.workunit.client.0.smithi055.stdout:7/86: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:07:56.490 INFO:tasks.workunit.client.1.smithi064.stdout:4/259: creat d0/d1d/d17/d44/f53 x:0 0 0 2024-04-26T21:07:56.492 INFO:tasks.workunit.client.0.smithi055.stdout:7/87: truncate d5/db/f14 4914472 0 2024-04-26T21:07:56.493 INFO:tasks.workunit.client.0.smithi055.stdout:7/88: getdents d5/d11 0 2024-04-26T21:07:56.494 INFO:tasks.workunit.client.1.smithi064.stdout:2/206: mkdir d12/d45 0 2024-04-26T21:07:56.495 INFO:tasks.workunit.client.1.smithi064.stdout:8/191: mknod d10/d2f/c3f 0 2024-04-26T21:07:56.499 INFO:tasks.workunit.client.1.smithi064.stdout:7/216: rmdir d6/db 39 2024-04-26T21:07:56.499 INFO:tasks.workunit.client.1.smithi064.stdout:7/217: write d6/d15/d1c/f25 [3830484,74655] 0 2024-04-26T21:07:56.499 INFO:tasks.workunit.client.1.smithi064.stdout:7/218: fsync f3 0 2024-04-26T21:07:56.501 INFO:tasks.workunit.client.0.smithi055.stdout:5/61: dwrite d4/fb [0,4194304] 0 2024-04-26T21:07:56.502 INFO:tasks.workunit.client.0.smithi055.stdout:4/27: read d4/f8 [778434,38224] 0 2024-04-26T21:07:56.509 INFO:tasks.workunit.client.0.smithi055.stdout:0/119: truncate d9/dc/d19/f24 876191 0 2024-04-26T21:07:56.513 INFO:tasks.workunit.client.0.smithi055.stdout:1/69: dread d8/f12 [0,4194304] 0 2024-04-26T21:07:56.515 INFO:tasks.workunit.client.1.smithi064.stdout:4/260: dread d0/d5/d13/d33/f39 [0,4194304] 0 2024-04-26T21:07:56.515 INFO:tasks.workunit.client.1.smithi064.stdout:4/261: stat d0/l22 0 2024-04-26T21:07:56.516 INFO:tasks.workunit.client.1.smithi064.stdout:4/262: fsync d0/d1d/d21/f47 0 2024-04-26T21:07:56.516 INFO:tasks.workunit.client.0.smithi055.stdout:2/95: dwrite f2 [0,4194304] 0 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:3/71: dread d0/d1/d13/f1b [0,4194304] 0 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:3/72: fdatasync d0/d1/f14 0 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:3/73: read - d0/d1/f14 zero size 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:3/74: chown d0/d1/d13 670152 1 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:7/89: truncate d5/db/fc 925876 0 2024-04-26T21:07:56.517 INFO:tasks.workunit.client.0.smithi055.stdout:7/90: chown d5/f12 342186038 1 2024-04-26T21:07:56.529 INFO:tasks.workunit.client.1.smithi064.stdout:4/263: getdents d0/d5/d13/d10 0 2024-04-26T21:07:56.530 INFO:tasks.workunit.client.0.smithi055.stdout:5/62: rename d4/fb to d4/d15/f16 0 2024-04-26T21:07:56.530 INFO:tasks.workunit.client.0.smithi055.stdout:5/63: dread - d4/f8 zero size 2024-04-26T21:07:56.530 INFO:tasks.workunit.client.0.smithi055.stdout:5/64: write d4/f10 [407396,44182] 0 2024-04-26T21:07:56.531 INFO:tasks.workunit.client.0.smithi055.stdout:5/65: readlink d4/la 0 2024-04-26T21:07:56.531 INFO:tasks.workunit.client.0.smithi055.stdout:0/120: symlink d9/dc/d1c/l2b 0 2024-04-26T21:07:56.531 INFO:tasks.workunit.client.0.smithi055.stdout:9/66: write d2/f8 [4848832,62849] 0 2024-04-26T21:07:56.531 INFO:tasks.workunit.client.0.smithi055.stdout:0/121: write d9/fa [4777913,12532] 0 2024-04-26T21:07:56.532 INFO:tasks.workunit.client.1.smithi064.stdout:7/219: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:56.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/220: write d6/db/f29 [327376,87497] 0 2024-04-26T21:07:56.537 INFO:tasks.workunit.client.1.smithi064.stdout:8/192: dread ff [4194304,4194304] 0 2024-04-26T21:07:56.537 INFO:tasks.workunit.client.1.smithi064.stdout:8/193: write fa [530195,15383] 0 2024-04-26T21:07:56.538 INFO:tasks.workunit.client.1.smithi064.stdout:8/194: fsync d10/f2d 0 2024-04-26T21:07:56.538 INFO:tasks.workunit.client.1.smithi064.stdout:8/195: chown d10/d1d/c22 1506 1 2024-04-26T21:07:56.538 INFO:tasks.workunit.client.0.smithi055.stdout:1/70: link f6 d8/d17/f18 0 2024-04-26T21:07:56.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/96: mknod d4/db/d1f/c22 0 2024-04-26T21:07:56.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/97: chown d4/d14/d17 16259 1 2024-04-26T21:07:56.552 INFO:tasks.workunit.client.1.smithi064.stdout:5/205: sync 2024-04-26T21:07:56.553 INFO:tasks.workunit.client.0.smithi055.stdout:5/66: link d4/f6 d4/df/d13/f17 0 2024-04-26T21:07:56.554 INFO:tasks.workunit.client.0.smithi055.stdout:9/67: unlink d2/ld 0 2024-04-26T21:07:56.554 INFO:tasks.workunit.client.0.smithi055.stdout:9/68: chown d2/d14 0 1 2024-04-26T21:07:56.555 INFO:tasks.workunit.client.0.smithi055.stdout:0/122: mkdir d9/dc/d1c/d2c 0 2024-04-26T21:07:56.555 INFO:tasks.workunit.client.0.smithi055.stdout:0/123: chown d9/d11/l15 74320 1 2024-04-26T21:07:56.555 INFO:tasks.workunit.client.0.smithi055.stdout:0/124: read f8 [3818256,107431] 0 2024-04-26T21:07:56.555 INFO:tasks.workunit.client.1.smithi064.stdout:8/196: write d10/d1d/f3d [147502,59865] 0 2024-04-26T21:07:56.560 INFO:tasks.workunit.client.1.smithi064.stdout:6/158: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:07:56.560 INFO:tasks.workunit.client.1.smithi064.stdout:9/243: dwrite d0/d4/d7/f2e [0,4194304] 0 2024-04-26T21:07:56.562 INFO:tasks.workunit.client.1.smithi064.stdout:5/206: getdents dd/d12 0 2024-04-26T21:07:56.565 INFO:tasks.workunit.client.0.smithi055.stdout:0/125: creat d9/dc/d1c/d2c/f2d x:0 0 0 2024-04-26T21:07:56.567 INFO:tasks.workunit.client.1.smithi064.stdout:7/221: truncate d6/d15/d1c/f25 3621882 0 2024-04-26T21:07:56.567 INFO:tasks.workunit.client.1.smithi064.stdout:7/222: fdatasync d6/d15/d1c/f2e 0 2024-04-26T21:07:56.567 INFO:tasks.workunit.client.1.smithi064.stdout:7/223: chown d6/d9/f36 176899411 1 2024-04-26T21:07:56.568 INFO:tasks.workunit.client.0.smithi055.stdout:2/98: getdents d4 0 2024-04-26T21:07:56.569 INFO:tasks.workunit.client.0.smithi055.stdout:2/99: fsync d4/dc/f11 0 2024-04-26T21:07:56.569 INFO:tasks.workunit.client.0.smithi055.stdout:3/75: dread d0/f12 [0,4194304] 0 2024-04-26T21:07:56.576 INFO:tasks.workunit.client.1.smithi064.stdout:9/244: dread d0/d4/f2a [0,4194304] 0 2024-04-26T21:07:56.577 INFO:tasks.workunit.client.1.smithi064.stdout:8/197: symlink d10/d31/l40 0 2024-04-26T21:07:56.577 INFO:tasks.workunit.client.1.smithi064.stdout:8/198: fsync d10/d2f/f36 0 2024-04-26T21:07:56.584 INFO:tasks.workunit.client.1.smithi064.stdout:8/199: dread d10/d2f/f33 [0,4194304] 0 2024-04-26T21:07:56.585 INFO:tasks.workunit.client.1.smithi064.stdout:2/207: dwrite d12/d1a/f42 [0,4194304] 0 2024-04-26T21:07:56.585 INFO:tasks.workunit.client.1.smithi064.stdout:2/208: chown d12/d1a/f2b 360090 1 2024-04-26T21:07:56.586 INFO:tasks.workunit.client.1.smithi064.stdout:6/159: mknod d4/d7/c2e 0 2024-04-26T21:07:56.591 INFO:tasks.workunit.client.1.smithi064.stdout:5/207: creat dd/d12/f40 x:0 0 0 2024-04-26T21:07:56.594 INFO:tasks.workunit.client.0.smithi055.stdout:5/67: write d4/fd [2934508,123607] 0 2024-04-26T21:07:56.594 INFO:tasks.workunit.client.0.smithi055.stdout:5/68: chown d4/f10 6 1 2024-04-26T21:07:56.594 INFO:tasks.workunit.client.0.smithi055.stdout:5/69: chown d4/ce 969 1 2024-04-26T21:07:56.595 INFO:tasks.workunit.client.0.smithi055.stdout:4/28: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:07:56.596 INFO:tasks.workunit.client.0.smithi055.stdout:2/100: write d4/dc/f16 [241728,129012] 0 2024-04-26T21:07:56.596 INFO:tasks.workunit.client.1.smithi064.stdout:3/197: dwrite d1/d14/f3b [0,4194304] 0 2024-04-26T21:07:56.596 INFO:tasks.workunit.client.0.smithi055.stdout:6/111: dwrite d3/f15 [0,4194304] 0 2024-04-26T21:07:56.597 INFO:tasks.workunit.client.0.smithi055.stdout:6/112: fdatasync d3/f12 0 2024-04-26T21:07:56.597 INFO:tasks.workunit.client.0.smithi055.stdout:7/91: dwrite d5/d6/ff [0,4194304] 0 2024-04-26T21:07:56.598 INFO:tasks.workunit.client.1.smithi064.stdout:7/224: creat d6/db/d1f/f4c x:0 0 0 2024-04-26T21:07:56.600 INFO:tasks.workunit.client.1.smithi064.stdout:9/245: write d0/d4/d7/f2e [463749,100607] 0 2024-04-26T21:07:56.601 INFO:tasks.workunit.client.1.smithi064.stdout:8/200: mkdir d10/d41 0 2024-04-26T21:07:56.612 INFO:tasks.workunit.client.1.smithi064.stdout:3/198: dread d1/f1b [0,4194304] 0 2024-04-26T21:07:56.614 INFO:tasks.workunit.client.1.smithi064.stdout:2/209: mkdir d12/d28/d3a/d46 0 2024-04-26T21:07:56.615 INFO:tasks.workunit.client.1.smithi064.stdout:2/210: write d12/d16/d29/f2d [1250029,67631] 0 2024-04-26T21:07:56.615 INFO:tasks.workunit.client.1.smithi064.stdout:2/211: fsync d12/d1a/f42 0 2024-04-26T21:07:56.619 INFO:tasks.workunit.client.1.smithi064.stdout:6/160: unlink d4/d7/c1a 0 2024-04-26T21:07:56.619 INFO:tasks.workunit.client.1.smithi064.stdout:6/161: truncate d4/d7/f1f 18863 0 2024-04-26T21:07:56.620 INFO:tasks.workunit.client.1.smithi064.stdout:5/208: mknod dd/d12/d18/d1a/c41 0 2024-04-26T21:07:56.626 INFO:tasks.workunit.client.0.smithi055.stdout:1/71: dwrite d8/f12 [0,4194304] 0 2024-04-26T21:07:56.631 INFO:tasks.workunit.client.0.smithi055.stdout:9/69: dwrite d2/f4 [0,4194304] 0 2024-04-26T21:07:56.631 INFO:tasks.workunit.client.0.smithi055.stdout:9/70: fdatasync d2/f8 0 2024-04-26T21:07:56.632 INFO:tasks.workunit.client.1.smithi064.stdout:4/264: dwrite d0/d1d/d17/d44/f53 [0,4194304] 0 2024-04-26T21:07:56.634 INFO:tasks.workunit.client.0.smithi055.stdout:0/126: rename d9/dc/f12 to d9/dc/d1c/d2c/f2e 0 2024-04-26T21:07:56.634 INFO:tasks.workunit.client.0.smithi055.stdout:3/76: symlink d0/d4/d16/l1c 0 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/70: mkdir d4/d18 0 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/71: fsync d4/f6 0 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/72: readlink d4/la 0 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/73: chown d4/f9 92106736 1 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/74: chown d4 401 1 2024-04-26T21:07:56.636 INFO:tasks.workunit.client.0.smithi055.stdout:4/29: symlink d4/lc 0 2024-04-26T21:07:56.638 INFO:tasks.workunit.client.0.smithi055.stdout:2/101: mkdir d4/dc/d23 0 2024-04-26T21:07:56.640 INFO:tasks.workunit.client.1.smithi064.stdout:5/209: dread f9 [0,4194304] 0 2024-04-26T21:07:56.641 INFO:tasks.workunit.client.1.smithi064.stdout:7/225: mkdir d6/d15/d33/d4d 0 2024-04-26T21:07:56.644 INFO:tasks.workunit.client.1.smithi064.stdout:9/246: mkdir d0/d4/d28/d4f 0 2024-04-26T21:07:56.646 INFO:tasks.workunit.client.1.smithi064.stdout:8/201: mknod d10/d2f/c42 0 2024-04-26T21:07:56.646 INFO:tasks.workunit.client.1.smithi064.stdout:8/202: creat d10/d1d/f43 x:0 0 0 2024-04-26T21:07:56.649 INFO:tasks.workunit.client.1.smithi064.stdout:3/199: link d1/d27/d2c/l30 d1/l43 0 2024-04-26T21:07:56.661 INFO:tasks.workunit.client.0.smithi055.stdout:7/92: rename d5/f15 to d5/d11/f17 0 2024-04-26T21:07:56.661 INFO:tasks.workunit.client.0.smithi055.stdout:7/93: truncate d5/d6/ff 4559932 0 2024-04-26T21:07:56.661 INFO:tasks.workunit.client.0.smithi055.stdout:7/94: write d5/d11/f17 [1006930,108445] 0 2024-04-26T21:07:56.662 INFO:tasks.workunit.client.1.smithi064.stdout:6/162: creat d4/f2f x:0 0 0 2024-04-26T21:07:56.662 INFO:tasks.workunit.client.0.smithi055.stdout:0/127: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:07:56.664 INFO:tasks.workunit.client.0.smithi055.stdout:3/77: creat d0/d1/d13/f1d x:0 0 0 2024-04-26T21:07:56.668 INFO:tasks.workunit.client.0.smithi055.stdout:4/30: symlink d4/ld 0 2024-04-26T21:07:56.670 INFO:tasks.workunit.client.1.smithi064.stdout:4/265: mkdir d0/d5/d3e/d54 0 2024-04-26T21:07:56.670 INFO:tasks.workunit.client.1.smithi064.stdout:4/266: write d0/ff [5141104,50367] 0 2024-04-26T21:07:56.672 INFO:tasks.workunit.client.0.smithi055.stdout:2/102: creat d4/dc/d21/f24 x:0 0 0 2024-04-26T21:07:56.678 INFO:tasks.workunit.client.1.smithi064.stdout:5/210: mknod dd/d12/d18/d1a/d1f/c42 0 2024-04-26T21:07:56.678 INFO:tasks.workunit.client.1.smithi064.stdout:5/211: stat dd/d12/d18/d25 0 2024-04-26T21:07:56.678 INFO:tasks.workunit.client.1.smithi064.stdout:0/192: sync 2024-04-26T21:07:56.679 INFO:tasks.workunit.client.1.smithi064.stdout:1/260: sync 2024-04-26T21:07:56.679 INFO:tasks.workunit.client.1.smithi064.stdout:7/226: link d6/db/c18 d6/d15/d1c/c4e 0 2024-04-26T21:07:56.680 INFO:tasks.workunit.client.0.smithi055.stdout:7/95: write d5/d6/ff [5422422,44297] 0 2024-04-26T21:07:56.681 INFO:tasks.workunit.client.0.smithi055.stdout:0/128: unlink d9/d11/l15 0 2024-04-26T21:07:56.682 INFO:tasks.workunit.client.1.smithi064.stdout:9/247: symlink d0/d4/d28/l50 0 2024-04-26T21:07:56.686 INFO:tasks.workunit.client.1.smithi064.stdout:6/163: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:56.687 INFO:tasks.workunit.client.0.smithi055.stdout:4/31: rename l3 to d4/le 0 2024-04-26T21:07:56.687 INFO:tasks.workunit.client.0.smithi055.stdout:4/32: creat d4/ff x:0 0 0 2024-04-26T21:07:56.689 INFO:tasks.workunit.client.0.smithi055.stdout:2/103: creat d4/db/f25 x:0 0 0 2024-04-26T21:07:56.691 INFO:tasks.workunit.client.1.smithi064.stdout:5/212: getdents dd/d12/d18 0 2024-04-26T21:07:56.692 INFO:tasks.workunit.client.0.smithi055.stdout:7/96: mkdir d5/d11/d18 0 2024-04-26T21:07:56.697 INFO:tasks.workunit.client.0.smithi055.stdout:1/72: dwrite d8/f12 [0,4194304] 0 2024-04-26T21:07:56.698 INFO:tasks.workunit.client.0.smithi055.stdout:1/73: write d8/f15 [87560,63520] 0 2024-04-26T21:07:56.698 INFO:tasks.workunit.client.0.smithi055.stdout:1/74: creat d8/f19 x:0 0 0 2024-04-26T21:07:56.699 INFO:tasks.workunit.client.1.smithi064.stdout:0/193: rename dd/d34/f35 to dd/d10/d1a/d31/f37 0 2024-04-26T21:07:56.714 INFO:tasks.workunit.client.1.smithi064.stdout:1/261: link d0/d6/d11/d1e/d27/f2f d0/f4d 0 2024-04-26T21:07:56.716 INFO:tasks.workunit.client.0.smithi055.stdout:4/33: symlink d4/l10 0 2024-04-26T21:07:56.718 INFO:tasks.workunit.client.0.smithi055.stdout:2/104: truncate d4/ff 3751369 0 2024-04-26T21:07:56.721 INFO:tasks.workunit.client.0.smithi055.stdout:0/129: dread f8 [0,4194304] 0 2024-04-26T21:07:56.721 INFO:tasks.workunit.client.0.smithi055.stdout:0/130: truncate d9/dc/f10 4411492 0 2024-04-26T21:07:56.722 INFO:tasks.workunit.client.0.smithi055.stdout:7/97: mknod d5/d6/c19 0 2024-04-26T21:07:56.722 INFO:tasks.workunit.client.0.smithi055.stdout:0/131: write d9/dc/d1c/f29 [104167,111885] 0 2024-04-26T21:07:56.723 INFO:tasks.workunit.client.1.smithi064.stdout:6/164: symlink d4/d7/d12/d1e/l30 0 2024-04-26T21:07:56.723 INFO:tasks.workunit.client.1.smithi064.stdout:9/248: mkdir d0/d4/d7/d51 0 2024-04-26T21:07:56.725 INFO:tasks.workunit.client.1.smithi064.stdout:3/200: dwrite d1/f1b [4194304,4194304] 0 2024-04-26T21:07:56.725 INFO:tasks.workunit.client.0.smithi055.stdout:1/75: write f6 [4041615,124606] 0 2024-04-26T21:07:56.726 INFO:tasks.workunit.client.0.smithi055.stdout:2/105: mkdir d4/db/d26 0 2024-04-26T21:07:56.726 INFO:tasks.workunit.client.0.smithi055.stdout:2/106: chown c3 16576798 1 2024-04-26T21:07:56.727 INFO:tasks.workunit.client.1.smithi064.stdout:1/262: write d0/d6/d11/d1e/f20 [1712037,120128] 0 2024-04-26T21:07:56.727 INFO:tasks.workunit.client.1.smithi064.stdout:4/267: dwrite d0/d1d/f1b [0,4194304] 0 2024-04-26T21:07:56.727 INFO:tasks.workunit.client.1.smithi064.stdout:4/268: write d0/d5/d2a/f4b [803716,130627] 0 2024-04-26T21:07:56.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/249: mknod d0/d4/da/d26/c52 0 2024-04-26T21:07:56.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/250: write d0/f3b [1808760,39071] 0 2024-04-26T21:07:56.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/251: chown d0/d4/d7/f9 13 1 2024-04-26T21:07:56.731 INFO:tasks.workunit.client.1.smithi064.stdout:9/252: dread - d0/d4/da/d31/d34/f49 zero size 2024-04-26T21:07:56.731 INFO:tasks.workunit.client.1.smithi064.stdout:9/253: write d0/f18 [1593129,17997] 0 2024-04-26T21:07:56.731 INFO:tasks.workunit.client.0.smithi055.stdout:9/71: dwrite d2/f4 [0,4194304] 0 2024-04-26T21:07:56.732 INFO:tasks.workunit.client.0.smithi055.stdout:7/98: creat d5/d11/f1a x:0 0 0 2024-04-26T21:07:56.733 INFO:tasks.workunit.client.1.smithi064.stdout:6/165: creat d4/f31 x:0 0 0 2024-04-26T21:07:56.736 INFO:tasks.workunit.client.0.smithi055.stdout:0/132: mknod d9/d27/c2f 0 2024-04-26T21:07:56.736 INFO:tasks.workunit.client.0.smithi055.stdout:0/133: chown d9/d27 52 1 2024-04-26T21:07:56.738 INFO:tasks.workunit.client.0.smithi055.stdout:1/76: symlink d8/l1a 0 2024-04-26T21:07:56.738 INFO:tasks.workunit.client.0.smithi055.stdout:1/77: read - d8/df/f10 zero size 2024-04-26T21:07:56.739 INFO:tasks.workunit.client.0.smithi055.stdout:2/107: dread d4/d14/f20 [0,4194304] 0 2024-04-26T21:07:56.739 INFO:tasks.workunit.client.0.smithi055.stdout:2/108: getdents d4 0 2024-04-26T21:07:56.740 INFO:tasks.workunit.client.1.smithi064.stdout:0/194: dread dd/d21/f36 [0,4194304] 0 2024-04-26T21:07:56.743 INFO:tasks.workunit.client.1.smithi064.stdout:1/263: unlink d0/d6/d11/d1e/f42 0 2024-04-26T21:07:56.743 INFO:tasks.workunit.client.0.smithi055.stdout:9/72: mkdir d2/d11/d15 0 2024-04-26T21:07:56.744 INFO:tasks.workunit.client.1.smithi064.stdout:6/166: creat d4/f32 x:0 0 0 2024-04-26T21:07:56.745 INFO:tasks.workunit.client.0.smithi055.stdout:3/78: dwrite d0/de/f17 [0,4194304] 0 2024-04-26T21:07:56.747 INFO:tasks.workunit.client.1.smithi064.stdout:7/227: dwrite d6/d9/f37 [0,4194304] 0 2024-04-26T21:07:56.748 INFO:tasks.workunit.client.1.smithi064.stdout:7/228: creat d6/d15/d1c/d45/f4f x:0 0 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/264: unlink d0/d6/d11/d1e/d2a/d34/f3a 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/265: write d0/d22/f2b [902598,79429] 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/266: readlink d0/d6/dd/l1a 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/267: fdatasync d0/d22/f3c 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/268: dread - d0/d6/d11/f35 zero size 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:1/269: truncate d0/d6/d11/d2c/f47 409505 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:8/203: dwrite d10/d1d/f43 [0,4194304] 0 2024-04-26T21:07:56.750 INFO:tasks.workunit.client.1.smithi064.stdout:9/254: dread d0/d4/da/fc [0,4194304] 0 2024-04-26T21:07:56.754 INFO:tasks.workunit.client.1.smithi064.stdout:6/167: unlink d4/d7/l11 0 2024-04-26T21:07:56.754 INFO:tasks.workunit.client.0.smithi055.stdout:9/73: mknod d2/d14/c16 0 2024-04-26T21:07:56.758 INFO:tasks.workunit.client.0.smithi055.stdout:1/78: dread f1 [0,4194304] 0 2024-04-26T21:07:56.768 INFO:tasks.workunit.client.1.smithi064.stdout:7/229: mkdir d6/db/d1f/d50 0 2024-04-26T21:07:56.768 INFO:tasks.workunit.client.0.smithi055.stdout:3/79: mknod d0/d4/d16/c1e 0 2024-04-26T21:07:56.770 INFO:tasks.workunit.client.0.smithi055.stdout:2/109: dread d4/dc/f18 [0,4194304] 0 2024-04-26T21:07:56.779 INFO:tasks.workunit.client.0.smithi055.stdout:4/34: rmdir d4 39 2024-04-26T21:07:56.779 INFO:tasks.workunit.client.0.smithi055.stdout:4/35: read - d4/ff zero size 2024-04-26T21:07:56.787 INFO:tasks.workunit.client.1.smithi064.stdout:1/270: rmdir d0/d6/d11/d1e/d2a 39 2024-04-26T21:07:56.788 INFO:tasks.workunit.client.1.smithi064.stdout:1/271: fdatasync d0/d6/d11/d1e/d2a/d34/f36 0 2024-04-26T21:07:56.788 INFO:tasks.workunit.client.1.smithi064.stdout:1/272: stat d0/d6/l3b 0 2024-04-26T21:07:56.794 INFO:tasks.workunit.client.1.smithi064.stdout:4/269: dwrite d0/d1d/f49 [0,4194304] 0 2024-04-26T21:07:56.794 INFO:tasks.workunit.client.1.smithi064.stdout:4/270: write d0/d5/d2a/f4b [1758233,90668] 0 2024-04-26T21:07:56.795 INFO:tasks.workunit.client.1.smithi064.stdout:6/168: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:56.801 INFO:tasks.workunit.client.0.smithi055.stdout:0/134: rmdir d9 39 2024-04-26T21:07:56.804 INFO:tasks.workunit.client.1.smithi064.stdout:0/195: dwrite fc [0,4194304] 0 2024-04-26T21:07:56.804 INFO:tasks.workunit.client.1.smithi064.stdout:0/196: truncate dd/f14 1032328 0 2024-04-26T21:07:56.805 INFO:tasks.workunit.client.0.smithi055.stdout:9/74: mknod d2/d14/c17 0 2024-04-26T21:07:56.805 INFO:tasks.workunit.client.0.smithi055.stdout:9/75: truncate d2/f4 4383357 0 2024-04-26T21:07:56.805 INFO:tasks.workunit.client.0.smithi055.stdout:9/76: dread - d2/f13 zero size 2024-04-26T21:07:56.808 INFO:tasks.workunit.client.0.smithi055.stdout:1/79: mkdir d8/d17/d1b 0 2024-04-26T21:07:56.809 INFO:tasks.workunit.client.1.smithi064.stdout:3/201: dwrite d1/d14/f31 [0,4194304] 0 2024-04-26T21:07:56.809 INFO:tasks.workunit.client.1.smithi064.stdout:3/202: chown d1/da/l33 84964 1 2024-04-26T21:07:56.809 INFO:tasks.workunit.client.1.smithi064.stdout:3/203: write d1/f11 [299868,60550] 0 2024-04-26T21:07:56.811 INFO:tasks.workunit.client.1.smithi064.stdout:9/255: creat d0/d4/f53 x:0 0 0 2024-04-26T21:07:56.812 INFO:tasks.workunit.client.0.smithi055.stdout:3/80: mknod d0/d4/d5/c1f 0 2024-04-26T21:07:56.814 INFO:tasks.workunit.client.1.smithi064.stdout:8/204: getdents d10/d31 0 2024-04-26T21:07:56.817 INFO:tasks.workunit.client.0.smithi055.stdout:2/110: rename d4/c10 to d4/db/d26/c27 0 2024-04-26T21:07:56.818 INFO:tasks.workunit.client.1.smithi064.stdout:1/273: mknod d0/d6/c4e 0 2024-04-26T21:07:56.820 INFO:tasks.workunit.client.0.smithi055.stdout:4/36: creat d4/f11 x:0 0 0 2024-04-26T21:07:56.823 INFO:tasks.workunit.client.0.smithi055.stdout:9/77: rmdir d2/d11 39 2024-04-26T21:07:56.827 INFO:tasks.workunit.client.1.smithi064.stdout:1/274: dread d0/d22/f38 [0,4194304] 0 2024-04-26T21:07:56.828 INFO:tasks.workunit.client.1.smithi064.stdout:6/169: mkdir d4/d7/d33 0 2024-04-26T21:07:56.828 INFO:tasks.workunit.client.1.smithi064.stdout:1/275: readlink d0/l8 0 2024-04-26T21:07:56.828 INFO:tasks.workunit.client.1.smithi064.stdout:1/276: chown d0/d6/d11/d1e 2170524 1 2024-04-26T21:07:56.828 INFO:tasks.workunit.client.1.smithi064.stdout:7/230: dwrite d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:07:56.829 INFO:tasks.workunit.client.0.smithi055.stdout:3/81: mknod d0/d1/d13/c20 0 2024-04-26T21:07:56.829 INFO:tasks.workunit.client.0.smithi055.stdout:3/82: read - d0/d1/d13/f1d zero size 2024-04-26T21:07:56.829 INFO:tasks.workunit.client.0.smithi055.stdout:0/135: dread d9/fa [4194304,4194304] 0 2024-04-26T21:07:56.830 INFO:tasks.workunit.client.0.smithi055.stdout:0/136: read d9/dc/f10 [4284887,69566] 0 2024-04-26T21:07:56.831 INFO:tasks.workunit.client.1.smithi064.stdout:0/197: rename dd/d10/d18/f19 to dd/d1c/d1d/f38 0 2024-04-26T21:07:56.831 INFO:tasks.workunit.client.1.smithi064.stdout:0/198: write dd/d10/d1a/d31/f37 [1438762,116664] 0 2024-04-26T21:07:56.834 INFO:tasks.workunit.client.1.smithi064.stdout:7/231: dread d6/d9/f30 [0,4194304] 0 2024-04-26T21:07:56.834 INFO:tasks.workunit.client.0.smithi055.stdout:2/111: truncate d4/dc/f11 2472318 0 2024-04-26T21:07:56.836 INFO:tasks.workunit.client.1.smithi064.stdout:4/271: dwrite d0/d1d/f2e [0,4194304] 0 2024-04-26T21:07:56.836 INFO:tasks.workunit.client.1.smithi064.stdout:4/272: truncate d0/d5/d13/d10/f2b 1853330 0 2024-04-26T21:07:56.836 INFO:tasks.workunit.client.1.smithi064.stdout:4/273: write d0/d5/d13/f3d [228702,89875] 0 2024-04-26T21:07:56.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/274: fsync d0/d5/d13/d10/f4c 0 2024-04-26T21:07:56.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/275: fdatasync d0/d5/d13/d10/f2b 0 2024-04-26T21:07:56.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/276: write d0/d5/d13/d10/f2b [2495088,37748] 0 2024-04-26T21:07:56.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/277: fdatasync d0/d1d/f2e 0 2024-04-26T21:07:56.839 INFO:tasks.workunit.client.1.smithi064.stdout:2/212: sync 2024-04-26T21:07:56.839 INFO:tasks.workunit.client.0.smithi055.stdout:4/37: mkdir d4/d12 0 2024-04-26T21:07:56.839 INFO:tasks.workunit.client.0.smithi055.stdout:4/38: fdatasync d4/f8 0 2024-04-26T21:07:56.842 INFO:tasks.workunit.client.0.smithi055.stdout:9/78: rmdir d2/d11/d15 0 2024-04-26T21:07:56.842 INFO:tasks.workunit.client.1.smithi064.stdout:3/204: creat d1/d12/f44 x:0 0 0 2024-04-26T21:07:56.844 INFO:tasks.workunit.client.1.smithi064.stdout:9/256: creat d0/d4/d7/f54 x:0 0 0 2024-04-26T21:07:56.847 INFO:tasks.workunit.client.0.smithi055.stdout:3/83: creat d0/d4/d5/f21 x:0 0 0 2024-04-26T21:07:56.847 INFO:tasks.workunit.client.0.smithi055.stdout:8/49: sync 2024-04-26T21:07:56.847 INFO:tasks.workunit.client.0.smithi055.stdout:3/84: write d0/f19 [1006835,95827] 0 2024-04-26T21:07:56.851 INFO:tasks.workunit.client.0.smithi055.stdout:0/137: creat d9/dc/d17/f30 x:0 0 0 2024-04-26T21:07:56.851 INFO:tasks.workunit.client.0.smithi055.stdout:0/138: readlink d9/l14 0 2024-04-26T21:07:56.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/170: creat d4/d7/d33/f34 x:0 0 0 2024-04-26T21:07:56.854 INFO:tasks.workunit.client.1.smithi064.stdout:1/277: creat d0/d6/d11/d1e/f4f x:0 0 0 2024-04-26T21:07:56.861 INFO:tasks.workunit.client.1.smithi064.stdout:1/278: dread d0/d6/d11/d1e/d27/f2f [0,4194304] 0 2024-04-26T21:07:56.862 INFO:tasks.workunit.client.0.smithi055.stdout:9/79: getdents d2 0 2024-04-26T21:07:56.864 INFO:tasks.workunit.client.0.smithi055.stdout:7/99: dwrite d5/d6/ff [4194304,4194304] 0 2024-04-26T21:07:56.864 INFO:tasks.workunit.client.0.smithi055.stdout:8/50: dread f1 [0,4194304] 0 2024-04-26T21:07:56.864 INFO:tasks.workunit.client.0.smithi055.stdout:8/51: creat d3/f14 x:0 0 0 2024-04-26T21:07:56.872 INFO:tasks.workunit.client.0.smithi055.stdout:4/39: getdents d4 0 2024-04-26T21:07:56.872 INFO:tasks.workunit.client.0.smithi055.stdout:9/80: rename d2/la to d2/d14/l18 0 2024-04-26T21:07:56.881 INFO:tasks.workunit.client.0.smithi055.stdout:8/52: truncate f2 2582123 0 2024-04-26T21:07:56.882 INFO:tasks.workunit.client.0.smithi055.stdout:4/40: rmdir d4 39 2024-04-26T21:07:56.886 INFO:tasks.workunit.client.0.smithi055.stdout:7/100: rename d5/db/l10 to d5/l1b 0 2024-04-26T21:07:56.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/171: dwrite d4/d7/d33/f34 [0,4194304] 0 2024-04-26T21:07:56.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/172: dread - d4/f31 zero size 2024-04-26T21:07:56.894 INFO:tasks.workunit.client.1.smithi064.stdout:5/213: sync 2024-04-26T21:07:56.895 INFO:tasks.workunit.client.0.smithi055.stdout:8/53: link d3/c7 d3/d9/c15 0 2024-04-26T21:07:56.895 INFO:tasks.workunit.client.0.smithi055.stdout:4/41: creat d4/f13 x:0 0 0 2024-04-26T21:07:56.895 INFO:tasks.workunit.client.1.smithi064.stdout:2/213: getdents d12/d41 0 2024-04-26T21:07:56.897 INFO:tasks.workunit.client.1.smithi064.stdout:3/205: mknod d1/d27/d29/c45 0 2024-04-26T21:07:56.898 INFO:tasks.workunit.client.1.smithi064.stdout:9/257: symlink d0/d4/da/l55 0 2024-04-26T21:07:56.899 INFO:tasks.workunit.client.0.smithi055.stdout:9/81: symlink d2/d14/l19 0 2024-04-26T21:07:56.902 INFO:tasks.workunit.client.0.smithi055.stdout:4/42: symlink d4/l14 0 2024-04-26T21:07:56.904 INFO:tasks.workunit.client.0.smithi055.stdout:9/82: creat d2/f1a x:0 0 0 2024-04-26T21:07:56.906 INFO:tasks.workunit.client.0.smithi055.stdout:1/80: dwrite d8/df/f10 [0,4194304] 0 2024-04-26T21:07:56.906 INFO:tasks.workunit.client.1.smithi064.stdout:6/173: read d4/f16 [2339072,117090] 0 2024-04-26T21:07:56.907 INFO:tasks.workunit.client.1.smithi064.stdout:5/214: dread dd/f16 [0,4194304] 0 2024-04-26T21:07:56.908 INFO:tasks.workunit.client.1.smithi064.stdout:8/205: getdents d10/d1d 0 2024-04-26T21:07:56.909 INFO:tasks.workunit.client.0.smithi055.stdout:9/83: stat d2/f4 0 2024-04-26T21:07:56.910 INFO:tasks.workunit.client.1.smithi064.stdout:1/279: unlink d0/d22/c33 0 2024-04-26T21:07:56.913 INFO:tasks.workunit.client.1.smithi064.stdout:7/232: rename f3 to d6/f51 0 2024-04-26T21:07:56.915 INFO:tasks.workunit.client.0.smithi055.stdout:1/81: getdents d8/df/d11 0 2024-04-26T21:07:56.917 INFO:tasks.workunit.client.1.smithi064.stdout:2/214: mknod d12/c47 0 2024-04-26T21:07:56.922 INFO:tasks.workunit.client.1.smithi064.stdout:9/258: link d0/d4/d7/f2e d0/f56 0 2024-04-26T21:07:56.922 INFO:tasks.workunit.client.1.smithi064.stdout:5/215: getdents dd/d12/d18/d1a 0 2024-04-26T21:07:56.923 INFO:tasks.workunit.client.0.smithi055.stdout:1/82: rmdir d8/df 39 2024-04-26T21:07:56.924 INFO:tasks.workunit.client.1.smithi064.stdout:1/280: creat d0/d6/d11/d1e/d27/f50 x:0 0 0 2024-04-26T21:07:56.925 INFO:tasks.workunit.client.1.smithi064.stdout:0/199: rmdir dd/d34 0 2024-04-26T21:07:56.926 INFO:tasks.workunit.client.0.smithi055.stdout:1/83: link l3 d8/df/d11/l1c 0 2024-04-26T21:07:56.928 INFO:tasks.workunit.client.0.smithi055.stdout:1/84: mknod d8/df/c1d 0 2024-04-26T21:07:56.928 INFO:tasks.workunit.client.0.smithi055.stdout:1/85: chown d8/f15 0 1 2024-04-26T21:07:56.928 INFO:tasks.workunit.client.0.smithi055.stdout:1/86: chown d8/l1a 1764 1 2024-04-26T21:07:56.929 INFO:tasks.workunit.client.1.smithi064.stdout:1/281: read d0/d6/f19 [1797100,59920] 0 2024-04-26T21:07:56.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/215: mkdir d12/d28/d3a/d46/d48 0 2024-04-26T21:07:56.930 INFO:tasks.workunit.client.1.smithi064.stdout:3/206: rmdir d1/da 39 2024-04-26T21:07:56.933 INFO:tasks.workunit.client.1.smithi064.stdout:9/259: getdents d0/d4/da/d26 0 2024-04-26T21:07:56.933 INFO:tasks.workunit.client.1.smithi064.stdout:5/216: symlink dd/d12/d18/d1a/d1b/l43 0 2024-04-26T21:07:56.933 INFO:tasks.workunit.client.1.smithi064.stdout:9/260: fsync d0/d4/d7/f46 0 2024-04-26T21:07:56.934 INFO:tasks.workunit.client.1.smithi064.stdout:9/261: readlink d0/d4/l36 0 2024-04-26T21:07:56.938 INFO:tasks.workunit.client.1.smithi064.stdout:0/200: mknod dd/d10/c39 0 2024-04-26T21:07:56.938 INFO:tasks.workunit.client.1.smithi064.stdout:1/282: truncate d0/d6/d11/d1e/f43 2986729 0 2024-04-26T21:07:56.938 INFO:tasks.workunit.client.1.smithi064.stdout:1/283: readlink d0/d6/dd/l1c 0 2024-04-26T21:07:56.938 INFO:tasks.workunit.client.1.smithi064.stdout:1/284: chown d0/f1f 4 1 2024-04-26T21:07:56.938 INFO:tasks.workunit.client.1.smithi064.stdout:3/207: mknod d1/da/d22/d26/c46 0 2024-04-26T21:07:56.939 INFO:tasks.workunit.client.1.smithi064.stdout:0/201: getdents dd/d21 0 2024-04-26T21:07:56.940 INFO:tasks.workunit.client.1.smithi064.stdout:3/208: stat d1/d12/l15 0 2024-04-26T21:07:56.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/285: rmdir d0/d6/d29 39 2024-04-26T21:07:56.941 INFO:tasks.workunit.client.0.smithi055.stdout:0/139: dwrite d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:07:56.944 INFO:tasks.workunit.client.0.smithi055.stdout:1/87: truncate d8/df/f10 189313 0 2024-04-26T21:07:56.945 INFO:tasks.workunit.client.0.smithi055.stdout:4/43: dread d4/f8 [0,4194304] 0 2024-04-26T21:07:56.945 INFO:tasks.workunit.client.1.smithi064.stdout:3/209: creat d1/d38/f47 x:0 0 0 2024-04-26T21:07:56.945 INFO:tasks.workunit.client.1.smithi064.stdout:3/210: chown d1/l3 5680511 1 2024-04-26T21:07:56.946 INFO:tasks.workunit.client.1.smithi064.stdout:3/211: write d1/fc [1293106,84217] 0 2024-04-26T21:07:56.947 INFO:tasks.workunit.client.1.smithi064.stdout:6/174: dwrite d4/f31 [0,4194304] 0 2024-04-26T21:07:56.947 INFO:tasks.workunit.client.1.smithi064.stdout:6/175: chown d4/d7/d12/d1e 5154 1 2024-04-26T21:07:56.947 INFO:tasks.workunit.client.1.smithi064.stdout:6/176: creat d4/d7/f35 x:0 0 0 2024-04-26T21:07:56.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/112: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:07:56.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/140: getdents d9/d27 0 2024-04-26T21:07:56.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/141: chown d9 0 1 2024-04-26T21:07:56.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/142: fsync d9/dc/f10 0 2024-04-26T21:07:56.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/143: write d9/dc/d1c/f26 [839723,72289] 0 2024-04-26T21:07:56.954 INFO:tasks.workunit.client.1.smithi064.stdout:6/177: symlink d4/d7/d33/l36 0 2024-04-26T21:07:56.955 INFO:tasks.workunit.client.1.smithi064.stdout:4/278: sync 2024-04-26T21:07:56.956 INFO:tasks.workunit.client.1.smithi064.stdout:4/279: creat d0/d1d/d17/f55 x:0 0 0 2024-04-26T21:07:56.956 INFO:tasks.workunit.client.1.smithi064.stdout:4/280: chown d0/d5/d13 3 1 2024-04-26T21:07:56.956 INFO:tasks.workunit.client.1.smithi064.stdout:4/281: chown d0/d1d/c24 15 1 2024-04-26T21:07:56.956 INFO:tasks.workunit.client.1.smithi064.stdout:4/282: truncate d0/d1d/d21/f4e 159296 0 2024-04-26T21:07:56.956 INFO:tasks.workunit.client.1.smithi064.stdout:2/216: read d12/d28/f37 [695212,35190] 0 2024-04-26T21:07:56.958 INFO:tasks.workunit.client.1.smithi064.stdout:4/283: read d0/d5/d2a/f4b [1244188,13963] 0 2024-04-26T21:07:56.959 INFO:tasks.workunit.client.0.smithi055.stdout:0/144: creat d9/f31 x:0 0 0 2024-04-26T21:07:56.963 INFO:tasks.workunit.client.1.smithi064.stdout:6/178: rename d4/l22 to d4/d7/d12/d1e/l37 0 2024-04-26T21:07:56.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/145: rename d9/f31 to d9/f32 0 2024-04-26T21:07:56.967 INFO:tasks.workunit.client.1.smithi064.stdout:2/217: creat d12/d16/d29/f49 x:0 0 0 2024-04-26T21:07:56.968 INFO:tasks.workunit.client.1.smithi064.stdout:2/218: write d12/d28/f3f [468091,116103] 0 2024-04-26T21:07:56.969 INFO:tasks.workunit.client.1.smithi064.stdout:3/212: write d1/da/d35/f36 [3465361,74862] 0 2024-04-26T21:07:56.969 INFO:tasks.workunit.client.1.smithi064.stdout:6/179: mkdir d4/d7/d12/d38 0 2024-04-26T21:07:56.971 INFO:tasks.workunit.client.0.smithi055.stdout:0/146: mknod d9/dc/c33 0 2024-04-26T21:07:56.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/147: mkdir d9/dc/d17/d34 0 2024-04-26T21:07:56.974 INFO:tasks.workunit.client.1.smithi064.stdout:1/286: write d0/d6/d11/f1d [2977481,110762] 0 2024-04-26T21:07:56.975 INFO:tasks.workunit.client.0.smithi055.stdout:0/148: rmdir d9/d11 39 2024-04-26T21:07:56.977 INFO:tasks.workunit.client.0.smithi055.stdout:1/88: unlink d8/df/f10 0 2024-04-26T21:07:56.978 INFO:tasks.workunit.client.1.smithi064.stdout:7/233: dwrite d6/d9/f1a [0,4194304] 0 2024-04-26T21:07:56.978 INFO:tasks.workunit.client.0.smithi055.stdout:0/149: rmdir d9/dc/d1c/d2c 39 2024-04-26T21:07:56.978 INFO:tasks.workunit.client.0.smithi055.stdout:0/150: truncate d9/f32 327989 0 2024-04-26T21:07:56.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/89: rename d8/df/c16 to d8/c1e 0 2024-04-26T21:07:56.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/90: write f1 [2473794,122169] 0 2024-04-26T21:07:56.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/91: chown d8/ca 5 1 2024-04-26T21:07:56.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/92: chown d8/cb 2939 1 2024-04-26T21:07:56.999 INFO:tasks.workunit.client.1.smithi064.stdout:4/284: write d0/d1d/d17/f2c [2242366,102447] 0 2024-04-26T21:07:57.013 INFO:tasks.workunit.client.1.smithi064.stdout:1/287: write d0/f12 [3155575,20882] 0 2024-04-26T21:07:57.013 INFO:tasks.workunit.client.1.smithi064.stdout:7/234: mkdir d6/db/d34/d52 0 2024-04-26T21:07:57.013 INFO:tasks.workunit.client.1.smithi064.stdout:7/235: write d6/d9/f39 [1184704,5763] 0 2024-04-26T21:07:57.013 INFO:tasks.workunit.client.1.smithi064.stdout:7/236: readlink d6/lf 0 2024-04-26T21:07:57.013 INFO:tasks.workunit.client.1.smithi064.stdout:7/237: write d6/db/d34/d41/f49 [596958,123537] 0 2024-04-26T21:07:57.014 INFO:tasks.workunit.client.1.smithi064.stdout:2/219: dread d12/d28/f35 [0,4194304] 0 2024-04-26T21:07:57.014 INFO:tasks.workunit.client.1.smithi064.stdout:2/220: stat d12/d28/f37 0 2024-04-26T21:07:57.014 INFO:tasks.workunit.client.1.smithi064.stdout:2/221: chown d12/d28/d3a/d46 415 1 2024-04-26T21:07:57.015 INFO:tasks.workunit.client.1.smithi064.stdout:0/202: dread dd/d10/f16 [0,4194304] 0 2024-04-26T21:07:57.019 INFO:tasks.workunit.client.0.smithi055.stdout:9/84: write d2/f10 [1485105,118881] 0 2024-04-26T21:07:57.022 INFO:tasks.workunit.client.1.smithi064.stdout:2/222: mknod d12/d28/d3a/c4a 0 2024-04-26T21:07:57.025 INFO:tasks.workunit.client.1.smithi064.stdout:2/223: creat d12/d41/f4b x:0 0 0 2024-04-26T21:07:57.026 INFO:tasks.workunit.client.1.smithi064.stdout:2/224: creat d12/d28/f4c x:0 0 0 2024-04-26T21:07:57.026 INFO:tasks.workunit.client.1.smithi064.stdout:2/225: chown d12/l26 280798267 1 2024-04-26T21:07:57.035 INFO:tasks.workunit.client.1.smithi064.stdout:4/285: dread d0/d5/d13/d33/f39 [0,4194304] 0 2024-04-26T21:07:57.037 INFO:tasks.workunit.client.1.smithi064.stdout:4/286: mkdir d0/d1d/d56 0 2024-04-26T21:07:57.037 INFO:tasks.workunit.client.1.smithi064.stdout:4/287: chown d0/l22 11442593 1 2024-04-26T21:07:57.043 INFO:tasks.workunit.client.1.smithi064.stdout:4/288: mkdir d0/d1d/d17/d57 0 2024-04-26T21:07:57.051 INFO:tasks.workunit.client.0.smithi055.stdout:7/101: dwrite d5/db/fc [0,4194304] 0 2024-04-26T21:07:57.056 INFO:tasks.workunit.client.1.smithi064.stdout:6/180: dwrite d4/d7/f2c [0,4194304] 0 2024-04-26T21:07:57.056 INFO:tasks.workunit.client.1.smithi064.stdout:6/181: chown d4/d7/c17 1629238 1 2024-04-26T21:07:57.056 INFO:tasks.workunit.client.1.smithi064.stdout:6/182: creat d4/d7/d12/d1e/f39 x:0 0 0 2024-04-26T21:07:57.059 INFO:tasks.workunit.client.1.smithi064.stdout:6/183: rename d4/f32 to d4/d7/f3a 0 2024-04-26T21:07:57.060 INFO:tasks.workunit.client.1.smithi064.stdout:6/184: creat d4/d7/f3b x:0 0 0 2024-04-26T21:07:57.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/289: read d0/d1d/f2e [1635114,81924] 0 2024-04-26T21:07:57.063 INFO:tasks.workunit.client.1.smithi064.stdout:4/290: creat d0/d5/d3e/d54/f58 x:0 0 0 2024-04-26T21:07:57.063 INFO:tasks.workunit.client.1.smithi064.stdout:4/291: creat d0/d5/d2a/f59 x:0 0 0 2024-04-26T21:07:57.065 INFO:tasks.workunit.client.1.smithi064.stdout:5/217: dwrite dd/d12/d18/f2f [0,4194304] 0 2024-04-26T21:07:57.071 INFO:tasks.workunit.client.0.smithi055.stdout:8/54: dwrite d3/f5 [0,4194304] 0 2024-04-26T21:07:57.071 INFO:tasks.workunit.client.0.smithi055.stdout:8/55: readlink d3/d9/l13 0 2024-04-26T21:07:57.072 INFO:tasks.workunit.client.0.smithi055.stdout:8/56: unlink d3/f12 0 2024-04-26T21:07:57.072 INFO:tasks.workunit.client.0.smithi055.stdout:8/57: write d3/f14 [73217,50945] 0 2024-04-26T21:07:57.073 INFO:tasks.workunit.client.0.smithi055.stdout:8/58: mknod d3/d9/c16 0 2024-04-26T21:07:57.073 INFO:tasks.workunit.client.0.smithi055.stdout:8/59: creat d3/f17 x:0 0 0 2024-04-26T21:07:57.074 INFO:tasks.workunit.client.1.smithi064.stdout:0/203: dwrite dd/d10/d1a/d31/f37 [0,4194304] 0 2024-04-26T21:07:57.075 INFO:tasks.workunit.client.0.smithi055.stdout:4/44: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:07:57.077 INFO:tasks.workunit.client.0.smithi055.stdout:2/113: dwrite d4/db/f25 [0,4194304] 0 2024-04-26T21:07:57.078 INFO:tasks.workunit.client.0.smithi055.stdout:8/60: rename d3/f5 to d3/f18 0 2024-04-26T21:07:57.078 INFO:tasks.workunit.client.0.smithi055.stdout:8/61: chown d3/c7 4519134 1 2024-04-26T21:07:57.078 INFO:tasks.workunit.client.0.smithi055.stdout:8/62: write f2 [2585699,57786] 0 2024-04-26T21:07:57.078 INFO:tasks.workunit.client.0.smithi055.stdout:0/151: dwrite d9/dc/d17/f30 [0,4194304] 0 2024-04-26T21:07:57.079 INFO:tasks.workunit.client.1.smithi064.stdout:1/288: dwrite d0/f3 [8388608,4194304] 0 2024-04-26T21:07:57.079 INFO:tasks.workunit.client.1.smithi064.stdout:1/289: creat d0/d6/d29/d31/f51 x:0 0 0 2024-04-26T21:07:57.081 INFO:tasks.workunit.client.1.smithi064.stdout:7/238: truncate d6/d9/f39 1140928 0 2024-04-26T21:07:57.085 INFO:tasks.workunit.client.1.smithi064.stdout:2/226: rmdir d12/d41 39 2024-04-26T21:07:57.087 INFO:tasks.workunit.client.1.smithi064.stdout:0/204: creat dd/d21/f3a x:0 0 0 2024-04-26T21:07:57.092 INFO:tasks.workunit.client.1.smithi064.stdout:1/290: creat d0/d6/f52 x:0 0 0 2024-04-26T21:07:57.096 INFO:tasks.workunit.client.1.smithi064.stdout:0/205: unlink dd/d10/d1a/l25 0 2024-04-26T21:07:57.096 INFO:tasks.workunit.client.0.smithi055.stdout:1/93: dwrite d8/f15 [0,4194304] 0 2024-04-26T21:07:57.099 INFO:tasks.workunit.client.1.smithi064.stdout:1/291: unlink d0/d22/f38 0 2024-04-26T21:07:57.099 INFO:tasks.workunit.client.1.smithi064.stdout:1/292: dread - d0/d6/d29/d31/f4c zero size 2024-04-26T21:07:57.099 INFO:tasks.workunit.client.1.smithi064.stdout:1/293: dread - d0/d6/d11/d1e/f4f zero size 2024-04-26T21:07:57.103 INFO:tasks.workunit.client.1.smithi064.stdout:1/294: creat d0/d6/d11/d1e/d2a/d34/f53 x:0 0 0 2024-04-26T21:07:57.105 INFO:tasks.workunit.client.0.smithi055.stdout:0/152: creat d9/d11/f35 x:0 0 0 2024-04-26T21:07:57.108 INFO:tasks.workunit.client.0.smithi055.stdout:1/94: symlink d8/df/d11/l1f 0 2024-04-26T21:07:57.115 INFO:tasks.workunit.client.0.smithi055.stdout:0/153: creat d9/dc/d17/d34/f36 x:0 0 0 2024-04-26T21:07:57.116 INFO:tasks.workunit.client.0.smithi055.stdout:1/95: creat d8/d17/d1b/f20 x:0 0 0 2024-04-26T21:07:57.116 INFO:tasks.workunit.client.1.smithi064.stdout:9/262: dwrite d0/d4/f24 [0,4194304] 0 2024-04-26T21:07:57.117 INFO:tasks.workunit.client.1.smithi064.stdout:9/263: write d0/d4/d7/f54 [67971,56238] 0 2024-04-26T21:07:57.119 INFO:tasks.workunit.client.0.smithi055.stdout:0/154: link d9/dc/d1c/f26 d9/d27/f37 0 2024-04-26T21:07:57.121 INFO:tasks.workunit.client.0.smithi055.stdout:1/96: mknod d8/df/c21 0 2024-04-26T21:07:57.122 INFO:tasks.workunit.client.1.smithi064.stdout:0/206: dread dd/d10/f2e [0,4194304] 0 2024-04-26T21:07:57.122 INFO:tasks.workunit.client.1.smithi064.stdout:0/207: chown dd/c13 481 1 2024-04-26T21:07:57.122 INFO:tasks.workunit.client.1.smithi064.stdout:0/208: write dd/f12 [4903186,16932] 0 2024-04-26T21:07:57.123 INFO:tasks.workunit.client.0.smithi055.stdout:0/155: rmdir d9/dc/d1c 39 2024-04-26T21:07:57.128 INFO:tasks.workunit.client.0.smithi055.stdout:1/97: rename d8/df/c21 to d8/d17/d1b/c22 0 2024-04-26T21:07:57.129 INFO:tasks.workunit.client.1.smithi064.stdout:1/295: write d0/d6/d11/f1d [7402655,112503] 0 2024-04-26T21:07:57.141 INFO:tasks.workunit.client.0.smithi055.stdout:0/156: unlink d9/d11/c23 0 2024-04-26T21:07:57.141 INFO:tasks.workunit.client.0.smithi055.stdout:0/157: chown d9/dc/f10 21682 1 2024-04-26T21:07:57.141 INFO:tasks.workunit.client.0.smithi055.stdout:0/158: fsync d9/dc/d17/f30 0 2024-04-26T21:07:57.145 INFO:tasks.workunit.client.1.smithi064.stdout:4/292: dread d0/ff [0,4194304] 0 2024-04-26T21:07:57.151 INFO:tasks.workunit.client.0.smithi055.stdout:7/102: dwrite d5/db/fc [0,4194304] 0 2024-04-26T21:07:57.151 INFO:tasks.workunit.client.0.smithi055.stdout:7/103: fdatasync f1 0 2024-04-26T21:07:57.152 INFO:tasks.workunit.client.0.smithi055.stdout:7/104: creat d5/db/f1c x:0 0 0 2024-04-26T21:07:57.153 INFO:tasks.workunit.client.1.smithi064.stdout:9/264: rename d0/d39/f3d to d0/d4/da/f57 0 2024-04-26T21:07:57.153 INFO:tasks.workunit.client.1.smithi064.stdout:5/218: dwrite dd/d12/d18/f2f [0,4194304] 0 2024-04-26T21:07:57.157 INFO:tasks.workunit.client.1.smithi064.stdout:1/296: link d0/f4d d0/d6/d11/d1e/f54 0 2024-04-26T21:07:57.161 INFO:tasks.workunit.client.0.smithi055.stdout:4/45: dwrite d4/ff [0,4194304] 0 2024-04-26T21:07:57.163 INFO:tasks.workunit.client.1.smithi064.stdout:6/185: dwrite d4/d7/f3b [0,4194304] 0 2024-04-26T21:07:57.166 INFO:tasks.workunit.client.1.smithi064.stdout:9/265: symlink d0/d4/l58 0 2024-04-26T21:07:57.166 INFO:tasks.workunit.client.1.smithi064.stdout:0/209: dread dd/d10/d1a/f2f [0,4194304] 0 2024-04-26T21:07:57.166 INFO:tasks.workunit.client.1.smithi064.stdout:7/239: dwrite d6/db/f2d [0,4194304] 0 2024-04-26T21:07:57.168 INFO:tasks.workunit.client.1.smithi064.stdout:2/227: dwrite d12/d41/f4b [0,4194304] 0 2024-04-26T21:07:57.172 INFO:tasks.workunit.client.0.smithi055.stdout:8/63: dwrite d3/f18 [0,4194304] 0 2024-04-26T21:07:57.173 INFO:tasks.workunit.client.1.smithi064.stdout:4/293: getdents d0/d1d 0 2024-04-26T21:07:57.174 INFO:tasks.workunit.client.0.smithi055.stdout:7/105: dread d5/f12 [0,4194304] 0 2024-04-26T21:07:57.177 INFO:tasks.workunit.client.0.smithi055.stdout:8/64: mknod d3/d9/c19 0 2024-04-26T21:07:57.177 INFO:tasks.workunit.client.0.smithi055.stdout:8/65: chown d3/d9/l13 84101471 1 2024-04-26T21:07:57.177 INFO:tasks.workunit.client.0.smithi055.stdout:8/66: fdatasync d3/d9/fe 0 2024-04-26T21:07:57.184 INFO:tasks.workunit.client.1.smithi064.stdout:6/186: creat d4/d7/d12/d38/f3c x:0 0 0 2024-04-26T21:07:57.184 INFO:tasks.workunit.client.1.smithi064.stdout:0/210: getdents dd/d1c/d1d 0 2024-04-26T21:07:57.184 INFO:tasks.workunit.client.1.smithi064.stdout:1/297: rmdir d0/d6/d11/d1e/d27 39 2024-04-26T21:07:57.189 INFO:tasks.workunit.client.0.smithi055.stdout:8/67: dread d3/f14 [0,4194304] 0 2024-04-26T21:07:57.189 INFO:tasks.workunit.client.0.smithi055.stdout:1/98: dwrite f1 [0,4194304] 0 2024-04-26T21:07:57.191 INFO:tasks.workunit.client.0.smithi055.stdout:4/46: dread d4/f8 [0,4194304] 0 2024-04-26T21:07:57.192 INFO:tasks.workunit.client.1.smithi064.stdout:2/228: dread d12/d41/f4b [0,4194304] 0 2024-04-26T21:07:57.195 INFO:tasks.workunit.client.1.smithi064.stdout:4/294: mknod d0/d1d/c5a 0 2024-04-26T21:07:57.196 INFO:tasks.workunit.client.0.smithi055.stdout:0/159: rmdir d9/d11 39 2024-04-26T21:07:57.197 INFO:tasks.workunit.client.0.smithi055.stdout:7/106: write d5/db/f14 [1613779,77610] 0 2024-04-26T21:07:57.199 INFO:tasks.workunit.client.0.smithi055.stdout:4/47: mkdir d4/d12/d15 0 2024-04-26T21:07:57.199 INFO:tasks.workunit.client.1.smithi064.stdout:0/211: mkdir dd/d1c/d1d/d3b 0 2024-04-26T21:07:57.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/298: truncate d0/d6/d11/d1e/d27/f2d 1752102 0 2024-04-26T21:07:57.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/299: dread - d0/d6/d11/d1e/f4f zero size 2024-04-26T21:07:57.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/300: creat d0/d6/d11/d2c/f55 x:0 0 0 2024-04-26T21:07:57.204 INFO:tasks.workunit.client.0.smithi055.stdout:0/160: symlink d9/dc/d17/l38 0 2024-04-26T21:07:57.204 INFO:tasks.workunit.client.0.smithi055.stdout:0/161: read d9/fa [92564,75347] 0 2024-04-26T21:07:57.207 INFO:tasks.workunit.client.0.smithi055.stdout:4/48: rmdir d4/d12 39 2024-04-26T21:07:57.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/301: read d0/d6/d11/d1e/f54 [708321,51995] 0 2024-04-26T21:07:57.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/302: creat d0/d6/d11/d1e/f56 x:0 0 0 2024-04-26T21:07:57.209 INFO:tasks.workunit.client.1.smithi064.stdout:8/206: sync 2024-04-26T21:07:57.209 INFO:tasks.workunit.client.1.smithi064.stdout:8/207: truncate d10/d1d/d38/f39 206118 0 2024-04-26T21:07:57.211 INFO:tasks.workunit.client.1.smithi064.stdout:3/213: sync 2024-04-26T21:07:57.211 INFO:tasks.workunit.client.1.smithi064.stdout:4/295: symlink d0/d1d/d17/l5b 0 2024-04-26T21:07:57.214 INFO:tasks.workunit.client.0.smithi055.stdout:5/75: sync 2024-04-26T21:07:57.214 INFO:tasks.workunit.client.0.smithi055.stdout:6/113: sync 2024-04-26T21:07:57.215 INFO:tasks.workunit.client.1.smithi064.stdout:6/187: getdents d4/d7 0 2024-04-26T21:07:57.219 INFO:tasks.workunit.client.0.smithi055.stdout:8/68: dread f1 [0,4194304] 0 2024-04-26T21:07:57.221 INFO:tasks.workunit.client.0.smithi055.stdout:4/49: creat d4/d12/d15/f16 x:0 0 0 2024-04-26T21:07:57.227 INFO:tasks.workunit.client.1.smithi064.stdout:5/219: dwrite dd/d12/d18/d1a/d1b/f3c [0,4194304] 0 2024-04-26T21:07:57.228 INFO:tasks.workunit.client.1.smithi064.stdout:5/220: creat dd/d12/d18/d1a/d1f/d20/f44 x:0 0 0 2024-04-26T21:07:57.228 INFO:tasks.workunit.client.1.smithi064.stdout:0/212: dread fc [0,4194304] 0 2024-04-26T21:07:57.230 INFO:tasks.workunit.client.0.smithi055.stdout:8/69: symlink d3/l1a 0 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:1/303: mkdir d0/d6/d11/d1e/d2a/d34/d57 0 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:3/214: symlink d1/da/d22/d26/l48 0 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:3/215: readlink d1/da/d22/d26/l28 0 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:3/216: chown d1/da 411550382 1 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:1/304: write d0/d6/d11/d1e/f20 [2215938,103260] 0 2024-04-26T21:07:57.232 INFO:tasks.workunit.client.1.smithi064.stdout:1/305: getdents d0/d6/d29 0 2024-04-26T21:07:57.233 INFO:tasks.workunit.client.0.smithi055.stdout:4/50: mkdir d4/d12/d17 0 2024-04-26T21:07:57.233 INFO:tasks.workunit.client.0.smithi055.stdout:4/51: stat d4/f11 0 2024-04-26T21:07:57.233 INFO:tasks.workunit.client.0.smithi055.stdout:6/114: getdents d3/d17/d19 0 2024-04-26T21:07:57.237 INFO:tasks.workunit.client.0.smithi055.stdout:8/70: symlink d3/d9/l1b 0 2024-04-26T21:07:57.237 INFO:tasks.workunit.client.0.smithi055.stdout:8/71: write d3/f14 [72800,3617] 0 2024-04-26T21:07:57.238 INFO:tasks.workunit.client.0.smithi055.stdout:4/52: mkdir d4/d18 0 2024-04-26T21:07:57.240 INFO:tasks.workunit.client.0.smithi055.stdout:8/72: read d3/d9/fe [254839,75582] 0 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/208: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/209: chown d10/d2f/f3a 1985151428 1 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/210: fsync d10/d2f/f33 0 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/211: write d10/d2f/f33 [734220,125131] 0 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/212: chown c8 64815120 1 2024-04-26T21:07:57.247 INFO:tasks.workunit.client.1.smithi064.stdout:8/213: write d10/d2f/f36 [694862,14412] 0 2024-04-26T21:07:57.248 INFO:tasks.workunit.client.1.smithi064.stdout:4/296: creat d0/d1d/d17/d44/d45/f5c x:0 0 0 2024-04-26T21:07:57.248 INFO:tasks.workunit.client.1.smithi064.stdout:4/297: readlink d0/d14/l27 0 2024-04-26T21:07:57.248 INFO:tasks.workunit.client.1.smithi064.stdout:6/188: symlink d4/d7/d33/l3d 0 2024-04-26T21:07:57.248 INFO:tasks.workunit.client.1.smithi064.stdout:5/221: symlink dd/d12/l45 0 2024-04-26T21:07:57.258 INFO:tasks.workunit.client.0.smithi055.stdout:5/76: dread d4/f11 [0,4194304] 0 2024-04-26T21:07:57.258 INFO:tasks.workunit.client.1.smithi064.stdout:8/214: mkdir d10/d41/d44 0 2024-04-26T21:07:57.258 INFO:tasks.workunit.client.0.smithi055.stdout:6/115: rmdir d3/d17 39 2024-04-26T21:07:57.259 INFO:tasks.workunit.client.0.smithi055.stdout:6/116: getdents d3 0 2024-04-26T21:07:57.259 INFO:tasks.workunit.client.0.smithi055.stdout:6/117: truncate d3/d17/d19/f1b 524907 0 2024-04-26T21:07:57.262 INFO:tasks.workunit.client.0.smithi055.stdout:7/107: dwrite d5/d11/f1a [0,4194304] 0 2024-04-26T21:07:57.263 INFO:tasks.workunit.client.1.smithi064.stdout:6/189: symlink d4/d7/d33/l3e 0 2024-04-26T21:07:57.264 INFO:tasks.workunit.client.1.smithi064.stdout:4/298: symlink d0/d5/d3e/d54/l5d 0 2024-04-26T21:07:57.265 INFO:tasks.workunit.client.0.smithi055.stdout:0/162: dwrite d9/d27/f37 [0,4194304] 0 2024-04-26T21:07:57.265 INFO:tasks.workunit.client.0.smithi055.stdout:5/77: symlink d4/df/l19 0 2024-04-26T21:07:57.270 INFO:tasks.workunit.client.1.smithi064.stdout:6/190: truncate d4/f31 431206 0 2024-04-26T21:07:57.271 INFO:tasks.workunit.client.1.smithi064.stdout:9/266: dwrite d0/d4/d7/df/f3a [0,4194304] 0 2024-04-26T21:07:57.272 INFO:tasks.workunit.client.1.smithi064.stdout:9/267: readlink d0/d4/d28/l42 0 2024-04-26T21:07:57.273 INFO:tasks.workunit.client.0.smithi055.stdout:6/118: mknod d3/d17/d19/c1f 0 2024-04-26T21:07:57.273 INFO:tasks.workunit.client.0.smithi055.stdout:1/99: dwrite f1 [0,4194304] 0 2024-04-26T21:07:57.278 INFO:tasks.workunit.client.1.smithi064.stdout:7/240: dwrite d6/d15/d1c/f2e [0,4194304] 0 2024-04-26T21:07:57.280 INFO:tasks.workunit.client.0.smithi055.stdout:8/73: getdents d3 0 2024-04-26T21:07:57.280 INFO:tasks.workunit.client.0.smithi055.stdout:8/74: write d3/f17 [824248,26839] 0 2024-04-26T21:07:57.283 INFO:tasks.workunit.client.1.smithi064.stdout:5/222: write dd/d12/d18/f1d [6960207,20944] 0 2024-04-26T21:07:57.287 INFO:tasks.workunit.client.1.smithi064.stdout:6/191: link d4/f28 d4/d7/d12/d38/f3f 0 2024-04-26T21:07:57.290 INFO:tasks.workunit.client.0.smithi055.stdout:7/108: unlink d5/d6/l13 0 2024-04-26T21:07:57.294 INFO:tasks.workunit.client.1.smithi064.stdout:8/215: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:07:57.294 INFO:tasks.workunit.client.1.smithi064.stdout:9/268: creat d0/f59 x:0 0 0 2024-04-26T21:07:57.295 INFO:tasks.workunit.client.1.smithi064.stdout:9/269: getdents d0/d4/da/d26 0 2024-04-26T21:07:57.295 INFO:tasks.workunit.client.1.smithi064.stdout:1/306: dread d0/d6/d11/f1d [0,4194304] 0 2024-04-26T21:07:57.295 INFO:tasks.workunit.client.1.smithi064.stdout:1/307: chown d0/d6/d11/d1e/d27/c3d 2323229 1 2024-04-26T21:07:57.298 INFO:tasks.workunit.client.1.smithi064.stdout:0/213: dwrite dd/f2a [0,4194304] 0 2024-04-26T21:07:57.298 INFO:tasks.workunit.client.1.smithi064.stdout:8/216: dread d10/d1d/f3d [0,4194304] 0 2024-04-26T21:07:57.305 INFO:tasks.workunit.client.0.smithi055.stdout:0/163: mknod d9/dc/d17/c39 0 2024-04-26T21:07:57.308 INFO:tasks.workunit.client.1.smithi064.stdout:7/241: mknod d6/d15/d1c/c53 0 2024-04-26T21:07:57.308 INFO:tasks.workunit.client.1.smithi064.stdout:7/242: dread - d6/d15/d33/f31 zero size 2024-04-26T21:07:57.312 INFO:tasks.workunit.client.1.smithi064.stdout:6/192: rename d4/d7/d12/d1e/l21 to d4/d7/l40 0 2024-04-26T21:07:57.312 INFO:tasks.workunit.client.1.smithi064.stdout:6/193: fdatasync d4/d7/d12/d38/f3f 0 2024-04-26T21:07:57.312 INFO:tasks.workunit.client.1.smithi064.stdout:6/194: fsync d4/d7/f3a 0 2024-04-26T21:07:57.325 INFO:tasks.workunit.client.1.smithi064.stdout:3/217: dwrite d1/f8 [0,4194304] 0 2024-04-26T21:07:57.325 INFO:tasks.workunit.client.1.smithi064.stdout:3/218: write d1/f2f [232370,23009] 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:3/219: creat d1/d38/f49 x:0 0 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:5/223: read dd/d12/d18/d1a/d1b/f3c [701252,22654] 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:9/270: unlink d0/d4/da/d26/f4e 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:9/271: chown d0/d4/d7/df/f40 62 1 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:1/308: getdents d0/d6/d11 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:1/309: truncate d0/d6/d11/d1e/d2a/d34/f36 532454 0 2024-04-26T21:07:57.326 INFO:tasks.workunit.client.1.smithi064.stdout:1/310: write d0/d6/f52 [1021672,95852] 0 2024-04-26T21:07:57.332 INFO:tasks.workunit.client.1.smithi064.stdout:4/299: dwrite d0/ff [0,4194304] 0 2024-04-26T21:07:57.334 INFO:tasks.workunit.client.1.smithi064.stdout:2/229: dwrite d12/f34 [0,4194304] 0 2024-04-26T21:07:57.334 INFO:tasks.workunit.client.1.smithi064.stdout:2/230: creat d12/d16/d2f/f4d x:0 0 0 2024-04-26T21:07:57.334 INFO:tasks.workunit.client.1.smithi064.stdout:2/231: readlink lb 0 2024-04-26T21:07:57.334 INFO:tasks.workunit.client.1.smithi064.stdout:2/232: chown d12/d16/f19 4271147 1 2024-04-26T21:07:57.336 INFO:tasks.workunit.client.0.smithi055.stdout:6/119: mkdir d3/d17/d19/d20 0 2024-04-26T21:07:57.337 INFO:tasks.workunit.client.1.smithi064.stdout:0/214: chown dd/d10/d18/c2c 42373011 1 2024-04-26T21:07:57.337 INFO:tasks.workunit.client.1.smithi064.stdout:0/215: stat dd/d10/d1a/d31 0 2024-04-26T21:07:57.338 INFO:tasks.workunit.client.1.smithi064.stdout:0/216: stat dd/d10/f2e 0 2024-04-26T21:07:57.340 INFO:tasks.workunit.client.0.smithi055.stdout:1/100: mknod d8/df/c23 0 2024-04-26T21:07:57.341 INFO:tasks.workunit.client.1.smithi064.stdout:8/217: symlink d10/d1d/d38/l45 0 2024-04-26T21:07:57.344 INFO:tasks.workunit.client.0.smithi055.stdout:8/75: unlink d3/f17 0 2024-04-26T21:07:57.344 INFO:tasks.workunit.client.1.smithi064.stdout:7/243: mknod d6/d15/d33/d4d/c54 0 2024-04-26T21:07:57.351 INFO:tasks.workunit.client.1.smithi064.stdout:7/244: dread d6/db/f29 [0,4194304] 0 2024-04-26T21:07:57.351 INFO:tasks.workunit.client.1.smithi064.stdout:4/300: dread d0/f1a [0,4194304] 0 2024-04-26T21:07:57.357 INFO:tasks.workunit.client.0.smithi055.stdout:5/78: dwrite d4/d15/f16 [0,4194304] 0 2024-04-26T21:07:57.358 INFO:tasks.workunit.client.0.smithi055.stdout:4/53: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:07:57.358 INFO:tasks.workunit.client.0.smithi055.stdout:4/54: fdatasync d4/d12/d15/f16 0 2024-04-26T21:07:57.363 INFO:tasks.workunit.client.0.smithi055.stdout:6/120: truncate f0 3093314 0 2024-04-26T21:07:57.363 INFO:tasks.workunit.client.0.smithi055.stdout:3/85: sync 2024-04-26T21:07:57.364 INFO:tasks.workunit.client.0.smithi055.stdout:3/86: dread - d0/d1/d13/f1d zero size 2024-04-26T21:07:57.364 INFO:tasks.workunit.client.0.smithi055.stdout:3/87: dread - d0/d1/d13/f1d zero size 2024-04-26T21:07:57.364 INFO:tasks.workunit.client.1.smithi064.stdout:7/245: dread d6/d9/f1a [0,4194304] 0 2024-04-26T21:07:57.364 INFO:tasks.workunit.client.1.smithi064.stdout:7/246: chown d6/d15/d1c/c53 164 1 2024-04-26T21:07:57.367 INFO:tasks.workunit.client.1.smithi064.stdout:3/220: rmdir d1/da/d37 0 2024-04-26T21:07:57.367 INFO:tasks.workunit.client.1.smithi064.stdout:5/224: rmdir dd/d12/d18/d1a/d1b 39 2024-04-26T21:07:57.367 INFO:tasks.workunit.client.1.smithi064.stdout:5/225: write dd/d12/d18/f2b [776852,130659] 0 2024-04-26T21:07:57.367 INFO:tasks.workunit.client.1.smithi064.stdout:5/226: fsync dd/d12/d18/d1a/d1f/d20/f3b 0 2024-04-26T21:07:57.370 INFO:tasks.workunit.client.0.smithi055.stdout:5/79: creat d4/d15/f1a x:0 0 0 2024-04-26T21:07:57.373 INFO:tasks.workunit.client.1.smithi064.stdout:9/272: rmdir d0/d4/d7/d51 0 2024-04-26T21:07:57.374 INFO:tasks.workunit.client.1.smithi064.stdout:9/273: write d0/d4/da/f57 [662773,34953] 0 2024-04-26T21:07:57.378 INFO:tasks.workunit.client.1.smithi064.stdout:1/311: symlink d0/d6/d11/d2c/l58 0 2024-04-26T21:07:57.390 INFO:tasks.workunit.client.1.smithi064.stdout:2/233: mkdir d12/d16/d29/d4e 0 2024-04-26T21:07:57.390 INFO:tasks.workunit.client.1.smithi064.stdout:2/234: fdatasync d12/d28/f3f 0 2024-04-26T21:07:57.391 INFO:tasks.workunit.client.0.smithi055.stdout:8/76: mknod d3/d9/c1c 0 2024-04-26T21:07:57.391 INFO:tasks.workunit.client.0.smithi055.stdout:8/77: fdatasync f1 0 2024-04-26T21:07:57.391 INFO:tasks.workunit.client.0.smithi055.stdout:8/78: write f1 [2740798,59304] 0 2024-04-26T21:07:57.392 INFO:tasks.workunit.client.1.smithi064.stdout:0/217: creat dd/d10/d1a/d31/f3c x:0 0 0 2024-04-26T21:07:57.394 INFO:tasks.workunit.client.0.smithi055.stdout:6/121: symlink d3/d17/d19/d20/l21 0 2024-04-26T21:07:57.395 INFO:tasks.workunit.client.1.smithi064.stdout:8/218: creat d10/d1d/d38/f46 x:0 0 0 2024-04-26T21:07:57.396 INFO:tasks.workunit.client.0.smithi055.stdout:5/80: creat d4/df/f1b x:0 0 0 2024-04-26T21:07:57.397 INFO:tasks.workunit.client.0.smithi055.stdout:5/81: truncate f0 4382173 0 2024-04-26T21:07:57.398 INFO:tasks.workunit.client.1.smithi064.stdout:6/195: getdents d4/d7/d12/d38 0 2024-04-26T21:07:57.399 INFO:tasks.workunit.client.0.smithi055.stdout:7/109: dwrite d5/d11/f1a [4194304,4194304] 0 2024-04-26T21:07:57.401 INFO:tasks.workunit.client.0.smithi055.stdout:6/122: rename d3/fc to d3/d17/d19/d20/f22 0 2024-04-26T21:07:57.406 INFO:tasks.workunit.client.0.smithi055.stdout:0/164: dwrite d9/dc/d1c/f26 [0,4194304] 0 2024-04-26T21:07:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:57 smithi064 ceph-mon[33404]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 390 op/s 2024-04-26T21:07:57.406 INFO:tasks.workunit.client.1.smithi064.stdout:4/301: rename d0/f11 to d0/d1d/d17/d57/f5e 0 2024-04-26T21:07:57.407 INFO:tasks.workunit.client.1.smithi064.stdout:3/221: symlink d1/d27/l4a 0 2024-04-26T21:07:57.410 INFO:tasks.workunit.client.1.smithi064.stdout:9/274: unlink d0/f56 0 2024-04-26T21:07:57.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/123: rename d3/d17/d19/f1a to d3/f23 0 2024-04-26T21:07:57.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/124: chown d3/cd 492 1 2024-04-26T21:07:57.413 INFO:tasks.workunit.client.0.smithi055.stdout:4/55: dwrite d4/ff [0,4194304] 0 2024-04-26T21:07:57.418 INFO:tasks.workunit.client.1.smithi064.stdout:2/235: truncate d12/d28/f37 227994 0 2024-04-26T21:07:57.419 INFO:tasks.workunit.client.1.smithi064.stdout:2/236: fdatasync d12/d16/d29/f2d 0 2024-04-26T21:07:57.419 INFO:tasks.workunit.client.0.smithi055.stdout:2/114: sync 2024-04-26T21:07:57.419 INFO:tasks.workunit.client.0.smithi055.stdout:9/85: sync 2024-04-26T21:07:57.419 INFO:tasks.workunit.client.0.smithi055.stdout:3/88: dwrite d0/d1/d13/f1d [0,4194304] 0 2024-04-26T21:07:57.420 INFO:tasks.workunit.client.1.smithi064.stdout:0/218: symlink dd/d10/d1a/l3d 0 2024-04-26T21:07:57.421 INFO:tasks.workunit.client.0.smithi055.stdout:7/110: getdents d5/d6 0 2024-04-26T21:07:57.425 INFO:tasks.workunit.client.0.smithi055.stdout:6/125: mknod d3/d17/d19/c24 0 2024-04-26T21:07:57.428 INFO:tasks.workunit.client.1.smithi064.stdout:4/302: stat d0/c23 0 2024-04-26T21:07:57.428 INFO:tasks.workunit.client.1.smithi064.stdout:4/303: creat d0/d5/d3e/d54/f5f x:0 0 0 2024-04-26T21:07:57.429 INFO:tasks.workunit.client.1.smithi064.stdout:4/304: write d0/d1d/d21/f47 [456892,123321] 0 2024-04-26T21:07:57.429 INFO:tasks.workunit.client.1.smithi064.stdout:4/305: creat d0/d5/d13/f60 x:0 0 0 2024-04-26T21:07:57.429 INFO:tasks.workunit.client.0.smithi055.stdout:4/56: creat d4/d12/d17/f19 x:0 0 0 2024-04-26T21:07:57.435 INFO:tasks.workunit.client.1.smithi064.stdout:7/247: rename d6/db/c18 to d6/d15/c55 0 2024-04-26T21:07:57.438 INFO:tasks.workunit.client.0.smithi055.stdout:2/115: mknod d4/d1e/c28 0 2024-04-26T21:07:57.438 INFO:tasks.workunit.client.0.smithi055.stdout:2/116: chown d4/dc/f18 0 1 2024-04-26T21:07:57.439 INFO:tasks.workunit.client.1.smithi064.stdout:1/312: rmdir d0/d22 39 2024-04-26T21:07:57.440 INFO:tasks.workunit.client.1.smithi064.stdout:1/313: write d0/d6/d11/f18 [986327,74516] 0 2024-04-26T21:07:57.440 INFO:tasks.workunit.client.0.smithi055.stdout:9/86: creat d2/d14/f1b x:0 0 0 2024-04-26T21:07:57.443 INFO:tasks.workunit.client.1.smithi064.stdout:2/237: symlink d12/d28/l4f 0 2024-04-26T21:07:57.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/111: symlink d5/db/l1d 0 2024-04-26T21:07:57.445 INFO:tasks.workunit.client.1.smithi064.stdout:0/219: mkdir dd/d10/d1a/d31/d3e 0 2024-04-26T21:07:57.445 INFO:tasks.workunit.client.1.smithi064.stdout:0/220: stat dd/d10/d1a/d31 0 2024-04-26T21:07:57.445 INFO:tasks.workunit.client.0.smithi055.stdout:6/126: mkdir d3/d17/d25 0 2024-04-26T21:07:57.447 INFO:tasks.workunit.client.0.smithi055.stdout:4/57: mkdir d4/d18/d1a 0 2024-04-26T21:07:57.447 INFO:tasks.workunit.client.1.smithi064.stdout:4/306: dread d0/d1d/d21/f4e [0,4194304] 0 2024-04-26T21:07:57.449 INFO:tasks.workunit.client.1.smithi064.stdout:6/196: rmdir d4 39 2024-04-26T21:07:57.449 INFO:tasks.workunit.client.1.smithi064.stdout:6/197: chown d4/d7/c17 1689 1 2024-04-26T21:07:57.450 INFO:tasks.workunit.client.1.smithi064.stdout:6/198: chown d4/d7/d33/l3e 120 1 2024-04-26T21:07:57.460 INFO:tasks.workunit.client.0.smithi055.stdout:7/112: unlink d5/f12 0 2024-04-26T21:07:57.460 INFO:tasks.workunit.client.0.smithi055.stdout:7/113: creat d5/db/f1e x:0 0 0 2024-04-26T21:07:57.462 INFO:tasks.workunit.client.0.smithi055.stdout:6/127: getdents d3 0 2024-04-26T21:07:57.464 INFO:tasks.workunit.client.0.smithi055.stdout:9/87: getdents d2/d11 0 2024-04-26T21:07:57.466 INFO:tasks.workunit.client.1.smithi064.stdout:9/275: getdents d0/d4/da/d26 0 2024-04-26T21:07:57.472 INFO:tasks.workunit.client.0.smithi055.stdout:2/117: write f2 [3440577,45892] 0 2024-04-26T21:07:57.472 INFO:tasks.workunit.client.0.smithi055.stdout:2/118: chown d4/d1e 313 1 2024-04-26T21:07:57.472 INFO:tasks.workunit.client.0.smithi055.stdout:2/119: truncate d4/dc/f1d 580474 0 2024-04-26T21:07:57.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/219: dwrite d10/d1d/d38/f39 [0,4194304] 0 2024-04-26T21:07:57.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/220: getdents d10/d41/d44 0 2024-04-26T21:07:57.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/221: chown d10/d31/l3e 4660919 1 2024-04-26T21:07:57.483 INFO:tasks.workunit.client.0.smithi055.stdout:0/165: dwrite d9/dc/d17/d34/f36 [0,4194304] 0 2024-04-26T21:07:57.483 INFO:tasks.workunit.client.1.smithi064.stdout:3/222: dwrite d1/da/f10 [4194304,4194304] 0 2024-04-26T21:07:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:57 smithi055 ceph-mon[25475]: pgmap v31: 65 pgs: 65 active+clean; 284 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 390 op/s 2024-04-26T21:07:57.507 INFO:tasks.workunit.client.1.smithi064.stdout:5/227: rename dd/d12/d18/d25/f35 to dd/d12/d18/d1a/d1f/d20/f46 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.1.smithi064.stdout:1/314: mknod d0/d6/c59 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.1.smithi064.stdout:4/307: unlink d0/d14/l29 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/89: dwrite d0/d4/d5/f21 [0,4194304] 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/90: chown d0/d1/d13/f1d 479 1 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/91: getdents d0/d1/d13/d1a 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/92: creat d0/f22 x:0 0 0 2024-04-26T21:07:57.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/93: write d0/f19 [1961983,128316] 0 2024-04-26T21:07:57.512 INFO:tasks.workunit.client.1.smithi064.stdout:7/248: dwrite d6/f51 [0,4194304] 0 2024-04-26T21:07:57.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/249: creat d6/d15/f56 x:0 0 0 2024-04-26T21:07:57.515 INFO:tasks.workunit.client.1.smithi064.stdout:6/199: unlink d4/d7/c2e 0 2024-04-26T21:07:57.520 INFO:tasks.workunit.client.1.smithi064.stdout:9/276: creat d0/d4/d7/df/f5a x:0 0 0 2024-04-26T21:07:57.520 INFO:tasks.workunit.client.1.smithi064.stdout:9/277: write d0/d4/d7/f46 [379806,64596] 0 2024-04-26T21:07:57.526 INFO:tasks.workunit.client.0.smithi055.stdout:4/58: dwrite d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:07:57.527 INFO:tasks.workunit.client.0.smithi055.stdout:4/59: readlink d4/le 0 2024-04-26T21:07:57.533 INFO:tasks.workunit.client.0.smithi055.stdout:3/94: mkdir d0/d1/d23 0 2024-04-26T21:07:57.538 INFO:tasks.workunit.client.1.smithi064.stdout:3/223: creat d1/d27/d29/f4b x:0 0 0 2024-04-26T21:07:57.539 INFO:tasks.workunit.client.1.smithi064.stdout:3/224: read - d1/da/d22/f40 zero size 2024-04-26T21:07:57.539 INFO:tasks.workunit.client.0.smithi055.stdout:9/88: rename d2/d14/f1b to d2/f1c 0 2024-04-26T21:07:57.540 INFO:tasks.workunit.client.0.smithi055.stdout:9/89: fdatasync f1 0 2024-04-26T21:07:57.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/120: write d4/db/f15 [2533809,114450] 0 2024-04-26T21:07:57.542 INFO:tasks.workunit.client.0.smithi055.stdout:6/128: dwrite f1 [0,4194304] 0 2024-04-26T21:07:57.542 INFO:tasks.workunit.client.0.smithi055.stdout:6/129: fdatasync d3/f9 0 2024-04-26T21:07:57.545 INFO:tasks.workunit.client.1.smithi064.stdout:2/238: rename lb to d12/d1a/l50 0 2024-04-26T21:07:57.546 INFO:tasks.workunit.client.0.smithi055.stdout:7/114: dwrite d5/d11/f1a [8388608,4194304] 0 2024-04-26T21:07:57.551 INFO:tasks.workunit.client.0.smithi055.stdout:0/166: rename d9/f32 to d9/dc/d17/f3a 0 2024-04-26T21:07:57.555 INFO:tasks.workunit.client.0.smithi055.stdout:9/90: link d2/d14/l18 d2/d11/l1d 0 2024-04-26T21:07:57.560 INFO:tasks.workunit.client.0.smithi055.stdout:6/130: mknod d3/d17/c26 0 2024-04-26T21:07:57.561 INFO:tasks.workunit.client.0.smithi055.stdout:4/60: write d4/f8 [3279339,548] 0 2024-04-26T21:07:57.562 INFO:tasks.workunit.client.0.smithi055.stdout:3/95: dread d0/d4/d5/f6 [4194304,4194304] 0 2024-04-26T21:07:57.562 INFO:tasks.workunit.client.0.smithi055.stdout:3/96: chown d0/d4/d5/f6 681134049 1 2024-04-26T21:07:57.566 INFO:tasks.workunit.client.0.smithi055.stdout:7/115: symlink d5/d6/l1f 0 2024-04-26T21:07:57.566 INFO:tasks.workunit.client.0.smithi055.stdout:7/116: chown d5/db/f14 469 1 2024-04-26T21:07:57.568 INFO:tasks.workunit.client.1.smithi064.stdout:7/250: getdents d6/d9/d3d 0 2024-04-26T21:07:57.569 INFO:tasks.workunit.client.0.smithi055.stdout:2/121: dread f2 [0,4194304] 0 2024-04-26T21:07:57.569 INFO:tasks.workunit.client.0.smithi055.stdout:2/122: chown d4/la 9099625 1 2024-04-26T21:07:57.575 INFO:tasks.workunit.client.1.smithi064.stdout:5/228: dwrite dd/d12/d18/d1a/d1f/d20/f2d [0,4194304] 0 2024-04-26T21:07:57.575 INFO:tasks.workunit.client.1.smithi064.stdout:5/229: fsync dd/f1e 0 2024-04-26T21:07:57.576 INFO:tasks.workunit.client.0.smithi055.stdout:6/131: truncate d3/d17/d19/d20/f22 1318506 0 2024-04-26T21:07:57.576 INFO:tasks.workunit.client.0.smithi055.stdout:6/132: chown d3/l13 351 1 2024-04-26T21:07:57.577 INFO:tasks.workunit.client.0.smithi055.stdout:3/97: truncate d0/d1/d13/f1d 333727 0 2024-04-26T21:07:57.578 INFO:tasks.workunit.client.0.smithi055.stdout:3/98: readlink d0/d4/d5/lc 0 2024-04-26T21:07:57.583 INFO:tasks.workunit.client.1.smithi064.stdout:9/278: unlink d0/d4/d7/f4a 0 2024-04-26T21:07:57.583 INFO:tasks.workunit.client.1.smithi064.stdout:9/279: chown d0/f59 15157 1 2024-04-26T21:07:57.583 INFO:tasks.workunit.client.1.smithi064.stdout:3/225: mkdir d1/da/d35/d4c 0 2024-04-26T21:07:57.584 INFO:tasks.workunit.client.0.smithi055.stdout:7/117: mknod d5/db/c20 0 2024-04-26T21:07:57.586 INFO:tasks.workunit.client.0.smithi055.stdout:9/91: rename d2/f4 to d2/f1e 0 2024-04-26T21:07:57.586 INFO:tasks.workunit.client.0.smithi055.stdout:2/123: creat d4/db/d1f/f29 x:0 0 0 2024-04-26T21:07:57.586 INFO:tasks.workunit.client.0.smithi055.stdout:2/124: write d4/dc/f12 [494343,102296] 0 2024-04-26T21:07:57.590 INFO:tasks.workunit.client.0.smithi055.stdout:9/92: creat d2/d11/f1f x:0 0 0 2024-04-26T21:07:57.590 INFO:tasks.workunit.client.0.smithi055.stdout:9/93: fdatasync f1 0 2024-04-26T21:07:57.591 INFO:tasks.workunit.client.0.smithi055.stdout:2/125: mkdir d4/d1e/d2a 0 2024-04-26T21:07:57.595 INFO:tasks.workunit.client.1.smithi064.stdout:6/200: dwrite d4/f2f [0,4194304] 0 2024-04-26T21:07:57.596 INFO:tasks.workunit.client.0.smithi055.stdout:9/94: getdents d2/d14 0 2024-04-26T21:07:57.603 INFO:tasks.workunit.client.0.smithi055.stdout:3/99: dread d0/d4/d5/f6 [4194304,4194304] 0 2024-04-26T21:07:57.603 INFO:tasks.workunit.client.0.smithi055.stdout:3/100: chown d0/d4/d5/f21 7720 1 2024-04-26T21:07:57.603 INFO:tasks.workunit.client.0.smithi055.stdout:3/101: write d0/d1/f14 [446401,95368] 0 2024-04-26T21:07:57.604 INFO:tasks.workunit.client.1.smithi064.stdout:2/239: symlink d12/d16/d2f/l51 0 2024-04-26T21:07:57.606 INFO:tasks.workunit.client.1.smithi064.stdout:1/315: dwrite d0/d6/d11/d2c/f47 [0,4194304] 0 2024-04-26T21:07:57.606 INFO:tasks.workunit.client.1.smithi064.stdout:7/251: creat d6/db/d1f/d50/f57 x:0 0 0 2024-04-26T21:07:57.609 INFO:tasks.workunit.client.1.smithi064.stdout:4/308: dwrite d0/d1d/d17/d44/f53 [0,4194304] 0 2024-04-26T21:07:57.612 INFO:tasks.workunit.client.0.smithi055.stdout:7/118: read d5/d11/f1a [1786148,80365] 0 2024-04-26T21:07:57.613 INFO:tasks.workunit.client.0.smithi055.stdout:7/119: creat d5/f21 x:0 0 0 2024-04-26T21:07:57.613 INFO:tasks.workunit.client.0.smithi055.stdout:7/120: chown d5 259 1 2024-04-26T21:07:57.615 INFO:tasks.workunit.client.1.smithi064.stdout:7/252: dread d6/d9/f30 [0,4194304] 0 2024-04-26T21:07:57.622 INFO:tasks.workunit.client.0.smithi055.stdout:7/121: creat d5/d11/d18/f22 x:0 0 0 2024-04-26T21:07:57.622 INFO:tasks.workunit.client.0.smithi055.stdout:7/122: creat d5/f23 x:0 0 0 2024-04-26T21:07:57.622 INFO:tasks.workunit.client.0.smithi055.stdout:7/123: write d5/db/f1e [1016325,1422] 0 2024-04-26T21:07:57.623 INFO:tasks.workunit.client.1.smithi064.stdout:9/280: creat d0/d4/da/f5b x:0 0 0 2024-04-26T21:07:57.625 INFO:tasks.workunit.client.1.smithi064.stdout:3/226: link d1/da/l3f d1/d27/d2c/l4d 0 2024-04-26T21:07:57.629 INFO:tasks.workunit.client.0.smithi055.stdout:0/167: dwrite d9/d11/f35 [0,4194304] 0 2024-04-26T21:07:57.633 INFO:tasks.workunit.client.0.smithi055.stdout:7/124: mkdir d5/d6/d24 0 2024-04-26T21:07:57.633 INFO:tasks.workunit.client.0.smithi055.stdout:7/125: creat d5/d11/f25 x:0 0 0 2024-04-26T21:07:57.635 INFO:tasks.workunit.client.0.smithi055.stdout:7/126: write d5/d11/f17 [1417566,54474] 0 2024-04-26T21:07:57.635 INFO:tasks.workunit.client.0.smithi055.stdout:7/127: dread - d5/d11/f25 zero size 2024-04-26T21:07:57.635 INFO:tasks.workunit.client.0.smithi055.stdout:7/128: chown d5/d11 26759 1 2024-04-26T21:07:57.637 INFO:tasks.workunit.client.1.smithi064.stdout:6/201: creat d4/f41 x:0 0 0 2024-04-26T21:07:57.637 INFO:tasks.workunit.client.1.smithi064.stdout:6/202: rename d4 to d4/d7/d12/d1e/d42 22 2024-04-26T21:07:57.637 INFO:tasks.workunit.client.1.smithi064.stdout:6/203: chown d4/d7/l1b 4661610 1 2024-04-26T21:07:57.638 INFO:tasks.workunit.client.1.smithi064.stdout:2/240: mkdir d12/d41/d52 0 2024-04-26T21:07:57.648 INFO:tasks.workunit.client.1.smithi064.stdout:1/316: symlink d0/d6/d11/l5a 0 2024-04-26T21:07:57.648 INFO:tasks.workunit.client.0.smithi055.stdout:9/95: dwrite d2/f10 [0,4194304] 0 2024-04-26T21:07:57.649 INFO:tasks.workunit.client.0.smithi055.stdout:2/126: read d4/dc/f18 [589340,71114] 0 2024-04-26T21:07:57.649 INFO:tasks.workunit.client.0.smithi055.stdout:2/127: dread - d4/dc/d21/f24 zero size 2024-04-26T21:07:57.650 INFO:tasks.workunit.client.0.smithi055.stdout:2/128: fdatasync d4/db/d1f/f29 0 2024-04-26T21:07:57.651 INFO:tasks.workunit.client.0.smithi055.stdout:4/61: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:07:57.653 INFO:tasks.workunit.client.1.smithi064.stdout:4/309: mknod d0/d5/d3e/c61 0 2024-04-26T21:07:57.653 INFO:tasks.workunit.client.1.smithi064.stdout:4/310: creat d0/d1d/d21/f62 x:0 0 0 2024-04-26T21:07:57.656 INFO:tasks.workunit.client.1.smithi064.stdout:7/253: mkdir d6/d9/d3d/d58 0 2024-04-26T21:07:57.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/62: symlink d4/d12/d15/l1b 0 2024-04-26T21:07:57.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/63: truncate d4/f11 463396 0 2024-04-26T21:07:57.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/64: readlink d4/lc 0 2024-04-26T21:07:57.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/65: fsync d4/d12/d17/f19 0 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/230: truncate dd/d12/d18/d1a/d1f/d20/f2d 3697001 0 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/231: chown dd 25 1 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/232: stat dd/f2a 0 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/233: fsync dd/d12/d18/d1a/d1f/d20/f44 0 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/234: creat dd/d12/d18/d1a/d1f/d20/f47 x:0 0 0 2024-04-26T21:07:57.663 INFO:tasks.workunit.client.1.smithi064.stdout:5/235: stat dd/f2a 0 2024-04-26T21:07:57.664 INFO:tasks.workunit.client.1.smithi064.stdout:9/281: creat d0/d39/f5c x:0 0 0 2024-04-26T21:07:57.665 INFO:tasks.workunit.client.0.smithi055.stdout:2/129: dread d4/dc/f16 [0,4194304] 0 2024-04-26T21:07:57.666 INFO:tasks.workunit.client.0.smithi055.stdout:4/66: symlink d4/d18/d1a/l1c 0 2024-04-26T21:07:57.668 INFO:tasks.workunit.client.1.smithi064.stdout:3/227: symlink d1/d27/d2c/l4e 0 2024-04-26T21:07:57.672 INFO:tasks.workunit.client.0.smithi055.stdout:4/67: truncate d4/d12/d15/f16 3456216 0 2024-04-26T21:07:57.672 INFO:tasks.workunit.client.0.smithi055.stdout:4/68: creat d4/f1d x:0 0 0 2024-04-26T21:07:57.673 INFO:tasks.workunit.client.0.smithi055.stdout:4/69: stat d4/le 0 2024-04-26T21:07:57.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/317: dread d0/d6/d11/d1e/f21 [0,4194304] 0 2024-04-26T21:07:57.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/318: truncate d0/d6/d11/d1e/d27/f50 355472 0 2024-04-26T21:07:57.674 INFO:tasks.workunit.client.1.smithi064.stdout:2/241: mkdir d12/d16/d2f/d53 0 2024-04-26T21:07:57.674 INFO:tasks.workunit.client.1.smithi064.stdout:2/242: write d12/d28/f37 [975594,112815] 0 2024-04-26T21:07:57.674 INFO:tasks.workunit.client.1.smithi064.stdout:2/243: write d12/d28/f3f [1857698,20825] 0 2024-04-26T21:07:57.676 INFO:tasks.workunit.client.1.smithi064.stdout:4/311: mknod d0/d14/c63 0 2024-04-26T21:07:57.677 INFO:tasks.workunit.client.1.smithi064.stdout:7/254: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:07:57.679 INFO:tasks.workunit.client.0.smithi055.stdout:4/70: mkdir d4/d18/d1e 0 2024-04-26T21:07:57.680 INFO:tasks.workunit.client.0.smithi055.stdout:4/71: chown d4/ff 20106 1 2024-04-26T21:07:57.680 INFO:tasks.workunit.client.0.smithi055.stdout:4/72: getdents d4/d18/d1e 0 2024-04-26T21:07:57.682 INFO:tasks.workunit.client.1.smithi064.stdout:5/236: mkdir dd/d12/d18/d33/d48 0 2024-04-26T21:07:57.683 INFO:tasks.workunit.client.0.smithi055.stdout:9/96: write d2/f1e [517994,109387] 0 2024-04-26T21:07:57.683 INFO:tasks.workunit.client.0.smithi055.stdout:0/168: dwrite f8 [0,4194304] 0 2024-04-26T21:07:57.686 INFO:tasks.workunit.client.0.smithi055.stdout:4/73: creat d4/d18/f1f x:0 0 0 2024-04-26T21:07:57.697 INFO:tasks.workunit.client.1.smithi064.stdout:8/222: sync 2024-04-26T21:07:57.697 INFO:tasks.workunit.client.1.smithi064.stdout:8/223: chown d10/d1d/f29 120968682 1 2024-04-26T21:07:57.697 INFO:tasks.workunit.client.1.smithi064.stdout:0/221: sync 2024-04-26T21:07:57.697 INFO:tasks.workunit.client.1.smithi064.stdout:7/255: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:07:57.699 INFO:tasks.workunit.client.1.smithi064.stdout:9/282: mkdir d0/d4/da/d26/d5d 0 2024-04-26T21:07:57.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/283: readlink d0/d4/d28/l50 0 2024-04-26T21:07:57.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/284: write d0/d4/d7/f9 [13464128,96148] 0 2024-04-26T21:07:57.700 INFO:tasks.workunit.client.1.smithi064.stdout:3/228: mknod d1/da/c4f 0 2024-04-26T21:07:57.700 INFO:tasks.workunit.client.0.smithi055.stdout:0/169: rename d9/dc/d17/d34 to d9/dc/d1c/d3b 0 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:6/204: symlink d4/l43 0 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:6/205: dread - d4/d7/d12/d1e/f39 zero size 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:6/206: dread - d4/d7/d12/d38/f3f zero size 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:1/319: creat d0/d6/d11/d1e/d2a/f5b x:0 0 0 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:2/244: mkdir d12/d28/d54 0 2024-04-26T21:07:57.703 INFO:tasks.workunit.client.1.smithi064.stdout:2/245: chown d12/d45 78262510 1 2024-04-26T21:07:57.708 INFO:tasks.workunit.client.0.smithi055.stdout:9/97: write d2/f10 [953195,87345] 0 2024-04-26T21:07:57.711 INFO:tasks.workunit.client.0.smithi055.stdout:7/129: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:07:57.716 INFO:tasks.workunit.client.1.smithi064.stdout:8/224: write d10/d1d/f43 [2175098,62761] 0 2024-04-26T21:07:57.717 INFO:tasks.workunit.client.1.smithi064.stdout:8/225: write d10/f12 [3204348,118060] 0 2024-04-26T21:07:57.720 INFO:tasks.workunit.client.1.smithi064.stdout:0/222: rmdir dd/d1c/d1d/d3b 0 2024-04-26T21:07:57.720 INFO:tasks.workunit.client.1.smithi064.stdout:7/256: creat d6/d9/d3d/d43/f59 x:0 0 0 2024-04-26T21:07:57.729 INFO:tasks.workunit.client.0.smithi055.stdout:7/130: dread d5/d11/f17 [0,4194304] 0 2024-04-26T21:07:57.736 INFO:tasks.workunit.client.1.smithi064.stdout:6/207: write d4/d7/f3b [1490569,41458] 0 2024-04-26T21:07:57.736 INFO:tasks.workunit.client.1.smithi064.stdout:6/208: truncate d4/d7/d12/d1e/f2b 889818 0 2024-04-26T21:07:57.739 INFO:tasks.workunit.client.1.smithi064.stdout:4/312: dwrite d0/d1d/d17/d57/f5e [0,4194304] 0 2024-04-26T21:07:57.739 INFO:tasks.workunit.client.1.smithi064.stdout:4/313: write d0/d1d/d17/d44/d45/f5c [55082,65816] 0 2024-04-26T21:07:57.757 INFO:tasks.workunit.client.0.smithi055.stdout:4/74: dwrite d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:07:57.757 INFO:tasks.workunit.client.0.smithi055.stdout:4/75: truncate d4/d12/d17/f19 290834 0 2024-04-26T21:07:57.757 INFO:tasks.workunit.client.0.smithi055.stdout:4/76: read - d4/d18/f1f zero size 2024-04-26T21:07:57.757 INFO:tasks.workunit.client.0.smithi055.stdout:4/77: write d4/f11 [646980,88187] 0 2024-04-26T21:07:57.757 INFO:tasks.workunit.client.0.smithi055.stdout:4/78: readlink d4/ld 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/237: dwrite dd/d12/d18/d1a/d1b/f29 [4194304,4194304] 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:1/320: dwrite d0/d22/f3c [0,4194304] 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/238: write dd/f16 [3073837,130922] 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/239: chown dd/d12/d18/d1a/d1f/d20/f46 54798855 1 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/240: dread - dd/d12/d18/d1a/d1f/d20/f47 zero size 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/241: write f0 [2165303,102801] 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/242: creat dd/d12/f49 x:0 0 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/243: fdatasync dd/f2a 0 2024-04-26T21:07:57.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/244: getdents dd/d12/d18/d25/d32 0 2024-04-26T21:07:57.759 INFO:tasks.workunit.client.1.smithi064.stdout:5/245: read - dd/d12/f3f zero size 2024-04-26T21:07:57.759 INFO:tasks.workunit.client.1.smithi064.stdout:9/285: mkdir d0/d4/da/d26/d5e 0 2024-04-26T21:07:57.759 INFO:tasks.workunit.client.1.smithi064.stdout:9/286: creat d0/d4/d7/df/f5f x:0 0 0 2024-04-26T21:07:57.763 INFO:tasks.workunit.client.1.smithi064.stdout:1/321: dread d0/d6/d11/d1e/d27/f2f [0,4194304] 0 2024-04-26T21:07:57.764 INFO:tasks.workunit.client.1.smithi064.stdout:3/229: rename d1/da to d1/d27/d50 0 2024-04-26T21:07:57.764 INFO:tasks.workunit.client.1.smithi064.stdout:3/230: readlink d1/l43 0 2024-04-26T21:07:57.764 INFO:tasks.workunit.client.1.smithi064.stdout:2/246: symlink d12/d28/d3a/d46/l55 0 2024-04-26T21:07:57.767 INFO:tasks.workunit.client.1.smithi064.stdout:7/257: rmdir d6/db/d34/d52 0 2024-04-26T21:07:57.768 INFO:tasks.workunit.client.0.smithi055.stdout:9/98: chown d2/f8 350 1 2024-04-26T21:07:57.771 INFO:tasks.workunit.client.0.smithi055.stdout:4/79: dread d4/ff [0,4194304] 0 2024-04-26T21:07:57.772 INFO:tasks.workunit.client.1.smithi064.stdout:6/209: creat d4/d7/d33/f44 x:0 0 0 2024-04-26T21:07:57.773 INFO:tasks.workunit.client.0.smithi055.stdout:7/131: symlink d5/d6/d24/l26 0 2024-04-26T21:07:57.780 INFO:tasks.workunit.client.0.smithi055.stdout:4/80: rename d4/l10 to d4/d12/d17/l20 0 2024-04-26T21:07:57.783 INFO:tasks.workunit.client.1.smithi064.stdout:4/314: link d0/d5/d13/f3d d0/d5/d2a/f64 0 2024-04-26T21:07:57.783 INFO:tasks.workunit.client.1.smithi064.stdout:4/315: stat d0/d5/d13/d10/f4c 0 2024-04-26T21:07:57.785 INFO:tasks.workunit.client.0.smithi055.stdout:4/81: unlink d4/d18/f1f 0 2024-04-26T21:07:57.785 INFO:tasks.workunit.client.0.smithi055.stdout:4/82: chown d4/ld 274567 1 2024-04-26T21:07:57.785 INFO:tasks.workunit.client.1.smithi064.stdout:7/258: write d6/f51 [2517291,8630] 0 2024-04-26T21:07:57.785 INFO:tasks.workunit.client.1.smithi064.stdout:7/259: write f5 [585384,127398] 0 2024-04-26T21:07:57.787 INFO:tasks.workunit.client.0.smithi055.stdout:7/132: truncate d5/db/f14 3990086 0 2024-04-26T21:07:57.790 INFO:tasks.workunit.client.0.smithi055.stdout:4/83: rename d4/f8 to d4/f21 0 2024-04-26T21:07:57.792 INFO:tasks.workunit.client.0.smithi055.stdout:7/133: creat d5/d6/d24/f27 x:0 0 0 2024-04-26T21:07:57.793 INFO:tasks.workunit.client.0.smithi055.stdout:7/134: chown d5/db/f1c 37571784 1 2024-04-26T21:07:57.795 INFO:tasks.workunit.client.0.smithi055.stdout:4/84: mknod d4/d18/c22 0 2024-04-26T21:07:57.797 INFO:tasks.workunit.client.0.smithi055.stdout:7/135: truncate d5/d6/ff 2721717 0 2024-04-26T21:07:57.797 INFO:tasks.workunit.client.0.smithi055.stdout:7/136: creat d5/d6/d24/f28 x:0 0 0 2024-04-26T21:07:57.797 INFO:tasks.workunit.client.0.smithi055.stdout:7/137: write f1 [4701380,35152] 0 2024-04-26T21:07:57.798 INFO:tasks.workunit.client.0.smithi055.stdout:7/138: creat d5/f29 x:0 0 0 2024-04-26T21:07:57.798 INFO:tasks.workunit.client.0.smithi055.stdout:7/139: fsync d5/db/f1c 0 2024-04-26T21:07:57.803 INFO:tasks.workunit.client.0.smithi055.stdout:4/85: mkdir d4/d23 0 2024-04-26T21:07:57.814 INFO:tasks.workunit.client.0.smithi055.stdout:7/140: mknod d5/d6/c2a 0 2024-04-26T21:07:57.814 INFO:tasks.workunit.client.0.smithi055.stdout:7/141: dread - d5/f21 zero size 2024-04-26T21:07:57.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/246: creat dd/d12/d18/d25/d32/f4a x:0 0 0 2024-04-26T21:07:57.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/247: read - dd/d12/d18/d1a/d1f/d20/f47 zero size 2024-04-26T21:07:57.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/248: write dd/d12/d18/f2f [99646,27866] 0 2024-04-26T21:07:57.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/249: chown dd/d12/d18/d1a/d1f/d20/f38 1091 1 2024-04-26T21:07:57.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/250: readlink dd/d12/d18/d1a/d1b/l43 0 2024-04-26T21:07:57.819 INFO:tasks.workunit.client.0.smithi055.stdout:4/86: mknod d4/d12/d17/c24 0 2024-04-26T21:07:57.819 INFO:tasks.workunit.client.0.smithi055.stdout:9/99: dwrite d2/f10 [0,4194304] 0 2024-04-26T21:07:57.820 INFO:tasks.workunit.client.1.smithi064.stdout:9/287: link d0/d4/d7/f9 d0/d4/da/d26/d5e/f60 0 2024-04-26T21:07:57.824 INFO:tasks.workunit.client.1.smithi064.stdout:1/322: creat d0/d6/dd/f5c x:0 0 0 2024-04-26T21:07:57.824 INFO:tasks.workunit.client.1.smithi064.stdout:1/323: chown d0/d6/cb 12273464 1 2024-04-26T21:07:57.824 INFO:tasks.workunit.client.1.smithi064.stdout:1/324: readlink d0/l45 0 2024-04-26T21:07:57.825 INFO:tasks.workunit.client.0.smithi055.stdout:4/87: creat d4/d23/f25 x:0 0 0 2024-04-26T21:07:57.826 INFO:tasks.workunit.client.1.smithi064.stdout:2/247: creat d12/d45/f56 x:0 0 0 2024-04-26T21:07:57.826 INFO:tasks.workunit.client.1.smithi064.stdout:2/248: dread - d12/d28/f3d zero size 2024-04-26T21:07:57.827 INFO:tasks.workunit.client.0.smithi055.stdout:9/100: mknod d2/d11/c20 0 2024-04-26T21:07:57.827 INFO:tasks.workunit.client.0.smithi055.stdout:9/101: chown d2/d11 7136533 1 2024-04-26T21:07:57.827 INFO:tasks.workunit.client.1.smithi064.stdout:3/231: dwrite d1/d12/f44 [0,4194304] 0 2024-04-26T21:07:57.827 INFO:tasks.workunit.client.1.smithi064.stdout:6/210: dwrite d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:57.828 INFO:tasks.workunit.client.1.smithi064.stdout:0/223: mknod dd/d10/d18/c3f 0 2024-04-26T21:07:57.828 INFO:tasks.workunit.client.0.smithi055.stdout:4/88: truncate d4/d12/d15/f16 4122431 0 2024-04-26T21:07:57.829 INFO:tasks.workunit.client.1.smithi064.stdout:4/316: creat d0/d1d/d56/f65 x:0 0 0 2024-04-26T21:07:57.831 INFO:tasks.workunit.client.0.smithi055.stdout:9/102: rename f1 to d2/d14/f21 0 2024-04-26T21:07:57.834 INFO:tasks.workunit.client.0.smithi055.stdout:4/89: mkdir d4/d26 0 2024-04-26T21:07:57.834 INFO:tasks.workunit.client.0.smithi055.stdout:4/90: fdatasync d4/d23/f25 0 2024-04-26T21:07:57.834 INFO:tasks.workunit.client.0.smithi055.stdout:4/91: readlink d4/l14 0 2024-04-26T21:07:57.836 INFO:tasks.workunit.client.0.smithi055.stdout:4/92: truncate d4/ff 1684955 0 2024-04-26T21:07:57.839 INFO:tasks.workunit.client.1.smithi064.stdout:9/288: creat d0/d4/d28/d4f/f61 x:0 0 0 2024-04-26T21:07:57.839 INFO:tasks.workunit.client.1.smithi064.stdout:9/289: fsync d0/d4/da/f5b 0 2024-04-26T21:07:57.839 INFO:tasks.workunit.client.1.smithi064.stdout:9/290: dread - d0/d4/d28/f30 zero size 2024-04-26T21:07:57.839 INFO:tasks.workunit.client.1.smithi064.stdout:9/291: write d0/d4/da/f5b [310239,66630] 0 2024-04-26T21:07:57.841 INFO:tasks.workunit.client.1.smithi064.stdout:1/325: symlink d0/d6/d11/d1e/d27/l5d 0 2024-04-26T21:07:57.844 INFO:tasks.workunit.client.0.smithi055.stdout:4/93: unlink d4/ca 0 2024-04-26T21:07:57.844 INFO:tasks.workunit.client.0.smithi055.stdout:4/94: creat d4/d12/d17/f27 x:0 0 0 2024-04-26T21:07:57.850 INFO:tasks.workunit.client.1.smithi064.stdout:3/232: creat d1/f51 x:0 0 0 2024-04-26T21:07:57.856 INFO:tasks.workunit.client.1.smithi064.stdout:6/211: creat d4/d7/d12/d1e/f45 x:0 0 0 2024-04-26T21:07:57.857 INFO:tasks.workunit.client.1.smithi064.stdout:6/212: creat d4/d7/d33/f46 x:0 0 0 2024-04-26T21:07:57.857 INFO:tasks.workunit.client.1.smithi064.stdout:6/213: stat d4/d7/d12/c1d 0 2024-04-26T21:07:57.858 INFO:tasks.workunit.client.0.smithi055.stdout:4/95: getdents d4/d12/d15 0 2024-04-26T21:07:57.861 INFO:tasks.workunit.client.0.smithi055.stdout:4/96: mkdir d4/d18/d1e/d28 0 2024-04-26T21:07:57.866 INFO:tasks.workunit.client.0.smithi055.stdout:4/97: mknod d4/d18/d1e/d28/c29 0 2024-04-26T21:07:57.869 INFO:tasks.workunit.client.1.smithi064.stdout:0/224: dread fc [0,4194304] 0 2024-04-26T21:07:57.870 INFO:tasks.workunit.client.0.smithi055.stdout:7/142: dwrite d5/f23 [0,4194304] 0 2024-04-26T21:07:57.873 INFO:tasks.workunit.client.1.smithi064.stdout:4/317: mknod d0/d1d/c66 0 2024-04-26T21:07:57.873 INFO:tasks.workunit.client.1.smithi064.stdout:4/318: write d0/d1d/d21/f62 [86604,43021] 0 2024-04-26T21:07:57.877 INFO:tasks.workunit.client.0.smithi055.stdout:4/98: symlink d4/d12/d15/l2a 0 2024-04-26T21:07:57.880 INFO:tasks.workunit.client.1.smithi064.stdout:9/292: creat d0/d4/da/d26/d47/f62 x:0 0 0 2024-04-26T21:07:57.885 INFO:tasks.workunit.client.1.smithi064.stdout:1/326: rename d0/f1f to d0/d6/d11/f5e 0 2024-04-26T21:07:57.893 INFO:tasks.workunit.client.1.smithi064.stdout:2/249: dwrite d12/d28/f3f [0,4194304] 0 2024-04-26T21:07:57.893 INFO:tasks.workunit.client.1.smithi064.stdout:6/214: mknod d4/d7/d33/c47 0 2024-04-26T21:07:57.894 INFO:tasks.workunit.client.1.smithi064.stdout:6/215: write d4/d7/f35 [417151,74263] 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/216: write d4/d7/d12/f14 [4917404,81781] 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/217: dread - d4/d7/d12/d1e/f39 zero size 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/218: readlink d4/l13 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:1/327: creat d0/d22/f5f x:0 0 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:1/328: chown d0/d6/d11/f35 23 1 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:1/329: chown d0/cc 358977 1 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:1/330: stat d0/d6/d11/d1e/f43 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:1/331: dread - d0/d6/d11/f5e zero size 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:5/251: dwrite dd/d12/d18/d1a/d1f/f24 [4194304,4194304] 0 2024-04-26T21:07:57.895 INFO:tasks.workunit.client.1.smithi064.stdout:5/252: chown dd/d12/d18 7937 1 2024-04-26T21:07:57.896 INFO:tasks.workunit.client.1.smithi064.stdout:1/332: truncate d0/d22/f30 1125146 0 2024-04-26T21:07:57.896 INFO:tasks.workunit.client.1.smithi064.stdout:1/333: fdatasync d0/d22/f3c 0 2024-04-26T21:07:57.896 INFO:tasks.workunit.client.1.smithi064.stdout:9/293: dread d0/d4/da/fc [0,4194304] 0 2024-04-26T21:07:57.900 INFO:tasks.workunit.client.0.smithi055.stdout:9/103: dwrite d2/f10 [0,4194304] 0 2024-04-26T21:07:57.900 INFO:tasks.workunit.client.0.smithi055.stdout:9/104: read d2/f1e [2712719,62353] 0 2024-04-26T21:07:57.900 INFO:tasks.workunit.client.0.smithi055.stdout:7/143: write d5/db/f14 [2001210,28856] 0 2024-04-26T21:07:57.900 INFO:tasks.workunit.client.0.smithi055.stdout:7/144: dread - d5/d11/d18/f22 zero size 2024-04-26T21:07:57.901 INFO:tasks.workunit.client.0.smithi055.stdout:7/145: fsync d5/d11/d18/f22 0 2024-04-26T21:07:57.901 INFO:tasks.workunit.client.0.smithi055.stdout:7/146: chown d5/db/le 33 1 2024-04-26T21:07:57.901 INFO:tasks.workunit.client.1.smithi064.stdout:8/226: sync 2024-04-26T21:07:57.904 INFO:tasks.workunit.client.1.smithi064.stdout:2/250: mkdir d12/d16/d57 0 2024-04-26T21:07:57.906 INFO:tasks.workunit.client.0.smithi055.stdout:9/105: creat d2/f22 x:0 0 0 2024-04-26T21:07:57.909 INFO:tasks.workunit.client.0.smithi055.stdout:7/147: mknod d5/d6/c2b 0 2024-04-26T21:07:57.914 INFO:tasks.workunit.client.1.smithi064.stdout:4/319: rmdir d0/d1d/d17 39 2024-04-26T21:07:57.914 INFO:tasks.workunit.client.0.smithi055.stdout:7/148: mknod d5/c2c 0 2024-04-26T21:07:57.915 INFO:tasks.workunit.client.1.smithi064.stdout:9/294: write d0/d4/d7/f9 [8878478,4700] 0 2024-04-26T21:07:57.915 INFO:tasks.workunit.client.1.smithi064.stdout:9/295: truncate d0/d4/d7/df/f2c 176157 0 2024-04-26T21:07:57.916 INFO:tasks.workunit.client.0.smithi055.stdout:9/106: mknod d2/c23 0 2024-04-26T21:07:57.917 INFO:tasks.workunit.client.0.smithi055.stdout:7/149: symlink d5/db/l2d 0 2024-04-26T21:07:57.918 INFO:tasks.workunit.client.1.smithi064.stdout:7/260: rename d6/d12 to d6/d5a 0 2024-04-26T21:07:57.919 INFO:tasks.workunit.client.1.smithi064.stdout:7/261: read d6/d9/f39 [600371,88290] 0 2024-04-26T21:07:57.919 INFO:tasks.workunit.client.1.smithi064.stdout:6/219: creat d4/d7/d12/f48 x:0 0 0 2024-04-26T21:07:57.924 INFO:tasks.workunit.client.1.smithi064.stdout:1/334: rename d0/d6/dd/l1a to d0/d6/d11/d1e/d2a/d34/d57/l60 0 2024-04-26T21:07:57.924 INFO:tasks.workunit.client.1.smithi064.stdout:8/227: creat d10/f47 x:0 0 0 2024-04-26T21:07:57.925 INFO:tasks.workunit.client.1.smithi064.stdout:2/251: creat d12/d28/d3a/f58 x:0 0 0 2024-04-26T21:07:57.925 INFO:tasks.workunit.client.1.smithi064.stdout:4/320: creat d0/d5/d3e/f67 x:0 0 0 2024-04-26T21:07:57.925 INFO:tasks.workunit.client.0.smithi055.stdout:7/150: unlink d5/l1b 0 2024-04-26T21:07:57.925 INFO:tasks.workunit.client.1.smithi064.stdout:4/321: write d0/d1d/d56/f65 [316874,16598] 0 2024-04-26T21:07:57.926 INFO:tasks.workunit.client.1.smithi064.stdout:9/296: mknod d0/d39/c63 0 2024-04-26T21:07:57.926 INFO:tasks.workunit.client.1.smithi064.stdout:7/262: creat d6/db/d34/f5b x:0 0 0 2024-04-26T21:07:57.926 INFO:tasks.workunit.client.1.smithi064.stdout:7/263: truncate d6/d9/d3d/d43/f59 579593 0 2024-04-26T21:07:57.926 INFO:tasks.workunit.client.1.smithi064.stdout:7/264: chown d6/d9/d3d/d43/f59 123 1 2024-04-26T21:07:57.927 INFO:tasks.workunit.client.1.smithi064.stdout:6/220: truncate d4/d7/d12/d1e/f2b 588089 0 2024-04-26T21:07:57.927 INFO:tasks.workunit.client.1.smithi064.stdout:6/221: chown d4/d7/l40 137507352 1 2024-04-26T21:07:57.927 INFO:tasks.workunit.client.1.smithi064.stdout:6/222: chown d4/d7/d12/f18 8205190 1 2024-04-26T21:07:57.928 INFO:tasks.workunit.client.1.smithi064.stdout:8/228: symlink d10/d1d/l48 0 2024-04-26T21:07:57.929 INFO:tasks.workunit.client.1.smithi064.stdout:2/252: symlink d12/d16/d2f/d53/l59 0 2024-04-26T21:07:57.929 INFO:tasks.workunit.client.1.smithi064.stdout:2/253: read - d12/d28/d3a/f58 zero size 2024-04-26T21:07:57.929 INFO:tasks.workunit.client.0.smithi055.stdout:7/151: getdents d5/d11 0 2024-04-26T21:07:57.930 INFO:tasks.workunit.client.1.smithi064.stdout:4/322: mknod d0/d5/d3e/d54/c68 0 2024-04-26T21:07:57.930 INFO:tasks.workunit.client.1.smithi064.stdout:8/229: write d10/d31/f3b [577151,47667] 0 2024-04-26T21:07:57.931 INFO:tasks.workunit.client.0.smithi055.stdout:7/152: read d5/d11/f17 [1126354,88448] 0 2024-04-26T21:07:57.931 INFO:tasks.workunit.client.1.smithi064.stdout:6/223: mkdir d4/d7/d12/d49 0 2024-04-26T21:07:57.932 INFO:tasks.workunit.client.1.smithi064.stdout:4/323: mkdir d0/d2f/d69 0 2024-04-26T21:07:57.933 INFO:tasks.workunit.client.0.smithi055.stdout:7/153: mknod d5/d6/d24/c2e 0 2024-04-26T21:07:57.933 INFO:tasks.workunit.client.0.smithi055.stdout:4/99: dwrite d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:07:57.934 INFO:tasks.workunit.client.1.smithi064.stdout:6/224: rename d4/d7/f2c to d4/d7/d12/d38/f4a 0 2024-04-26T21:07:57.935 INFO:tasks.workunit.client.1.smithi064.stdout:6/225: fdatasync d4/d7/d12/d38/f3c 0 2024-04-26T21:07:57.936 INFO:tasks.workunit.client.0.smithi055.stdout:7/154: creat d5/d11/f2f x:0 0 0 2024-04-26T21:07:57.936 INFO:tasks.workunit.client.0.smithi055.stdout:7/155: creat d5/d6/d24/f30 x:0 0 0 2024-04-26T21:07:57.937 INFO:tasks.workunit.client.1.smithi064.stdout:2/254: truncate d12/d16/d29/f2d 2031220 0 2024-04-26T21:07:57.939 INFO:tasks.workunit.client.1.smithi064.stdout:6/226: mkdir d4/d7/d12/d49/d4b 0 2024-04-26T21:07:57.939 INFO:tasks.workunit.client.1.smithi064.stdout:6/227: fdatasync d4/d7/d33/f34 0 2024-04-26T21:07:57.940 INFO:tasks.workunit.client.0.smithi055.stdout:4/100: mknod d4/d18/d1e/c2b 0 2024-04-26T21:07:57.941 INFO:tasks.workunit.client.0.smithi055.stdout:9/107: write d2/fe [4116823,90529] 0 2024-04-26T21:07:57.944 INFO:tasks.workunit.client.1.smithi064.stdout:9/297: read d0/d4/d28/f2d [2710763,93144] 0 2024-04-26T21:07:57.946 INFO:tasks.workunit.client.0.smithi055.stdout:7/156: link d5/d11/f2f d5/d6/f31 0 2024-04-26T21:07:57.949 INFO:tasks.workunit.client.0.smithi055.stdout:4/101: mknod d4/d18/d1e/c2c 0 2024-04-26T21:07:57.952 INFO:tasks.workunit.client.1.smithi064.stdout:6/228: symlink d4/l4c 0 2024-04-26T21:07:57.952 INFO:tasks.workunit.client.1.smithi064.stdout:6/229: readlink d4/d7/d12/d1e/l30 0 2024-04-26T21:07:57.957 INFO:tasks.workunit.client.0.smithi055.stdout:7/157: unlink d5/d11/d18/f22 0 2024-04-26T21:07:57.957 INFO:tasks.workunit.client.0.smithi055.stdout:7/158: chown d5/d11/f17 4091 1 2024-04-26T21:07:57.958 INFO:tasks.workunit.client.0.smithi055.stdout:7/159: creat d5/f32 x:0 0 0 2024-04-26T21:07:57.958 INFO:tasks.workunit.client.0.smithi055.stdout:4/102: mkdir d4/d18/d1e/d2d 0 2024-04-26T21:07:57.958 INFO:tasks.workunit.client.0.smithi055.stdout:4/103: fsync d4/d12/d15/f16 0 2024-04-26T21:07:57.960 INFO:tasks.workunit.client.1.smithi064.stdout:8/230: dread d10/d1d/f1e [0,4194304] 0 2024-04-26T21:07:57.960 INFO:tasks.workunit.client.1.smithi064.stdout:8/231: fsync d10/f12 0 2024-04-26T21:07:57.964 INFO:tasks.workunit.client.1.smithi064.stdout:4/324: getdents d0/d5/d3e/d54 0 2024-04-26T21:07:57.964 INFO:tasks.workunit.client.1.smithi064.stdout:1/335: dread d0/d6/d11/f18 [0,4194304] 0 2024-04-26T21:07:57.965 INFO:tasks.workunit.client.1.smithi064.stdout:6/230: link d4/d7/d12/d38/f3c d4/d7/f4d 0 2024-04-26T21:07:57.965 INFO:tasks.workunit.client.1.smithi064.stdout:8/232: truncate f4 948965 0 2024-04-26T21:07:57.965 INFO:tasks.workunit.client.1.smithi064.stdout:6/231: chown d4/d7/fd 856761741 1 2024-04-26T21:07:57.965 INFO:tasks.workunit.client.1.smithi064.stdout:8/233: chown d10/d1d/l2c 27 1 2024-04-26T21:07:57.966 INFO:tasks.workunit.client.0.smithi055.stdout:4/104: mknod d4/d12/d17/c2e 0 2024-04-26T21:07:57.966 INFO:tasks.workunit.client.0.smithi055.stdout:4/105: fsync d4/d23/f25 0 2024-04-26T21:07:57.971 INFO:tasks.workunit.client.1.smithi064.stdout:5/253: dwrite dd/d12/d18/d1a/d1f/d20/f47 [0,4194304] 0 2024-04-26T21:07:57.971 INFO:tasks.workunit.client.1.smithi064.stdout:5/254: read - dd/d12/d18/d1a/d1f/d20/f38 zero size 2024-04-26T21:07:57.971 INFO:tasks.workunit.client.1.smithi064.stdout:5/255: chown dd/d12/d18/d1a/d1b/f29 46583 1 2024-04-26T21:07:57.971 INFO:tasks.workunit.client.1.smithi064.stdout:5/256: write f0 [2065511,4510] 0 2024-04-26T21:07:57.973 INFO:tasks.workunit.client.1.smithi064.stdout:4/325: creat d0/d5/d13/d33/f6a x:0 0 0 2024-04-26T21:07:57.973 INFO:tasks.workunit.client.1.smithi064.stdout:4/326: chown d0/d14/l27 46 1 2024-04-26T21:07:57.973 INFO:tasks.workunit.client.1.smithi064.stdout:2/255: write d12/d16/d29/f2d [2881698,22831] 0 2024-04-26T21:07:57.973 INFO:tasks.workunit.client.1.smithi064.stdout:2/256: readlink d12/d28/d3a/d46/l55 0 2024-04-26T21:07:57.978 INFO:tasks.workunit.client.1.smithi064.stdout:1/336: symlink d0/d6/d11/d1e/l61 0 2024-04-26T21:07:57.981 INFO:tasks.workunit.client.1.smithi064.stdout:8/234: symlink d10/d41/d44/l49 0 2024-04-26T21:07:57.986 INFO:tasks.workunit.client.0.smithi055.stdout:7/160: getdents d5/d11 0 2024-04-26T21:07:57.991 INFO:tasks.workunit.client.1.smithi064.stdout:7/265: dwrite d6/d9/d38/f42 [0,4194304] 0 2024-04-26T21:07:57.991 INFO:tasks.workunit.client.1.smithi064.stdout:7/266: write d6/d9/f11 [4177185,56010] 0 2024-04-26T21:07:57.994 INFO:tasks.workunit.client.0.smithi055.stdout:7/161: unlink d5/db/f1c 0 2024-04-26T21:07:57.997 INFO:tasks.workunit.client.1.smithi064.stdout:5/257: creat dd/d12/d18/d1a/d1f/f4b x:0 0 0 2024-04-26T21:07:57.997 INFO:tasks.workunit.client.1.smithi064.stdout:5/258: dread - dd/d12/f40 zero size 2024-04-26T21:07:58.001 INFO:tasks.workunit.client.1.smithi064.stdout:1/337: mknod d0/d6/d11/d2c/c62 0 2024-04-26T21:07:58.002 INFO:tasks.workunit.client.1.smithi064.stdout:1/338: creat d0/d6/f63 x:0 0 0 2024-04-26T21:07:58.002 INFO:tasks.workunit.client.1.smithi064.stdout:1/339: readlink d0/d6/d11/d2c/l58 0 2024-04-26T21:07:58.002 INFO:tasks.workunit.client.1.smithi064.stdout:1/340: creat d0/f64 x:0 0 0 2024-04-26T21:07:58.002 INFO:tasks.workunit.client.1.smithi064.stdout:8/235: rename d10/d2f/c42 to d10/d41/d44/c4a 0 2024-04-26T21:07:58.006 INFO:tasks.workunit.client.1.smithi064.stdout:7/267: truncate d6/d9/f1a 921494 0 2024-04-26T21:07:58.007 INFO:tasks.workunit.client.1.smithi064.stdout:5/259: creat dd/d12/d18/d33/d48/f4c x:0 0 0 2024-04-26T21:07:58.010 INFO:tasks.workunit.client.1.smithi064.stdout:0/225: dwrite dd/d1c/d1d/f38 [0,4194304] 0 2024-04-26T21:07:58.011 INFO:tasks.workunit.client.1.smithi064.stdout:1/341: creat d0/d6/d11/d1e/d27/f65 x:0 0 0 2024-04-26T21:07:58.011 INFO:tasks.workunit.client.1.smithi064.stdout:1/342: chown d0/d6/d11/f35 39527 1 2024-04-26T21:07:58.014 INFO:tasks.workunit.client.1.smithi064.stdout:8/236: link d10/d1d/c23 d10/c4b 0 2024-04-26T21:07:58.018 INFO:tasks.workunit.client.1.smithi064.stdout:0/226: symlink dd/d10/d1a/d31/l40 0 2024-04-26T21:07:58.018 INFO:tasks.workunit.client.1.smithi064.stdout:0/227: write dd/d21/f3a [976811,29550] 0 2024-04-26T21:07:58.018 INFO:tasks.workunit.client.1.smithi064.stdout:0/228: creat dd/d10/d1a/d31/f41 x:0 0 0 2024-04-26T21:07:58.035 INFO:tasks.workunit.client.1.smithi064.stdout:0/229: write dd/f12 [1572618,6829] 0 2024-04-26T21:07:58.035 INFO:tasks.workunit.client.1.smithi064.stdout:0/230: stat dd 0 2024-04-26T21:07:58.036 INFO:tasks.workunit.client.1.smithi064.stdout:5/260: dread dd/d12/d18/d1a/d1f/d20/f46 [0,4194304] 0 2024-04-26T21:07:58.038 INFO:tasks.workunit.client.1.smithi064.stdout:5/261: symlink dd/l4d 0 2024-04-26T21:07:58.038 INFO:tasks.workunit.client.1.smithi064.stdout:5/262: read f9 [3321755,109739] 0 2024-04-26T21:07:58.038 INFO:tasks.workunit.client.1.smithi064.stdout:5/263: creat dd/d12/d18/d1a/d1f/d20/f4e x:0 0 0 2024-04-26T21:07:58.044 INFO:tasks.workunit.client.1.smithi064.stdout:2/257: dwrite d12/d16/d2f/f4d [0,4194304] 0 2024-04-26T21:07:58.047 INFO:tasks.workunit.client.1.smithi064.stdout:2/258: creat d12/d41/d52/f5a x:0 0 0 2024-04-26T21:07:58.048 INFO:tasks.workunit.client.1.smithi064.stdout:2/259: rename d12/c47 to d12/d16/d29/c5b 0 2024-04-26T21:07:58.051 INFO:tasks.workunit.client.1.smithi064.stdout:2/260: rename ld to d12/d16/d2f/d53/l5c 0 2024-04-26T21:07:58.056 INFO:tasks.workunit.client.1.smithi064.stdout:7/268: read d6/d5a/f3b [253860,25044] 0 2024-04-26T21:07:58.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/261: mkdir d12/d28/d3a/d5d 0 2024-04-26T21:07:58.059 INFO:tasks.workunit.client.0.smithi055.stdout:0/170: dwrite d9/d27/f37 [0,4194304] 0 2024-04-26T21:07:58.062 INFO:tasks.workunit.client.0.smithi055.stdout:0/171: unlink d9/dc/d1c/d2c/f2d 0 2024-04-26T21:07:58.063 INFO:tasks.workunit.client.1.smithi064.stdout:1/343: write d0/d22/f2b [838020,123288] 0 2024-04-26T21:07:58.064 INFO:tasks.workunit.client.1.smithi064.stdout:1/344: mkdir d0/d6/d11/d1e/d2a/d34/d57/d66 0 2024-04-26T21:07:58.067 INFO:tasks.workunit.client.0.smithi055.stdout:7/162: fsync d5/d6/f31 0 2024-04-26T21:07:58.075 INFO:tasks.workunit.client.0.smithi055.stdout:9/108: dwrite d2/fe [4194304,4194304] 0 2024-04-26T21:07:58.075 INFO:tasks.workunit.client.0.smithi055.stdout:9/109: readlink d2/d14/l19 0 2024-04-26T21:07:58.077 INFO:tasks.workunit.client.0.smithi055.stdout:4/106: dwrite d4/d12/d17/f27 [0,4194304] 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:2/262: dread d12/d1a/f42 [0,4194304] 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:2/263: stat d12/d16/d29/d43 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:2/264: chown d12/d28/d3a/l40 55979842 1 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:1/345: link d0/d6/c59 d0/d6/dd/c67 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:6/232: fsync d4/d7/f4d 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:6/233: write d4/d7/d12/d1e/f39 [804430,87810] 0 2024-04-26T21:07:58.078 INFO:tasks.workunit.client.1.smithi064.stdout:6/234: chown d4/f28 29468 1 2024-04-26T21:07:58.082 INFO:tasks.workunit.client.0.smithi055.stdout:0/172: write d9/d11/f35 [3405935,9374] 0 2024-04-26T21:07:58.083 INFO:tasks.workunit.client.1.smithi064.stdout:2/265: mknod d12/d1a/c5e 0 2024-04-26T21:07:58.083 INFO:tasks.workunit.client.1.smithi064.stdout:2/266: creat d12/d1a/f5f x:0 0 0 2024-04-26T21:07:58.083 INFO:tasks.workunit.client.1.smithi064.stdout:2/267: readlink d12/l26 0 2024-04-26T21:07:58.083 INFO:tasks.workunit.client.1.smithi064.stdout:2/268: truncate d12/d45/f56 763143 0 2024-04-26T21:07:58.083 INFO:tasks.workunit.client.1.smithi064.stdout:2/269: readlink d12/d28/d3a/l40 0 2024-04-26T21:07:58.084 INFO:tasks.workunit.client.1.smithi064.stdout:2/270: fdatasync d12/d1a/f5f 0 2024-04-26T21:07:58.084 INFO:tasks.workunit.client.1.smithi064.stdout:2/271: creat d12/d1a/f60 x:0 0 0 2024-04-26T21:07:58.085 INFO:tasks.workunit.client.1.smithi064.stdout:0/231: dwrite fc [0,4194304] 0 2024-04-26T21:07:58.085 INFO:tasks.workunit.client.1.smithi064.stdout:0/232: readlink dd/d10/d1a/l24 0 2024-04-26T21:07:58.085 INFO:tasks.workunit.client.0.smithi055.stdout:8/79: sync 2024-04-26T21:07:58.086 INFO:tasks.workunit.client.0.smithi055.stdout:1/101: sync 2024-04-26T21:07:58.086 INFO:tasks.workunit.client.0.smithi055.stdout:5/82: sync 2024-04-26T21:07:58.087 INFO:tasks.workunit.client.1.smithi064.stdout:1/346: rename d0/d6/d11/d1e/d27/f2f to d0/d6/d29/f68 0 2024-04-26T21:07:58.087 INFO:tasks.workunit.client.1.smithi064.stdout:1/347: chown d0/d6/d11/d1e/d2a/f5b 9860 1 2024-04-26T21:07:58.090 INFO:tasks.workunit.client.1.smithi064.stdout:5/264: dread f0 [0,4194304] 0 2024-04-26T21:07:58.092 INFO:tasks.workunit.client.1.smithi064.stdout:2/272: truncate d12/d1a/f2c 509 0 2024-04-26T21:07:58.093 INFO:tasks.workunit.client.1.smithi064.stdout:2/273: fdatasync d12/d28/f4c 0 2024-04-26T21:07:58.093 INFO:tasks.workunit.client.1.smithi064.stdout:2/274: fdatasync d12/d41/f4b 0 2024-04-26T21:07:58.093 INFO:tasks.workunit.client.1.smithi064.stdout:2/275: stat d12/d41/l44 0 2024-04-26T21:07:58.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/110: rename d2/lb to d2/d14/l24 0 2024-04-26T21:07:58.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/111: chown d2/f10 39509 1 2024-04-26T21:07:58.102 INFO:tasks.workunit.client.0.smithi055.stdout:0/173: dread d9/dc/d19/f24 [0,4194304] 0 2024-04-26T21:07:58.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/163: dread d5/db/f14 [0,4194304] 0 2024-04-26T21:07:58.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/164: dread - d5/d11/f2f zero size 2024-04-26T21:07:58.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/165: write d5/d6/ff [3415096,78777] 0 2024-04-26T21:07:58.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/107: write d4/f13 [1111603,63925] 0 2024-04-26T21:07:58.105 INFO:tasks.workunit.client.0.smithi055.stdout:4/108: write d4/f9 [5119703,18696] 0 2024-04-26T21:07:58.112 INFO:tasks.workunit.client.1.smithi064.stdout:2/276: mkdir d12/d41/d61 0 2024-04-26T21:07:58.112 INFO:tasks.workunit.client.1.smithi064.stdout:2/277: read - d12/d41/d52/f5a zero size 2024-04-26T21:07:58.114 INFO:tasks.workunit.client.0.smithi055.stdout:8/80: mkdir d3/d9/d1d 0 2024-04-26T21:07:58.121 INFO:tasks.workunit.client.0.smithi055.stdout:1/102: creat d8/df/f24 x:0 0 0 2024-04-26T21:07:58.124 INFO:tasks.workunit.client.0.smithi055.stdout:0/174: symlink d9/dc/d1c/d2c/l3c 0 2024-04-26T21:07:58.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/265: dread f0 [0,4194304] 0 2024-04-26T21:07:58.129 INFO:tasks.workunit.client.1.smithi064.stdout:6/235: dwrite d4/f2f [0,4194304] 0 2024-04-26T21:07:58.129 INFO:tasks.workunit.client.1.smithi064.stdout:6/236: truncate d4/f41 495408 0 2024-04-26T21:07:58.135 INFO:tasks.workunit.client.0.smithi055.stdout:7/166: dread d5/db/fc [0,4194304] 0 2024-04-26T21:07:58.135 INFO:tasks.workunit.client.0.smithi055.stdout:7/167: write d5/d11/f2f [451844,25444] 0 2024-04-26T21:07:58.135 INFO:tasks.workunit.client.0.smithi055.stdout:7/168: write d5/d6/d24/f28 [569755,2201] 0 2024-04-26T21:07:58.135 INFO:tasks.workunit.client.0.smithi055.stdout:7/169: chown d5/d11/f2f 25433 1 2024-04-26T21:07:58.135 INFO:tasks.workunit.client.0.smithi055.stdout:7/170: truncate d5/d6/d24/f28 1456026 0 2024-04-26T21:07:58.136 INFO:tasks.workunit.client.1.smithi064.stdout:0/233: dwrite dd/d10/d1a/d31/f41 [0,4194304] 0 2024-04-26T21:07:58.136 INFO:tasks.workunit.client.1.smithi064.stdout:5/266: dread dd/f13 [0,4194304] 0 2024-04-26T21:07:58.136 INFO:tasks.workunit.client.1.smithi064.stdout:5/267: readlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:07:58.136 INFO:tasks.workunit.client.1.smithi064.stdout:5/268: read - dd/d12/f49 zero size 2024-04-26T21:07:58.136 INFO:tasks.workunit.client.1.smithi064.stdout:5/269: chown dd/d12/d18/d33 1 1 2024-04-26T21:07:58.137 INFO:tasks.workunit.client.0.smithi055.stdout:9/112: write d2/d14/f21 [6967803,51926] 0 2024-04-26T21:07:58.143 INFO:tasks.workunit.client.1.smithi064.stdout:7/269: dwrite d6/d9/d38/f42 [4194304,4194304] 0 2024-04-26T21:07:58.144 INFO:tasks.workunit.client.1.smithi064.stdout:1/348: dwrite d0/d6/ff [0,4194304] 0 2024-04-26T21:07:58.157 INFO:tasks.workunit.client.1.smithi064.stdout:1/349: write d0/d6/d11/d1e/f43 [184670,46710] 0 2024-04-26T21:07:58.157 INFO:tasks.workunit.client.1.smithi064.stdout:1/350: read d0/f4d [535189,15702] 0 2024-04-26T21:07:58.158 INFO:tasks.workunit.client.1.smithi064.stdout:1/351: write d0/d6/d11/f5e [557311,93967] 0 2024-04-26T21:07:58.158 INFO:tasks.workunit.client.1.smithi064.stdout:1/352: creat d0/d6/d11/d1e/d2a/d34/f69 x:0 0 0 2024-04-26T21:07:58.188 INFO:tasks.workunit.client.0.smithi055.stdout:5/83: rename d4/df/l19 to d4/d18/l1c 0 2024-04-26T21:07:58.188 INFO:tasks.workunit.client.0.smithi055.stdout:5/84: chown d4/f10 7 1 2024-04-26T21:07:58.197 INFO:tasks.workunit.client.1.smithi064.stdout:7/270: dwrite d6/d5a/f3b [0,4194304] 0 2024-04-26T21:07:58.197 INFO:tasks.workunit.client.1.smithi064.stdout:7/271: dread - d6/db/d1f/f4c zero size 2024-04-26T21:07:58.198 INFO:tasks.workunit.client.1.smithi064.stdout:7/272: dread - d6/d15/d1c/d45/f4f zero size 2024-04-26T21:07:58.198 INFO:tasks.workunit.client.1.smithi064.stdout:7/273: truncate d6/d15/d1c/f25 4378082 0 2024-04-26T21:07:58.199 INFO:tasks.workunit.client.1.smithi064.stdout:3/233: sync 2024-04-26T21:07:58.206 INFO:tasks.workunit.client.0.smithi055.stdout:7/171: dwrite d5/d6/f31 [0,4194304] 0 2024-04-26T21:07:58.206 INFO:tasks.workunit.client.0.smithi055.stdout:7/172: write d5/db/f14 [4344652,92333] 0 2024-04-26T21:07:58.211 INFO:tasks.workunit.client.0.smithi055.stdout:8/81: mknod d3/d9/d1d/c1e 0 2024-04-26T21:07:58.219 INFO:tasks.workunit.client.0.smithi055.stdout:1/103: mknod d8/d17/d1b/c25 0 2024-04-26T21:07:58.224 INFO:tasks.workunit.client.0.smithi055.stdout:0/175: unlink d9/dc/d17/c39 0 2024-04-26T21:07:58.224 INFO:tasks.workunit.client.0.smithi055.stdout:0/176: read d9/dc/d1c/d2c/f2e [3572630,97044] 0 2024-04-26T21:07:58.229 INFO:tasks.workunit.client.1.smithi064.stdout:0/234: truncate dd/f15 957984 0 2024-04-26T21:07:58.229 INFO:tasks.workunit.client.1.smithi064.stdout:0/235: truncate dd/f30 564745 0 2024-04-26T21:07:58.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/130: sync 2024-04-26T21:07:58.234 INFO:tasks.workunit.client.0.smithi055.stdout:3/102: sync 2024-04-26T21:07:58.234 INFO:tasks.workunit.client.1.smithi064.stdout:5/270: mkdir dd/d12/d4f 0 2024-04-26T21:07:58.235 INFO:tasks.workunit.client.1.smithi064.stdout:5/271: stat f9 0 2024-04-26T21:07:58.238 INFO:tasks.workunit.client.0.smithi055.stdout:6/133: sync 2024-04-26T21:07:58.243 INFO:tasks.workunit.client.0.smithi055.stdout:9/113: getdents d2/d14 0 2024-04-26T21:07:58.251 INFO:tasks.workunit.client.0.smithi055.stdout:1/104: read d8/f15 [3308258,77627] 0 2024-04-26T21:07:58.252 INFO:tasks.workunit.client.0.smithi055.stdout:1/105: write d8/f12 [4561313,48346] 0 2024-04-26T21:07:58.252 INFO:tasks.workunit.client.0.smithi055.stdout:1/106: readlink d8/lc 0 2024-04-26T21:07:58.257 INFO:tasks.workunit.client.0.smithi055.stdout:2/131: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:07:58.270 INFO:tasks.workunit.client.1.smithi064.stdout:1/353: truncate d0/d6/d11/d1e/f21 157848 0 2024-04-26T21:07:58.270 INFO:tasks.workunit.client.1.smithi064.stdout:1/354: write d0/d6/d11/d1e/f20 [313065,75890] 0 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/82: mkdir d3/d9/d1f 0 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/83: stat d3 0 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/84: chown d3/d9/l1b 6217630 1 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/85: stat d3/d9/c16 0 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/86: chown d3/d9/c10 0 1 2024-04-26T21:07:58.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/87: getdents d3/d9/d1f 0 2024-04-26T21:07:58.302 INFO:tasks.workunit.client.0.smithi055.stdout:0/177: mknod d9/d27/c3d 0 2024-04-26T21:07:58.302 INFO:tasks.workunit.client.0.smithi055.stdout:0/178: write d9/d11/f35 [902377,5760] 0 2024-04-26T21:07:58.302 INFO:tasks.workunit.client.0.smithi055.stdout:0/179: fdatasync d9/d27/f37 0 2024-04-26T21:07:58.302 INFO:tasks.workunit.client.0.smithi055.stdout:0/180: fdatasync f8 0 2024-04-26T21:07:58.305 INFO:tasks.workunit.client.0.smithi055.stdout:3/103: link d0/f22 d0/d1/d13/d1a/f24 0 2024-04-26T21:07:58.305 INFO:tasks.workunit.client.0.smithi055.stdout:3/104: chown d0/d4/d16/l1c 12817646 1 2024-04-26T21:07:58.305 INFO:tasks.workunit.client.0.smithi055.stdout:3/105: getdents d0/d4/d16/d18 0 2024-04-26T21:07:58.306 INFO:tasks.workunit.client.0.smithi055.stdout:1/107: dwrite f1 [0,4194304] 0 2024-04-26T21:07:58.306 INFO:tasks.workunit.client.0.smithi055.stdout:1/108: chown d8/f15 187884 1 2024-04-26T21:07:58.306 INFO:tasks.workunit.client.0.smithi055.stdout:1/109: dread - d8/df/f24 zero size 2024-04-26T21:07:58.308 INFO:tasks.workunit.client.0.smithi055.stdout:6/134: creat d3/f27 x:0 0 0 2024-04-26T21:07:58.310 INFO:tasks.workunit.client.0.smithi055.stdout:9/114: symlink d2/d14/l25 0 2024-04-26T21:07:58.310 INFO:tasks.workunit.client.0.smithi055.stdout:3/106: read d0/f19 [1799788,12800] 0 2024-04-26T21:07:58.316 INFO:tasks.workunit.client.0.smithi055.stdout:8/88: symlink d3/d9/d1f/l20 0 2024-04-26T21:07:58.317 INFO:tasks.workunit.client.0.smithi055.stdout:8/89: chown d3/d9 31578159 1 2024-04-26T21:07:58.322 INFO:tasks.workunit.client.0.smithi055.stdout:0/181: dread f8 [0,4194304] 0 2024-04-26T21:07:58.322 INFO:tasks.workunit.client.0.smithi055.stdout:0/182: fsync d9/dc/d17/f1e 0 2024-04-26T21:07:58.323 INFO:tasks.workunit.client.0.smithi055.stdout:1/110: truncate d8/d17/f18 3932925 0 2024-04-26T21:07:58.330 INFO:tasks.workunit.client.0.smithi055.stdout:6/135: rename d3/f23 to d3/d17/d19/d20/f28 0 2024-04-26T21:07:58.332 INFO:tasks.workunit.client.0.smithi055.stdout:3/107: rename d0/d4/d5/c1f to d0/d4/d5/c25 0 2024-04-26T21:07:58.338 INFO:tasks.workunit.client.0.smithi055.stdout:0/183: getdents d9/dc/d1c 0 2024-04-26T21:07:58.338 INFO:tasks.workunit.client.0.smithi055.stdout:0/184: stat d9/d11 0 2024-04-26T21:07:58.338 INFO:tasks.workunit.client.0.smithi055.stdout:0/185: stat d9/dc/d1c/d2c/f2e 0 2024-04-26T21:07:58.341 INFO:tasks.workunit.client.0.smithi055.stdout:1/111: dread f1 [0,4194304] 0 2024-04-26T21:07:58.342 INFO:tasks.workunit.client.0.smithi055.stdout:1/112: creat d8/f26 x:0 0 0 2024-04-26T21:07:58.342 INFO:tasks.workunit.client.0.smithi055.stdout:1/113: chown d8/df/d11 6 1 2024-04-26T21:07:58.342 INFO:tasks.workunit.client.0.smithi055.stdout:6/136: creat d3/d17/f29 x:0 0 0 2024-04-26T21:07:58.345 INFO:tasks.workunit.client.0.smithi055.stdout:8/90: unlink d3/c7 0 2024-04-26T21:07:58.348 INFO:tasks.workunit.client.0.smithi055.stdout:0/186: mkdir d9/dc/d1c/d3e 0 2024-04-26T21:07:58.348 INFO:tasks.workunit.client.0.smithi055.stdout:0/187: creat d9/dc/d17/f3f x:0 0 0 2024-04-26T21:07:58.355 INFO:tasks.workunit.client.0.smithi055.stdout:1/114: mkdir d8/df/d11/d27 0 2024-04-26T21:07:58.355 INFO:tasks.workunit.client.0.smithi055.stdout:1/115: fdatasync f1 0 2024-04-26T21:07:58.360 INFO:tasks.workunit.client.0.smithi055.stdout:6/137: dread f0 [0,4194304] 0 2024-04-26T21:07:58.366 INFO:tasks.workunit.client.0.smithi055.stdout:0/188: creat d9/d27/f40 x:0 0 0 2024-04-26T21:07:58.366 INFO:tasks.workunit.client.0.smithi055.stdout:0/189: chown d9/dc/d19/l22 66891 1 2024-04-26T21:07:58.366 INFO:tasks.workunit.client.0.smithi055.stdout:0/190: chown d9/dc/d1c/d3e 365949 1 2024-04-26T21:07:58.369 INFO:tasks.workunit.client.0.smithi055.stdout:8/91: mknod d3/c21 0 2024-04-26T21:07:58.371 INFO:tasks.workunit.client.1.smithi064.stdout:7/274: mkdir d6/db/d34/d41/d5c 0 2024-04-26T21:07:58.371 INFO:tasks.workunit.client.1.smithi064.stdout:7/275: creat d6/d15/f5d x:0 0 0 2024-04-26T21:07:58.371 INFO:tasks.workunit.client.1.smithi064.stdout:7/276: creat d6/db/d34/d41/f5e x:0 0 0 2024-04-26T21:07:58.374 INFO:tasks.workunit.client.1.smithi064.stdout:3/234: unlink d1/d27/d50/l17 0 2024-04-26T21:07:58.378 INFO:tasks.workunit.client.1.smithi064.stdout:6/237: getdents d4/d7 0 2024-04-26T21:07:58.380 INFO:tasks.workunit.client.0.smithi055.stdout:8/92: mknod d3/d9/c22 0 2024-04-26T21:07:58.380 INFO:tasks.workunit.client.1.smithi064.stdout:6/238: write d4/f28 [418851,128928] 0 2024-04-26T21:07:58.383 INFO:tasks.workunit.client.1.smithi064.stdout:5/272: rmdir dd/d12/d18/d1a/d1b 39 2024-04-26T21:07:58.384 INFO:tasks.workunit.client.1.smithi064.stdout:0/236: read dd/f15 [638175,58476] 0 2024-04-26T21:07:58.385 INFO:tasks.workunit.client.0.smithi055.stdout:9/115: dwrite d2/f22 [0,4194304] 0 2024-04-26T21:07:58.388 INFO:tasks.workunit.client.1.smithi064.stdout:3/235: creat d1/d27/d50/f52 x:0 0 0 2024-04-26T21:07:58.391 INFO:tasks.workunit.client.1.smithi064.stdout:6/239: creat d4/d7/f4e x:0 0 0 2024-04-26T21:07:58.391 INFO:tasks.workunit.client.1.smithi064.stdout:6/240: creat d4/d7/d12/f4f x:0 0 0 2024-04-26T21:07:58.395 INFO:tasks.workunit.client.1.smithi064.stdout:1/355: fsync d0/d6/d11/d1e/d2a/d34/f69 0 2024-04-26T21:07:58.402 INFO:tasks.workunit.client.1.smithi064.stdout:0/237: dread dd/f15 [0,4194304] 0 2024-04-26T21:07:58.403 INFO:tasks.workunit.client.1.smithi064.stdout:0/238: truncate dd/d10/f2e 1016344 0 2024-04-26T21:07:58.404 INFO:tasks.workunit.client.0.smithi055.stdout:3/108: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:07:58.405 INFO:tasks.workunit.client.0.smithi055.stdout:9/116: dread d2/f1e [0,4194304] 0 2024-04-26T21:07:58.405 INFO:tasks.workunit.client.1.smithi064.stdout:0/239: getdents dd/d10 0 2024-04-26T21:07:58.415 INFO:tasks.workunit.client.1.smithi064.stdout:0/240: mkdir dd/d10/d1a/d31/d3e/d42 0 2024-04-26T21:07:58.415 INFO:tasks.workunit.client.1.smithi064.stdout:0/241: chown dd/d10/d1a/d31 79478 1 2024-04-26T21:07:58.417 INFO:tasks.workunit.client.1.smithi064.stdout:0/242: mkdir dd/d10/d1a/d31/d43 0 2024-04-26T21:07:58.417 INFO:tasks.workunit.client.1.smithi064.stdout:6/241: dread d4/d7/d12/d1e/f39 [0,4194304] 0 2024-04-26T21:07:58.421 INFO:tasks.workunit.client.1.smithi064.stdout:0/243: mknod dd/d1c/d1d/c44 0 2024-04-26T21:07:58.421 INFO:tasks.workunit.client.1.smithi064.stdout:0/244: creat dd/d21/f45 x:0 0 0 2024-04-26T21:07:58.429 INFO:tasks.workunit.client.1.smithi064.stdout:3/236: write d1/fc [2220003,29708] 0 2024-04-26T21:07:58.437 INFO:tasks.workunit.client.0.smithi055.stdout:3/109: rmdir d0 39 2024-04-26T21:07:58.438 INFO:tasks.workunit.client.0.smithi055.stdout:6/138: rmdir d3 39 2024-04-26T21:07:58.439 INFO:tasks.workunit.client.0.smithi055.stdout:3/110: unlink d0/d1/d13/f1b 0 2024-04-26T21:07:58.440 INFO:tasks.workunit.client.0.smithi055.stdout:6/139: symlink d3/d17/d19/d20/l2a 0 2024-04-26T21:07:58.442 INFO:tasks.workunit.client.0.smithi055.stdout:3/111: creat d0/d4/d16/f26 x:0 0 0 2024-04-26T21:07:58.445 INFO:tasks.workunit.client.0.smithi055.stdout:6/140: creat d3/d17/d25/f2b x:0 0 0 2024-04-26T21:07:58.457 INFO:tasks.workunit.client.1.smithi064.stdout:2/278: rmdir d12/d45 39 2024-04-26T21:07:58.457 INFO:tasks.workunit.client.1.smithi064.stdout:2/279: fdatasync d12/d28/f35 0 2024-04-26T21:07:58.457 INFO:tasks.workunit.client.1.smithi064.stdout:2/280: truncate d12/d28/f33 1698024 0 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:9/298: sync 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:4/327: sync 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:4/328: chown d0/d5/d3e/f67 0 1 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:2/281: mknod d12/d28/d3a/d3e/c62 0 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:2/282: fsync d12/d16/d29/f49 0 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:2/283: read - d12/d41/d52/f5a zero size 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:8/237: sync 2024-04-26T21:07:58.458 INFO:tasks.workunit.client.1.smithi064.stdout:2/284: stat d12/d41/f4b 0 2024-04-26T21:07:58.459 INFO:tasks.workunit.client.1.smithi064.stdout:8/238: write f4 [1017304,93112] 0 2024-04-26T21:07:58.459 INFO:tasks.workunit.client.1.smithi064.stdout:8/239: creat d10/d2f/f4c x:0 0 0 2024-04-26T21:07:58.462 INFO:tasks.workunit.client.0.smithi055.stdout:8/93: rename f2 to d3/d9/d1f/f23 0 2024-04-26T21:07:58.465 INFO:tasks.workunit.client.1.smithi064.stdout:4/329: rename d0/d5/cb to d0/d2f/d69/c6b 0 2024-04-26T21:07:58.465 INFO:tasks.workunit.client.1.smithi064.stdout:4/330: write d0/d1d/d21/f4e [356407,49219] 0 2024-04-26T21:07:58.467 INFO:tasks.workunit.client.0.smithi055.stdout:6/141: rename d3/d17/d19/c24 to d3/d17/d25/c2c 0 2024-04-26T21:07:58.469 INFO:tasks.workunit.client.0.smithi055.stdout:3/112: write d0/d4/d5/f21 [2026244,110619] 0 2024-04-26T21:07:58.470 INFO:tasks.workunit.client.0.smithi055.stdout:8/94: fsync d3/f18 0 2024-04-26T21:07:58.473 INFO:tasks.workunit.client.0.smithi055.stdout:6/142: unlink d3/f11 0 2024-04-26T21:07:58.475 INFO:tasks.workunit.client.1.smithi064.stdout:4/331: rename d0/d1d/d17/d44/f53 to d0/d14/f6c 0 2024-04-26T21:07:58.477 INFO:tasks.workunit.client.0.smithi055.stdout:3/113: mkdir d0/d1/d13/d27 0 2024-04-26T21:07:58.478 INFO:tasks.workunit.client.0.smithi055.stdout:9/117: dwrite d2/f1a [0,4194304] 0 2024-04-26T21:07:58.478 INFO:tasks.workunit.client.0.smithi055.stdout:9/118: dread - d2/d11/f1f zero size 2024-04-26T21:07:58.478 INFO:tasks.workunit.client.0.smithi055.stdout:9/119: fsync d2/f1e 0 2024-04-26T21:07:58.479 INFO:tasks.workunit.client.0.smithi055.stdout:9/120: creat d2/d11/f26 x:0 0 0 2024-04-26T21:07:58.481 INFO:tasks.workunit.client.0.smithi055.stdout:8/95: read d3/d9/fe [456985,121592] 0 2024-04-26T21:07:58.485 INFO:tasks.workunit.client.0.smithi055.stdout:6/143: mknod d3/d17/d19/d20/c2d 0 2024-04-26T21:07:58.485 INFO:tasks.workunit.client.0.smithi055.stdout:6/144: chown d3/d17/d25/f2b 468937661 1 2024-04-26T21:07:58.486 INFO:tasks.workunit.client.0.smithi055.stdout:3/114: link d0/d4/d16/f26 d0/d1/d23/f28 0 2024-04-26T21:07:58.492 INFO:tasks.workunit.client.0.smithi055.stdout:3/115: write d0/d1/d13/f1d [234663,66135] 0 2024-04-26T21:07:58.492 INFO:tasks.workunit.client.1.smithi064.stdout:4/332: rename d0/d5/d2a to d0/d5/d13/d6d 0 2024-04-26T21:07:58.494 INFO:tasks.workunit.client.1.smithi064.stdout:9/299: creat d0/f64 x:0 0 0 2024-04-26T21:07:58.494 INFO:tasks.workunit.client.1.smithi064.stdout:9/300: write d0/d4/da/d31/d34/f49 [1037137,70078] 0 2024-04-26T21:07:58.496 INFO:tasks.workunit.client.0.smithi055.stdout:9/121: rmdir d2/d14 39 2024-04-26T21:07:58.498 INFO:tasks.workunit.client.1.smithi064.stdout:4/333: mknod d0/d14/c6e 0 2024-04-26T21:07:58.499 INFO:tasks.workunit.client.1.smithi064.stdout:3/237: read d1/d12/f44 [2137422,54249] 0 2024-04-26T21:07:58.499 INFO:tasks.workunit.client.1.smithi064.stdout:3/238: dread - d1/d38/f49 zero size 2024-04-26T21:07:58.499 INFO:tasks.workunit.client.0.smithi055.stdout:6/145: creat d3/d17/d19/f2e x:0 0 0 2024-04-26T21:07:58.500 INFO:tasks.workunit.client.0.smithi055.stdout:6/146: dread - d3/d17/d19/f2e zero size 2024-04-26T21:07:58.501 INFO:tasks.workunit.client.1.smithi064.stdout:4/334: creat d0/d2f/f6f x:0 0 0 2024-04-26T21:07:58.505 INFO:tasks.workunit.client.1.smithi064.stdout:3/239: mknod d1/d27/c53 0 2024-04-26T21:07:58.507 INFO:tasks.workunit.client.0.smithi055.stdout:3/116: symlink d0/d1/d23/l29 0 2024-04-26T21:07:58.509 INFO:tasks.workunit.client.1.smithi064.stdout:4/335: creat d0/d1d/f70 x:0 0 0 2024-04-26T21:07:58.509 INFO:tasks.workunit.client.1.smithi064.stdout:4/336: truncate d0/d1d/d21/f47 1187013 0 2024-04-26T21:07:58.509 INFO:tasks.workunit.client.1.smithi064.stdout:4/337: readlink d0/d5/l6 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/242: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/243: chown d4/d7/d12/c2a 8791811 1 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/244: stat d4/d7/d12/d49/d4b 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/245: fdatasync d4/d7/d12/f4f 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/246: write d4/d7/fe [3213543,33528] 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/247: creat d4/d7/d33/f50 x:0 0 0 2024-04-26T21:07:58.513 INFO:tasks.workunit.client.1.smithi064.stdout:6/248: truncate d4/d7/f4d 776516 0 2024-04-26T21:07:58.514 INFO:tasks.workunit.client.1.smithi064.stdout:6/249: write d4/d7/d12/f18 [2839199,121659] 0 2024-04-26T21:07:58.514 INFO:tasks.workunit.client.0.smithi055.stdout:9/122: chown d2/l9 575905 1 2024-04-26T21:07:58.515 INFO:tasks.workunit.client.1.smithi064.stdout:7/277: dwrite d6/db/d34/d41/f5e [0,4194304] 0 2024-04-26T21:07:58.515 INFO:tasks.workunit.client.1.smithi064.stdout:7/278: readlink d6/l7 0 2024-04-26T21:07:58.516 INFO:tasks.workunit.client.1.smithi064.stdout:7/279: write d6/db/d1f/d50/f57 [364948,22923] 0 2024-04-26T21:07:58.516 INFO:tasks.workunit.client.1.smithi064.stdout:7/280: write f5 [3639432,19320] 0 2024-04-26T21:07:58.516 INFO:tasks.workunit.client.1.smithi064.stdout:1/356: dwrite d0/d6/dd/f5c [0,4194304] 0 2024-04-26T21:07:58.516 INFO:tasks.workunit.client.1.smithi064.stdout:1/357: chown d0/d6/dd/f5c 87 1 2024-04-26T21:07:58.516 INFO:tasks.workunit.client.1.smithi064.stdout:3/240: rmdir d1/d27/d2c 39 2024-04-26T21:07:58.517 INFO:tasks.workunit.client.0.smithi055.stdout:6/147: rmdir d3/d17/d19/d20 39 2024-04-26T21:07:58.519 INFO:tasks.workunit.client.1.smithi064.stdout:4/338: link d0/d5/d13/d6d/c41 d0/d1d/d21/c71 0 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.0.smithi055.stdout:3/117: dread d0/f19 [0,4194304] 0 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.0.smithi055.stdout:3/118: dread - d0/d1/d13/d1a/f24 zero size 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.0.smithi055.stdout:3/119: readlink d0/d4/ld 0 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.0.smithi055.stdout:3/120: fdatasync d0/d4/d5/f6 0 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.0.smithi055.stdout:3/121: chown d0/d1/d13/c20 937 1 2024-04-26T21:07:58.526 INFO:tasks.workunit.client.1.smithi064.stdout:2/285: dwrite d12/d41/d52/f5a [0,4194304] 0 2024-04-26T21:07:58.527 INFO:tasks.workunit.client.1.smithi064.stdout:6/250: fdatasync d4/d7/fe 0 2024-04-26T21:07:58.528 INFO:tasks.workunit.client.1.smithi064.stdout:7/281: mkdir d6/d5a/d5f 0 2024-04-26T21:07:58.529 INFO:tasks.workunit.client.0.smithi055.stdout:3/122: mknod d0/d1/d13/d1a/c2a 0 2024-04-26T21:07:58.532 INFO:tasks.workunit.client.1.smithi064.stdout:6/251: dread d4/d7/d12/d1e/f2b [0,4194304] 0 2024-04-26T21:07:58.534 INFO:tasks.workunit.client.1.smithi064.stdout:1/358: unlink d0/f64 0 2024-04-26T21:07:58.536 INFO:tasks.workunit.client.1.smithi064.stdout:3/241: mknod d1/d27/d50/d22/d26/c54 0 2024-04-26T21:07:58.537 INFO:tasks.workunit.client.0.smithi055.stdout:8/96: creat d3/d9/f24 x:0 0 0 2024-04-26T21:07:58.537 INFO:tasks.workunit.client.1.smithi064.stdout:0/245: dwrite dd/d10/d1a/d31/f41 [0,4194304] 0 2024-04-26T21:07:58.537 INFO:tasks.workunit.client.1.smithi064.stdout:8/240: dwrite f4 [0,4194304] 0 2024-04-26T21:07:58.540 INFO:tasks.workunit.client.1.smithi064.stdout:4/339: stat d0/d2f/d69/c6b 0 2024-04-26T21:07:58.544 INFO:tasks.workunit.client.1.smithi064.stdout:2/286: rmdir d12/d28/d54 0 2024-04-26T21:07:58.544 INFO:tasks.workunit.client.1.smithi064.stdout:7/282: truncate d6/d9/d38/f42 875961 0 2024-04-26T21:07:58.544 INFO:tasks.workunit.client.1.smithi064.stdout:7/283: stat d6/d9/d3d/d58 0 2024-04-26T21:07:58.551 INFO:tasks.workunit.client.1.smithi064.stdout:1/359: truncate d0/d6/d11/d1e/f20 1833668 0 2024-04-26T21:07:58.566 INFO:tasks.workunit.client.1.smithi064.stdout:8/241: rename d10/d1d/d38/f46 to d10/f4d 0 2024-04-26T21:07:58.570 INFO:tasks.workunit.client.1.smithi064.stdout:9/301: dwrite d0/d4/d7/f54 [0,4194304] 0 2024-04-26T21:07:58.570 INFO:tasks.workunit.client.1.smithi064.stdout:2/287: mknod d12/d28/d3a/d46/c63 0 2024-04-26T21:07:58.576 INFO:tasks.workunit.client.0.smithi055.stdout:6/148: dwrite f1 [0,4194304] 0 2024-04-26T21:07:58.578 INFO:tasks.workunit.client.1.smithi064.stdout:4/340: link d0/d2f/f6f d0/d5/d3e/d54/f72 0 2024-04-26T21:07:58.578 INFO:tasks.workunit.client.0.smithi055.stdout:6/149: stat d3/d17/d19/d20 0 2024-04-26T21:07:58.583 INFO:tasks.workunit.client.0.smithi055.stdout:6/150: write d3/f9 [117749,91735] 0 2024-04-26T21:07:58.588 INFO:tasks.workunit.client.1.smithi064.stdout:1/360: write d0/d6/dd/f5c [2601173,101109] 0 2024-04-26T21:07:58.594 INFO:tasks.workunit.client.1.smithi064.stdout:2/288: read d12/d41/f4b [1999842,86934] 0 2024-04-26T21:07:58.594 INFO:tasks.workunit.client.1.smithi064.stdout:2/289: fsync d12/d1a/f60 0 2024-04-26T21:07:58.594 INFO:tasks.workunit.client.1.smithi064.stdout:5/273: sync 2024-04-26T21:07:58.594 INFO:tasks.workunit.client.1.smithi064.stdout:2/290: readlink d12/d16/d2f/d53/l5c 0 2024-04-26T21:07:58.596 INFO:tasks.workunit.client.1.smithi064.stdout:5/274: unlink dd/d12/d18/d1a/d1b/l21 0 2024-04-26T21:07:58.596 INFO:tasks.workunit.client.1.smithi064.stdout:9/302: write d0/d4/d7/f54 [2442672,75083] 0 2024-04-26T21:07:58.598 INFO:tasks.workunit.client.1.smithi064.stdout:5/275: rename dd/d12/d18/d1a/d1b/l43 to dd/d12/d18/d1a/d1b/l50 0 2024-04-26T21:07:58.598 INFO:tasks.workunit.client.1.smithi064.stdout:5/276: write dd/d12/d18/d25/d32/f37 [514327,103480] 0 2024-04-26T21:07:58.600 INFO:tasks.workunit.client.0.smithi055.stdout:6/151: dread d3/d17/f18 [0,4194304] 0 2024-04-26T21:07:58.601 INFO:tasks.workunit.client.0.smithi055.stdout:6/152: mknod d3/d17/d19/c2f 0 2024-04-26T21:07:58.602 INFO:tasks.workunit.client.1.smithi064.stdout:0/246: write fc [3035949,84520] 0 2024-04-26T21:07:58.603 INFO:tasks.workunit.client.0.smithi055.stdout:6/153: creat d3/f30 x:0 0 0 2024-04-26T21:07:58.605 INFO:tasks.workunit.client.0.smithi055.stdout:6/154: unlink d3/f27 0 2024-04-26T21:07:58.607 INFO:tasks.workunit.client.0.smithi055.stdout:6/155: truncate d3/f16 2133059 0 2024-04-26T21:07:58.609 INFO:tasks.workunit.client.1.smithi064.stdout:5/277: unlink dd/d12/d18/d1a/d1b/f3c 0 2024-04-26T21:07:58.610 INFO:tasks.workunit.client.1.smithi064.stdout:7/284: dread d6/d9/d38/f3a [0,4194304] 0 2024-04-26T21:07:58.610 INFO:tasks.workunit.client.1.smithi064.stdout:7/285: readlink d6/d15/l21 0 2024-04-26T21:07:58.610 INFO:tasks.workunit.client.1.smithi064.stdout:7/286: stat d6/d15/d1c/l46 0 2024-04-26T21:07:58.610 INFO:tasks.workunit.client.1.smithi064.stdout:7/287: truncate d6/db/f29 1223103 0 2024-04-26T21:07:58.610 INFO:tasks.workunit.client.1.smithi064.stdout:4/341: dread d0/d5/d13/f36 [0,4194304] 0 2024-04-26T21:07:58.611 INFO:tasks.workunit.client.1.smithi064.stdout:4/342: rmdir d0/d1d/d17/d44/d45 39 2024-04-26T21:07:58.614 INFO:tasks.workunit.client.1.smithi064.stdout:8/242: read ff [5803427,86719] 0 2024-04-26T21:07:58.615 INFO:tasks.workunit.client.0.smithi055.stdout:3/123: dwrite d0/d4/d16/f26 [0,4194304] 0 2024-04-26T21:07:58.616 INFO:tasks.workunit.client.1.smithi064.stdout:6/252: dwrite d4/d7/f35 [0,4194304] 0 2024-04-26T21:07:58.621 INFO:tasks.workunit.client.1.smithi064.stdout:1/361: dread d0/d22/f3c [0,4194304] 0 2024-04-26T21:07:58.636 INFO:tasks.workunit.client.1.smithi064.stdout:6/253: creat d4/d7/d12/d38/f51 x:0 0 0 2024-04-26T21:07:58.636 INFO:tasks.workunit.client.1.smithi064.stdout:6/254: truncate d4/d7/d12/f48 171789 0 2024-04-26T21:07:58.636 INFO:tasks.workunit.client.1.smithi064.stdout:1/362: rename d0/d6/d11/d2c/f4b to d0/d6/d11/d1e/d2a/d34/d57/d66/f6a 0 2024-04-26T21:07:58.636 INFO:tasks.workunit.client.1.smithi064.stdout:1/363: write d0/d6/d11/d1e/d2a/d34/d57/d66/f6a [679976,62749] 0 2024-04-26T21:07:58.636 INFO:tasks.workunit.client.1.smithi064.stdout:1/364: truncate d0/d6/d11/d1e/f21 338600 0 2024-04-26T21:07:58.642 INFO:tasks.workunit.client.0.smithi055.stdout:8/97: dwrite d3/d9/d1f/f23 [0,4194304] 0 2024-04-26T21:07:58.644 INFO:tasks.workunit.client.1.smithi064.stdout:1/365: unlink d0/d6/d11/d1e/d27/c3d 0 2024-04-26T21:07:58.644 INFO:tasks.workunit.client.1.smithi064.stdout:1/366: dread - d0/d6/d29/d31/f51 zero size 2024-04-26T21:07:58.646 INFO:tasks.workunit.client.1.smithi064.stdout:1/367: mkdir d0/d6b 0 2024-04-26T21:07:58.647 INFO:tasks.workunit.client.0.smithi055.stdout:8/98: truncate d3/f14 133372 0 2024-04-26T21:07:58.649 INFO:tasks.workunit.client.1.smithi064.stdout:1/368: mkdir d0/d6/d11/d6c 0 2024-04-26T21:07:58.651 INFO:tasks.workunit.client.1.smithi064.stdout:2/291: dwrite d12/d28/f33 [0,4194304] 0 2024-04-26T21:07:58.651 INFO:tasks.workunit.client.1.smithi064.stdout:2/292: creat d12/d28/d3a/f64 x:0 0 0 2024-04-26T21:07:58.651 INFO:tasks.workunit.client.1.smithi064.stdout:1/369: symlink d0/d6/d11/d1e/d2a/l6d 0 2024-04-26T21:07:58.663 INFO:tasks.workunit.client.1.smithi064.stdout:1/370: creat d0/d6/d11/d1e/d2a/d34/d57/d66/f6e x:0 0 0 2024-04-26T21:07:58.663 INFO:tasks.workunit.client.1.smithi064.stdout:3/242: dwrite d1/f51 [0,4194304] 0 2024-04-26T21:07:58.665 INFO:tasks.workunit.client.1.smithi064.stdout:9/303: dread d0/d4/d7/df/f40 [0,4194304] 0 2024-04-26T21:07:58.666 INFO:tasks.workunit.client.1.smithi064.stdout:9/304: creat d0/d4/da/d26/d47/f65 x:0 0 0 2024-04-26T21:07:58.667 INFO:tasks.workunit.client.1.smithi064.stdout:3/243: mkdir d1/d27/d50/d35/d4c/d55 0 2024-04-26T21:07:58.671 INFO:tasks.workunit.client.1.smithi064.stdout:9/305: truncate d0/d4/da/f14 416999 0 2024-04-26T21:07:58.673 INFO:tasks.workunit.client.1.smithi064.stdout:8/243: dread d10/d2f/f33 [0,4194304] 0 2024-04-26T21:07:58.673 INFO:tasks.workunit.client.1.smithi064.stdout:3/244: mknod d1/d27/d29/c56 0 2024-04-26T21:07:58.673 INFO:tasks.workunit.client.1.smithi064.stdout:8/244: fdatasync d10/f1b 0 2024-04-26T21:07:58.673 INFO:tasks.workunit.client.1.smithi064.stdout:8/245: fdatasync d10/d2f/f3a 0 2024-04-26T21:07:58.673 INFO:tasks.workunit.client.1.smithi064.stdout:9/306: rename d0/d4/da/l1a to d0/d4/d7/df/l66 0 2024-04-26T21:07:58.674 INFO:tasks.workunit.client.1.smithi064.stdout:3/245: creat d1/d27/d2c/f57 x:0 0 0 2024-04-26T21:07:58.675 INFO:tasks.workunit.client.1.smithi064.stdout:9/307: mkdir d0/d4/da/d67 0 2024-04-26T21:07:58.675 INFO:tasks.workunit.client.1.smithi064.stdout:9/308: write d0/d4/d7/f20 [1722233,15370] 0 2024-04-26T21:07:58.677 INFO:tasks.workunit.client.0.smithi055.stdout:6/156: dwrite d3/d17/d19/f1e [0,4194304] 0 2024-04-26T21:07:58.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/246: rename d10/d31 to d10/d41/d4e 0 2024-04-26T21:07:58.678 INFO:tasks.workunit.client.1.smithi064.stdout:9/309: creat d0/d4/da/d26/d5d/f68 x:0 0 0 2024-04-26T21:07:58.680 INFO:tasks.workunit.client.1.smithi064.stdout:7/288: dread d6/d9/f36 [0,4194304] 0 2024-04-26T21:07:58.682 INFO:tasks.workunit.client.1.smithi064.stdout:9/310: read d0/d4/da/d26/d47/f4b [653786,46554] 0 2024-04-26T21:07:58.683 INFO:tasks.workunit.client.1.smithi064.stdout:7/289: rename d6/d15/d1c/c4e to d6/d9/d3d/c60 0 2024-04-26T21:07:58.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/157: dread d3/d17/d19/d20/f22 [0,4194304] 0 2024-04-26T21:07:58.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/158: chown d3/d17 3 1 2024-04-26T21:07:58.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/159: chown d3/d17/f18 151651 1 2024-04-26T21:07:58.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/160: symlink d3/l31 0 2024-04-26T21:07:58.691 INFO:tasks.workunit.client.0.smithi055.stdout:6/161: chown d3/d17/d19/d20 222 1 2024-04-26T21:07:58.693 INFO:tasks.workunit.client.1.smithi064.stdout:9/311: unlink d0/d4/da/c38 0 2024-04-26T21:07:58.693 INFO:tasks.workunit.client.1.smithi064.stdout:2/293: write d12/d16/f19 [7528969,67286] 0 2024-04-26T21:07:58.693 INFO:tasks.workunit.client.1.smithi064.stdout:2/294: truncate d12/f34 4903912 0 2024-04-26T21:07:58.703 INFO:tasks.workunit.client.1.smithi064.stdout:4/343: dwrite d0/d1d/d17/d44/d45/f5c [0,4194304] 0 2024-04-26T21:07:58.703 INFO:tasks.workunit.client.1.smithi064.stdout:4/344: read - d0/d5/d13/f60 zero size 2024-04-26T21:07:58.708 INFO:tasks.workunit.client.1.smithi064.stdout:2/295: mkdir d12/d28/d3a/d3e/d65 0 2024-04-26T21:07:58.708 INFO:tasks.workunit.client.1.smithi064.stdout:4/345: rename d0/d5/d13/d33/c3c to d0/d1d/d21/c73 0 2024-04-26T21:07:58.709 INFO:tasks.workunit.client.1.smithi064.stdout:2/296: unlink d12/d41/l44 0 2024-04-26T21:07:58.710 INFO:tasks.workunit.client.1.smithi064.stdout:2/297: link d12/d16/d2f/l51 d12/d16/d57/l66 0 2024-04-26T21:07:58.713 INFO:tasks.workunit.client.1.smithi064.stdout:2/298: unlink d12/d1a/f5f 0 2024-04-26T21:07:58.714 INFO:tasks.workunit.client.1.smithi064.stdout:2/299: chown c4 59005872 1 2024-04-26T21:07:58.719 INFO:tasks.workunit.client.1.smithi064.stdout:9/312: read d0/d4/d7/df/f40 [2510549,80233] 0 2024-04-26T21:07:58.719 INFO:tasks.workunit.client.1.smithi064.stdout:5/278: dwrite f0 [0,4194304] 0 2024-04-26T21:07:58.719 INFO:tasks.workunit.client.1.smithi064.stdout:6/255: dwrite d4/d7/d12/f4f [0,4194304] 0 2024-04-26T21:07:58.722 INFO:tasks.workunit.client.0.smithi055.stdout:8/99: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:07:58.723 INFO:tasks.workunit.client.1.smithi064.stdout:6/256: rename d4/l26 to d4/d7/d12/d38/l52 0 2024-04-26T21:07:58.723 INFO:tasks.workunit.client.0.smithi055.stdout:3/124: dwrite d0/f12 [0,4194304] 0 2024-04-26T21:07:58.730 INFO:tasks.workunit.client.1.smithi064.stdout:1/371: dwrite d0/d6/d11/f35 [0,4194304] 0 2024-04-26T21:07:58.730 INFO:tasks.workunit.client.1.smithi064.stdout:0/247: dwrite dd/f30 [0,4194304] 0 2024-04-26T21:07:58.730 INFO:tasks.workunit.client.1.smithi064.stdout:0/248: fdatasync dd/d10/d1a/d31/f41 0 2024-04-26T21:07:58.730 INFO:tasks.workunit.client.0.smithi055.stdout:3/125: mknod d0/d1/d23/c2b 0 2024-04-26T21:07:58.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/126: readlink d0/d4/d5/lc 0 2024-04-26T21:07:58.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/127: dread - d0/d1/d13/d1a/f24 zero size 2024-04-26T21:07:58.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/128: chown d0/d1/d23/f28 313276575 1 2024-04-26T21:07:58.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/129: unlink d0/f12 0 2024-04-26T21:07:58.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/130: creat d0/d4/d5/f2c x:0 0 0 2024-04-26T21:07:58.733 INFO:tasks.workunit.client.1.smithi064.stdout:4/346: dread d0/d1d/d17/d57/f5e [0,4194304] 0 2024-04-26T21:07:58.734 INFO:tasks.workunit.client.1.smithi064.stdout:5/279: symlink dd/d12/d18/d25/d32/l51 0 2024-04-26T21:07:58.734 INFO:tasks.workunit.client.1.smithi064.stdout:4/347: write d0/d5/d3e/f67 [999200,106508] 0 2024-04-26T21:07:58.734 INFO:tasks.workunit.client.1.smithi064.stdout:2/300: write d12/d1a/f42 [3654617,42041] 0 2024-04-26T21:07:58.734 INFO:tasks.workunit.client.1.smithi064.stdout:2/301: creat d12/d16/f67 x:0 0 0 2024-04-26T21:07:58.735 INFO:tasks.workunit.client.0.smithi055.stdout:3/131: symlink d0/de/l2d 0 2024-04-26T21:07:58.741 INFO:tasks.workunit.client.0.smithi055.stdout:8/100: dread d3/d9/d1f/f23 [0,4194304] 0 2024-04-26T21:07:58.741 INFO:tasks.workunit.client.0.smithi055.stdout:8/101: write f1 [2880080,90820] 0 2024-04-26T21:07:58.742 INFO:tasks.workunit.client.1.smithi064.stdout:1/372: symlink d0/d6/d11/l6f 0 2024-04-26T21:07:58.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/249: link dd/d10/d18/c3f dd/d10/d1a/d31/d3e/d42/c46 0 2024-04-26T21:07:58.746 INFO:tasks.workunit.client.1.smithi064.stdout:4/348: truncate d0/d1d/f49 1808055 0 2024-04-26T21:07:58.748 INFO:tasks.workunit.client.1.smithi064.stdout:2/302: rmdir d12/d28/d3a/d3e/d65 0 2024-04-26T21:07:58.749 INFO:tasks.workunit.client.1.smithi064.stdout:2/303: rename d12/d28 to d12/d28/d3a/d3e/d68 22 2024-04-26T21:07:58.750 INFO:tasks.workunit.client.1.smithi064.stdout:0/250: mkdir dd/d10/d1a/d31/d47 0 2024-04-26T21:07:58.754 INFO:tasks.workunit.client.1.smithi064.stdout:2/304: mknod d12/c69 0 2024-04-26T21:07:58.754 INFO:tasks.workunit.client.1.smithi064.stdout:2/305: chown d12/d28/f3f 62329 1 2024-04-26T21:07:58.754 INFO:tasks.workunit.client.1.smithi064.stdout:4/349: creat d0/d5/f74 x:0 0 0 2024-04-26T21:07:58.754 INFO:tasks.workunit.client.1.smithi064.stdout:2/306: chown d12/d28/d3a 7659340 1 2024-04-26T21:07:58.754 INFO:tasks.workunit.client.1.smithi064.stdout:1/373: getdents d0/d6/d11/d1e 0 2024-04-26T21:07:58.758 INFO:tasks.workunit.client.1.smithi064.stdout:4/350: creat d0/d1d/d17/d44/d45/f75 x:0 0 0 2024-04-26T21:07:58.758 INFO:tasks.workunit.client.1.smithi064.stdout:4/351: fsync d0/d5/d13/d6d/f64 0 2024-04-26T21:07:58.758 INFO:tasks.workunit.client.1.smithi064.stdout:4/352: chown d0/d5/d13/f36 7347607 1 2024-04-26T21:07:58.759 INFO:tasks.workunit.client.1.smithi064.stdout:1/374: creat d0/d6/f70 x:0 0 0 2024-04-26T21:07:58.761 INFO:tasks.workunit.client.0.smithi055.stdout:4/109: sync 2024-04-26T21:07:58.764 INFO:tasks.workunit.client.0.smithi055.stdout:5/85: sync 2024-04-26T21:07:58.764 INFO:tasks.workunit.client.0.smithi055.stdout:5/86: stat f0 0 2024-04-26T21:07:58.764 INFO:tasks.workunit.client.0.smithi055.stdout:5/87: dread - d4/d15/f1a zero size 2024-04-26T21:07:58.764 INFO:tasks.workunit.client.0.smithi055.stdout:5/88: chown d4/f8 2482160 1 2024-04-26T21:07:58.764 INFO:tasks.workunit.client.0.smithi055.stdout:5/89: chown d4 0 1 2024-04-26T21:07:58.765 INFO:tasks.workunit.client.0.smithi055.stdout:3/132: getdents d0/d4/d5 0 2024-04-26T21:07:58.765 INFO:tasks.workunit.client.0.smithi055.stdout:3/133: write d0/d1/f14 [1071690,33202] 0 2024-04-26T21:07:58.765 INFO:tasks.workunit.client.0.smithi055.stdout:3/134: chown d0/d1/l2 426 1 2024-04-26T21:07:58.765 INFO:tasks.workunit.client.1.smithi064.stdout:7/290: dwrite d6/f51 [0,4194304] 0 2024-04-26T21:07:58.765 INFO:tasks.workunit.client.1.smithi064.stdout:2/307: rename d12/d41/d52 to d12/d28/d3a/d46/d6a 0 2024-04-26T21:07:58.767 INFO:tasks.workunit.client.0.smithi055.stdout:5/90: rmdir d4/df/d13 39 2024-04-26T21:07:58.767 INFO:tasks.workunit.client.1.smithi064.stdout:9/313: dwrite d0/d4/da/d26/d47/f65 [0,4194304] 0 2024-04-26T21:07:58.769 INFO:tasks.workunit.client.0.smithi055.stdout:3/135: link d0/f19 d0/d1/f2e 0 2024-04-26T21:07:58.769 INFO:tasks.workunit.client.0.smithi055.stdout:3/136: chown d0/d4/d16/l1c 10447 1 2024-04-26T21:07:58.770 INFO:tasks.workunit.client.1.smithi064.stdout:7/291: rmdir d6/d9/d3d 39 2024-04-26T21:07:58.771 INFO:tasks.workunit.client.1.smithi064.stdout:4/353: rename d0/d5/d13/d33/f6a to d0/d1d/d21/f76 0 2024-04-26T21:07:58.776 INFO:tasks.workunit.client.0.smithi055.stdout:5/91: creat d4/df/d13/f1d x:0 0 0 2024-04-26T21:07:58.781 INFO:tasks.workunit.client.1.smithi064.stdout:0/251: read dd/d10/d1a/d31/f41 [1829788,49322] 0 2024-04-26T21:07:58.783 INFO:tasks.workunit.client.1.smithi064.stdout:1/375: dread d0/f12 [0,4194304] 0 2024-04-26T21:07:58.786 INFO:tasks.workunit.client.1.smithi064.stdout:9/314: creat d0/d4/da/d26/d5e/f69 x:0 0 0 2024-04-26T21:07:58.786 INFO:tasks.workunit.client.1.smithi064.stdout:9/315: write d0/d4/da/d26/d47/f4b [713851,88135] 0 2024-04-26T21:07:58.786 INFO:tasks.workunit.client.1.smithi064.stdout:9/316: dread - d0/d4/d7/df/f5f zero size 2024-04-26T21:07:58.789 INFO:tasks.workunit.client.1.smithi064.stdout:2/308: dread d12/d28/f37 [0,4194304] 0 2024-04-26T21:07:58.797 INFO:tasks.workunit.client.0.smithi055.stdout:3/137: rmdir d0 39 2024-04-26T21:07:58.798 INFO:tasks.workunit.client.1.smithi064.stdout:0/252: truncate dd/d1c/f1f 3755027 0 2024-04-26T21:07:58.798 INFO:tasks.workunit.client.1.smithi064.stdout:0/253: fsync dd/f14 0 2024-04-26T21:07:58.798 INFO:tasks.workunit.client.1.smithi064.stdout:7/292: write d6/d15/d1c/f25 [2843830,95401] 0 2024-04-26T21:07:58.798 INFO:tasks.workunit.client.1.smithi064.stdout:7/293: chown d6/d5a/d5f 669619268 1 2024-04-26T21:07:58.799 INFO:tasks.workunit.client.1.smithi064.stdout:1/376: rename d0/d6/d11/d2c/l58 to d0/d6b/l71 0 2024-04-26T21:07:58.800 INFO:tasks.workunit.client.1.smithi064.stdout:1/377: truncate d0/d6/d11/d1e/f43 4031822 0 2024-04-26T21:07:58.800 INFO:tasks.workunit.client.1.smithi064.stdout:1/378: write d0/d6/d11/d1e/d27/f65 [723106,120190] 0 2024-04-26T21:07:58.800 INFO:tasks.workunit.client.1.smithi064.stdout:9/317: mknod d0/d4/da/c6a 0 2024-04-26T21:07:58.801 INFO:tasks.workunit.client.1.smithi064.stdout:9/318: read - d0/d4/d7/df/f5a zero size 2024-04-26T21:07:58.801 INFO:tasks.workunit.client.1.smithi064.stdout:9/319: fdatasync d0/d4/d28/f30 0 2024-04-26T21:07:58.802 INFO:tasks.workunit.client.0.smithi055.stdout:3/138: mknod d0/d1/d13/d27/c2f 0 2024-04-26T21:07:58.802 INFO:tasks.workunit.client.0.smithi055.stdout:3/139: fdatasync d0/d1/d23/f28 0 2024-04-26T21:07:58.802 INFO:tasks.workunit.client.0.smithi055.stdout:3/140: fdatasync d0/d1/d23/f28 0 2024-04-26T21:07:58.803 INFO:tasks.workunit.client.1.smithi064.stdout:8/247: dwrite d10/d1d/f43 [0,4194304] 0 2024-04-26T21:07:58.803 INFO:tasks.workunit.client.0.smithi055.stdout:5/92: dread f0 [0,4194304] 0 2024-04-26T21:07:58.803 INFO:tasks.workunit.client.1.smithi064.stdout:4/354: getdents d0/d1d/d21 0 2024-04-26T21:07:58.804 INFO:tasks.workunit.client.1.smithi064.stdout:4/355: chown d0/d5/d3e/c61 45628319 1 2024-04-26T21:07:58.806 INFO:tasks.workunit.client.0.smithi055.stdout:3/141: rename d0/d1/d23/f28 to d0/d4/d16/d18/f30 0 2024-04-26T21:07:58.806 INFO:tasks.workunit.client.0.smithi055.stdout:5/93: rename d4 to d4/d18/d1e 22 2024-04-26T21:07:58.806 INFO:tasks.workunit.client.0.smithi055.stdout:5/94: write d4/fd [2673423,50133] 0 2024-04-26T21:07:58.807 INFO:tasks.workunit.client.0.smithi055.stdout:5/95: creat d4/d15/f1f x:0 0 0 2024-04-26T21:07:58.807 INFO:tasks.workunit.client.0.smithi055.stdout:5/96: write f0 [2577003,114032] 0 2024-04-26T21:07:58.807 INFO:tasks.workunit.client.0.smithi055.stdout:5/97: fdatasync d4/d15/f16 0 2024-04-26T21:07:58.808 INFO:tasks.workunit.client.1.smithi064.stdout:0/254: symlink dd/d10/d1a/d31/d3e/d42/l48 0 2024-04-26T21:07:58.809 INFO:tasks.workunit.client.1.smithi064.stdout:9/320: mkdir d0/d4/da/d26/d47/d6b 0 2024-04-26T21:07:58.809 INFO:tasks.workunit.client.1.smithi064.stdout:9/321: fdatasync d0/d4/d7/f2e 0 2024-04-26T21:07:58.810 INFO:tasks.workunit.client.0.smithi055.stdout:3/142: mkdir d0/de/d31 0 2024-04-26T21:07:58.812 INFO:tasks.workunit.client.1.smithi064.stdout:8/248: unlink d10/d41/d4e/f3b 0 2024-04-26T21:07:58.814 INFO:tasks.workunit.client.0.smithi055.stdout:8/102: dwrite d3/f18 [0,4194304] 0 2024-04-26T21:07:58.814 INFO:tasks.workunit.client.0.smithi055.stdout:8/103: read d3/d9/fe [493826,60951] 0 2024-04-26T21:07:58.815 INFO:tasks.workunit.client.1.smithi064.stdout:5/280: dwrite dd/f11 [0,4194304] 0 2024-04-26T21:07:58.815 INFO:tasks.workunit.client.1.smithi064.stdout:4/356: creat d0/d2f/d69/f77 x:0 0 0 2024-04-26T21:07:58.817 INFO:tasks.workunit.client.0.smithi055.stdout:5/98: creat d4/d18/f20 x:0 0 0 2024-04-26T21:07:58.820 INFO:tasks.workunit.client.1.smithi064.stdout:8/249: mknod d10/d1d/d38/c4f 0 2024-04-26T21:07:58.820 INFO:tasks.workunit.client.1.smithi064.stdout:8/250: truncate d10/d2f/f4c 832662 0 2024-04-26T21:07:58.823 INFO:tasks.workunit.client.0.smithi055.stdout:5/99: rename f0 to d4/df/d13/f21 0 2024-04-26T21:07:58.824 INFO:tasks.workunit.client.1.smithi064.stdout:5/281: chown dd/d12/d18/d1a/d1f 22835 1 2024-04-26T21:07:58.827 INFO:tasks.workunit.client.0.smithi055.stdout:8/104: creat d3/d9/d1d/f25 x:0 0 0 2024-04-26T21:07:58.827 INFO:tasks.workunit.client.0.smithi055.stdout:3/143: write d0/d4/d16/d18/f30 [3234485,29808] 0 2024-04-26T21:07:58.827 INFO:tasks.workunit.client.0.smithi055.stdout:3/144: write d0/d1/d13/f1d [674133,96786] 0 2024-04-26T21:07:58.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/145: symlink d0/d1/l32 0 2024-04-26T21:07:58.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/146: fdatasync d0/f22 0 2024-04-26T21:07:58.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/147: chown d0/d1/l2 378 1 2024-04-26T21:07:58.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/148: fsync d0/f22 0 2024-04-26T21:07:58.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/149: write d0/d4/d5/f2c [666339,26746] 0 2024-04-26T21:07:58.836 INFO:tasks.workunit.client.0.smithi055.stdout:3/150: rename d0/d1/d23/c2b to d0/de/d31/c33 0 2024-04-26T21:07:58.838 INFO:tasks.workunit.client.0.smithi055.stdout:3/151: creat d0/f34 x:0 0 0 2024-04-26T21:07:58.838 INFO:tasks.workunit.client.0.smithi055.stdout:3/152: truncate d0/d4/d5/f21 4277463 0 2024-04-26T21:07:58.840 INFO:tasks.workunit.client.0.smithi055.stdout:3/153: creat d0/d1/d13/d1a/f35 x:0 0 0 2024-04-26T21:07:58.840 INFO:tasks.workunit.client.0.smithi055.stdout:3/154: write d0/f19 [1184796,88551] 0 2024-04-26T21:07:58.848 INFO:tasks.workunit.client.0.smithi055.stdout:3/155: fdatasync d0/d1/f2e 0 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:5/282: creat dd/d12/d18/d1a/d1b/f52 x:0 0 0 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:0/255: link dd/f12 dd/d10/d18/f49 0 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:0/256: creat dd/d10/d1a/d31/f4a x:0 0 0 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:5/283: read - dd/d12/d18/d1a/d1f/d20/f3b zero size 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:5/284: dread - dd/d12/d18/d1a/d1f/d20/f44 zero size 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:0/257: fdatasync dd/f15 0 2024-04-26T21:07:58.855 INFO:tasks.workunit.client.1.smithi064.stdout:5/285: chown dd/d12/d18/d1a/d1f/d20 1142 1 2024-04-26T21:07:58.857 INFO:tasks.workunit.client.1.smithi064.stdout:5/286: creat dd/d12/d18/d1a/d1f/f53 x:0 0 0 2024-04-26T21:07:58.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/246: dwrite d1/d14/f1c [0,4194304] 0 2024-04-26T21:07:58.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/247: read d1/fc [2667168,26967] 0 2024-04-26T21:07:58.876 INFO:tasks.workunit.client.1.smithi064.stdout:0/258: truncate dd/d10/d1a/d31/f37 1065900 0 2024-04-26T21:07:58.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/259: creat dd/d10/d1a/d31/f4b x:0 0 0 2024-04-26T21:07:58.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/260: stat dd/f15 0 2024-04-26T21:07:58.890 INFO:tasks.workunit.client.1.smithi064.stdout:3/248: write d1/f6 [1754493,87399] 0 2024-04-26T21:07:58.891 INFO:tasks.workunit.client.1.smithi064.stdout:3/249: write d1/f11 [3418612,117637] 0 2024-04-26T21:07:58.891 INFO:tasks.workunit.client.1.smithi064.stdout:3/250: truncate d1/d27/d50/f39 277175 0 2024-04-26T21:07:58.910 INFO:tasks.workunit.client.1.smithi064.stdout:2/309: dwrite d12/d28/f33 [4194304,4194304] 0 2024-04-26T21:07:58.910 INFO:tasks.workunit.client.1.smithi064.stdout:2/310: dread - d12/d16/d29/f49 zero size 2024-04-26T21:07:58.923 INFO:tasks.workunit.client.1.smithi064.stdout:0/261: read dd/f30 [2755721,75085] 0 2024-04-26T21:07:58.938 INFO:tasks.workunit.client.1.smithi064.stdout:3/251: dread d1/ff [0,4194304] 0 2024-04-26T21:07:58.938 INFO:tasks.workunit.client.1.smithi064.stdout:3/252: rename d1/f6 to d1/d27/d50/d22/d26/f58 0 2024-04-26T21:07:58.940 INFO:tasks.workunit.client.1.smithi064.stdout:3/253: creat d1/d27/f59 x:0 0 0 2024-04-26T21:07:58.943 INFO:tasks.workunit.client.1.smithi064.stdout:9/322: dwrite d0/d4/d7/df/f5a [0,4194304] 0 2024-04-26T21:07:58.943 INFO:tasks.workunit.client.1.smithi064.stdout:9/323: read - d0/d4/d28/f30 zero size 2024-04-26T21:07:58.944 INFO:tasks.workunit.client.0.smithi055.stdout:5/100: dwrite d4/f6 [0,4194304] 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:1/379: dwrite d0/d6/d11/f35 [0,4194304] 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:6/257: dwrite d4/d7/d12/d38/f3f [0,4194304] 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:6/258: creat d4/d7/f53 x:0 0 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:6/259: fsync d4/d7/d33/f46 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/357: dwrite d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/358: chown d0/d5/d3e/f67 125067289 1 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/359: chown d0/d1d/d21/f47 94 1 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/360: fsync d0/d1d/d17/d44/d45/f5c 0 2024-04-26T21:07:58.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/361: readlink d0/d1d/l26 0 2024-04-26T21:07:58.949 INFO:tasks.workunit.client.1.smithi064.stdout:5/287: dwrite dd/d12/f2e [0,4194304] 0 2024-04-26T21:07:58.949 INFO:tasks.workunit.client.1.smithi064.stdout:5/288: write dd/d12/d18/d25/d32/f4a [408074,64414] 0 2024-04-26T21:07:58.950 INFO:tasks.workunit.client.1.smithi064.stdout:0/262: read dd/d10/d18/f29 [1526523,118762] 0 2024-04-26T21:07:58.950 INFO:tasks.workunit.client.1.smithi064.stdout:0/263: stat dd/d10/d18 0 2024-04-26T21:07:58.950 INFO:tasks.workunit.client.1.smithi064.stdout:1/380: unlink d0/d6/f70 0 2024-04-26T21:07:58.951 INFO:tasks.workunit.client.1.smithi064.stdout:9/324: truncate d0/d4/d7/fd 5820567 0 2024-04-26T21:07:58.951 INFO:tasks.workunit.client.0.smithi055.stdout:5/101: write d4/f10 [215465,106916] 0 2024-04-26T21:07:58.951 INFO:tasks.workunit.client.0.smithi055.stdout:5/102: chown d4/f8 465147427 1 2024-04-26T21:07:58.951 INFO:tasks.workunit.client.0.smithi055.stdout:5/103: chown d4/f9 1 1 2024-04-26T21:07:58.951 INFO:tasks.workunit.client.0.smithi055.stdout:3/156: dwrite d0/d4/d16/f26 [0,4194304] 0 2024-04-26T21:07:58.952 INFO:tasks.workunit.client.1.smithi064.stdout:7/294: dwrite d6/d9/d38/f3a [0,4194304] 0 2024-04-26T21:07:58.953 INFO:tasks.workunit.client.0.smithi055.stdout:8/105: dwrite d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:07:58.954 INFO:tasks.workunit.client.0.smithi055.stdout:3/157: creat d0/d4/d5/f36 x:0 0 0 2024-04-26T21:07:58.954 INFO:tasks.workunit.client.1.smithi064.stdout:6/260: mknod d4/d7/d33/c54 0 2024-04-26T21:07:58.959 INFO:tasks.workunit.client.1.smithi064.stdout:0/264: rename dd/d10/c39 to dd/d21/c4c 0 2024-04-26T21:07:58.962 INFO:tasks.workunit.client.1.smithi064.stdout:8/251: dwrite d10/f4d [0,4194304] 0 2024-04-26T21:07:58.962 INFO:tasks.workunit.client.1.smithi064.stdout:8/252: dread - d10/f47 zero size 2024-04-26T21:07:58.962 INFO:tasks.workunit.client.1.smithi064.stdout:8/253: dread - d10/f24 zero size 2024-04-26T21:07:58.963 INFO:tasks.workunit.client.1.smithi064.stdout:1/381: mkdir d0/d6/d11/d1e/d2a/d72 0 2024-04-26T21:07:58.964 INFO:tasks.workunit.client.1.smithi064.stdout:0/265: readlink l6 0 2024-04-26T21:07:58.970 INFO:tasks.workunit.client.1.smithi064.stdout:2/311: dwrite d12/d1a/f60 [0,4194304] 0 2024-04-26T21:07:58.970 INFO:tasks.workunit.client.1.smithi064.stdout:7/295: rename d6/d9/l14 to d6/db/d1f/d50/l61 0 2024-04-26T21:07:58.970 INFO:tasks.workunit.client.1.smithi064.stdout:7/296: write d6/d15/f5d [383559,129617] 0 2024-04-26T21:07:58.975 INFO:tasks.workunit.client.1.smithi064.stdout:8/254: mknod d10/d41/d44/c50 0 2024-04-26T21:07:58.985 INFO:tasks.workunit.client.0.smithi055.stdout:5/104: write d4/df/d13/f17 [75874,43745] 0 2024-04-26T21:07:58.989 INFO:tasks.workunit.client.0.smithi055.stdout:5/105: fdatasync d4/d15/f1a 0 2024-04-26T21:07:58.989 INFO:tasks.workunit.client.0.smithi055.stdout:5/106: write d4/df/f1b [326613,111436] 0 2024-04-26T21:07:58.991 INFO:tasks.workunit.client.1.smithi064.stdout:0/266: chown dd/d10/d18/c23 57279 1 2024-04-26T21:07:58.993 INFO:tasks.workunit.client.0.smithi055.stdout:3/158: rmdir d0/d4/d16/d18 39 2024-04-26T21:07:58.995 INFO:tasks.workunit.client.0.smithi055.stdout:8/106: dread d3/f18 [0,4194304] 0 2024-04-26T21:07:58.995 INFO:tasks.workunit.client.1.smithi064.stdout:2/312: symlink d12/d16/d29/d43/l6b 0 2024-04-26T21:07:58.998 INFO:tasks.workunit.client.0.smithi055.stdout:2/132: sync 2024-04-26T21:07:58.998 INFO:tasks.workunit.client.0.smithi055.stdout:1/116: sync 2024-04-26T21:07:58.998 INFO:tasks.workunit.client.0.smithi055.stdout:7/173: sync 2024-04-26T21:07:58.998 INFO:tasks.workunit.client.0.smithi055.stdout:9/123: sync 2024-04-26T21:07:58.998 INFO:tasks.workunit.client.0.smithi055.stdout:8/107: truncate d3/f18 4162671 0 2024-04-26T21:07:58.999 INFO:tasks.workunit.client.0.smithi055.stdout:6/162: sync 2024-04-26T21:07:58.999 INFO:tasks.workunit.client.0.smithi055.stdout:0/191: sync 2024-04-26T21:07:59.006 INFO:tasks.workunit.client.0.smithi055.stdout:5/107: fsync d4/df/d13/f21 0 2024-04-26T21:07:59.006 INFO:tasks.workunit.client.0.smithi055.stdout:5/108: write d4/d15/f1a [595799,68174] 0 2024-04-26T21:07:59.006 INFO:tasks.workunit.client.0.smithi055.stdout:2/133: symlink d4/l2b 0 2024-04-26T21:07:59.007 INFO:tasks.workunit.client.0.smithi055.stdout:1/117: mkdir d8/df/d11/d27/d28 0 2024-04-26T21:07:59.007 INFO:tasks.workunit.client.0.smithi055.stdout:1/118: dread - d8/f26 zero size 2024-04-26T21:07:59.010 INFO:tasks.workunit.client.1.smithi064.stdout:8/255: creat d10/d41/d44/f51 x:0 0 0 2024-04-26T21:07:59.013 INFO:tasks.workunit.client.0.smithi055.stdout:9/124: creat d2/d14/f27 x:0 0 0 2024-04-26T21:07:59.019 INFO:tasks.workunit.client.0.smithi055.stdout:6/163: creat d3/d17/f32 x:0 0 0 2024-04-26T21:07:59.021 INFO:tasks.workunit.client.0.smithi055.stdout:4/110: sync 2024-04-26T21:07:59.021 INFO:tasks.workunit.client.0.smithi055.stdout:4/111: chown d4/f1d 22198952 1 2024-04-26T21:07:59.027 INFO:tasks.workunit.client.1.smithi064.stdout:7/297: dwrite d6/d9/f36 [4194304,4194304] 0 2024-04-26T21:07:59.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/289: dwrite dd/d12/d18/d1a/d1b/f52 [0,4194304] 0 2024-04-26T21:07:59.028 INFO:tasks.workunit.client.1.smithi064.stdout:3/254: dwrite d1/d38/f49 [0,4194304] 0 2024-04-26T21:07:59.028 INFO:tasks.workunit.client.1.smithi064.stdout:3/255: read - d1/d27/d50/f21 zero size 2024-04-26T21:07:59.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/119: creat d8/df/d11/d27/d28/f29 x:0 0 0 2024-04-26T21:07:59.030 INFO:tasks.workunit.client.1.smithi064.stdout:1/382: getdents d0/d6 0 2024-04-26T21:07:59.030 INFO:tasks.workunit.client.1.smithi064.stdout:6/261: dwrite d4/d7/f3a [0,4194304] 0 2024-04-26T21:07:59.031 INFO:tasks.workunit.client.0.smithi055.stdout:5/109: dread d4/f6 [0,4194304] 0 2024-04-26T21:07:59.034 INFO:tasks.workunit.client.1.smithi064.stdout:2/313: mkdir d12/d41/d61/d6c 0 2024-04-26T21:07:59.034 INFO:tasks.workunit.client.1.smithi064.stdout:0/267: symlink dd/d21/l4d 0 2024-04-26T21:07:59.034 INFO:tasks.workunit.client.1.smithi064.stdout:0/268: chown dd/d1c/d1d 3 1 2024-04-26T21:07:59.035 INFO:tasks.workunit.client.1.smithi064.stdout:9/325: dwrite d0/d4/f24 [0,4194304] 0 2024-04-26T21:07:59.042 INFO:tasks.workunit.client.0.smithi055.stdout:6/164: unlink d3/d17/d19/f1b 0 2024-04-26T21:07:59.042 INFO:tasks.workunit.client.0.smithi055.stdout:4/112: symlink d4/d18/d1e/d28/l2f 0 2024-04-26T21:07:59.044 INFO:tasks.workunit.client.0.smithi055.stdout:1/120: unlink l5 0 2024-04-26T21:07:59.044 INFO:tasks.workunit.client.0.smithi055.stdout:1/121: fdatasync d8/d17/f18 0 2024-04-26T21:07:59.047 INFO:tasks.workunit.client.0.smithi055.stdout:9/125: rmdir d2/d11 39 2024-04-26T21:07:59.055 INFO:tasks.workunit.client.1.smithi064.stdout:9/326: dread d0/d4/d7/f54 [0,4194304] 0 2024-04-26T21:07:59.057 INFO:tasks.workunit.client.0.smithi055.stdout:8/108: rename d3/c8 to d3/d9/c26 0 2024-04-26T21:07:59.057 INFO:tasks.workunit.client.0.smithi055.stdout:8/109: chown d3/d9/fe 595 1 2024-04-26T21:07:59.060 INFO:tasks.workunit.client.0.smithi055.stdout:7/174: rmdir d5/d11/d18 0 2024-04-26T21:07:59.060 INFO:tasks.workunit.client.0.smithi055.stdout:7/175: readlink d5/d6/l1f 0 2024-04-26T21:07:59.063 INFO:tasks.workunit.client.0.smithi055.stdout:9/126: mknod d2/d11/c28 0 2024-04-26T21:07:59.065 INFO:tasks.workunit.client.0.smithi055.stdout:4/113: write d4/d12/d17/f27 [828452,122486] 0 2024-04-26T21:07:59.071 INFO:tasks.workunit.client.0.smithi055.stdout:1/122: rmdir d8/df/d11/d27/d28 39 2024-04-26T21:07:59.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/123: fsync d8/d17/f18 0 2024-04-26T21:07:59.072 INFO:tasks.workunit.client.0.smithi055.stdout:8/110: creat d3/d9/d1f/f27 x:0 0 0 2024-04-26T21:07:59.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/124: write d8/df/d11/d27/d28/f29 [291390,97469] 0 2024-04-26T21:07:59.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/125: readlink d8/df/d11/l1c 0 2024-04-26T21:07:59.076 INFO:tasks.workunit.client.0.smithi055.stdout:9/127: truncate d2/f8 4166932 0 2024-04-26T21:07:59.077 INFO:tasks.workunit.client.0.smithi055.stdout:9/128: chown d2/d11/c20 10838457 1 2024-04-26T21:07:59.093 INFO:tasks.workunit.client.0.smithi055.stdout:1/126: mkdir d8/df/d11/d27/d28/d2a 0 2024-04-26T21:07:59.099 INFO:tasks.workunit.client.1.smithi064.stdout:8/256: mknod d10/d2f/c52 0 2024-04-26T21:07:59.099 INFO:tasks.workunit.client.1.smithi064.stdout:8/257: stat d10/d1d/f1e 0 2024-04-26T21:07:59.102 INFO:tasks.workunit.client.0.smithi055.stdout:3/159: dwrite d0/d1/f2e [0,4194304] 0 2024-04-26T21:07:59.102 INFO:tasks.workunit.client.0.smithi055.stdout:3/160: write d0/d4/d5/f21 [3570495,102837] 0 2024-04-26T21:07:59.102 INFO:tasks.workunit.client.0.smithi055.stdout:3/161: truncate d0/d4/d5/f36 523019 0 2024-04-26T21:07:59.104 INFO:tasks.workunit.client.1.smithi064.stdout:1/383: dwrite d0/d6/d11/d2c/f47 [0,4194304] 0 2024-04-26T21:07:59.105 INFO:tasks.workunit.client.0.smithi055.stdout:0/192: rename d9/dc/d1c/d2c to d9/dc/d1c/d3b/d41 0 2024-04-26T21:07:59.105 INFO:tasks.workunit.client.0.smithi055.stdout:0/193: fdatasync d9/d27/f40 0 2024-04-26T21:07:59.105 INFO:tasks.workunit.client.0.smithi055.stdout:0/194: creat d9/d27/f42 x:0 0 0 2024-04-26T21:07:59.113 INFO:tasks.workunit.client.0.smithi055.stdout:7/176: read d5/f23 [425233,7114] 0 2024-04-26T21:07:59.113 INFO:tasks.workunit.client.0.smithi055.stdout:5/110: dwrite d4/d15/f16 [0,4194304] 0 2024-04-26T21:07:59.113 INFO:tasks.workunit.client.0.smithi055.stdout:5/111: truncate d4/df/d13/f17 4986425 0 2024-04-26T21:07:59.113 INFO:tasks.workunit.client.1.smithi064.stdout:5/290: fsync dd/d12/d18/f36 0 2024-04-26T21:07:59.115 INFO:tasks.workunit.client.1.smithi064.stdout:1/384: dread d0/d6/d11/d1e/d27/f2d [0,4194304] 0 2024-04-26T21:07:59.116 INFO:tasks.workunit.client.1.smithi064.stdout:1/385: creat d0/d6/d11/d1e/d2a/d34/f73 x:0 0 0 2024-04-26T21:07:59.119 INFO:tasks.workunit.client.0.smithi055.stdout:3/162: mkdir d0/d1/d23/d37 0 2024-04-26T21:07:59.120 INFO:tasks.workunit.client.0.smithi055.stdout:6/165: dwrite f1 [0,4194304] 0 2024-04-26T21:07:59.120 INFO:tasks.workunit.client.0.smithi055.stdout:6/166: chown d3/l13 79178 1 2024-04-26T21:07:59.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/134: rename d4/db/d26/c27 to d4/d14/d17/c2c 0 2024-04-26T21:07:59.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/135: write d4/d14/f19 [3892361,117933] 0 2024-04-26T21:07:59.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/136: chown f2 25664 1 2024-04-26T21:07:59.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/137: chown d4/ff 46528932 1 2024-04-26T21:07:59.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/138: chown d4/d14/f20 363 1 2024-04-26T21:07:59.127 INFO:tasks.workunit.client.1.smithi064.stdout:3/256: unlink d1/d12/f1f 0 2024-04-26T21:07:59.127 INFO:tasks.workunit.client.1.smithi064.stdout:3/257: chown d1/l43 3425362 1 2024-04-26T21:07:59.127 INFO:tasks.workunit.client.1.smithi064.stdout:3/258: stat d1/d27/d50/d22/f2e 0 2024-04-26T21:07:59.135 INFO:tasks.workunit.client.1.smithi064.stdout:6/262: truncate d4/f2f 1625225 0 2024-04-26T21:07:59.135 INFO:tasks.workunit.client.0.smithi055.stdout:5/112: dread d4/df/d13/f21 [0,4194304] 0 2024-04-26T21:07:59.145 INFO:tasks.workunit.client.1.smithi064.stdout:2/314: truncate d12/d28/d3a/d46/d6a/f5a 2425927 0 2024-04-26T21:07:59.149 INFO:tasks.workunit.client.1.smithi064.stdout:0/269: symlink dd/d10/d1a/d31/d3e/d42/l4e 0 2024-04-26T21:07:59.149 INFO:tasks.workunit.client.1.smithi064.stdout:0/270: chown dd/d10/d18/c23 31 1 2024-04-26T21:07:59.149 INFO:tasks.workunit.client.1.smithi064.stdout:0/271: chown dd/d21/f3a 463193 1 2024-04-26T21:07:59.149 INFO:tasks.workunit.client.1.smithi064.stdout:0/272: stat dd/d21/l28 0 2024-04-26T21:07:59.157 INFO:tasks.workunit.client.1.smithi064.stdout:9/327: symlink d0/d4/da/d26/d47/l6c 0 2024-04-26T21:07:59.157 INFO:tasks.workunit.client.1.smithi064.stdout:9/328: creat d0/d4/da/d26/d5d/f6d x:0 0 0 2024-04-26T21:07:59.157 INFO:tasks.workunit.client.1.smithi064.stdout:9/329: chown d0/d4/da/c6a 11742 1 2024-04-26T21:07:59.158 INFO:tasks.workunit.client.1.smithi064.stdout:8/258: mkdir d10/d41/d53 0 2024-04-26T21:07:59.167 INFO:tasks.workunit.client.0.smithi055.stdout:4/114: dwrite d4/d12/d17/f27 [0,4194304] 0 2024-04-26T21:07:59.167 INFO:tasks.workunit.client.0.smithi055.stdout:0/195: dread d9/fa [0,4194304] 0 2024-04-26T21:07:59.169 INFO:tasks.workunit.client.0.smithi055.stdout:3/163: dwrite d0/de/f17 [0,4194304] 0 2024-04-26T21:07:59.171 INFO:tasks.workunit.client.0.smithi055.stdout:1/127: rmdir d8 39 2024-04-26T21:07:59.171 INFO:tasks.workunit.client.0.smithi055.stdout:1/128: readlink d8/df/d11/l1c 0 2024-04-26T21:07:59.178 INFO:tasks.workunit.client.1.smithi064.stdout:1/386: creat d0/d6/f74 x:0 0 0 2024-04-26T21:07:59.179 INFO:tasks.workunit.client.1.smithi064.stdout:7/298: getdents d6/d9/d38 0 2024-04-26T21:07:59.179 INFO:tasks.workunit.client.1.smithi064.stdout:1/387: creat d0/d6/d11/d1e/d2a/d34/f75 x:0 0 0 2024-04-26T21:07:59.179 INFO:tasks.workunit.client.1.smithi064.stdout:1/388: truncate d0/d6/d11/d1e/d2a/f5b 607796 0 2024-04-26T21:07:59.179 INFO:tasks.workunit.client.0.smithi055.stdout:7/177: rmdir d5/db 39 2024-04-26T21:07:59.180 INFO:tasks.workunit.client.1.smithi064.stdout:3/259: unlink d1/d27/d50/c4f 0 2024-04-26T21:07:59.180 INFO:tasks.workunit.client.1.smithi064.stdout:3/260: read d1/ff [3741430,19207] 0 2024-04-26T21:07:59.180 INFO:tasks.workunit.client.1.smithi064.stdout:6/263: symlink d4/d7/d12/d49/d4b/l55 0 2024-04-26T21:07:59.180 INFO:tasks.workunit.client.1.smithi064.stdout:6/264: truncate d4/d7/f4e 233403 0 2024-04-26T21:07:59.182 INFO:tasks.workunit.client.1.smithi064.stdout:2/315: creat d12/d16/d2f/d53/f6d x:0 0 0 2024-04-26T21:07:59.183 INFO:tasks.workunit.client.0.smithi055.stdout:0/196: mkdir d9/d43 0 2024-04-26T21:07:59.185 INFO:tasks.workunit.client.1.smithi064.stdout:0/273: mkdir dd/d1c/d4f 0 2024-04-26T21:07:59.188 INFO:tasks.workunit.client.0.smithi055.stdout:3/164: creat d0/d4/d16/d18/f38 x:0 0 0 2024-04-26T21:07:59.188 INFO:tasks.workunit.client.0.smithi055.stdout:3/165: truncate d0/d1/d13/d1a/f35 476360 0 2024-04-26T21:07:59.188 INFO:tasks.workunit.client.0.smithi055.stdout:3/166: write d0/f22 [211962,85562] 0 2024-04-26T21:07:59.188 INFO:tasks.workunit.client.0.smithi055.stdout:3/167: dread - d0/f34 zero size 2024-04-26T21:07:59.189 INFO:tasks.workunit.client.1.smithi064.stdout:9/330: symlink d0/d4/da/l6e 0 2024-04-26T21:07:59.191 INFO:tasks.workunit.client.0.smithi055.stdout:1/129: unlink d8/ca 0 2024-04-26T21:07:59.192 INFO:tasks.workunit.client.0.smithi055.stdout:2/139: dwrite d4/dc/f12 [0,4194304] 0 2024-04-26T21:07:59.194 INFO:tasks.workunit.client.1.smithi064.stdout:5/291: getdents dd/d12/d18/d1a/d1f 0 2024-04-26T21:07:59.194 INFO:tasks.workunit.client.1.smithi064.stdout:5/292: fsync dd/d12/d18/d1a/d1b/f29 0 2024-04-26T21:07:59.195 INFO:tasks.workunit.client.0.smithi055.stdout:7/178: unlink d5/f23 0 2024-04-26T21:07:59.196 INFO:tasks.workunit.client.1.smithi064.stdout:4/362: sync 2024-04-26T21:07:59.199 INFO:tasks.workunit.client.1.smithi064.stdout:7/299: rename d6/c1e to d6/d15/c62 0 2024-04-26T21:07:59.200 INFO:tasks.workunit.client.1.smithi064.stdout:3/261: dread d1/f1b [0,4194304] 0 2024-04-26T21:07:59.200 INFO:tasks.workunit.client.0.smithi055.stdout:5/113: dwrite f2 [0,4194304] 0 2024-04-26T21:07:59.204 INFO:tasks.workunit.client.0.smithi055.stdout:0/197: link d9/dc/d19/f24 d9/d43/f44 0 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/198: dread - d9/d27/f40 zero size 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/199: fdatasync d9/fa 0 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.0.smithi055.stdout:3/168: mknod d0/d1/d23/d37/c39 0 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.0.smithi055.stdout:3/169: fdatasync d0/d4/d5/f21 0 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.1.smithi064.stdout:3/262: write d1/d27/d50/f24 [587115,68713] 0 2024-04-26T21:07:59.205 INFO:tasks.workunit.client.1.smithi064.stdout:3/263: dread - d1/d27/d50/f2d zero size 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/389: mkdir d0/d6/d76 0 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/390: truncate d0/d6/d29/f68 1378031 0 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/391: readlink d0/l8 0 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/392: truncate d0/d6/f19 2137288 0 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:1/393: fdatasync d0/d22/f5f 0 2024-04-26T21:07:59.209 INFO:tasks.workunit.client.1.smithi064.stdout:6/265: mkdir d4/d7/d12/d49/d4b/d56 0 2024-04-26T21:07:59.210 INFO:tasks.workunit.client.0.smithi055.stdout:1/130: rename d8/df/d11/l1f to d8/df/d11/d27/d28/l2b 0 2024-04-26T21:07:59.210 INFO:tasks.workunit.client.1.smithi064.stdout:1/394: creat d0/d6/d11/d1e/d2a/f77 x:0 0 0 2024-04-26T21:07:59.210 INFO:tasks.workunit.client.1.smithi064.stdout:1/395: write d0/d6/d11/d1e/f1b [3051687,68404] 0 2024-04-26T21:07:59.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/131: truncate d8/df/f24 500339 0 2024-04-26T21:07:59.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/132: write d8/f19 [20899,89560] 0 2024-04-26T21:07:59.211 INFO:tasks.workunit.client.0.smithi055.stdout:0/200: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:07:59.211 INFO:tasks.workunit.client.0.smithi055.stdout:0/201: creat d9/dc/d17/f45 x:0 0 0 2024-04-26T21:07:59.215 INFO:tasks.workunit.client.1.smithi064.stdout:0/274: mknod dd/d1c/c50 0 2024-04-26T21:07:59.217 INFO:tasks.workunit.client.0.smithi055.stdout:7/179: write d5/d6/ff [2253467,69242] 0 2024-04-26T21:07:59.218 INFO:tasks.workunit.client.1.smithi064.stdout:9/331: link d0/f3b d0/d4/da/d26/f6f 0 2024-04-26T21:07:59.218 INFO:tasks.workunit.client.0.smithi055.stdout:2/140: mknod d4/dc/c2d 0 2024-04-26T21:07:59.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/264: dread d1/d27/d50/f13 [0,4194304] 0 2024-04-26T21:07:59.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/265: chown d1/d27/d50/f39 143 1 2024-04-26T21:07:59.221 INFO:tasks.workunit.client.1.smithi064.stdout:3/266: creat d1/d14/f5a x:0 0 0 2024-04-26T21:07:59.221 INFO:tasks.workunit.client.1.smithi064.stdout:5/293: getdents dd 0 2024-04-26T21:07:59.223 INFO:tasks.workunit.client.1.smithi064.stdout:8/259: dwrite d10/f1b [0,4194304] 0 2024-04-26T21:07:59.224 INFO:tasks.workunit.client.1.smithi064.stdout:8/260: write d10/f1b [4955603,31900] 0 2024-04-26T21:07:59.224 INFO:tasks.workunit.client.1.smithi064.stdout:8/261: write f4 [5046899,30584] 0 2024-04-26T21:07:59.224 INFO:tasks.workunit.client.1.smithi064.stdout:7/300: symlink d6/d15/l63 0 2024-04-26T21:07:59.224 INFO:tasks.workunit.client.1.smithi064.stdout:4/363: creat d0/d1d/d17/d44/f78 x:0 0 0 2024-04-26T21:07:59.226 INFO:tasks.workunit.client.0.smithi055.stdout:4/115: dwrite d4/ff [0,4194304] 0 2024-04-26T21:07:59.230 INFO:tasks.workunit.client.1.smithi064.stdout:6/266: mknod d4/d7/d33/c57 0 2024-04-26T21:07:59.230 INFO:tasks.workunit.client.1.smithi064.stdout:6/267: chown d4/d7/f53 11528525 1 2024-04-26T21:07:59.230 INFO:tasks.workunit.client.1.smithi064.stdout:6/268: write d4/d7/d12/d1e/f45 [231314,3583] 0 2024-04-26T21:07:59.233 INFO:tasks.workunit.client.0.smithi055.stdout:1/133: mknod d8/d17/c2c 0 2024-04-26T21:07:59.233 INFO:tasks.workunit.client.0.smithi055.stdout:1/134: getdents d8/df/d11/d27/d28/d2a 0 2024-04-26T21:07:59.233 INFO:tasks.workunit.client.0.smithi055.stdout:0/202: creat d9/d11/f46 x:0 0 0 2024-04-26T21:07:59.233 INFO:tasks.workunit.client.0.smithi055.stdout:2/141: creat d4/d14/d17/f2e x:0 0 0 2024-04-26T21:07:59.234 INFO:tasks.workunit.client.1.smithi064.stdout:1/396: mknod d0/d6/d11/d1e/d27/c78 0 2024-04-26T21:07:59.234 INFO:tasks.workunit.client.1.smithi064.stdout:1/397: chown d0/d6/d11/d1e/d2a/d34/d57 19 1 2024-04-26T21:07:59.236 INFO:tasks.workunit.client.1.smithi064.stdout:0/275: creat dd/d10/d1a/d31/d3e/d42/f51 x:0 0 0 2024-04-26T21:07:59.236 INFO:tasks.workunit.client.1.smithi064.stdout:0/276: truncate dd/d10/d1a/d31/f3c 956291 0 2024-04-26T21:07:59.236 INFO:tasks.workunit.client.1.smithi064.stdout:0/277: chown dd/d10/d1a/d31/d3e/d42/l4e 1021 1 2024-04-26T21:07:59.236 INFO:tasks.workunit.client.1.smithi064.stdout:0/278: chown dd/d10/d1a/d31/d3e/d42 102 1 2024-04-26T21:07:59.242 INFO:tasks.workunit.client.0.smithi055.stdout:2/142: dread d4/dc/f1d [0,4194304] 0 2024-04-26T21:07:59.251 INFO:tasks.workunit.client.1.smithi064.stdout:2/316: dwrite d12/f24 [0,4194304] 0 2024-04-26T21:07:59.251 INFO:tasks.workunit.client.0.smithi055.stdout:1/135: link l4 d8/df/d11/d27/d28/d2a/l2d 0 2024-04-26T21:07:59.254 INFO:tasks.workunit.client.0.smithi055.stdout:0/203: creat d9/dc/d1c/d3e/f47 x:0 0 0 2024-04-26T21:07:59.254 INFO:tasks.workunit.client.0.smithi055.stdout:0/204: chown d9/dc/d17/f45 30960 1 2024-04-26T21:07:59.254 INFO:tasks.workunit.client.0.smithi055.stdout:4/116: read d4/ff [3344712,120016] 0 2024-04-26T21:07:59.256 INFO:tasks.workunit.client.1.smithi064.stdout:5/294: chown dd/d12/d18/d33 1352 1 2024-04-26T21:07:59.256 INFO:tasks.workunit.client.1.smithi064.stdout:5/295: readlink dd/d12/l45 0 2024-04-26T21:07:59.260 INFO:tasks.workunit.client.0.smithi055.stdout:0/205: truncate d9/dc/d17/f30 2094751 0 2024-04-26T21:07:59.260 INFO:tasks.workunit.client.1.smithi064.stdout:8/262: mkdir d10/d41/d4e/d54 0 2024-04-26T21:07:59.267 INFO:tasks.workunit.client.1.smithi064.stdout:7/301: rename d6/d15/l21 to d6/d9/d38/l64 0 2024-04-26T21:07:59.272 INFO:tasks.workunit.client.0.smithi055.stdout:0/206: mknod d9/d11/c48 0 2024-04-26T21:07:59.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/180: dread d5/d11/f2f [0,4194304] 0 2024-04-26T21:07:59.277 INFO:tasks.workunit.client.1.smithi064.stdout:2/317: dread d12/d28/d3a/d46/d6a/f5a [0,4194304] 0 2024-04-26T21:07:59.280 INFO:tasks.workunit.client.1.smithi064.stdout:6/269: unlink d4/d7/d33/l36 0 2024-04-26T21:07:59.280 INFO:tasks.workunit.client.1.smithi064.stdout:6/270: chown d4/d7/d33/l3d 14319177 1 2024-04-26T21:07:59.281 INFO:tasks.workunit.client.0.smithi055.stdout:5/114: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:07:59.285 INFO:tasks.workunit.client.0.smithi055.stdout:0/207: symlink d9/l49 0 2024-04-26T21:07:59.285 INFO:tasks.workunit.client.0.smithi055.stdout:0/208: write d9/d43/f44 [1121038,33021] 0 2024-04-26T21:07:59.285 INFO:tasks.workunit.client.1.smithi064.stdout:2/318: dread d12/d1a/f2b [0,4194304] 0 2024-04-26T21:07:59.289 INFO:tasks.workunit.client.1.smithi064.stdout:5/296: chown dd/d12/d18/f1d 1 1 2024-04-26T21:07:59.295 INFO:tasks.workunit.client.0.smithi055.stdout:7/181: rename d5/db/fc to d5/d11/f33 0 2024-04-26T21:07:59.300 INFO:tasks.workunit.client.1.smithi064.stdout:3/267: dwrite d1/d27/d50/d35/f36 [0,4194304] 0 2024-04-26T21:07:59.300 INFO:tasks.workunit.client.1.smithi064.stdout:3/268: creat d1/d27/d50/f5b x:0 0 0 2024-04-26T21:07:59.303 INFO:tasks.workunit.client.1.smithi064.stdout:8/263: creat d10/d41/d4e/d54/f55 x:0 0 0 2024-04-26T21:07:59.305 INFO:tasks.workunit.client.1.smithi064.stdout:4/364: dwrite d0/d5/d13/d6d/f59 [0,4194304] 0 2024-04-26T21:07:59.306 INFO:tasks.workunit.client.1.smithi064.stdout:0/279: dwrite dd/d10/f2e [0,4194304] 0 2024-04-26T21:07:59.310 INFO:tasks.workunit.client.1.smithi064.stdout:1/398: rename d0/d22/f3c to d0/d6/d11/d1e/d2a/d34/f79 0 2024-04-26T21:07:59.310 INFO:tasks.workunit.client.1.smithi064.stdout:1/399: dread - d0/d6/d11/d1e/d2a/f77 zero size 2024-04-26T21:07:59.310 INFO:tasks.workunit.client.1.smithi064.stdout:1/400: fsync d0/d6/d11/d1e/f4f 0 2024-04-26T21:07:59.310 INFO:tasks.workunit.client.1.smithi064.stdout:1/401: write d0/d6/d29/f68 [2242735,86470] 0 2024-04-26T21:07:59.318 INFO:tasks.workunit.client.0.smithi055.stdout:4/117: dwrite d4/f9 [4194304,4194304] 0 2024-04-26T21:07:59.321 INFO:tasks.workunit.client.1.smithi064.stdout:7/302: mkdir d6/d15/d33/d65 0 2024-04-26T21:07:59.322 INFO:tasks.workunit.client.1.smithi064.stdout:5/297: dread dd/f1e [0,4194304] 0 2024-04-26T21:07:59.331 INFO:tasks.workunit.client.0.smithi055.stdout:7/182: creat d5/d6/f34 x:0 0 0 2024-04-26T21:07:59.331 INFO:tasks.workunit.client.0.smithi055.stdout:7/183: chown d5/cd 7 1 2024-04-26T21:07:59.333 INFO:tasks.workunit.client.1.smithi064.stdout:6/271: mknod d4/d7/d12/d49/d4b/c58 0 2024-04-26T21:07:59.333 INFO:tasks.workunit.client.1.smithi064.stdout:6/272: dread - d4/d7/d33/f44 zero size 2024-04-26T21:07:59.334 INFO:tasks.workunit.client.1.smithi064.stdout:7/303: dread d6/d9/f1a [0,4194304] 0 2024-04-26T21:07:59.338 INFO:tasks.workunit.client.0.smithi055.stdout:3/170: dwrite d0/d4/d5/f21 [0,4194304] 0 2024-04-26T21:07:59.339 INFO:tasks.workunit.client.0.smithi055.stdout:3/171: chown d0/d4/ld 0 1 2024-04-26T21:07:59.341 INFO:tasks.workunit.client.0.smithi055.stdout:0/209: dwrite d9/d27/f37 [0,4194304] 0 2024-04-26T21:07:59.342 INFO:tasks.workunit.client.1.smithi064.stdout:2/319: symlink d12/d41/d61/l6e 0 2024-04-26T21:07:59.346 INFO:tasks.workunit.client.0.smithi055.stdout:1/136: dwrite f1 [0,4194304] 0 2024-04-26T21:07:59.350 INFO:tasks.workunit.client.0.smithi055.stdout:5/115: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:07:59.356 INFO:tasks.workunit.client.0.smithi055.stdout:3/172: mkdir d0/de/d31/d3a 0 2024-04-26T21:07:59.356 INFO:tasks.workunit.client.0.smithi055.stdout:0/210: creat d9/d43/f4a x:0 0 0 2024-04-26T21:07:59.356 INFO:tasks.workunit.client.0.smithi055.stdout:0/211: fdatasync d9/dc/d17/f3f 0 2024-04-26T21:07:59.368 INFO:tasks.workunit.client.0.smithi055.stdout:2/143: dwrite d4/db/f25 [0,4194304] 0 2024-04-26T21:07:59.372 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:07:59 smithi055 ceph-mon[25475]: pgmap v32: 65 pgs: 65 active+clean; 722 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 73 MiB/s rd, 82 MiB/s wr, 511 op/s 2024-04-26T21:07:59.377 INFO:tasks.workunit.client.0.smithi055.stdout:0/212: mkdir d9/d43/d4b 0 2024-04-26T21:07:59.377 INFO:tasks.workunit.client.0.smithi055.stdout:5/116: dread d4/f8 [0,4194304] 0 2024-04-26T21:07:59.377 INFO:tasks.workunit.client.0.smithi055.stdout:5/117: fdatasync d4/df/d13/f17 0 2024-04-26T21:07:59.377 INFO:tasks.workunit.client.0.smithi055.stdout:4/118: truncate d4/f9 2842689 0 2024-04-26T21:07:59.377 INFO:tasks.workunit.client.0.smithi055.stdout:4/119: creat d4/f30 x:0 0 0 2024-04-26T21:07:59.386 INFO:tasks.workunit.client.1.smithi064.stdout:3/269: mknod d1/c5c 0 2024-04-26T21:07:59.386 INFO:tasks.workunit.client.0.smithi055.stdout:2/144: symlink d4/db/d1f/l2f 0 2024-04-26T21:07:59.389 INFO:tasks.workunit.client.1.smithi064.stdout:8/264: truncate d10/f12 3259505 0 2024-04-26T21:07:59.396 INFO:tasks.workunit.client.1.smithi064.stdout:4/365: mkdir d0/d5/d79 0 2024-04-26T21:07:59.396 INFO:tasks.workunit.client.1.smithi064.stdout:4/366: truncate d0/d1d/d21/f3a 269500 0 2024-04-26T21:07:59.399 INFO:tasks.workunit.client.0.smithi055.stdout:5/118: rename d4/fc to d4/df/d13/f22 0 2024-04-26T21:07:59.400 INFO:tasks.workunit.client.1.smithi064.stdout:6/273: dwrite d4/d7/d12/f48 [0,4194304] 0 2024-04-26T21:07:59.402 INFO:tasks.workunit.client.0.smithi055.stdout:1/137: dread d8/d17/f18 [0,4194304] 0 2024-04-26T21:07:59.402 INFO:tasks.workunit.client.1.smithi064.stdout:5/298: mknod dd/d12/c54 0 2024-04-26T21:07:59.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:07:59 smithi064 ceph-mon[33404]: pgmap v32: 65 pgs: 65 active+clean; 722 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 73 MiB/s rd, 82 MiB/s wr, 511 op/s 2024-04-26T21:07:59.409 INFO:tasks.workunit.client.0.smithi055.stdout:0/213: dread f8 [0,4194304] 0 2024-04-26T21:07:59.409 INFO:tasks.workunit.client.1.smithi064.stdout:7/304: creat d6/d5a/d5f/f66 x:0 0 0 2024-04-26T21:07:59.411 INFO:tasks.workunit.client.0.smithi055.stdout:4/120: write d4/f21 [1588086,7655] 0 2024-04-26T21:07:59.411 INFO:tasks.workunit.client.0.smithi055.stdout:3/173: dwrite d0/d4/d16/d18/f38 [0,4194304] 0 2024-04-26T21:07:59.411 INFO:tasks.workunit.client.0.smithi055.stdout:3/174: write d0/de/f17 [4903702,53933] 0 2024-04-26T21:07:59.411 INFO:tasks.workunit.client.0.smithi055.stdout:3/175: write d0/f34 [960358,89467] 0 2024-04-26T21:07:59.414 INFO:tasks.workunit.client.1.smithi064.stdout:3/270: dread d1/d38/f49 [0,4194304] 0 2024-04-26T21:07:59.417 INFO:tasks.workunit.client.1.smithi064.stdout:4/367: symlink d0/d2f/d69/l7a 0 2024-04-26T21:07:59.418 INFO:tasks.workunit.client.1.smithi064.stdout:4/368: write d0/d2f/d69/f77 [785365,106720] 0 2024-04-26T21:07:59.418 INFO:tasks.workunit.client.0.smithi055.stdout:7/184: dwrite d5/d11/f33 [0,4194304] 0 2024-04-26T21:07:59.420 INFO:tasks.workunit.client.1.smithi064.stdout:0/280: getdents dd/d1c 0 2024-04-26T21:07:59.420 INFO:tasks.workunit.client.1.smithi064.stdout:1/402: dwrite d0/d6/d11/d1e/f54 [0,4194304] 0 2024-04-26T21:07:59.420 INFO:tasks.workunit.client.1.smithi064.stdout:1/403: write d0/f12 [257749,106830] 0 2024-04-26T21:07:59.429 INFO:tasks.workunit.client.1.smithi064.stdout:6/274: symlink d4/d7/d12/d38/l59 0 2024-04-26T21:07:59.433 INFO:tasks.workunit.client.0.smithi055.stdout:0/214: mknod d9/d11/c4c 0 2024-04-26T21:07:59.434 INFO:tasks.workunit.client.0.smithi055.stdout:0/215: truncate d9/d27/f40 951958 0 2024-04-26T21:07:59.434 INFO:tasks.workunit.client.1.smithi064.stdout:5/299: creat dd/d12/d4f/f55 x:0 0 0 2024-04-26T21:07:59.435 INFO:tasks.workunit.client.1.smithi064.stdout:6/275: dread d4/d7/d12/d1e/f2b [0,4194304] 0 2024-04-26T21:07:59.436 INFO:tasks.workunit.client.1.smithi064.stdout:7/305: rename d6/d15/d33 to d6/d15/d67 0 2024-04-26T21:07:59.438 INFO:tasks.workunit.client.1.smithi064.stdout:6/276: read d4/d7/f4e [228046,28094] 0 2024-04-26T21:07:59.438 INFO:tasks.workunit.client.1.smithi064.stdout:6/277: chown d4/f2f 59 1 2024-04-26T21:07:59.438 INFO:tasks.workunit.client.1.smithi064.stdout:5/300: write dd/d12/d18/d25/d32/f4a [358699,111196] 0 2024-04-26T21:07:59.438 INFO:tasks.workunit.client.1.smithi064.stdout:5/301: dread - dd/d12/d18/d1a/d1f/d20/f31 zero size 2024-04-26T21:07:59.440 INFO:tasks.workunit.client.1.smithi064.stdout:2/320: getdents d12/d41 0 2024-04-26T21:07:59.441 INFO:tasks.workunit.client.1.smithi064.stdout:3/271: link d1/c5c d1/d27/d29/c5d 0 2024-04-26T21:07:59.441 INFO:tasks.workunit.client.1.smithi064.stdout:3/272: chown d1/d14/l2b 0 1 2024-04-26T21:07:59.442 INFO:tasks.workunit.client.0.smithi055.stdout:4/121: mkdir d4/d18/d1e/d2d/d31 0 2024-04-26T21:07:59.442 INFO:tasks.workunit.client.0.smithi055.stdout:4/122: dread - d4/f1d zero size 2024-04-26T21:07:59.444 INFO:tasks.workunit.client.1.smithi064.stdout:4/369: symlink d0/d2f/l7b 0 2024-04-26T21:07:59.456 INFO:tasks.workunit.client.0.smithi055.stdout:3/176: rename d0/de/d31 to d0/d1/d13/d27/d3b 0 2024-04-26T21:07:59.456 INFO:tasks.workunit.client.0.smithi055.stdout:3/177: chown d0/d1/f14 19 1 2024-04-26T21:07:59.457 INFO:tasks.workunit.client.0.smithi055.stdout:1/138: dread d8/f15 [0,4194304] 0 2024-04-26T21:07:59.464 INFO:tasks.workunit.client.0.smithi055.stdout:4/123: write d4/d12/d17/f27 [2128471,6473] 0 2024-04-26T21:07:59.464 INFO:tasks.workunit.client.0.smithi055.stdout:3/178: symlink d0/d1/d23/d37/l3c 0 2024-04-26T21:07:59.464 INFO:tasks.workunit.client.0.smithi055.stdout:1/139: write d8/f19 [377295,57437] 0 2024-04-26T21:07:59.465 INFO:tasks.workunit.client.1.smithi064.stdout:0/281: rename dd/c13 to dd/d10/d1a/d31/d47/c52 0 2024-04-26T21:07:59.467 INFO:tasks.workunit.client.1.smithi064.stdout:1/404: unlink d0/d6/f52 0 2024-04-26T21:07:59.470 INFO:tasks.workunit.client.0.smithi055.stdout:3/179: mkdir d0/d1/d23/d37/d3d 0 2024-04-26T21:07:59.470 INFO:tasks.workunit.client.1.smithi064.stdout:6/278: truncate d4/d7/fd 4558062 0 2024-04-26T21:07:59.472 INFO:tasks.workunit.client.1.smithi064.stdout:5/302: truncate f9 3938981 0 2024-04-26T21:07:59.474 INFO:tasks.workunit.client.0.smithi055.stdout:1/140: creat d8/d17/f2e x:0 0 0 2024-04-26T21:07:59.476 INFO:tasks.workunit.client.1.smithi064.stdout:2/321: symlink d12/d28/l6f 0 2024-04-26T21:07:59.477 INFO:tasks.workunit.client.1.smithi064.stdout:2/322: write d12/d28/d3a/f64 [859499,5135] 0 2024-04-26T21:07:59.477 INFO:tasks.workunit.client.1.smithi064.stdout:2/323: creat d12/d28/f70 x:0 0 0 2024-04-26T21:07:59.493 INFO:tasks.workunit.client.1.smithi064.stdout:7/306: dwrite f5 [0,4194304] 0 2024-04-26T21:07:59.498 INFO:tasks.workunit.client.0.smithi055.stdout:2/145: dwrite d4/d14/d17/f2e [0,4194304] 0 2024-04-26T21:07:59.531 INFO:tasks.workunit.client.1.smithi064.stdout:2/324: dwrite d12/d1a/f42 [0,4194304] 0 2024-04-26T21:07:59.541 INFO:tasks.workunit.client.0.smithi055.stdout:5/119: dwrite d4/df/d13/f1d [0,4194304] 0 2024-04-26T21:07:59.541 INFO:tasks.workunit.client.0.smithi055.stdout:5/120: creat d4/df/f23 x:0 0 0 2024-04-26T21:07:59.557 INFO:tasks.workunit.client.0.smithi055.stdout:3/180: dwrite d0/d1/f14 [0,4194304] 0 2024-04-26T21:07:59.610 INFO:tasks.workunit.client.1.smithi064.stdout:3/273: mkdir d1/d27/d29/d5e 0 2024-04-26T21:07:59.613 INFO:tasks.workunit.client.1.smithi064.stdout:4/370: unlink d0/d5/c1e 0 2024-04-26T21:07:59.613 INFO:tasks.workunit.client.1.smithi064.stdout:4/371: dread - d0/d2f/f6f zero size 2024-04-26T21:07:59.617 INFO:tasks.workunit.client.1.smithi064.stdout:0/282: creat dd/d10/d1a/d31/d47/f53 x:0 0 0 2024-04-26T21:07:59.617 INFO:tasks.workunit.client.1.smithi064.stdout:0/283: truncate dd/d1c/d1d/f38 5235385 0 2024-04-26T21:07:59.619 INFO:tasks.workunit.client.1.smithi064.stdout:1/405: creat d0/d6/d11/f7a x:0 0 0 2024-04-26T21:07:59.622 INFO:tasks.workunit.client.1.smithi064.stdout:9/332: sync 2024-04-26T21:07:59.622 INFO:tasks.workunit.client.1.smithi064.stdout:9/333: truncate d0/d4/da/d26/d5d/f68 693657 0 2024-04-26T21:07:59.625 INFO:tasks.workunit.client.1.smithi064.stdout:5/303: mkdir dd/d12/d18/d33/d48/d56 0 2024-04-26T21:07:59.632 INFO:tasks.workunit.client.1.smithi064.stdout:7/307: symlink d6/d9/l68 0 2024-04-26T21:07:59.633 INFO:tasks.workunit.client.1.smithi064.stdout:7/308: write d6/d9/f11 [1587642,124645] 0 2024-04-26T21:07:59.634 INFO:tasks.workunit.client.1.smithi064.stdout:2/325: mkdir d12/d41/d61/d6c/d71 0 2024-04-26T21:07:59.636 INFO:tasks.workunit.client.1.smithi064.stdout:9/334: dread d0/d4/da/d26/d47/f4b [0,4194304] 0 2024-04-26T21:07:59.642 INFO:tasks.workunit.client.0.smithi055.stdout:2/146: creat d4/d1e/d2a/f30 x:0 0 0 2024-04-26T21:07:59.650 INFO:tasks.workunit.client.1.smithi064.stdout:3/274: rename d1/d27/c53 to d1/d27/d50/d35/d4c/d55/c5f 0 2024-04-26T21:07:59.651 INFO:tasks.workunit.client.1.smithi064.stdout:3/275: truncate d1/d27/d50/f21 295301 0 2024-04-26T21:07:59.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/121: link d4/df/d13/f21 d4/d15/f24 0 2024-04-26T21:07:59.651 INFO:tasks.workunit.client.0.smithi055.stdout:6/167: sync 2024-04-26T21:07:59.651 INFO:tasks.workunit.client.0.smithi055.stdout:6/168: read - d3/d17/f29 zero size 2024-04-26T21:07:59.652 INFO:tasks.workunit.client.0.smithi055.stdout:6/169: fdatasync d3/f15 0 2024-04-26T21:07:59.653 INFO:tasks.workunit.client.1.smithi064.stdout:0/284: truncate dd/d10/d1a/f2f 3883281 0 2024-04-26T21:07:59.655 INFO:tasks.workunit.client.1.smithi064.stdout:1/406: creat d0/d6/d11/d1e/f7b x:0 0 0 2024-04-26T21:07:59.656 INFO:tasks.workunit.client.0.smithi055.stdout:9/129: sync 2024-04-26T21:07:59.656 INFO:tasks.workunit.client.0.smithi055.stdout:8/111: sync 2024-04-26T21:07:59.658 INFO:tasks.workunit.client.1.smithi064.stdout:6/279: getdents d4/d7/d12 0 2024-04-26T21:07:59.658 INFO:tasks.workunit.client.1.smithi064.stdout:6/280: chown d4/d7/d12/d49/d4b/d56 1187734 1 2024-04-26T21:07:59.658 INFO:tasks.workunit.client.1.smithi064.stdout:6/281: chown d4/d7/d12/c27 193619 1 2024-04-26T21:07:59.658 INFO:tasks.workunit.client.1.smithi064.stdout:6/282: fdatasync d4/d7/fe 0 2024-04-26T21:07:59.659 INFO:tasks.workunit.client.0.smithi055.stdout:3/181: symlink d0/d1/d13/d27/d3b/l3e 0 2024-04-26T21:07:59.659 INFO:tasks.workunit.client.1.smithi064.stdout:5/304: creat dd/d12/d18/d1a/f57 x:0 0 0 2024-04-26T21:07:59.660 INFO:tasks.workunit.client.0.smithi055.stdout:1/141: link d8/c1e d8/d17/d1b/c2f 0 2024-04-26T21:07:59.660 INFO:tasks.workunit.client.0.smithi055.stdout:1/142: write d8/d17/d1b/f20 [303362,2137] 0 2024-04-26T21:07:59.663 INFO:tasks.workunit.client.1.smithi064.stdout:7/309: symlink d6/d15/d67/d65/l69 0 2024-04-26T21:07:59.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/265: sync 2024-04-26T21:07:59.664 INFO:tasks.workunit.client.0.smithi055.stdout:6/170: symlink d3/d17/d19/d20/l33 0 2024-04-26T21:07:59.666 INFO:tasks.workunit.client.1.smithi064.stdout:2/326: symlink d12/d28/d3a/d46/l72 0 2024-04-26T21:07:59.667 INFO:tasks.workunit.client.0.smithi055.stdout:2/147: write d4/d14/d17/f2e [1895425,31767] 0 2024-04-26T21:07:59.672 INFO:tasks.workunit.client.0.smithi055.stdout:3/182: getdents d0/d4 0 2024-04-26T21:07:59.672 INFO:tasks.workunit.client.0.smithi055.stdout:5/122: fsync d4/d15/f24 0 2024-04-26T21:07:59.674 INFO:tasks.workunit.client.0.smithi055.stdout:2/148: rmdir d4/d1e 39 2024-04-26T21:07:59.675 INFO:tasks.workunit.client.1.smithi064.stdout:9/335: link d0/d4/d7/f54 d0/d4/da/d26/d47/d6b/f70 0 2024-04-26T21:07:59.675 INFO:tasks.workunit.client.1.smithi064.stdout:9/336: write d0/d4/da/f57 [458131,67207] 0 2024-04-26T21:07:59.676 INFO:tasks.workunit.client.1.smithi064.stdout:6/283: mkdir d4/d7/d12/d49/d4b/d5a 0 2024-04-26T21:07:59.680 INFO:tasks.workunit.client.1.smithi064.stdout:8/266: mkdir d10/d2f/d56 0 2024-04-26T21:07:59.681 INFO:tasks.workunit.client.0.smithi055.stdout:6/171: dread d3/f16 [0,4194304] 0 2024-04-26T21:07:59.681 INFO:tasks.workunit.client.0.smithi055.stdout:1/143: dread d8/d17/f18 [0,4194304] 0 2024-04-26T21:07:59.684 INFO:tasks.workunit.client.0.smithi055.stdout:2/149: symlink d4/dc/d21/l31 0 2024-04-26T21:07:59.687 INFO:tasks.workunit.client.1.smithi064.stdout:7/310: creat d6/d15/d67/d4d/f6a x:0 0 0 2024-04-26T21:07:59.688 INFO:tasks.workunit.client.0.smithi055.stdout:8/112: rename d3/l1a to d3/d9/l28 0 2024-04-26T21:07:59.689 INFO:tasks.workunit.client.1.smithi064.stdout:2/327: mkdir d12/d41/d73 0 2024-04-26T21:07:59.690 INFO:tasks.workunit.client.1.smithi064.stdout:2/328: dread - d12/d16/f67 zero size 2024-04-26T21:07:59.690 INFO:tasks.workunit.client.1.smithi064.stdout:2/329: fsync d12/d28/d3a/d46/d6a/f5a 0 2024-04-26T21:07:59.697 INFO:tasks.workunit.client.0.smithi055.stdout:3/183: rename d0/d4/d16/d18/f38 to d0/d1/f3f 0 2024-04-26T21:07:59.698 INFO:tasks.workunit.client.1.smithi064.stdout:6/284: getdents d4 0 2024-04-26T21:07:59.698 INFO:tasks.workunit.client.1.smithi064.stdout:6/285: creat d4/d7/d12/d38/f5b x:0 0 0 2024-04-26T21:07:59.699 INFO:tasks.workunit.client.1.smithi064.stdout:8/267: getdents d10/d41 0 2024-04-26T21:07:59.699 INFO:tasks.workunit.client.1.smithi064.stdout:8/268: readlink d10/d41/d4e/l3e 0 2024-04-26T21:07:59.699 INFO:tasks.workunit.client.1.smithi064.stdout:8/269: fdatasync d10/d1d/f30 0 2024-04-26T21:07:59.701 INFO:tasks.workunit.client.1.smithi064.stdout:7/311: creat d6/d9/d3d/f6b x:0 0 0 2024-04-26T21:07:59.703 INFO:tasks.workunit.client.0.smithi055.stdout:3/184: creat d0/d4/f40 x:0 0 0 2024-04-26T21:07:59.705 INFO:tasks.workunit.client.0.smithi055.stdout:8/113: dread d3/f14 [0,4194304] 0 2024-04-26T21:07:59.706 INFO:tasks.workunit.client.0.smithi055.stdout:3/185: creat d0/d1/d23/d37/f41 x:0 0 0 2024-04-26T21:07:59.709 INFO:tasks.workunit.client.1.smithi064.stdout:8/270: unlink d10/c19 0 2024-04-26T21:07:59.709 INFO:tasks.workunit.client.1.smithi064.stdout:5/305: write dd/d12/d18/d1a/d1f/f24 [7120617,115788] 0 2024-04-26T21:07:59.710 INFO:tasks.workunit.client.1.smithi064.stdout:7/312: rmdir d6/d15/d67/d65 39 2024-04-26T21:07:59.710 INFO:tasks.workunit.client.1.smithi064.stdout:7/313: creat d6/db/d1f/f6c x:0 0 0 2024-04-26T21:07:59.713 INFO:tasks.workunit.client.0.smithi055.stdout:3/186: truncate d0/d4/d5/f2c 570001 0 2024-04-26T21:07:59.714 INFO:tasks.workunit.client.0.smithi055.stdout:9/130: dwrite d2/f1e [4194304,4194304] 0 2024-04-26T21:07:59.715 INFO:tasks.workunit.client.0.smithi055.stdout:9/131: write d2/d14/f21 [5585852,95349] 0 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.0.smithi055.stdout:8/114: getdents d3/d9/d1f 0 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.0.smithi055.stdout:8/115: chown c0 2 1 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.0.smithi055.stdout:8/116: stat d3/d9/d1f 0 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.0.smithi055.stdout:8/117: chown d3/d9/d1f 1249 1 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.1.smithi064.stdout:4/372: dwrite d0/d14/f50 [0,4194304] 0 2024-04-26T21:07:59.720 INFO:tasks.workunit.client.1.smithi064.stdout:4/373: chown d0/d2f/l7b 0 1 2024-04-26T21:07:59.721 INFO:tasks.workunit.client.1.smithi064.stdout:7/314: mknod d6/db/d34/c6d 0 2024-04-26T21:07:59.722 INFO:tasks.workunit.client.0.smithi055.stdout:3/187: rmdir d0/d4/d16 39 2024-04-26T21:07:59.729 INFO:tasks.workunit.client.0.smithi055.stdout:9/132: mknod d2/d14/c29 0 2024-04-26T21:07:59.734 INFO:tasks.workunit.client.0.smithi055.stdout:8/118: creat d3/d9/d1f/f29 x:0 0 0 2024-04-26T21:07:59.735 INFO:tasks.workunit.client.1.smithi064.stdout:7/315: link d6/db/d34/f5b d6/d9/d3d/f6e 0 2024-04-26T21:07:59.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/188: mkdir d0/d1/d23/d42 0 2024-04-26T21:07:59.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/189: readlink d0/de/l2d 0 2024-04-26T21:07:59.742 INFO:tasks.workunit.client.0.smithi055.stdout:5/123: dwrite d4/d15/f24 [4194304,4194304] 0 2024-04-26T21:07:59.742 INFO:tasks.workunit.client.0.smithi055.stdout:5/124: creat d4/df/d13/f25 x:0 0 0 2024-04-26T21:07:59.743 INFO:tasks.workunit.client.1.smithi064.stdout:4/374: rmdir d0/d1d/d17/d44/d45 39 2024-04-26T21:07:59.749 INFO:tasks.workunit.client.0.smithi055.stdout:9/133: truncate d2/f22 1164593 0 2024-04-26T21:07:59.752 INFO:tasks.workunit.client.0.smithi055.stdout:1/144: write d8/f19 [116300,36440] 0 2024-04-26T21:07:59.754 INFO:tasks.workunit.client.1.smithi064.stdout:7/316: mkdir d6/db/d34/d6f 0 2024-04-26T21:07:59.754 INFO:tasks.workunit.client.1.smithi064.stdout:7/317: fsync d6/d9/d3d/f6b 0 2024-04-26T21:07:59.757 INFO:tasks.workunit.client.0.smithi055.stdout:5/125: mkdir d4/df/d13/d26 0 2024-04-26T21:07:59.762 INFO:tasks.workunit.client.0.smithi055.stdout:9/134: link d2/d14/l18 d2/d14/l2a 0 2024-04-26T21:07:59.770 INFO:tasks.workunit.client.1.smithi064.stdout:3/276: dwrite d1/d27/d50/f2d [0,4194304] 0 2024-04-26T21:07:59.775 INFO:tasks.workunit.client.1.smithi064.stdout:7/318: mkdir d6/d70 0 2024-04-26T21:07:59.775 INFO:tasks.workunit.client.1.smithi064.stdout:7/319: chown d6/d5a/l23 485040 1 2024-04-26T21:07:59.778 INFO:tasks.workunit.client.0.smithi055.stdout:3/190: write d0/f19 [566503,98923] 0 2024-04-26T21:07:59.778 INFO:tasks.workunit.client.0.smithi055.stdout:3/191: readlink d0/d1/d13/d27/d3b/l3e 0 2024-04-26T21:07:59.779 INFO:tasks.workunit.client.1.smithi064.stdout:7/320: dread - d6/d15/f56 zero size 2024-04-26T21:07:59.779 INFO:tasks.workunit.client.1.smithi064.stdout:1/407: write d0/d6/d29/f68 [3020221,8651] 0 2024-04-26T21:07:59.781 INFO:tasks.workunit.client.0.smithi055.stdout:5/126: rename d4/df/d13/f1d to d4/f27 0 2024-04-26T21:07:59.783 INFO:tasks.workunit.client.0.smithi055.stdout:9/135: stat d2/d14/l18 0 2024-04-26T21:07:59.787 INFO:tasks.workunit.client.0.smithi055.stdout:1/145: symlink d8/df/d11/d27/d28/d2a/l30 0 2024-04-26T21:07:59.789 INFO:tasks.workunit.client.0.smithi055.stdout:1/146: read d8/df/d11/d27/d28/f29 [180517,94763] 0 2024-04-26T21:07:59.789 INFO:tasks.workunit.client.0.smithi055.stdout:6/172: dwrite d3/d17/d19/d20/f22 [0,4194304] 0 2024-04-26T21:07:59.790 INFO:tasks.workunit.client.0.smithi055.stdout:6/173: creat d3/d17/f34 x:0 0 0 2024-04-26T21:07:59.790 INFO:tasks.workunit.client.0.smithi055.stdout:3/192: symlink d0/d1/d23/d42/l43 0 2024-04-26T21:07:59.790 INFO:tasks.workunit.client.0.smithi055.stdout:3/193: read d0/d1/f2e [3730866,49986] 0 2024-04-26T21:07:59.791 INFO:tasks.workunit.client.0.smithi055.stdout:3/194: creat d0/d4/f44 x:0 0 0 2024-04-26T21:07:59.792 INFO:tasks.workunit.client.0.smithi055.stdout:3/195: chown d0/d4 6 1 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/286: write d4/f16 [3216719,1490] 0 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/287: readlink d4/lf 0 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/288: write d4/d7/d12/f14 [5804376,6572] 0 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:5/306: dwrite dd/f16 [0,4194304] 0 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:9/337: dwrite d0/d4/d7/df/f3a [0,4194304] 0 2024-04-26T21:07:59.796 INFO:tasks.workunit.client.1.smithi064.stdout:9/338: read - d0/d4/da/d26/d47/f62 zero size 2024-04-26T21:07:59.797 INFO:tasks.workunit.client.1.smithi064.stdout:0/285: dwrite dd/d10/d1a/d31/f37 [0,4194304] 0 2024-04-26T21:07:59.803 INFO:tasks.workunit.client.1.smithi064.stdout:2/330: dwrite d12/d1a/f60 [0,4194304] 0 2024-04-26T21:07:59.805 INFO:tasks.workunit.client.0.smithi055.stdout:1/147: creat d8/f31 x:0 0 0 2024-04-26T21:07:59.811 INFO:tasks.workunit.client.1.smithi064.stdout:4/375: dwrite d0/d5/d13/d33/f42 [0,4194304] 0 2024-04-26T21:07:59.812 INFO:tasks.workunit.client.0.smithi055.stdout:6/174: mknod d3/d17/d25/c35 0 2024-04-26T21:07:59.812 INFO:tasks.workunit.client.0.smithi055.stdout:6/175: truncate d3/f30 790191 0 2024-04-26T21:07:59.812 INFO:tasks.workunit.client.0.smithi055.stdout:6/176: creat d3/d17/d19/f36 x:0 0 0 2024-04-26T21:07:59.813 INFO:tasks.workunit.client.1.smithi064.stdout:1/408: rmdir d0/d6/d11/d1e 39 2024-04-26T21:07:59.813 INFO:tasks.workunit.client.1.smithi064.stdout:3/277: rename d1/d27/d2c to d1/d14/d60 0 2024-04-26T21:07:59.814 INFO:tasks.workunit.client.1.smithi064.stdout:3/278: write d1/d27/d50/d22/f40 [152547,30453] 0 2024-04-26T21:07:59.818 INFO:tasks.workunit.client.1.smithi064.stdout:8/271: dwrite d10/f2d [0,4194304] 0 2024-04-26T21:07:59.819 INFO:tasks.workunit.client.1.smithi064.stdout:6/289: creat d4/d7/d12/d49/f5c x:0 0 0 2024-04-26T21:07:59.819 INFO:tasks.workunit.client.1.smithi064.stdout:6/290: fsync d4/d7/d12/d1e/f2b 0 2024-04-26T21:07:59.819 INFO:tasks.workunit.client.1.smithi064.stdout:6/291: fsync d4/d7/d33/f50 0 2024-04-26T21:07:59.819 INFO:tasks.workunit.client.0.smithi055.stdout:9/136: link d2/f13 d2/d14/f2b 0 2024-04-26T21:07:59.822 INFO:tasks.workunit.client.0.smithi055.stdout:1/148: mknod d8/df/c32 0 2024-04-26T21:07:59.822 INFO:tasks.workunit.client.0.smithi055.stdout:1/149: chown d8/df/d11/l1c 767869213 1 2024-04-26T21:07:59.822 INFO:tasks.workunit.client.0.smithi055.stdout:1/150: stat d8/d17/d1b 0 2024-04-26T21:07:59.823 INFO:tasks.workunit.client.1.smithi064.stdout:0/286: unlink dd/d10/d1a/d31/f4a 0 2024-04-26T21:07:59.824 INFO:tasks.workunit.client.1.smithi064.stdout:0/287: readlink dd/d10/d1a/l3d 0 2024-04-26T21:07:59.827 INFO:tasks.workunit.client.0.smithi055.stdout:6/177: symlink d3/l37 0 2024-04-26T21:07:59.830 INFO:tasks.workunit.client.1.smithi064.stdout:2/331: unlink cc 0 2024-04-26T21:07:59.830 INFO:tasks.workunit.client.1.smithi064.stdout:7/321: dwrite d6/d5a/d5f/f66 [0,4194304] 0 2024-04-26T21:07:59.830 INFO:tasks.workunit.client.1.smithi064.stdout:7/322: read - d6/db/d1f/f6c zero size 2024-04-26T21:07:59.830 INFO:tasks.workunit.client.1.smithi064.stdout:7/323: chown l4 1069712618 1 2024-04-26T21:07:59.830 INFO:tasks.workunit.client.0.smithi055.stdout:9/137: rename d2/d14/l25 to d2/d11/l2c 0 2024-04-26T21:07:59.831 INFO:tasks.workunit.client.0.smithi055.stdout:9/138: dread - d2/d11/f1f zero size 2024-04-26T21:07:59.833 INFO:tasks.workunit.client.0.smithi055.stdout:1/151: mkdir d8/d17/d33 0 2024-04-26T21:07:59.833 INFO:tasks.workunit.client.1.smithi064.stdout:2/332: write d12/d45/f56 [247744,104984] 0 2024-04-26T21:07:59.837 INFO:tasks.workunit.client.0.smithi055.stdout:3/196: dwrite d0/f34 [0,4194304] 0 2024-04-26T21:07:59.838 INFO:tasks.workunit.client.0.smithi055.stdout:6/178: symlink d3/l38 0 2024-04-26T21:07:59.838 INFO:tasks.workunit.client.0.smithi055.stdout:6/179: creat d3/d17/d25/f39 x:0 0 0 2024-04-26T21:07:59.839 INFO:tasks.workunit.client.1.smithi064.stdout:3/279: mkdir d1/d27/d50/d35/d4c/d61 0 2024-04-26T21:07:59.840 INFO:tasks.workunit.client.0.smithi055.stdout:9/139: mknod d2/d14/c2d 0 2024-04-26T21:07:59.844 INFO:tasks.workunit.client.0.smithi055.stdout:1/152: unlink d8/d17/d1b/c25 0 2024-04-26T21:07:59.849 INFO:tasks.workunit.client.1.smithi064.stdout:8/272: creat d10/d41/d4e/d54/f57 x:0 0 0 2024-04-26T21:07:59.851 INFO:tasks.workunit.client.1.smithi064.stdout:5/307: symlink dd/d12/d18/l58 0 2024-04-26T21:07:59.852 INFO:tasks.workunit.client.0.smithi055.stdout:3/197: mknod d0/d1/d13/d1a/c45 0 2024-04-26T21:07:59.855 INFO:tasks.workunit.client.1.smithi064.stdout:0/288: symlink dd/d10/d1a/d31/d47/l54 0 2024-04-26T21:07:59.857 INFO:tasks.workunit.client.1.smithi064.stdout:6/292: write d4/d7/fd [2946990,62023] 0 2024-04-26T21:07:59.858 INFO:tasks.workunit.client.0.smithi055.stdout:6/180: mkdir d3/d17/d19/d20/d3a 0 2024-04-26T21:07:59.862 INFO:tasks.workunit.client.1.smithi064.stdout:1/409: dwrite d0/d6/d11/d1e/f21 [0,4194304] 0 2024-04-26T21:07:59.864 INFO:tasks.workunit.client.0.smithi055.stdout:9/140: symlink d2/d11/l2e 0 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:9/339: dwrite d0/f3b [0,4194304] 0 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/324: symlink d6/d9/d3d/d43/l71 0 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/325: chown d6/db 5 1 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/326: chown d6/d5a/d5f/f66 3 1 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/327: write d6/d15/d1c/f25 [5335859,105939] 0 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/328: read - d6/db/d34/f5b zero size 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/329: stat d6/d15/d1c/d45/f47 0 2024-04-26T21:07:59.865 INFO:tasks.workunit.client.1.smithi064.stdout:7/330: chown d6/d15/d1c/d45 954402 1 2024-04-26T21:07:59.866 INFO:tasks.workunit.client.0.smithi055.stdout:1/153: creat d8/d17/d33/f34 x:0 0 0 2024-04-26T21:07:59.867 INFO:tasks.workunit.client.1.smithi064.stdout:2/333: mknod d12/d16/c74 0 2024-04-26T21:07:59.867 INFO:tasks.workunit.client.1.smithi064.stdout:2/334: chown d12/d16/d2f/d53/l5c 0 1 2024-04-26T21:07:59.869 INFO:tasks.workunit.client.1.smithi064.stdout:4/376: getdents d0/d5/d3e 0 2024-04-26T21:07:59.869 INFO:tasks.workunit.client.1.smithi064.stdout:4/377: write d0/d1d/f2e [418212,24136] 0 2024-04-26T21:07:59.872 INFO:tasks.workunit.client.0.smithi055.stdout:3/198: mkdir d0/d1/d13/d1a/d46 0 2024-04-26T21:07:59.873 INFO:tasks.workunit.client.1.smithi064.stdout:3/280: mknod d1/d27/d29/c62 0 2024-04-26T21:07:59.874 INFO:tasks.workunit.client.0.smithi055.stdout:1/154: creat d8/f35 x:0 0 0 2024-04-26T21:07:59.874 INFO:tasks.workunit.client.0.smithi055.stdout:1/155: dread - d8/f31 zero size 2024-04-26T21:07:59.875 INFO:tasks.workunit.client.1.smithi064.stdout:6/293: dread d4/f16 [0,4194304] 0 2024-04-26T21:07:59.882 INFO:tasks.workunit.client.1.smithi064.stdout:0/289: creat dd/d10/d1a/d31/d43/f55 x:0 0 0 2024-04-26T21:07:59.882 INFO:tasks.workunit.client.0.smithi055.stdout:3/199: rename d0/d1/d23 to d0/d1/d47 0 2024-04-26T21:07:59.883 INFO:tasks.workunit.client.0.smithi055.stdout:3/200: write d0/d1/d13/d1a/f24 [970852,92194] 0 2024-04-26T21:07:59.884 INFO:tasks.workunit.client.1.smithi064.stdout:1/410: getdents d0/d6/d11/d1e/d2a 0 2024-04-26T21:07:59.884 INFO:tasks.workunit.client.1.smithi064.stdout:1/411: stat d0/l8 0 2024-04-26T21:07:59.886 INFO:tasks.workunit.client.1.smithi064.stdout:4/378: dread d0/d5/d13/d33/f39 [0,4194304] 0 2024-04-26T21:07:59.887 INFO:tasks.workunit.client.1.smithi064.stdout:4/379: creat d0/d5/f7c x:0 0 0 2024-04-26T21:07:59.888 INFO:tasks.workunit.client.0.smithi055.stdout:3/201: rename d0/d1/l10 to d0/d1/d13/d27/l48 0 2024-04-26T21:07:59.890 INFO:tasks.workunit.client.1.smithi064.stdout:9/340: mkdir d0/d4/d71 0 2024-04-26T21:07:59.893 INFO:tasks.workunit.client.1.smithi064.stdout:7/331: symlink d6/d5a/l72 0 2024-04-26T21:07:59.895 INFO:tasks.workunit.client.0.smithi055.stdout:1/156: dread d8/f15 [0,4194304] 0 2024-04-26T21:07:59.897 INFO:tasks.workunit.client.1.smithi064.stdout:3/281: getdents d1/d27/d50/d35/d4c 0 2024-04-26T21:07:59.898 INFO:tasks.workunit.client.1.smithi064.stdout:0/290: symlink dd/l56 0 2024-04-26T21:07:59.900 INFO:tasks.workunit.client.0.smithi055.stdout:9/141: dread d2/f10 [0,4194304] 0 2024-04-26T21:07:59.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/157: mkdir d8/d17/d36 0 2024-04-26T21:07:59.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/158: write d8/f15 [1046449,20072] 0 2024-04-26T21:07:59.900 INFO:tasks.workunit.client.0.smithi055.stdout:9/142: write d2/f1e [1911563,52542] 0 2024-04-26T21:07:59.901 INFO:tasks.workunit.client.1.smithi064.stdout:1/412: symlink d0/d6/d11/d1e/d27/l7c 0 2024-04-26T21:07:59.901 INFO:tasks.workunit.client.1.smithi064.stdout:1/413: dread - d0/d6/d11/f7a zero size 2024-04-26T21:07:59.903 INFO:tasks.workunit.client.1.smithi064.stdout:4/380: mkdir d0/d2f/d7d 0 2024-04-26T21:07:59.903 INFO:tasks.workunit.client.1.smithi064.stdout:4/381: dread - d0/d5/d3e/d54/f72 zero size 2024-04-26T21:07:59.904 INFO:tasks.workunit.client.0.smithi055.stdout:1/159: creat d8/df/d11/f37 x:0 0 0 2024-04-26T21:07:59.905 INFO:tasks.workunit.client.1.smithi064.stdout:9/341: rmdir d0/d4/d71 0 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:8/273: write d10/f4d [1248673,57366] 0 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:8/274: readlink d10/d41/d4e/l3e 0 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:8/275: dread - d10/d41/d4e/d54/f55 zero size 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:5/308: dwrite dd/d12/d18/d1a/d1f/f24 [8388608,4194304] 0 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:5/309: readlink dd/d12/d18/d1a/l3a 0 2024-04-26T21:07:59.911 INFO:tasks.workunit.client.1.smithi064.stdout:5/310: creat dd/d12/d18/d1a/d1f/d20/f59 x:0 0 0 2024-04-26T21:07:59.912 INFO:tasks.workunit.client.1.smithi064.stdout:7/332: symlink d6/d15/d67/l73 0 2024-04-26T21:07:59.913 INFO:tasks.workunit.client.0.smithi055.stdout:3/202: dread d0/d1/d13/f1d [0,4194304] 0 2024-04-26T21:07:59.914 INFO:tasks.workunit.client.0.smithi055.stdout:3/203: write d0/d4/d5/f36 [920604,28107] 0 2024-04-26T21:07:59.916 INFO:tasks.workunit.client.0.smithi055.stdout:9/143: rmdir d2/d14 39 2024-04-26T21:07:59.917 INFO:tasks.workunit.client.1.smithi064.stdout:3/282: symlink d1/d38/l63 0 2024-04-26T21:07:59.917 INFO:tasks.workunit.client.1.smithi064.stdout:3/283: write d1/f11 [4874580,38544] 0 2024-04-26T21:07:59.918 INFO:tasks.workunit.client.1.smithi064.stdout:0/291: dread dd/f2a [0,4194304] 0 2024-04-26T21:07:59.919 INFO:tasks.workunit.client.0.smithi055.stdout:6/181: dwrite d3/d17/f29 [0,4194304] 0 2024-04-26T21:07:59.919 INFO:tasks.workunit.client.0.smithi055.stdout:6/182: stat d3/ca 0 2024-04-26T21:07:59.919 INFO:tasks.workunit.client.0.smithi055.stdout:6/183: chown d3/d17/d25/c2c 50066401 1 2024-04-26T21:07:59.921 INFO:tasks.workunit.client.1.smithi064.stdout:4/382: mkdir d0/d5/d13/d6d/d7e 0 2024-04-26T21:07:59.921 INFO:tasks.workunit.client.1.smithi064.stdout:4/383: dread - d0/d5/d13/d10/f4c zero size 2024-04-26T21:07:59.921 INFO:tasks.workunit.client.1.smithi064.stdout:4/384: chown d0/d5/d3e/f67 1955073304 1 2024-04-26T21:07:59.923 INFO:tasks.workunit.client.0.smithi055.stdout:9/144: creat d2/d11/f2f x:0 0 0 2024-04-26T21:07:59.923 INFO:tasks.workunit.client.0.smithi055.stdout:9/145: write d2/d11/f2f [248321,94044] 0 2024-04-26T21:07:59.924 INFO:tasks.workunit.client.1.smithi064.stdout:9/342: write d0/d4/f24 [1228642,21280] 0 2024-04-26T21:07:59.928 INFO:tasks.workunit.client.1.smithi064.stdout:6/294: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:07:59.928 INFO:tasks.workunit.client.1.smithi064.stdout:6/295: write d4/d7/d12/d38/f51 [190309,71093] 0 2024-04-26T21:07:59.931 INFO:tasks.workunit.client.0.smithi055.stdout:3/204: write d0/d4/d16/f26 [4101761,80509] 0 2024-04-26T21:07:59.934 INFO:tasks.workunit.client.0.smithi055.stdout:9/146: dread d2/f22 [0,4194304] 0 2024-04-26T21:07:59.935 INFO:tasks.workunit.client.1.smithi064.stdout:7/333: mkdir d6/d70/d74 0 2024-04-26T21:07:59.935 INFO:tasks.workunit.client.1.smithi064.stdout:2/335: rename d12/d1a to d12/d41/d61/d75 0 2024-04-26T21:07:59.936 INFO:tasks.workunit.client.1.smithi064.stdout:0/292: dread dd/d10/d1a/f2f [0,4194304] 0 2024-04-26T21:07:59.937 INFO:tasks.workunit.client.1.smithi064.stdout:0/293: fsync dd/d10/f2e 0 2024-04-26T21:07:59.937 INFO:tasks.workunit.client.0.smithi055.stdout:6/184: rmdir d3/d17/d19/d20/d3a 0 2024-04-26T21:07:59.937 INFO:tasks.workunit.client.0.smithi055.stdout:6/185: fdatasync f0 0 2024-04-26T21:07:59.938 INFO:tasks.workunit.client.1.smithi064.stdout:3/284: symlink d1/l64 0 2024-04-26T21:07:59.939 INFO:tasks.workunit.client.0.smithi055.stdout:9/147: symlink d2/d14/l30 0 2024-04-26T21:07:59.940 INFO:tasks.workunit.client.1.smithi064.stdout:4/385: mknod d0/d2f/c7f 0 2024-04-26T21:07:59.943 INFO:tasks.workunit.client.0.smithi055.stdout:6/186: link d3/l37 d3/d17/l3b 0 2024-04-26T21:07:59.943 INFO:tasks.workunit.client.0.smithi055.stdout:6/187: chown d3/f5 6692394 1 2024-04-26T21:07:59.946 INFO:tasks.workunit.client.1.smithi064.stdout:9/343: mkdir d0/d4/da/d26/d47/d72 0 2024-04-26T21:07:59.946 INFO:tasks.workunit.client.1.smithi064.stdout:9/344: stat d0/d4/d7/f20 0 2024-04-26T21:07:59.948 INFO:tasks.workunit.client.0.smithi055.stdout:9/148: symlink d2/d11/l31 0 2024-04-26T21:07:59.954 INFO:tasks.workunit.client.1.smithi064.stdout:6/296: creat d4/d7/d12/d49/d4b/d5a/f5d x:0 0 0 2024-04-26T21:07:59.961 INFO:tasks.workunit.client.1.smithi064.stdout:1/414: rename d0/d6/d11/f1d to d0/d6/f7d 0 2024-04-26T21:07:59.962 INFO:tasks.workunit.client.0.smithi055.stdout:6/188: rmdir d3/d17/d25 39 2024-04-26T21:07:59.970 INFO:tasks.workunit.client.1.smithi064.stdout:0/294: creat dd/d1c/d1d/f57 x:0 0 0 2024-04-26T21:07:59.970 INFO:tasks.workunit.client.1.smithi064.stdout:4/386: unlink d0/d14/l27 0 2024-04-26T21:07:59.970 INFO:tasks.workunit.client.1.smithi064.stdout:6/297: mknod d4/d7/c5e 0 2024-04-26T21:07:59.970 INFO:tasks.workunit.client.1.smithi064.stdout:3/285: getdents d1/d27/d50/d35/d4c/d55 0 2024-04-26T21:07:59.970 INFO:tasks.workunit.client.1.smithi064.stdout:7/334: getdents d6/db/d1f/d50 0 2024-04-26T21:07:59.973 INFO:tasks.workunit.client.1.smithi064.stdout:5/311: rename dd/d12/d18/d1a/d1f/d20/f31 to dd/d12/d18/d1a/d1f/f5a 0 2024-04-26T21:07:59.974 INFO:tasks.workunit.client.1.smithi064.stdout:5/312: stat dd/d12/d18/d1a/d1f/f5a 0 2024-04-26T21:07:59.974 INFO:tasks.workunit.client.1.smithi064.stdout:1/415: unlink d0/d6/d11/d1e/d2a/d34/f53 0 2024-04-26T21:07:59.974 INFO:tasks.workunit.client.1.smithi064.stdout:1/416: fsync d0/d6/f74 0 2024-04-26T21:07:59.977 INFO:tasks.workunit.client.1.smithi064.stdout:4/387: truncate d0/d5/d13/d6d/f4b 1657664 0 2024-04-26T21:07:59.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/286: symlink d1/d27/d50/d35/d4c/d61/l65 0 2024-04-26T21:07:59.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/287: readlink d1/d12/l15 0 2024-04-26T21:07:59.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/288: truncate d1/d38/f49 4681588 0 2024-04-26T21:07:59.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/289: fsync d1/ff 0 2024-04-26T21:07:59.981 INFO:tasks.workunit.client.1.smithi064.stdout:5/313: rename dd/f2a to dd/d12/d18/d1a/d1b/f5b 0 2024-04-26T21:07:59.982 INFO:tasks.workunit.client.1.smithi064.stdout:1/417: truncate d0/d6/d11/d1e/f43 450000 0 2024-04-26T21:07:59.982 INFO:tasks.workunit.client.1.smithi064.stdout:6/298: read d4/f2f [253918,27578] 0 2024-04-26T21:07:59.983 INFO:tasks.workunit.client.1.smithi064.stdout:0/295: mkdir dd/d10/d18/d58 0 2024-04-26T21:07:59.985 INFO:tasks.workunit.client.1.smithi064.stdout:4/388: creat d0/d5/d79/f80 x:0 0 0 2024-04-26T21:07:59.987 INFO:tasks.workunit.client.1.smithi064.stdout:7/335: rename d6/d9/d38/l64 to d6/d9/l75 0 2024-04-26T21:07:59.995 INFO:tasks.workunit.client.0.smithi055.stdout:1/160: dwrite d8/f19 [0,4194304] 0 2024-04-26T21:07:59.996 INFO:tasks.workunit.client.1.smithi064.stdout:0/296: mknod dd/d10/d1a/d31/c59 0 2024-04-26T21:07:59.996 INFO:tasks.workunit.client.1.smithi064.stdout:5/314: creat dd/d12/d18/f5c x:0 0 0 2024-04-26T21:07:59.996 INFO:tasks.workunit.client.1.smithi064.stdout:0/297: chown dd/d21/c33 1825032 1 2024-04-26T21:07:59.996 INFO:tasks.workunit.client.1.smithi064.stdout:6/299: dread d4/d7/d12/d1e/f2b [0,4194304] 0 2024-04-26T21:07:59.996 INFO:tasks.workunit.client.1.smithi064.stdout:8/276: dwrite d10/d2f/f4c [0,4194304] 0 2024-04-26T21:07:59.997 INFO:tasks.workunit.client.1.smithi064.stdout:4/389: creat d0/d1d/d17/d57/f81 x:0 0 0 2024-04-26T21:08:00.001 INFO:tasks.workunit.client.1.smithi064.stdout:8/277: fdatasync d10/f24 0 2024-04-26T21:08:00.002 INFO:tasks.workunit.client.0.smithi055.stdout:1/161: symlink d8/d17/d36/l38 0 2024-04-26T21:08:00.002 INFO:tasks.workunit.client.0.smithi055.stdout:1/162: readlink d8/df/d11/d27/d28/d2a/l30 0 2024-04-26T21:08:00.003 INFO:tasks.workunit.client.0.smithi055.stdout:6/189: dread d3/f5 [0,4194304] 0 2024-04-26T21:08:00.004 INFO:tasks.workunit.client.1.smithi064.stdout:8/278: chown d10/d1d/f30 344 1 2024-04-26T21:08:00.006 INFO:tasks.workunit.client.0.smithi055.stdout:6/190: mknod d3/d17/d19/d20/c3c 0 2024-04-26T21:08:00.006 INFO:tasks.workunit.client.0.smithi055.stdout:6/191: creat d3/d17/d19/f3d x:0 0 0 2024-04-26T21:08:00.019 INFO:tasks.workunit.client.0.smithi055.stdout:1/163: dread d8/f15 [0,4194304] 0 2024-04-26T21:08:00.020 INFO:tasks.workunit.client.0.smithi055.stdout:1/164: write f1 [4359146,27073] 0 2024-04-26T21:08:00.042 INFO:tasks.workunit.client.0.smithi055.stdout:9/149: dwrite d2/d14/f21 [4194304,4194304] 0 2024-04-26T21:08:00.042 INFO:tasks.workunit.client.1.smithi064.stdout:8/279: dread d10/f12 [0,4194304] 0 2024-04-26T21:08:00.042 INFO:tasks.workunit.client.0.smithi055.stdout:1/165: mknod d8/df/d11/d27/d28/d2a/c39 0 2024-04-26T21:08:00.051 INFO:tasks.workunit.client.0.smithi055.stdout:3/205: dwrite d0/d4/d5/f6 [4194304,4194304] 0 2024-04-26T21:08:00.051 INFO:tasks.workunit.client.0.smithi055.stdout:3/206: rename d0/d1/d13/d27 to d0/d1/d13/d27/d3b/d49 22 2024-04-26T21:08:00.054 INFO:tasks.workunit.client.0.smithi055.stdout:9/150: unlink d2/d14/c29 0 2024-04-26T21:08:00.060 INFO:tasks.workunit.client.1.smithi064.stdout:2/336: dwrite d12/d16/d2f/d53/f6d [0,4194304] 0 2024-04-26T21:08:00.060 INFO:tasks.workunit.client.1.smithi064.stdout:8/280: link c8 d10/d41/c58 0 2024-04-26T21:08:00.067 INFO:tasks.workunit.client.0.smithi055.stdout:3/207: mknod d0/d4/d16/d18/c4a 0 2024-04-26T21:08:00.069 INFO:tasks.workunit.client.1.smithi064.stdout:3/290: dwrite d1/d27/d50/d35/f36 [0,4194304] 0 2024-04-26T21:08:00.070 INFO:tasks.workunit.client.1.smithi064.stdout:5/315: dread dd/d12/d18/f36 [0,4194304] 0 2024-04-26T21:08:00.073 INFO:tasks.workunit.client.1.smithi064.stdout:2/337: mknod d12/d41/d61/c76 0 2024-04-26T21:08:00.073 INFO:tasks.workunit.client.1.smithi064.stdout:2/338: truncate d12/d41/d61/d75/f60 4978661 0 2024-04-26T21:08:00.073 INFO:tasks.workunit.client.1.smithi064.stdout:2/339: creat d12/d16/f77 x:0 0 0 2024-04-26T21:08:00.074 INFO:tasks.workunit.client.1.smithi064.stdout:2/340: stat d12/d28/d3a/c4a 0 2024-04-26T21:08:00.075 INFO:tasks.workunit.client.1.smithi064.stdout:7/336: dwrite d6/db/d1f/d50/f57 [0,4194304] 0 2024-04-26T21:08:00.075 INFO:tasks.workunit.client.1.smithi064.stdout:7/337: fdatasync d6/d9/f36 0 2024-04-26T21:08:00.075 INFO:tasks.workunit.client.1.smithi064.stdout:7/338: creat d6/d9/f76 x:0 0 0 2024-04-26T21:08:00.078 INFO:tasks.workunit.client.1.smithi064.stdout:3/291: creat d1/d27/d50/d35/f66 x:0 0 0 2024-04-26T21:08:00.078 INFO:tasks.workunit.client.1.smithi064.stdout:3/292: creat d1/d27/d29/f67 x:0 0 0 2024-04-26T21:08:00.079 INFO:tasks.workunit.client.1.smithi064.stdout:1/418: dwrite d0/d22/f5f [0,4194304] 0 2024-04-26T21:08:00.080 INFO:tasks.workunit.client.0.smithi055.stdout:6/192: dwrite d3/f15 [4194304,4194304] 0 2024-04-26T21:08:00.080 INFO:tasks.workunit.client.1.smithi064.stdout:5/316: truncate dd/d12/d18/f36 125880 0 2024-04-26T21:08:00.081 INFO:tasks.workunit.client.1.smithi064.stdout:2/341: creat d12/f78 x:0 0 0 2024-04-26T21:08:00.081 INFO:tasks.workunit.client.1.smithi064.stdout:2/342: fsync d12/d28/d3a/f64 0 2024-04-26T21:08:00.081 INFO:tasks.workunit.client.1.smithi064.stdout:2/343: truncate d12/d28/d3a/d46/d6a/f5a 3449816 0 2024-04-26T21:08:00.085 INFO:tasks.workunit.client.1.smithi064.stdout:0/298: dwrite dd/f15 [0,4194304] 0 2024-04-26T21:08:00.086 INFO:tasks.workunit.client.0.smithi055.stdout:9/151: write d2/f10 [3383956,91354] 0 2024-04-26T21:08:00.086 INFO:tasks.workunit.client.1.smithi064.stdout:8/281: unlink d10/f2d 0 2024-04-26T21:08:00.092 INFO:tasks.workunit.client.0.smithi055.stdout:9/152: truncate d2/f22 1019237 0 2024-04-26T21:08:00.098 INFO:tasks.workunit.client.1.smithi064.stdout:3/293: mkdir d1/d38/d68 0 2024-04-26T21:08:00.098 INFO:tasks.workunit.client.1.smithi064.stdout:3/294: chown d1/d38/f49 182162 1 2024-04-26T21:08:00.098 INFO:tasks.workunit.client.1.smithi064.stdout:3/295: write d1/d14/d60/f57 [297189,116331] 0 2024-04-26T21:08:00.102 INFO:tasks.workunit.client.0.smithi055.stdout:0/216: sync 2024-04-26T21:08:00.102 INFO:tasks.workunit.client.0.smithi055.stdout:4/124: sync 2024-04-26T21:08:00.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/185: sync 2024-04-26T21:08:00.102 INFO:tasks.workunit.client.0.smithi055.stdout:0/217: write d9/d11/f46 [479959,30747] 0 2024-04-26T21:08:00.103 INFO:tasks.workunit.client.0.smithi055.stdout:6/193: dread d3/f16 [0,4194304] 0 2024-04-26T21:08:00.103 INFO:tasks.workunit.client.0.smithi055.stdout:6/194: truncate d3/d17/f34 167342 0 2024-04-26T21:08:00.103 INFO:tasks.workunit.client.0.smithi055.stdout:6/195: write d3/d17/d19/f3d [526849,33038] 0 2024-04-26T21:08:00.106 INFO:tasks.workunit.client.1.smithi064.stdout:1/419: creat d0/d6/d11/d1e/d2a/d34/d57/d66/f7e x:0 0 0 2024-04-26T21:08:00.106 INFO:tasks.workunit.client.1.smithi064.stdout:4/390: dwrite d0/d1d/d56/f65 [0,4194304] 0 2024-04-26T21:08:00.106 INFO:tasks.workunit.client.1.smithi064.stdout:1/420: write d0/d6/d11/d1e/d2a/d34/f79 [4555050,115035] 0 2024-04-26T21:08:00.106 INFO:tasks.workunit.client.1.smithi064.stdout:4/391: fsync d0/d5/d13/f12 0 2024-04-26T21:08:00.111 INFO:tasks.workunit.client.0.smithi055.stdout:3/208: dread d0/d4/d5/f6 [4194304,4194304] 0 2024-04-26T21:08:00.112 INFO:tasks.workunit.client.0.smithi055.stdout:3/209: readlink d0/d1/d47/d37/l3c 0 2024-04-26T21:08:00.112 INFO:tasks.workunit.client.0.smithi055.stdout:1/166: dwrite d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:00.112 INFO:tasks.workunit.client.0.smithi055.stdout:1/167: readlink l3 0 2024-04-26T21:08:00.112 INFO:tasks.workunit.client.0.smithi055.stdout:1/168: dread - d8/f31 zero size 2024-04-26T21:08:00.112 INFO:tasks.workunit.client.1.smithi064.stdout:2/344: rmdir d12/d28/d3a/d3e 39 2024-04-26T21:08:00.113 INFO:tasks.workunit.client.1.smithi064.stdout:2/345: chown d12/l1d 233724998 1 2024-04-26T21:08:00.113 INFO:tasks.workunit.client.1.smithi064.stdout:2/346: creat d12/d28/d3a/f79 x:0 0 0 2024-04-26T21:08:00.117 INFO:tasks.workunit.client.1.smithi064.stdout:7/339: write d6/d9/d38/f3a [2480746,98174] 0 2024-04-26T21:08:00.117 INFO:tasks.workunit.client.1.smithi064.stdout:6/300: dwrite d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:00.117 INFO:tasks.workunit.client.1.smithi064.stdout:6/301: write d4/d7/d12/d38/f5b [489482,114598] 0 2024-04-26T21:08:00.117 INFO:tasks.workunit.client.1.smithi064.stdout:0/299: dread dd/d10/d1a/d31/f3c [0,4194304] 0 2024-04-26T21:08:00.118 INFO:tasks.workunit.client.1.smithi064.stdout:0/300: dread - dd/d1c/d1d/f57 zero size 2024-04-26T21:08:00.119 INFO:tasks.workunit.client.1.smithi064.stdout:8/282: mkdir d10/d41/d4e/d59 0 2024-04-26T21:08:00.124 INFO:tasks.workunit.client.1.smithi064.stdout:3/296: symlink d1/d27/l69 0 2024-04-26T21:08:00.124 INFO:tasks.workunit.client.1.smithi064.stdout:3/297: creat d1/d14/f6a x:0 0 0 2024-04-26T21:08:00.124 INFO:tasks.workunit.client.1.smithi064.stdout:3/298: chown d1/d38/f47 27398 1 2024-04-26T21:08:00.125 INFO:tasks.workunit.client.0.smithi055.stdout:0/218: read d9/d27/f37 [3810584,79036] 0 2024-04-26T21:08:00.125 INFO:tasks.workunit.client.0.smithi055.stdout:0/219: write d9/dc/d17/f3f [749724,104965] 0 2024-04-26T21:08:00.125 INFO:tasks.workunit.client.0.smithi055.stdout:0/220: write f8 [4210809,33082] 0 2024-04-26T21:08:00.127 INFO:tasks.workunit.client.0.smithi055.stdout:9/153: mknod d2/d14/c32 0 2024-04-26T21:08:00.135 INFO:tasks.workunit.client.1.smithi064.stdout:1/421: rename d0/d6/d11/d1e/f43 to d0/d6/d29/d31/f7f 0 2024-04-26T21:08:00.136 INFO:tasks.workunit.client.0.smithi055.stdout:6/196: mkdir d3/d17/d19/d20/d3e 0 2024-04-26T21:08:00.137 INFO:tasks.workunit.client.0.smithi055.stdout:6/197: write d3/d17/d19/f36 [239345,37946] 0 2024-04-26T21:08:00.138 INFO:tasks.workunit.client.1.smithi064.stdout:4/392: rmdir d0/d1d/d17/d44/d45 39 2024-04-26T21:08:00.138 INFO:tasks.workunit.client.0.smithi055.stdout:3/210: dread d0/d4/d5/f6 [4194304,4194304] 0 2024-04-26T21:08:00.144 INFO:tasks.workunit.client.1.smithi064.stdout:2/347: symlink d12/d41/d73/l7a 0 2024-04-26T21:08:00.145 INFO:tasks.workunit.client.0.smithi055.stdout:1/169: creat d8/df/d11/d27/f3a x:0 0 0 2024-04-26T21:08:00.147 INFO:tasks.workunit.client.0.smithi055.stdout:0/221: rmdir d9 39 2024-04-26T21:08:00.147 INFO:tasks.workunit.client.0.smithi055.stdout:7/186: dwrite f1 [0,4194304] 0 2024-04-26T21:08:00.147 INFO:tasks.workunit.client.0.smithi055.stdout:7/187: write d5/db/f14 [1192731,127857] 0 2024-04-26T21:08:00.148 INFO:tasks.workunit.client.1.smithi064.stdout:5/317: dwrite dd/d12/f40 [0,4194304] 0 2024-04-26T21:08:00.148 INFO:tasks.workunit.client.1.smithi064.stdout:5/318: creat dd/d12/d18/d25/d32/f5d x:0 0 0 2024-04-26T21:08:00.151 INFO:tasks.workunit.client.0.smithi055.stdout:9/154: mkdir d2/d14/d33 0 2024-04-26T21:08:00.157 INFO:tasks.workunit.client.0.smithi055.stdout:6/198: mknod d3/d17/d19/c3f 0 2024-04-26T21:08:00.157 INFO:tasks.workunit.client.0.smithi055.stdout:3/211: mkdir d0/d4/d16/d18/d4b 0 2024-04-26T21:08:00.167 INFO:tasks.workunit.client.0.smithi055.stdout:9/155: chown d2/c5 170545 1 2024-04-26T21:08:00.167 INFO:tasks.workunit.client.0.smithi055.stdout:9/156: chown d2/fe 26806697 1 2024-04-26T21:08:00.167 INFO:tasks.workunit.client.1.smithi064.stdout:6/302: dwrite d4/d7/d12/d49/d4b/d5a/f5d [0,4194304] 0 2024-04-26T21:08:00.169 INFO:tasks.workunit.client.0.smithi055.stdout:3/212: mkdir d0/d1/d47/d37/d3d/d4c 0 2024-04-26T21:08:00.171 INFO:tasks.workunit.client.0.smithi055.stdout:2/150: sync 2024-04-26T21:08:00.172 INFO:tasks.workunit.client.0.smithi055.stdout:5/127: sync 2024-04-26T21:08:00.172 INFO:tasks.workunit.client.0.smithi055.stdout:8/119: sync 2024-04-26T21:08:00.172 INFO:tasks.workunit.client.0.smithi055.stdout:8/120: fdatasync f1 0 2024-04-26T21:08:00.173 INFO:tasks.workunit.client.1.smithi064.stdout:7/340: unlink d6/d15/d67/f31 0 2024-04-26T21:08:00.175 INFO:tasks.workunit.client.0.smithi055.stdout:3/213: rmdir d0/d1/d13 39 2024-04-26T21:08:00.180 INFO:tasks.workunit.client.1.smithi064.stdout:0/301: truncate dd/f14 291195 0 2024-04-26T21:08:00.180 INFO:tasks.workunit.client.1.smithi064.stdout:0/302: chown dd/f12 7080913 1 2024-04-26T21:08:00.185 INFO:tasks.workunit.client.0.smithi055.stdout:2/151: mkdir d4/db/d1f/d32 0 2024-04-26T21:08:00.185 INFO:tasks.workunit.client.0.smithi055.stdout:2/152: write d4/d14/f20 [1479265,21891] 0 2024-04-26T21:08:00.189 INFO:tasks.workunit.client.1.smithi064.stdout:8/283: mkdir d10/d41/d44/d5a 0 2024-04-26T21:08:00.189 INFO:tasks.workunit.client.1.smithi064.stdout:8/284: chown d10/d41/c58 6 1 2024-04-26T21:08:00.190 INFO:tasks.workunit.client.0.smithi055.stdout:6/199: dread d3/f16 [0,4194304] 0 2024-04-26T21:08:00.195 INFO:tasks.workunit.client.0.smithi055.stdout:5/128: mkdir d4/df/d13/d26/d28 0 2024-04-26T21:08:00.201 INFO:tasks.workunit.client.1.smithi064.stdout:3/299: symlink d1/d27/d50/l6b 0 2024-04-26T21:08:00.201 INFO:tasks.workunit.client.1.smithi064.stdout:3/300: creat d1/d38/f6c x:0 0 0 2024-04-26T21:08:00.201 INFO:tasks.workunit.client.1.smithi064.stdout:3/301: chown d1/d27/d50/f52 29 1 2024-04-26T21:08:00.201 INFO:tasks.workunit.client.1.smithi064.stdout:3/302: readlink d1/d27/d29/l41 0 2024-04-26T21:08:00.201 INFO:tasks.workunit.client.0.smithi055.stdout:9/157: mknod d2/c34 0 2024-04-26T21:08:00.202 INFO:tasks.workunit.client.1.smithi064.stdout:1/422: getdents d0/d6/d29 0 2024-04-26T21:08:00.204 INFO:tasks.workunit.client.0.smithi055.stdout:1/170: write d8/f12 [777578,79629] 0 2024-04-26T21:08:00.205 INFO:tasks.workunit.client.0.smithi055.stdout:3/214: link d0/d1/l2 d0/d1/d47/d37/d3d/l4d 0 2024-04-26T21:08:00.207 INFO:tasks.workunit.client.1.smithi064.stdout:4/393: mknod d0/d1d/c82 0 2024-04-26T21:08:00.207 INFO:tasks.workunit.client.1.smithi064.stdout:4/394: chown d0/d2f/d69/l7a 62 1 2024-04-26T21:08:00.208 INFO:tasks.workunit.client.0.smithi055.stdout:6/200: symlink d3/d17/d19/d20/d3e/l40 0 2024-04-26T21:08:00.208 INFO:tasks.workunit.client.0.smithi055.stdout:6/201: stat d3/d17/d19/c3f 0 2024-04-26T21:08:00.210 INFO:tasks.workunit.client.1.smithi064.stdout:2/348: symlink d12/d41/d73/l7b 0 2024-04-26T21:08:00.211 INFO:tasks.workunit.client.0.smithi055.stdout:5/129: unlink d4/d15/f16 0 2024-04-26T21:08:00.212 INFO:tasks.workunit.client.0.smithi055.stdout:2/153: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:08:00.214 INFO:tasks.workunit.client.0.smithi055.stdout:8/121: getdents d3/d9 0 2024-04-26T21:08:00.215 INFO:tasks.workunit.client.0.smithi055.stdout:8/122: truncate d3/d9/d1f/f27 759443 0 2024-04-26T21:08:00.217 INFO:tasks.workunit.client.0.smithi055.stdout:1/171: symlink d8/df/l3b 0 2024-04-26T21:08:00.217 INFO:tasks.workunit.client.0.smithi055.stdout:1/172: write d8/df/d11/d27/d28/f29 [903223,6943] 0 2024-04-26T21:08:00.219 INFO:tasks.workunit.client.0.smithi055.stdout:1/173: write d8/f12 [4101676,94580] 0 2024-04-26T21:08:00.221 INFO:tasks.workunit.client.1.smithi064.stdout:9/345: sync 2024-04-26T21:08:00.221 INFO:tasks.workunit.client.0.smithi055.stdout:0/222: dwrite d9/fa [0,4194304] 0 2024-04-26T21:08:00.223 INFO:tasks.workunit.client.0.smithi055.stdout:3/215: mknod d0/d1/d13/d1a/c4e 0 2024-04-26T21:08:00.223 INFO:tasks.workunit.client.0.smithi055.stdout:5/130: symlink d4/l29 0 2024-04-26T21:08:00.223 INFO:tasks.workunit.client.0.smithi055.stdout:3/216: chown d0/d4/d16/d18/d4b 241464 1 2024-04-26T21:08:00.224 INFO:tasks.workunit.client.0.smithi055.stdout:5/131: write d4/d15/f1f [359209,119845] 0 2024-04-26T21:08:00.228 INFO:tasks.workunit.client.0.smithi055.stdout:9/158: dread d2/d14/f21 [0,4194304] 0 2024-04-26T21:08:00.228 INFO:tasks.workunit.client.0.smithi055.stdout:7/188: dwrite d5/f29 [0,4194304] 0 2024-04-26T21:08:00.229 INFO:tasks.workunit.client.1.smithi064.stdout:3/303: dread d1/d12/f44 [0,4194304] 0 2024-04-26T21:08:00.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/154: mkdir d4/d14/d33 0 2024-04-26T21:08:00.233 INFO:tasks.workunit.client.1.smithi064.stdout:6/303: dwrite d4/f2f [0,4194304] 0 2024-04-26T21:08:00.234 INFO:tasks.workunit.client.0.smithi055.stdout:9/159: read d2/f22 [831007,59902] 0 2024-04-26T21:08:00.236 INFO:tasks.workunit.client.0.smithi055.stdout:8/123: chown d3/cf 1137 1 2024-04-26T21:08:00.239 INFO:tasks.workunit.client.0.smithi055.stdout:0/223: mkdir d9/d11/d4d 0 2024-04-26T21:08:00.241 INFO:tasks.workunit.client.0.smithi055.stdout:1/174: dread f6 [0,4194304] 0 2024-04-26T21:08:00.242 INFO:tasks.workunit.client.1.smithi064.stdout:4/395: unlink d0/d2f/c31 0 2024-04-26T21:08:00.244 INFO:tasks.workunit.client.1.smithi064.stdout:2/349: symlink d12/d28/d3a/d46/d6a/l7c 0 2024-04-26T21:08:00.245 INFO:tasks.workunit.client.0.smithi055.stdout:3/217: truncate d0/d4/d5/f6 6805032 0 2024-04-26T21:08:00.247 INFO:tasks.workunit.client.1.smithi064.stdout:1/423: dwrite d0/d6/d29/d31/f51 [0,4194304] 0 2024-04-26T21:08:00.247 INFO:tasks.workunit.client.1.smithi064.stdout:1/424: write d0/d6/d11/d1e/f54 [725005,19647] 0 2024-04-26T21:08:00.247 INFO:tasks.workunit.client.1.smithi064.stdout:1/425: write d0/d6/d11/d1e/d2a/d34/d57/d66/f7e [186697,44926] 0 2024-04-26T21:08:00.248 INFO:tasks.workunit.client.1.smithi064.stdout:5/319: link dd/d12/d18/c28 dd/d12/d4f/c5e 0 2024-04-26T21:08:00.252 INFO:tasks.workunit.client.1.smithi064.stdout:3/304: creat d1/d27/d29/d5e/f6d x:0 0 0 2024-04-26T21:08:00.252 INFO:tasks.workunit.client.1.smithi064.stdout:3/305: truncate d1/f2f 981964 0 2024-04-26T21:08:00.252 INFO:tasks.workunit.client.1.smithi064.stdout:1/426: fdatasync d0/d6/d11/d1e/d2a/d34/d57/d66/f7e 0 2024-04-26T21:08:00.253 INFO:tasks.workunit.client.1.smithi064.stdout:0/303: rename dd/d10/d1a/d31/d47/c52 to dd/d1c/d1d/c5a 0 2024-04-26T21:08:00.253 INFO:tasks.workunit.client.1.smithi064.stdout:0/304: creat dd/d10/d1a/d31/d3e/d42/f5b x:0 0 0 2024-04-26T21:08:00.253 INFO:tasks.workunit.client.1.smithi064.stdout:8/285: dwrite d10/d1d/f29 [0,4194304] 0 2024-04-26T21:08:00.254 INFO:tasks.workunit.client.0.smithi055.stdout:0/224: write d9/dc/f10 [3019497,42368] 0 2024-04-26T21:08:00.254 INFO:tasks.workunit.client.0.smithi055.stdout:0/225: fdatasync d9/dc/d17/f45 0 2024-04-26T21:08:00.255 INFO:tasks.workunit.client.0.smithi055.stdout:7/189: dread d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:00.256 INFO:tasks.workunit.client.1.smithi064.stdout:4/396: dread d0/d2f/d69/f77 [0,4194304] 0 2024-04-26T21:08:00.256 INFO:tasks.workunit.client.1.smithi064.stdout:4/397: fdatasync d0/d5/d13/d10/f4c 0 2024-04-26T21:08:00.257 INFO:tasks.workunit.client.1.smithi064.stdout:6/304: symlink d4/d7/d12/d49/d4b/d5a/l5f 0 2024-04-26T21:08:00.262 INFO:tasks.workunit.client.0.smithi055.stdout:2/155: symlink d4/d14/d33/l34 0 2024-04-26T21:08:00.263 INFO:tasks.workunit.client.0.smithi055.stdout:2/156: readlink d4/dc/d21/l31 0 2024-04-26T21:08:00.263 INFO:tasks.workunit.client.0.smithi055.stdout:2/157: creat d4/d14/f35 x:0 0 0 2024-04-26T21:08:00.263 INFO:tasks.workunit.client.0.smithi055.stdout:2/158: write d4/d14/d17/f2e [2208446,91038] 0 2024-04-26T21:08:00.263 INFO:tasks.workunit.client.0.smithi055.stdout:2/159: stat d4/db/d26 0 2024-04-26T21:08:00.265 INFO:tasks.workunit.client.1.smithi064.stdout:2/350: unlink d12/d16/d2f/f32 0 2024-04-26T21:08:00.269 INFO:tasks.workunit.client.0.smithi055.stdout:9/160: symlink d2/d11/l35 0 2024-04-26T21:08:00.271 INFO:tasks.workunit.client.0.smithi055.stdout:0/226: dread d9/dc/d17/f30 [0,4194304] 0 2024-04-26T21:08:00.271 INFO:tasks.workunit.client.0.smithi055.stdout:0/227: chown d9/d11/f35 175115 1 2024-04-26T21:08:00.271 INFO:tasks.workunit.client.0.smithi055.stdout:0/228: chown d9/d11/c4c 1120519 1 2024-04-26T21:08:00.280 INFO:tasks.workunit.client.0.smithi055.stdout:8/124: symlink d3/d9/d1f/l2a 0 2024-04-26T21:08:00.280 INFO:tasks.workunit.client.0.smithi055.stdout:2/160: write d4/f5 [2797266,3445] 0 2024-04-26T21:08:00.280 INFO:tasks.workunit.client.0.smithi055.stdout:1/175: symlink d8/df/d11/d27/d28/d2a/l3c 0 2024-04-26T21:08:00.281 INFO:tasks.workunit.client.1.smithi064.stdout:1/427: symlink d0/d22/l80 0 2024-04-26T21:08:00.281 INFO:tasks.workunit.client.1.smithi064.stdout:4/398: write d0/d5/d13/d33/f39 [834637,18952] 0 2024-04-26T21:08:00.281 INFO:tasks.workunit.client.1.smithi064.stdout:3/306: rename d1/d14/c2a to d1/d38/c6e 0 2024-04-26T21:08:00.285 INFO:tasks.workunit.client.1.smithi064.stdout:0/305: mkdir dd/d10/d1a/d31/d5c 0 2024-04-26T21:08:00.286 INFO:tasks.workunit.client.1.smithi064.stdout:0/306: chown dd/d10/d1a/d31/d3e/d42/c46 411320996 1 2024-04-26T21:08:00.286 INFO:tasks.workunit.client.1.smithi064.stdout:9/346: dwrite d0/f64 [0,4194304] 0 2024-04-26T21:08:00.290 INFO:tasks.workunit.client.1.smithi064.stdout:6/305: mknod d4/d7/d12/d49/c60 0 2024-04-26T21:08:00.292 INFO:tasks.workunit.client.0.smithi055.stdout:3/218: unlink d0/d1/d47/d37/l3c 0 2024-04-26T21:08:00.294 INFO:tasks.workunit.client.1.smithi064.stdout:2/351: creat d12/d45/f7d x:0 0 0 2024-04-26T21:08:00.299 INFO:tasks.workunit.client.1.smithi064.stdout:1/428: creat d0/d6/d11/d1e/d27/f81 x:0 0 0 2024-04-26T21:08:00.301 INFO:tasks.workunit.client.1.smithi064.stdout:3/307: mkdir d1/d27/d29/d6f 0 2024-04-26T21:08:00.302 INFO:tasks.workunit.client.0.smithi055.stdout:7/190: mknod d5/d6/d24/c35 0 2024-04-26T21:08:00.302 INFO:tasks.workunit.client.0.smithi055.stdout:8/125: dread d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:08:00.302 INFO:tasks.workunit.client.0.smithi055.stdout:8/126: chown d3/d9/c26 63471 1 2024-04-26T21:08:00.302 INFO:tasks.workunit.client.0.smithi055.stdout:8/127: fdatasync d3/d9/d1f/f27 0 2024-04-26T21:08:00.303 INFO:tasks.workunit.client.0.smithi055.stdout:0/229: dread d9/d11/f35 [0,4194304] 0 2024-04-26T21:08:00.313 INFO:tasks.workunit.client.0.smithi055.stdout:2/161: getdents d4/db/d26 0 2024-04-26T21:08:00.313 INFO:tasks.workunit.client.1.smithi064.stdout:0/307: rename dd/d10/d1a/d31/d3e/d42/c46 to dd/d10/d1a/d31/d3e/c5d 0 2024-04-26T21:08:00.313 INFO:tasks.workunit.client.1.smithi064.stdout:0/308: fdatasync dd/d1c/f1f 0 2024-04-26T21:08:00.313 INFO:tasks.workunit.client.1.smithi064.stdout:0/309: dread - dd/d10/d1a/d31/d3e/d42/f5b zero size 2024-04-26T21:08:00.314 INFO:tasks.workunit.client.1.smithi064.stdout:9/347: dread d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:00.318 INFO:tasks.workunit.client.1.smithi064.stdout:5/320: dwrite dd/d12/d4f/f55 [0,4194304] 0 2024-04-26T21:08:00.318 INFO:tasks.workunit.client.1.smithi064.stdout:5/321: stat dd/d12/d18/d1a/d1f/d20/f59 0 2024-04-26T21:08:00.318 INFO:tasks.workunit.client.0.smithi055.stdout:1/176: mkdir d8/df/d11/d27/d28/d3d 0 2024-04-26T21:08:00.320 INFO:tasks.workunit.client.1.smithi064.stdout:3/308: mknod d1/d27/d29/d5e/c70 0 2024-04-26T21:08:00.323 INFO:tasks.workunit.client.0.smithi055.stdout:7/191: mknod d5/d6/d24/c36 0 2024-04-26T21:08:00.323 INFO:tasks.workunit.client.0.smithi055.stdout:7/192: fsync f1 0 2024-04-26T21:08:00.323 INFO:tasks.workunit.client.0.smithi055.stdout:7/193: creat d5/d6/d24/f37 x:0 0 0 2024-04-26T21:08:00.326 INFO:tasks.workunit.client.0.smithi055.stdout:8/128: creat d3/d9/f2b x:0 0 0 2024-04-26T21:08:00.327 INFO:tasks.workunit.client.1.smithi064.stdout:6/306: rename d4/d7/d33/f46 to d4/d7/d12/d38/f61 0 2024-04-26T21:08:00.329 INFO:tasks.workunit.client.1.smithi064.stdout:8/286: dwrite d10/d2f/f33 [0,4194304] 0 2024-04-26T21:08:00.333 INFO:tasks.workunit.client.0.smithi055.stdout:0/230: truncate d9/dc/d1c/d3b/f36 440239 0 2024-04-26T21:08:00.339 INFO:tasks.workunit.client.1.smithi064.stdout:0/310: creat dd/d10/d1a/d31/d5c/f5e x:0 0 0 2024-04-26T21:08:00.339 INFO:tasks.workunit.client.0.smithi055.stdout:9/161: mknod d2/c36 0 2024-04-26T21:08:00.342 INFO:tasks.workunit.client.0.smithi055.stdout:2/162: mkdir d4/d14/d17/d36 0 2024-04-26T21:08:00.345 INFO:tasks.workunit.client.0.smithi055.stdout:1/177: stat d8/df/d11/l1c 0 2024-04-26T21:08:00.345 INFO:tasks.workunit.client.1.smithi064.stdout:1/429: dwrite d0/d6/f7d [4194304,4194304] 0 2024-04-26T21:08:00.346 INFO:tasks.workunit.client.1.smithi064.stdout:1/430: fdatasync d0/d6/f7d 0 2024-04-26T21:08:00.348 INFO:tasks.workunit.client.1.smithi064.stdout:2/352: rmdir d12/d28/d3a 39 2024-04-26T21:08:00.348 INFO:tasks.workunit.client.1.smithi064.stdout:2/353: write d12/d28/d3a/f58 [35018,115998] 0 2024-04-26T21:08:00.352 INFO:tasks.workunit.client.1.smithi064.stdout:1/431: dread d0/d6/d11/d1e/d2a/d34/f36 [0,4194304] 0 2024-04-26T21:08:00.353 INFO:tasks.workunit.client.0.smithi055.stdout:8/129: dread d3/f18 [0,4194304] 0 2024-04-26T21:08:00.354 INFO:tasks.workunit.client.0.smithi055.stdout:1/178: dread d8/df/f24 [0,4194304] 0 2024-04-26T21:08:00.356 INFO:tasks.workunit.client.1.smithi064.stdout:5/322: link dd/d12/d18/d25/d32/l51 dd/d12/d18/d1a/d1b/l5f 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.0.smithi055.stdout:7/194: unlink d5/d6/d24/c2e 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.1.smithi064.stdout:9/348: dwrite d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.1.smithi064.stdout:3/309: symlink d1/d27/d50/l71 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.1.smithi064.stdout:9/349: write d0/d4/da/d26/d47/f4b [521396,100015] 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.1.smithi064.stdout:9/350: creat d0/d4/da/d26/d47/f73 x:0 0 0 2024-04-26T21:08:00.359 INFO:tasks.workunit.client.1.smithi064.stdout:9/351: write d0/d4/da/d26/d5e/f69 [48656,123144] 0 2024-04-26T21:08:00.362 INFO:tasks.workunit.client.0.smithi055.stdout:9/162: rename d2/d14/f27 to d2/d14/d33/f37 0 2024-04-26T21:08:00.362 INFO:tasks.workunit.client.0.smithi055.stdout:0/231: dread d9/d11/f46 [0,4194304] 0 2024-04-26T21:08:00.364 INFO:tasks.workunit.client.1.smithi064.stdout:6/307: dwrite d4/d7/d33/f44 [0,4194304] 0 2024-04-26T21:08:00.364 INFO:tasks.workunit.client.1.smithi064.stdout:6/308: creat d4/d7/f62 x:0 0 0 2024-04-26T21:08:00.365 INFO:tasks.workunit.client.1.smithi064.stdout:0/311: dread dd/d10/d18/f29 [0,4194304] 0 2024-04-26T21:08:00.365 INFO:tasks.workunit.client.1.smithi064.stdout:0/312: chown dd/f12 139760 1 2024-04-26T21:08:00.367 INFO:tasks.workunit.client.1.smithi064.stdout:1/432: dread d0/d6/f19 [0,4194304] 0 2024-04-26T21:08:00.367 INFO:tasks.workunit.client.0.smithi055.stdout:8/130: link d3/d9/c26 d3/d9/d1f/c2c 0 2024-04-26T21:08:00.369 INFO:tasks.workunit.client.1.smithi064.stdout:1/433: write d0/d6/d11/d1e/d27/f65 [225924,67398] 0 2024-04-26T21:08:00.371 INFO:tasks.workunit.client.1.smithi064.stdout:3/310: write d1/f1a [1050289,2832] 0 2024-04-26T21:08:00.373 INFO:tasks.workunit.client.0.smithi055.stdout:1/179: link d8/df/c23 d8/d17/c3e 0 2024-04-26T21:08:00.373 INFO:tasks.workunit.client.0.smithi055.stdout:1/180: stat d8/df/d11/d27/f3a 0 2024-04-26T21:08:00.377 INFO:tasks.workunit.client.0.smithi055.stdout:9/163: link d2/d11/l31 d2/d11/l38 0 2024-04-26T21:08:00.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/287: truncate d10/d1d/f30 556124 0 2024-04-26T21:08:00.379 INFO:tasks.workunit.client.0.smithi055.stdout:0/232: mknod d9/dc/d1c/d3e/c4e 0 2024-04-26T21:08:00.381 INFO:tasks.workunit.client.1.smithi064.stdout:2/354: creat d12/d28/d3a/d46/d6a/f7e x:0 0 0 2024-04-26T21:08:00.386 INFO:tasks.workunit.client.0.smithi055.stdout:2/163: rmdir d4/dc 39 2024-04-26T21:08:00.392 INFO:tasks.workunit.client.0.smithi055.stdout:8/131: creat d3/d9/f2d x:0 0 0 2024-04-26T21:08:00.399 INFO:tasks.workunit.client.0.smithi055.stdout:0/233: unlink d9/l49 0 2024-04-26T21:08:00.404 INFO:tasks.workunit.client.0.smithi055.stdout:2/164: unlink d4/d14/d33/l34 0 2024-04-26T21:08:00.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:00 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:00.406 INFO:tasks.workunit.client.0.smithi055.stdout:1/181: getdents d8/d17/d1b 0 2024-04-26T21:08:00.410 INFO:tasks.workunit.client.0.smithi055.stdout:3/219: dwrite d0/de/f17 [0,4194304] 0 2024-04-26T21:08:00.410 INFO:tasks.workunit.client.0.smithi055.stdout:9/164: dread d2/fe [0,4194304] 0 2024-04-26T21:08:00.414 INFO:tasks.workunit.client.1.smithi064.stdout:9/352: dwrite d0/d4/da/d26/d47/f62 [0,4194304] 0 2024-04-26T21:08:00.414 INFO:tasks.workunit.client.1.smithi064.stdout:5/323: mknod dd/d12/d18/d33/c60 0 2024-04-26T21:08:00.416 INFO:tasks.workunit.client.0.smithi055.stdout:0/234: creat d9/dc/d1c/f4f x:0 0 0 2024-04-26T21:08:00.418 INFO:tasks.workunit.client.0.smithi055.stdout:2/165: unlink d4/d14/c1b 0 2024-04-26T21:08:00.418 INFO:tasks.workunit.client.0.smithi055.stdout:2/166: creat d4/d14/d17/f37 x:0 0 0 2024-04-26T21:08:00.418 INFO:tasks.workunit.client.0.smithi055.stdout:2/167: creat d4/d14/f38 x:0 0 0 2024-04-26T21:08:00.434 INFO:tasks.workunit.client.1.smithi064.stdout:8/288: dread d10/d2f/f4c [0,4194304] 0 2024-04-26T21:08:00.435 INFO:tasks.workunit.client.1.smithi064.stdout:3/311: dwrite d1/ff [0,4194304] 0 2024-04-26T21:08:00.435 INFO:tasks.workunit.client.0.smithi055.stdout:1/182: rename f6 to d8/df/d11/d27/f3f 0 2024-04-26T21:08:00.439 INFO:tasks.workunit.client.0.smithi055.stdout:0/235: mknod d9/dc/d1c/d3b/c50 0 2024-04-26T21:08:00.444 INFO:tasks.workunit.client.1.smithi064.stdout:2/355: dwrite d12/d28/f35 [0,4194304] 0 2024-04-26T21:08:00.444 INFO:tasks.workunit.client.1.smithi064.stdout:9/353: dread d0/d4/d7/f2f [0,4194304] 0 2024-04-26T21:08:00.447 INFO:tasks.workunit.client.0.smithi055.stdout:7/195: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:00.447 INFO:tasks.workunit.client.0.smithi055.stdout:7/196: chown d5/d11/f1a 57554 1 2024-04-26T21:08:00.449 INFO:tasks.workunit.client.1.smithi064.stdout:6/309: link d4/d7/d12/f18 d4/d7/d12/d1e/f63 0 2024-04-26T21:08:00.449 INFO:tasks.workunit.client.1.smithi064.stdout:6/310: stat d4/d7/d12/d49/d4b/d5a 0 2024-04-26T21:08:00.452 INFO:tasks.workunit.client.1.smithi064.stdout:0/313: symlink dd/d10/d1a/d31/d3e/l5f 0 2024-04-26T21:08:00.452 INFO:tasks.workunit.client.1.smithi064.stdout:0/314: chown dd/ce 1 1 2024-04-26T21:08:00.455 INFO:tasks.workunit.client.1.smithi064.stdout:1/434: creat d0/d6/d11/d1e/f82 x:0 0 0 2024-04-26T21:08:00.455 INFO:tasks.workunit.client.1.smithi064.stdout:1/435: creat d0/d6/d29/d31/f83 x:0 0 0 2024-04-26T21:08:00.456 INFO:tasks.workunit.client.0.smithi055.stdout:0/236: mknod d9/d43/d4b/c51 0 2024-04-26T21:08:00.460 INFO:tasks.workunit.client.0.smithi055.stdout:7/197: link d5/d11/f2f d5/d6/d24/f38 0 2024-04-26T21:08:00.460 INFO:tasks.workunit.client.0.smithi055.stdout:7/198: write d5/d11/f2f [4438070,62374] 0 2024-04-26T21:08:00.463 INFO:tasks.workunit.client.0.smithi055.stdout:1/183: rename d8/f26 to d8/df/d11/d27/d28/f40 0 2024-04-26T21:08:00.465 INFO:tasks.workunit.client.0.smithi055.stdout:0/237: mknod d9/dc/d1c/d3b/d41/c52 0 2024-04-26T21:08:00.465 INFO:tasks.workunit.client.0.smithi055.stdout:0/238: stat d9/dc/d1c/d3b/f36 0 2024-04-26T21:08:00.465 INFO:tasks.workunit.client.0.smithi055.stdout:0/239: read d9/dc/f10 [1907661,35441] 0 2024-04-26T21:08:00.467 INFO:tasks.workunit.client.0.smithi055.stdout:7/199: mkdir d5/d6/d39 0 2024-04-26T21:08:00.471 INFO:tasks.workunit.client.0.smithi055.stdout:3/220: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:08:00.473 INFO:tasks.workunit.client.0.smithi055.stdout:9/165: rename d2/d14/l19 to d2/d11/l39 0 2024-04-26T21:08:00.474 INFO:tasks.workunit.client.1.smithi064.stdout:5/324: rename dd/d12/d18/d1a/d1f/f53 to dd/d12/f61 0 2024-04-26T21:08:00.474 INFO:tasks.workunit.client.1.smithi064.stdout:2/356: truncate d12/d28/f3f 766440 0 2024-04-26T21:08:00.475 INFO:tasks.workunit.client.0.smithi055.stdout:1/184: mkdir d8/d17/d1b/d41 0 2024-04-26T21:08:00.477 INFO:tasks.workunit.client.1.smithi064.stdout:7/341: sync 2024-04-26T21:08:00.478 INFO:tasks.workunit.client.1.smithi064.stdout:9/354: rmdir d0/d4/da/d26/d47/d72 0 2024-04-26T21:08:00.479 INFO:tasks.workunit.client.0.smithi055.stdout:0/240: symlink d9/d43/l53 0 2024-04-26T21:08:00.480 INFO:tasks.workunit.client.1.smithi064.stdout:0/315: truncate dd/d21/f3a 478933 0 2024-04-26T21:08:00.481 INFO:tasks.workunit.client.0.smithi055.stdout:7/200: rmdir d5/d11 39 2024-04-26T21:08:00.485 INFO:tasks.workunit.client.1.smithi064.stdout:8/289: rmdir d10/d41/d44 39 2024-04-26T21:08:00.488 INFO:tasks.workunit.client.1.smithi064.stdout:3/312: rename d1/d27/d50/d22 to d1/d27/d29/d6f/d72 0 2024-04-26T21:08:00.488 INFO:tasks.workunit.client.1.smithi064.stdout:3/313: chown d1/l64 9 1 2024-04-26T21:08:00.489 INFO:tasks.workunit.client.0.smithi055.stdout:3/221: mknod d0/d1/d13/d27/d3b/d3a/c4f 0 2024-04-26T21:08:00.493 INFO:tasks.workunit.client.0.smithi055.stdout:1/185: mknod d8/d17/d36/c42 0 2024-04-26T21:08:00.494 INFO:tasks.workunit.client.0.smithi055.stdout:1/186: write d8/df/d11/d27/f3a [338070,121292] 0 2024-04-26T21:08:00.494 INFO:tasks.workunit.client.1.smithi064.stdout:2/357: creat d12/d16/d29/d43/f7f x:0 0 0 2024-04-26T21:08:00.495 INFO:tasks.workunit.client.0.smithi055.stdout:9/166: write d2/f1a [923297,101221] 0 2024-04-26T21:08:00.498 INFO:tasks.workunit.client.0.smithi055.stdout:7/201: link d5/d6/c19 d5/d6/d39/c3a 0 2024-04-26T21:08:00.501 INFO:tasks.workunit.client.1.smithi064.stdout:9/355: mkdir d0/d4/d28/d4f/d74 0 2024-04-26T21:08:00.501 INFO:tasks.workunit.client.1.smithi064.stdout:8/290: write d10/d1d/d38/f39 [1664331,94691] 0 2024-04-26T21:08:00.501 INFO:tasks.workunit.client.1.smithi064.stdout:4/399: sync 2024-04-26T21:08:00.502 INFO:tasks.workunit.client.1.smithi064.stdout:4/400: fdatasync d0/d1d/d17/d57/f5e 0 2024-04-26T21:08:00.502 INFO:tasks.workunit.client.0.smithi055.stdout:3/222: mkdir d0/d1/d13/d27/d50 0 2024-04-26T21:08:00.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:00 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:00.507 INFO:tasks.workunit.client.1.smithi064.stdout:0/316: symlink dd/d10/d18/d58/l60 0 2024-04-26T21:08:00.508 INFO:tasks.workunit.client.0.smithi055.stdout:3/223: write d0/d4/d5/f2c [436695,83584] 0 2024-04-26T21:08:00.509 INFO:tasks.workunit.client.1.smithi064.stdout:1/436: dwrite d0/d6/d11/f18 [0,4194304] 0 2024-04-26T21:08:00.510 INFO:tasks.workunit.client.0.smithi055.stdout:9/167: symlink d2/d14/d33/l3a 0 2024-04-26T21:08:00.510 INFO:tasks.workunit.client.0.smithi055.stdout:9/168: creat d2/d11/f3b x:0 0 0 2024-04-26T21:08:00.515 INFO:tasks.workunit.client.1.smithi064.stdout:6/311: rename d4/d7/d33/c54 to d4/d7/d12/d49/d4b/c64 0 2024-04-26T21:08:00.515 INFO:tasks.workunit.client.1.smithi064.stdout:6/312: readlink d4/d7/l19 0 2024-04-26T21:08:00.516 INFO:tasks.workunit.client.1.smithi064.stdout:2/358: write d12/d28/f33 [8369107,38389] 0 2024-04-26T21:08:00.518 INFO:tasks.workunit.client.1.smithi064.stdout:8/291: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:08:00.518 INFO:tasks.workunit.client.1.smithi064.stdout:7/342: rmdir d6/d5a/d5f 39 2024-04-26T21:08:00.518 INFO:tasks.workunit.client.1.smithi064.stdout:8/292: truncate d10/d41/d4e/d54/f55 406781 0 2024-04-26T21:08:00.525 INFO:tasks.workunit.client.0.smithi055.stdout:7/202: getdents d5/d11 0 2024-04-26T21:08:00.525 INFO:tasks.workunit.client.0.smithi055.stdout:7/203: chown d5/db 3190 1 2024-04-26T21:08:00.529 INFO:tasks.workunit.client.1.smithi064.stdout:4/401: creat d0/d5/d13/d6d/f83 x:0 0 0 2024-04-26T21:08:00.535 INFO:tasks.workunit.client.1.smithi064.stdout:0/317: unlink dd/d10/d1a/d31/d3e/d42/l48 0 2024-04-26T21:08:00.535 INFO:tasks.workunit.client.0.smithi055.stdout:1/187: dread d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:00.538 INFO:tasks.workunit.client.1.smithi064.stdout:5/325: dwrite dd/d12/d18/d1a/d1f/d20/f47 [4194304,4194304] 0 2024-04-26T21:08:00.539 INFO:tasks.workunit.client.1.smithi064.stdout:2/359: dread d12/d41/d61/d75/f60 [0,4194304] 0 2024-04-26T21:08:00.542 INFO:tasks.workunit.client.0.smithi055.stdout:0/241: dwrite d9/d43/f44 [0,4194304] 0 2024-04-26T21:08:00.544 INFO:tasks.workunit.client.0.smithi055.stdout:0/242: write d9/d27/f40 [670333,61561] 0 2024-04-26T21:08:00.551 INFO:tasks.workunit.client.1.smithi064.stdout:6/313: mknod d4/c65 0 2024-04-26T21:08:00.556 INFO:tasks.workunit.client.1.smithi064.stdout:7/343: rmdir d6/db/d1f/d50 39 2024-04-26T21:08:00.557 INFO:tasks.workunit.client.1.smithi064.stdout:8/293: fsync d10/f1b 0 2024-04-26T21:08:00.558 INFO:tasks.workunit.client.1.smithi064.stdout:8/294: write fa [742888,14355] 0 2024-04-26T21:08:00.562 INFO:tasks.workunit.client.1.smithi064.stdout:4/402: link d0/d5/d13/d6d/f4b d0/d5/d79/f84 0 2024-04-26T21:08:00.562 INFO:tasks.workunit.client.1.smithi064.stdout:0/318: rmdir dd/d1c 39 2024-04-26T21:08:00.566 INFO:tasks.workunit.client.1.smithi064.stdout:6/314: dread d4/f31 [0,4194304] 0 2024-04-26T21:08:00.566 INFO:tasks.workunit.client.1.smithi064.stdout:8/295: dread d10/d2f/f3a [0,4194304] 0 2024-04-26T21:08:00.566 INFO:tasks.workunit.client.1.smithi064.stdout:8/296: creat d10/d1d/d38/f5b x:0 0 0 2024-04-26T21:08:00.566 INFO:tasks.workunit.client.1.smithi064.stdout:8/297: write d10/d41/d4e/d54/f55 [481478,50734] 0 2024-04-26T21:08:00.566 INFO:tasks.workunit.client.1.smithi064.stdout:8/298: read d10/d1d/d38/f39 [2068763,51565] 0 2024-04-26T21:08:00.567 INFO:tasks.workunit.client.1.smithi064.stdout:3/314: dwrite d1/d27/d29/d6f/d72/f40 [0,4194304] 0 2024-04-26T21:08:00.568 INFO:tasks.workunit.client.1.smithi064.stdout:9/356: dwrite d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:00.570 INFO:tasks.workunit.client.1.smithi064.stdout:5/326: creat dd/d12/d18/d33/d48/d56/f62 x:0 0 0 2024-04-26T21:08:00.570 INFO:tasks.workunit.client.1.smithi064.stdout:5/327: chown dd/d12/d4f 67848376 1 2024-04-26T21:08:00.570 INFO:tasks.workunit.client.1.smithi064.stdout:5/328: fsync dd/d12/d18/d1a/d1f/f24 0 2024-04-26T21:08:00.575 INFO:tasks.workunit.client.0.smithi055.stdout:3/224: rename d0/d1/d13/d27/d3b/d3a to d0/d1/d13/d1a/d46/d51 0 2024-04-26T21:08:00.575 INFO:tasks.workunit.client.1.smithi064.stdout:7/344: mkdir d6/d9/d77 0 2024-04-26T21:08:00.576 INFO:tasks.workunit.client.1.smithi064.stdout:7/345: write d6/d15/d67/d4d/f6a [73847,126770] 0 2024-04-26T21:08:00.582 INFO:tasks.workunit.client.1.smithi064.stdout:4/403: unlink d0/d1d/d17/f55 0 2024-04-26T21:08:00.583 INFO:tasks.workunit.client.1.smithi064.stdout:1/437: dwrite d0/d6/d29/d31/f51 [0,4194304] 0 2024-04-26T21:08:00.585 INFO:tasks.workunit.client.0.smithi055.stdout:3/225: symlink d0/d1/d13/d27/d50/l52 0 2024-04-26T21:08:00.585 INFO:tasks.workunit.client.1.smithi064.stdout:0/319: getdents dd/d10/d18 0 2024-04-26T21:08:00.586 INFO:tasks.workunit.client.0.smithi055.stdout:1/188: dwrite d8/df/d11/f37 [0,4194304] 0 2024-04-26T21:08:00.589 INFO:tasks.workunit.client.0.smithi055.stdout:0/243: rename d9/d43 to d9/dc/d1c/d54 0 2024-04-26T21:08:00.597 INFO:tasks.workunit.client.0.smithi055.stdout:1/189: rename d8/df/d11/d27/d28/d2a/l2d to d8/df/d11/d27/d28/d3d/l43 0 2024-04-26T21:08:00.599 INFO:tasks.workunit.client.0.smithi055.stdout:0/244: mknod d9/dc/d17/c55 0 2024-04-26T21:08:00.602 INFO:tasks.workunit.client.1.smithi064.stdout:3/315: mkdir d1/d27/d29/d6f/d72/d73 0 2024-04-26T21:08:00.603 INFO:tasks.workunit.client.1.smithi064.stdout:9/357: rename d0/d4/c43 to d0/d4/da/d26/d45/c75 0 2024-04-26T21:08:00.603 INFO:tasks.workunit.client.1.smithi064.stdout:9/358: chown d0/d4/da/d26/d47/f4b 3028794 1 2024-04-26T21:08:00.603 INFO:tasks.workunit.client.1.smithi064.stdout:5/329: mkdir dd/d12/d18/d33/d63 0 2024-04-26T21:08:00.603 INFO:tasks.workunit.client.1.smithi064.stdout:3/316: creat d1/d27/d50/f74 x:0 0 0 2024-04-26T21:08:00.603 INFO:tasks.workunit.client.1.smithi064.stdout:3/317: chown d1/d27/d29/f4b 26 1 2024-04-26T21:08:00.609 INFO:tasks.workunit.client.0.smithi055.stdout:0/245: rmdir d9/dc/d19 39 2024-04-26T21:08:00.609 INFO:tasks.workunit.client.0.smithi055.stdout:3/226: read d0/d4/d5/f21 [551138,69414] 0 2024-04-26T21:08:00.610 INFO:tasks.workunit.client.0.smithi055.stdout:3/227: read d0/d1/f2e [3903027,15838] 0 2024-04-26T21:08:00.610 INFO:tasks.workunit.client.0.smithi055.stdout:3/228: stat d0/de/f17 0 2024-04-26T21:08:00.610 INFO:tasks.workunit.client.0.smithi055.stdout:7/204: dread d5/db/f14 [0,4194304] 0 2024-04-26T21:08:00.610 INFO:tasks.workunit.client.0.smithi055.stdout:7/205: write f1 [5173628,25226] 0 2024-04-26T21:08:00.611 INFO:tasks.workunit.client.1.smithi064.stdout:7/346: mkdir d6/d15/d67/d78 0 2024-04-26T21:08:00.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/169: dwrite d2/f22 [0,4194304] 0 2024-04-26T21:08:00.620 INFO:tasks.workunit.client.0.smithi055.stdout:3/229: creat d0/d1/d47/d42/f53 x:0 0 0 2024-04-26T21:08:00.621 INFO:tasks.workunit.client.0.smithi055.stdout:3/230: chown d0/d4/d5/f21 0 1 2024-04-26T21:08:00.625 INFO:tasks.workunit.client.0.smithi055.stdout:1/190: dread d8/f15 [0,4194304] 0 2024-04-26T21:08:00.635 INFO:tasks.workunit.client.1.smithi064.stdout:7/347: read d6/d9/f37 [334003,1862] 0 2024-04-26T21:08:00.635 INFO:tasks.workunit.client.1.smithi064.stdout:7/348: chown d6/d9/d38/l40 1252114577 1 2024-04-26T21:08:00.639 INFO:tasks.workunit.client.1.smithi064.stdout:6/315: getdents d4/d7/d12/d1e 0 2024-04-26T21:08:00.643 INFO:tasks.workunit.client.0.smithi055.stdout:1/191: mkdir d8/df/d11/d44 0 2024-04-26T21:08:00.643 INFO:tasks.workunit.client.0.smithi055.stdout:1/192: write d8/f31 [273970,43583] 0 2024-04-26T21:08:00.644 INFO:tasks.workunit.client.0.smithi055.stdout:9/170: link d2/d14/c32 d2/c3c 0 2024-04-26T21:08:00.653 INFO:tasks.workunit.client.0.smithi055.stdout:1/193: getdents d8/d17/d1b 0 2024-04-26T21:08:00.655 INFO:tasks.workunit.client.1.smithi064.stdout:5/330: unlink dd/d12/d18/f5c 0 2024-04-26T21:08:00.657 INFO:tasks.workunit.client.1.smithi064.stdout:4/404: getdents d0/d5 0 2024-04-26T21:08:00.658 INFO:tasks.workunit.client.0.smithi055.stdout:1/194: truncate d8/d17/d1b/f20 68128 0 2024-04-26T21:08:00.658 INFO:tasks.workunit.client.1.smithi064.stdout:4/405: creat d0/d5/d13/d33/f85 x:0 0 0 2024-04-26T21:08:00.658 INFO:tasks.workunit.client.1.smithi064.stdout:4/406: stat d0/d1d/d21/f62 0 2024-04-26T21:08:00.659 INFO:tasks.workunit.client.1.smithi064.stdout:7/349: symlink d6/d15/d67/d65/l79 0 2024-04-26T21:08:00.662 INFO:tasks.workunit.client.1.smithi064.stdout:1/438: rmdir d0/d6/d29/d31 39 2024-04-26T21:08:00.662 INFO:tasks.workunit.client.0.smithi055.stdout:1/195: symlink d8/d17/l45 0 2024-04-26T21:08:00.665 INFO:tasks.workunit.client.1.smithi064.stdout:6/316: mknod d4/d7/d12/d49/d4b/c66 0 2024-04-26T21:08:00.668 INFO:tasks.workunit.client.1.smithi064.stdout:6/317: write d4/d7/d12/d49/f5c [195978,26564] 0 2024-04-26T21:08:00.668 INFO:tasks.workunit.client.1.smithi064.stdout:0/320: rename dd/d10/d1a/d31/d3e to dd/d10/d1a/d31/d47/d61 0 2024-04-26T21:08:00.668 INFO:tasks.workunit.client.1.smithi064.stdout:0/321: chown dd/d10 285 1 2024-04-26T21:08:00.669 INFO:tasks.workunit.client.1.smithi064.stdout:5/331: mkdir dd/d12/d4f/d64 0 2024-04-26T21:08:00.672 INFO:tasks.workunit.client.1.smithi064.stdout:2/360: sync 2024-04-26T21:08:00.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/439: creat d0/d6/d11/d1e/d2a/d72/f84 x:0 0 0 2024-04-26T21:08:00.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/440: creat d0/d6/d11/d2c/f85 x:0 0 0 2024-04-26T21:08:00.675 INFO:tasks.workunit.client.1.smithi064.stdout:5/332: truncate fb 3719741 0 2024-04-26T21:08:00.675 INFO:tasks.workunit.client.1.smithi064.stdout:8/299: sync 2024-04-26T21:08:00.677 INFO:tasks.workunit.client.1.smithi064.stdout:1/441: mknod d0/d6/d11/d1e/d27/c86 0 2024-04-26T21:08:00.678 INFO:tasks.workunit.client.1.smithi064.stdout:1/442: chown d0/d6/d11/d2c/c39 23846 1 2024-04-26T21:08:00.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/318: dwrite d1/f1b [4194304,4194304] 0 2024-04-26T21:08:00.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/319: getdents d1/d38/d68 0 2024-04-26T21:08:00.679 INFO:tasks.workunit.client.1.smithi064.stdout:3/320: dread - d1/d27/d29/f67 zero size 2024-04-26T21:08:00.679 INFO:tasks.workunit.client.1.smithi064.stdout:5/333: symlink dd/d12/d18/d1a/d1f/l65 0 2024-04-26T21:08:00.679 INFO:tasks.workunit.client.1.smithi064.stdout:5/334: chown dd/d12/d18/d1a/d1f/d20/f4e 97 1 2024-04-26T21:08:00.679 INFO:tasks.workunit.client.1.smithi064.stdout:5/335: creat dd/d12/d4f/f66 x:0 0 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:8/300: rename cd to d10/d41/d4e/d54/c5c 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:8/301: write d10/f4d [1027342,117246] 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:8/302: fsync d10/d1d/f43 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:6/318: dread d4/d7/f4e [0,4194304] 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:3/321: symlink d1/d27/d50/d35/d4c/l75 0 2024-04-26T21:08:00.684 INFO:tasks.workunit.client.1.smithi064.stdout:3/322: creat d1/d27/d29/d5e/f76 x:0 0 0 2024-04-26T21:08:00.689 INFO:tasks.workunit.client.0.smithi055.stdout:9/171: dread d2/f22 [0,4194304] 0 2024-04-26T21:08:00.692 INFO:tasks.workunit.client.1.smithi064.stdout:4/407: getdents d0/d5/d13/d33 0 2024-04-26T21:08:00.693 INFO:tasks.workunit.client.1.smithi064.stdout:1/443: fsync d0/d6/d11/d1e/d2a/d72/f84 0 2024-04-26T21:08:00.693 INFO:tasks.workunit.client.1.smithi064.stdout:1/444: fsync d0/d6/d11/f35 0 2024-04-26T21:08:00.696 INFO:tasks.workunit.client.0.smithi055.stdout:9/172: symlink d2/l3d 0 2024-04-26T21:08:00.698 INFO:tasks.workunit.client.1.smithi064.stdout:7/350: dread d6/f24 [0,4194304] 0 2024-04-26T21:08:00.698 INFO:tasks.workunit.client.0.smithi055.stdout:1/196: write d8/d17/d33/f34 [3720234,69050] 0 2024-04-26T21:08:00.703 INFO:tasks.workunit.client.0.smithi055.stdout:1/197: mknod d8/df/d11/c46 0 2024-04-26T21:08:00.703 INFO:tasks.workunit.client.0.smithi055.stdout:1/198: creat d8/d17/f47 x:0 0 0 2024-04-26T21:08:00.703 INFO:tasks.workunit.client.1.smithi064.stdout:4/408: unlink d0/d5/d13/d10/f2b 0 2024-04-26T21:08:00.705 INFO:tasks.workunit.client.0.smithi055.stdout:0/246: dwrite d9/dc/d1c/d3b/d41/f2e [0,4194304] 0 2024-04-26T21:08:00.707 INFO:tasks.workunit.client.1.smithi064.stdout:7/351: getdents d6/d9/d38 0 2024-04-26T21:08:00.940 INFO:tasks.workunit.client.1.smithi064.stdout:5/336: write dd/d12/d18/d25/d32/f37 [455364,85852] 0 2024-04-26T21:08:00.940 INFO:tasks.workunit.client.1.smithi064.stdout:5/337: read - dd/d12/d18/d1a/d1f/d20/f59 zero size 2024-04-26T21:08:00.940 INFO:tasks.workunit.client.1.smithi064.stdout:7/352: truncate d6/db/f29 987371 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:3/323: dread d1/d14/f31 [0,4194304] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:7/353: mknod d6/d15/d67/d4d/c7a 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:2/361: dread d12/d28/f33 [4194304,4194304] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:3/324: unlink d1/f1a 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:3/325: write d1/d27/d50/f39 [415515,71774] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:5/338: getdents dd/d12/d18/d1a/d1b 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:6/319: dread d4/d7/d12/f48 [0,4194304] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:3/326: mknod d1/d27/d50/c77 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:1/445: dwrite d0/d6/d11/d1e/d2a/d34/d57/d66/f7e [0,4194304] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:1/446: dread - d0/d6/d11/d1e/d27/f81 zero size 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:1/447: write d0/d6/d29/d31/f83 [87580,30841] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:0/322: dwrite dd/d21/f36 [4194304,4194304] 0 2024-04-26T21:08:00.941 INFO:tasks.workunit.client.1.smithi064.stdout:2/362: read d12/d16/d2f/f4d [1289225,119164] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:2/363: write d12/d28/f33 [6467145,81489] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:8/303: dwrite d10/d2f/f3a [0,4194304] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:8/304: fsync d10/d41/d4e/d54/f55 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:4/409: dwrite d0/d5/d13/f60 [0,4194304] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:3/327: dwrite d1/f11 [0,4194304] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:3/328: fdatasync d1/d27/d29/d6f/d72/f40 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:5/339: dwrite dd/d12/d18/d1a/d1f/d20/f44 [0,4194304] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:5/340: fsync dd/d12/f49 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:6/320: dwrite d4/d7/d12/d49/d4b/d5a/f5d [0,4194304] 0 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:6/321: chown d4/lf 3143318 1 2024-04-26T21:08:00.942 INFO:tasks.workunit.client.1.smithi064.stdout:7/354: dwrite d6/db/d1f/f6c [0,4194304] 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:7/355: write d6/db/d1f/f4c [467453,28648] 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:1/448: rmdir d0 39 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:1/449: write d0/d22/f30 [1931570,60468] 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:9/359: sync 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:9/360: chown d0/f18 389 1 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:0/323: link l4 dd/d10/d1a/d31/d5c/l62 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:9/361: dread d0/d4/d7/df/f40 [4194304,4194304] 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:2/364: getdents d12/d16/d2f/d53 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:4/410: creat d0/d5/d13/d33/f86 x:0 0 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:3/329: unlink d1/d27/d29/c5d 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:5/341: stat dd/d12/d18/c23 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:6/322: mknod d4/d7/d12/d49/d4b/d5a/c67 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:7/356: rename d6/d9/d3d/d43/f59 to d6/db/d34/d41/d5c/f7b 0 2024-04-26T21:08:00.943 INFO:tasks.workunit.client.1.smithi064.stdout:1/450: rmdir d0/d6/d11/d2c 39 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:8/305: getdents d10/d41/d4e/d54 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:0/324: truncate dd/d10/d1a/f2f 844580 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:0/325: stat dd/d10 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:9/362: mkdir d0/d4/d28/d4f/d74/d76 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:9/363: write d0/d4/da/d26/d47/d6b/f70 [901644,103371] 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:2/365: creat d12/d28/d3a/d46/f80 x:0 0 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:3/330: symlink d1/d27/d29/d6f/d72/d73/l78 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:3/331: dread - d1/d14/f5a zero size 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:5/342: mkdir dd/d12/d18/d25/d67 0 2024-04-26T21:08:00.944 INFO:tasks.workunit.client.1.smithi064.stdout:4/411: dwrite d0/d1d/f1b [0,4194304] 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.1.smithi064.stdout:8/306: mkdir d10/d41/d4e/d59/d5d 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.1.smithi064.stdout:8/307: creat d10/d1d/d38/f5e x:0 0 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.0.smithi055.stdout:7/206: dwrite d5/d11/f33 [0,4194304] 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.0.smithi055.stdout:7/207: truncate d5/d6/ff 1134664 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.0.smithi055.stdout:9/173: dread d2/f1a [0,4194304] 0 2024-04-26T21:08:00.946 INFO:tasks.workunit.client.0.smithi055.stdout:3/231: dwrite d0/d1/d47/d37/f41 [0,4194304] 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:3/232: creat d0/d1/d13/d1a/f54 x:0 0 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:7/208: mkdir d5/d6/d24/d3b 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:9/174: rmdir d2/d14/d33 39 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:8/132: sync 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/202: sync 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/203: creat d3/d17/d19/f41 x:0 0 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:4/125: sync 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:2/168: sync 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:5/132: sync 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:8/133: mkdir d3/d9/d1f/d2e 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/204: mknod d3/d17/d19/c42 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/205: fdatasync d3/f12 0 2024-04-26T21:08:00.947 INFO:tasks.workunit.client.0.smithi055.stdout:0/247: dwrite d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:0/248: readlink d9/l14 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:7/209: dwrite d5/d6/d24/f37 [0,4194304] 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:7/210: stat d5/d6/d24/c35 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:2/169: rename d4/dc/d21/l31 to d4/l39 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:2/170: readlink d4/l2b 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:8/134: readlink d3/lb 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:0/249: symlink d9/dc/d1c/d54/l56 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:7/211: dread d5/db/f14 [4194304,4194304] 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:5/133: dread d4/df/f1b [0,4194304] 0 2024-04-26T21:08:00.948 INFO:tasks.workunit.client.0.smithi055.stdout:2/171: creat d4/d14/d33/f3a x:0 0 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/172: chown d4/db/f25 555052190 1 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/173: truncate d4/d14/d33/f3a 6436 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:8/135: rename d3/cf to d3/d9/d1f/c2f 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:6/206: write d3/d17/d19/f1e [3243586,127679] 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:3/233: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/250: creat d9/dc/f57 x:0 0 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/251: chown d9/fa 1365407 1 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/252: truncate d9/dc/f57 116766 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/253: write d9/d11/f35 [2403357,123288] 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/254: read - d9/dc/d1c/f4f zero size 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/255: fsync d9/dc/d1c/f29 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/256: fsync d9/d27/f42 0 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/257: rename d9/dc to d9/dc/d1c/d54/d58 22 2024-04-26T21:08:00.949 INFO:tasks.workunit.client.0.smithi055.stdout:5/134: symlink d4/df/d13/d26/d28/l2a 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:5/135: read - d4/df/d13/f25 zero size 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:2/174: symlink d4/d14/d17/l3b 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:6/207: dread d3/f12 [0,4194304] 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:6/208: write d3/d17/d19/f3d [1285401,64149] 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:3/234: mkdir d0/d1/d13/d1a/d46/d55 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:3/235: dread - d0/d4/f44 zero size 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/258: unlink d9/dc/d17/c55 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/259: write d9/d27/f37 [2272741,35198] 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/260: chown d9/d11/c28 104 1 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/261: write f8 [4498425,121931] 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:2/175: mknod d4/d14/d17/d36/c3c 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:6/209: unlink d3/d17/d19/f2e 0 2024-04-26T21:08:00.950 INFO:tasks.workunit.client.0.smithi055.stdout:4/126: dwrite d4/f30 [0,4194304] 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:0/262: mkdir d9/d11/d59 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:2/176: rename d4/dc/f18 to d4/db/d1f/f3d 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:6/210: unlink d3/l13 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:6/211: fsync d3/d17/d19/f41 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:3/236: write d0/d4/d5/f6 [1585022,91895] 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:0/263: write d9/dc/d17/f30 [106426,67943] 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:4/127: rmdir d4/d23 39 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:8/136: dwrite d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:3/237: symlink d0/d1/d13/d1a/d46/d55/l56 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:2/177: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:4/128: rename d4/d12/d17/f27 to d4/d18/d1e/d28/f32 0 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:4/129: chown d4/d12/d17/c2e 24478 1 2024-04-26T21:08:00.951 INFO:tasks.workunit.client.0.smithi055.stdout:8/137: creat d3/d9/f30 x:0 0 0 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/264: dread f8 [0,4194304] 0 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:2/178: unlink d4/db/d1f/l2f 0 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:8/138: dread d3/d9/d1f/f27 [0,4194304] 0 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/265: rename d9/d11/f35 to d9/f5a 0 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/266: dread - d9/dc/d1c/d54/f4a zero size 2024-04-26T21:08:00.952 INFO:tasks.workunit.client.0.smithi055.stdout:2/179: rmdir d4/d14/d17/d36 39 2024-04-26T21:08:00.953 INFO:tasks.workunit.client.0.smithi055.stdout:2/180: read d4/dc/f16 [159888,48068] 0 2024-04-26T21:08:00.953 INFO:tasks.workunit.client.1.smithi064.stdout:6/323: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:08:00.953 INFO:tasks.workunit.client.1.smithi064.stdout:6/324: stat d4/d7/c5e 0 2024-04-26T21:08:00.956 INFO:tasks.workunit.client.0.smithi055.stdout:0/267: rename d9/d11/d4d to d9/d11/d5b 0 2024-04-26T21:08:00.956 INFO:tasks.workunit.client.0.smithi055.stdout:0/268: write d9/dc/d1c/f26 [1371402,11545] 0 2024-04-26T21:08:00.957 INFO:tasks.workunit.client.1.smithi064.stdout:7/357: dwrite d6/db/f2a [0,4194304] 0 2024-04-26T21:08:00.957 INFO:tasks.workunit.client.1.smithi064.stdout:7/358: read - d6/d15/f56 zero size 2024-04-26T21:08:00.964 INFO:tasks.workunit.client.0.smithi055.stdout:8/139: rename d3/d9/f30 to d3/d9/d1f/f31 0 2024-04-26T21:08:00.964 INFO:tasks.workunit.client.0.smithi055.stdout:8/140: chown d3/d9/l28 105754 1 2024-04-26T21:08:00.964 INFO:tasks.workunit.client.0.smithi055.stdout:8/141: creat d3/d9/d1f/f32 x:0 0 0 2024-04-26T21:08:00.965 INFO:tasks.workunit.client.0.smithi055.stdout:8/142: write d3/d9/d1f/f29 [415779,113182] 0 2024-04-26T21:08:00.965 INFO:tasks.workunit.client.0.smithi055.stdout:8/143: chown d3/d9/l13 4 1 2024-04-26T21:08:00.967 INFO:tasks.workunit.client.1.smithi064.stdout:7/359: dread d6/db/d1f/f4c [0,4194304] 0 2024-04-26T21:08:00.970 INFO:tasks.workunit.client.0.smithi055.stdout:2/181: unlink c3 0 2024-04-26T21:08:00.970 INFO:tasks.workunit.client.0.smithi055.stdout:3/238: dwrite d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:00.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/269: symlink d9/dc/d1c/d54/d4b/l5c 0 2024-04-26T21:08:00.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/270: chown d9/dc/d17/f3f 1919 1 2024-04-26T21:08:00.977 INFO:tasks.workunit.client.1.smithi064.stdout:3/332: rename d1/d27/d29/c62 to d1/d27/d29/c79 0 2024-04-26T21:08:00.977 INFO:tasks.workunit.client.1.smithi064.stdout:4/412: mkdir d0/d2f/d87 0 2024-04-26T21:08:00.979 INFO:tasks.workunit.client.0.smithi055.stdout:8/144: stat d3/ca 0 2024-04-26T21:08:00.979 INFO:tasks.workunit.client.0.smithi055.stdout:8/145: write d3/d9/d1f/f29 [724030,42979] 0 2024-04-26T21:08:00.980 INFO:tasks.workunit.client.1.smithi064.stdout:9/364: dwrite d0/d4/da/fc [8388608,4194304] 0 2024-04-26T21:08:00.981 INFO:tasks.workunit.client.1.smithi064.stdout:0/326: dwrite dd/d10/d1a/d31/f4b [0,4194304] 0 2024-04-26T21:08:00.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/365: read d0/d4/d7/df/f32 [3330159,41796] 0 2024-04-26T21:08:00.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/366: chown d0/d4/da/d26/d5e/f69 442 1 2024-04-26T21:08:00.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/367: write d0/d4/da/f57 [508025,19266] 0 2024-04-26T21:08:00.981 INFO:tasks.workunit.client.1.smithi064.stdout:5/343: dwrite f9 [0,4194304] 0 2024-04-26T21:08:00.982 INFO:tasks.workunit.client.1.smithi064.stdout:9/368: creat d0/d4/da/f77 x:0 0 0 2024-04-26T21:08:00.982 INFO:tasks.workunit.client.1.smithi064.stdout:9/369: fdatasync d0/d4/da/d26/f6f 0 2024-04-26T21:08:00.983 INFO:tasks.workunit.client.0.smithi055.stdout:3/239: mkdir d0/d4/d16/d18/d4b/d57 0 2024-04-26T21:08:00.985 INFO:tasks.workunit.client.1.smithi064.stdout:8/308: mknod d10/d41/d44/c5f 0 2024-04-26T21:08:00.991 INFO:tasks.workunit.client.0.smithi055.stdout:8/146: mknod d3/d9/d1d/c33 0 2024-04-26T21:08:00.998 INFO:tasks.workunit.client.1.smithi064.stdout:7/360: rename d6/d9/d3d/d43/l71 to d6/d15/d1c/d45/l7c 0 2024-04-26T21:08:00.998 INFO:tasks.workunit.client.1.smithi064.stdout:7/361: chown d6/d9/f11 17 1 2024-04-26T21:08:00.998 INFO:tasks.workunit.client.1.smithi064.stdout:7/362: chown d6/d9/d3d 1 1 2024-04-26T21:08:00.999 INFO:tasks.workunit.client.0.smithi055.stdout:3/240: symlink d0/d4/d16/d18/d4b/d57/l58 0 2024-04-26T21:08:00.999 INFO:tasks.workunit.client.1.smithi064.stdout:9/370: write d0/d4/da/f29 [3550589,79839] 0 2024-04-26T21:08:01.000 INFO:tasks.workunit.client.1.smithi064.stdout:2/366: getdents d12/d16/d2f 0 2024-04-26T21:08:01.000 INFO:tasks.workunit.client.1.smithi064.stdout:2/367: write d12/d28/f33 [5006203,119706] 0 2024-04-26T21:08:01.004 INFO:tasks.workunit.client.1.smithi064.stdout:4/413: creat d0/d1d/d17/d44/d45/f88 x:0 0 0 2024-04-26T21:08:01.004 INFO:tasks.workunit.client.1.smithi064.stdout:4/414: dread - d0/d5/d13/d33/f86 zero size 2024-04-26T21:08:01.004 INFO:tasks.workunit.client.1.smithi064.stdout:4/415: read - d0/d5/d13/d33/f85 zero size 2024-04-26T21:08:01.005 INFO:tasks.workunit.client.0.smithi055.stdout:4/130: dwrite d4/f30 [4194304,4194304] 0 2024-04-26T21:08:01.015 INFO:tasks.workunit.client.1.smithi064.stdout:0/327: getdents dd/d10/d18/d58 0 2024-04-26T21:08:01.020 INFO:tasks.workunit.client.0.smithi055.stdout:3/241: dread d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:01.021 INFO:tasks.workunit.client.0.smithi055.stdout:4/131: rmdir d4/d12/d15 39 2024-04-26T21:08:01.027 INFO:tasks.workunit.client.1.smithi064.stdout:8/309: mkdir d10/d41/d4e/d60 0 2024-04-26T21:08:01.030 INFO:tasks.workunit.client.0.smithi055.stdout:3/242: creat d0/d1/d13/d1a/d46/d55/f59 x:0 0 0 2024-04-26T21:08:01.031 INFO:tasks.workunit.client.1.smithi064.stdout:3/333: rename d1/d27/d50/d35/d4c/d61 to d1/d27/d29/d6f/d72/d7a 0 2024-04-26T21:08:01.031 INFO:tasks.workunit.client.1.smithi064.stdout:3/334: fdatasync d1/d27/d50/f24 0 2024-04-26T21:08:01.035 INFO:tasks.workunit.client.0.smithi055.stdout:2/182: dwrite d4/d14/d17/f2e [0,4194304] 0 2024-04-26T21:08:01.035 INFO:tasks.workunit.client.0.smithi055.stdout:2/183: dread - d4/d14/d17/f37 zero size 2024-04-26T21:08:01.047 INFO:tasks.workunit.client.1.smithi064.stdout:5/344: dread dd/d12/d18/f2f [0,4194304] 0 2024-04-26T21:08:01.047 INFO:tasks.workunit.client.1.smithi064.stdout:5/345: write dd/d12/d18/d1a/d1f/d20/f59 [823857,31119] 0 2024-04-26T21:08:01.054 INFO:tasks.workunit.client.1.smithi064.stdout:7/363: mknod d6/db/d34/d6f/c7d 0 2024-04-26T21:08:01.056 INFO:tasks.workunit.client.1.smithi064.stdout:3/335: dread d1/d12/f44 [0,4194304] 0 2024-04-26T21:08:01.058 INFO:tasks.workunit.client.1.smithi064.stdout:9/371: mknod d0/d4/da/c78 0 2024-04-26T21:08:01.062 INFO:tasks.workunit.client.1.smithi064.stdout:2/368: mknod d12/c81 0 2024-04-26T21:08:01.066 INFO:tasks.workunit.client.0.smithi055.stdout:3/243: symlink d0/d4/l5a 0 2024-04-26T21:08:01.068 INFO:tasks.workunit.client.0.smithi055.stdout:3/244: write d0/d1/d13/d1a/f35 [1212147,88217] 0 2024-04-26T21:08:01.076 INFO:tasks.workunit.client.0.smithi055.stdout:2/184: link d4/db/d1f/f3d d4/db/d1f/d32/f3e 0 2024-04-26T21:08:01.076 INFO:tasks.workunit.client.0.smithi055.stdout:2/185: chown d4/d1e/c28 6456002 1 2024-04-26T21:08:01.084 INFO:tasks.workunit.client.1.smithi064.stdout:4/416: mkdir d0/d1d/d56/d89 0 2024-04-26T21:08:01.084 INFO:tasks.workunit.client.1.smithi064.stdout:9/372: mknod d0/d4/d28/d4f/c79 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:0/328: mknod dd/d10/d1a/d31/d47/d61/c63 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:7/364: mknod d6/d15/d1c/c7e 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:0/329: readlink dd/d21/l26 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:2/369: symlink d12/d41/d61/d6c/d71/l82 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:2/370: chown d12/d28/f33 62 1 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:2/371: stat d12/d28/d3a/c4a 0 2024-04-26T21:08:01.085 INFO:tasks.workunit.client.1.smithi064.stdout:5/346: symlink dd/d12/d18/d1a/d1f/d20/l68 0 2024-04-26T21:08:01.086 INFO:tasks.workunit.client.1.smithi064.stdout:4/417: rename d0/d5/d79/f84 to d0/d2f/d7d/f8a 0 2024-04-26T21:08:01.087 INFO:tasks.workunit.client.1.smithi064.stdout:4/418: creat d0/d1d/d56/f8b x:0 0 0 2024-04-26T21:08:01.088 INFO:tasks.workunit.client.1.smithi064.stdout:7/365: getdents d6/d5a 0 2024-04-26T21:08:01.090 INFO:tasks.workunit.client.1.smithi064.stdout:2/372: mkdir d12/d41/d73/d83 0 2024-04-26T21:08:01.094 INFO:tasks.workunit.client.1.smithi064.stdout:4/419: link d0/d5/d13/f3d d0/d5/d79/f8c 0 2024-04-26T21:08:01.095 INFO:tasks.workunit.client.1.smithi064.stdout:8/310: dwrite d10/d1d/d38/f5b [0,4194304] 0 2024-04-26T21:08:01.095 INFO:tasks.workunit.client.1.smithi064.stdout:8/311: write d10/f24 [283035,101460] 0 2024-04-26T21:08:01.095 INFO:tasks.workunit.client.1.smithi064.stdout:7/366: unlink d6/d5a/c1d 0 2024-04-26T21:08:01.103 INFO:tasks.workunit.client.1.smithi064.stdout:8/312: mkdir d10/d2f/d61 0 2024-04-26T21:08:01.103 INFO:tasks.workunit.client.0.smithi055.stdout:2/186: dread d4/dc/f11 [0,4194304] 0 2024-04-26T21:08:01.104 INFO:tasks.workunit.client.0.smithi055.stdout:8/147: dwrite d3/d9/d1f/f31 [0,4194304] 0 2024-04-26T21:08:01.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/132: dwrite d4/d23/f25 [0,4194304] 0 2024-04-26T21:08:01.114 INFO:tasks.workunit.client.1.smithi064.stdout:0/330: dread dd/d10/d1a/d31/f37 [0,4194304] 0 2024-04-26T21:08:01.120 INFO:tasks.workunit.client.1.smithi064.stdout:5/347: write dd/d12/d18/d1a/d1f/f24 [9046325,102335] 0 2024-04-26T21:08:01.120 INFO:tasks.workunit.client.1.smithi064.stdout:5/348: chown dd 248083 1 2024-04-26T21:08:01.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/187: dread d4/d14/d33/f3a [0,4194304] 0 2024-04-26T21:08:01.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/188: stat d4/d14/d17 0 2024-04-26T21:08:01.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/189: fsync d4/db/f25 0 2024-04-26T21:08:01.121 INFO:tasks.workunit.client.0.smithi055.stdout:2/190: write f2 [3115745,62182] 0 2024-04-26T21:08:01.122 INFO:tasks.workunit.client.1.smithi064.stdout:1/451: sync 2024-04-26T21:08:01.123 INFO:tasks.workunit.client.1.smithi064.stdout:6/325: sync 2024-04-26T21:08:01.126 INFO:tasks.workunit.client.0.smithi055.stdout:1/199: sync 2024-04-26T21:08:01.126 INFO:tasks.workunit.client.0.smithi055.stdout:1/200: chown d8/df/d11/d27/d28/d2a 1294507 1 2024-04-26T21:08:01.127 INFO:tasks.workunit.client.0.smithi055.stdout:9/175: sync 2024-04-26T21:08:01.127 INFO:tasks.workunit.client.0.smithi055.stdout:9/176: write d2/f10 [698118,20716] 0 2024-04-26T21:08:01.128 INFO:tasks.workunit.client.1.smithi064.stdout:7/367: dread d6/d5a/d5f/f66 [0,4194304] 0 2024-04-26T21:08:01.130 INFO:tasks.workunit.client.0.smithi055.stdout:8/148: mknod d3/d9/d1d/c34 0 2024-04-26T21:08:01.130 INFO:tasks.workunit.client.0.smithi055.stdout:8/149: chown d3/d9/d1f/d2e 21045722 1 2024-04-26T21:08:01.132 INFO:tasks.workunit.client.0.smithi055.stdout:4/133: write d4/d23/f25 [1571219,16362] 0 2024-04-26T21:08:01.133 INFO:tasks.workunit.client.1.smithi064.stdout:3/336: dwrite d1/fc [0,4194304] 0 2024-04-26T21:08:01.136 INFO:tasks.workunit.client.0.smithi055.stdout:3/245: dwrite d0/d1/f3f [4194304,4194304] 0 2024-04-26T21:08:01.136 INFO:tasks.workunit.client.1.smithi064.stdout:9/373: dwrite d0/d4/d7/df/f40 [4194304,4194304] 0 2024-04-26T21:08:01.137 INFO:tasks.workunit.client.0.smithi055.stdout:2/191: mknod d4/d1e/c3f 0 2024-04-26T21:08:01.137 INFO:tasks.workunit.client.0.smithi055.stdout:2/192: write d4/d14/f38 [948161,52471] 0 2024-04-26T21:08:01.142 INFO:tasks.workunit.client.1.smithi064.stdout:2/373: rmdir d12 39 2024-04-26T21:08:01.144 INFO:tasks.workunit.client.1.smithi064.stdout:4/420: rmdir d0/d2f/d69 39 2024-04-26T21:08:01.146 INFO:tasks.workunit.client.0.smithi055.stdout:9/177: symlink d2/d11/l3e 0 2024-04-26T21:08:01.146 INFO:tasks.workunit.client.0.smithi055.stdout:9/178: write d2/d14/f2b [526194,76613] 0 2024-04-26T21:08:01.146 INFO:tasks.workunit.client.0.smithi055.stdout:8/150: unlink d3/d9/d1f/c2c 0 2024-04-26T21:08:01.148 INFO:tasks.workunit.client.1.smithi064.stdout:0/331: mkdir dd/d10/d18/d64 0 2024-04-26T21:08:01.148 INFO:tasks.workunit.client.1.smithi064.stdout:0/332: truncate dd/d10/d1a/f2f 1710427 0 2024-04-26T21:08:01.149 INFO:tasks.workunit.client.0.smithi055.stdout:1/201: dread f1 [0,4194304] 0 2024-04-26T21:08:01.149 INFO:tasks.workunit.client.1.smithi064.stdout:5/349: creat dd/d12/d18/d25/d67/f69 x:0 0 0 2024-04-26T21:08:01.152 INFO:tasks.workunit.client.0.smithi055.stdout:4/134: dread d4/d23/f25 [0,4194304] 0 2024-04-26T21:08:01.152 INFO:tasks.workunit.client.0.smithi055.stdout:4/135: truncate d4/d12/d17/f19 811732 0 2024-04-26T21:08:01.154 INFO:tasks.workunit.client.1.smithi064.stdout:1/452: mkdir d0/d22/d87 0 2024-04-26T21:08:01.155 INFO:tasks.workunit.client.1.smithi064.stdout:6/326: creat d4/d7/d12/f68 x:0 0 0 2024-04-26T21:08:01.155 INFO:tasks.workunit.client.1.smithi064.stdout:6/327: fsync d4/d7/f53 0 2024-04-26T21:08:01.156 INFO:tasks.workunit.client.1.smithi064.stdout:7/368: creat d6/d15/d67/d78/f7f x:0 0 0 2024-04-26T21:08:01.158 INFO:tasks.workunit.client.1.smithi064.stdout:3/337: mkdir d1/d27/d50/d35/d4c/d7b 0 2024-04-26T21:08:01.158 INFO:tasks.workunit.client.1.smithi064.stdout:3/338: creat d1/d12/f7c x:0 0 0 2024-04-26T21:08:01.158 INFO:tasks.workunit.client.0.smithi055.stdout:2/193: symlink d4/dc/l40 0 2024-04-26T21:08:01.159 INFO:tasks.workunit.client.0.smithi055.stdout:2/194: chown d4/d14/d33 2093119 1 2024-04-26T21:08:01.159 INFO:tasks.workunit.client.0.smithi055.stdout:2/195: fdatasync d4/dc/f11 0 2024-04-26T21:08:01.160 INFO:tasks.workunit.client.1.smithi064.stdout:9/374: mknod d0/d4/da/d31/c7a 0 2024-04-26T21:08:01.166 INFO:tasks.workunit.client.0.smithi055.stdout:9/179: write d2/d14/f21 [3874195,87936] 0 2024-04-26T21:08:01.167 INFO:tasks.workunit.client.1.smithi064.stdout:2/374: creat d12/d28/d3a/d3e/f84 x:0 0 0 2024-04-26T21:08:01.167 INFO:tasks.workunit.client.1.smithi064.stdout:4/421: rename d0/d5/l6 to d0/d1d/l8d 0 2024-04-26T21:08:01.167 INFO:tasks.workunit.client.1.smithi064.stdout:2/375: getdents d12/d28/d3a/d5d 0 2024-04-26T21:08:01.172 INFO:tasks.workunit.client.0.smithi055.stdout:3/246: write d0/d1/d47/d37/f41 [2272669,121607] 0 2024-04-26T21:08:01.173 INFO:tasks.workunit.client.1.smithi064.stdout:0/333: link dd/d21/f3a dd/d10/d18/d64/f65 0 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:7/369: symlink d6/db/d34/l80 0 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:7/370: dread - d6/d9/d3d/f6b zero size 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:3/339: mkdir d1/d12/d7d 0 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:4/422: write d0/d5/d3e/f67 [515936,5647] 0 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:4/423: read d0/d1d/f2e [3712464,59499] 0 2024-04-26T21:08:01.174 INFO:tasks.workunit.client.1.smithi064.stdout:4/424: chown d0/d5/d13/d33/c37 1216826 1 2024-04-26T21:08:01.179 INFO:tasks.workunit.client.0.smithi055.stdout:3/247: symlink d0/d4/d16/d18/l5b 0 2024-04-26T21:08:01.181 INFO:tasks.workunit.client.0.smithi055.stdout:3/248: mkdir d0/d1/d13/d5c 0 2024-04-26T21:08:01.181 INFO:tasks.workunit.client.0.smithi055.stdout:3/249: write d0/d4/f44 [471364,51879] 0 2024-04-26T21:08:01.181 INFO:tasks.workunit.client.1.smithi064.stdout:5/350: write dd/d12/d18/d1a/d1f/d20/f44 [2209053,43256] 0 2024-04-26T21:08:01.181 INFO:tasks.workunit.client.1.smithi064.stdout:1/453: rename d0/f3 to d0/d22/d87/f88 0 2024-04-26T21:08:01.181 INFO:tasks.workunit.client.1.smithi064.stdout:9/375: rmdir d0/d4/d7 39 2024-04-26T21:08:01.182 INFO:tasks.workunit.client.1.smithi064.stdout:1/454: write d0/d6/d11/f5e [1580770,59046] 0 2024-04-26T21:08:01.182 INFO:tasks.workunit.client.1.smithi064.stdout:8/313: dwrite d10/f1b [4194304,4194304] 0 2024-04-26T21:08:01.182 INFO:tasks.workunit.client.1.smithi064.stdout:4/425: creat d0/d1d/d21/f8e x:0 0 0 2024-04-26T21:08:01.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/351: mkdir dd/d12/d18/d33/d48/d6a 0 2024-04-26T21:08:01.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/352: chown dd/d12/d18/d1a/d1b/f2c 53509689 1 2024-04-26T21:08:01.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/353: fsync dd/d12/f40 0 2024-04-26T21:08:01.186 INFO:tasks.workunit.client.1.smithi064.stdout:5/354: write dd/d12/d18/d1a/d1f/f5a [149498,9670] 0 2024-04-26T21:08:01.194 INFO:tasks.workunit.client.1.smithi064.stdout:6/328: rename d4/d7/d12/f48 to d4/d7/f69 0 2024-04-26T21:08:01.197 INFO:tasks.workunit.client.1.smithi064.stdout:4/426: rmdir d0/d5/d13/d6d/d7e 0 2024-04-26T21:08:01.199 INFO:tasks.workunit.client.0.smithi055.stdout:2/196: dread f2 [0,4194304] 0 2024-04-26T21:08:01.200 INFO:tasks.workunit.client.1.smithi064.stdout:5/355: symlink dd/d12/d18/l6b 0 2024-04-26T21:08:01.201 INFO:tasks.workunit.client.1.smithi064.stdout:7/371: dread d6/db/f2d [0,4194304] 0 2024-04-26T21:08:01.202 INFO:tasks.workunit.client.1.smithi064.stdout:1/455: link d0/d22/d87/f88 d0/d6/d11/d1e/d27/f89 0 2024-04-26T21:08:01.203 INFO:tasks.workunit.client.0.smithi055.stdout:2/197: write d4/d14/f38 [298130,114591] 0 2024-04-26T21:08:01.204 INFO:tasks.workunit.client.1.smithi064.stdout:7/372: mkdir d6/db/d34/d6f/d81 0 2024-04-26T21:08:01.204 INFO:tasks.workunit.client.1.smithi064.stdout:7/373: read - d6/d15/f56 zero size 2024-04-26T21:08:01.206 INFO:tasks.workunit.client.1.smithi064.stdout:1/456: rmdir d0/d6/d29 39 2024-04-26T21:08:01.208 INFO:tasks.workunit.client.1.smithi064.stdout:7/374: link d6/d15/c55 d6/d15/d67/d4d/c82 0 2024-04-26T21:08:01.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/198: mkdir d4/db/d26/d41 0 2024-04-26T21:08:01.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/199: chown d4/d14/f38 27 1 2024-04-26T21:08:01.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/200: creat d4/d14/d33/f42 x:0 0 0 2024-04-26T21:08:01.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/201: truncate d4/d14/f38 1335238 0 2024-04-26T21:08:01.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/202: fsync d4/f5 0 2024-04-26T21:08:01.211 INFO:tasks.workunit.client.0.smithi055.stdout:3/250: write d0/d1/d13/d1a/f24 [3527368,126858] 0 2024-04-26T21:08:01.211 INFO:tasks.workunit.client.0.smithi055.stdout:3/251: truncate d0/d4/f40 138634 0 2024-04-26T21:08:01.211 INFO:tasks.workunit.client.0.smithi055.stdout:3/252: creat d0/d4/d16/d18/f5d x:0 0 0 2024-04-26T21:08:01.211 INFO:tasks.workunit.client.0.smithi055.stdout:3/253: write d0/d4/d5/f6 [1936305,98745] 0 2024-04-26T21:08:01.212 INFO:tasks.workunit.client.1.smithi064.stdout:3/340: write d1/d14/f1c [1361604,108298] 0 2024-04-26T21:08:01.212 INFO:tasks.workunit.client.1.smithi064.stdout:3/341: fsync d1/d27/f3d 0 2024-04-26T21:08:01.212 INFO:tasks.workunit.client.1.smithi064.stdout:7/375: symlink d6/d70/d74/l83 0 2024-04-26T21:08:01.212 INFO:tasks.workunit.client.1.smithi064.stdout:7/376: write d6/db/d1f/f4c [1117206,50418] 0 2024-04-26T21:08:01.215 INFO:tasks.workunit.client.0.smithi055.stdout:8/151: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:01.215 INFO:tasks.workunit.client.0.smithi055.stdout:8/152: creat d3/d9/d1d/f35 x:0 0 0 2024-04-26T21:08:01.218 INFO:tasks.workunit.client.1.smithi064.stdout:7/377: rename d6/d15/f56 to d6/db/d34/d6f/d81/f84 0 2024-04-26T21:08:01.219 INFO:tasks.workunit.client.0.smithi055.stdout:9/180: dwrite d2/f22 [0,4194304] 0 2024-04-26T21:08:01.223 INFO:tasks.workunit.client.1.smithi064.stdout:8/314: dread d10/d1d/f29 [0,4194304] 0 2024-04-26T21:08:01.224 INFO:tasks.workunit.client.1.smithi064.stdout:7/378: creat d6/d70/d74/f85 x:0 0 0 2024-04-26T21:08:01.229 INFO:tasks.workunit.client.0.smithi055.stdout:3/254: creat d0/d1/d13/d1a/d46/d51/f5e x:0 0 0 2024-04-26T21:08:01.229 INFO:tasks.workunit.client.0.smithi055.stdout:3/255: fdatasync d0/f34 0 2024-04-26T21:08:01.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/203: getdents d4/db/d1f 0 2024-04-26T21:08:01.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/204: readlink d4/dc/l40 0 2024-04-26T21:08:01.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/205: stat d4/d14/f38 0 2024-04-26T21:08:01.230 INFO:tasks.workunit.client.0.smithi055.stdout:2/206: chown d4/d14/d33 7 1 2024-04-26T21:08:01.230 INFO:tasks.workunit.client.1.smithi064.stdout:6/329: read d4/d7/d12/d49/d4b/d5a/f5d [3894142,125159] 0 2024-04-26T21:08:01.232 INFO:tasks.workunit.client.1.smithi064.stdout:9/376: dread d0/d4/da/d26/d47/d6b/f70 [0,4194304] 0 2024-04-26T21:08:01.232 INFO:tasks.workunit.client.1.smithi064.stdout:9/377: write d0/d4/da/d26/d5d/f6d [1014944,56932] 0 2024-04-26T21:08:01.232 INFO:tasks.workunit.client.1.smithi064.stdout:9/378: readlink d0/d4/da/l1c 0 2024-04-26T21:08:01.233 INFO:tasks.workunit.client.1.smithi064.stdout:7/379: symlink d6/d70/d74/l86 0 2024-04-26T21:08:01.234 INFO:tasks.workunit.client.0.smithi055.stdout:8/153: link d3/d9/l13 d3/d9/d1f/d2e/l36 0 2024-04-26T21:08:01.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/334: dwrite dd/d10/d18/f49 [0,4194304] 0 2024-04-26T21:08:01.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/335: stat dd/d1c/d1d/f38 0 2024-04-26T21:08:01.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/336: readlink dd/l56 0 2024-04-26T21:08:01.242 INFO:tasks.workunit.client.1.smithi064.stdout:2/376: dwrite d12/d16/d29/d43/f7f [0,4194304] 0 2024-04-26T21:08:01.242 INFO:tasks.workunit.client.1.smithi064.stdout:2/377: dread - d12/d16/f77 zero size 2024-04-26T21:08:01.242 INFO:tasks.workunit.client.1.smithi064.stdout:3/342: read d1/d27/d50/f2d [1239171,19668] 0 2024-04-26T21:08:01.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/256: rename d0/d1/d47/d37/f41 to d0/d4/f5f 0 2024-04-26T21:08:01.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/257: fdatasync d0/d4/d5/f2c 0 2024-04-26T21:08:01.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/258: stat d0/d1/d47/d37 0 2024-04-26T21:08:01.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/259: read d0/f19 [2747710,18941] 0 2024-04-26T21:08:01.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/260: creat d0/d1/d47/d42/f60 x:0 0 0 2024-04-26T21:08:01.253 INFO:tasks.workunit.client.0.smithi055.stdout:2/207: truncate d4/db/d1f/d32/f3e 1615269 0 2024-04-26T21:08:01.255 INFO:tasks.workunit.client.1.smithi064.stdout:2/378: rename d12/d16 to d12/d28/d3a/d46/d48/d85 0 2024-04-26T21:08:01.255 INFO:tasks.workunit.client.1.smithi064.stdout:4/427: dwrite d0/d14/f50 [0,4194304] 0 2024-04-26T21:08:01.256 INFO:tasks.workunit.client.0.smithi055.stdout:9/181: rmdir d2 39 2024-04-26T21:08:01.259 INFO:tasks.workunit.client.0.smithi055.stdout:2/208: creat d4/dc/d21/f43 x:0 0 0 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:2/209: dread - d4/d14/d33/f42 zero size 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:2/210: fdatasync d4/d14/d33/f42 0 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:2/211: write d4/dc/f16 [1210650,58733] 0 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:2/212: fsync d4/d14/d33/f3a 0 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:8/154: write d3/d9/d1f/f23 [384880,16321] 0 2024-04-26T21:08:01.260 INFO:tasks.workunit.client.0.smithi055.stdout:8/155: truncate d3/d9/d1f/f23 4748146 0 2024-04-26T21:08:01.263 INFO:tasks.workunit.client.0.smithi055.stdout:9/182: creat d2/f3f x:0 0 0 2024-04-26T21:08:01.264 INFO:tasks.workunit.client.1.smithi064.stdout:2/379: mkdir d12/d28/d3a/d46/d6a/d86 0 2024-04-26T21:08:01.264 INFO:tasks.workunit.client.1.smithi064.stdout:2/380: write d12/f78 [458650,72474] 0 2024-04-26T21:08:01.267 INFO:tasks.workunit.client.0.smithi055.stdout:2/213: mkdir d4/d1e/d44 0 2024-04-26T21:08:01.269 INFO:tasks.workunit.client.1.smithi064.stdout:9/379: dread d0/d4/f2a [0,4194304] 0 2024-04-26T21:08:01.269 INFO:tasks.workunit.client.1.smithi064.stdout:9/380: chown d0/d4/da/d31/d34/c35 51 1 2024-04-26T21:08:01.269 INFO:tasks.workunit.client.1.smithi064.stdout:9/381: fdatasync d0/d39/f3e 0 2024-04-26T21:08:01.270 INFO:tasks.workunit.client.1.smithi064.stdout:9/382: creat d0/d4/da/d26/d5d/f7b x:0 0 0 2024-04-26T21:08:01.270 INFO:tasks.workunit.client.1.smithi064.stdout:9/383: truncate d0/d4/d7/df/f5f 188442 0 2024-04-26T21:08:01.276 INFO:tasks.workunit.client.1.smithi064.stdout:4/428: creat d0/d1d/d56/d89/f8f x:0 0 0 2024-04-26T21:08:01.280 INFO:tasks.workunit.client.1.smithi064.stdout:2/381: write d12/d28/f3f [455664,119140] 0 2024-04-26T21:08:01.283 INFO:tasks.workunit.client.0.smithi055.stdout:9/183: truncate d2/f1a 1440207 0 2024-04-26T21:08:01.285 INFO:tasks.workunit.client.1.smithi064.stdout:5/356: dwrite dd/d12/d18/d1a/d1f/d20/f38 [0,4194304] 0 2024-04-26T21:08:01.286 INFO:tasks.workunit.client.1.smithi064.stdout:3/343: rename d1/d27/d50/d35/f36 to d1/d27/d50/d35/d4c/d55/f7e 0 2024-04-26T21:08:01.289 INFO:tasks.workunit.client.1.smithi064.stdout:8/315: dwrite d10/f1b [0,4194304] 0 2024-04-26T21:08:01.289 INFO:tasks.workunit.client.1.smithi064.stdout:3/344: write d1/d27/d50/f24 [383082,59468] 0 2024-04-26T21:08:01.289 INFO:tasks.workunit.client.1.smithi064.stdout:3/345: readlink d1/d14/d60/l30 0 2024-04-26T21:08:01.291 INFO:tasks.workunit.client.0.smithi055.stdout:3/261: dread d0/d4/f44 [0,4194304] 0 2024-04-26T21:08:01.297 INFO:tasks.workunit.client.1.smithi064.stdout:9/384: mknod d0/d4/da/c7c 0 2024-04-26T21:08:01.300 INFO:tasks.workunit.client.0.smithi055.stdout:9/184: mknod d2/d14/d33/c40 0 2024-04-26T21:08:01.304 INFO:tasks.workunit.client.0.smithi055.stdout:3/262: mknod d0/d4/d16/d18/d4b/c61 0 2024-04-26T21:08:01.304 INFO:tasks.workunit.client.0.smithi055.stdout:3/263: creat d0/d4/d5/f62 x:0 0 0 2024-04-26T21:08:01.305 INFO:tasks.workunit.client.0.smithi055.stdout:9/185: creat d2/f41 x:0 0 0 2024-04-26T21:08:01.307 INFO:tasks.workunit.client.1.smithi064.stdout:7/380: dwrite d6/db/d1f/f6c [0,4194304] 0 2024-04-26T21:08:01.307 INFO:tasks.workunit.client.1.smithi064.stdout:7/381: fdatasync d6/d9/f30 0 2024-04-26T21:08:01.308 INFO:tasks.workunit.client.1.smithi064.stdout:1/457: dwrite d0/d6/f74 [0,4194304] 0 2024-04-26T21:08:01.308 INFO:tasks.workunit.client.1.smithi064.stdout:1/458: read d0/d6/d11/d1e/f1b [1888245,51687] 0 2024-04-26T21:08:01.310 INFO:tasks.workunit.client.1.smithi064.stdout:0/337: dwrite dd/d10/d1a/d31/d47/d61/d42/f5b [0,4194304] 0 2024-04-26T21:08:01.311 INFO:tasks.workunit.client.0.smithi055.stdout:3/264: link d0/d4/d5/f36 d0/d1/d47/d37/d3d/d4c/f63 0 2024-04-26T21:08:01.314 INFO:tasks.workunit.client.0.smithi055.stdout:9/186: rename d2/c34 to d2/d11/c42 0 2024-04-26T21:08:01.315 INFO:tasks.workunit.client.0.smithi055.stdout:9/187: fdatasync d2/f10 0 2024-04-26T21:08:01.315 INFO:tasks.workunit.client.1.smithi064.stdout:2/382: fsync d12/d28/f37 0 2024-04-26T21:08:01.316 INFO:tasks.workunit.client.1.smithi064.stdout:5/357: creat dd/d12/d18/d1a/d1b/f6c x:0 0 0 2024-04-26T21:08:01.322 INFO:tasks.workunit.client.0.smithi055.stdout:9/188: unlink d2/fe 0 2024-04-26T21:08:01.327 INFO:tasks.workunit.client.1.smithi064.stdout:3/346: creat d1/d27/d29/d6f/d72/d73/f7f x:0 0 0 2024-04-26T21:08:01.327 INFO:tasks.workunit.client.0.smithi055.stdout:9/189: link d2/f10 d2/d14/f43 0 2024-04-26T21:08:01.327 INFO:tasks.workunit.client.0.smithi055.stdout:9/190: truncate d2/f1c 219509 0 2024-04-26T21:08:01.330 INFO:tasks.workunit.client.0.smithi055.stdout:7/212: sync 2024-04-26T21:08:01.333 INFO:tasks.workunit.client.0.smithi055.stdout:9/191: symlink d2/d14/l44 0 2024-04-26T21:08:01.335 INFO:tasks.workunit.client.1.smithi064.stdout:1/459: creat d0/d6/d11/d1e/d2a/f8a x:0 0 0 2024-04-26T21:08:01.337 INFO:tasks.workunit.client.0.smithi055.stdout:7/213: rename d5/d6/d24/f37 to d5/d6/d24/d3b/f3c 0 2024-04-26T21:08:01.337 INFO:tasks.workunit.client.1.smithi064.stdout:8/316: write d10/d2f/f4c [4039817,121539] 0 2024-04-26T21:08:01.341 INFO:tasks.workunit.client.0.smithi055.stdout:8/156: dwrite d3/d9/d1d/f25 [4194304,4194304] 0 2024-04-26T21:08:01.342 INFO:tasks.workunit.client.0.smithi055.stdout:9/192: creat d2/d14/d33/f45 x:0 0 0 2024-04-26T21:08:01.345 INFO:tasks.workunit.client.0.smithi055.stdout:7/214: mknod d5/d6/d24/d3b/c3d 0 2024-04-26T21:08:01.346 INFO:tasks.workunit.client.1.smithi064.stdout:9/385: dread d0/d4/d7/df/f3a [0,4194304] 0 2024-04-26T21:08:01.346 INFO:tasks.workunit.client.1.smithi064.stdout:9/386: readlink d0/d4/da/d26/d47/l6c 0 2024-04-26T21:08:01.349 INFO:tasks.workunit.client.1.smithi064.stdout:2/383: dread d12/d41/d61/d75/f60 [0,4194304] 0 2024-04-26T21:08:01.349 INFO:tasks.workunit.client.1.smithi064.stdout:2/384: truncate d12/d45/f56 842586 0 2024-04-26T21:08:01.349 INFO:tasks.workunit.client.1.smithi064.stdout:4/429: dwrite d0/d1d/d17/d57/f81 [0,4194304] 0 2024-04-26T21:08:01.353 INFO:tasks.workunit.client.1.smithi064.stdout:7/382: dwrite d6/db/d34/d41/d5c/f7b [0,4194304] 0 2024-04-26T21:08:01.353 INFO:tasks.workunit.client.0.smithi055.stdout:8/157: unlink d3/d9/c26 0 2024-04-26T21:08:01.360 INFO:tasks.workunit.client.0.smithi055.stdout:9/193: mkdir d2/d46 0 2024-04-26T21:08:01.365 INFO:tasks.workunit.client.0.smithi055.stdout:8/158: mknod d3/d9/c37 0 2024-04-26T21:08:01.366 INFO:tasks.workunit.client.1.smithi064.stdout:5/358: symlink dd/d12/d18/d33/d63/l6d 0 2024-04-26T21:08:01.368 INFO:tasks.workunit.client.0.smithi055.stdout:9/194: creat d2/d14/f47 x:0 0 0 2024-04-26T21:08:01.368 INFO:tasks.workunit.client.0.smithi055.stdout:9/195: truncate d2/f1c 323888 0 2024-04-26T21:08:01.370 INFO:tasks.workunit.client.1.smithi064.stdout:3/347: mknod d1/d27/d50/c80 0 2024-04-26T21:08:01.370 INFO:tasks.workunit.client.1.smithi064.stdout:3/348: write d1/d27/d50/f39 [653528,102525] 0 2024-04-26T21:08:01.372 INFO:tasks.workunit.client.1.smithi064.stdout:0/338: dwrite dd/d10/d1a/d31/d47/d61/d42/f5b [0,4194304] 0 2024-04-26T21:08:01.373 INFO:tasks.workunit.client.0.smithi055.stdout:2/214: truncate d4/db/d1f/f3d 1399523 0 2024-04-26T21:08:01.374 INFO:tasks.workunit.client.1.smithi064.stdout:1/460: mknod d0/d6/d29/d31/c8b 0 2024-04-26T21:08:01.374 INFO:tasks.workunit.client.1.smithi064.stdout:1/461: stat d0/d6/d11/d1e/f21 0 2024-04-26T21:08:01.376 INFO:tasks.workunit.client.1.smithi064.stdout:8/317: creat d10/d41/d44/d5a/f62 x:0 0 0 2024-04-26T21:08:01.380 INFO:tasks.workunit.client.0.smithi055.stdout:2/215: symlink d4/db/l45 0 2024-04-26T21:08:01.382 INFO:tasks.workunit.client.0.smithi055.stdout:8/159: mknod d3/c38 0 2024-04-26T21:08:01.382 INFO:tasks.workunit.client.0.smithi055.stdout:8/160: readlink d3/d9/l28 0 2024-04-26T21:08:01.390 INFO:tasks.workunit.client.0.smithi055.stdout:2/216: mkdir d4/db/d1f/d46 0 2024-04-26T21:08:01.395 INFO:tasks.workunit.client.0.smithi055.stdout:2/217: creat d4/d1e/f47 x:0 0 0 2024-04-26T21:08:01.395 INFO:tasks.workunit.client.1.smithi064.stdout:2/385: rename d12/d28/d3a/d46/d48/d85/d29/d43/l6b to d12/d41/d61/l87 0 2024-04-26T21:08:01.395 INFO:tasks.workunit.client.1.smithi064.stdout:3/349: read d1/d27/d29/d6f/d72/f40 [1876078,61060] 0 2024-04-26T21:08:01.399 INFO:tasks.workunit.client.1.smithi064.stdout:7/383: write d6/d5a/d5f/f66 [3520196,117951] 0 2024-04-26T21:08:01.399 INFO:tasks.workunit.client.1.smithi064.stdout:7/384: stat d6/db/d34/d41/d5c 0 2024-04-26T21:08:01.402 INFO:tasks.workunit.client.1.smithi064.stdout:4/430: dwrite d0/d5/d13/d6d/f59 [0,4194304] 0 2024-04-26T21:08:01.402 INFO:tasks.workunit.client.1.smithi064.stdout:4/431: fdatasync d0/d5/d13/d6d/f4b 0 2024-04-26T21:08:01.402 INFO:tasks.workunit.client.1.smithi064.stdout:4/432: chown d0/d5/l7 100 1 2024-04-26T21:08:01.402 INFO:tasks.workunit.client.1.smithi064.stdout:4/433: stat d0/d5/d13/d33/c37 0 2024-04-26T21:08:01.403 INFO:tasks.workunit.client.0.smithi055.stdout:2/218: mknod d4/d1e/c48 0 2024-04-26T21:08:01.405 INFO:tasks.workunit.client.0.smithi055.stdout:8/161: write d3/d9/d1f/f31 [1401261,81287] 0 2024-04-26T21:08:01.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:01 smithi064 ceph-mon[33404]: pgmap v33: 65 pgs: 65 active+clean; 722 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 72 MiB/s rd, 80 MiB/s wr, 314 op/s 2024-04-26T21:08:01.407 INFO:tasks.workunit.client.0.smithi055.stdout:2/219: mkdir d4/d49 0 2024-04-26T21:08:01.408 INFO:tasks.workunit.client.0.smithi055.stdout:7/215: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:01.409 INFO:tasks.workunit.client.1.smithi064.stdout:2/386: write d12/f34 [1134502,90955] 0 2024-04-26T21:08:01.412 INFO:tasks.workunit.client.1.smithi064.stdout:0/339: unlink dd/d1c/d1d/f57 0 2024-04-26T21:08:01.412 INFO:tasks.workunit.client.1.smithi064.stdout:1/462: mknod d0/d6/d11/d1e/d2a/d34/d57/c8c 0 2024-04-26T21:08:01.413 INFO:tasks.workunit.client.0.smithi055.stdout:5/136: sync 2024-04-26T21:08:01.414 INFO:tasks.workunit.client.0.smithi055.stdout:6/212: sync 2024-04-26T21:08:01.414 INFO:tasks.workunit.client.0.smithi055.stdout:0/271: sync 2024-04-26T21:08:01.416 INFO:tasks.workunit.client.0.smithi055.stdout:2/220: rename d4/dc/d23 to d4/db/d26/d41/d4a 0 2024-04-26T21:08:01.417 INFO:tasks.workunit.client.0.smithi055.stdout:2/221: write d4/d1e/f47 [132041,104010] 0 2024-04-26T21:08:01.417 INFO:tasks.workunit.client.0.smithi055.stdout:2/222: read d4/f5 [837279,24530] 0 2024-04-26T21:08:01.417 INFO:tasks.workunit.client.0.smithi055.stdout:2/223: creat d4/d14/d33/f4b x:0 0 0 2024-04-26T21:08:01.420 INFO:tasks.workunit.client.0.smithi055.stdout:7/216: creat d5/d6/d39/f3e x:0 0 0 2024-04-26T21:08:01.425 INFO:tasks.workunit.client.1.smithi064.stdout:8/318: creat d10/d41/d4e/d59/d5d/f63 x:0 0 0 2024-04-26T21:08:01.425 INFO:tasks.workunit.client.0.smithi055.stdout:0/272: mkdir d9/dc/d17/d5d 0 2024-04-26T21:08:01.427 INFO:tasks.workunit.client.0.smithi055.stdout:6/213: mknod d3/d17/d25/c43 0 2024-04-26T21:08:01.427 INFO:tasks.workunit.client.0.smithi055.stdout:6/214: readlink d3/d17/d19/d20/l33 0 2024-04-26T21:08:01.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/359: rename dd/d12/d18/d25/d67/f69 to dd/d12/d18/d1a/f6e 0 2024-04-26T21:08:01.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/360: write dd/d12/d18/f36 [403352,19624] 0 2024-04-26T21:08:01.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/361: dread - dd/d12/f3f zero size 2024-04-26T21:08:01.448 INFO:tasks.workunit.client.1.smithi064.stdout:7/385: symlink d6/db/d34/l87 0 2024-04-26T21:08:01.448 INFO:tasks.workunit.client.1.smithi064.stdout:7/386: write d6/d9/f76 [157693,85144] 0 2024-04-26T21:08:01.452 INFO:tasks.workunit.client.0.smithi055.stdout:2/224: mkdir d4/d49/d4c 0 2024-04-26T21:08:01.455 INFO:tasks.workunit.client.1.smithi064.stdout:3/350: dread d1/d27/d50/fb [0,4194304] 0 2024-04-26T21:08:01.455 INFO:tasks.workunit.client.1.smithi064.stdout:3/351: write d1/d27/d29/d6f/d72/d73/f7f [64801,67923] 0 2024-04-26T21:08:01.456 INFO:tasks.workunit.client.0.smithi055.stdout:8/162: dwrite d3/d9/d1f/f27 [0,4194304] 0 2024-04-26T21:08:01.458 INFO:tasks.workunit.client.1.smithi064.stdout:0/340: truncate dd/f30 3605130 0 2024-04-26T21:08:01.458 INFO:tasks.workunit.client.1.smithi064.stdout:0/341: creat dd/d10/d1a/d31/d47/f66 x:0 0 0 2024-04-26T21:08:01.459 INFO:tasks.workunit.client.0.smithi055.stdout:6/215: creat d3/d17/d19/d20/d3e/f44 x:0 0 0 2024-04-26T21:08:01.463 INFO:tasks.workunit.client.1.smithi064.stdout:6/330: sync 2024-04-26T21:08:01.466 INFO:tasks.workunit.client.0.smithi055.stdout:5/137: rename d4/la to d4/df/d13/d26/l2b 0 2024-04-26T21:08:01.466 INFO:tasks.workunit.client.1.smithi064.stdout:1/463: rename d0/l45 to d0/d6/d11/d2c/l8d 0 2024-04-26T21:08:01.468 INFO:tasks.workunit.client.1.smithi064.stdout:5/362: mknod dd/d12/d18/d33/c6f 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/387: unlink d6/db/f29 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/388: stat d6/db/l16 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/389: chown d6/db/d34/l80 941 1 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:4/434: getdents d0/d1d/d17/d44/d45 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/390: chown d6/d15/d67/d4d 1214621 1 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/391: chown d6/db/d34/d6f/c7d 145779 1 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:4/435: fsync d0/f1a 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/392: fsync d6/db/d34/d41/f5e 0 2024-04-26T21:08:01.472 INFO:tasks.workunit.client.1.smithi064.stdout:7/393: chown d6/db 25696 1 2024-04-26T21:08:01.478 INFO:tasks.workunit.client.0.smithi055.stdout:7/217: rmdir d5/d6/d39 39 2024-04-26T21:08:01.485 INFO:tasks.workunit.client.1.smithi064.stdout:6/331: rename d4/d7/d12/d49/d4b/d5a/c67 to d4/d7/d12/d49/d4b/c6a 0 2024-04-26T21:08:01.485 INFO:tasks.workunit.client.1.smithi064.stdout:3/352: dread d1/d14/f31 [0,4194304] 0 2024-04-26T21:08:01.485 INFO:tasks.workunit.client.1.smithi064.stdout:3/353: readlink d1/d27/d50/l3f 0 2024-04-26T21:08:01.486 INFO:tasks.workunit.client.1.smithi064.stdout:3/354: read d1/d14/f3e [18668,45305] 0 2024-04-26T21:08:01.487 INFO:tasks.workunit.client.1.smithi064.stdout:3/355: fsync d1/d27/d29/f67 0 2024-04-26T21:08:01.487 INFO:tasks.workunit.client.1.smithi064.stdout:3/356: fsync d1/d27/d50/f5b 0 2024-04-26T21:08:01.488 INFO:tasks.workunit.client.0.smithi055.stdout:5/138: dread d4/df/d13/f21 [4194304,4194304] 0 2024-04-26T21:08:01.488 INFO:tasks.workunit.client.0.smithi055.stdout:8/163: creat d3/d9/f39 x:0 0 0 2024-04-26T21:08:01.488 INFO:tasks.workunit.client.0.smithi055.stdout:2/225: rename f2 to d4/db/d26/f4d 0 2024-04-26T21:08:01.488 INFO:tasks.workunit.client.0.smithi055.stdout:8/164: dread - d3/d9/d1f/f32 zero size 2024-04-26T21:08:01.489 INFO:tasks.workunit.client.1.smithi064.stdout:1/464: rename d0/d22/f30 to d0/d6/d11/d1e/d2a/d34/f8e 0 2024-04-26T21:08:01.493 INFO:tasks.workunit.client.0.smithi055.stdout:5/139: truncate d4/df/d13/f22 1875113 0 2024-04-26T21:08:01.495 INFO:tasks.workunit.client.1.smithi064.stdout:3/357: creat d1/d12/d7d/f81 x:0 0 0 2024-04-26T21:08:01.496 INFO:tasks.workunit.client.0.smithi055.stdout:8/165: link c0 d3/d9/d1d/c3a 0 2024-04-26T21:08:01.499 INFO:tasks.workunit.client.1.smithi064.stdout:7/394: write d6/d15/d1c/f2e [1343205,28539] 0 2024-04-26T21:08:01.500 INFO:tasks.workunit.client.1.smithi064.stdout:5/363: rename dd/d12/d18/l58 to dd/d12/d18/d25/l70 0 2024-04-26T21:08:01.500 INFO:tasks.workunit.client.1.smithi064.stdout:6/332: rename d4/d7 to d4/d7/d12/d49/d4b/d6b 22 2024-04-26T21:08:01.500 INFO:tasks.workunit.client.1.smithi064.stdout:5/364: truncate dd/d12/f3f 919037 0 2024-04-26T21:08:01.500 INFO:tasks.workunit.client.1.smithi064.stdout:6/333: dread - d4/d7/d12/d38/f61 zero size 2024-04-26T21:08:01.501 INFO:tasks.workunit.client.0.smithi055.stdout:2/226: creat d4/d14/d17/d36/f4e x:0 0 0 2024-04-26T21:08:01.501 INFO:tasks.workunit.client.0.smithi055.stdout:2/227: creat d4/d1e/f4f x:0 0 0 2024-04-26T21:08:01.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:01 smithi055 ceph-mon[25475]: pgmap v33: 65 pgs: 65 active+clean; 722 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 72 MiB/s rd, 80 MiB/s wr, 314 op/s 2024-04-26T21:08:01.508 INFO:tasks.workunit.client.0.smithi055.stdout:9/196: dwrite d2/f3f [0,4194304] 0 2024-04-26T21:08:01.509 INFO:tasks.workunit.client.0.smithi055.stdout:9/197: chown d2/f13 18 1 2024-04-26T21:08:01.509 INFO:tasks.workunit.client.0.smithi055.stdout:9/198: write d2/d14/d33/f45 [122052,19135] 0 2024-04-26T21:08:01.510 INFO:tasks.workunit.client.0.smithi055.stdout:9/199: read - d2/d11/f1f zero size 2024-04-26T21:08:01.511 INFO:tasks.workunit.client.1.smithi064.stdout:1/465: rename d0/d6/d29/d31/f7f to d0/d6/f8f 0 2024-04-26T21:08:01.512 INFO:tasks.workunit.client.0.smithi055.stdout:8/166: creat d3/d9/f3b x:0 0 0 2024-04-26T21:08:01.518 INFO:tasks.workunit.client.1.smithi064.stdout:1/466: write d0/d6/d11/d1e/d27/f50 [304683,122801] 0 2024-04-26T21:08:01.521 INFO:tasks.workunit.client.1.smithi064.stdout:2/387: dwrite d12/f78 [0,4194304] 0 2024-04-26T21:08:01.522 INFO:tasks.workunit.client.1.smithi064.stdout:5/365: dread dd/d12/d18/d1a/d1f/d20/f44 [0,4194304] 0 2024-04-26T21:08:01.524 INFO:tasks.workunit.client.0.smithi055.stdout:7/218: dread d5/d6/d24/f38 [0,4194304] 0 2024-04-26T21:08:01.524 INFO:tasks.workunit.client.0.smithi055.stdout:7/219: dread - d5/d6/f34 zero size 2024-04-26T21:08:01.526 INFO:tasks.workunit.client.1.smithi064.stdout:0/342: dwrite dd/d10/d1a/d31/d47/d61/d42/f5b [0,4194304] 0 2024-04-26T21:08:01.527 INFO:tasks.workunit.client.1.smithi064.stdout:6/334: dread d4/d7/d12/f14 [4194304,4194304] 0 2024-04-26T21:08:01.528 INFO:tasks.workunit.client.0.smithi055.stdout:2/228: creat d4/d49/f50 x:0 0 0 2024-04-26T21:08:01.532 INFO:tasks.workunit.client.0.smithi055.stdout:0/273: dwrite d9/d27/f42 [0,4194304] 0 2024-04-26T21:08:01.533 INFO:tasks.workunit.client.1.smithi064.stdout:2/388: dread d12/d28/d3a/f58 [0,4194304] 0 2024-04-26T21:08:01.534 INFO:tasks.workunit.client.0.smithi055.stdout:8/167: read d3/d9/d1f/f27 [2849222,30688] 0 2024-04-26T21:08:01.545 INFO:tasks.workunit.client.1.smithi064.stdout:4/436: dwrite d0/d5/d3e/d54/f5f [0,4194304] 0 2024-04-26T21:08:01.545 INFO:tasks.workunit.client.1.smithi064.stdout:1/467: symlink d0/d22/l90 0 2024-04-26T21:08:01.546 INFO:tasks.workunit.client.0.smithi055.stdout:2/229: mkdir d4/db/d1f/d46/d51 0 2024-04-26T21:08:01.546 INFO:tasks.workunit.client.0.smithi055.stdout:9/200: creat d2/d46/f48 x:0 0 0 2024-04-26T21:08:01.546 INFO:tasks.workunit.client.0.smithi055.stdout:6/216: dwrite d3/d17/f29 [0,4194304] 0 2024-04-26T21:08:01.550 INFO:tasks.workunit.client.1.smithi064.stdout:6/335: rmdir d4/d7/d12/d49/d4b 39 2024-04-26T21:08:01.550 INFO:tasks.workunit.client.1.smithi064.stdout:2/389: getdents d12/d28/d3a/d46/d48/d85/d29/d43 0 2024-04-26T21:08:01.550 INFO:tasks.workunit.client.1.smithi064.stdout:2/390: chown d12/d28/d3a/d46/d48 37306 1 2024-04-26T21:08:01.551 INFO:tasks.workunit.client.1.smithi064.stdout:2/391: write d12/f34 [2461903,110458] 0 2024-04-26T21:08:01.551 INFO:tasks.workunit.client.1.smithi064.stdout:2/392: chown d12/d28/f3f 650189052 1 2024-04-26T21:08:01.554 INFO:tasks.workunit.client.1.smithi064.stdout:0/343: write dd/d10/d18/f49 [5914742,389] 0 2024-04-26T21:08:01.555 INFO:tasks.workunit.client.1.smithi064.stdout:0/344: fdatasync dd/d10/f16 0 2024-04-26T21:08:01.559 INFO:tasks.workunit.client.1.smithi064.stdout:4/437: rmdir d0/d5/d3e/d54 39 2024-04-26T21:08:01.559 INFO:tasks.workunit.client.1.smithi064.stdout:4/438: chown d0/d5/d13/d33 1000 0 2024-04-26T21:08:01.560 INFO:tasks.workunit.client.0.smithi055.stdout:7/220: dread d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:01.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/201: symlink d2/d14/d33/l49 0 2024-04-26T21:08:01.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/202: write d2/f1c [22827,72364] 0 2024-04-26T21:08:01.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/203: write d2/d11/f1f [227483,101685] 0 2024-04-26T21:08:01.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/204: creat d2/d14/d33/f4a x:0 0 0 2024-04-26T21:08:01.565 INFO:tasks.workunit.client.0.smithi055.stdout:7/221: read d5/db/f1e [721169,51341] 0 2024-04-26T21:08:01.565 INFO:tasks.workunit.client.0.smithi055.stdout:7/222: chown d5/d6/f34 6 1 2024-04-26T21:08:01.565 INFO:tasks.workunit.client.0.smithi055.stdout:7/223: chown d5/d6/d24/f30 22783768 1 2024-04-26T21:08:01.565 INFO:tasks.workunit.client.0.smithi055.stdout:6/217: mknod d3/d17/d19/d20/d3e/c45 0 2024-04-26T21:08:01.566 INFO:tasks.workunit.client.1.smithi064.stdout:2/393: mkdir d12/d88 0 2024-04-26T21:08:01.568 INFO:tasks.workunit.client.1.smithi064.stdout:0/345: link fc dd/f67 0 2024-04-26T21:08:01.568 INFO:tasks.workunit.client.1.smithi064.stdout:0/346: read dd/d21/f36 [4692611,53367] 0 2024-04-26T21:08:01.574 INFO:tasks.workunit.client.1.smithi064.stdout:4/439: truncate d0/d1d/d56/f65 2386151 0 2024-04-26T21:08:01.575 INFO:tasks.workunit.client.0.smithi055.stdout:6/218: mkdir d3/d17/d46 0 2024-04-26T21:08:01.576 INFO:tasks.workunit.client.1.smithi064.stdout:1/468: write d0/d6/d11/d1e/d2a/d34/f79 [476566,67617] 0 2024-04-26T21:08:01.576 INFO:tasks.workunit.client.1.smithi064.stdout:1/469: chown d0/d6/d11/d1e/d27/f50 1340 1 2024-04-26T21:08:01.583 INFO:tasks.workunit.client.1.smithi064.stdout:7/395: dwrite d6/d5a/f3b [0,4194304] 0 2024-04-26T21:08:01.583 INFO:tasks.workunit.client.1.smithi064.stdout:4/440: mknod d0/d5/d13/d10/c90 0 2024-04-26T21:08:01.583 INFO:tasks.workunit.client.0.smithi055.stdout:9/205: getdents d2 0 2024-04-26T21:08:01.583 INFO:tasks.workunit.client.0.smithi055.stdout:9/206: chown d2/c3c 3 1 2024-04-26T21:08:01.587 INFO:tasks.workunit.client.1.smithi064.stdout:1/470: mkdir d0/d6/d91 0 2024-04-26T21:08:01.589 INFO:tasks.workunit.client.1.smithi064.stdout:7/396: mkdir d6/d15/d88 0 2024-04-26T21:08:01.591 INFO:tasks.workunit.client.1.smithi064.stdout:4/441: symlink d0/d1d/d56/d89/l91 0 2024-04-26T21:08:01.595 INFO:tasks.workunit.client.1.smithi064.stdout:4/442: write d0/ff [4410989,109526] 0 2024-04-26T21:08:01.595 INFO:tasks.workunit.client.1.smithi064.stdout:1/471: mkdir d0/d6/d91/d92 0 2024-04-26T21:08:01.595 INFO:tasks.workunit.client.1.smithi064.stdout:1/472: chown d0/d6/d11/d1e/f4f 14765 1 2024-04-26T21:08:01.595 INFO:tasks.workunit.client.1.smithi064.stdout:4/443: dread - d0/d1d/d56/f8b zero size 2024-04-26T21:08:01.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/473: mknod d0/d6/d29/c93 0 2024-04-26T21:08:01.601 INFO:tasks.workunit.client.1.smithi064.stdout:4/444: rename d0/d5/d13/cd to d0/d2f/d7d/c92 0 2024-04-26T21:08:01.604 INFO:tasks.workunit.client.1.smithi064.stdout:4/445: mkdir d0/d1d/d17/d93 0 2024-04-26T21:08:01.604 INFO:tasks.workunit.client.1.smithi064.stdout:4/446: readlink d0/d1d/l8d 0 2024-04-26T21:08:01.604 INFO:tasks.workunit.client.1.smithi064.stdout:4/447: dread - d0/d5/d79/f80 zero size 2024-04-26T21:08:01.608 INFO:tasks.workunit.client.1.smithi064.stdout:5/366: dwrite dd/d12/d18/d33/d48/d56/f62 [0,4194304] 0 2024-04-26T21:08:01.608 INFO:tasks.workunit.client.1.smithi064.stdout:5/367: chown dd/d12/d18/d1a/d1f/d20/f2d 252 1 2024-04-26T21:08:01.608 INFO:tasks.workunit.client.1.smithi064.stdout:4/448: getdents d0/d2f 0 2024-04-26T21:08:01.610 INFO:tasks.workunit.client.1.smithi064.stdout:1/474: dread d0/d22/f2b [0,4194304] 0 2024-04-26T21:08:01.611 INFO:tasks.workunit.client.1.smithi064.stdout:1/475: chown d0/d6/d11/l6f 376719574 1 2024-04-26T21:08:01.611 INFO:tasks.workunit.client.1.smithi064.stdout:1/476: write d0/f12 [237768,20922] 0 2024-04-26T21:08:01.611 INFO:tasks.workunit.client.1.smithi064.stdout:2/394: dread d12/f24 [0,4194304] 0 2024-04-26T21:08:01.615 INFO:tasks.workunit.client.1.smithi064.stdout:1/477: creat d0/d6/d91/f94 x:0 0 0 2024-04-26T21:08:01.615 INFO:tasks.workunit.client.1.smithi064.stdout:5/368: rmdir dd/d12/d4f 39 2024-04-26T21:08:01.618 INFO:tasks.workunit.client.1.smithi064.stdout:1/478: mknod d0/d6/d29/d31/c95 0 2024-04-26T21:08:01.619 INFO:tasks.workunit.client.0.smithi055.stdout:0/274: dwrite d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:01.620 INFO:tasks.workunit.client.0.smithi055.stdout:9/207: dread d2/f1c [0,4194304] 0 2024-04-26T21:08:01.621 INFO:tasks.workunit.client.1.smithi064.stdout:1/479: rename d0/d6/d11/f18 to d0/d6/d11/d1e/d2a/d34/d57/f96 0 2024-04-26T21:08:01.623 INFO:tasks.workunit.client.0.smithi055.stdout:0/275: mkdir d9/d11/d5b/d5e 0 2024-04-26T21:08:01.623 INFO:tasks.workunit.client.0.smithi055.stdout:0/276: creat d9/dc/d17/f5f x:0 0 0 2024-04-26T21:08:01.626 INFO:tasks.workunit.client.0.smithi055.stdout:5/140: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:08:01.627 INFO:tasks.workunit.client.1.smithi064.stdout:1/480: creat d0/d6/dd/f97 x:0 0 0 2024-04-26T21:08:01.627 INFO:tasks.workunit.client.1.smithi064.stdout:1/481: readlink d0/l3e 0 2024-04-26T21:08:01.628 INFO:tasks.workunit.client.0.smithi055.stdout:8/168: dread d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:01.634 INFO:tasks.workunit.client.0.smithi055.stdout:2/230: dwrite d4/d14/d33/f4b [0,4194304] 0 2024-04-26T21:08:01.639 INFO:tasks.workunit.client.1.smithi064.stdout:1/482: rename d0/d6/d11/d1e/l32 to d0/d6/d29/l98 0 2024-04-26T21:08:01.646 INFO:tasks.workunit.client.0.smithi055.stdout:8/169: symlink d3/d9/d1d/l3c 0 2024-04-26T21:08:01.649 INFO:tasks.workunit.client.0.smithi055.stdout:9/208: dread d2/d14/d33/f45 [0,4194304] 0 2024-04-26T21:08:01.650 INFO:tasks.workunit.client.0.smithi055.stdout:9/209: read d2/f1a [580363,125088] 0 2024-04-26T21:08:01.650 INFO:tasks.workunit.client.0.smithi055.stdout:9/210: readlink d2/d11/l2c 0 2024-04-26T21:08:01.652 INFO:tasks.workunit.client.1.smithi064.stdout:1/483: unlink d0/d6/d11/d1e/l61 0 2024-04-26T21:08:01.653 INFO:tasks.workunit.client.1.smithi064.stdout:1/484: write d0/d6/d11/d1e/d27/f2d [2320796,89735] 0 2024-04-26T21:08:01.656 INFO:tasks.workunit.client.0.smithi055.stdout:1/202: sync 2024-04-26T21:08:01.659 INFO:tasks.workunit.client.1.smithi064.stdout:1/485: truncate d0/d22/d87/f88 8275424 0 2024-04-26T21:08:01.659 INFO:tasks.workunit.client.1.smithi064.stdout:1/486: chown d0/d6/d11/f5e 8290 1 2024-04-26T21:08:01.660 INFO:tasks.workunit.client.1.smithi064.stdout:9/387: sync 2024-04-26T21:08:01.660 INFO:tasks.workunit.client.1.smithi064.stdout:9/388: read d0/d4/da/d26/d47/d6b/f70 [1701569,1333] 0 2024-04-26T21:08:01.660 INFO:tasks.workunit.client.1.smithi064.stdout:9/389: write d0/d4/f53 [700344,83525] 0 2024-04-26T21:08:01.660 INFO:tasks.workunit.client.0.smithi055.stdout:6/219: dwrite d3/d17/d19/f3d [0,4194304] 0 2024-04-26T21:08:01.664 INFO:tasks.workunit.client.1.smithi064.stdout:7/397: dwrite d6/db/d1f/f4c [0,4194304] 0 2024-04-26T21:08:01.664 INFO:tasks.workunit.client.1.smithi064.stdout:7/398: fsync d6/d15/d1c/f25 0 2024-04-26T21:08:01.664 INFO:tasks.workunit.client.1.smithi064.stdout:7/399: stat d6/d9/d38/f42 0 2024-04-26T21:08:01.666 INFO:tasks.workunit.client.0.smithi055.stdout:3/265: sync 2024-04-26T21:08:01.666 INFO:tasks.workunit.client.0.smithi055.stdout:3/266: creat d0/d4/f64 x:0 0 0 2024-04-26T21:08:01.666 INFO:tasks.workunit.client.0.smithi055.stdout:4/136: sync 2024-04-26T21:08:01.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/390: link d0/d4/da/f5b d0/d4/da/d26/d45/f7d 0 2024-04-26T21:08:01.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/391: stat d0/f59 0 2024-04-26T21:08:01.674 INFO:tasks.workunit.client.0.smithi055.stdout:8/170: dread d3/d9/d1d/f25 [4194304,4194304] 0 2024-04-26T21:08:01.677 INFO:tasks.workunit.client.1.smithi064.stdout:3/358: sync 2024-04-26T21:08:01.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/319: sync 2024-04-26T21:08:01.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/320: read d10/f12 [3102746,106338] 0 2024-04-26T21:08:01.678 INFO:tasks.workunit.client.0.smithi055.stdout:9/211: dread d2/f8 [0,4194304] 0 2024-04-26T21:08:01.686 INFO:tasks.workunit.client.0.smithi055.stdout:7/224: dwrite d5/d11/f17 [0,4194304] 0 2024-04-26T21:08:01.686 INFO:tasks.workunit.client.0.smithi055.stdout:7/225: fdatasync d5/f32 0 2024-04-26T21:08:01.687 INFO:tasks.workunit.client.1.smithi064.stdout:9/392: symlink d0/d4/da/d26/d47/d6b/l7e 0 2024-04-26T21:08:01.687 INFO:tasks.workunit.client.1.smithi064.stdout:5/369: write dd/d12/d18/d1a/d1b/f52 [3641985,84847] 0 2024-04-26T21:08:01.695 INFO:tasks.workunit.client.1.smithi064.stdout:3/359: rename d1/d14/d60 to d1/d27/d50/d35/d4c/d7b/d82 0 2024-04-26T21:08:01.696 INFO:tasks.workunit.client.0.smithi055.stdout:5/141: truncate d4/f6 5543539 0 2024-04-26T21:08:01.699 INFO:tasks.workunit.client.1.smithi064.stdout:9/393: symlink d0/l7f 0 2024-04-26T21:08:01.700 INFO:tasks.workunit.client.0.smithi055.stdout:1/203: stat d8/df/d11/d27/d28/d3d/l43 0 2024-04-26T21:08:01.700 INFO:tasks.workunit.client.0.smithi055.stdout:1/204: chown l3 5 1 2024-04-26T21:08:01.702 INFO:tasks.workunit.client.1.smithi064.stdout:5/370: mknod dd/d12/d18/d1a/d1f/d20/c71 0 2024-04-26T21:08:01.702 INFO:tasks.workunit.client.1.smithi064.stdout:5/371: creat dd/d12/d18/d33/d48/f72 x:0 0 0 2024-04-26T21:08:01.705 INFO:tasks.workunit.client.0.smithi055.stdout:0/277: rmdir d9 39 2024-04-26T21:08:01.705 INFO:tasks.workunit.client.0.smithi055.stdout:0/278: truncate d9/dc/f57 205255 0 2024-04-26T21:08:01.710 INFO:tasks.workunit.client.1.smithi064.stdout:1/487: write d0/d6/d11/d2c/f47 [1338177,52215] 0 2024-04-26T21:08:01.710 INFO:tasks.workunit.client.1.smithi064.stdout:1/488: write d0/d6/d11/d1e/d2a/f5b [860343,119260] 0 2024-04-26T21:08:01.710 INFO:tasks.workunit.client.1.smithi064.stdout:0/347: dwrite dd/d21/f36 [4194304,4194304] 0 2024-04-26T21:08:01.710 INFO:tasks.workunit.client.1.smithi064.stdout:5/372: mkdir dd/d12/d4f/d64/d73 0 2024-04-26T21:08:01.711 INFO:tasks.workunit.client.0.smithi055.stdout:3/267: unlink d0/de/f17 0 2024-04-26T21:08:01.711 INFO:tasks.workunit.client.1.smithi064.stdout:4/449: dwrite d0/d1d/f49 [0,4194304] 0 2024-04-26T21:08:01.713 INFO:tasks.workunit.client.1.smithi064.stdout:7/400: dwrite d6/d9/d38/f42 [0,4194304] 0 2024-04-26T21:08:01.714 INFO:tasks.workunit.client.1.smithi064.stdout:7/401: creat d6/d15/d67/d78/f89 x:0 0 0 2024-04-26T21:08:01.714 INFO:tasks.workunit.client.1.smithi064.stdout:7/402: read - d6/d70/d74/f85 zero size 2024-04-26T21:08:01.720 INFO:tasks.workunit.client.1.smithi064.stdout:1/489: mknod d0/d6/dd/c99 0 2024-04-26T21:08:01.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/348: creat dd/d1c/f68 x:0 0 0 2024-04-26T21:08:01.727 INFO:tasks.workunit.client.0.smithi055.stdout:7/226: rename d5/db/c20 to d5/d11/c3f 0 2024-04-26T21:08:01.727 INFO:tasks.workunit.client.0.smithi055.stdout:7/227: chown f1 194 1 2024-04-26T21:08:01.729 INFO:tasks.workunit.client.0.smithi055.stdout:5/142: stat d4/f10 0 2024-04-26T21:08:01.729 INFO:tasks.workunit.client.1.smithi064.stdout:5/373: mkdir dd/d12/d18/d25/d74 0 2024-04-26T21:08:01.730 INFO:tasks.workunit.client.0.smithi055.stdout:1/205: truncate d8/df/d11/f37 555365 0 2024-04-26T21:08:01.732 INFO:tasks.workunit.client.1.smithi064.stdout:4/450: link d0/d5/d13/d33/f86 d0/d2f/d7d/f94 0 2024-04-26T21:08:01.732 INFO:tasks.workunit.client.1.smithi064.stdout:4/451: stat d0/d5/d13/d6d/f64 0 2024-04-26T21:08:01.732 INFO:tasks.workunit.client.1.smithi064.stdout:4/452: dread - d0/d1d/d56/d89/f8f zero size 2024-04-26T21:08:01.733 INFO:tasks.workunit.client.1.smithi064.stdout:4/453: chown d0/d1d/d17/d44/d45/f88 1475 1 2024-04-26T21:08:01.734 INFO:tasks.workunit.client.0.smithi055.stdout:9/212: dwrite d2/d14/f43 [0,4194304] 0 2024-04-26T21:08:01.735 INFO:tasks.workunit.client.0.smithi055.stdout:0/279: creat d9/dc/d1c/d3b/f60 x:0 0 0 2024-04-26T21:08:01.740 INFO:tasks.workunit.client.1.smithi064.stdout:7/403: creat d6/d9/d77/f8a x:0 0 0 2024-04-26T21:08:01.745 INFO:tasks.workunit.client.1.smithi064.stdout:0/349: write dd/d10/d1a/d31/f4b [1478046,2807] 0 2024-04-26T21:08:01.746 INFO:tasks.workunit.client.1.smithi064.stdout:3/360: dwrite d1/d38/f47 [0,4194304] 0 2024-04-26T21:08:01.746 INFO:tasks.workunit.client.0.smithi055.stdout:6/220: getdents d3 0 2024-04-26T21:08:01.748 INFO:tasks.workunit.client.0.smithi055.stdout:3/268: symlink d0/d1/d13/d1a/d46/d51/l65 0 2024-04-26T21:08:01.748 INFO:tasks.workunit.client.0.smithi055.stdout:3/269: truncate d0/d4/f64 243450 0 2024-04-26T21:08:01.749 INFO:tasks.workunit.client.1.smithi064.stdout:1/490: creat d0/d6/d11/d1e/f9a x:0 0 0 2024-04-26T21:08:01.750 INFO:tasks.workunit.client.0.smithi055.stdout:8/171: link d3/c6 d3/d9/d1d/c3d 0 2024-04-26T21:08:01.752 INFO:tasks.workunit.client.0.smithi055.stdout:7/228: mknod d5/d6/c40 0 2024-04-26T21:08:01.752 INFO:tasks.workunit.client.0.smithi055.stdout:7/229: creat d5/d6/f41 x:0 0 0 2024-04-26T21:08:01.754 INFO:tasks.workunit.client.0.smithi055.stdout:5/143: stat d4/f11 0 2024-04-26T21:08:01.754 INFO:tasks.workunit.client.1.smithi064.stdout:4/454: truncate d0/d1d/d17/f25 1387791 0 2024-04-26T21:08:01.755 INFO:tasks.workunit.client.1.smithi064.stdout:0/350: creat dd/d10/d1a/d31/d47/d61/f69 x:0 0 0 2024-04-26T21:08:01.756 INFO:tasks.workunit.client.1.smithi064.stdout:1/491: dread d0/d6/d11/d1e/f46 [0,4194304] 0 2024-04-26T21:08:01.756 INFO:tasks.workunit.client.0.smithi055.stdout:1/206: symlink d8/df/l48 0 2024-04-26T21:08:01.761 INFO:tasks.workunit.client.0.smithi055.stdout:9/213: creat d2/d11/f4b x:0 0 0 2024-04-26T21:08:01.761 INFO:tasks.workunit.client.0.smithi055.stdout:8/172: dread d3/f14 [0,4194304] 0 2024-04-26T21:08:01.765 INFO:tasks.workunit.client.0.smithi055.stdout:0/280: unlink f8 0 2024-04-26T21:08:01.765 INFO:tasks.workunit.client.0.smithi055.stdout:0/281: dread - d9/dc/d17/f5f zero size 2024-04-26T21:08:01.767 INFO:tasks.workunit.client.0.smithi055.stdout:6/221: truncate f1 91985 0 2024-04-26T21:08:01.772 INFO:tasks.workunit.client.0.smithi055.stdout:3/270: mknod d0/d1/d47/c66 0 2024-04-26T21:08:01.773 INFO:tasks.workunit.client.0.smithi055.stdout:3/271: chown d0/d1/l32 197 1 2024-04-26T21:08:01.777 INFO:tasks.workunit.client.1.smithi064.stdout:6/336: sync 2024-04-26T21:08:01.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/492: write d0/d6/d11/f23 [676077,42577] 0 2024-04-26T21:08:01.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/493: stat d0/d22/c25 0 2024-04-26T21:08:01.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/494: dread - d0/d6/d11/d1e/f9a zero size 2024-04-26T21:08:01.782 INFO:tasks.workunit.client.1.smithi064.stdout:0/351: mknod dd/d1c/d1d/c6a 0 2024-04-26T21:08:01.782 INFO:tasks.workunit.client.1.smithi064.stdout:0/352: chown dd/d10/d1a/d31/d5c/l62 189 1 2024-04-26T21:08:01.782 INFO:tasks.workunit.client.1.smithi064.stdout:5/374: dwrite dd/d12/d18/f36 [0,4194304] 0 2024-04-26T21:08:01.783 INFO:tasks.workunit.client.1.smithi064.stdout:5/375: chown dd/d12/d18/d1a/d1b 6408 1 2024-04-26T21:08:01.785 INFO:tasks.workunit.client.0.smithi055.stdout:5/144: write d4/f8 [1377055,64609] 0 2024-04-26T21:08:01.787 INFO:tasks.workunit.client.0.smithi055.stdout:9/214: dread d2/f13 [0,4194304] 0 2024-04-26T21:08:01.788 INFO:tasks.workunit.client.0.smithi055.stdout:9/215: read - d2/d14/d33/f37 zero size 2024-04-26T21:08:01.792 INFO:tasks.workunit.client.0.smithi055.stdout:7/230: unlink d5/d6/f34 0 2024-04-26T21:08:01.792 INFO:tasks.workunit.client.0.smithi055.stdout:7/231: read - d5/d6/d24/f27 zero size 2024-04-26T21:08:01.792 INFO:tasks.workunit.client.1.smithi064.stdout:6/337: rmdir d4/d7/d12/d49/d4b 39 2024-04-26T21:08:01.795 INFO:tasks.workunit.client.0.smithi055.stdout:1/207: mknod d8/d17/d1b/d41/c49 0 2024-04-26T21:08:01.801 INFO:tasks.workunit.client.0.smithi055.stdout:0/282: creat d9/dc/d17/f61 x:0 0 0 2024-04-26T21:08:01.802 INFO:tasks.workunit.client.1.smithi064.stdout:1/495: mkdir d0/d6/d11/d1e/d2a/d34/d57/d9b 0 2024-04-26T21:08:01.802 INFO:tasks.workunit.client.1.smithi064.stdout:1/496: stat d0/d6/dd/f5c 0 2024-04-26T21:08:01.803 INFO:tasks.workunit.client.0.smithi055.stdout:6/222: creat d3/d17/d25/f47 x:0 0 0 2024-04-26T21:08:01.803 INFO:tasks.workunit.client.0.smithi055.stdout:6/223: getdents d3/d17/d46 0 2024-04-26T21:08:01.803 INFO:tasks.workunit.client.0.smithi055.stdout:6/224: rename d3/d17/d19 to d3/d17/d19/d20/d3e/d48 22 2024-04-26T21:08:01.803 INFO:tasks.workunit.client.0.smithi055.stdout:6/225: write d3/d17/d25/f47 [274052,23693] 0 2024-04-26T21:08:01.806 INFO:tasks.workunit.client.1.smithi064.stdout:0/353: mknod dd/d10/d18/d58/c6b 0 2024-04-26T21:08:01.806 INFO:tasks.workunit.client.1.smithi064.stdout:0/354: dread - dd/d10/d1a/d31/d47/d61/d42/f51 zero size 2024-04-26T21:08:01.807 INFO:tasks.workunit.client.1.smithi064.stdout:5/376: symlink dd/d12/d18/d25/l75 0 2024-04-26T21:08:01.809 INFO:tasks.workunit.client.0.smithi055.stdout:3/272: creat d0/d4/d16/d18/d4b/d57/f67 x:0 0 0 2024-04-26T21:08:01.809 INFO:tasks.workunit.client.0.smithi055.stdout:3/273: write d0/d1/d13/d1a/f54 [970368,75930] 0 2024-04-26T21:08:01.809 INFO:tasks.workunit.client.1.smithi064.stdout:0/355: dread dd/f67 [4194304,4194304] 0 2024-04-26T21:08:01.813 INFO:tasks.workunit.client.0.smithi055.stdout:9/216: symlink d2/d14/d33/l4c 0 2024-04-26T21:08:01.813 INFO:tasks.workunit.client.0.smithi055.stdout:9/217: truncate d2/d46/f48 455212 0 2024-04-26T21:08:01.814 INFO:tasks.workunit.client.0.smithi055.stdout:9/218: truncate d2/d11/f2f 402301 0 2024-04-26T21:08:01.814 INFO:tasks.workunit.client.0.smithi055.stdout:9/219: chown d2/d11/l35 33425673 1 2024-04-26T21:08:01.815 INFO:tasks.workunit.client.0.smithi055.stdout:5/145: creat d4/df/d13/d26/d28/f2c x:0 0 0 2024-04-26T21:08:01.815 INFO:tasks.workunit.client.0.smithi055.stdout:7/232: creat d5/d6/d24/d3b/f42 x:0 0 0 2024-04-26T21:08:01.818 INFO:tasks.workunit.client.0.smithi055.stdout:0/283: symlink d9/dc/d17/l62 0 2024-04-26T21:08:01.818 INFO:tasks.workunit.client.0.smithi055.stdout:0/284: chown d9/d11/d5b/d5e 910 1 2024-04-26T21:08:01.818 INFO:tasks.workunit.client.0.smithi055.stdout:0/285: chown d9/dc/d1c/d54/d4b/l5c 93269 1 2024-04-26T21:08:01.818 INFO:tasks.workunit.client.1.smithi064.stdout:6/338: mknod d4/d7/d12/d1e/c6c 0 2024-04-26T21:08:01.819 INFO:tasks.workunit.client.0.smithi055.stdout:6/226: link d3/d17/d19/d20/d3e/f44 d3/d17/d19/f49 0 2024-04-26T21:08:01.822 INFO:tasks.workunit.client.1.smithi064.stdout:1/497: truncate d0/d6/d11/d1e/f54 3558053 0 2024-04-26T21:08:01.825 INFO:tasks.workunit.client.1.smithi064.stdout:5/377: mkdir dd/d12/d18/d25/d74/d76 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:9/220: mknod d2/d14/d33/c4d 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:9/221: fsync d2/f1e 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:9/222: truncate d2/d14/d33/f4a 191718 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:9/223: chown d2/f41 11538961 1 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:9/224: write d2/d14/d33/f45 [169648,127803] 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:6/227: symlink d3/d17/l4a 0 2024-04-26T21:08:01.826 INFO:tasks.workunit.client.0.smithi055.stdout:5/146: symlink d4/df/d13/d26/d28/l2d 0 2024-04-26T21:08:01.827 INFO:tasks.workunit.client.0.smithi055.stdout:0/286: mknod d9/dc/d1c/d54/c63 0 2024-04-26T21:08:01.827 INFO:tasks.workunit.client.1.smithi064.stdout:3/361: dwrite d1/d14/f6a [0,4194304] 0 2024-04-26T21:08:01.827 INFO:tasks.workunit.client.1.smithi064.stdout:0/356: dread dd/f2a [0,4194304] 0 2024-04-26T21:08:01.830 INFO:tasks.workunit.client.0.smithi055.stdout:5/147: write d4/d15/f1f [531569,80699] 0 2024-04-26T21:08:01.831 INFO:tasks.workunit.client.1.smithi064.stdout:4/455: dwrite d0/ff [0,4194304] 0 2024-04-26T21:08:01.831 INFO:tasks.workunit.client.1.smithi064.stdout:4/456: chown d0/d2f/d69/l7a 81 1 2024-04-26T21:08:01.831 INFO:tasks.workunit.client.1.smithi064.stdout:4/457: chown d0/d5/c4 14740026 1 2024-04-26T21:08:01.833 INFO:tasks.workunit.client.1.smithi064.stdout:1/498: mkdir d0/d6/d11/d2c/d9c 0 2024-04-26T21:08:01.836 INFO:tasks.workunit.client.1.smithi064.stdout:3/362: unlink d1/d27/d50/l71 0 2024-04-26T21:08:01.843 INFO:tasks.workunit.client.1.smithi064.stdout:5/378: dread dd/d12/d18/f2b [0,4194304] 0 2024-04-26T21:08:01.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/458: creat d0/d14/f95 x:0 0 0 2024-04-26T21:08:01.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/459: fdatasync d0/d5/d13/d33/f39 0 2024-04-26T21:08:01.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/460: creat d0/d1d/d56/d89/f96 x:0 0 0 2024-04-26T21:08:01.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/461: chown d0/d1d/d17/d44/d45/f75 0 1 2024-04-26T21:08:01.852 INFO:tasks.workunit.client.0.smithi055.stdout:8/173: dwrite d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:01.852 INFO:tasks.workunit.client.0.smithi055.stdout:8/174: truncate d3/d9/f2d 455972 0 2024-04-26T21:08:01.852 INFO:tasks.workunit.client.0.smithi055.stdout:8/175: read d3/d9/d1f/f27 [1799692,126679] 0 2024-04-26T21:08:01.852 INFO:tasks.workunit.client.1.smithi064.stdout:1/499: rmdir d0/d6 39 2024-04-26T21:08:01.859 INFO:tasks.workunit.client.1.smithi064.stdout:3/363: read d1/d14/f6a [1875237,104810] 0 2024-04-26T21:08:01.859 INFO:tasks.workunit.client.1.smithi064.stdout:3/364: write d1/fc [5542831,130546] 0 2024-04-26T21:08:01.865 INFO:tasks.workunit.client.1.smithi064.stdout:5/379: creat dd/d12/d18/d25/d74/d76/f77 x:0 0 0 2024-04-26T21:08:01.867 INFO:tasks.workunit.client.0.smithi055.stdout:7/233: dread d5/f29 [0,4194304] 0 2024-04-26T21:08:01.868 INFO:tasks.workunit.client.1.smithi064.stdout:6/339: write d4/d7/d33/f34 [637794,101027] 0 2024-04-26T21:08:01.868 INFO:tasks.workunit.client.1.smithi064.stdout:6/340: rename d4/d7/d12/d49/d4b to d4/d7/d12/d49/d4b/d5a/d6d 22 2024-04-26T21:08:01.875 INFO:tasks.workunit.client.1.smithi064.stdout:1/500: creat d0/d6b/f9d x:0 0 0 2024-04-26T21:08:01.879 INFO:tasks.workunit.client.0.smithi055.stdout:1/208: dwrite d8/d17/f18 [0,4194304] 0 2024-04-26T21:08:01.881 INFO:tasks.workunit.client.0.smithi055.stdout:6/228: dread d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:01.883 INFO:tasks.workunit.client.1.smithi064.stdout:3/365: creat d1/d27/d50/d35/d4c/f83 x:0 0 0 2024-04-26T21:08:01.889 INFO:tasks.workunit.client.0.smithi055.stdout:7/234: truncate d5/d11/f2f 4278462 0 2024-04-26T21:08:01.889 INFO:tasks.workunit.client.0.smithi055.stdout:3/274: dwrite d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:01.889 INFO:tasks.workunit.client.0.smithi055.stdout:3/275: creat d0/f68 x:0 0 0 2024-04-26T21:08:01.889 INFO:tasks.workunit.client.0.smithi055.stdout:8/176: write d3/d9/f24 [331407,16053] 0 2024-04-26T21:08:01.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/341: link d4/d7/d33/c57 d4/d7/d12/d49/d4b/c6e 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.1.smithi064.stdout:6/342: creat d4/d7/d33/f6f x:0 0 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.1.smithi064.stdout:6/343: stat d4/d7/d12/d1e/c6c 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.0.smithi055.stdout:9/225: dwrite d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.0.smithi055.stdout:0/287: dwrite d9/dc/d1c/d3e/f47 [0,4194304] 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.0.smithi055.stdout:0/288: fsync d9/fa 0 2024-04-26T21:08:01.896 INFO:tasks.workunit.client.0.smithi055.stdout:9/226: truncate d2/f3f 5213816 0 2024-04-26T21:08:01.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/209: creat d8/df/d11/d27/d28/f4a x:0 0 0 2024-04-26T21:08:01.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/210: chown d8/d17/c3e 208790297 1 2024-04-26T21:08:01.900 INFO:tasks.workunit.client.0.smithi055.stdout:1/211: write d8/df/d11/d27/f3a [517639,111698] 0 2024-04-26T21:08:01.903 INFO:tasks.workunit.client.1.smithi064.stdout:6/344: dread d4/d7/d12/d38/f3c [0,4194304] 0 2024-04-26T21:08:01.904 INFO:tasks.workunit.client.0.smithi055.stdout:7/235: write d5/d11/f1a [5627922,49071] 0 2024-04-26T21:08:01.904 INFO:tasks.workunit.client.0.smithi055.stdout:7/236: truncate d5/d6/d24/f27 802671 0 2024-04-26T21:08:01.904 INFO:tasks.workunit.client.1.smithi064.stdout:3/366: mkdir d1/d27/d29/d6f/d72/d7a/d84 0 2024-04-26T21:08:01.910 INFO:tasks.workunit.client.1.smithi064.stdout:5/380: getdents dd/d12/d18/d1a/d1f/d20 0 2024-04-26T21:08:01.910 INFO:tasks.workunit.client.1.smithi064.stdout:5/381: creat dd/d12/d18/d25/d32/f78 x:0 0 0 2024-04-26T21:08:01.910 INFO:tasks.workunit.client.1.smithi064.stdout:5/382: chown dd/d12/d18/d25/c3d 10884802 1 2024-04-26T21:08:01.911 INFO:tasks.workunit.client.1.smithi064.stdout:5/383: readlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:08:01.911 INFO:tasks.workunit.client.1.smithi064.stdout:5/384: readlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:08:01.912 INFO:tasks.workunit.client.1.smithi064.stdout:2/395: sync 2024-04-26T21:08:01.915 INFO:tasks.workunit.client.1.smithi064.stdout:3/367: rename d1/d27/d50/d35/f66 to d1/d27/d29/d6f/d72/d73/f85 0 2024-04-26T21:08:01.920 INFO:tasks.workunit.client.0.smithi055.stdout:1/212: dread d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:01.920 INFO:tasks.workunit.client.0.smithi055.stdout:1/213: chown d8/df/f24 158549636 1 2024-04-26T21:08:01.921 INFO:tasks.workunit.client.1.smithi064.stdout:1/501: dread d0/d6/d29/f68 [0,4194304] 0 2024-04-26T21:08:01.922 INFO:tasks.workunit.client.1.smithi064.stdout:2/396: creat d12/d28/d3a/d46/d6a/f89 x:0 0 0 2024-04-26T21:08:01.924 INFO:tasks.workunit.client.1.smithi064.stdout:1/502: mkdir d0/d6b/d9e 0 2024-04-26T21:08:01.926 INFO:tasks.workunit.client.1.smithi064.stdout:2/397: mknod d12/d28/d3a/d46/d48/d85/d2f/c8a 0 2024-04-26T21:08:01.927 INFO:tasks.workunit.client.1.smithi064.stdout:6/345: dread d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:01.928 INFO:tasks.workunit.client.1.smithi064.stdout:1/503: truncate d0/d6/d11/d1e/d27/f2d 511067 0 2024-04-26T21:08:01.933 INFO:tasks.workunit.client.0.smithi055.stdout:3/276: mkdir d0/d1/d47/d42/d69 0 2024-04-26T21:08:01.940 INFO:tasks.workunit.client.1.smithi064.stdout:2/398: unlink d12/d28/d3a/d46/d48/d85/d2f/c8a 0 2024-04-26T21:08:01.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/504: mkdir d0/d22/d9f 0 2024-04-26T21:08:01.941 INFO:tasks.workunit.client.0.smithi055.stdout:8/177: symlink d3/d9/d1f/l3e 0 2024-04-26T21:08:01.946 INFO:tasks.workunit.client.1.smithi064.stdout:2/399: creat d12/d45/f8b x:0 0 0 2024-04-26T21:08:01.946 INFO:tasks.workunit.client.1.smithi064.stdout:2/400: chown d12/d28/d3a/d46/d6a/f89 104309 1 2024-04-26T21:08:01.948 INFO:tasks.workunit.client.1.smithi064.stdout:8/321: sync 2024-04-26T21:08:01.948 INFO:tasks.workunit.client.1.smithi064.stdout:9/394: sync 2024-04-26T21:08:01.948 INFO:tasks.workunit.client.1.smithi064.stdout:8/322: chown le 2331504 1 2024-04-26T21:08:01.948 INFO:tasks.workunit.client.1.smithi064.stdout:7/404: sync 2024-04-26T21:08:01.949 INFO:tasks.workunit.client.0.smithi055.stdout:0/289: creat d9/f64 x:0 0 0 2024-04-26T21:08:01.950 INFO:tasks.workunit.client.1.smithi064.stdout:0/357: sync 2024-04-26T21:08:01.951 INFO:tasks.workunit.client.1.smithi064.stdout:2/401: symlink d12/d28/d3a/d46/d48/d85/d2f/d53/l8c 0 2024-04-26T21:08:01.953 INFO:tasks.workunit.client.0.smithi055.stdout:9/227: mknod d2/d11/c4e 0 2024-04-26T21:08:01.955 INFO:tasks.workunit.client.1.smithi064.stdout:9/395: creat d0/d4/da/d31/f80 x:0 0 0 2024-04-26T21:08:01.955 INFO:tasks.workunit.client.1.smithi064.stdout:9/396: creat d0/d4/da/d26/d47/f81 x:0 0 0 2024-04-26T21:08:01.959 INFO:tasks.workunit.client.1.smithi064.stdout:9/397: creat d0/d4/da/d31/f82 x:0 0 0 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:6/229: rmdir d3/d17/d19/d20/d3e 39 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:2/231: sync 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:4/137: sync 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:6/230: fsync d3/d17/d25/f2b 0 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:4/138: dread - d4/f1d zero size 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:4/139: read d4/f21 [1626877,69020] 0 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.0.smithi055.stdout:4/140: chown d4/d18/d1a/l1c 4 1 2024-04-26T21:08:01.960 INFO:tasks.workunit.client.1.smithi064.stdout:8/323: creat d10/d41/d53/f64 x:0 0 0 2024-04-26T21:08:01.976 INFO:tasks.workunit.client.0.smithi055.stdout:2/232: write d4/dc/f11 [813598,85596] 0 2024-04-26T21:08:01.977 INFO:tasks.workunit.client.1.smithi064.stdout:8/324: symlink d10/d41/d4e/l65 0 2024-04-26T21:08:01.977 INFO:tasks.workunit.client.1.smithi064.stdout:8/325: stat d10/d2f/f4c 0 2024-04-26T21:08:01.980 INFO:tasks.workunit.client.0.smithi055.stdout:1/214: unlink d8/d17/f2e 0 2024-04-26T21:08:01.980 INFO:tasks.workunit.client.0.smithi055.stdout:1/215: truncate d8/f35 745737 0 2024-04-26T21:08:01.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/398: dread d0/d4/da/d26/d5d/f68 [0,4194304] 0 2024-04-26T21:08:01.981 INFO:tasks.workunit.client.0.smithi055.stdout:0/290: mknod d9/d27/c65 0 2024-04-26T21:08:01.989 INFO:tasks.workunit.client.1.smithi064.stdout:8/326: rename d10/f1b to d10/d41/d44/f66 0 2024-04-26T21:08:01.993 INFO:tasks.workunit.client.0.smithi055.stdout:7/237: getdents d5/d6/d24 0 2024-04-26T21:08:01.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/277: dwrite d0/d4/f40 [0,4194304] 0 2024-04-26T21:08:01.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/278: read d0/d4/d5/f2c [522930,103676] 0 2024-04-26T21:08:02.001 INFO:tasks.workunit.client.0.smithi055.stdout:2/233: unlink d4/d14/d17/l3b 0 2024-04-26T21:08:02.002 INFO:tasks.workunit.client.0.smithi055.stdout:2/234: read d4/db/f15 [3845016,49235] 0 2024-04-26T21:08:02.002 INFO:tasks.workunit.client.1.smithi064.stdout:7/405: dread d6/d5a/f3b [0,4194304] 0 2024-04-26T21:08:02.003 INFO:tasks.workunit.client.0.smithi055.stdout:1/216: mknod d8/d17/d36/c4b 0 2024-04-26T21:08:02.003 INFO:tasks.workunit.client.0.smithi055.stdout:6/231: getdents d3/d17 0 2024-04-26T21:08:02.004 INFO:tasks.workunit.client.0.smithi055.stdout:6/232: chown d3/d17/d19/c2f 33 1 2024-04-26T21:08:02.004 INFO:tasks.workunit.client.0.smithi055.stdout:6/233: chown d3/d17/d19/d20/d3e 0 1 2024-04-26T21:08:02.007 INFO:tasks.workunit.client.0.smithi055.stdout:7/238: mknod d5/c43 0 2024-04-26T21:08:02.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/358: write dd/f2a [993578,127675] 0 2024-04-26T21:08:02.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/359: fdatasync dd/d21/f36 0 2024-04-26T21:08:02.009 INFO:tasks.workunit.client.0.smithi055.stdout:7/239: fdatasync d5/d6/f31 0 2024-04-26T21:08:02.011 INFO:tasks.workunit.client.1.smithi064.stdout:7/406: mknod d6/d9/d3d/d43/c8b 0 2024-04-26T21:08:02.016 INFO:tasks.workunit.client.0.smithi055.stdout:3/279: mknod d0/d1/d47/d37/c6a 0 2024-04-26T21:08:02.017 INFO:tasks.workunit.client.1.smithi064.stdout:8/327: dread d10/d1d/f1e [0,4194304] 0 2024-04-26T21:08:02.019 INFO:tasks.workunit.client.0.smithi055.stdout:2/235: symlink d4/db/d1f/l52 0 2024-04-26T21:08:02.024 INFO:tasks.workunit.client.1.smithi064.stdout:8/328: link le d10/d1d/d38/l67 0 2024-04-26T21:08:02.024 INFO:tasks.workunit.client.1.smithi064.stdout:8/329: chown d10/d1d/f30 480144 1 2024-04-26T21:08:02.028 INFO:tasks.workunit.client.0.smithi055.stdout:6/234: symlink d3/l4b 0 2024-04-26T21:08:02.028 INFO:tasks.workunit.client.0.smithi055.stdout:7/240: rename d5/d11/f17 to d5/d6/d24/d3b/f44 0 2024-04-26T21:08:02.028 INFO:tasks.workunit.client.0.smithi055.stdout:7/241: dread - d5/d11/f25 zero size 2024-04-26T21:08:02.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/330: mknod d10/d2f/d61/c68 0 2024-04-26T21:08:02.030 INFO:tasks.workunit.client.1.smithi064.stdout:7/407: rename d6/d15/d67/d78 to d6/d8c 0 2024-04-26T21:08:02.030 INFO:tasks.workunit.client.1.smithi064.stdout:7/408: write d6/d15/d1c/f2e [1370231,21114] 0 2024-04-26T21:08:02.030 INFO:tasks.workunit.client.1.smithi064.stdout:7/409: readlink d6/db/d1f/l44 0 2024-04-26T21:08:02.031 INFO:tasks.workunit.client.1.smithi064.stdout:7/410: creat d6/d9/f8d x:0 0 0 2024-04-26T21:08:02.031 INFO:tasks.workunit.client.1.smithi064.stdout:3/368: dwrite d1/d38/f6c [0,4194304] 0 2024-04-26T21:08:02.032 INFO:tasks.workunit.client.1.smithi064.stdout:0/360: dread dd/d10/d1a/d31/f41 [0,4194304] 0 2024-04-26T21:08:02.032 INFO:tasks.workunit.client.1.smithi064.stdout:0/361: write dd/d10/d1a/d31/d47/f66 [279308,2321] 0 2024-04-26T21:08:02.034 INFO:tasks.workunit.client.1.smithi064.stdout:4/462: dwrite d0/d1d/d17/f25 [0,4194304] 0 2024-04-26T21:08:02.036 INFO:tasks.workunit.client.0.smithi055.stdout:9/228: dwrite d2/d11/f4b [0,4194304] 0 2024-04-26T21:08:02.036 INFO:tasks.workunit.client.0.smithi055.stdout:9/229: dread - d2/f41 zero size 2024-04-26T21:08:02.036 INFO:tasks.workunit.client.0.smithi055.stdout:1/217: dread d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:02.041 INFO:tasks.workunit.client.0.smithi055.stdout:2/236: dread d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:02.041 INFO:tasks.workunit.client.1.smithi064.stdout:7/411: rmdir d6/d9/d38 39 2024-04-26T21:08:02.041 INFO:tasks.workunit.client.1.smithi064.stdout:7/412: truncate d6/d9/f1a 1166714 0 2024-04-26T21:08:02.043 INFO:tasks.workunit.client.0.smithi055.stdout:6/235: link d3/d17/d19/f36 d3/d17/d19/d20/d3e/f4c 0 2024-04-26T21:08:02.048 INFO:tasks.workunit.client.1.smithi064.stdout:3/369: link d1/d14/f5a d1/d27/d29/d6f/f86 0 2024-04-26T21:08:02.049 INFO:tasks.workunit.client.1.smithi064.stdout:1/505: dwrite d0/d6/ff [4194304,4194304] 0 2024-04-26T21:08:02.051 INFO:tasks.workunit.client.0.smithi055.stdout:9/230: rename d2/d14/d33/f4a to d2/d14/f4f 0 2024-04-26T21:08:02.053 INFO:tasks.workunit.client.0.smithi055.stdout:7/242: read d5/d6/d24/d3b/f3c [2687157,76985] 0 2024-04-26T21:08:02.056 INFO:tasks.workunit.client.1.smithi064.stdout:0/362: link dd/d10/l17 dd/d1c/l6c 0 2024-04-26T21:08:02.057 INFO:tasks.workunit.client.0.smithi055.stdout:1/218: creat d8/df/d11/d27/d28/d3d/f4c x:0 0 0 2024-04-26T21:08:02.057 INFO:tasks.workunit.client.0.smithi055.stdout:1/219: write d8/f31 [1311438,62962] 0 2024-04-26T21:08:02.057 INFO:tasks.workunit.client.0.smithi055.stdout:1/220: chown d8/df/d11/c46 6017007 1 2024-04-26T21:08:02.060 INFO:tasks.workunit.client.0.smithi055.stdout:1/221: read d8/df/f24 [442722,42432] 0 2024-04-26T21:08:02.060 INFO:tasks.workunit.client.0.smithi055.stdout:1/222: write d8/df/f24 [1167461,10625] 0 2024-04-26T21:08:02.061 INFO:tasks.workunit.client.0.smithi055.stdout:7/243: dread d5/d6/d24/f28 [0,4194304] 0 2024-04-26T21:08:02.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/178: dwrite f1 [0,4194304] 0 2024-04-26T21:08:02.067 INFO:tasks.workunit.client.0.smithi055.stdout:8/179: read d3/d9/fe [252081,100265] 0 2024-04-26T21:08:02.067 INFO:tasks.workunit.client.0.smithi055.stdout:8/180: readlink d3/d9/l13 0 2024-04-26T21:08:02.067 INFO:tasks.workunit.client.0.smithi055.stdout:8/181: fsync d3/d9/d1d/f35 0 2024-04-26T21:08:02.070 INFO:tasks.workunit.client.0.smithi055.stdout:6/236: rename d3/d17/d19/d20/d3e/f4c to d3/d17/d19/d20/d3e/f4d 0 2024-04-26T21:08:02.073 INFO:tasks.workunit.client.0.smithi055.stdout:6/237: fdatasync d3/d17/d25/f47 0 2024-04-26T21:08:02.073 INFO:tasks.workunit.client.1.smithi064.stdout:2/402: dwrite d12/d28/d3a/d46/d6a/f5a [0,4194304] 0 2024-04-26T21:08:02.076 INFO:tasks.workunit.client.1.smithi064.stdout:4/463: unlink d0/d5/d13/d33/l35 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:4/141: dwrite d4/f1d [0,4194304] 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/244: read d5/d11/f2f [979958,57669] 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/245: fsync d5/d6/d24/d3b/f42 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/246: chown d5/db/le 7473 1 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/247: chown d5/d6/d24/c35 3910 1 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/248: write d5/d6/ff [196602,11389] 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/249: creat d5/d6/d24/d3b/f45 x:0 0 0 2024-04-26T21:08:02.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/250: dread - d5/d6/d39/f3e zero size 2024-04-26T21:08:02.080 INFO:tasks.workunit.client.0.smithi055.stdout:3/280: dwrite d0/f68 [0,4194304] 0 2024-04-26T21:08:02.081 INFO:tasks.workunit.client.0.smithi055.stdout:3/281: fdatasync d0/d4/d16/d18/f5d 0 2024-04-26T21:08:02.081 INFO:tasks.workunit.client.0.smithi055.stdout:3/282: chown d0/d1/d13/d1a/c45 4094 1 2024-04-26T21:08:02.081 INFO:tasks.workunit.client.0.smithi055.stdout:3/283: stat d0/d1/d47/l29 0 2024-04-26T21:08:02.081 INFO:tasks.workunit.client.1.smithi064.stdout:8/331: getdents d10/d2f 0 2024-04-26T21:08:02.081 INFO:tasks.workunit.client.1.smithi064.stdout:8/332: stat d10/d1d/d38/l3c 0 2024-04-26T21:08:02.088 INFO:tasks.workunit.client.0.smithi055.stdout:0/291: dwrite d9/dc/d17/f45 [0,4194304] 0 2024-04-26T21:08:02.088 INFO:tasks.workunit.client.0.smithi055.stdout:0/292: fdatasync d9/dc/d17/f5f 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:0/293: stat d9/dc/d17/f45 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:3/284: write d0/f19 [1310322,36121] 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:3/285: chown d0/d4/d16/l1c 4053 1 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:3/286: chown d0/d1/d13/d27/d3b 0 1 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:1/223: creat d8/d17/d36/f4d x:0 0 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:1/224: write d8/f15 [5145241,89512] 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:1/225: write d8/df/f24 [1922740,79207] 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.0.smithi055.stdout:6/238: rename d3/ca to d3/d17/d46/c4e 0 2024-04-26T21:08:02.089 INFO:tasks.workunit.client.1.smithi064.stdout:9/399: dwrite d0/d4/d7/df/f2c [0,4194304] 0 2024-04-26T21:08:02.090 INFO:tasks.workunit.client.1.smithi064.stdout:9/400: chown d0/d39/f3e 873262 1 2024-04-26T21:08:02.091 INFO:tasks.workunit.client.1.smithi064.stdout:3/370: mknod d1/d27/d50/d35/d4c/c87 0 2024-04-26T21:08:02.106 INFO:tasks.workunit.client.1.smithi064.stdout:7/413: dwrite d6/d15/f5d [0,4194304] 0 2024-04-26T21:08:02.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/231: dwrite d2/d11/f1f [0,4194304] 0 2024-04-26T21:08:02.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/232: fsync d2/d46/f48 0 2024-04-26T21:08:02.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/233: chown d2/d14/l24 1 1 2024-04-26T21:08:02.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/234: creat d2/d46/f50 x:0 0 0 2024-04-26T21:08:02.121 INFO:tasks.workunit.client.1.smithi064.stdout:0/363: creat dd/d1c/d1d/f6d x:0 0 0 2024-04-26T21:08:02.131 INFO:tasks.workunit.client.1.smithi064.stdout:2/403: creat d12/d41/d73/d83/f8d x:0 0 0 2024-04-26T21:08:02.136 INFO:tasks.workunit.client.0.smithi055.stdout:2/237: dread d4/d14/d33/f4b [0,4194304] 0 2024-04-26T21:08:02.136 INFO:tasks.workunit.client.0.smithi055.stdout:2/238: chown d4/d1e/f4f 12 1 2024-04-26T21:08:02.143 INFO:tasks.workunit.client.1.smithi064.stdout:1/506: dwrite d0/d6/d11/d1e/d27/f50 [0,4194304] 0 2024-04-26T21:08:02.143 INFO:tasks.workunit.client.1.smithi064.stdout:8/333: dwrite d10/d41/d44/f51 [0,4194304] 0 2024-04-26T21:08:02.143 INFO:tasks.workunit.client.1.smithi064.stdout:8/334: fdatasync d10/d2f/f33 0 2024-04-26T21:08:02.143 INFO:tasks.workunit.client.1.smithi064.stdout:1/507: dread - d0/d6/d11/d1e/d27/f81 zero size 2024-04-26T21:08:02.157 INFO:tasks.workunit.client.0.smithi055.stdout:7/251: dread d5/db/f1e [0,4194304] 0 2024-04-26T21:08:02.164 INFO:tasks.workunit.client.0.smithi055.stdout:4/142: dwrite d4/f11 [0,4194304] 0 2024-04-26T21:08:02.164 INFO:tasks.workunit.client.0.smithi055.stdout:4/143: fsync d4/f1d 0 2024-04-26T21:08:02.165 INFO:tasks.workunit.client.0.smithi055.stdout:4/144: fdatasync d4/f9 0 2024-04-26T21:08:02.173 INFO:tasks.workunit.client.1.smithi064.stdout:9/401: symlink d0/d39/l83 0 2024-04-26T21:08:02.173 INFO:tasks.workunit.client.1.smithi064.stdout:9/402: dread - d0/d4/da/d26/d47/f81 zero size 2024-04-26T21:08:02.175 INFO:tasks.workunit.client.1.smithi064.stdout:3/371: mkdir d1/d27/d29/d6f/d72/d73/d88 0 2024-04-26T21:08:02.175 INFO:tasks.workunit.client.1.smithi064.stdout:3/372: chown d1/d27/d29/f4b 214760377 1 2024-04-26T21:08:02.175 INFO:tasks.workunit.client.1.smithi064.stdout:0/364: dwrite dd/d1c/f68 [0,4194304] 0 2024-04-26T21:08:02.176 INFO:tasks.workunit.client.0.smithi055.stdout:3/287: mkdir d0/d1/d13/d27/d50/d6b 0 2024-04-26T21:08:02.179 INFO:tasks.workunit.client.0.smithi055.stdout:8/182: dwrite d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:08:02.180 INFO:tasks.workunit.client.0.smithi055.stdout:8/183: truncate d3/d9/f3b 535007 0 2024-04-26T21:08:02.180 INFO:tasks.workunit.client.0.smithi055.stdout:8/184: chown d3/d9/d1f/l20 3515 1 2024-04-26T21:08:02.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/239: dwrite d3/d17/d25/f2b [0,4194304] 0 2024-04-26T21:08:02.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/240: write d3/f9 [1916989,87223] 0 2024-04-26T21:08:02.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/241: fsync d3/d17/d25/f39 0 2024-04-26T21:08:02.182 INFO:tasks.workunit.client.1.smithi064.stdout:0/365: dread dd/d10/d18/d64/f65 [0,4194304] 0 2024-04-26T21:08:02.184 INFO:tasks.workunit.client.0.smithi055.stdout:3/288: write d0/d1/d13/d1a/f35 [385883,81490] 0 2024-04-26T21:08:02.184 INFO:tasks.workunit.client.0.smithi055.stdout:1/226: rename l4 to d8/d17/d1b/l4e 0 2024-04-26T21:08:02.184 INFO:tasks.workunit.client.0.smithi055.stdout:1/227: stat d8/df/f24 0 2024-04-26T21:08:02.194 INFO:tasks.workunit.client.0.smithi055.stdout:0/294: dwrite d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:02.207 INFO:tasks.workunit.client.0.smithi055.stdout:9/235: mkdir d2/d46/d51 0 2024-04-26T21:08:02.207 INFO:tasks.workunit.client.0.smithi055.stdout:9/236: write d2/f1c [67927,19407] 0 2024-04-26T21:08:02.211 INFO:tasks.workunit.client.0.smithi055.stdout:2/239: unlink d4/d14/f19 0 2024-04-26T21:08:02.214 INFO:tasks.workunit.client.1.smithi064.stdout:3/373: symlink d1/d38/l89 0 2024-04-26T21:08:02.215 INFO:tasks.workunit.client.0.smithi055.stdout:4/145: symlink d4/d12/d15/l33 0 2024-04-26T21:08:02.216 INFO:tasks.workunit.client.0.smithi055.stdout:4/146: write d4/d18/d1e/d28/f32 [3848792,52756] 0 2024-04-26T21:08:02.219 INFO:tasks.workunit.client.1.smithi064.stdout:0/366: mknod dd/d10/d1a/d31/d47/c6e 0 2024-04-26T21:08:02.219 INFO:tasks.workunit.client.1.smithi064.stdout:0/367: creat dd/d10/d1a/d31/d5c/f6f x:0 0 0 2024-04-26T21:08:02.221 INFO:tasks.workunit.client.1.smithi064.stdout:9/403: dwrite d0/d4/da/d26/d47/d6b/f70 [0,4194304] 0 2024-04-26T21:08:02.221 INFO:tasks.workunit.client.0.smithi055.stdout:6/242: mkdir d3/d4f 0 2024-04-26T21:08:02.221 INFO:tasks.workunit.client.0.smithi055.stdout:6/243: readlink d3/d17/l3b 0 2024-04-26T21:08:02.221 INFO:tasks.workunit.client.0.smithi055.stdout:6/244: write d3/f9 [2198125,36811] 0 2024-04-26T21:08:02.223 INFO:tasks.workunit.client.1.smithi064.stdout:4/464: rename d0/d1d/d17/d57 to d0/d5/d13/d6d/d97 0 2024-04-26T21:08:02.223 INFO:tasks.workunit.client.1.smithi064.stdout:4/465: chown d0/d2f/d69 657194 1 2024-04-26T21:08:02.224 INFO:tasks.workunit.client.1.smithi064.stdout:4/466: write d0/d1d/d56/d89/f96 [973874,7874] 0 2024-04-26T21:08:02.224 INFO:tasks.workunit.client.0.smithi055.stdout:7/252: dwrite d5/d6/f31 [4194304,4194304] 0 2024-04-26T21:08:02.224 INFO:tasks.workunit.client.0.smithi055.stdout:7/253: chown d5/d11/c3f 2048992266 1 2024-04-26T21:08:02.226 INFO:tasks.workunit.client.1.smithi064.stdout:8/335: unlink d10/l2e 0 2024-04-26T21:08:02.228 INFO:tasks.workunit.client.0.smithi055.stdout:0/295: link d9/d27/c3d d9/dc/d17/c66 0 2024-04-26T21:08:02.238 INFO:tasks.workunit.client.0.smithi055.stdout:3/289: dread d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:02.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/368: dread dd/f67 [0,4194304] 0 2024-04-26T21:08:02.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/369: creat dd/d10/d1a/d31/d47/d61/f70 x:0 0 0 2024-04-26T21:08:02.240 INFO:tasks.workunit.client.1.smithi064.stdout:0/370: write dd/f2a [4600964,10465] 0 2024-04-26T21:08:02.242 INFO:tasks.workunit.client.1.smithi064.stdout:9/404: dread d0/d4/d7/df/f32 [0,4194304] 0 2024-04-26T21:08:02.242 INFO:tasks.workunit.client.0.smithi055.stdout:8/185: dwrite d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:02.248 INFO:tasks.workunit.client.0.smithi055.stdout:9/237: mknod d2/d46/d51/c52 0 2024-04-26T21:08:02.248 INFO:tasks.workunit.client.0.smithi055.stdout:2/240: creat d4/db/d26/d41/d4a/f53 x:0 0 0 2024-04-26T21:08:02.249 INFO:tasks.workunit.client.1.smithi064.stdout:2/404: rename d12/d28/d3a/l40 to d12/d28/d3a/d46/l8e 0 2024-04-26T21:08:02.250 INFO:tasks.workunit.client.1.smithi064.stdout:2/405: chown d12/c81 20588 1 2024-04-26T21:08:02.250 INFO:tasks.workunit.client.1.smithi064.stdout:2/406: write d12/d28/d3a/d46/d48/d85/d29/f49 [990139,52757] 0 2024-04-26T21:08:02.250 INFO:tasks.workunit.client.1.smithi064.stdout:2/407: chown d12/d28/d3a/d3e/f84 468 1 2024-04-26T21:08:02.251 INFO:tasks.workunit.client.0.smithi055.stdout:6/245: unlink d3/d17/d19/c42 0 2024-04-26T21:08:02.253 INFO:tasks.workunit.client.1.smithi064.stdout:8/336: link d10/d41/c58 d10/d1d/c69 0 2024-04-26T21:08:02.255 INFO:tasks.workunit.client.0.smithi055.stdout:7/254: dread f1 [0,4194304] 0 2024-04-26T21:08:02.255 INFO:tasks.workunit.client.1.smithi064.stdout:3/374: getdents d1/d27/d29/d6f/d72/d73 0 2024-04-26T21:08:02.263 INFO:tasks.workunit.client.1.smithi064.stdout:0/371: dread dd/f30 [0,4194304] 0 2024-04-26T21:08:02.265 INFO:tasks.workunit.client.1.smithi064.stdout:9/405: creat d0/d4/d28/d4f/d74/f84 x:0 0 0 2024-04-26T21:08:02.265 INFO:tasks.workunit.client.1.smithi064.stdout:9/406: chown d0/d4/da/d26/d47/f4b 671 1 2024-04-26T21:08:02.265 INFO:tasks.workunit.client.1.smithi064.stdout:9/407: write d0/d4/da/f29 [219643,122986] 0 2024-04-26T21:08:02.265 INFO:tasks.workunit.client.1.smithi064.stdout:9/408: creat d0/d4/d28/d4f/d74/f85 x:0 0 0 2024-04-26T21:08:02.265 INFO:tasks.workunit.client.1.smithi064.stdout:9/409: truncate d0/d4/d28/d4f/f61 848658 0 2024-04-26T21:08:02.268 INFO:tasks.workunit.client.1.smithi064.stdout:4/467: rename d0/c8 to d0/d1d/d17/d44/c98 0 2024-04-26T21:08:02.270 INFO:tasks.workunit.client.1.smithi064.stdout:5/385: sync 2024-04-26T21:08:02.270 INFO:tasks.workunit.client.1.smithi064.stdout:6/346: sync 2024-04-26T21:08:02.270 INFO:tasks.workunit.client.1.smithi064.stdout:5/386: fdatasync dd/d12/d18/f2b 0 2024-04-26T21:08:02.270 INFO:tasks.workunit.client.1.smithi064.stdout:2/408: mknod d12/d41/d73/c8f 0 2024-04-26T21:08:02.270 INFO:tasks.workunit.client.1.smithi064.stdout:2/409: write d12/d28/f3d [871646,47700] 0 2024-04-26T21:08:02.271 INFO:tasks.workunit.client.0.smithi055.stdout:9/238: dread d2/f10 [0,4194304] 0 2024-04-26T21:08:02.271 INFO:tasks.workunit.client.0.smithi055.stdout:9/239: fsync d2/f3f 0 2024-04-26T21:08:02.273 INFO:tasks.workunit.client.1.smithi064.stdout:3/375: mkdir d1/d12/d7d/d8a 0 2024-04-26T21:08:02.275 INFO:tasks.workunit.client.0.smithi055.stdout:4/147: dwrite d4/d18/d1e/d28/f32 [0,4194304] 0 2024-04-26T21:08:02.276 INFO:tasks.workunit.client.0.smithi055.stdout:6/246: dread d3/d17/f29 [0,4194304] 0 2024-04-26T21:08:02.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/186: dread d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:08:02.283 INFO:tasks.workunit.client.1.smithi064.stdout:0/372: symlink dd/d10/d1a/d31/d43/l71 0 2024-04-26T21:08:02.287 INFO:tasks.workunit.client.0.smithi055.stdout:0/296: mkdir d9/d11/d5b/d5e/d67 0 2024-04-26T21:08:02.287 INFO:tasks.workunit.client.0.smithi055.stdout:0/297: chown d9/d27/c3d 11 1 2024-04-26T21:08:02.287 INFO:tasks.workunit.client.0.smithi055.stdout:0/298: write d9/dc/d1c/d3b/f36 [1175836,54288] 0 2024-04-26T21:08:02.290 INFO:tasks.workunit.client.1.smithi064.stdout:7/414: sync 2024-04-26T21:08:02.290 INFO:tasks.workunit.client.0.smithi055.stdout:3/290: rename d0/d4/d16/d18/d4b/d57/l58 to d0/de/l6c 0 2024-04-26T21:08:02.295 INFO:tasks.workunit.client.1.smithi064.stdout:8/337: rename d10/d1d/f1e to d10/d2f/d56/f6a 0 2024-04-26T21:08:02.297 INFO:tasks.workunit.client.1.smithi064.stdout:4/468: symlink d0/d5/d79/l99 0 2024-04-26T21:08:02.297 INFO:tasks.workunit.client.1.smithi064.stdout:4/469: readlink d0/d5/l52 0 2024-04-26T21:08:02.298 INFO:tasks.workunit.client.1.smithi064.stdout:4/470: truncate d0/d1d/f70 360368 0 2024-04-26T21:08:02.298 INFO:tasks.workunit.client.1.smithi064.stdout:1/508: sync 2024-04-26T21:08:02.301 INFO:tasks.workunit.client.1.smithi064.stdout:4/471: write d0/d5/d13/d6d/f4b [2148275,83829] 0 2024-04-26T21:08:02.302 INFO:tasks.workunit.client.0.smithi055.stdout:2/241: symlink d4/d14/l54 0 2024-04-26T21:08:02.302 INFO:tasks.workunit.client.0.smithi055.stdout:6/247: mknod d3/d17/d19/d20/d3e/c50 0 2024-04-26T21:08:02.303 INFO:tasks.workunit.client.0.smithi055.stdout:9/240: dread d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:02.304 INFO:tasks.workunit.client.1.smithi064.stdout:5/387: truncate dd/d12/d18/d1a/d1f/d20/f59 831135 0 2024-04-26T21:08:02.305 INFO:tasks.workunit.client.0.smithi055.stdout:8/187: truncate d3/d9/d1f/f31 1181103 0 2024-04-26T21:08:02.311 INFO:tasks.workunit.client.0.smithi055.stdout:3/291: symlink d0/d4/l6d 0 2024-04-26T21:08:02.315 INFO:tasks.workunit.client.0.smithi055.stdout:7/255: rename d5/db/l2d to d5/d11/l46 0 2024-04-26T21:08:02.320 INFO:tasks.workunit.client.1.smithi064.stdout:7/415: mkdir d6/db/d8e 0 2024-04-26T21:08:02.325 INFO:tasks.workunit.client.0.smithi055.stdout:6/248: mkdir d3/d17/d19/d20/d51 0 2024-04-26T21:08:02.338 INFO:tasks.workunit.client.0.smithi055.stdout:9/241: unlink d2/d11/l39 0 2024-04-26T21:08:02.343 INFO:tasks.workunit.client.0.smithi055.stdout:3/292: rename d0/d4/d16/d18/c4a to d0/de/c6e 0 2024-04-26T21:08:02.343 INFO:tasks.workunit.client.1.smithi064.stdout:9/410: dwrite d0/f59 [0,4194304] 0 2024-04-26T21:08:02.344 INFO:tasks.workunit.client.1.smithi064.stdout:9/411: dread - d0/d4/da/d26/d47/f81 zero size 2024-04-26T21:08:02.346 INFO:tasks.workunit.client.0.smithi055.stdout:6/249: rmdir d3/d17/d19/d20 39 2024-04-26T21:08:02.346 INFO:tasks.workunit.client.0.smithi055.stdout:6/250: fsync d3/d17/d19/d20/f28 0 2024-04-26T21:08:02.347 INFO:tasks.workunit.client.0.smithi055.stdout:6/251: write d3/d17/d19/f1e [2085813,52404] 0 2024-04-26T21:08:02.350 INFO:tasks.workunit.client.1.smithi064.stdout:4/472: truncate d0/d5/d3e/d54/f5f 2745627 0 2024-04-26T21:08:02.355 INFO:tasks.workunit.client.1.smithi064.stdout:3/376: dwrite d1/d27/d50/f52 [0,4194304] 0 2024-04-26T21:08:02.359 INFO:tasks.workunit.client.0.smithi055.stdout:8/188: getdents d3/d9/d1d 0 2024-04-26T21:08:02.359 INFO:tasks.workunit.client.0.smithi055.stdout:5/148: sync 2024-04-26T21:08:02.359 INFO:tasks.workunit.client.0.smithi055.stdout:8/189: write d3/f18 [4790943,61445] 0 2024-04-26T21:08:02.370 INFO:tasks.workunit.client.0.smithi055.stdout:9/242: creat d2/f53 x:0 0 0 2024-04-26T21:08:02.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/293: creat d0/d1/d47/d37/f6f x:0 0 0 2024-04-26T21:08:02.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/294: dread - d0/d1/d47/d42/f53 zero size 2024-04-26T21:08:02.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/295: write d0/d4/d5/f21 [5057340,10032] 0 2024-04-26T21:08:02.375 INFO:tasks.workunit.client.1.smithi064.stdout:4/473: creat d0/d2f/d69/f9a x:0 0 0 2024-04-26T21:08:02.375 INFO:tasks.workunit.client.1.smithi064.stdout:4/474: truncate d0/d5/d13/d6d/f64 1116563 0 2024-04-26T21:08:02.377 INFO:tasks.workunit.client.0.smithi055.stdout:8/190: rmdir d3/d9/d1d 39 2024-04-26T21:08:02.377 INFO:tasks.workunit.client.0.smithi055.stdout:8/191: dread - d3/d9/d1f/f32 zero size 2024-04-26T21:08:02.377 INFO:tasks.workunit.client.0.smithi055.stdout:8/192: truncate d3/d9/d1f/f32 752112 0 2024-04-26T21:08:02.378 INFO:tasks.workunit.client.0.smithi055.stdout:8/193: read d3/d9/f2d [277508,123268] 0 2024-04-26T21:08:02.386 INFO:tasks.workunit.client.0.smithi055.stdout:3/296: creat d0/d4/d16/f70 x:0 0 0 2024-04-26T21:08:02.386 INFO:tasks.workunit.client.0.smithi055.stdout:3/297: chown d0/d4/d16/d18/d4b 199912 1 2024-04-26T21:08:02.386 INFO:tasks.workunit.client.1.smithi064.stdout:5/388: write dd/d12/d18/d33/d48/d56/f62 [3353446,1166] 0 2024-04-26T21:08:02.386 INFO:tasks.workunit.client.1.smithi064.stdout:5/389: chown dd/d12/d18/d1a/d1f/d20/l3e 1 1 2024-04-26T21:08:02.387 INFO:tasks.workunit.client.1.smithi064.stdout:8/338: dwrite fa [0,4194304] 0 2024-04-26T21:08:02.391 INFO:tasks.workunit.client.1.smithi064.stdout:3/377: symlink d1/d27/d29/d6f/d72/d7a/l8b 0 2024-04-26T21:08:02.394 INFO:tasks.workunit.client.0.smithi055.stdout:9/243: unlink d2/d14/d33/f37 0 2024-04-26T21:08:02.395 INFO:tasks.workunit.client.0.smithi055.stdout:9/244: creat d2/d46/f54 x:0 0 0 2024-04-26T21:08:02.397 INFO:tasks.workunit.client.1.smithi064.stdout:0/373: dwrite dd/d10/d18/d64/f65 [0,4194304] 0 2024-04-26T21:08:02.399 INFO:tasks.workunit.client.1.smithi064.stdout:7/416: mkdir d6/d5a/d8f 0 2024-04-26T21:08:02.400 INFO:tasks.workunit.client.0.smithi055.stdout:7/256: dwrite d5/d6/d24/f27 [0,4194304] 0 2024-04-26T21:08:02.400 INFO:tasks.workunit.client.0.smithi055.stdout:7/257: write d5/d11/f25 [742533,124968] 0 2024-04-26T21:08:02.413 INFO:tasks.workunit.client.1.smithi064.stdout:4/475: mkdir d0/d1d/d17/d9b 0 2024-04-26T21:08:02.413 INFO:tasks.workunit.client.1.smithi064.stdout:4/476: dread - d0/d14/f95 zero size 2024-04-26T21:08:02.422 INFO:tasks.workunit.client.0.smithi055.stdout:5/149: dread d4/df/d13/f17 [0,4194304] 0 2024-04-26T21:08:02.422 INFO:tasks.workunit.client.0.smithi055.stdout:5/150: stat d4/f6 0 2024-04-26T21:08:02.424 INFO:tasks.workunit.client.0.smithi055.stdout:2/242: dwrite d4/db/f15 [0,4194304] 0 2024-04-26T21:08:02.426 INFO:tasks.workunit.client.1.smithi064.stdout:5/390: creat dd/d12/d18/d33/d48/d6a/f79 x:0 0 0 2024-04-26T21:08:02.427 INFO:tasks.workunit.client.1.smithi064.stdout:5/391: chown dd/d12/d18/d1a/d1f/d20 617780355 1 2024-04-26T21:08:02.427 INFO:tasks.workunit.client.1.smithi064.stdout:5/392: chown dd/d12/d18/d25/d32/f37 960 1 2024-04-26T21:08:02.427 INFO:tasks.workunit.client.1.smithi064.stdout:6/347: dwrite d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:02.427 INFO:tasks.workunit.client.1.smithi064.stdout:6/348: chown d4/f41 1737 1 2024-04-26T21:08:02.427 INFO:tasks.workunit.client.1.smithi064.stdout:6/349: write d4/d7/d12/d1e/f63 [414057,32008] 0 2024-04-26T21:08:02.431 INFO:tasks.workunit.client.1.smithi064.stdout:1/509: dwrite d0/d6/d11/f35 [0,4194304] 0 2024-04-26T21:08:02.431 INFO:tasks.workunit.client.1.smithi064.stdout:1/510: chown d0/f4d 986098 1 2024-04-26T21:08:02.431 INFO:tasks.workunit.client.1.smithi064.stdout:1/511: dread - d0/d6b/f9d zero size 2024-04-26T21:08:02.431 INFO:tasks.workunit.client.1.smithi064.stdout:1/512: creat d0/d6b/fa0 x:0 0 0 2024-04-26T21:08:02.431 INFO:tasks.workunit.client.1.smithi064.stdout:8/339: link d10/d41/d44/c5f d10/d41/d44/c6b 0 2024-04-26T21:08:02.436 INFO:tasks.workunit.client.0.smithi055.stdout:6/252: dwrite d3/d17/d19/d20/d3e/f4d [0,4194304] 0 2024-04-26T21:08:02.448 INFO:tasks.workunit.client.1.smithi064.stdout:3/378: truncate d1/d14/f1c 710609 0 2024-04-26T21:08:02.448 INFO:tasks.workunit.client.1.smithi064.stdout:3/379: dread - d1/d27/d29/f4b zero size 2024-04-26T21:08:02.456 INFO:tasks.workunit.client.0.smithi055.stdout:0/299: dwrite d9/d27/f42 [0,4194304] 0 2024-04-26T21:08:02.456 INFO:tasks.workunit.client.0.smithi055.stdout:0/300: truncate d9/dc/d1c/f4f 432629 0 2024-04-26T21:08:02.459 INFO:tasks.workunit.client.0.smithi055.stdout:7/258: creat d5/d6/d24/f47 x:0 0 0 2024-04-26T21:08:02.463 INFO:tasks.workunit.client.1.smithi064.stdout:0/374: mknod dd/d10/d1a/c72 0 2024-04-26T21:08:02.463 INFO:tasks.workunit.client.1.smithi064.stdout:0/375: write dd/d10/d18/f29 [2608981,64330] 0 2024-04-26T21:08:02.467 INFO:tasks.workunit.client.1.smithi064.stdout:6/350: dread d4/d7/d12/f4f [0,4194304] 0 2024-04-26T21:08:02.471 INFO:tasks.workunit.client.1.smithi064.stdout:7/417: dwrite d6/d70/d74/f85 [0,4194304] 0 2024-04-26T21:08:02.471 INFO:tasks.workunit.client.1.smithi064.stdout:7/418: chown d6/db/c3e 0 1 2024-04-26T21:08:02.477 INFO:tasks.workunit.client.1.smithi064.stdout:4/477: dwrite d0/d1d/f49 [0,4194304] 0 2024-04-26T21:08:02.481 INFO:tasks.workunit.client.0.smithi055.stdout:8/194: dwrite d3/d9/d1f/f32 [0,4194304] 0 2024-04-26T21:08:02.482 INFO:tasks.workunit.client.0.smithi055.stdout:2/243: rename d4/d1e/d44 to d4/d55 0 2024-04-26T21:08:02.486 INFO:tasks.workunit.client.1.smithi064.stdout:5/393: symlink dd/d12/d4f/d64/d73/l7a 0 2024-04-26T21:08:02.486 INFO:tasks.workunit.client.1.smithi064.stdout:5/394: write dd/d12/d18/d1a/d1f/d20/f3b [281180,52559] 0 2024-04-26T21:08:02.490 INFO:tasks.workunit.client.0.smithi055.stdout:6/253: symlink d3/l52 0 2024-04-26T21:08:02.497 INFO:tasks.workunit.client.1.smithi064.stdout:1/513: symlink d0/d6/d91/la1 0 2024-04-26T21:08:02.497 INFO:tasks.workunit.client.1.smithi064.stdout:8/340: truncate d10/d1d/f3d 152629 0 2024-04-26T21:08:02.497 INFO:tasks.workunit.client.1.smithi064.stdout:0/376: mknod dd/d10/d18/d58/c73 0 2024-04-26T21:08:02.499 INFO:tasks.workunit.client.1.smithi064.stdout:3/380: dwrite d1/d27/d29/f67 [0,4194304] 0 2024-04-26T21:08:02.502 INFO:tasks.workunit.client.0.smithi055.stdout:0/301: mkdir d9/dc/d1c/d54/d4b/d68 0 2024-04-26T21:08:02.502 INFO:tasks.workunit.client.0.smithi055.stdout:0/302: write d9/dc/d1c/d54/f4a [474822,67861] 0 2024-04-26T21:08:02.502 INFO:tasks.workunit.client.0.smithi055.stdout:0/303: write d9/dc/d1c/d3b/d41/f2e [6934686,65649] 0 2024-04-26T21:08:02.502 INFO:tasks.workunit.client.0.smithi055.stdout:0/304: write d9/fa [6814496,120299] 0 2024-04-26T21:08:02.504 INFO:tasks.workunit.client.0.smithi055.stdout:7/259: mkdir d5/d6/d24/d48 0 2024-04-26T21:08:02.504 INFO:tasks.workunit.client.0.smithi055.stdout:7/260: chown d5/d11 40129 1 2024-04-26T21:08:02.504 INFO:tasks.workunit.client.0.smithi055.stdout:7/261: dread - d5/f32 zero size 2024-04-26T21:08:02.514 INFO:tasks.workunit.client.1.smithi064.stdout:1/514: dread d0/d6/d11/d1e/f21 [0,4194304] 0 2024-04-26T21:08:02.514 INFO:tasks.workunit.client.1.smithi064.stdout:1/515: getdents d0/d6/d11/d6c 0 2024-04-26T21:08:02.519 INFO:tasks.workunit.client.0.smithi055.stdout:6/254: dread d3/d17/d19/f36 [0,4194304] 0 2024-04-26T21:08:02.520 INFO:tasks.workunit.client.1.smithi064.stdout:7/419: mkdir d6/db/d8e/d90 0 2024-04-26T21:08:02.520 INFO:tasks.workunit.client.0.smithi055.stdout:6/255: write d3/f30 [1042910,98377] 0 2024-04-26T21:08:02.526 INFO:tasks.workunit.client.0.smithi055.stdout:8/195: link d3/ca d3/d9/d1f/c3f 0 2024-04-26T21:08:02.526 INFO:tasks.workunit.client.0.smithi055.stdout:7/262: dread d5/d11/f25 [0,4194304] 0 2024-04-26T21:08:02.530 INFO:tasks.workunit.client.1.smithi064.stdout:6/351: dwrite d4/d7/d33/f34 [0,4194304] 0 2024-04-26T21:08:02.530 INFO:tasks.workunit.client.0.smithi055.stdout:0/305: dread d9/dc/d1c/f26 [0,4194304] 0 2024-04-26T21:08:02.532 INFO:tasks.workunit.client.0.smithi055.stdout:2/244: rename d4/db/d26/d41 to d4/db/d56 0 2024-04-26T21:08:02.532 INFO:tasks.workunit.client.0.smithi055.stdout:2/245: chown d4/db/d1f/d46/d51 63 1 2024-04-26T21:08:02.532 INFO:tasks.workunit.client.0.smithi055.stdout:2/246: readlink d4/db/l45 0 2024-04-26T21:08:02.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/298: dwrite d0/d4/d5/f21 [0,4194304] 0 2024-04-26T21:08:02.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/299: fsync d0/d4/d5/f36 0 2024-04-26T21:08:02.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/300: chown d0/de 663573294 1 2024-04-26T21:08:02.540 INFO:tasks.workunit.client.1.smithi064.stdout:5/395: dwrite dd/d12/d18/d1a/d1f/d20/f44 [4194304,4194304] 0 2024-04-26T21:08:02.541 INFO:tasks.workunit.client.0.smithi055.stdout:0/306: mknod d9/d27/c69 0 2024-04-26T21:08:02.541 INFO:tasks.workunit.client.0.smithi055.stdout:0/307: write d9/d27/f37 [4944562,34576] 0 2024-04-26T21:08:02.541 INFO:tasks.workunit.client.0.smithi055.stdout:0/308: write d9/dc/f10 [2640655,31777] 0 2024-04-26T21:08:02.541 INFO:tasks.workunit.client.0.smithi055.stdout:0/309: read - d9/dc/d17/f61 zero size 2024-04-26T21:08:02.541 INFO:tasks.workunit.client.0.smithi055.stdout:0/310: fdatasync d9/dc/d17/f30 0 2024-04-26T21:08:02.542 INFO:tasks.workunit.client.1.smithi064.stdout:8/341: mknod d10/d2f/c6c 0 2024-04-26T21:08:02.552 INFO:tasks.workunit.client.0.smithi055.stdout:7/263: rename f1 to d5/f49 0 2024-04-26T21:08:02.557 INFO:tasks.workunit.client.1.smithi064.stdout:3/381: symlink d1/d12/d7d/d8a/l8c 0 2024-04-26T21:08:02.557 INFO:tasks.workunit.client.1.smithi064.stdout:3/382: stat d1/d38/f6c 0 2024-04-26T21:08:02.562 INFO:tasks.workunit.client.0.smithi055.stdout:5/151: dwrite d4/d18/f20 [0,4194304] 0 2024-04-26T21:08:02.562 INFO:tasks.workunit.client.0.smithi055.stdout:5/152: write d4/f6 [4094526,35758] 0 2024-04-26T21:08:02.562 INFO:tasks.workunit.client.0.smithi055.stdout:3/301: truncate d0/d4/d5/f36 1478928 0 2024-04-26T21:08:02.564 INFO:tasks.workunit.client.1.smithi064.stdout:0/377: dwrite dd/d1c/d1d/f38 [4194304,4194304] 0 2024-04-26T21:08:02.564 INFO:tasks.workunit.client.1.smithi064.stdout:0/378: chown dd/d10/d1a/d31/d43 312 1 2024-04-26T21:08:02.564 INFO:tasks.workunit.client.1.smithi064.stdout:1/516: mkdir d0/d6b/d9e/da2 0 2024-04-26T21:08:02.564 INFO:tasks.workunit.client.1.smithi064.stdout:2/410: sync 2024-04-26T21:08:02.568 INFO:tasks.workunit.client.1.smithi064.stdout:7/420: creat d6/f91 x:0 0 0 2024-04-26T21:08:02.568 INFO:tasks.workunit.client.1.smithi064.stdout:7/421: fdatasync d6/db/d34/f5b 0 2024-04-26T21:08:02.575 INFO:tasks.workunit.client.1.smithi064.stdout:2/411: dread d12/d41/d61/d75/f2b [0,4194304] 0 2024-04-26T21:08:02.577 INFO:tasks.workunit.client.0.smithi055.stdout:2/247: getdents d4/d49 0 2024-04-26T21:08:02.580 INFO:tasks.workunit.client.1.smithi064.stdout:5/396: creat dd/d12/d18/d1a/d1f/f7b x:0 0 0 2024-04-26T21:08:02.580 INFO:tasks.workunit.client.1.smithi064.stdout:5/397: fdatasync dd/d12/d18/d1a/d1b/f2c 0 2024-04-26T21:08:02.580 INFO:tasks.workunit.client.1.smithi064.stdout:5/398: creat dd/d12/f7c x:0 0 0 2024-04-26T21:08:02.587 INFO:tasks.workunit.client.1.smithi064.stdout:2/412: dread d12/d28/d3a/d46/d48/d85/d29/f49 [0,4194304] 0 2024-04-26T21:08:02.590 INFO:tasks.workunit.client.1.smithi064.stdout:7/422: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:08:02.593 INFO:tasks.workunit.client.1.smithi064.stdout:3/383: rmdir d1/d27/d29/d6f/d72/d73/d88 0 2024-04-26T21:08:02.598 INFO:tasks.workunit.client.1.smithi064.stdout:6/352: dwrite d4/d7/fe [0,4194304] 0 2024-04-26T21:08:02.598 INFO:tasks.workunit.client.1.smithi064.stdout:6/353: fsync d4/d7/f3b 0 2024-04-26T21:08:02.600 INFO:tasks.workunit.client.1.smithi064.stdout:1/517: getdents d0/d22/d87 0 2024-04-26T21:08:02.600 INFO:tasks.workunit.client.1.smithi064.stdout:1/518: chown d0/d6/d29/d31/f51 980 1 2024-04-26T21:08:02.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/519: chown d0/d6/c3f 18367 1 2024-04-26T21:08:02.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/520: write d0/d6/d11/f23 [928920,77471] 0 2024-04-26T21:08:02.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/521: stat d0/d6/d11/d6c 0 2024-04-26T21:08:02.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/522: chown d0/d6/d11/d1e/d2a/l6d 1692920 1 2024-04-26T21:08:02.607 INFO:tasks.workunit.client.0.smithi055.stdout:2/248: mkdir d4/db/d1f/d32/d57 0 2024-04-26T21:08:02.608 INFO:tasks.workunit.client.0.smithi055.stdout:2/249: chown d4/d14 15 1 2024-04-26T21:08:02.608 INFO:tasks.workunit.client.0.smithi055.stdout:2/250: truncate d4/d1e/d2a/f30 523243 0 2024-04-26T21:08:02.608 INFO:tasks.workunit.client.1.smithi064.stdout:5/399: mknod dd/d12/d18/d25/d74/c7d 0 2024-04-26T21:08:02.608 INFO:tasks.workunit.client.1.smithi064.stdout:3/384: write d1/d38/f47 [975233,128962] 0 2024-04-26T21:08:02.608 INFO:tasks.workunit.client.1.smithi064.stdout:3/385: readlink d1/d12/l15 0 2024-04-26T21:08:02.618 INFO:tasks.workunit.client.1.smithi064.stdout:6/354: creat d4/d7/d12/d49/d4b/d56/f70 x:0 0 0 2024-04-26T21:08:02.618 INFO:tasks.workunit.client.1.smithi064.stdout:6/355: creat d4/d7/f71 x:0 0 0 2024-04-26T21:08:02.622 INFO:tasks.workunit.client.1.smithi064.stdout:1/523: symlink d0/d6/d11/d1e/d2a/d34/d57/d66/la3 0 2024-04-26T21:08:02.622 INFO:tasks.workunit.client.1.smithi064.stdout:1/524: fsync d0/d6/d11/d1e/d27/f81 0 2024-04-26T21:08:02.627 INFO:tasks.workunit.client.0.smithi055.stdout:0/311: dwrite d9/dc/d17/f5f [0,4194304] 0 2024-04-26T21:08:02.627 INFO:tasks.workunit.client.1.smithi064.stdout:3/386: mkdir d1/d12/d7d/d8d 0 2024-04-26T21:08:02.634 INFO:tasks.workunit.client.1.smithi064.stdout:7/423: rmdir d6/d15 39 2024-04-26T21:08:02.634 INFO:tasks.workunit.client.1.smithi064.stdout:7/424: creat d6/d9/d3d/f92 x:0 0 0 2024-04-26T21:08:02.636 INFO:tasks.workunit.client.1.smithi064.stdout:0/379: rename dd/d1c to dd/d10/d74 0 2024-04-26T21:08:02.637 INFO:tasks.workunit.client.1.smithi064.stdout:1/525: creat d0/d6b/d9e/fa4 x:0 0 0 2024-04-26T21:08:02.637 INFO:tasks.workunit.client.1.smithi064.stdout:1/526: dread - d0/d6/d11/d1e/d2a/f8a zero size 2024-04-26T21:08:02.637 INFO:tasks.workunit.client.1.smithi064.stdout:1/527: fdatasync d0/d6/d11/d1e/d27/f65 0 2024-04-26T21:08:02.638 INFO:tasks.workunit.client.1.smithi064.stdout:3/387: mkdir d1/d27/d50/d35/d4c/d7b/d8e 0 2024-04-26T21:08:02.638 INFO:tasks.workunit.client.1.smithi064.stdout:3/388: creat d1/d38/f8f x:0 0 0 2024-04-26T21:08:02.639 INFO:tasks.workunit.client.1.smithi064.stdout:0/380: symlink dd/l75 0 2024-04-26T21:08:02.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/528: creat d0/d6/d11/fa5 x:0 0 0 2024-04-26T21:08:02.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/529: fdatasync d0/d6/d11/d1e/d2a/d34/f79 0 2024-04-26T21:08:02.643 INFO:tasks.workunit.client.1.smithi064.stdout:3/389: creat d1/d27/d29/d6f/d72/d73/f90 x:0 0 0 2024-04-26T21:08:02.646 INFO:tasks.workunit.client.1.smithi064.stdout:0/381: getdents dd/d21 0 2024-04-26T21:08:02.648 INFO:tasks.workunit.client.1.smithi064.stdout:3/390: unlink d1/d27/d29/d6f/d72/d7a/l8b 0 2024-04-26T21:08:02.648 INFO:tasks.workunit.client.1.smithi064.stdout:3/391: fsync d1/d27/d29/d6f/f86 0 2024-04-26T21:08:02.648 INFO:tasks.workunit.client.1.smithi064.stdout:3/392: creat d1/d27/d50/f91 x:0 0 0 2024-04-26T21:08:02.648 INFO:tasks.workunit.client.1.smithi064.stdout:0/382: symlink dd/d10/d1a/l76 0 2024-04-26T21:08:02.651 INFO:tasks.workunit.client.1.smithi064.stdout:0/383: stat dd/d10/l17 0 2024-04-26T21:08:02.653 INFO:tasks.workunit.client.1.smithi064.stdout:2/413: dwrite d12/d41/f4b [0,4194304] 0 2024-04-26T21:08:02.658 INFO:tasks.workunit.client.1.smithi064.stdout:2/414: unlink d12/d41/d61/c76 0 2024-04-26T21:08:02.668 INFO:tasks.workunit.client.1.smithi064.stdout:5/400: dwrite dd/d12/d18/d1a/d1f/f5a [0,4194304] 0 2024-04-26T21:08:02.668 INFO:tasks.workunit.client.1.smithi064.stdout:5/401: chown dd/d12/d18/d33/d48/d56/f62 137 1 2024-04-26T21:08:02.671 INFO:tasks.workunit.client.1.smithi064.stdout:5/402: creat dd/d12/d18/d33/d48/f7e x:0 0 0 2024-04-26T21:08:02.671 INFO:tasks.workunit.client.1.smithi064.stdout:5/403: write dd/d12/d18/d1a/d1f/f4b [17171,52859] 0 2024-04-26T21:08:02.675 INFO:tasks.workunit.client.1.smithi064.stdout:5/404: creat dd/d12/d18/d33/d63/f7f x:0 0 0 2024-04-26T21:08:02.676 INFO:tasks.workunit.client.1.smithi064.stdout:5/405: creat dd/d12/d18/d25/d32/f80 x:0 0 0 2024-04-26T21:08:02.676 INFO:tasks.workunit.client.1.smithi064.stdout:5/406: readlink dd/d12/d18/d25/l70 0 2024-04-26T21:08:02.704 INFO:tasks.workunit.client.0.smithi055.stdout:8/196: dwrite d3/d9/d1d/f25 [4194304,4194304] 0 2024-04-26T21:08:02.705 INFO:tasks.workunit.client.0.smithi055.stdout:7/264: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:02.707 INFO:tasks.workunit.client.1.smithi064.stdout:9/412: sync 2024-04-26T21:08:02.707 INFO:tasks.workunit.client.1.smithi064.stdout:9/413: fsync d0/d4/d28/d4f/d74/f85 0 2024-04-26T21:08:02.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/414: symlink d0/d4/d7/l86 0 2024-04-26T21:08:02.712 INFO:tasks.workunit.client.0.smithi055.stdout:7/265: mknod d5/d6/d24/c4a 0 2024-04-26T21:08:02.712 INFO:tasks.workunit.client.0.smithi055.stdout:7/266: creat d5/d6/d24/f4b x:0 0 0 2024-04-26T21:08:02.715 INFO:tasks.workunit.client.0.smithi055.stdout:8/197: dread d3/d9/f3b [0,4194304] 0 2024-04-26T21:08:02.715 INFO:tasks.workunit.client.0.smithi055.stdout:8/198: chown d3/ca 0 1 2024-04-26T21:08:02.719 INFO:tasks.workunit.client.1.smithi064.stdout:9/415: unlink d0/d39/c63 0 2024-04-26T21:08:02.719 INFO:tasks.workunit.client.1.smithi064.stdout:9/416: dread - d0/d4/da/f77 zero size 2024-04-26T21:08:02.719 INFO:tasks.workunit.client.1.smithi064.stdout:9/417: write d0/d4/da/f29 [1161470,85703] 0 2024-04-26T21:08:02.724 INFO:tasks.workunit.client.1.smithi064.stdout:9/418: unlink d0/d4/da/d26/d47/f81 0 2024-04-26T21:08:02.724 INFO:tasks.workunit.client.1.smithi064.stdout:9/419: fsync d0/d4/da/d26/d5e/f60 0 2024-04-26T21:08:02.729 INFO:tasks.workunit.client.1.smithi064.stdout:9/420: unlink d0/d4/f24 0 2024-04-26T21:08:02.744 INFO:tasks.workunit.client.0.smithi055.stdout:8/199: dread d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:02.765 INFO:tasks.workunit.client.1.smithi064.stdout:4/478: sync 2024-04-26T21:08:02.766 INFO:tasks.workunit.client.1.smithi064.stdout:4/479: truncate d0/d1d/f49 2027419 0 2024-04-26T21:08:02.767 INFO:tasks.workunit.client.1.smithi064.stdout:1/530: dwrite d0/d6/d11/f23 [0,4194304] 0 2024-04-26T21:08:02.767 INFO:tasks.workunit.client.1.smithi064.stdout:1/531: stat d0/d6/d11/d1e/d2a/d34/d57/c8c 0 2024-04-26T21:08:02.768 INFO:tasks.workunit.client.1.smithi064.stdout:6/356: dwrite d4/d7/d12/d38/f3f [0,4194304] 0 2024-04-26T21:08:02.768 INFO:tasks.workunit.client.1.smithi064.stdout:2/415: dwrite d12/d45/f56 [0,4194304] 0 2024-04-26T21:08:02.768 INFO:tasks.workunit.client.0.smithi055.stdout:5/153: dwrite d4/df/d13/f22 [0,4194304] 0 2024-04-26T21:08:02.772 INFO:tasks.workunit.client.1.smithi064.stdout:1/532: symlink d0/d6/la6 0 2024-04-26T21:08:02.774 INFO:tasks.workunit.client.0.smithi055.stdout:5/154: chown d4/f9 685768 1 2024-04-26T21:08:02.774 INFO:tasks.workunit.client.0.smithi055.stdout:5/155: chown d4/df/d13 335 1 2024-04-26T21:08:02.776 INFO:tasks.workunit.client.1.smithi064.stdout:6/357: mknod d4/d7/d12/d49/d4b/c72 0 2024-04-26T21:08:02.776 INFO:tasks.workunit.client.1.smithi064.stdout:6/358: creat d4/d7/d12/d38/f73 x:0 0 0 2024-04-26T21:08:02.776 INFO:tasks.workunit.client.0.smithi055.stdout:5/156: mkdir d4/df/d13/d26/d28/d2e 0 2024-04-26T21:08:02.776 INFO:tasks.workunit.client.0.smithi055.stdout:5/157: fdatasync d4/f9 0 2024-04-26T21:08:02.778 INFO:tasks.workunit.client.1.smithi064.stdout:2/416: rename d12/d41/d61/d75/l1e to d12/d28/d3a/d46/d48/d85/d2f/d53/l90 0 2024-04-26T21:08:02.779 INFO:tasks.workunit.client.1.smithi064.stdout:1/533: mkdir d0/d6/d76/da7 0 2024-04-26T21:08:02.780 INFO:tasks.workunit.client.1.smithi064.stdout:6/359: creat d4/d7/d12/d49/d4b/f74 x:0 0 0 2024-04-26T21:08:02.781 INFO:tasks.workunit.client.1.smithi064.stdout:2/417: mkdir d12/d28/d3a/d46/d91 0 2024-04-26T21:08:02.782 INFO:tasks.workunit.client.1.smithi064.stdout:6/360: mknod d4/d7/d12/d38/c75 0 2024-04-26T21:08:02.782 INFO:tasks.workunit.client.1.smithi064.stdout:2/418: mkdir d12/d28/d3a/d46/d91/d92 0 2024-04-26T21:08:02.783 INFO:tasks.workunit.client.1.smithi064.stdout:0/384: dwrite dd/d10/d1a/d31/d5c/f5e [0,4194304] 0 2024-04-26T21:08:02.783 INFO:tasks.workunit.client.0.smithi055.stdout:3/302: dwrite d0/d1/d47/d37/f6f [0,4194304] 0 2024-04-26T21:08:02.784 INFO:tasks.workunit.client.1.smithi064.stdout:6/361: symlink d4/d7/d33/l76 0 2024-04-26T21:08:02.784 INFO:tasks.workunit.client.1.smithi064.stdout:6/362: creat d4/d7/d12/f77 x:0 0 0 2024-04-26T21:08:02.784 INFO:tasks.workunit.client.1.smithi064.stdout:4/480: read d0/d5/d13/d6d/d97/f81 [3704543,126692] 0 2024-04-26T21:08:02.784 INFO:tasks.workunit.client.1.smithi064.stdout:4/481: chown d0/d14/f95 24 1 2024-04-26T21:08:02.785 INFO:tasks.workunit.client.0.smithi055.stdout:2/251: dwrite d4/dc/d21/f43 [0,4194304] 0 2024-04-26T21:08:02.787 INFO:tasks.workunit.client.1.smithi064.stdout:3/393: dwrite d1/d14/f31 [0,4194304] 0 2024-04-26T21:08:02.787 INFO:tasks.workunit.client.1.smithi064.stdout:3/394: fdatasync d1/d27/d50/d35/d4c/d7b/d82/f57 0 2024-04-26T21:08:02.788 INFO:tasks.workunit.client.1.smithi064.stdout:9/421: dwrite d0/d4/da/d31/d34/f49 [0,4194304] 0 2024-04-26T21:08:02.788 INFO:tasks.workunit.client.1.smithi064.stdout:5/407: dwrite dd/d12/d18/f2f [0,4194304] 0 2024-04-26T21:08:02.791 INFO:tasks.workunit.client.0.smithi055.stdout:7/267: dwrite d5/d6/ff [0,4194304] 0 2024-04-26T21:08:02.791 INFO:tasks.workunit.client.0.smithi055.stdout:7/268: chown d5/d6/d24/d3b/f42 49 1 2024-04-26T21:08:02.795 INFO:tasks.workunit.client.1.smithi064.stdout:2/419: creat d12/d41/d61/d75/f93 x:0 0 0 2024-04-26T21:08:02.796 INFO:tasks.workunit.client.1.smithi064.stdout:2/420: write d12/d28/d3a/d46/d48/d85/f67 [660118,808] 0 2024-04-26T21:08:02.796 INFO:tasks.workunit.client.1.smithi064.stdout:2/421: chown d12/d28/d3a/f58 998253 1 2024-04-26T21:08:02.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/363: mknod d4/d7/d12/c78 0 2024-04-26T21:08:02.798 INFO:tasks.workunit.client.0.smithi055.stdout:0/312: dwrite d9/dc/d17/f5f [4194304,4194304] 0 2024-04-26T21:08:02.801 INFO:tasks.workunit.client.1.smithi064.stdout:4/482: mkdir d0/d1d/d21/d9c 0 2024-04-26T21:08:02.811 INFO:tasks.workunit.client.0.smithi055.stdout:7/269: read d5/d11/f2f [2744676,89394] 0 2024-04-26T21:08:02.817 INFO:tasks.workunit.client.1.smithi064.stdout:9/422: mkdir d0/d4/da/d31/d34/d87 0 2024-04-26T21:08:02.823 INFO:tasks.workunit.client.1.smithi064.stdout:4/483: rmdir d0/d1d/d17/d93 0 2024-04-26T21:08:02.826 INFO:tasks.workunit.client.1.smithi064.stdout:1/534: dread d0/d6/d29/d31/f51 [0,4194304] 0 2024-04-26T21:08:02.827 INFO:tasks.workunit.client.1.smithi064.stdout:9/423: mkdir d0/d4/da/d26/d47/d88 0 2024-04-26T21:08:02.829 INFO:tasks.workunit.client.1.smithi064.stdout:8/342: sync 2024-04-26T21:08:02.837 INFO:tasks.workunit.client.0.smithi055.stdout:2/252: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:08:02.838 INFO:tasks.workunit.client.0.smithi055.stdout:2/253: chown d4/d1e/c28 1 1 2024-04-26T21:08:02.838 INFO:tasks.workunit.client.1.smithi064.stdout:9/424: creat d0/d4/d7/f89 x:0 0 0 2024-04-26T21:08:02.838 INFO:tasks.workunit.client.1.smithi064.stdout:9/425: creat d0/f8a x:0 0 0 2024-04-26T21:08:02.841 INFO:tasks.workunit.client.1.smithi064.stdout:5/408: rename dd/d12/d18/d25/d74/d76 to dd/d12/d18/d33/d48/d6a/d81 0 2024-04-26T21:08:02.842 INFO:tasks.workunit.client.1.smithi064.stdout:3/395: dread d1/d14/f3b [0,4194304] 0 2024-04-26T21:08:02.842 INFO:tasks.workunit.client.1.smithi064.stdout:8/343: creat d10/d41/d44/f6d x:0 0 0 2024-04-26T21:08:02.845 INFO:tasks.workunit.client.0.smithi055.stdout:2/254: creat d4/dc/f58 x:0 0 0 2024-04-26T21:08:02.845 INFO:tasks.workunit.client.0.smithi055.stdout:2/255: write d4/db/d1f/f29 [834562,109967] 0 2024-04-26T21:08:02.848 INFO:tasks.workunit.client.1.smithi064.stdout:9/426: link d0/d4/d28/d4f/f61 d0/d4/da/d31/d34/d87/f8b 0 2024-04-26T21:08:02.851 INFO:tasks.workunit.client.0.smithi055.stdout:8/200: dwrite d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:02.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/364: rmdir d4/d7/d12 39 2024-04-26T21:08:02.852 INFO:tasks.workunit.client.0.smithi055.stdout:2/256: getdents d4/db 0 2024-04-26T21:08:02.853 INFO:tasks.workunit.client.1.smithi064.stdout:3/396: unlink d1/d27/f3d 0 2024-04-26T21:08:02.856 INFO:tasks.workunit.client.0.smithi055.stdout:5/158: dwrite d4/df/d13/f21 [0,4194304] 0 2024-04-26T21:08:02.856 INFO:tasks.workunit.client.0.smithi055.stdout:5/159: fdatasync d4/df/d13/f21 0 2024-04-26T21:08:02.857 INFO:tasks.workunit.client.0.smithi055.stdout:2/257: link d4/d1e/d2a/f30 d4/d14/d33/f59 0 2024-04-26T21:08:02.857 INFO:tasks.workunit.client.1.smithi064.stdout:8/344: creat d10/d41/d4e/d59/f6e x:0 0 0 2024-04-26T21:08:02.858 INFO:tasks.workunit.client.0.smithi055.stdout:1/228: sync 2024-04-26T21:08:02.858 INFO:tasks.workunit.client.0.smithi055.stdout:4/148: sync 2024-04-26T21:08:02.858 INFO:tasks.workunit.client.0.smithi055.stdout:3/303: dwrite d0/d4/f40 [0,4194304] 0 2024-04-26T21:08:02.858 INFO:tasks.workunit.client.0.smithi055.stdout:3/304: creat d0/d1/d13/d1a/d46/d51/f71 x:0 0 0 2024-04-26T21:08:02.863 INFO:tasks.workunit.client.1.smithi064.stdout:0/385: dwrite dd/d21/f45 [0,4194304] 0 2024-04-26T21:08:02.867 INFO:tasks.workunit.client.0.smithi055.stdout:5/160: chown d4/f27 2023948 1 2024-04-26T21:08:02.868 INFO:tasks.workunit.client.1.smithi064.stdout:7/425: sync 2024-04-26T21:08:02.870 INFO:tasks.workunit.client.1.smithi064.stdout:2/422: rename d12/d28 to d12/d41/d73/d83/d94 0 2024-04-26T21:08:02.870 INFO:tasks.workunit.client.1.smithi064.stdout:2/423: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f49 [1658055,75884] 0 2024-04-26T21:08:02.871 INFO:tasks.workunit.client.1.smithi064.stdout:4/484: getdents d0/d1d/d17 0 2024-04-26T21:08:02.871 INFO:tasks.workunit.client.0.smithi055.stdout:2/258: creat d4/db/d1f/d46/f5a x:0 0 0 2024-04-26T21:08:02.872 INFO:tasks.workunit.client.0.smithi055.stdout:0/313: dwrite d9/dc/d17/f3f [0,4194304] 0 2024-04-26T21:08:02.872 INFO:tasks.workunit.client.0.smithi055.stdout:0/314: truncate d9/dc/f57 1216897 0 2024-04-26T21:08:02.872 INFO:tasks.workunit.client.0.smithi055.stdout:0/315: chown d9/dc/d17/l38 947467 1 2024-04-26T21:08:02.872 INFO:tasks.workunit.client.0.smithi055.stdout:4/149: rename d4/lc to d4/d12/d15/l34 0 2024-04-26T21:08:02.873 INFO:tasks.workunit.client.0.smithi055.stdout:4/150: chown d4 3 1 2024-04-26T21:08:02.874 INFO:tasks.workunit.client.1.smithi064.stdout:1/535: dwrite d0/d6/d11/d1e/f7b [0,4194304] 0 2024-04-26T21:08:02.875 INFO:tasks.workunit.client.0.smithi055.stdout:5/161: creat d4/df/d13/d26/f2f x:0 0 0 2024-04-26T21:08:02.876 INFO:tasks.workunit.client.1.smithi064.stdout:8/345: symlink d10/d41/d4e/l6f 0 2024-04-26T21:08:02.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/386: symlink dd/d10/d74/d4f/l77 0 2024-04-26T21:08:02.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/387: creat dd/d10/d1a/d31/d5c/f78 x:0 0 0 2024-04-26T21:08:02.878 INFO:tasks.workunit.client.1.smithi064.stdout:0/388: chown dd/d10/d18/d58/c73 56714500 1 2024-04-26T21:08:02.881 INFO:tasks.workunit.client.1.smithi064.stdout:7/426: truncate f5 773759 0 2024-04-26T21:08:02.886 INFO:tasks.workunit.client.0.smithi055.stdout:0/316: creat d9/dc/d1c/d3e/f6a x:0 0 0 2024-04-26T21:08:02.886 INFO:tasks.workunit.client.0.smithi055.stdout:0/317: readlink d9/dc/d17/l38 0 2024-04-26T21:08:02.886 INFO:tasks.workunit.client.0.smithi055.stdout:0/318: dread - d9/dc/d17/f61 zero size 2024-04-26T21:08:02.892 INFO:tasks.workunit.client.0.smithi055.stdout:4/151: rmdir d4/d18/d1a 39 2024-04-26T21:08:02.892 INFO:tasks.workunit.client.0.smithi055.stdout:4/152: fsync d4/f9 0 2024-04-26T21:08:02.898 INFO:tasks.workunit.client.1.smithi064.stdout:4/485: mknod d0/d2f/d87/c9d 0 2024-04-26T21:08:02.898 INFO:tasks.workunit.client.1.smithi064.stdout:1/536: read d0/d6/d11/d1e/d2a/d34/d57/d66/f7e [1302893,65305] 0 2024-04-26T21:08:02.898 INFO:tasks.workunit.client.1.smithi064.stdout:1/537: write d0/d6/d11/d1e/f46 [543858,67622] 0 2024-04-26T21:08:02.898 INFO:tasks.workunit.client.1.smithi064.stdout:1/538: creat d0/d6b/fa8 x:0 0 0 2024-04-26T21:08:02.898 INFO:tasks.workunit.client.1.smithi064.stdout:1/539: stat d0/d6/d11/d1e/d2a/d34/f75 0 2024-04-26T21:08:02.903 INFO:tasks.workunit.client.0.smithi055.stdout:6/256: sync 2024-04-26T21:08:02.903 INFO:tasks.workunit.client.0.smithi055.stdout:9/245: sync 2024-04-26T21:08:02.905 INFO:tasks.workunit.client.1.smithi064.stdout:0/389: creat dd/d10/d74/d1d/f79 x:0 0 0 2024-04-26T21:08:02.905 INFO:tasks.workunit.client.1.smithi064.stdout:0/390: write dd/f30 [3714612,102649] 0 2024-04-26T21:08:02.905 INFO:tasks.workunit.client.1.smithi064.stdout:0/391: chown dd/d10/d1a/d31/d47/d61/d42/l4e 2046136 1 2024-04-26T21:08:02.907 INFO:tasks.workunit.client.1.smithi064.stdout:7/427: symlink d6/d15/d67/d4d/l93 0 2024-04-26T21:08:02.907 INFO:tasks.workunit.client.1.smithi064.stdout:7/428: truncate d6/d9/d3d/f92 253357 0 2024-04-26T21:08:02.907 INFO:tasks.workunit.client.1.smithi064.stdout:7/429: read d6/d9/f36 [688261,26817] 0 2024-04-26T21:08:02.907 INFO:tasks.workunit.client.0.smithi055.stdout:2/259: rmdir d4/dc/d21 39 2024-04-26T21:08:02.910 INFO:tasks.workunit.client.0.smithi055.stdout:0/319: mknod d9/c6b 0 2024-04-26T21:08:02.910 INFO:tasks.workunit.client.0.smithi055.stdout:0/320: dread - d9/dc/d1c/d3b/f60 zero size 2024-04-26T21:08:02.915 INFO:tasks.workunit.client.0.smithi055.stdout:0/321: dread d9/dc/d1c/f4f [0,4194304] 0 2024-04-26T21:08:02.915 INFO:tasks.workunit.client.0.smithi055.stdout:0/322: chown d9/dc/d17/f30 0 1 2024-04-26T21:08:02.916 INFO:tasks.workunit.client.1.smithi064.stdout:0/392: rename dd/d10/d1a/d31/d47/d61/f69 to dd/d10/d1a/d31/f7a 0 2024-04-26T21:08:02.916 INFO:tasks.workunit.client.1.smithi064.stdout:0/393: readlink l2 0 2024-04-26T21:08:02.916 INFO:tasks.workunit.client.1.smithi064.stdout:0/394: stat dd/d10/d1a/d31/d43/l71 0 2024-04-26T21:08:02.917 INFO:tasks.workunit.client.1.smithi064.stdout:7/430: creat d6/d15/d67/f94 x:0 0 0 2024-04-26T21:08:02.920 INFO:tasks.workunit.client.0.smithi055.stdout:6/257: creat d3/d17/d19/d20/d3e/f53 x:0 0 0 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:6/258: write d3/d17/d19/d20/d3e/f53 [788661,117538] 0 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:6/259: chown d3/l52 0 1 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:6/260: truncate d3/d17/f34 1016019 0 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:5/162: getdents d4/df/d13 0 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:5/163: write d4/df/d13/d26/f2f [210825,16216] 0 2024-04-26T21:08:02.923 INFO:tasks.workunit.client.0.smithi055.stdout:5/164: creat d4/df/f30 x:0 0 0 2024-04-26T21:08:02.924 INFO:tasks.workunit.client.0.smithi055.stdout:3/305: rename d0/d1/d47/d42 to d0/d1/d13/d1a/d46/d72 0 2024-04-26T21:08:02.924 INFO:tasks.workunit.client.1.smithi064.stdout:7/431: creat d6/d9/d38/f95 x:0 0 0 2024-04-26T21:08:02.926 INFO:tasks.workunit.client.0.smithi055.stdout:0/323: mkdir d9/d11/d5b/d5e/d6c 0 2024-04-26T21:08:02.929 INFO:tasks.workunit.client.1.smithi064.stdout:1/540: write d0/d6/d29/d31/f51 [3334573,43978] 0 2024-04-26T21:08:02.930 INFO:tasks.workunit.client.0.smithi055.stdout:6/261: mkdir d3/d17/d46/d54 0 2024-04-26T21:08:02.930 INFO:tasks.workunit.client.0.smithi055.stdout:6/262: stat d3/l52 0 2024-04-26T21:08:02.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/541: creat d0/d6/dd/fa9 x:0 0 0 2024-04-26T21:08:02.933 INFO:tasks.workunit.client.1.smithi064.stdout:7/432: link d6/f91 d6/db/d34/f96 0 2024-04-26T21:08:02.934 INFO:tasks.workunit.client.0.smithi055.stdout:1/229: dwrite d8/d17/d1b/f20 [0,4194304] 0 2024-04-26T21:08:02.935 INFO:tasks.workunit.client.0.smithi055.stdout:1/230: fsync d8/d17/f18 0 2024-04-26T21:08:02.935 INFO:tasks.workunit.client.0.smithi055.stdout:4/153: dread d4/f21 [0,4194304] 0 2024-04-26T21:08:02.935 INFO:tasks.workunit.client.0.smithi055.stdout:3/306: getdents d0/d1/d13/d27 0 2024-04-26T21:08:02.936 INFO:tasks.workunit.client.1.smithi064.stdout:6/365: dwrite d4/d7/f71 [0,4194304] 0 2024-04-26T21:08:02.941 INFO:tasks.workunit.client.1.smithi064.stdout:3/397: dwrite d1/f8 [4194304,4194304] 0 2024-04-26T21:08:02.943 INFO:tasks.workunit.client.1.smithi064.stdout:7/433: symlink d6/d9/d77/l97 0 2024-04-26T21:08:02.944 INFO:tasks.workunit.client.1.smithi064.stdout:7/434: creat d6/d9/d3d/d43/f98 x:0 0 0 2024-04-26T21:08:02.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/263: symlink d3/d4f/l55 0 2024-04-26T21:08:02.949 INFO:tasks.workunit.client.1.smithi064.stdout:5/409: dwrite dd/d12/d18/d33/d63/f7f [0,4194304] 0 2024-04-26T21:08:02.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/260: read d4/dc/f1d [520023,41340] 0 2024-04-26T21:08:02.949 INFO:tasks.workunit.client.0.smithi055.stdout:2/261: dread - d4/d1e/f4f zero size 2024-04-26T21:08:02.950 INFO:tasks.workunit.client.0.smithi055.stdout:5/165: dread d4/f6 [0,4194304] 0 2024-04-26T21:08:02.951 INFO:tasks.workunit.client.0.smithi055.stdout:2/262: write d4/dc/f16 [530981,79956] 0 2024-04-26T21:08:02.952 INFO:tasks.workunit.client.1.smithi064.stdout:6/366: mkdir d4/d7/d12/d49/d4b/d5a/d79 0 2024-04-26T21:08:02.954 INFO:tasks.workunit.client.0.smithi055.stdout:4/154: symlink d4/d12/d15/l35 0 2024-04-26T21:08:02.954 INFO:tasks.workunit.client.0.smithi055.stdout:1/231: rename d8/d17/d36/c42 to d8/df/d11/d44/c4f 0 2024-04-26T21:08:02.958 INFO:tasks.workunit.client.0.smithi055.stdout:5/166: link d4/df/d13/d26/d28/f2c d4/df/d13/d26/f31 0 2024-04-26T21:08:02.958 INFO:tasks.workunit.client.0.smithi055.stdout:5/167: creat d4/df/d13/d26/f32 x:0 0 0 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/435: write d6/db/d34/d41/d5c/f7b [1710491,86158] 0 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/436: chown d6/db/d8e/d90 118752 1 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/437: stat d6/d15/d1c 0 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/438: chown d6/db/c20 16 1 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/439: write d6/d9/f1a [1171235,112610] 0 2024-04-26T21:08:02.963 INFO:tasks.workunit.client.0.smithi055.stdout:2/263: mknod d4/d14/d17/c5b 0 2024-04-26T21:08:02.964 INFO:tasks.workunit.client.1.smithi064.stdout:5/410: creat dd/d12/d18/d25/d74/f82 x:0 0 0 2024-04-26T21:08:02.964 INFO:tasks.workunit.client.0.smithi055.stdout:4/155: link d4/f30 d4/f36 0 2024-04-26T21:08:02.964 INFO:tasks.workunit.client.0.smithi055.stdout:4/156: fdatasync d4/ff 0 2024-04-26T21:08:02.965 INFO:tasks.workunit.client.0.smithi055.stdout:4/157: readlink d4/l7 0 2024-04-26T21:08:02.965 INFO:tasks.workunit.client.0.smithi055.stdout:4/158: fdatasync d4/f9 0 2024-04-26T21:08:02.965 INFO:tasks.workunit.client.1.smithi064.stdout:9/427: dwrite d0/d4/d7/df/f40 [4194304,4194304] 0 2024-04-26T21:08:02.965 INFO:tasks.workunit.client.1.smithi064.stdout:9/428: fdatasync d0/d4/d7/f33 0 2024-04-26T21:08:02.965 INFO:tasks.workunit.client.1.smithi064.stdout:9/429: chown d0/d4/da/d31/d34/c35 1217958 1 2024-04-26T21:08:02.966 INFO:tasks.workunit.client.1.smithi064.stdout:6/367: mknod d4/d7/d12/d49/d4b/c7a 0 2024-04-26T21:08:02.966 INFO:tasks.workunit.client.1.smithi064.stdout:6/368: write d4/d7/d12/d38/f3c [1767747,49248] 0 2024-04-26T21:08:02.966 INFO:tasks.workunit.client.1.smithi064.stdout:6/369: write d4/d7/d12/d49/d4b/f74 [821763,25617] 0 2024-04-26T21:08:02.968 INFO:tasks.workunit.client.1.smithi064.stdout:4/486: dwrite d0/d1d/d17/d44/d45/f5c [4194304,4194304] 0 2024-04-26T21:08:02.968 INFO:tasks.workunit.client.1.smithi064.stdout:3/398: getdents d1/d27/d50/d35/d4c 0 2024-04-26T21:08:02.969 INFO:tasks.workunit.client.0.smithi055.stdout:9/246: dwrite d2/f1e [4194304,4194304] 0 2024-04-26T21:08:02.969 INFO:tasks.workunit.client.0.smithi055.stdout:9/247: creat d2/f55 x:0 0 0 2024-04-26T21:08:02.969 INFO:tasks.workunit.client.0.smithi055.stdout:9/248: truncate d2/d11/f26 366026 0 2024-04-26T21:08:02.969 INFO:tasks.workunit.client.0.smithi055.stdout:9/249: stat d2/d14/d33/l4c 0 2024-04-26T21:08:02.973 INFO:tasks.workunit.client.0.smithi055.stdout:1/232: symlink d8/df/l50 0 2024-04-26T21:08:02.973 INFO:tasks.workunit.client.0.smithi055.stdout:1/233: fsync d8/d17/f47 0 2024-04-26T21:08:02.974 INFO:tasks.workunit.client.0.smithi055.stdout:1/234: creat d8/df/d11/d27/d28/d3d/f51 x:0 0 0 2024-04-26T21:08:02.974 INFO:tasks.workunit.client.0.smithi055.stdout:2/264: getdents d4/db/d1f 0 2024-04-26T21:08:02.974 INFO:tasks.workunit.client.0.smithi055.stdout:1/235: creat d8/df/d11/d27/d28/d3d/f52 x:0 0 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/411: symlink dd/d12/d18/d1a/d1b/l83 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/412: readlink dd/d12/d18/d25/d32/l51 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/413: creat dd/d12/d18/d33/d63/f84 x:0 0 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/414: creat dd/d12/d18/d25/d67/f85 x:0 0 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/415: write dd/d12/d18/d33/d48/d6a/f79 [268054,56550] 0 2024-04-26T21:08:02.980 INFO:tasks.workunit.client.1.smithi064.stdout:7/440: write d6/db/d34/d41/f49 [165605,93650] 0 2024-04-26T21:08:02.986 INFO:tasks.workunit.client.0.smithi055.stdout:9/250: mknod d2/d46/d51/c56 0 2024-04-26T21:08:02.987 INFO:tasks.workunit.client.1.smithi064.stdout:9/430: truncate d0/d4/f2a 2359380 0 2024-04-26T21:08:02.987 INFO:tasks.workunit.client.1.smithi064.stdout:9/431: chown d0/d4/d7/f54 1006852141 1 2024-04-26T21:08:02.987 INFO:tasks.workunit.client.1.smithi064.stdout:9/432: fdatasync d0/d39/f5c 0 2024-04-26T21:08:02.988 INFO:tasks.workunit.client.0.smithi055.stdout:4/159: write d4/f36 [4547830,7483] 0 2024-04-26T21:08:02.989 INFO:tasks.workunit.client.1.smithi064.stdout:4/487: symlink d0/d5/d3e/l9e 0 2024-04-26T21:08:02.994 INFO:tasks.workunit.client.1.smithi064.stdout:0/395: dwrite dd/d10/d1a/d31/d47/f66 [0,4194304] 0 2024-04-26T21:08:03.000 INFO:tasks.workunit.client.1.smithi064.stdout:2/424: dwrite d12/d41/d73/d83/d94/d3a/f58 [0,4194304] 0 2024-04-26T21:08:03.003 INFO:tasks.workunit.client.1.smithi064.stdout:5/416: unlink dd/d12/d18/c23 0 2024-04-26T21:08:03.004 INFO:tasks.workunit.client.0.smithi055.stdout:3/307: rename d0/d1 to d0/d4/d5/d73 0 2024-04-26T21:08:03.004 INFO:tasks.workunit.client.0.smithi055.stdout:3/308: chown d0/d4/d5/d73/d47/d37/d3d/d4c 94502886 1 2024-04-26T21:08:03.008 INFO:tasks.workunit.client.0.smithi055.stdout:1/236: readlink d8/lc 0 2024-04-26T21:08:03.008 INFO:tasks.workunit.client.1.smithi064.stdout:7/441: mkdir d6/d70/d74/d99 0 2024-04-26T21:08:03.008 INFO:tasks.workunit.client.1.smithi064.stdout:7/442: chown d6/db/l16 1714601421 1 2024-04-26T21:08:03.011 INFO:tasks.workunit.client.1.smithi064.stdout:9/433: link d0/d4/da/f14 d0/d4/d28/d4f/d74/f8c 0 2024-04-26T21:08:03.011 INFO:tasks.workunit.client.1.smithi064.stdout:8/346: dwrite d10/d1d/f3d [0,4194304] 0 2024-04-26T21:08:03.012 INFO:tasks.workunit.client.0.smithi055.stdout:2/265: mknod d4/d14/c5c 0 2024-04-26T21:08:03.012 INFO:tasks.workunit.client.0.smithi055.stdout:2/266: creat d4/d14/d17/f5d x:0 0 0 2024-04-26T21:08:03.017 INFO:tasks.workunit.client.1.smithi064.stdout:4/488: mknod d0/d5/d13/d33/c9f 0 2024-04-26T21:08:03.017 INFO:tasks.workunit.client.1.smithi064.stdout:4/489: chown d0/d5/f7c 5 1 2024-04-26T21:08:03.018 INFO:tasks.workunit.client.0.smithi055.stdout:9/251: mkdir d2/d14/d57 0 2024-04-26T21:08:03.022 INFO:tasks.workunit.client.0.smithi055.stdout:4/160: creat d4/d18/d1a/f37 x:0 0 0 2024-04-26T21:08:03.022 INFO:tasks.workunit.client.1.smithi064.stdout:2/425: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f [1557710,97061] 0 2024-04-26T21:08:03.025 INFO:tasks.workunit.client.1.smithi064.stdout:5/417: write f9 [4143136,15516] 0 2024-04-26T21:08:03.025 INFO:tasks.workunit.client.1.smithi064.stdout:6/370: getdents d4/d7/d12/d49/d4b/d5a 0 2024-04-26T21:08:03.025 INFO:tasks.workunit.client.1.smithi064.stdout:6/371: stat d4/d7/d12/d38 0 2024-04-26T21:08:03.031 INFO:tasks.workunit.client.0.smithi055.stdout:3/309: link d0/de/l2d d0/d4/l74 0 2024-04-26T21:08:03.031 INFO:tasks.workunit.client.0.smithi055.stdout:3/310: chown d0/de/l2d 17522844 1 2024-04-26T21:08:03.031 INFO:tasks.workunit.client.0.smithi055.stdout:3/311: write d0/d4/f40 [5160422,21279] 0 2024-04-26T21:08:03.031 INFO:tasks.workunit.client.0.smithi055.stdout:3/312: chown d0/d4/d5/d73/d47 1886 1 2024-04-26T21:08:03.032 INFO:tasks.workunit.client.0.smithi055.stdout:5/168: dwrite d4/d15/f1a [0,4194304] 0 2024-04-26T21:08:03.033 INFO:tasks.workunit.client.0.smithi055.stdout:1/237: rename d8/df/d11/d27/d28/d2a/c39 to d8/df/d11/d27/d28/d2a/c53 0 2024-04-26T21:08:03.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/399: dwrite d1/d27/d50/f39 [0,4194304] 0 2024-04-26T21:08:03.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/400: truncate d1/d27/f59 323907 0 2024-04-26T21:08:03.038 INFO:tasks.workunit.client.0.smithi055.stdout:8/201: dwrite d3/d9/d1f/f32 [0,4194304] 0 2024-04-26T21:08:03.042 INFO:tasks.workunit.client.0.smithi055.stdout:8/202: write d3/d9/d1f/f31 [2165358,45985] 0 2024-04-26T21:08:03.043 INFO:tasks.workunit.client.0.smithi055.stdout:2/267: mkdir d4/d49/d4c/d5e 0 2024-04-26T21:08:03.043 INFO:tasks.workunit.client.0.smithi055.stdout:2/268: write d4/db/d56/d4a/f53 [172898,93304] 0 2024-04-26T21:08:03.053 INFO:tasks.workunit.client.0.smithi055.stdout:3/313: mknod d0/d4/d5/d73/d47/d37/d3d/d4c/c75 0 2024-04-26T21:08:03.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/443: dread d6/d15/d1c/f2e [0,4194304] 0 2024-04-26T21:08:03.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/444: write d6/d9/f37 [4814428,60826] 0 2024-04-26T21:08:03.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/445: dread - d6/d9/d77/f8a zero size 2024-04-26T21:08:03.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/446: fdatasync d6/d9/f1a 0 2024-04-26T21:08:03.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/447: chown d6/d9/d3d/d43 93211057 1 2024-04-26T21:08:03.056 INFO:tasks.workunit.client.0.smithi055.stdout:4/161: write d4/f1d [833190,75577] 0 2024-04-26T21:08:03.058 INFO:tasks.workunit.client.1.smithi064.stdout:9/434: dread d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:03.060 INFO:tasks.workunit.client.1.smithi064.stdout:9/435: write d0/d4/da/d31/d34/d87/f8b [467627,32498] 0 2024-04-26T21:08:03.063 INFO:tasks.workunit.client.0.smithi055.stdout:5/169: symlink d4/df/l33 0 2024-04-26T21:08:03.072 INFO:tasks.workunit.client.1.smithi064.stdout:0/396: mkdir dd/d10/d74/d4f/d7b 0 2024-04-26T21:08:03.081 INFO:tasks.workunit.client.1.smithi064.stdout:4/490: mkdir d0/d1d/d17/d44/d45/da0 0 2024-04-26T21:08:03.081 INFO:tasks.workunit.client.0.smithi055.stdout:5/170: dread d4/df/d13/f21 [4194304,4194304] 0 2024-04-26T21:08:03.082 INFO:tasks.workunit.client.0.smithi055.stdout:8/203: creat d3/d9/d1f/d2e/f40 x:0 0 0 2024-04-26T21:08:03.085 INFO:tasks.workunit.client.1.smithi064.stdout:2/426: mknod d12/d41/d73/d83/d94/d3a/c95 0 2024-04-26T21:08:03.086 INFO:tasks.workunit.client.0.smithi055.stdout:2/269: creat d4/db/d1f/d32/f5f x:0 0 0 2024-04-26T21:08:03.087 INFO:tasks.workunit.client.0.smithi055.stdout:2/270: stat d4/d1e/c3f 0 2024-04-26T21:08:03.088 INFO:tasks.workunit.client.1.smithi064.stdout:5/418: mknod dd/d12/c86 0 2024-04-26T21:08:03.088 INFO:tasks.workunit.client.1.smithi064.stdout:5/419: chown dd/d12/c17 1279399707 1 2024-04-26T21:08:03.088 INFO:tasks.workunit.client.1.smithi064.stdout:5/420: readlink dd/l4d 0 2024-04-26T21:08:03.088 INFO:tasks.workunit.client.1.smithi064.stdout:5/421: chown dd/d12/d18/d1a/d1f/d20/f38 1292245 1 2024-04-26T21:08:03.088 INFO:tasks.workunit.client.0.smithi055.stdout:4/162: creat d4/d18/d1e/f38 x:0 0 0 2024-04-26T21:08:03.092 INFO:tasks.workunit.client.1.smithi064.stdout:3/401: dread d1/d27/d50/f52 [0,4194304] 0 2024-04-26T21:08:03.092 INFO:tasks.workunit.client.1.smithi064.stdout:3/402: creat d1/d27/d29/f92 x:0 0 0 2024-04-26T21:08:03.093 INFO:tasks.workunit.client.1.smithi064.stdout:3/403: creat d1/d12/f93 x:0 0 0 2024-04-26T21:08:03.098 INFO:tasks.workunit.client.0.smithi055.stdout:5/171: link d4/df/l33 d4/df/l34 0 2024-04-26T21:08:03.098 INFO:tasks.workunit.client.0.smithi055.stdout:5/172: stat d4/df/d13/d26/d28/f2c 0 2024-04-26T21:08:03.105 INFO:tasks.workunit.client.0.smithi055.stdout:1/238: dwrite d8/df/d11/d27/d28/f29 [0,4194304] 0 2024-04-26T21:08:03.105 INFO:tasks.workunit.client.0.smithi055.stdout:1/239: dread - d8/df/d11/d27/d28/f4a zero size 2024-04-26T21:08:03.105 INFO:tasks.workunit.client.0.smithi055.stdout:1/240: stat d8/df/d11/d27/d28 0 2024-04-26T21:08:03.108 INFO:tasks.workunit.client.0.smithi055.stdout:6/264: dwrite f0 [0,4194304] 0 2024-04-26T21:08:03.114 INFO:tasks.workunit.client.0.smithi055.stdout:1/241: unlink d8/d17/f47 0 2024-04-26T21:08:03.115 INFO:tasks.workunit.client.0.smithi055.stdout:1/242: dread - d8/df/d11/d27/d28/f40 zero size 2024-04-26T21:08:03.115 INFO:tasks.workunit.client.0.smithi055.stdout:1/243: truncate d8/df/d11/d27/f3f 4262706 0 2024-04-26T21:08:03.118 INFO:tasks.workunit.client.1.smithi064.stdout:6/372: dwrite d4/d7/d12/d38/f61 [0,4194304] 0 2024-04-26T21:08:03.118 INFO:tasks.workunit.client.1.smithi064.stdout:6/373: stat d4/d7/l40 0 2024-04-26T21:08:03.119 INFO:tasks.workunit.client.0.smithi055.stdout:9/252: dwrite d2/d11/f4b [0,4194304] 0 2024-04-26T21:08:03.119 INFO:tasks.workunit.client.0.smithi055.stdout:6/265: dread d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:03.120 INFO:tasks.workunit.client.1.smithi064.stdout:0/397: creat dd/d10/d18/d64/f7c x:0 0 0 2024-04-26T21:08:03.120 INFO:tasks.workunit.client.0.smithi055.stdout:5/173: symlink d4/l35 0 2024-04-26T21:08:03.121 INFO:tasks.workunit.client.0.smithi055.stdout:5/174: rename d4/df to d4/df/d13/d26/d28/d2e/d36 22 2024-04-26T21:08:03.122 INFO:tasks.workunit.client.1.smithi064.stdout:4/491: mkdir d0/d5/d79/da1 0 2024-04-26T21:08:03.124 INFO:tasks.workunit.client.0.smithi055.stdout:1/244: creat d8/df/d11/d44/f54 x:0 0 0 2024-04-26T21:08:03.124 INFO:tasks.workunit.client.0.smithi055.stdout:1/245: readlink d8/df/d11/l1c 0 2024-04-26T21:08:03.124 INFO:tasks.workunit.client.0.smithi055.stdout:1/246: write d8/d17/d1b/f20 [4718920,9581] 0 2024-04-26T21:08:03.124 INFO:tasks.workunit.client.0.smithi055.stdout:1/247: dread - d8/df/d11/d44/f54 zero size 2024-04-26T21:08:03.129 INFO:tasks.workunit.client.1.smithi064.stdout:9/436: dwrite d0/d4/d28/d4f/d74/f84 [0,4194304] 0 2024-04-26T21:08:03.129 INFO:tasks.workunit.client.1.smithi064.stdout:9/437: fdatasync d0/f59 0 2024-04-26T21:08:03.141 INFO:tasks.workunit.client.1.smithi064.stdout:4/492: dread d0/d5/d3e/d54/f5f [0,4194304] 0 2024-04-26T21:08:03.141 INFO:tasks.workunit.client.1.smithi064.stdout:4/493: chown d0/d5/f74 1764537 1 2024-04-26T21:08:03.143 INFO:tasks.workunit.client.0.smithi055.stdout:4/163: dread d4/f21 [0,4194304] 0 2024-04-26T21:08:03.152 INFO:tasks.workunit.client.0.smithi055.stdout:3/314: dwrite d0/d4/d5/d73/f14 [4194304,4194304] 0 2024-04-26T21:08:03.152 INFO:tasks.workunit.client.0.smithi055.stdout:3/315: dread - d0/d4/d5/d73/d13/d1a/d46/d55/f59 zero size 2024-04-26T21:08:03.152 INFO:tasks.workunit.client.0.smithi055.stdout:2/271: dread d4/db/d26/f4d [0,4194304] 0 2024-04-26T21:08:03.152 INFO:tasks.workunit.client.0.smithi055.stdout:2/272: stat d4/db/d1f 0 2024-04-26T21:08:03.154 INFO:tasks.workunit.client.1.smithi064.stdout:3/404: dwrite d1/d27/d29/f67 [0,4194304] 0 2024-04-26T21:08:03.154 INFO:tasks.workunit.client.1.smithi064.stdout:3/405: fdatasync d1/f8 0 2024-04-26T21:08:03.167 INFO:tasks.workunit.client.0.smithi055.stdout:8/204: dwrite d3/d9/fe [0,4194304] 0 2024-04-26T21:08:03.179 INFO:tasks.workunit.client.1.smithi064.stdout:2/427: mkdir d12/d41/d73/d83/d94/d3a/d46/d91/d96 0 2024-04-26T21:08:03.179 INFO:tasks.workunit.client.1.smithi064.stdout:2/428: rename d12/d41/d73/d83/d94 to d12/d41/d73/d83/d94/d3a/d5d/d97 22 2024-04-26T21:08:03.179 INFO:tasks.workunit.client.1.smithi064.stdout:2/429: creat d12/d45/f98 x:0 0 0 2024-04-26T21:08:03.180 INFO:tasks.workunit.client.0.smithi055.stdout:9/253: link d2/d14/f4f d2/d14/d33/f58 0 2024-04-26T21:08:03.181 INFO:tasks.workunit.client.1.smithi064.stdout:5/422: mkdir dd/d12/d18/d1a/d1f/d20/d87 0 2024-04-26T21:08:03.182 INFO:tasks.workunit.client.0.smithi055.stdout:6/266: creat d3/d17/d19/d20/f56 x:0 0 0 2024-04-26T21:08:03.190 INFO:tasks.workunit.client.1.smithi064.stdout:7/448: truncate d6/db/d34/d41/f49 597497 0 2024-04-26T21:08:03.190 INFO:tasks.workunit.client.1.smithi064.stdout:7/449: fdatasync d6/db/f2a 0 2024-04-26T21:08:03.190 INFO:tasks.workunit.client.1.smithi064.stdout:7/450: write d6/d5a/d5f/f66 [4651540,21736] 0 2024-04-26T21:08:03.191 INFO:tasks.workunit.client.1.smithi064.stdout:7/451: read - d6/d15/d1c/d45/f47 zero size 2024-04-26T21:08:03.191 INFO:tasks.workunit.client.1.smithi064.stdout:7/452: chown d6/d15/l63 21926 1 2024-04-26T21:08:03.193 INFO:tasks.workunit.client.0.smithi055.stdout:4/164: rmdir d4/d18/d1e/d2d/d31 0 2024-04-26T21:08:03.196 INFO:tasks.workunit.client.0.smithi055.stdout:5/175: dwrite d4/df/d13/f22 [0,4194304] 0 2024-04-26T21:08:03.198 INFO:tasks.workunit.client.1.smithi064.stdout:5/423: dread fb [0,4194304] 0 2024-04-26T21:08:03.201 INFO:tasks.workunit.client.1.smithi064.stdout:6/374: symlink d4/d7/d12/d49/l7b 0 2024-04-26T21:08:03.201 INFO:tasks.workunit.client.0.smithi055.stdout:6/267: dread d3/f30 [0,4194304] 0 2024-04-26T21:08:03.226 INFO:tasks.workunit.client.0.smithi055.stdout:2/273: mknod d4/d14/d33/c60 0 2024-04-26T21:08:03.228 INFO:tasks.workunit.client.1.smithi064.stdout:6/375: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:08:03.238 INFO:tasks.workunit.client.1.smithi064.stdout:9/438: truncate d0/d4/d7/f54 1845988 0 2024-04-26T21:08:03.250 INFO:tasks.workunit.client.1.smithi064.stdout:9/439: dread d0/d4/da/d26/d5e/f69 [0,4194304] 0 2024-04-26T21:08:03.250 INFO:tasks.workunit.client.1.smithi064.stdout:9/440: chown d0/d4/da/d26/d47/d6b/l7e 61865 1 2024-04-26T21:08:03.256 INFO:tasks.workunit.client.1.smithi064.stdout:1/542: sync 2024-04-26T21:08:03.256 INFO:tasks.workunit.client.1.smithi064.stdout:1/543: stat d0/d6/f74 0 2024-04-26T21:08:03.256 INFO:tasks.workunit.client.1.smithi064.stdout:1/544: chown d0/d6b/fa8 137970595 1 2024-04-26T21:08:03.256 INFO:tasks.workunit.client.1.smithi064.stdout:5/424: dwrite dd/d12/f3f [0,4194304] 0 2024-04-26T21:08:03.257 INFO:tasks.workunit.client.1.smithi064.stdout:5/425: readlink dd/d12/d18/d1a/d1f/d20/l68 0 2024-04-26T21:08:03.257 INFO:tasks.workunit.client.1.smithi064.stdout:5/426: chown dd/d12/d18/d25/d74/f82 26581 1 2024-04-26T21:08:03.257 INFO:tasks.workunit.client.1.smithi064.stdout:5/427: chown dd/d12/d18/d25 967092 1 2024-04-26T21:08:03.267 INFO:tasks.workunit.client.0.smithi055.stdout:3/316: dwrite d0/d4/d5/d73/d47/d37/d3d/d4c/f63 [0,4194304] 0 2024-04-26T21:08:03.267 INFO:tasks.workunit.client.0.smithi055.stdout:3/317: truncate d0/d4/d5/d73/f2e 4592457 0 2024-04-26T21:08:03.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/205: rmdir d3 39 2024-04-26T21:08:03.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/206: stat d3/f14 0 2024-04-26T21:08:03.295 INFO:tasks.workunit.client.1.smithi064.stdout:4/494: creat d0/d1d/d21/d9c/fa2 x:0 0 0 2024-04-26T21:08:03.305 INFO:tasks.workunit.client.0.smithi055.stdout:9/254: dwrite d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:03.305 INFO:tasks.workunit.client.0.smithi055.stdout:9/255: creat d2/d14/f59 x:0 0 0 2024-04-26T21:08:03.308 INFO:tasks.workunit.client.1.smithi064.stdout:3/406: mknod d1/d27/d50/d35/d4c/c94 0 2024-04-26T21:08:03.329 INFO:tasks.workunit.client.0.smithi055.stdout:5/176: creat d4/df/d13/f37 x:0 0 0 2024-04-26T21:08:03.333 INFO:tasks.workunit.client.1.smithi064.stdout:3/407: write d1/f51 [2818383,122008] 0 2024-04-26T21:08:03.333 INFO:tasks.workunit.client.1.smithi064.stdout:3/408: write d1/fc [8836322,92307] 0 2024-04-26T21:08:03.333 INFO:tasks.workunit.client.1.smithi064.stdout:3/409: write d1/d27/d50/d35/d4c/f83 [366360,58633] 0 2024-04-26T21:08:03.334 INFO:tasks.workunit.client.0.smithi055.stdout:2/274: symlink d4/d14/d17/l61 0 2024-04-26T21:08:03.335 INFO:tasks.workunit.client.0.smithi055.stdout:2/275: chown d4/db/d1f 527837481 1 2024-04-26T21:08:03.337 INFO:tasks.workunit.client.0.smithi055.stdout:3/318: unlink d0/d4/l6d 0 2024-04-26T21:08:03.346 INFO:tasks.workunit.client.1.smithi064.stdout:2/430: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99 0 2024-04-26T21:08:03.348 INFO:tasks.workunit.client.0.smithi055.stdout:9/256: rmdir d2/d14/d57 0 2024-04-26T21:08:03.352 INFO:tasks.workunit.client.1.smithi064.stdout:7/453: chown d6/d5a/l13 15972986 1 2024-04-26T21:08:03.356 INFO:tasks.workunit.client.0.smithi055.stdout:4/165: truncate d4/f30 5186571 0 2024-04-26T21:08:03.358 INFO:tasks.workunit.client.1.smithi064.stdout:6/376: getdents d4/d7/d12/d49/d4b/d56 0 2024-04-26T21:08:03.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/276: write d4/dc/d21/f43 [2191449,61220] 0 2024-04-26T21:08:03.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/277: creat d4/d1e/d2a/f62 x:0 0 0 2024-04-26T21:08:03.361 INFO:tasks.workunit.client.0.smithi055.stdout:3/319: creat d0/d4/d5/d73/d47/f76 x:0 0 0 2024-04-26T21:08:03.374 INFO:tasks.workunit.client.1.smithi064.stdout:1/545: creat d0/d6/d11/d1e/d2a/d34/d57/faa x:0 0 0 2024-04-26T21:08:03.376 INFO:tasks.workunit.client.0.smithi055.stdout:9/257: dread d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:03.379 INFO:tasks.workunit.client.0.smithi055.stdout:2/278: rmdir d4/dc 39 2024-04-26T21:08:03.379 INFO:tasks.workunit.client.1.smithi064.stdout:5/428: mkdir dd/d12/d18/d33/d48/d88 0 2024-04-26T21:08:03.384 INFO:tasks.workunit.client.0.smithi055.stdout:1/248: creat d8/df/f55 x:0 0 0 2024-04-26T21:08:03.385 INFO:tasks.workunit.client.1.smithi064.stdout:3/410: mkdir d1/d27/d29/d6f/d72/d95 0 2024-04-26T21:08:03.385 INFO:tasks.workunit.client.1.smithi064.stdout:3/411: chown d1/d14/f6a 0 1 2024-04-26T21:08:03.385 INFO:tasks.workunit.client.1.smithi064.stdout:3/412: stat d1/d27/d29/l41 0 2024-04-26T21:08:03.387 INFO:tasks.workunit.client.0.smithi055.stdout:2/279: symlink d4/db/d1f/d46/l63 0 2024-04-26T21:08:03.387 INFO:tasks.workunit.client.0.smithi055.stdout:2/280: fsync d4/d14/d17/d36/f4e 0 2024-04-26T21:08:03.388 INFO:tasks.workunit.client.1.smithi064.stdout:2/431: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l59 d12/d41/d73/d83/d94/d3a/d46/l9a 0 2024-04-26T21:08:03.396 INFO:tasks.workunit.client.0.smithi055.stdout:1/249: rename d8/d17/d1b/c2f to d8/d17/d1b/c56 0 2024-04-26T21:08:03.401 INFO:tasks.workunit.client.0.smithi055.stdout:2/281: unlink d4/d14/f38 0 2024-04-26T21:08:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:03 smithi064 ceph-mon[33404]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 155 MiB/s rd, 183 MiB/s wr, 458 op/s 2024-04-26T21:08:03.411 INFO:tasks.workunit.client.1.smithi064.stdout:2/432: creat d12/d41/d61/d6c/f9b x:0 0 0 2024-04-26T21:08:03.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/433: read d12/d41/d73/d83/d94/f35 [2553574,73048] 0 2024-04-26T21:08:03.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/434: fdatasync d12/f34 0 2024-04-26T21:08:03.435 INFO:tasks.workunit.client.0.smithi055.stdout:4/166: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:08:03.438 INFO:tasks.workunit.client.1.smithi064.stdout:4/495: dwrite d0/d1d/f1b [4194304,4194304] 0 2024-04-26T21:08:03.438 INFO:tasks.workunit.client.0.smithi055.stdout:3/320: dwrite d0/d4/d16/d18/f5d [0,4194304] 0 2024-04-26T21:08:03.438 INFO:tasks.workunit.client.0.smithi055.stdout:3/321: creat d0/d4/d5/d73/d47/f77 x:0 0 0 2024-04-26T21:08:03.441 INFO:tasks.workunit.client.1.smithi064.stdout:3/413: dwrite d1/f8 [0,4194304] 0 2024-04-26T21:08:03.465 INFO:tasks.workunit.client.1.smithi064.stdout:2/435: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/f4d [0,4194304] 0 2024-04-26T21:08:03.470 INFO:tasks.workunit.client.1.smithi064.stdout:3/414: write d1/d38/f49 [1337544,75128] 0 2024-04-26T21:08:03.471 INFO:tasks.workunit.client.1.smithi064.stdout:3/415: write d1/d27/d29/d6f/f86 [613025,107455] 0 2024-04-26T21:08:03.471 INFO:tasks.workunit.client.1.smithi064.stdout:3/416: readlink d1/d12/l3a 0 2024-04-26T21:08:03.471 INFO:tasks.workunit.client.1.smithi064.stdout:3/417: chown d1/d27/d50/f52 53 1 2024-04-26T21:08:03.472 INFO:tasks.workunit.client.1.smithi064.stdout:1/546: dwrite d0/d6/d11/d1e/f9a [0,4194304] 0 2024-04-26T21:08:03.486 INFO:tasks.workunit.client.1.smithi064.stdout:3/418: mknod d1/d12/d7d/d8d/c96 0 2024-04-26T21:08:03.486 INFO:tasks.workunit.client.1.smithi064.stdout:3/419: fdatasync d1/d12/f93 0 2024-04-26T21:08:03.486 INFO:tasks.workunit.client.1.smithi064.stdout:3/420: fsync d1/d14/f6a 0 2024-04-26T21:08:03.487 INFO:tasks.workunit.client.0.smithi055.stdout:1/250: dwrite d8/f12 [0,4194304] 0 2024-04-26T21:08:03.487 INFO:tasks.workunit.client.0.smithi055.stdout:1/251: read d8/f15 [2204599,77244] 0 2024-04-26T21:08:03.487 INFO:tasks.workunit.client.0.smithi055.stdout:2/282: dwrite d4/db/f15 [0,4194304] 0 2024-04-26T21:08:03.498 INFO:tasks.workunit.client.1.smithi064.stdout:3/421: link d1/d27/d29/d6f/d72/d26/c46 d1/d12/d7d/d8d/c97 0 2024-04-26T21:08:03.498 INFO:tasks.workunit.client.1.smithi064.stdout:3/422: chown d1/d27/d50/d35/d4c/f83 323 1 2024-04-26T21:08:03.503 INFO:tasks.workunit.client.1.smithi064.stdout:2/436: dread d12/f24 [0,4194304] 0 2024-04-26T21:08:03.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/437: write d12/d41/d73/d83/d94/f3d [229630,107122] 0 2024-04-26T21:08:03.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/438: write d12/d41/d73/d83/d94/f3d [1849241,37483] 0 2024-04-26T21:08:03.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/439: stat d12/d41/d73/d83/d94/f3f 0 2024-04-26T21:08:03.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/440: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85/c31 0 2024-04-26T21:08:03.508 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:03 smithi055 ceph-mon[25475]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 155 MiB/s rd, 183 MiB/s wr, 458 op/s 2024-04-26T21:08:03.512 INFO:tasks.workunit.client.0.smithi055.stdout:4/167: dwrite d4/f11 [0,4194304] 0 2024-04-26T21:08:03.517 INFO:tasks.workunit.client.0.smithi055.stdout:4/168: creat d4/d12/d15/f39 x:0 0 0 2024-04-26T21:08:03.517 INFO:tasks.workunit.client.0.smithi055.stdout:4/169: readlink d4/d18/d1e/d28/l2f 0 2024-04-26T21:08:03.517 INFO:tasks.workunit.client.0.smithi055.stdout:4/170: fsync d4/d18/d1a/f37 0 2024-04-26T21:08:03.518 INFO:tasks.workunit.client.1.smithi064.stdout:1/547: dwrite d0/d6/d11/f5e [0,4194304] 0 2024-04-26T21:08:03.527 INFO:tasks.workunit.client.1.smithi064.stdout:0/398: creat dd/d10/f7d x:0 0 0 2024-04-26T21:08:03.535 INFO:tasks.workunit.client.1.smithi064.stdout:2/441: dread d12/d41/d61/d75/f42 [0,4194304] 0 2024-04-26T21:08:03.536 INFO:tasks.workunit.client.0.smithi055.stdout:1/252: dwrite d8/f15 [0,4194304] 0 2024-04-26T21:08:03.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/322: dwrite d0/d4/d5/d73/f14 [0,4194304] 0 2024-04-26T21:08:03.538 INFO:tasks.workunit.client.0.smithi055.stdout:1/253: symlink d8/df/d11/d44/l57 0 2024-04-26T21:08:03.542 INFO:tasks.workunit.client.0.smithi055.stdout:1/254: write d8/d17/d33/f34 [2783307,34307] 0 2024-04-26T21:08:03.542 INFO:tasks.workunit.client.0.smithi055.stdout:3/323: truncate d0/d4/d5/d73/d47/d37/f6f 2367413 0 2024-04-26T21:08:03.545 INFO:tasks.workunit.client.0.smithi055.stdout:3/324: symlink d0/d4/d16/d18/d4b/l78 0 2024-04-26T21:08:03.545 INFO:tasks.workunit.client.0.smithi055.stdout:3/325: chown d0/d4/d5/d73/d13/d5c 990790 1 2024-04-26T21:08:03.553 INFO:tasks.workunit.client.0.smithi055.stdout:1/255: dread d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:03.555 INFO:tasks.workunit.client.0.smithi055.stdout:1/256: creat d8/df/d11/d27/d28/d2a/f58 x:0 0 0 2024-04-26T21:08:03.558 INFO:tasks.workunit.client.0.smithi055.stdout:1/257: readlink d8/l1a 0 2024-04-26T21:08:03.560 INFO:tasks.workunit.client.1.smithi064.stdout:0/399: write dd/d21/f3a [2508860,119902] 0 2024-04-26T21:08:03.560 INFO:tasks.workunit.client.1.smithi064.stdout:0/400: creat dd/d10/f7e x:0 0 0 2024-04-26T21:08:03.561 INFO:tasks.workunit.client.0.smithi055.stdout:4/171: dread d4/f30 [0,4194304] 0 2024-04-26T21:08:03.562 INFO:tasks.workunit.client.1.smithi064.stdout:6/377: unlink d4/d7/d12/c78 0 2024-04-26T21:08:03.565 INFO:tasks.workunit.client.0.smithi055.stdout:4/172: creat d4/d18/d1e/d2d/f3a x:0 0 0 2024-04-26T21:08:03.567 INFO:tasks.workunit.client.0.smithi055.stdout:3/326: dread d0/d4/d5/d73/f2e [0,4194304] 0 2024-04-26T21:08:03.571 INFO:tasks.workunit.client.0.smithi055.stdout:7/270: sync 2024-04-26T21:08:03.571 INFO:tasks.workunit.client.0.smithi055.stdout:0/324: sync 2024-04-26T21:08:03.574 INFO:tasks.workunit.client.1.smithi064.stdout:0/401: link dd/f12 dd/d10/d74/d4f/f7f 0 2024-04-26T21:08:03.576 INFO:tasks.workunit.client.1.smithi064.stdout:6/378: symlink d4/l7c 0 2024-04-26T21:08:03.576 INFO:tasks.workunit.client.1.smithi064.stdout:6/379: fsync d4/d7/f62 0 2024-04-26T21:08:03.578 INFO:tasks.workunit.client.1.smithi064.stdout:0/402: creat dd/d10/d74/f80 x:0 0 0 2024-04-26T21:08:03.579 INFO:tasks.workunit.client.1.smithi064.stdout:6/380: mkdir d4/d7/d12/d49/d4b/d7d 0 2024-04-26T21:08:03.581 INFO:tasks.workunit.client.0.smithi055.stdout:8/207: creat d3/f41 x:0 0 0 2024-04-26T21:08:03.581 INFO:tasks.workunit.client.0.smithi055.stdout:8/208: chown d3/d9/l13 5 1 2024-04-26T21:08:03.582 INFO:tasks.workunit.client.0.smithi055.stdout:3/327: mknod d0/d4/d5/d73/d13/d1a/d46/d72/d69/c79 0 2024-04-26T21:08:03.583 INFO:tasks.workunit.client.0.smithi055.stdout:7/271: creat d5/d6/f4c x:0 0 0 2024-04-26T21:08:03.585 INFO:tasks.workunit.client.0.smithi055.stdout:9/258: rename d2/f13 to d2/f5a 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/496: symlink d0/la3 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/497: write d0/d1d/d56/f65 [3145418,85568] 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/498: write d0/d1d/d17/d44/d45/f88 [492515,44893] 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/499: fdatasync d0/d5/f74 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/500: readlink d0/d1d/d56/d89/l91 0 2024-04-26T21:08:03.586 INFO:tasks.workunit.client.1.smithi064.stdout:4/501: dread - d0/d5/d13/d6d/f83 zero size 2024-04-26T21:08:03.587 INFO:tasks.workunit.client.1.smithi064.stdout:1/548: rmdir d0/d6/d11/d1e 39 2024-04-26T21:08:03.587 INFO:tasks.workunit.client.0.smithi055.stdout:8/209: unlink d3/d9/f39 0 2024-04-26T21:08:03.588 INFO:tasks.workunit.client.0.smithi055.stdout:3/328: mknod d0/d4/d5/d73/d13/d27/d3b/c7a 0 2024-04-26T21:08:03.588 INFO:tasks.workunit.client.0.smithi055.stdout:3/329: fdatasync d0/d4/d5/f2c 0 2024-04-26T21:08:03.589 INFO:tasks.workunit.client.0.smithi055.stdout:7/272: mkdir d5/d6/d24/d4d 0 2024-04-26T21:08:03.590 INFO:tasks.workunit.client.1.smithi064.stdout:1/549: creat d0/d6/d11/d6c/fab x:0 0 0 2024-04-26T21:08:03.590 INFO:tasks.workunit.client.1.smithi064.stdout:1/550: read d0/d6/d11/d1e/d2a/d34/f79 [1707534,63061] 0 2024-04-26T21:08:03.592 INFO:tasks.workunit.client.1.smithi064.stdout:1/551: creat d0/d6/d11/d1e/d2a/d34/fac x:0 0 0 2024-04-26T21:08:03.593 INFO:tasks.workunit.client.0.smithi055.stdout:8/210: symlink d3/d9/l42 0 2024-04-26T21:08:03.597 INFO:tasks.workunit.client.1.smithi064.stdout:5/429: rename dd/d12/d18/f2f to dd/d12/d18/d33/d63/f89 0 2024-04-26T21:08:03.598 INFO:tasks.workunit.client.1.smithi064.stdout:5/430: fdatasync dd/f16 0 2024-04-26T21:08:03.598 INFO:tasks.workunit.client.1.smithi064.stdout:5/431: readlink dd/d12/d4f/d64/d73/l7a 0 2024-04-26T21:08:03.598 INFO:tasks.workunit.client.1.smithi064.stdout:0/403: dread dd/d10/d74/f68 [0,4194304] 0 2024-04-26T21:08:03.599 INFO:tasks.workunit.client.0.smithi055.stdout:5/177: symlink d4/l38 0 2024-04-26T21:08:03.600 INFO:tasks.workunit.client.0.smithi055.stdout:5/178: creat d4/df/d13/d26/d28/f39 x:0 0 0 2024-04-26T21:08:03.600 INFO:tasks.workunit.client.0.smithi055.stdout:5/179: fdatasync d4/df/d13/d26/f2f 0 2024-04-26T21:08:03.602 INFO:tasks.workunit.client.1.smithi064.stdout:5/432: mkdir dd/d12/d18/d33/d48/d88/d8a 0 2024-04-26T21:08:03.602 INFO:tasks.workunit.client.1.smithi064.stdout:6/381: write d4/f16 [1914480,28580] 0 2024-04-26T21:08:03.602 INFO:tasks.workunit.client.1.smithi064.stdout:6/382: readlink d4/d7/d12/d49/d4b/l55 0 2024-04-26T21:08:03.602 INFO:tasks.workunit.client.1.smithi064.stdout:6/383: readlink d4/d7/d12/d49/d4b/d5a/l5f 0 2024-04-26T21:08:03.606 INFO:tasks.workunit.client.1.smithi064.stdout:2/442: rename d12/d41/d73/d83/d94/f3d to d12/d41/d73/d83/d94/d3a/d46/d6a/f9c 0 2024-04-26T21:08:03.606 INFO:tasks.workunit.client.1.smithi064.stdout:2/443: stat d12/d41/d73/l7b 0 2024-04-26T21:08:03.610 INFO:tasks.workunit.client.1.smithi064.stdout:6/384: rmdir d4/d7/d12/d38 39 2024-04-26T21:08:03.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/404: rmdir dd/d10/d1a/d31/d43 39 2024-04-26T21:08:03.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/405: stat dd/d21/f3a 0 2024-04-26T21:08:03.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/406: creat dd/d10/d1a/d31/d47/d61/f81 x:0 0 0 2024-04-26T21:08:03.615 INFO:tasks.workunit.client.0.smithi055.stdout:5/180: write d4/df/d13/f21 [1383535,1121] 0 2024-04-26T21:08:03.615 INFO:tasks.workunit.client.0.smithi055.stdout:5/181: truncate d4/d18/f20 5203650 0 2024-04-26T21:08:03.616 INFO:tasks.workunit.client.0.smithi055.stdout:8/211: write d3/d9/f2b [3234359,12109] 0 2024-04-26T21:08:03.616 INFO:tasks.workunit.client.0.smithi055.stdout:8/212: readlink d3/d9/ld 0 2024-04-26T21:08:03.621 INFO:tasks.workunit.client.0.smithi055.stdout:5/182: unlink d4/df/d13/d26/d28/l2a 0 2024-04-26T21:08:03.623 INFO:tasks.workunit.client.1.smithi064.stdout:9/441: mkdir d0/d4/da/d8d 0 2024-04-26T21:08:03.623 INFO:tasks.workunit.client.1.smithi064.stdout:9/442: chown d0/d4/da/d26/d47/d88 301272 1 2024-04-26T21:08:03.624 INFO:tasks.workunit.client.0.smithi055.stdout:2/283: unlink d4/dc/f58 0 2024-04-26T21:08:03.625 INFO:tasks.workunit.client.0.smithi055.stdout:8/213: link d3/c6 d3/d9/d1f/c43 0 2024-04-26T21:08:03.628 INFO:tasks.workunit.client.0.smithi055.stdout:5/183: mknod d4/d18/c3a 0 2024-04-26T21:08:03.628 INFO:tasks.workunit.client.1.smithi064.stdout:6/385: rmdir d4/d7/d33 39 2024-04-26T21:08:03.630 INFO:tasks.workunit.client.1.smithi064.stdout:0/407: rename dd/d10/d1a/d31/d47/d61/d42/l4e to dd/d10/d74/d1d/l82 0 2024-04-26T21:08:03.630 INFO:tasks.workunit.client.1.smithi064.stdout:0/408: write dd/d10/d1a/d31/d5c/f6f [428426,59900] 0 2024-04-26T21:08:03.631 INFO:tasks.workunit.client.0.smithi055.stdout:8/214: truncate d3/d9/d1f/f32 2426905 0 2024-04-26T21:08:03.631 INFO:tasks.workunit.client.0.smithi055.stdout:8/215: stat d3/d9/d1d/l3c 0 2024-04-26T21:08:03.632 INFO:tasks.workunit.client.0.smithi055.stdout:8/216: write d3/d9/d1f/f29 [1084172,85746] 0 2024-04-26T21:08:03.632 INFO:tasks.workunit.client.0.smithi055.stdout:8/217: fdatasync d3/d9/d1f/d2e/f40 0 2024-04-26T21:08:03.634 INFO:tasks.workunit.client.1.smithi064.stdout:9/443: truncate d0/d4/da/d31/d34/f49 2575320 0 2024-04-26T21:08:03.635 INFO:tasks.workunit.client.1.smithi064.stdout:9/444: fsync d0/d4/d7/f2e 0 2024-04-26T21:08:03.635 INFO:tasks.workunit.client.0.smithi055.stdout:6/268: rename d3/d17/d19/c1f to d3/d17/d46/d54/c57 0 2024-04-26T21:08:03.635 INFO:tasks.workunit.client.0.smithi055.stdout:4/173: rmdir d4/d12 39 2024-04-26T21:08:03.636 INFO:tasks.workunit.client.0.smithi055.stdout:4/174: read d4/f21 [1593252,66526] 0 2024-04-26T21:08:03.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/184: link d4/f27 d4/df/f3b 0 2024-04-26T21:08:03.639 INFO:tasks.workunit.client.1.smithi064.stdout:6/386: mknod d4/d7/d12/d49/d4b/c7e 0 2024-04-26T21:08:03.639 INFO:tasks.workunit.client.1.smithi064.stdout:6/387: fdatasync d4/d7/d33/f6f 0 2024-04-26T21:08:03.645 INFO:tasks.workunit.client.0.smithi055.stdout:9/259: dwrite d2/f55 [0,4194304] 0 2024-04-26T21:08:03.652 INFO:tasks.workunit.client.0.smithi055.stdout:2/284: dread d4/db/d1f/f3d [0,4194304] 0 2024-04-26T21:08:03.652 INFO:tasks.workunit.client.0.smithi055.stdout:2/285: write d4/db/d26/f4d [2666049,107582] 0 2024-04-26T21:08:03.652 INFO:tasks.workunit.client.0.smithi055.stdout:2/286: creat d4/db/d1f/d46/f64 x:0 0 0 2024-04-26T21:08:03.692 INFO:tasks.workunit.client.1.smithi064.stdout:0/409: dwrite dd/f30 [0,4194304] 0 2024-04-26T21:08:03.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/445: unlink d0/d4/d7/f54 0 2024-04-26T21:08:03.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/446: write d0/d4/da/d26/d47/f4b [851860,22626] 0 2024-04-26T21:08:03.714 INFO:tasks.workunit.client.0.smithi055.stdout:6/269: mkdir d3/d17/d19/d20/d51/d58 0 2024-04-26T21:08:03.716 INFO:tasks.workunit.client.1.smithi064.stdout:3/423: creat d1/d27/f98 x:0 0 0 2024-04-26T21:08:03.716 INFO:tasks.workunit.client.1.smithi064.stdout:4/502: dwrite d0/d1d/d21/f47 [0,4194304] 0 2024-04-26T21:08:03.717 INFO:tasks.workunit.client.1.smithi064.stdout:4/503: write d0/d1d/d17/f25 [4285450,65079] 0 2024-04-26T21:08:03.717 INFO:tasks.workunit.client.1.smithi064.stdout:4/504: truncate d0/d1d/d21/f4e 477709 0 2024-04-26T21:08:03.717 INFO:tasks.workunit.client.1.smithi064.stdout:2/444: dwrite d12/d41/d73/d83/f8d [0,4194304] 0 2024-04-26T21:08:03.720 INFO:tasks.workunit.client.0.smithi055.stdout:7/273: rename d5/d6/d39/f3e to d5/d6/d24/d3b/f4e 0 2024-04-26T21:08:03.720 INFO:tasks.workunit.client.0.smithi055.stdout:7/274: stat d5/d6/l1f 0 2024-04-26T21:08:03.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/410: rename dd/d10/d74/d4f/f7f to dd/d10/d1a/d31/d47/d61/f83 0 2024-04-26T21:08:03.724 INFO:tasks.workunit.client.1.smithi064.stdout:0/411: write dd/d10/d74/d1d/f79 [306083,18490] 0 2024-04-26T21:08:03.727 INFO:tasks.workunit.client.0.smithi055.stdout:4/175: getdents d4/d18/d1e 0 2024-04-26T21:08:03.727 INFO:tasks.workunit.client.0.smithi055.stdout:4/176: fsync d4/d18/d1e/f38 0 2024-04-26T21:08:03.727 INFO:tasks.workunit.client.0.smithi055.stdout:4/177: fsync d4/d12/d17/f19 0 2024-04-26T21:08:03.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/447: symlink d0/d4/da/d26/d45/l8e 0 2024-04-26T21:08:03.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/448: chown d0/d4/da/d26/d47/f4b 19 1 2024-04-26T21:08:03.730 INFO:tasks.workunit.client.1.smithi064.stdout:8/347: sync 2024-04-26T21:08:03.730 INFO:tasks.workunit.client.1.smithi064.stdout:8/348: dread - d10/d41/d4e/d59/d5d/f63 zero size 2024-04-26T21:08:03.734 INFO:tasks.workunit.client.1.smithi064.stdout:2/445: read d12/d41/d73/d83/f8d [2316389,12237] 0 2024-04-26T21:08:03.735 INFO:tasks.workunit.client.0.smithi055.stdout:9/260: dread d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:03.736 INFO:tasks.workunit.client.0.smithi055.stdout:5/185: dwrite d4/df/d13/f37 [0,4194304] 0 2024-04-26T21:08:03.742 INFO:tasks.workunit.client.1.smithi064.stdout:3/424: mkdir d1/d27/d29/d6f/d72/d7a/d99 0 2024-04-26T21:08:03.745 INFO:tasks.workunit.client.1.smithi064.stdout:8/349: dread d10/f24 [0,4194304] 0 2024-04-26T21:08:03.745 INFO:tasks.workunit.client.0.smithi055.stdout:2/287: symlink d4/d1e/l65 0 2024-04-26T21:08:03.746 INFO:tasks.workunit.client.1.smithi064.stdout:6/388: dwrite d4/d7/f3b [0,4194304] 0 2024-04-26T21:08:03.750 INFO:tasks.workunit.client.0.smithi055.stdout:6/270: symlink d3/d17/d19/l59 0 2024-04-26T21:08:03.750 INFO:tasks.workunit.client.0.smithi055.stdout:6/271: chown d3/f9 62016 1 2024-04-26T21:08:03.750 INFO:tasks.workunit.client.0.smithi055.stdout:6/272: fsync d3/d17/d19/d20/f56 0 2024-04-26T21:08:03.752 INFO:tasks.workunit.client.1.smithi064.stdout:5/433: dwrite dd/d12/d18/d1a/d1f/d20/f59 [0,4194304] 0 2024-04-26T21:08:03.752 INFO:tasks.workunit.client.1.smithi064.stdout:3/425: dread d1/d27/d50/f24 [0,4194304] 0 2024-04-26T21:08:03.753 INFO:tasks.workunit.client.0.smithi055.stdout:7/275: mkdir d5/d6/d24/d4f 0 2024-04-26T21:08:03.754 INFO:tasks.workunit.client.0.smithi055.stdout:7/276: creat d5/d6/d24/f50 x:0 0 0 2024-04-26T21:08:03.755 INFO:tasks.workunit.client.0.smithi055.stdout:4/178: rmdir d4/d18/d1e/d28 39 2024-04-26T21:08:03.755 INFO:tasks.workunit.client.0.smithi055.stdout:3/330: read d0/d4/d16/d18/f30 [4176848,94510] 0 2024-04-26T21:08:03.762 INFO:tasks.workunit.client.0.smithi055.stdout:5/186: dread d4/df/d13/f21 [4194304,4194304] 0 2024-04-26T21:08:03.764 INFO:tasks.workunit.client.0.smithi055.stdout:9/261: mknod d2/d14/c5b 0 2024-04-26T21:08:03.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/505: link d0/d1d/d56/f65 d0/d5/d13/fa4 0 2024-04-26T21:08:03.766 INFO:tasks.workunit.client.0.smithi055.stdout:2/288: getdents d4/dc/d21 0 2024-04-26T21:08:03.766 INFO:tasks.workunit.client.0.smithi055.stdout:2/289: stat d4/d1e/c3f 0 2024-04-26T21:08:03.767 INFO:tasks.workunit.client.0.smithi055.stdout:2/290: fsync d4/db/f25 0 2024-04-26T21:08:03.770 INFO:tasks.workunit.client.0.smithi055.stdout:6/273: symlink d3/d4f/l5a 0 2024-04-26T21:08:03.778 INFO:tasks.workunit.client.0.smithi055.stdout:8/218: dwrite d3/d9/d1f/f29 [0,4194304] 0 2024-04-26T21:08:03.779 INFO:tasks.workunit.client.0.smithi055.stdout:3/331: dread d0/d4/f40 [0,4194304] 0 2024-04-26T21:08:03.779 INFO:tasks.workunit.client.0.smithi055.stdout:7/277: truncate d5/d6/ff 430720 0 2024-04-26T21:08:03.779 INFO:tasks.workunit.client.0.smithi055.stdout:3/332: fdatasync d0/d4/d5/d73/d47/f76 0 2024-04-26T21:08:03.781 INFO:tasks.workunit.client.0.smithi055.stdout:5/187: mkdir d4/df/d13/d26/d3c 0 2024-04-26T21:08:03.782 INFO:tasks.workunit.client.1.smithi064.stdout:6/389: mknod d4/d7/d12/d1e/c7f 0 2024-04-26T21:08:03.782 INFO:tasks.workunit.client.1.smithi064.stdout:6/390: chown d4/la 1 1 2024-04-26T21:08:03.786 INFO:tasks.workunit.client.0.smithi055.stdout:2/291: symlink d4/dc/l66 0 2024-04-26T21:08:03.789 INFO:tasks.workunit.client.0.smithi055.stdout:6/274: creat d3/f5b x:0 0 0 2024-04-26T21:08:03.789 INFO:tasks.workunit.client.0.smithi055.stdout:6/275: write d3/d17/d19/f1e [2134280,7962] 0 2024-04-26T21:08:03.791 INFO:tasks.workunit.client.1.smithi064.stdout:8/350: dwrite d10/d1d/f30 [0,4194304] 0 2024-04-26T21:08:03.792 INFO:tasks.workunit.client.1.smithi064.stdout:5/434: creat dd/d12/d18/d1a/d1f/d20/f8b x:0 0 0 2024-04-26T21:08:03.794 INFO:tasks.workunit.client.0.smithi055.stdout:8/219: dread d3/d9/d1f/f23 [0,4194304] 0 2024-04-26T21:08:03.795 INFO:tasks.workunit.client.0.smithi055.stdout:8/220: write d3/d9/f24 [2065331,82097] 0 2024-04-26T21:08:03.795 INFO:tasks.workunit.client.0.smithi055.stdout:3/333: rename d0/d4/d5/d73/d47/d37/d3d/l4d to d0/d4/d5/d73/d13/l7b 0 2024-04-26T21:08:03.795 INFO:tasks.workunit.client.0.smithi055.stdout:3/334: write d0/d4/d5/d73/d13/d1a/d46/d72/f53 [368881,34423] 0 2024-04-26T21:08:03.795 INFO:tasks.workunit.client.0.smithi055.stdout:8/221: chown d3/d9/c19 890 1 2024-04-26T21:08:03.796 INFO:tasks.workunit.client.0.smithi055.stdout:6/276: write d3/f9 [1691680,9282] 0 2024-04-26T21:08:03.797 INFO:tasks.workunit.client.1.smithi064.stdout:3/426: creat d1/d27/d29/d6f/d72/d26/f9a x:0 0 0 2024-04-26T21:08:03.797 INFO:tasks.workunit.client.1.smithi064.stdout:3/427: readlink d1/d12/d7d/d8a/l8c 0 2024-04-26T21:08:03.799 INFO:tasks.workunit.client.1.smithi064.stdout:2/446: getdents d12/d41/d73/d83/d94/d3a/d46/d6a 0 2024-04-26T21:08:03.799 INFO:tasks.workunit.client.0.smithi055.stdout:6/277: fsync d3/f9 0 2024-04-26T21:08:03.800 INFO:tasks.workunit.client.0.smithi055.stdout:4/179: truncate d4/d18/d1e/d28/f32 1911153 0 2024-04-26T21:08:03.803 INFO:tasks.workunit.client.1.smithi064.stdout:8/351: dread d10/f24 [0,4194304] 0 2024-04-26T21:08:03.803 INFO:tasks.workunit.client.1.smithi064.stdout:8/352: readlink d10/d1d/d38/l67 0 2024-04-26T21:08:03.803 INFO:tasks.workunit.client.1.smithi064.stdout:8/353: fdatasync d10/d41/d4e/d54/f57 0 2024-04-26T21:08:03.803 INFO:tasks.workunit.client.0.smithi055.stdout:9/262: getdents d2/d11 0 2024-04-26T21:08:03.804 INFO:tasks.workunit.client.0.smithi055.stdout:9/263: chown d2/d11/f1f 0 1 2024-04-26T21:08:03.804 INFO:tasks.workunit.client.0.smithi055.stdout:9/264: fdatasync d2/d11/f4b 0 2024-04-26T21:08:03.807 INFO:tasks.workunit.client.1.smithi064.stdout:4/506: link d0/l22 d0/d5/d79/la5 0 2024-04-26T21:08:03.807 INFO:tasks.workunit.client.1.smithi064.stdout:4/507: creat d0/d2f/d69/fa6 x:0 0 0 2024-04-26T21:08:03.808 INFO:tasks.workunit.client.0.smithi055.stdout:2/292: creat d4/db/d1f/f67 x:0 0 0 2024-04-26T21:08:03.813 INFO:tasks.workunit.client.1.smithi064.stdout:7/454: sync 2024-04-26T21:08:03.814 INFO:tasks.workunit.client.1.smithi064.stdout:6/391: mknod d4/d7/d12/d49/d4b/d56/c80 0 2024-04-26T21:08:03.816 INFO:tasks.workunit.client.1.smithi064.stdout:9/449: unlink d0/d4/d7/df/f2c 0 2024-04-26T21:08:03.817 INFO:tasks.workunit.client.0.smithi055.stdout:3/335: creat d0/d4/d5/d73/d13/d1a/d46/d72/f7c x:0 0 0 2024-04-26T21:08:03.818 INFO:tasks.workunit.client.0.smithi055.stdout:3/336: fsync d0/d4/d5/d73/d13/d1a/d46/d72/f60 0 2024-04-26T21:08:03.818 INFO:tasks.workunit.client.0.smithi055.stdout:3/337: write d0/d4/d5/d73/d13/d1a/d46/d55/f59 [738375,12802] 0 2024-04-26T21:08:03.818 INFO:tasks.workunit.client.0.smithi055.stdout:8/222: write d3/d9/d1f/f32 [3434884,46417] 0 2024-04-26T21:08:03.824 INFO:tasks.workunit.client.0.smithi055.stdout:2/293: dread d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:03.826 INFO:tasks.workunit.client.0.smithi055.stdout:4/180: creat d4/d23/f3b x:0 0 0 2024-04-26T21:08:03.831 INFO:tasks.workunit.client.1.smithi064.stdout:2/447: creat d12/f9d x:0 0 0 2024-04-26T21:08:03.836 INFO:tasks.workunit.client.0.smithi055.stdout:2/294: symlink d4/d14/d17/l68 0 2024-04-26T21:08:03.836 INFO:tasks.workunit.client.0.smithi055.stdout:3/338: dread d0/d4/f44 [0,4194304] 0 2024-04-26T21:08:03.837 INFO:tasks.workunit.client.0.smithi055.stdout:3/339: truncate d0/d4/d5/d73/d13/d1a/d46/d51/f5e 552106 0 2024-04-26T21:08:03.840 INFO:tasks.workunit.client.1.smithi064.stdout:2/448: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f49 [1316790,53131] 0 2024-04-26T21:08:03.840 INFO:tasks.workunit.client.1.smithi064.stdout:2/449: read - d12/d41/d61/d75/f93 zero size 2024-04-26T21:08:03.845 INFO:tasks.workunit.client.0.smithi055.stdout:5/188: dread d4/df/f3b [0,4194304] 0 2024-04-26T21:08:03.846 INFO:tasks.workunit.client.0.smithi055.stdout:5/189: write d4/df/f30 [949964,127850] 0 2024-04-26T21:08:03.847 INFO:tasks.workunit.client.0.smithi055.stdout:5/190: stat d4/f9 0 2024-04-26T21:08:03.847 INFO:tasks.workunit.client.0.smithi055.stdout:5/191: read d4/df/d13/f17 [841030,123752] 0 2024-04-26T21:08:03.847 INFO:tasks.workunit.client.0.smithi055.stdout:4/181: read - d4/d18/d1e/f38 zero size 2024-04-26T21:08:03.847 INFO:tasks.workunit.client.0.smithi055.stdout:4/182: readlink d4/d12/d15/l33 0 2024-04-26T21:08:03.851 INFO:tasks.workunit.client.1.smithi064.stdout:7/455: mknod d6/d9/d77/c9a 0 2024-04-26T21:08:03.851 INFO:tasks.workunit.client.1.smithi064.stdout:7/456: write f5 [1003715,17057] 0 2024-04-26T21:08:03.851 INFO:tasks.workunit.client.1.smithi064.stdout:7/457: chown d6/d5a/l13 1590322 1 2024-04-26T21:08:03.856 INFO:tasks.workunit.client.1.smithi064.stdout:0/412: getdents dd/d10/d1a/d31/d47/d61 0 2024-04-26T21:08:03.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/450: creat d12/d41/d73/d83/d94/d3a/d46/d91/d96/f9e x:0 0 0 2024-04-26T21:08:03.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/451: creat d12/d41/d61/d75/f9f x:0 0 0 2024-04-26T21:08:03.868 INFO:tasks.workunit.client.0.smithi055.stdout:5/192: mknod d4/df/d13/d26/d28/d2e/c3d 0 2024-04-26T21:08:03.870 INFO:tasks.workunit.client.0.smithi055.stdout:4/183: fdatasync d4/d18/d1e/d2d/f3a 0 2024-04-26T21:08:03.874 INFO:tasks.workunit.client.1.smithi064.stdout:8/354: dread d10/d2f/f4c [0,4194304] 0 2024-04-26T21:08:03.875 INFO:tasks.workunit.client.0.smithi055.stdout:5/193: creat d4/df/d13/d26/d3c/f3e x:0 0 0 2024-04-26T21:08:03.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/413: write dd/d21/f36 [2406215,82222] 0 2024-04-26T21:08:03.878 INFO:tasks.workunit.client.0.smithi055.stdout:6/278: dwrite d3/d17/d19/f3d [0,4194304] 0 2024-04-26T21:08:03.879 INFO:tasks.workunit.client.0.smithi055.stdout:7/278: dwrite d5/d6/d24/f38 [0,4194304] 0 2024-04-26T21:08:03.879 INFO:tasks.workunit.client.1.smithi064.stdout:9/450: read d0/d4/da/d26/d47/f65 [1387538,126377] 0 2024-04-26T21:08:03.881 INFO:tasks.workunit.client.0.smithi055.stdout:9/265: dwrite d2/d11/f26 [0,4194304] 0 2024-04-26T21:08:03.886 INFO:tasks.workunit.client.1.smithi064.stdout:6/392: write d4/f28 [3133371,4374] 0 2024-04-26T21:08:03.889 INFO:tasks.workunit.client.0.smithi055.stdout:6/279: unlink d3/d17/d19/d20/f22 0 2024-04-26T21:08:03.892 INFO:tasks.workunit.client.1.smithi064.stdout:9/451: chown d0/d4/d7/df/l2b 136742529 1 2024-04-26T21:08:03.894 INFO:tasks.workunit.client.0.smithi055.stdout:7/279: symlink d5/d6/d24/d4d/l51 0 2024-04-26T21:08:03.894 INFO:tasks.workunit.client.0.smithi055.stdout:4/184: dread d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:08:03.899 INFO:tasks.workunit.client.1.smithi064.stdout:0/414: getdents dd/d10/d74/d1d 0 2024-04-26T21:08:03.899 INFO:tasks.workunit.client.1.smithi064.stdout:4/508: dwrite d0/d1d/d21/d9c/fa2 [0,4194304] 0 2024-04-26T21:08:03.900 INFO:tasks.workunit.client.0.smithi055.stdout:2/295: dwrite d4/dc/f12 [0,4194304] 0 2024-04-26T21:08:03.901 INFO:tasks.workunit.client.1.smithi064.stdout:3/428: dwrite d1/fc [4194304,4194304] 0 2024-04-26T21:08:03.902 INFO:tasks.workunit.client.1.smithi064.stdout:6/393: rmdir d4/d7 39 2024-04-26T21:08:03.905 INFO:tasks.workunit.client.1.smithi064.stdout:9/452: link d0/d4/da/d26/d47/f73 d0/d4/f8f 0 2024-04-26T21:08:03.909 INFO:tasks.workunit.client.0.smithi055.stdout:2/296: mkdir d4/d1e/d69 0 2024-04-26T21:08:03.911 INFO:tasks.workunit.client.1.smithi064.stdout:0/415: link dd/d10/d1a/d31/d47/f66 dd/d10/f84 0 2024-04-26T21:08:03.920 INFO:tasks.workunit.client.1.smithi064.stdout:6/394: creat d4/d7/d33/f81 x:0 0 0 2024-04-26T21:08:03.923 INFO:tasks.workunit.client.1.smithi064.stdout:0/416: creat dd/f85 x:0 0 0 2024-04-26T21:08:03.924 INFO:tasks.workunit.client.1.smithi064.stdout:0/417: creat dd/d10/d18/d64/f86 x:0 0 0 2024-04-26T21:08:03.928 INFO:tasks.workunit.client.1.smithi064.stdout:6/395: creat d4/d7/d12/d49/d4b/d56/f82 x:0 0 0 2024-04-26T21:08:03.928 INFO:tasks.workunit.client.1.smithi064.stdout:6/396: truncate d4/d7/f62 1007960 0 2024-04-26T21:08:03.929 INFO:tasks.workunit.client.1.smithi064.stdout:0/418: mknod dd/d10/d1a/d31/d5c/c87 0 2024-04-26T21:08:03.929 INFO:tasks.workunit.client.1.smithi064.stdout:0/419: truncate dd/d10/d1a/d31/d47/d61/f81 635936 0 2024-04-26T21:08:03.930 INFO:tasks.workunit.client.1.smithi064.stdout:0/420: write dd/d21/f3a [2368135,126189] 0 2024-04-26T21:08:03.931 INFO:tasks.workunit.client.1.smithi064.stdout:9/453: dread d0/d4/d7/df/f5f [0,4194304] 0 2024-04-26T21:08:03.932 INFO:tasks.workunit.client.1.smithi064.stdout:2/452: dwrite d12/d41/d61/d75/f2b [0,4194304] 0 2024-04-26T21:08:03.935 INFO:tasks.workunit.client.0.smithi055.stdout:7/280: dread d5/d11/f33 [0,4194304] 0 2024-04-26T21:08:03.935 INFO:tasks.workunit.client.0.smithi055.stdout:7/281: read - d5/d6/d24/f4b zero size 2024-04-26T21:08:03.938 INFO:tasks.workunit.client.1.smithi064.stdout:0/421: unlink dd/f12 0 2024-04-26T21:08:03.938 INFO:tasks.workunit.client.0.smithi055.stdout:6/280: dwrite d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:03.938 INFO:tasks.workunit.client.0.smithi055.stdout:6/281: chown d3/d17/d19/d20/f28 296458 1 2024-04-26T21:08:03.940 INFO:tasks.workunit.client.1.smithi064.stdout:9/454: mkdir d0/d4/da/d26/d45/d90 0 2024-04-26T21:08:03.940 INFO:tasks.workunit.client.1.smithi064.stdout:9/455: chown d0/d4/d28/d4f/d74/f84 15658341 1 2024-04-26T21:08:03.942 INFO:tasks.workunit.client.1.smithi064.stdout:1/552: sync 2024-04-26T21:08:03.946 INFO:tasks.workunit.client.1.smithi064.stdout:6/397: write d4/d7/f35 [2222978,46920] 0 2024-04-26T21:08:03.948 INFO:tasks.workunit.client.1.smithi064.stdout:1/553: write d0/d6/d11/d1e/d2a/d34/f79 [4525113,52533] 0 2024-04-26T21:08:03.948 INFO:tasks.workunit.client.0.smithi055.stdout:6/282: rename d3/l52 to d3/l5c 0 2024-04-26T21:08:03.950 INFO:tasks.workunit.client.1.smithi064.stdout:6/398: mkdir d4/d7/d12/d49/d4b/d7d/d83 0 2024-04-26T21:08:03.951 INFO:tasks.workunit.client.1.smithi064.stdout:2/453: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f [0,4194304] 0 2024-04-26T21:08:03.952 INFO:tasks.workunit.client.0.smithi055.stdout:6/283: mknod d3/d17/d19/d20/d51/d58/c5d 0 2024-04-26T21:08:03.954 INFO:tasks.workunit.client.1.smithi064.stdout:1/554: mknod d0/d22/d87/cad 0 2024-04-26T21:08:03.956 INFO:tasks.workunit.client.1.smithi064.stdout:4/509: dwrite d0/d5/d3e/f67 [0,4194304] 0 2024-04-26T21:08:03.956 INFO:tasks.workunit.client.1.smithi064.stdout:3/429: dwrite d1/d27/d50/f24 [0,4194304] 0 2024-04-26T21:08:03.956 INFO:tasks.workunit.client.1.smithi064.stdout:3/430: fdatasync d1/d27/d29/d6f/d72/f40 0 2024-04-26T21:08:03.958 INFO:tasks.workunit.client.0.smithi055.stdout:7/282: dread d5/d6/d24/f38 [4194304,4194304] 0 2024-04-26T21:08:03.958 INFO:tasks.workunit.client.0.smithi055.stdout:6/284: creat d3/d17/d46/d54/f5e x:0 0 0 2024-04-26T21:08:03.960 INFO:tasks.workunit.client.1.smithi064.stdout:6/399: link d4/l7c d4/d7/d33/l84 0 2024-04-26T21:08:03.960 INFO:tasks.workunit.client.1.smithi064.stdout:2/454: creat d12/d88/fa0 x:0 0 0 2024-04-26T21:08:03.961 INFO:tasks.workunit.client.1.smithi064.stdout:0/422: dread dd/f67 [0,4194304] 0 2024-04-26T21:08:03.961 INFO:tasks.workunit.client.0.smithi055.stdout:5/194: rename d4/df/d13/d26/d28 to d4/d18/d3f 0 2024-04-26T21:08:03.964 INFO:tasks.workunit.client.1.smithi064.stdout:1/555: rmdir d0/d6/d76/da7 0 2024-04-26T21:08:03.965 INFO:tasks.workunit.client.0.smithi055.stdout:2/297: dwrite d4/d1e/f47 [0,4194304] 0 2024-04-26T21:08:03.965 INFO:tasks.workunit.client.0.smithi055.stdout:2/298: chown d4/d1e/d2a 6759421 1 2024-04-26T21:08:03.973 INFO:tasks.workunit.client.0.smithi055.stdout:9/266: rename d2/d14/c2d to d2/d46/c5c 0 2024-04-26T21:08:03.973 INFO:tasks.workunit.client.0.smithi055.stdout:5/195: mknod d4/df/d13/d26/d3c/c40 0 2024-04-26T21:08:03.973 INFO:tasks.workunit.client.0.smithi055.stdout:5/196: chown d4/df/d13/d26/f32 490008127 1 2024-04-26T21:08:03.975 INFO:tasks.workunit.client.0.smithi055.stdout:7/283: dread d5/f29 [0,4194304] 0 2024-04-26T21:08:03.982 INFO:tasks.workunit.client.1.smithi064.stdout:6/400: dread d4/d7/d33/f44 [0,4194304] 0 2024-04-26T21:08:03.985 INFO:tasks.workunit.client.0.smithi055.stdout:4/185: rename d4/d12/d17/l20 to d4/d18/l3c 0 2024-04-26T21:08:03.986 INFO:tasks.workunit.client.0.smithi055.stdout:4/186: write d4/d23/f3b [93218,117411] 0 2024-04-26T21:08:03.988 INFO:tasks.workunit.client.0.smithi055.stdout:5/197: symlink d4/df/l41 0 2024-04-26T21:08:03.988 INFO:tasks.workunit.client.0.smithi055.stdout:5/198: truncate d4/df/f1b 957385 0 2024-04-26T21:08:03.988 INFO:tasks.workunit.client.0.smithi055.stdout:5/199: write d4/d15/f24 [11221,19580] 0 2024-04-26T21:08:03.989 INFO:tasks.workunit.client.1.smithi064.stdout:4/510: symlink d0/d5/d13/d6d/d97/la7 0 2024-04-26T21:08:03.991 INFO:tasks.workunit.client.1.smithi064.stdout:9/456: dwrite d0/d4/da/d26/d47/f62 [0,4194304] 0 2024-04-26T21:08:03.992 INFO:tasks.workunit.client.0.smithi055.stdout:7/284: rename d5/d6/d24/d4f to d5/d6/d24/d52 0 2024-04-26T21:08:03.992 INFO:tasks.workunit.client.0.smithi055.stdout:7/285: chown d5/d6/d24/d3b/f4e 22447 1 2024-04-26T21:08:03.995 INFO:tasks.workunit.client.0.smithi055.stdout:7/286: write d5/d6/ff [354541,51534] 0 2024-04-26T21:08:03.996 INFO:tasks.workunit.client.0.smithi055.stdout:2/299: dread d4/f5 [0,4194304] 0 2024-04-26T21:08:03.997 INFO:tasks.workunit.client.1.smithi064.stdout:2/455: creat d12/d41/d73/d83/d94/d3a/d46/d48/fa1 x:0 0 0 2024-04-26T21:08:03.999 INFO:tasks.workunit.client.0.smithi055.stdout:5/200: rename d4/d18/d3f/f39 to d4/df/d13/d26/d3c/f42 0 2024-04-26T21:08:03.999 INFO:tasks.workunit.client.0.smithi055.stdout:5/201: dread - d4/df/d13/f25 zero size 2024-04-26T21:08:04.000 INFO:tasks.workunit.client.1.smithi064.stdout:0/423: mknod dd/d10/d1a/d31/d47/c88 0 2024-04-26T21:08:04.001 INFO:tasks.workunit.client.1.smithi064.stdout:1/556: mknod d0/d6/d11/d6c/cae 0 2024-04-26T21:08:04.003 INFO:tasks.workunit.client.1.smithi064.stdout:6/401: mkdir d4/d7/d12/d49/d4b/d7d/d83/d85 0 2024-04-26T21:08:04.004 INFO:tasks.workunit.client.0.smithi055.stdout:5/202: symlink d4/df/l43 0 2024-04-26T21:08:04.006 INFO:tasks.workunit.client.0.smithi055.stdout:2/300: dread d4/d14/d33/f59 [0,4194304] 0 2024-04-26T21:08:04.010 INFO:tasks.workunit.client.0.smithi055.stdout:2/301: mknod d4/d55/c6a 0 2024-04-26T21:08:04.011 INFO:tasks.workunit.client.0.smithi055.stdout:2/302: chown d4/d14/d33/f59 6 1 2024-04-26T21:08:04.011 INFO:tasks.workunit.client.0.smithi055.stdout:2/303: write d4/dc/f16 [1746210,91178] 0 2024-04-26T21:08:04.011 INFO:tasks.workunit.client.0.smithi055.stdout:2/304: dread - d4/db/d1f/f67 zero size 2024-04-26T21:08:04.011 INFO:tasks.workunit.client.0.smithi055.stdout:2/305: fdatasync d4/db/d1f/f3d 0 2024-04-26T21:08:04.013 INFO:tasks.workunit.client.1.smithi064.stdout:4/511: link d0/d5/d13/f3d d0/d5/d3e/d54/fa8 0 2024-04-26T21:08:04.014 INFO:tasks.workunit.client.0.smithi055.stdout:2/306: creat d4/d1e/d2a/f6b x:0 0 0 2024-04-26T21:08:04.014 INFO:tasks.workunit.client.0.smithi055.stdout:2/307: truncate d4/d1e/d2a/f62 857732 0 2024-04-26T21:08:04.014 INFO:tasks.workunit.client.0.smithi055.stdout:2/308: fsync d4/db/d1f/f3d 0 2024-04-26T21:08:04.019 INFO:tasks.workunit.client.1.smithi064.stdout:9/457: link d0/d4/da/d26/d47/f62 d0/d39/f91 0 2024-04-26T21:08:04.023 INFO:tasks.workunit.client.1.smithi064.stdout:3/431: rmdir d1/d38 39 2024-04-26T21:08:04.023 INFO:tasks.workunit.client.1.smithi064.stdout:3/432: write d1/d14/f6a [541909,86534] 0 2024-04-26T21:08:04.023 INFO:tasks.workunit.client.1.smithi064.stdout:3/433: chown d1/d27/d50/l18 12935446 1 2024-04-26T21:08:04.023 INFO:tasks.workunit.client.1.smithi064.stdout:3/434: fdatasync d1/d27/f98 0 2024-04-26T21:08:04.028 INFO:tasks.workunit.client.1.smithi064.stdout:0/424: rename dd/d10/d1a/c72 to dd/d10/d74/d1d/c89 0 2024-04-26T21:08:04.028 INFO:tasks.workunit.client.1.smithi064.stdout:0/425: write dd/d10/d1a/d31/d5c/f6f [1014745,64672] 0 2024-04-26T21:08:04.028 INFO:tasks.workunit.client.1.smithi064.stdout:0/426: readlink dd/d10/d74/l20 0 2024-04-26T21:08:04.030 INFO:tasks.workunit.client.0.smithi055.stdout:6/285: getdents d3/d17/d46/d54 0 2024-04-26T21:08:04.033 INFO:tasks.workunit.client.1.smithi064.stdout:6/402: rmdir d4/d7/d12/d49/d4b/d7d/d83/d85 0 2024-04-26T21:08:04.033 INFO:tasks.workunit.client.1.smithi064.stdout:6/403: dread - d4/d7/d12/d49/d4b/d56/f70 zero size 2024-04-26T21:08:04.033 INFO:tasks.workunit.client.1.smithi064.stdout:6/404: chown d4/d7/d12/c27 8989 1 2024-04-26T21:08:04.040 INFO:tasks.workunit.client.1.smithi064.stdout:2/456: dwrite d12/d41/d73/d83/d94/d3a/d46/d6a/f5a [4194304,4194304] 0 2024-04-26T21:08:04.042 INFO:tasks.workunit.client.1.smithi064.stdout:4/512: mkdir d0/d5/d3e/da9 0 2024-04-26T21:08:04.050 INFO:tasks.workunit.client.0.smithi055.stdout:5/203: write d4/f27 [2831478,7836] 0 2024-04-26T21:08:04.050 INFO:tasks.workunit.client.1.smithi064.stdout:3/435: mkdir d1/d27/d50/d35/d4c/d7b/d82/d9b 0 2024-04-26T21:08:04.051 INFO:tasks.workunit.client.1.smithi064.stdout:5/435: sync 2024-04-26T21:08:04.051 INFO:tasks.workunit.client.1.smithi064.stdout:5/436: creat dd/d12/d18/d25/d32/f8c x:0 0 0 2024-04-26T21:08:04.054 INFO:tasks.workunit.client.1.smithi064.stdout:1/557: rename d0/d6/d11/d1e/d2a/d34/f36 to d0/d6/d76/faf 0 2024-04-26T21:08:04.058 INFO:tasks.workunit.client.1.smithi064.stdout:0/427: creat dd/d10/d74/d1d/f8a x:0 0 0 2024-04-26T21:08:04.060 INFO:tasks.workunit.client.0.smithi055.stdout:5/204: symlink d4/d18/d3f/d2e/l44 0 2024-04-26T21:08:04.060 INFO:tasks.workunit.client.0.smithi055.stdout:5/205: chown d4/df/d13/f21 555 1 2024-04-26T21:08:04.061 INFO:tasks.workunit.client.1.smithi064.stdout:6/405: creat d4/d7/d12/d49/d4b/d5a/d79/f86 x:0 0 0 2024-04-26T21:08:04.064 INFO:tasks.workunit.client.0.smithi055.stdout:2/309: read d4/d14/d17/f2e [3481895,51568] 0 2024-04-26T21:08:04.064 INFO:tasks.workunit.client.1.smithi064.stdout:2/457: getdents d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57 0 2024-04-26T21:08:04.065 INFO:tasks.workunit.client.0.smithi055.stdout:9/267: dwrite d2/f1c [0,4194304] 0 2024-04-26T21:08:04.065 INFO:tasks.workunit.client.0.smithi055.stdout:9/268: chown d2/d14/f59 7275 1 2024-04-26T21:08:04.065 INFO:tasks.workunit.client.0.smithi055.stdout:9/269: write d2/f1a [2349480,72243] 0 2024-04-26T21:08:04.065 INFO:tasks.workunit.client.0.smithi055.stdout:9/270: stat d2/d46/f54 0 2024-04-26T21:08:04.068 INFO:tasks.workunit.client.1.smithi064.stdout:9/458: symlink d0/d4/d7/df/l92 0 2024-04-26T21:08:04.068 INFO:tasks.workunit.client.1.smithi064.stdout:3/436: rmdir d1/d12/d7d/d8a 39 2024-04-26T21:08:04.068 INFO:tasks.workunit.client.1.smithi064.stdout:6/406: read d4/d7/f4d [1013484,75517] 0 2024-04-26T21:08:04.069 INFO:tasks.workunit.client.0.smithi055.stdout:4/187: getdents d4/d18 0 2024-04-26T21:08:04.072 INFO:tasks.workunit.client.0.smithi055.stdout:6/286: dread d3/d17/d19/d20/d3e/f4d [0,4194304] 0 2024-04-26T21:08:04.074 INFO:tasks.workunit.client.0.smithi055.stdout:7/287: dwrite d5/d6/d24/f30 [0,4194304] 0 2024-04-26T21:08:04.075 INFO:tasks.workunit.client.1.smithi064.stdout:0/428: truncate dd/d10/d1a/d31/d5c/f5e 1923513 0 2024-04-26T21:08:04.080 INFO:tasks.workunit.client.1.smithi064.stdout:8/355: sync 2024-04-26T21:08:04.080 INFO:tasks.workunit.client.1.smithi064.stdout:7/458: sync 2024-04-26T21:08:04.081 INFO:tasks.workunit.client.1.smithi064.stdout:9/459: mknod d0/d4/da/d26/c93 0 2024-04-26T21:08:04.084 INFO:tasks.workunit.client.1.smithi064.stdout:6/407: symlink d4/d7/d12/d49/l87 0 2024-04-26T21:08:04.085 INFO:tasks.workunit.client.1.smithi064.stdout:6/408: write d4/d7/f1f [750043,61443] 0 2024-04-26T21:08:04.086 INFO:tasks.workunit.client.1.smithi064.stdout:6/409: read d4/f41 [357140,27492] 0 2024-04-26T21:08:04.089 INFO:tasks.workunit.client.0.smithi055.stdout:2/310: unlink d4/d14/d33/f3a 0 2024-04-26T21:08:04.098 INFO:tasks.workunit.client.1.smithi064.stdout:3/437: link d1/d27/f59 d1/d38/f9c 0 2024-04-26T21:08:04.099 INFO:tasks.workunit.client.0.smithi055.stdout:9/271: mkdir d2/d11/d5d 0 2024-04-26T21:08:04.099 INFO:tasks.workunit.client.0.smithi055.stdout:9/272: fdatasync d2/d11/f1f 0 2024-04-26T21:08:04.100 INFO:tasks.workunit.client.1.smithi064.stdout:8/356: symlink d10/d2f/l70 0 2024-04-26T21:08:04.101 INFO:tasks.workunit.client.1.smithi064.stdout:8/357: chown d10/d41/d44/c5f 406 1 2024-04-26T21:08:04.101 INFO:tasks.workunit.client.1.smithi064.stdout:8/358: dread - d10/d41/d44/f6d zero size 2024-04-26T21:08:04.102 INFO:tasks.workunit.client.1.smithi064.stdout:7/459: creat d6/d15/d67/d4d/f9b x:0 0 0 2024-04-26T21:08:04.105 INFO:tasks.workunit.client.0.smithi055.stdout:4/188: unlink d4/l7 0 2024-04-26T21:08:04.106 INFO:tasks.workunit.client.1.smithi064.stdout:9/460: mknod d0/d4/da/d31/d34/d87/c94 0 2024-04-26T21:08:04.106 INFO:tasks.workunit.client.1.smithi064.stdout:9/461: truncate d0/d4/d28/d4f/d74/f8c 748654 0 2024-04-26T21:08:04.107 INFO:tasks.workunit.client.1.smithi064.stdout:5/437: dwrite dd/d12/d18/d25/d74/f82 [0,4194304] 0 2024-04-26T21:08:04.107 INFO:tasks.workunit.client.0.smithi055.stdout:5/206: dwrite d4/d15/f24 [4194304,4194304] 0 2024-04-26T21:08:04.107 INFO:tasks.workunit.client.0.smithi055.stdout:5/207: truncate d4/df/d13/d26/f32 545766 0 2024-04-26T21:08:04.111 INFO:tasks.workunit.client.0.smithi055.stdout:6/287: mkdir d3/d17/d25/d5f 0 2024-04-26T21:08:04.111 INFO:tasks.workunit.client.0.smithi055.stdout:6/288: creat d3/d17/d25/f60 x:0 0 0 2024-04-26T21:08:04.111 INFO:tasks.workunit.client.0.smithi055.stdout:6/289: stat d3/d17/d19/c3f 0 2024-04-26T21:08:04.112 INFO:tasks.workunit.client.1.smithi064.stdout:6/410: symlink d4/d7/d33/l88 0 2024-04-26T21:08:04.112 INFO:tasks.workunit.client.1.smithi064.stdout:6/411: creat d4/d7/d33/f89 x:0 0 0 2024-04-26T21:08:04.117 INFO:tasks.workunit.client.1.smithi064.stdout:3/438: truncate d1/d27/d50/d35/d4c/d55/f7e 1251957 0 2024-04-26T21:08:04.117 INFO:tasks.workunit.client.1.smithi064.stdout:3/439: chown d1/d14/f6a 2 1 2024-04-26T21:08:04.118 INFO:tasks.workunit.client.1.smithi064.stdout:1/558: dwrite d0/d6/f74 [4194304,4194304] 0 2024-04-26T21:08:04.118 INFO:tasks.workunit.client.1.smithi064.stdout:1/559: write d0/d6/d11/d1e/f4f [70206,130608] 0 2024-04-26T21:08:04.120 INFO:tasks.workunit.client.1.smithi064.stdout:2/458: dread d12/d41/d61/d75/f2b [0,4194304] 0 2024-04-26T21:08:04.121 INFO:tasks.workunit.client.1.smithi064.stdout:2/459: fdatasync d12/d41/d73/d83/d94/d3a/d46/d48/d85/f19 0 2024-04-26T21:08:04.126 INFO:tasks.workunit.client.1.smithi064.stdout:9/462: rename d0/d4/da/l55 to d0/d4/da/d26/d47/d88/l95 0 2024-04-26T21:08:04.126 INFO:tasks.workunit.client.0.smithi055.stdout:5/208: write d4/df/d13/f37 [1737050,21310] 0 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/438: unlink dd/d12/d18/d25/l70 0 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/439: creat dd/d12/d18/d33/d48/d6a/f8d x:0 0 0 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/440: creat dd/d12/d18/d1a/d1b/f8e x:0 0 0 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/441: chown dd/d12/d18/d25/d32/f80 994488 1 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/442: chown dd/f13 19 1 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/443: readlink dd/d12/d18/d1a/l3a 0 2024-04-26T21:08:04.129 INFO:tasks.workunit.client.1.smithi064.stdout:5/444: creat dd/d12/d18/d33/d48/d6a/f8f x:0 0 0 2024-04-26T21:08:04.137 INFO:tasks.workunit.client.1.smithi064.stdout:6/412: symlink d4/d7/d33/l8a 0 2024-04-26T21:08:04.137 INFO:tasks.workunit.client.1.smithi064.stdout:3/440: mkdir d1/d27/d29/d9d 0 2024-04-26T21:08:04.137 INFO:tasks.workunit.client.1.smithi064.stdout:3/441: write d1/d38/f8f [688361,571] 0 2024-04-26T21:08:04.137 INFO:tasks.workunit.client.1.smithi064.stdout:3/442: write d1/d12/d7d/f81 [142129,804] 0 2024-04-26T21:08:04.145 INFO:tasks.workunit.client.1.smithi064.stdout:1/560: rename d0/d6/d11/f35 to d0/d6/d11/fb0 0 2024-04-26T21:08:04.146 INFO:tasks.workunit.client.1.smithi064.stdout:1/561: truncate d0/d6/d11/d1e/f56 787876 0 2024-04-26T21:08:04.146 INFO:tasks.workunit.client.1.smithi064.stdout:1/562: dread - d0/d6/d11/d1e/d2a/f8a zero size 2024-04-26T21:08:04.146 INFO:tasks.workunit.client.1.smithi064.stdout:1/563: fdatasync d0/d6/d11/d1e/d27/f65 0 2024-04-26T21:08:04.146 INFO:tasks.workunit.client.1.smithi064.stdout:0/429: dwrite dd/d10/f7d [0,4194304] 0 2024-04-26T21:08:04.149 INFO:tasks.workunit.client.1.smithi064.stdout:5/445: read dd/d12/d18/d33/d63/f7f [3000726,58832] 0 2024-04-26T21:08:04.152 INFO:tasks.workunit.client.1.smithi064.stdout:2/460: rename d12/d41/d61/d6c/d71/l82 to d12/d41/d73/d83/d94/la2 0 2024-04-26T21:08:04.152 INFO:tasks.workunit.client.1.smithi064.stdout:2/461: stat d12/d41/d61/d75 0 2024-04-26T21:08:04.152 INFO:tasks.workunit.client.1.smithi064.stdout:2/462: truncate d12/d41/d73/d83/d94/f3f 1362014 0 2024-04-26T21:08:04.154 INFO:tasks.workunit.client.0.smithi055.stdout:7/288: truncate d5/d11/f2f 7478539 0 2024-04-26T21:08:04.157 INFO:tasks.workunit.client.0.smithi055.stdout:9/273: link d2/d46/f50 d2/f5e 0 2024-04-26T21:08:04.158 INFO:tasks.workunit.client.0.smithi055.stdout:2/311: dwrite d4/dc/d21/f24 [0,4194304] 0 2024-04-26T21:08:04.158 INFO:tasks.workunit.client.0.smithi055.stdout:2/312: chown d4/d14/d17/f2e 174849674 1 2024-04-26T21:08:04.160 INFO:tasks.workunit.client.1.smithi064.stdout:9/463: dread d0/f64 [0,4194304] 0 2024-04-26T21:08:04.167 INFO:tasks.workunit.client.0.smithi055.stdout:6/290: symlink d3/d17/d19/d20/d51/d58/l61 0 2024-04-26T21:08:04.173 INFO:tasks.workunit.client.1.smithi064.stdout:6/413: symlink d4/d7/d12/d49/d4b/d5a/l8b 0 2024-04-26T21:08:04.173 INFO:tasks.workunit.client.1.smithi064.stdout:6/414: truncate d4/d7/d33/f89 593358 0 2024-04-26T21:08:04.175 INFO:tasks.workunit.client.1.smithi064.stdout:8/359: dwrite d10/d2f/f33 [0,4194304] 0 2024-04-26T21:08:04.175 INFO:tasks.workunit.client.1.smithi064.stdout:8/360: creat d10/d1d/d38/f71 x:0 0 0 2024-04-26T21:08:04.176 INFO:tasks.workunit.client.0.smithi055.stdout:5/209: mknod d4/d18/d3f/d2e/c45 0 2024-04-26T21:08:04.176 INFO:tasks.workunit.client.0.smithi055.stdout:5/210: stat d4/f11 0 2024-04-26T21:08:04.177 INFO:tasks.workunit.client.1.smithi064.stdout:3/443: mknod d1/d27/c9e 0 2024-04-26T21:08:04.181 INFO:tasks.workunit.client.1.smithi064.stdout:1/564: mkdir d0/d6/d11/d1e/d2a/d34/db1 0 2024-04-26T21:08:04.185 INFO:tasks.workunit.client.1.smithi064.stdout:0/430: mknod dd/d10/d18/d64/c8b 0 2024-04-26T21:08:04.185 INFO:tasks.workunit.client.1.smithi064.stdout:0/431: readlink dd/d10/d18/d58/l60 0 2024-04-26T21:08:04.187 INFO:tasks.workunit.client.1.smithi064.stdout:1/565: dread d0/d6/d11/d1e/f4f [0,4194304] 0 2024-04-26T21:08:04.196 INFO:tasks.workunit.client.0.smithi055.stdout:2/313: write d4/d1e/f47 [2003676,55237] 0 2024-04-26T21:08:04.196 INFO:tasks.workunit.client.0.smithi055.stdout:2/314: write d4/db/d1f/d32/f3e [2120576,80246] 0 2024-04-26T21:08:04.196 INFO:tasks.workunit.client.0.smithi055.stdout:2/315: chown d4/d1e/c28 4089 1 2024-04-26T21:08:04.200 INFO:tasks.workunit.client.0.smithi055.stdout:9/274: mkdir d2/d14/d33/d5f 0 2024-04-26T21:08:04.202 INFO:tasks.workunit.client.1.smithi064.stdout:6/415: unlink d4/d7/c17 0 2024-04-26T21:08:04.202 INFO:tasks.workunit.client.1.smithi064.stdout:6/416: chown d4/d7/f3a 38 1 2024-04-26T21:08:04.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/566: dread d0/d6/d76/faf [0,4194304] 0 2024-04-26T21:08:04.207 INFO:tasks.workunit.client.1.smithi064.stdout:5/446: dwrite dd/d12/d18/d25/d74/f82 [0,4194304] 0 2024-04-26T21:08:04.207 INFO:tasks.workunit.client.1.smithi064.stdout:5/447: write dd/f10 [4578822,65637] 0 2024-04-26T21:08:04.207 INFO:tasks.workunit.client.1.smithi064.stdout:5/448: creat dd/d12/d18/d25/d74/f90 x:0 0 0 2024-04-26T21:08:04.208 INFO:tasks.workunit.client.1.smithi064.stdout:2/463: dwrite d12/d41/d61/d75/f9f [0,4194304] 0 2024-04-26T21:08:04.208 INFO:tasks.workunit.client.1.smithi064.stdout:2/464: write d12/d41/d73/d83/d94/f37 [442525,68773] 0 2024-04-26T21:08:04.208 INFO:tasks.workunit.client.1.smithi064.stdout:2/465: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/f77 19 1 2024-04-26T21:08:04.208 INFO:tasks.workunit.client.1.smithi064.stdout:2/466: stat d12/d41/d73/d83/d94/d3a/f64 0 2024-04-26T21:08:04.213 INFO:tasks.workunit.client.0.smithi055.stdout:4/189: getdents d4/d18/d1a 0 2024-04-26T21:08:04.215 INFO:tasks.workunit.client.1.smithi064.stdout:8/361: mknod d10/d41/d4e/d60/c72 0 2024-04-26T21:08:04.216 INFO:tasks.workunit.client.1.smithi064.stdout:3/444: mknod d1/d12/d7d/c9f 0 2024-04-26T21:08:04.219 INFO:tasks.workunit.client.0.smithi055.stdout:2/316: mkdir d4/d55/d6c 0 2024-04-26T21:08:04.222 INFO:tasks.workunit.client.0.smithi055.stdout:9/275: symlink d2/d14/d33/d5f/l60 0 2024-04-26T21:08:04.225 INFO:tasks.workunit.client.0.smithi055.stdout:2/317: mkdir d4/d14/d17/d6d 0 2024-04-26T21:08:04.225 INFO:tasks.workunit.client.0.smithi055.stdout:2/318: creat d4/d1e/f6e x:0 0 0 2024-04-26T21:08:04.225 INFO:tasks.workunit.client.0.smithi055.stdout:2/319: write d4/dc/d21/f43 [4421774,55941] 0 2024-04-26T21:08:04.228 INFO:tasks.workunit.client.0.smithi055.stdout:6/291: dwrite d3/d17/f29 [4194304,4194304] 0 2024-04-26T21:08:04.230 INFO:tasks.workunit.client.0.smithi055.stdout:9/276: creat d2/d46/d51/f61 x:0 0 0 2024-04-26T21:08:04.231 INFO:tasks.workunit.client.0.smithi055.stdout:7/289: dwrite d5/d6/d24/d3b/f44 [0,4194304] 0 2024-04-26T21:08:04.231 INFO:tasks.workunit.client.1.smithi064.stdout:5/449: dread dd/d12/d18/d1a/d1f/d20/f47 [4194304,4194304] 0 2024-04-26T21:08:04.233 INFO:tasks.workunit.client.1.smithi064.stdout:9/464: rmdir d0/d4 39 2024-04-26T21:08:04.235 INFO:tasks.workunit.client.0.smithi055.stdout:0/325: sync 2024-04-26T21:08:04.237 INFO:tasks.workunit.client.0.smithi055.stdout:6/292: mkdir d3/d17/d19/d20/d51/d58/d62 0 2024-04-26T21:08:04.241 INFO:tasks.workunit.client.0.smithi055.stdout:7/290: mkdir d5/d53 0 2024-04-26T21:08:04.241 INFO:tasks.workunit.client.0.smithi055.stdout:7/291: chown d5/d6/d24/f30 1 1 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:9/277: write d2/d14/f43 [4020537,34206] 0 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:9/278: fdatasync d2/d14/d33/f58 0 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:6/293: rename d3/l5c to d3/d17/d25/l63 0 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:8/223: sync 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:3/340: sync 2024-04-26T21:08:04.255 INFO:tasks.workunit.client.0.smithi055.stdout:1/258: sync 2024-04-26T21:08:04.257 INFO:tasks.workunit.client.1.smithi064.stdout:9/465: write d0/f59 [1781729,23859] 0 2024-04-26T21:08:04.257 INFO:tasks.workunit.client.0.smithi055.stdout:9/279: truncate d2/f1a 2256606 0 2024-04-26T21:08:04.258 INFO:tasks.workunit.client.1.smithi064.stdout:9/466: write d0/d4/da/f57 [836205,21648] 0 2024-04-26T21:08:04.258 INFO:tasks.workunit.client.1.smithi064.stdout:9/467: chown d0/d4/d28/d4f/d74/f85 341175651 1 2024-04-26T21:08:04.261 INFO:tasks.workunit.client.0.smithi055.stdout:6/294: rename d3/d17/d25/f60 to d3/f64 0 2024-04-26T21:08:04.261 INFO:tasks.workunit.client.0.smithi055.stdout:4/190: dwrite d4/d18/d1e/d28/f32 [0,4194304] 0 2024-04-26T21:08:04.261 INFO:tasks.workunit.client.0.smithi055.stdout:4/191: readlink d4/d12/d15/l34 0 2024-04-26T21:08:04.272 INFO:tasks.workunit.client.0.smithi055.stdout:3/341: creat d0/d4/d5/d73/d13/d27/d50/d6b/f7d x:0 0 0 2024-04-26T21:08:04.275 INFO:tasks.workunit.client.0.smithi055.stdout:6/295: symlink d3/d17/d19/l65 0 2024-04-26T21:08:04.277 INFO:tasks.workunit.client.1.smithi064.stdout:3/445: truncate d1/d38/f49 3248500 0 2024-04-26T21:08:04.277 INFO:tasks.workunit.client.1.smithi064.stdout:9/468: dread d0/d4/da/d26/f23 [0,4194304] 0 2024-04-26T21:08:04.279 INFO:tasks.workunit.client.0.smithi055.stdout:9/280: rename d2/d14/f2b to d2/d14/d33/f62 0 2024-04-26T21:08:04.280 INFO:tasks.workunit.client.1.smithi064.stdout:6/417: dwrite d4/d7/d12/f18 [4194304,4194304] 0 2024-04-26T21:08:04.280 INFO:tasks.workunit.client.1.smithi064.stdout:6/418: write d4/d7/fd [3044505,63742] 0 2024-04-26T21:08:04.280 INFO:tasks.workunit.client.1.smithi064.stdout:6/419: stat d4/l15 0 2024-04-26T21:08:04.281 INFO:tasks.workunit.client.1.smithi064.stdout:5/450: truncate dd/d12/d18/d1a/d1f/f5a 636148 0 2024-04-26T21:08:04.281 INFO:tasks.workunit.client.1.smithi064.stdout:5/451: dread - dd/d12/d18/d1a/d1b/f6c zero size 2024-04-26T21:08:04.281 INFO:tasks.workunit.client.1.smithi064.stdout:6/420: write d4/d7/d12/d38/f73 [147143,90260] 0 2024-04-26T21:08:04.281 INFO:tasks.workunit.client.0.smithi055.stdout:8/224: mkdir d3/d9/d44 0 2024-04-26T21:08:04.284 INFO:tasks.workunit.client.0.smithi055.stdout:4/192: mkdir d4/d12/d17/d3d 0 2024-04-26T21:08:04.285 INFO:tasks.workunit.client.0.smithi055.stdout:4/193: write d4/ff [4953288,105047] 0 2024-04-26T21:08:04.285 INFO:tasks.workunit.client.0.smithi055.stdout:4/194: fsync d4/d18/d1a/f37 0 2024-04-26T21:08:04.286 INFO:tasks.workunit.client.0.smithi055.stdout:1/259: getdents d8/df/d11/d27/d28/d2a 0 2024-04-26T21:08:04.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/432: dwrite dd/d10/d1a/d31/f7a [0,4194304] 0 2024-04-26T21:08:04.287 INFO:tasks.workunit.client.1.smithi064.stdout:1/567: dwrite d0/d6/d11/d1e/f7b [0,4194304] 0 2024-04-26T21:08:04.290 INFO:tasks.workunit.client.0.smithi055.stdout:1/260: creat d8/d17/d36/f59 x:0 0 0 2024-04-26T21:08:04.292 INFO:tasks.workunit.client.0.smithi055.stdout:3/342: creat d0/d4/d5/d73/d13/f7e x:0 0 0 2024-04-26T21:08:04.295 INFO:tasks.workunit.client.0.smithi055.stdout:6/296: mkdir d3/d17/d46/d54/d66 0 2024-04-26T21:08:04.295 INFO:tasks.workunit.client.0.smithi055.stdout:6/297: chown d3/d17/d25/d5f 974037 1 2024-04-26T21:08:04.297 INFO:tasks.workunit.client.1.smithi064.stdout:3/446: mknod d1/d12/d7d/ca0 0 2024-04-26T21:08:04.297 INFO:tasks.workunit.client.1.smithi064.stdout:4/513: sync 2024-04-26T21:08:04.298 INFO:tasks.workunit.client.1.smithi064.stdout:3/447: truncate d1/d27/d29/d6f/d72/d73/f85 498095 0 2024-04-26T21:08:04.307 INFO:tasks.workunit.client.0.smithi055.stdout:9/281: rmdir d2/d11/d5d 0 2024-04-26T21:08:04.307 INFO:tasks.workunit.client.0.smithi055.stdout:9/282: chown d2/d11/l35 89427 1 2024-04-26T21:08:04.309 INFO:tasks.workunit.client.1.smithi064.stdout:5/452: mknod dd/d12/d18/d1a/d1f/d20/d87/c91 0 2024-04-26T21:08:04.311 INFO:tasks.workunit.client.1.smithi064.stdout:8/362: dwrite d10/d41/d4e/d59/f6e [0,4194304] 0 2024-04-26T21:08:04.314 INFO:tasks.workunit.client.0.smithi055.stdout:4/195: stat d4/d12/d15/l34 0 2024-04-26T21:08:04.314 INFO:tasks.workunit.client.1.smithi064.stdout:8/363: write d10/d2f/f4c [5105292,61508] 0 2024-04-26T21:08:04.315 INFO:tasks.workunit.client.1.smithi064.stdout:6/421: rmdir d4/d7/d12/d49/d4b 39 2024-04-26T21:08:04.316 INFO:tasks.workunit.client.0.smithi055.stdout:2/320: dwrite d4/db/d1f/f67 [0,4194304] 0 2024-04-26T21:08:04.320 INFO:tasks.workunit.client.0.smithi055.stdout:6/298: mkdir d3/d17/d19/d20/d67 0 2024-04-26T21:08:04.320 INFO:tasks.workunit.client.0.smithi055.stdout:6/299: write d3/d17/d19/f49 [887020,119731] 0 2024-04-26T21:08:04.320 INFO:tasks.workunit.client.0.smithi055.stdout:6/300: dread - d3/d17/f32 zero size 2024-04-26T21:08:04.327 INFO:tasks.workunit.client.0.smithi055.stdout:2/321: rename d4/db/d1f/d46/l63 to d4/d1e/d69/l6f 0 2024-04-26T21:08:04.329 INFO:tasks.workunit.client.1.smithi064.stdout:0/433: symlink dd/d10/d18/l8c 0 2024-04-26T21:08:04.330 INFO:tasks.workunit.client.0.smithi055.stdout:7/292: dwrite d5/f21 [0,4194304] 0 2024-04-26T21:08:04.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/322: creat d4/db/d56/f70 x:0 0 0 2024-04-26T21:08:04.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/323: readlink d4/l1a 0 2024-04-26T21:08:04.331 INFO:tasks.workunit.client.0.smithi055.stdout:2/324: chown d4/db/d26 191566047 1 2024-04-26T21:08:04.334 INFO:tasks.workunit.client.1.smithi064.stdout:1/568: unlink d0/d6/d11/d1e/f7b 0 2024-04-26T21:08:04.334 INFO:tasks.workunit.client.1.smithi064.stdout:1/569: write d0/d6/d11/d2c/f47 [2174636,87125] 0 2024-04-26T21:08:04.336 INFO:tasks.workunit.client.1.smithi064.stdout:3/448: symlink d1/d14/la1 0 2024-04-26T21:08:04.338 INFO:tasks.workunit.client.1.smithi064.stdout:5/453: chown dd/d12/d18/f39 7 1 2024-04-26T21:08:04.341 INFO:tasks.workunit.client.0.smithi055.stdout:4/196: write d4/d12/d15/f16 [3994208,118018] 0 2024-04-26T21:08:04.341 INFO:tasks.workunit.client.0.smithi055.stdout:4/197: dread - d4/d18/d1e/d2d/f3a zero size 2024-04-26T21:08:04.341 INFO:tasks.workunit.client.0.smithi055.stdout:4/198: write d4/d23/f3b [843559,54572] 0 2024-04-26T21:08:04.341 INFO:tasks.workunit.client.0.smithi055.stdout:2/325: creat d4/dc/f71 x:0 0 0 2024-04-26T21:08:04.341 INFO:tasks.workunit.client.1.smithi064.stdout:5/454: write dd/d12/d18/d1a/d1b/f2c [109830,26567] 0 2024-04-26T21:08:04.343 INFO:tasks.workunit.client.0.smithi055.stdout:4/199: creat d4/d12/f3e x:0 0 0 2024-04-26T21:08:04.346 INFO:tasks.workunit.client.1.smithi064.stdout:0/434: symlink dd/d10/d1a/d31/d47/d61/d42/l8d 0 2024-04-26T21:08:04.347 INFO:tasks.workunit.client.0.smithi055.stdout:4/200: mknod d4/d12/c3f 0 2024-04-26T21:08:04.347 INFO:tasks.workunit.client.0.smithi055.stdout:4/201: dread - d4/d12/f3e zero size 2024-04-26T21:08:04.348 INFO:tasks.workunit.client.1.smithi064.stdout:8/364: dread d10/f12 [0,4194304] 0 2024-04-26T21:08:04.348 INFO:tasks.workunit.client.1.smithi064.stdout:8/365: chown d10/d1d/d38/f39 1 1 2024-04-26T21:08:04.352 INFO:tasks.workunit.client.1.smithi064.stdout:3/449: symlink d1/d38/d68/la2 0 2024-04-26T21:08:04.352 INFO:tasks.workunit.client.1.smithi064.stdout:5/455: unlink dd/d12/d18/d1a/d1b/f8e 0 2024-04-26T21:08:04.352 INFO:tasks.workunit.client.1.smithi064.stdout:9/469: dwrite d0/d4/d7/f33 [0,4194304] 0 2024-04-26T21:08:04.353 INFO:tasks.workunit.client.0.smithi055.stdout:4/202: symlink d4/d18/d1e/d2d/l40 0 2024-04-26T21:08:04.357 INFO:tasks.workunit.client.1.smithi064.stdout:0/435: unlink dd/f15 0 2024-04-26T21:08:04.358 INFO:tasks.workunit.client.1.smithi064.stdout:8/366: mknod d10/d41/d4e/d54/c73 0 2024-04-26T21:08:04.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/326: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:08:04.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/327: write d4/dc/f11 [2689269,10961] 0 2024-04-26T21:08:04.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/328: chown d4/dc/d21 1364 1 2024-04-26T21:08:04.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/329: chown d4/db/d1f/d32/f3e 91 1 2024-04-26T21:08:04.364 INFO:tasks.workunit.client.1.smithi064.stdout:5/456: truncate dd/f16 1317965 0 2024-04-26T21:08:04.364 INFO:tasks.workunit.client.1.smithi064.stdout:9/470: mknod d0/d4/d7/c96 0 2024-04-26T21:08:04.366 INFO:tasks.workunit.client.0.smithi055.stdout:1/261: dread d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:04.366 INFO:tasks.workunit.client.0.smithi055.stdout:1/262: chown d8/df/d11/d27/f3a 575 1 2024-04-26T21:08:04.369 INFO:tasks.workunit.client.0.smithi055.stdout:1/263: creat d8/d17/f5a x:0 0 0 2024-04-26T21:08:04.370 INFO:tasks.workunit.client.1.smithi064.stdout:7/460: sync 2024-04-26T21:08:04.370 INFO:tasks.workunit.client.1.smithi064.stdout:7/461: truncate d6/d15/d1c/d45/f4f 575574 0 2024-04-26T21:08:04.373 INFO:tasks.workunit.client.0.smithi055.stdout:1/264: link d8/df/l3b d8/d17/d36/l5b 0 2024-04-26T21:08:04.373 INFO:tasks.workunit.client.0.smithi055.stdout:1/265: chown d8/d17/d1b/c56 598907 1 2024-04-26T21:08:04.375 INFO:tasks.workunit.client.1.smithi064.stdout:3/450: dread d1/d27/d50/f52 [0,4194304] 0 2024-04-26T21:08:04.376 INFO:tasks.workunit.client.1.smithi064.stdout:8/367: symlink d10/d41/l74 0 2024-04-26T21:08:04.377 INFO:tasks.workunit.client.1.smithi064.stdout:8/368: write d10/f24 [439453,102096] 0 2024-04-26T21:08:04.377 INFO:tasks.workunit.client.1.smithi064.stdout:5/457: unlink dd/d12/d18/d1a/d1f/d20/d87/c91 0 2024-04-26T21:08:04.380 INFO:tasks.workunit.client.0.smithi055.stdout:2/330: dread d4/dc/d21/f24 [0,4194304] 0 2024-04-26T21:08:04.380 INFO:tasks.workunit.client.0.smithi055.stdout:2/331: dread - d4/db/d56/f70 zero size 2024-04-26T21:08:04.380 INFO:tasks.workunit.client.1.smithi064.stdout:7/462: rename d6/d5a/d5f/f66 to d6/d8c/f9c 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/463: truncate d6/db/d34/f96 544788 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/464: creat d6/db/d34/d41/f9d x:0 0 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/465: readlink d6/l2c 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/466: write d6/d15/d1c/f2e [2258845,12987] 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/467: truncate d6/db/d1f/d50/f57 4197627 0 2024-04-26T21:08:04.382 INFO:tasks.workunit.client.0.smithi055.stdout:2/332: rename d4/d1e/f47 to d4/d14/d17/d6d/f72 0 2024-04-26T21:08:04.385 INFO:tasks.workunit.client.1.smithi064.stdout:3/451: symlink d1/d27/d50/d35/d4c/la3 0 2024-04-26T21:08:04.385 INFO:tasks.workunit.client.1.smithi064.stdout:3/452: fdatasync d1/d27/d50/f21 0 2024-04-26T21:08:04.385 INFO:tasks.workunit.client.0.smithi055.stdout:6/301: dread d3/f12 [0,4194304] 0 2024-04-26T21:08:04.386 INFO:tasks.workunit.client.0.smithi055.stdout:6/302: dread - d3/d17/d46/d54/f5e zero size 2024-04-26T21:08:04.386 INFO:tasks.workunit.client.0.smithi055.stdout:2/333: write d4/dc/f16 [1673726,46072] 0 2024-04-26T21:08:04.387 INFO:tasks.workunit.client.1.smithi064.stdout:8/369: mkdir d10/d1d/d75 0 2024-04-26T21:08:04.387 INFO:tasks.workunit.client.1.smithi064.stdout:4/514: dwrite d0/d1d/d56/d89/f8f [0,4194304] 0 2024-04-26T21:08:04.387 INFO:tasks.workunit.client.1.smithi064.stdout:4/515: fdatasync d0/d5/f7c 0 2024-04-26T21:08:04.393 INFO:tasks.workunit.client.0.smithi055.stdout:6/303: rename d3/d17/f34 to d3/d17/d25/f68 0 2024-04-26T21:08:04.397 INFO:tasks.workunit.client.0.smithi055.stdout:9/283: dread d2/f1e [4194304,4194304] 0 2024-04-26T21:08:04.397 INFO:tasks.workunit.client.0.smithi055.stdout:9/284: write d2/d46/f54 [206358,65217] 0 2024-04-26T21:08:04.398 INFO:tasks.workunit.client.1.smithi064.stdout:7/468: mkdir d6/d8c/d9e 0 2024-04-26T21:08:04.400 INFO:tasks.workunit.client.0.smithi055.stdout:8/225: dwrite d3/f14 [0,4194304] 0 2024-04-26T21:08:04.403 INFO:tasks.workunit.client.1.smithi064.stdout:7/469: write d6/d15/d67/d4d/f6a [18604,96797] 0 2024-04-26T21:08:04.403 INFO:tasks.workunit.client.1.smithi064.stdout:7/470: dread - d6/db/d34/d6f/d81/f84 zero size 2024-04-26T21:08:04.404 INFO:tasks.workunit.client.0.smithi055.stdout:2/334: rename d4/d14/d17/f37 to d4/d49/d4c/f73 0 2024-04-26T21:08:04.404 INFO:tasks.workunit.client.0.smithi055.stdout:4/203: getdents d4/d18/d1e/d2d 0 2024-04-26T21:08:04.405 INFO:tasks.workunit.client.0.smithi055.stdout:4/204: write d4/d18/d1a/f37 [52171,32421] 0 2024-04-26T21:08:04.405 INFO:tasks.workunit.client.0.smithi055.stdout:9/285: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:04.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/471: creat d6/d8c/f9f x:0 0 0 2024-04-26T21:08:04.415 INFO:tasks.workunit.client.1.smithi064.stdout:8/370: getdents d10/d41/d44/d5a 0 2024-04-26T21:08:04.425 INFO:tasks.workunit.client.0.smithi055.stdout:8/226: unlink d3/d9/d1d/c34 0 2024-04-26T21:08:04.432 INFO:tasks.workunit.client.0.smithi055.stdout:9/286: rename d2/c36 to d2/d46/d51/c63 0 2024-04-26T21:08:04.432 INFO:tasks.workunit.client.1.smithi064.stdout:2/467: sync 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/468: dread - d12/f9d zero size 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/469: readlink d12/d41/d73/l7b 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:2/470: creat d12/d41/d73/d83/d94/d3a/d46/d91/d96/fa3 x:0 0 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:8/371: symlink d10/d41/l76 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:8/372: stat d10/d41/d44/f66 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/472: symlink d6/d9/d3d/d58/la0 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/473: readlink d6/db/d1f/d50/l61 0 2024-04-26T21:08:04.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/474: write d6/d9/d3d/f92 [404703,27031] 0 2024-04-26T21:08:04.435 INFO:tasks.workunit.client.0.smithi055.stdout:2/335: mknod d4/d49/d4c/d5e/c74 0 2024-04-26T21:08:04.435 INFO:tasks.workunit.client.0.smithi055.stdout:2/336: creat d4/db/d1f/d46/f75 x:0 0 0 2024-04-26T21:08:04.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/287: link d2/c3c d2/d14/c64 0 2024-04-26T21:08:04.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/288: write d2/d14/f4f [946892,50162] 0 2024-04-26T21:08:04.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/289: write d2/f1e [617673,71205] 0 2024-04-26T21:08:04.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/290: chown d2/d46/d51/c56 3324179 1 2024-04-26T21:08:04.442 INFO:tasks.workunit.client.0.smithi055.stdout:9/291: symlink d2/d46/l65 0 2024-04-26T21:08:04.442 INFO:tasks.workunit.client.0.smithi055.stdout:9/292: stat d2/d11/l2e 0 2024-04-26T21:08:04.444 INFO:tasks.workunit.client.1.smithi064.stdout:6/422: dwrite d4/d7/d12/d38/f61 [0,4194304] 0 2024-04-26T21:08:04.444 INFO:tasks.workunit.client.1.smithi064.stdout:2/471: truncate d12/d41/d73/d83/d94/f35 4348086 0 2024-04-26T21:08:04.444 INFO:tasks.workunit.client.1.smithi064.stdout:9/471: dread d0/d4/da/f14 [0,4194304] 0 2024-04-26T21:08:04.444 INFO:tasks.workunit.client.1.smithi064.stdout:8/373: truncate d10/d1d/f43 2015431 0 2024-04-26T21:08:04.445 INFO:tasks.workunit.client.0.smithi055.stdout:9/293: symlink d2/d11/l66 0 2024-04-26T21:08:04.445 INFO:tasks.workunit.client.0.smithi055.stdout:9/294: write d2/f55 [4349770,36465] 0 2024-04-26T21:08:04.448 INFO:tasks.workunit.client.1.smithi064.stdout:5/458: dwrite dd/d12/f40 [4194304,4194304] 0 2024-04-26T21:08:04.450 INFO:tasks.workunit.client.0.smithi055.stdout:2/337: dread d4/d1e/d2a/f30 [0,4194304] 0 2024-04-26T21:08:04.451 INFO:tasks.workunit.client.1.smithi064.stdout:4/516: dwrite d0/d5/d13/d6d/f83 [0,4194304] 0 2024-04-26T21:08:04.452 INFO:tasks.workunit.client.1.smithi064.stdout:4/517: truncate d0/d2f/d69/f9a 518032 0 2024-04-26T21:08:04.452 INFO:tasks.workunit.client.1.smithi064.stdout:4/518: fdatasync d0/d5/d13/f12 0 2024-04-26T21:08:04.459 INFO:tasks.workunit.client.1.smithi064.stdout:6/423: dread d4/f41 [0,4194304] 0 2024-04-26T21:08:04.459 INFO:tasks.workunit.client.1.smithi064.stdout:6/424: creat d4/d7/d33/f8c x:0 0 0 2024-04-26T21:08:04.459 INFO:tasks.workunit.client.0.smithi055.stdout:8/227: write d3/d9/d1d/f25 [4153777,77229] 0 2024-04-26T21:08:04.459 INFO:tasks.workunit.client.0.smithi055.stdout:8/228: chown d3/d9/d1f/l20 13188243 1 2024-04-26T21:08:04.461 INFO:tasks.workunit.client.1.smithi064.stdout:7/475: link d6/db/c20 d6/ca1 0 2024-04-26T21:08:04.466 INFO:tasks.workunit.client.1.smithi064.stdout:9/472: mknod d0/d4/da/d31/d34/c97 0 2024-04-26T21:08:04.469 INFO:tasks.workunit.client.1.smithi064.stdout:2/472: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/la4 0 2024-04-26T21:08:04.473 INFO:tasks.workunit.client.1.smithi064.stdout:7/476: write f5 [720903,129491] 0 2024-04-26T21:08:04.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/374: link d10/d41/d44/f66 d10/d41/f77 0 2024-04-26T21:08:04.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/375: dread - d10/d41/d44/d5a/f62 zero size 2024-04-26T21:08:04.479 INFO:tasks.workunit.client.0.smithi055.stdout:8/229: mknod d3/d9/c45 0 2024-04-26T21:08:04.480 INFO:tasks.workunit.client.1.smithi064.stdout:3/453: dwrite d1/d27/d29/f4b [0,4194304] 0 2024-04-26T21:08:04.481 INFO:tasks.workunit.client.1.smithi064.stdout:5/459: creat dd/d12/d18/d33/d48/d88/d8a/f92 x:0 0 0 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/266: dwrite d8/df/f55 [0,4194304] 0 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/267: dread - d8/df/d11/d27/d28/f4a zero size 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/268: write d8/df/d11/d27/d28/d3d/f51 [2645,64592] 0 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/269: creat d8/df/f5c x:0 0 0 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/270: write d8/df/d11/d27/d28/d3d/f4c [378844,9505] 0 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/271: chown d8/d17/d1b/f20 746 1 2024-04-26T21:08:04.484 INFO:tasks.workunit.client.0.smithi055.stdout:1/272: read - d8/df/d11/d27/d28/f40 zero size 2024-04-26T21:08:04.485 INFO:tasks.workunit.client.0.smithi055.stdout:4/205: dwrite d4/ff [0,4194304] 0 2024-04-26T21:08:04.485 INFO:tasks.workunit.client.0.smithi055.stdout:4/206: write d4/d18/d1e/d2d/f3a [734522,92566] 0 2024-04-26T21:08:04.490 INFO:tasks.workunit.client.0.smithi055.stdout:8/230: creat d3/f46 x:0 0 0 2024-04-26T21:08:04.491 INFO:tasks.workunit.client.1.smithi064.stdout:4/519: symlink d0/d1d/d17/d44/laa 0 2024-04-26T21:08:04.496 INFO:tasks.workunit.client.1.smithi064.stdout:6/425: truncate d4/d7/f1f 268590 0 2024-04-26T21:08:04.497 INFO:tasks.workunit.client.1.smithi064.stdout:0/436: dwrite dd/d10/d74/d1d/f38 [0,4194304] 0 2024-04-26T21:08:04.500 INFO:tasks.workunit.client.1.smithi064.stdout:9/473: rmdir d0/d4/da/d8d 0 2024-04-26T21:08:04.502 INFO:tasks.workunit.client.0.smithi055.stdout:4/207: link d4/d23/f3b d4/d18/d1e/d2d/f41 0 2024-04-26T21:08:04.509 INFO:tasks.workunit.client.0.smithi055.stdout:8/231: creat d3/f47 x:0 0 0 2024-04-26T21:08:04.513 INFO:tasks.workunit.client.0.smithi055.stdout:8/232: mkdir d3/d9/d1d/d48 0 2024-04-26T21:08:04.513 INFO:tasks.workunit.client.1.smithi064.stdout:2/473: creat d12/d41/d73/d83/d94/fa5 x:0 0 0 2024-04-26T21:08:04.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/477: rename d6/db/d34/c6d to d6/d9/d38/ca2 0 2024-04-26T21:08:04.514 INFO:tasks.workunit.client.1.smithi064.stdout:8/376: rename d10 to d10/d2f/d56/d78 22 2024-04-26T21:08:04.514 INFO:tasks.workunit.client.1.smithi064.stdout:4/520: dread d0/ff [0,4194304] 0 2024-04-26T21:08:04.514 INFO:tasks.workunit.client.1.smithi064.stdout:4/521: chown d0/d1d/f1b 2178765 1 2024-04-26T21:08:04.514 INFO:tasks.workunit.client.1.smithi064.stdout:4/522: dread - d0/d2f/f6f zero size 2024-04-26T21:08:04.514 INFO:tasks.workunit.client.0.smithi055.stdout:6/304: dwrite d3/d17/d19/d20/f56 [0,4194304] 0 2024-04-26T21:08:04.517 INFO:tasks.workunit.client.1.smithi064.stdout:3/454: link d1/ld d1/d27/d50/d35/d4c/d7b/d82/la4 0 2024-04-26T21:08:04.517 INFO:tasks.workunit.client.1.smithi064.stdout:5/460: link dd/d12/d18/d25/d32/f78 dd/d12/d18/d25/d67/f93 0 2024-04-26T21:08:04.517 INFO:tasks.workunit.client.1.smithi064.stdout:5/461: fsync dd/d12/d18/d1a/d1b/f2c 0 2024-04-26T21:08:04.520 INFO:tasks.workunit.client.0.smithi055.stdout:8/233: mknod d3/d9/d1f/d2e/c49 0 2024-04-26T21:08:04.520 INFO:tasks.workunit.client.0.smithi055.stdout:8/234: write d3/d9/d1f/f23 [3582005,85922] 0 2024-04-26T21:08:04.520 INFO:tasks.workunit.client.0.smithi055.stdout:1/273: dread d8/df/d11/d27/f3f [0,4194304] 0 2024-04-26T21:08:04.525 INFO:tasks.workunit.client.1.smithi064.stdout:6/426: mkdir d4/d7/d12/d8d 0 2024-04-26T21:08:04.525 INFO:tasks.workunit.client.1.smithi064.stdout:6/427: readlink d4/l15 0 2024-04-26T21:08:04.538 INFO:tasks.workunit.client.0.smithi055.stdout:2/338: dwrite d4/db/d1f/f3d [0,4194304] 0 2024-04-26T21:08:04.541 INFO:tasks.workunit.client.1.smithi064.stdout:4/523: write d0/d1d/d56/d89/f8f [2278966,73984] 0 2024-04-26T21:08:04.542 INFO:tasks.workunit.client.0.smithi055.stdout:1/274: unlink d8/ce 0 2024-04-26T21:08:04.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/377: dread d10/d1d/d38/f5b [0,4194304] 0 2024-04-26T21:08:04.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/378: dread - d10/d41/d4e/d54/f57 zero size 2024-04-26T21:08:04.545 INFO:tasks.workunit.client.0.smithi055.stdout:8/235: write d3/f14 [1947498,52811] 0 2024-04-26T21:08:04.546 INFO:tasks.workunit.client.1.smithi064.stdout:2/474: stat d12/d41/d61/d75/l27 0 2024-04-26T21:08:04.546 INFO:tasks.workunit.client.1.smithi064.stdout:9/474: rename d0/d4/d28/d4f/c79 to d0/d4/da/d26/d47/d88/c98 0 2024-04-26T21:08:04.546 INFO:tasks.workunit.client.1.smithi064.stdout:2/475: creat d12/d41/d73/d83/fa6 x:0 0 0 2024-04-26T21:08:04.549 INFO:tasks.workunit.client.1.smithi064.stdout:5/462: write dd/f1e [365576,129610] 0 2024-04-26T21:08:04.549 INFO:tasks.workunit.client.1.smithi064.stdout:5/463: creat dd/d12/d18/d25/d67/f94 x:0 0 0 2024-04-26T21:08:04.551 INFO:tasks.workunit.client.0.smithi055.stdout:4/208: rename d4/d18/d1e to d4/d26/d42 0 2024-04-26T21:08:04.551 INFO:tasks.workunit.client.0.smithi055.stdout:4/209: truncate d4/d23/f3b 1017638 0 2024-04-26T21:08:04.551 INFO:tasks.workunit.client.0.smithi055.stdout:4/210: creat d4/d12/f43 x:0 0 0 2024-04-26T21:08:04.557 INFO:tasks.workunit.client.1.smithi064.stdout:4/524: creat d0/d1d/d17/fab x:0 0 0 2024-04-26T21:08:04.557 INFO:tasks.workunit.client.1.smithi064.stdout:8/379: readlink d10/l28 0 2024-04-26T21:08:04.558 INFO:tasks.workunit.client.0.smithi055.stdout:2/339: symlink d4/d1e/l76 0 2024-04-26T21:08:04.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/428: dwrite d4/d7/d33/f89 [0,4194304] 0 2024-04-26T21:08:04.564 INFO:tasks.workunit.client.0.smithi055.stdout:1/275: symlink d8/df/d11/d27/d28/d2a/l5d 0 2024-04-26T21:08:04.564 INFO:tasks.workunit.client.0.smithi055.stdout:1/276: readlink d8/d17/d36/l5b 0 2024-04-26T21:08:04.566 INFO:tasks.workunit.client.1.smithi064.stdout:9/475: unlink d0/d4/d28/l4c 0 2024-04-26T21:08:04.566 INFO:tasks.workunit.client.1.smithi064.stdout:7/478: rename d6/d15/d1c/d45/l7c to d6/d5a/d5f/la3 0 2024-04-26T21:08:04.584 INFO:tasks.workunit.client.0.smithi055.stdout:6/305: rename d3/f5 to d3/d4f/f69 0 2024-04-26T21:08:04.584 INFO:tasks.workunit.client.0.smithi055.stdout:6/306: fdatasync d3/d4f/f69 0 2024-04-26T21:08:04.585 INFO:tasks.workunit.client.0.smithi055.stdout:4/211: creat d4/d26/d42/d28/f44 x:0 0 0 2024-04-26T21:08:04.585 INFO:tasks.workunit.client.0.smithi055.stdout:4/212: dread - d4/d12/f43 zero size 2024-04-26T21:08:04.586 INFO:tasks.workunit.client.0.smithi055.stdout:2/340: creat d4/d14/d17/d6d/f77 x:0 0 0 2024-04-26T21:08:04.588 INFO:tasks.workunit.client.0.smithi055.stdout:1/277: symlink d8/d17/d1b/d41/l5e 0 2024-04-26T21:08:04.588 INFO:tasks.workunit.client.0.smithi055.stdout:1/278: chown d8/d17/d36/c4b 468862160 1 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:4/525: dread d0/d5/d13/d33/f39 [0,4194304] 0 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:1/570: sync 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:4/526: write d0/d5/d3e/d54/fa8 [1797088,96216] 0 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:6/429: truncate d4/d7/d12/d49/d4b/d5a/f5d 715280 0 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:7/479: symlink d6/d15/d67/la4 0 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:6/430: fdatasync d4/f2f 0 2024-04-26T21:08:04.593 INFO:tasks.workunit.client.1.smithi064.stdout:7/480: chown d6/db/d1f/f6c 14 1 2024-04-26T21:08:04.594 INFO:tasks.workunit.client.0.smithi055.stdout:8/236: symlink d3/l4a 0 2024-04-26T21:08:04.594 INFO:tasks.workunit.client.0.smithi055.stdout:4/213: creat d4/d12/d17/d3d/f45 x:0 0 0 2024-04-26T21:08:04.596 INFO:tasks.workunit.client.0.smithi055.stdout:2/341: symlink d4/d49/l78 0 2024-04-26T21:08:04.596 INFO:tasks.workunit.client.0.smithi055.stdout:2/342: fsync d4/d14/d17/d6d/f72 0 2024-04-26T21:08:04.600 INFO:tasks.workunit.client.0.smithi055.stdout:1/279: unlink d8/d17/c3e 0 2024-04-26T21:08:04.604 INFO:tasks.workunit.client.0.smithi055.stdout:4/214: rename d4/d26/d42/d28/l2f to d4/d12/d15/l46 0 2024-04-26T21:08:04.604 INFO:tasks.workunit.client.0.smithi055.stdout:4/215: chown d4/d12/f43 57 1 2024-04-26T21:08:04.605 INFO:tasks.workunit.client.1.smithi064.stdout:9/476: dwrite d0/d4/f8f [0,4194304] 0 2024-04-26T21:08:04.613 INFO:tasks.workunit.client.0.smithi055.stdout:2/343: rmdir d4/d55 39 2024-04-26T21:08:04.616 INFO:tasks.workunit.client.1.smithi064.stdout:7/481: symlink d6/db/d34/d41/d5c/la5 0 2024-04-26T21:08:04.618 INFO:tasks.workunit.client.1.smithi064.stdout:3/455: rename d1/d12 to d1/d27/d29/d6f/d72/da5 0 2024-04-26T21:08:04.620 INFO:tasks.workunit.client.1.smithi064.stdout:4/527: dread d0/d14/f50 [0,4194304] 0 2024-04-26T21:08:04.623 INFO:tasks.workunit.client.1.smithi064.stdout:7/482: creat d6/d70/fa6 x:0 0 0 2024-04-26T21:08:04.628 INFO:tasks.workunit.client.1.smithi064.stdout:8/380: rename d10/d1d/d75 to d10/d41/d4e/d59/d5d/d79 0 2024-04-26T21:08:04.633 INFO:tasks.workunit.client.1.smithi064.stdout:1/571: rename d0/d6/f19 to d0/d6/d11/fb2 0 2024-04-26T21:08:04.634 INFO:tasks.workunit.client.1.smithi064.stdout:1/572: chown d0/d6/d11/d1e/f54 1752 1 2024-04-26T21:08:04.634 INFO:tasks.workunit.client.1.smithi064.stdout:9/477: write d0/d4/f53 [280870,118170] 0 2024-04-26T21:08:04.636 INFO:tasks.workunit.client.1.smithi064.stdout:0/437: dwrite dd/d10/f7d [0,4194304] 0 2024-04-26T21:08:04.638 INFO:tasks.workunit.client.1.smithi064.stdout:1/573: rename d0/ca to d0/d6b/d9e/cb3 0 2024-04-26T21:08:04.639 INFO:tasks.workunit.client.1.smithi064.stdout:1/574: truncate d0/d6/d29/d31/f4c 318643 0 2024-04-26T21:08:04.650 INFO:tasks.workunit.client.1.smithi064.stdout:9/478: dread d0/d4/da/d26/d47/f4b [0,4194304] 0 2024-04-26T21:08:04.659 INFO:tasks.workunit.client.1.smithi064.stdout:6/431: rename d4/c65 to d4/d7/d12/d49/c8e 0 2024-04-26T21:08:04.659 INFO:tasks.workunit.client.1.smithi064.stdout:0/438: mknod dd/d10/d74/d4f/d7b/c8e 0 2024-04-26T21:08:04.660 INFO:tasks.workunit.client.1.smithi064.stdout:6/432: write d4/d7/fd [1310443,33489] 0 2024-04-26T21:08:04.660 INFO:tasks.workunit.client.1.smithi064.stdout:6/433: chown d4/d7/d12/d1e/l30 214833724 1 2024-04-26T21:08:04.660 INFO:tasks.workunit.client.1.smithi064.stdout:6/434: truncate d4/d7/d12/d38/f61 4522636 0 2024-04-26T21:08:04.662 INFO:tasks.workunit.client.1.smithi064.stdout:9/479: getdents d0/d4/d28/d4f 0 2024-04-26T21:08:04.666 INFO:tasks.workunit.client.1.smithi064.stdout:0/439: mknod dd/d10/d74/c8f 0 2024-04-26T21:08:04.666 INFO:tasks.workunit.client.1.smithi064.stdout:0/440: write dd/d10/d74/d1d/f8a [981846,17026] 0 2024-04-26T21:08:04.666 INFO:tasks.workunit.client.1.smithi064.stdout:6/435: stat d4/d7/d12/d49/d4b/c6a 0 2024-04-26T21:08:04.667 INFO:tasks.workunit.client.0.smithi055.stdout:4/216: write d4/f11 [2525243,71173] 0 2024-04-26T21:08:04.669 INFO:tasks.workunit.client.1.smithi064.stdout:9/480: chown d0/d4/da/d26/d47/d6b/l7e 407508588 1 2024-04-26T21:08:04.669 INFO:tasks.workunit.client.1.smithi064.stdout:9/481: read d0/d4/da/d26/d47/f65 [1852322,35622] 0 2024-04-26T21:08:04.669 INFO:tasks.workunit.client.1.smithi064.stdout:9/482: dread - d0/d4/da/d31/f82 zero size 2024-04-26T21:08:04.669 INFO:tasks.workunit.client.1.smithi064.stdout:9/483: write d0/f59 [419468,38347] 0 2024-04-26T21:08:04.671 INFO:tasks.workunit.client.1.smithi064.stdout:0/441: mknod dd/d10/d74/d1d/c90 0 2024-04-26T21:08:04.672 INFO:tasks.workunit.client.1.smithi064.stdout:3/456: dread d1/d27/d29/d6f/d72/da5/f44 [0,4194304] 0 2024-04-26T21:08:04.672 INFO:tasks.workunit.client.1.smithi064.stdout:6/436: mkdir d4/d7/d12/d49/d4b/d5a/d8f 0 2024-04-26T21:08:04.678 INFO:tasks.workunit.client.0.smithi055.stdout:4/217: rmdir d4/d23 39 2024-04-26T21:08:04.679 INFO:tasks.workunit.client.0.smithi055.stdout:6/307: dwrite d3/d4f/f69 [0,4194304] 0 2024-04-26T21:08:04.682 INFO:tasks.workunit.client.1.smithi064.stdout:9/484: creat d0/d4/da/d31/d34/d87/f99 x:0 0 0 2024-04-26T21:08:04.682 INFO:tasks.workunit.client.1.smithi064.stdout:3/457: mknod d1/d27/d29/d6f/d72/d73/ca6 0 2024-04-26T21:08:04.682 INFO:tasks.workunit.client.1.smithi064.stdout:9/485: read d0/d4/d7/df/f40 [1576690,62731] 0 2024-04-26T21:08:04.685 INFO:tasks.workunit.client.1.smithi064.stdout:9/486: unlink d0/d4/f8f 0 2024-04-26T21:08:04.685 INFO:tasks.workunit.client.1.smithi064.stdout:6/437: unlink d4/d7/d12/c2a 0 2024-04-26T21:08:04.685 INFO:tasks.workunit.client.1.smithi064.stdout:6/438: creat d4/d7/d12/d49/d4b/d5a/d79/f90 x:0 0 0 2024-04-26T21:08:04.689 INFO:tasks.workunit.client.0.smithi055.stdout:6/308: rename d3/d17/d19/d20 to d3/d17/d46/d54/d66/d6a 0 2024-04-26T21:08:04.691 INFO:tasks.workunit.client.1.smithi064.stdout:7/483: dread d6/db/f2a [0,4194304] 0 2024-04-26T21:08:04.691 INFO:tasks.workunit.client.1.smithi064.stdout:3/458: dread d1/d14/f3e [0,4194304] 0 2024-04-26T21:08:04.691 INFO:tasks.workunit.client.0.smithi055.stdout:6/309: mkdir d3/d17/d46/d54/d66/d6a/d6b 0 2024-04-26T21:08:04.693 INFO:tasks.workunit.client.1.smithi064.stdout:6/439: rmdir d4/d7/d33 39 2024-04-26T21:08:04.693 INFO:tasks.workunit.client.1.smithi064.stdout:6/440: getdents d4/d7/d12/d8d 0 2024-04-26T21:08:04.693 INFO:tasks.workunit.client.1.smithi064.stdout:6/441: write d4/d7/d12/f77 [885427,43200] 0 2024-04-26T21:08:04.695 INFO:tasks.workunit.client.0.smithi055.stdout:6/310: symlink d3/d17/d19/l6c 0 2024-04-26T21:08:04.695 INFO:tasks.workunit.client.0.smithi055.stdout:2/344: dwrite d4/db/d1f/d46/f64 [0,4194304] 0 2024-04-26T21:08:04.696 INFO:tasks.workunit.client.0.smithi055.stdout:2/345: creat d4/db/d1f/d46/f79 x:0 0 0 2024-04-26T21:08:04.696 INFO:tasks.workunit.client.0.smithi055.stdout:2/346: chown d4/db/d1f/f29 14167 1 2024-04-26T21:08:04.696 INFO:tasks.workunit.client.0.smithi055.stdout:2/347: chown d4/d14/d17/d6d/f77 1880683 1 2024-04-26T21:08:04.696 INFO:tasks.workunit.client.1.smithi064.stdout:3/459: truncate d1/d38/f6c 1549954 0 2024-04-26T21:08:04.700 INFO:tasks.workunit.client.1.smithi064.stdout:5/464: dwrite dd/d12/d18/d25/d32/f80 [0,4194304] 0 2024-04-26T21:08:04.701 INFO:tasks.workunit.client.1.smithi064.stdout:5/465: truncate dd/d12/d18/d25/d67/f93 713043 0 2024-04-26T21:08:04.701 INFO:tasks.workunit.client.1.smithi064.stdout:5/466: write dd/d12/d18/d33/d48/f72 [537471,65920] 0 2024-04-26T21:08:04.702 INFO:tasks.workunit.client.0.smithi055.stdout:4/218: dread d4/f9 [0,4194304] 0 2024-04-26T21:08:04.703 INFO:tasks.workunit.client.0.smithi055.stdout:1/280: dwrite d8/f12 [0,4194304] 0 2024-04-26T21:08:04.703 INFO:tasks.workunit.client.0.smithi055.stdout:1/281: dread - d8/df/d11/d27/d28/d3d/f52 zero size 2024-04-26T21:08:04.705 INFO:tasks.workunit.client.0.smithi055.stdout:8/237: dwrite d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:04.707 INFO:tasks.workunit.client.1.smithi064.stdout:6/442: link d4/d7/d12/d38/f3f d4/d7/d12/d49/d4b/d7d/f91 0 2024-04-26T21:08:04.707 INFO:tasks.workunit.client.0.smithi055.stdout:1/282: write d8/df/f24 [1689802,74034] 0 2024-04-26T21:08:04.712 INFO:tasks.workunit.client.0.smithi055.stdout:6/311: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d6d 0 2024-04-26T21:08:04.715 INFO:tasks.workunit.client.1.smithi064.stdout:1/575: getdents d0/d6b/d9e 0 2024-04-26T21:08:04.716 INFO:tasks.workunit.client.1.smithi064.stdout:1/576: chown d0/d6/d11/d1e/d27/f81 1288 1 2024-04-26T21:08:04.716 INFO:tasks.workunit.client.1.smithi064.stdout:1/577: truncate d0/d6/f8f 1209952 0 2024-04-26T21:08:04.718 INFO:tasks.workunit.client.0.smithi055.stdout:4/219: creat d4/d18/f47 x:0 0 0 2024-04-26T21:08:04.718 INFO:tasks.workunit.client.0.smithi055.stdout:4/220: fdatasync d4/d12/d15/f16 0 2024-04-26T21:08:04.719 INFO:tasks.workunit.client.1.smithi064.stdout:6/443: dread d4/d7/d12/d38/f3c [0,4194304] 0 2024-04-26T21:08:04.722 INFO:tasks.workunit.client.1.smithi064.stdout:4/528: dwrite d0/d5/f7c [0,4194304] 0 2024-04-26T21:08:04.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/487: dread d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:04.730 INFO:tasks.workunit.client.1.smithi064.stdout:9/488: getdents d0/d4/da/d26/d45/d90 0 2024-04-26T21:08:04.733 INFO:tasks.workunit.client.1.smithi064.stdout:1/578: creat d0/d22/d87/fb4 x:0 0 0 2024-04-26T21:08:04.733 INFO:tasks.workunit.client.1.smithi064.stdout:1/579: dread - d0/d6/dd/f97 zero size 2024-04-26T21:08:04.737 INFO:tasks.workunit.client.1.smithi064.stdout:6/444: symlink d4/d7/d12/d8d/l92 0 2024-04-26T21:08:04.737 INFO:tasks.workunit.client.1.smithi064.stdout:6/445: write d4/d7/f1f [935260,91674] 0 2024-04-26T21:08:04.737 INFO:tasks.workunit.client.1.smithi064.stdout:6/446: fsync d4/d7/f69 0 2024-04-26T21:08:04.744 INFO:tasks.workunit.client.0.smithi055.stdout:1/283: rename d8/df/d11/d27/d28/l2b to d8/df/d11/d27/d28/d3d/l5f 0 2024-04-26T21:08:04.744 INFO:tasks.workunit.client.0.smithi055.stdout:2/348: dwrite d4/d1e/f4f [0,4194304] 0 2024-04-26T21:08:04.744 INFO:tasks.workunit.client.0.smithi055.stdout:2/349: dread - d4/d1e/d2a/f6b zero size 2024-04-26T21:08:04.746 INFO:tasks.workunit.client.1.smithi064.stdout:4/529: rename d0/d5/d3e to d0/d1d/d17/d44/dac 0 2024-04-26T21:08:04.747 INFO:tasks.workunit.client.1.smithi064.stdout:4/530: dread - d0/d5/d13/d33/f85 zero size 2024-04-26T21:08:04.747 INFO:tasks.workunit.client.1.smithi064.stdout:4/531: write d0/d2f/d69/fa6 [712289,24901] 0 2024-04-26T21:08:04.748 INFO:tasks.workunit.client.0.smithi055.stdout:6/312: creat d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e x:0 0 0 2024-04-26T21:08:04.753 INFO:tasks.workunit.client.1.smithi064.stdout:7/484: dwrite d6/d9/d38/f3a [0,4194304] 0 2024-04-26T21:08:04.759 INFO:tasks.workunit.client.1.smithi064.stdout:1/580: link d0/d22/d87/fb4 d0/d6/d11/d1e/fb5 0 2024-04-26T21:08:04.762 INFO:tasks.workunit.client.0.smithi055.stdout:8/238: rmdir d3/d9 39 2024-04-26T21:08:04.763 INFO:tasks.workunit.client.1.smithi064.stdout:6/447: symlink d4/d7/l93 0 2024-04-26T21:08:04.765 INFO:tasks.workunit.client.1.smithi064.stdout:3/460: dwrite d1/d14/f3e [0,4194304] 0 2024-04-26T21:08:04.767 INFO:tasks.workunit.client.1.smithi064.stdout:4/532: rename d0/d5/d13/c3b to d0/d1d/d17/d44/dac/da9/cad 0 2024-04-26T21:08:04.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/221: rename d4/d12/c3f to d4/c48 0 2024-04-26T21:08:04.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/222: truncate d4/f9 3680186 0 2024-04-26T21:08:04.774 INFO:tasks.workunit.client.0.smithi055.stdout:1/284: mknod d8/d17/d1b/c60 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.1.smithi064.stdout:7/485: stat d6/db/d1f/l44 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.1.smithi064.stdout:7/486: fsync d6/d15/d1c/f2e 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.1.smithi064.stdout:7/487: read d6/db/d34/d41/f49 [287069,27250] 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.0.smithi055.stdout:6/313: write d3/d17/f18 [2594717,107804] 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.0.smithi055.stdout:6/314: read d3/d17/d19/f1e [1894861,57402] 0 2024-04-26T21:08:04.775 INFO:tasks.workunit.client.0.smithi055.stdout:6/315: write d3/f64 [483300,71355] 0 2024-04-26T21:08:04.778 INFO:tasks.workunit.client.1.smithi064.stdout:9/489: dwrite d0/d4/da/f57 [0,4194304] 0 2024-04-26T21:08:04.778 INFO:tasks.workunit.client.1.smithi064.stdout:9/490: write d0/d4/da/d31/f80 [1011960,75435] 0 2024-04-26T21:08:04.781 INFO:tasks.workunit.client.1.smithi064.stdout:4/533: read d0/d1d/d17/d44/dac/d54/f5f [1079130,678] 0 2024-04-26T21:08:04.781 INFO:tasks.workunit.client.1.smithi064.stdout:1/581: truncate d0/d6/d11/d1e/d27/f89 7002582 0 2024-04-26T21:08:04.781 INFO:tasks.workunit.client.1.smithi064.stdout:2/476: sync 2024-04-26T21:08:04.781 INFO:tasks.workunit.client.1.smithi064.stdout:5/467: dwrite dd/d12/d18/d33/d48/f4c [0,4194304] 0 2024-04-26T21:08:04.783 INFO:tasks.workunit.client.0.smithi055.stdout:2/350: mknod d4/db/d1f/c7a 0 2024-04-26T21:08:04.791 INFO:tasks.workunit.client.1.smithi064.stdout:3/461: creat d1/d38/fa7 x:0 0 0 2024-04-26T21:08:04.794 INFO:tasks.workunit.client.0.smithi055.stdout:1/285: symlink d8/df/d11/d27/l61 0 2024-04-26T21:08:04.794 INFO:tasks.workunit.client.0.smithi055.stdout:1/286: fdatasync d8/df/d11/d27/d28/d2a/f58 0 2024-04-26T21:08:04.795 INFO:tasks.workunit.client.0.smithi055.stdout:1/287: stat d8/d17/c2c 0 2024-04-26T21:08:04.795 INFO:tasks.workunit.client.0.smithi055.stdout:8/239: truncate d3/d9/d1f/f23 3145133 0 2024-04-26T21:08:04.798 INFO:tasks.workunit.client.0.smithi055.stdout:9/295: sync 2024-04-26T21:08:04.801 INFO:tasks.workunit.client.1.smithi064.stdout:9/491: creat d0/d4/da/d26/d45/f9a x:0 0 0 2024-04-26T21:08:04.811 INFO:tasks.workunit.client.0.smithi055.stdout:1/288: creat d8/d17/d1b/f62 x:0 0 0 2024-04-26T21:08:04.811 INFO:tasks.workunit.client.0.smithi055.stdout:8/240: mkdir d3/d9/d1d/d48/d4b 0 2024-04-26T21:08:04.811 INFO:tasks.workunit.client.0.smithi055.stdout:5/211: sync 2024-04-26T21:08:04.812 INFO:tasks.workunit.client.1.smithi064.stdout:5/468: dread dd/f13 [0,4194304] 0 2024-04-26T21:08:04.812 INFO:tasks.workunit.client.1.smithi064.stdout:5/469: fdatasync dd/d12/d18/d25/d32/f80 0 2024-04-26T21:08:04.812 INFO:tasks.workunit.client.1.smithi064.stdout:5/470: creat dd/d12/d18/d1a/d1f/d20/f95 x:0 0 0 2024-04-26T21:08:04.813 INFO:tasks.workunit.client.1.smithi064.stdout:4/534: mknod d0/d5/d79/da1/cae 0 2024-04-26T21:08:04.815 INFO:tasks.workunit.client.0.smithi055.stdout:1/289: mkdir d8/df/d11/d27/d63 0 2024-04-26T21:08:04.815 INFO:tasks.workunit.client.0.smithi055.stdout:7/293: sync 2024-04-26T21:08:04.820 INFO:tasks.workunit.client.1.smithi064.stdout:3/462: rename d1/l43 to d1/d27/d50/d35/la8 0 2024-04-26T21:08:04.822 INFO:tasks.workunit.client.0.smithi055.stdout:7/294: mknod d5/d53/c54 0 2024-04-26T21:08:04.822 INFO:tasks.workunit.client.0.smithi055.stdout:7/295: truncate d5/f32 975268 0 2024-04-26T21:08:04.822 INFO:tasks.workunit.client.0.smithi055.stdout:0/326: sync 2024-04-26T21:08:04.822 INFO:tasks.workunit.client.0.smithi055.stdout:3/343: sync 2024-04-26T21:08:04.825 INFO:tasks.workunit.client.1.smithi064.stdout:5/471: symlink dd/d12/d18/d33/d48/d88/d8a/l96 0 2024-04-26T21:08:04.825 INFO:tasks.workunit.client.1.smithi064.stdout:5/472: truncate dd/d12/d18/d1a/d1f/d20/f8b 574769 0 2024-04-26T21:08:04.826 INFO:tasks.workunit.client.1.smithi064.stdout:5/473: dread - dd/d12/d18/d25/d32/f5d zero size 2024-04-26T21:08:04.826 INFO:tasks.workunit.client.1.smithi064.stdout:5/474: readlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:08:04.827 INFO:tasks.workunit.client.0.smithi055.stdout:7/296: link d5/d6/f41 d5/d6/d24/d4d/f55 0 2024-04-26T21:08:04.833 INFO:tasks.workunit.client.0.smithi055.stdout:3/344: rmdir d0/d4/d5/d73/d13/d1a 39 2024-04-26T21:08:04.843 INFO:tasks.workunit.client.0.smithi055.stdout:9/296: dread d2/f10 [0,4194304] 0 2024-04-26T21:08:04.847 INFO:tasks.workunit.client.0.smithi055.stdout:9/297: creat d2/d14/d33/d5f/f67 x:0 0 0 2024-04-26T21:08:04.847 INFO:tasks.workunit.client.0.smithi055.stdout:9/298: chown d2/f1c 2 1 2024-04-26T21:08:04.847 INFO:tasks.workunit.client.0.smithi055.stdout:9/299: fsync d2/f1e 0 2024-04-26T21:08:04.847 INFO:tasks.workunit.client.0.smithi055.stdout:9/300: truncate d2/d11/f2f 747132 0 2024-04-26T21:08:04.850 INFO:tasks.workunit.client.0.smithi055.stdout:9/301: symlink d2/d14/d33/d5f/l68 0 2024-04-26T21:08:04.853 INFO:tasks.workunit.client.1.smithi064.stdout:8/381: sync 2024-04-26T21:08:04.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/302: link d2/d14/d33/d5f/f67 d2/d14/d33/d5f/f69 0 2024-04-26T21:08:04.857 INFO:tasks.workunit.client.0.smithi055.stdout:5/212: dread d4/f6 [0,4194304] 0 2024-04-26T21:08:04.877 INFO:tasks.workunit.client.0.smithi055.stdout:1/290: read d8/df/d11/d27/d28/f29 [2243875,127687] 0 2024-04-26T21:08:04.877 INFO:tasks.workunit.client.0.smithi055.stdout:4/223: dwrite d4/f21 [0,4194304] 0 2024-04-26T21:08:04.877 INFO:tasks.workunit.client.0.smithi055.stdout:6/316: dwrite d3/f5b [0,4194304] 0 2024-04-26T21:08:04.877 INFO:tasks.workunit.client.0.smithi055.stdout:1/291: mkdir d8/d17/d64 0 2024-04-26T21:08:04.881 INFO:tasks.workunit.client.0.smithi055.stdout:6/317: rename d3/d17/d46/d54/d66/d6a/c3c to d3/d17/d46/d54/d66/d6a/d51/d58/d6d/c6f 0 2024-04-26T21:08:04.881 INFO:tasks.workunit.client.0.smithi055.stdout:6/318: chown d3/d17/d46/d54/d66/d6a/d51/d58/c5d 128508 1 2024-04-26T21:08:04.882 INFO:tasks.workunit.client.1.smithi064.stdout:2/477: dwrite d12/d41/d73/d83/d94/d3a/d46/d91/d96/f9e [0,4194304] 0 2024-04-26T21:08:04.883 INFO:tasks.workunit.client.1.smithi064.stdout:2/478: write d12/d41/d73/d83/f8d [959675,79423] 0 2024-04-26T21:08:04.883 INFO:tasks.workunit.client.1.smithi064.stdout:2/479: dread - d12/d45/f7d zero size 2024-04-26T21:08:04.888 INFO:tasks.workunit.client.1.smithi064.stdout:2/480: link d12/d41/d73/d83/d94/d3a/d46/d6a/f9c d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fa7 0 2024-04-26T21:08:04.889 INFO:tasks.workunit.client.1.smithi064.stdout:2/481: creat d12/d88/fa8 x:0 0 0 2024-04-26T21:08:04.890 INFO:tasks.workunit.client.0.smithi055.stdout:1/292: dread d8/f31 [0,4194304] 0 2024-04-26T21:08:04.892 INFO:tasks.workunit.client.0.smithi055.stdout:1/293: mkdir d8/d17/d64/d65 0 2024-04-26T21:08:04.892 INFO:tasks.workunit.client.0.smithi055.stdout:1/294: fsync d8/df/f5c 0 2024-04-26T21:08:04.894 INFO:tasks.workunit.client.0.smithi055.stdout:1/295: creat d8/df/d11/d27/d63/f66 x:0 0 0 2024-04-26T21:08:04.898 INFO:tasks.workunit.client.0.smithi055.stdout:1/296: symlink d8/df/d11/d27/d63/l67 0 2024-04-26T21:08:04.902 INFO:tasks.workunit.client.1.smithi064.stdout:1/582: dread d0/d6/d11/d1e/d27/f89 [4194304,4194304] 0 2024-04-26T21:08:04.905 INFO:tasks.workunit.client.1.smithi064.stdout:1/583: getdents d0/d6/d11/d1e/d2a/d34/d57 0 2024-04-26T21:08:04.907 INFO:tasks.workunit.client.1.smithi064.stdout:9/492: dwrite d0/d4/da/d26/d45/f9a [0,4194304] 0 2024-04-26T21:08:04.909 INFO:tasks.workunit.client.0.smithi055.stdout:9/303: write d2/d11/f1f [2656784,105541] 0 2024-04-26T21:08:04.909 INFO:tasks.workunit.client.0.smithi055.stdout:9/304: readlink d2/d11/l66 0 2024-04-26T21:08:04.909 INFO:tasks.workunit.client.0.smithi055.stdout:9/305: stat d2/d11/c4e 0 2024-04-26T21:08:04.910 INFO:tasks.workunit.client.1.smithi064.stdout:2/482: dread d12/d41/d73/d83/d94/f37 [0,4194304] 0 2024-04-26T21:08:04.911 INFO:tasks.workunit.client.1.smithi064.stdout:9/493: rename d0/d4/da/d26/d5e/f60 to d0/d4/da/d26/d5e/f9b 0 2024-04-26T21:08:04.915 INFO:tasks.workunit.client.1.smithi064.stdout:9/494: truncate d0/d4/da/f5b 4172825 0 2024-04-26T21:08:04.917 INFO:tasks.workunit.client.1.smithi064.stdout:9/495: mknod d0/d4/d28/d4f/d74/c9c 0 2024-04-26T21:08:04.917 INFO:tasks.workunit.client.1.smithi064.stdout:3/463: dwrite d1/d27/d29/f4b [0,4194304] 0 2024-04-26T21:08:04.926 INFO:tasks.workunit.client.1.smithi064.stdout:5/475: dwrite dd/f13 [0,4194304] 0 2024-04-26T21:08:04.928 INFO:tasks.workunit.client.0.smithi055.stdout:8/241: dwrite d3/d9/fe [4194304,4194304] 0 2024-04-26T21:08:04.928 INFO:tasks.workunit.client.0.smithi055.stdout:8/242: write d3/d9/d1f/f23 [904313,17818] 0 2024-04-26T21:08:04.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/584: dread d0/d6/f7d [4194304,4194304] 0 2024-04-26T21:08:04.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/585: stat d0/d22/f5f 0 2024-04-26T21:08:04.939 INFO:tasks.workunit.client.0.smithi055.stdout:6/319: dread d3/d17/d19/f36 [0,4194304] 0 2024-04-26T21:08:04.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/586: creat d0/d6/d11/d2c/d9c/fb6 x:0 0 0 2024-04-26T21:08:04.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/587: chown d0/d22/c25 174690 1 2024-04-26T21:08:04.942 INFO:tasks.workunit.client.0.smithi055.stdout:3/345: dwrite d0/f68 [0,4194304] 0 2024-04-26T21:08:04.942 INFO:tasks.workunit.client.0.smithi055.stdout:3/346: readlink d0/d4/d16/d18/d4b/l78 0 2024-04-26T21:08:04.943 INFO:tasks.workunit.client.0.smithi055.stdout:0/327: dread d9/dc/d1c/d3b/d41/f2e [0,4194304] 0 2024-04-26T21:08:04.943 INFO:tasks.workunit.client.0.smithi055.stdout:2/351: dwrite d4/db/d56/d4a/f53 [0,4194304] 0 2024-04-26T21:08:04.944 INFO:tasks.workunit.client.0.smithi055.stdout:2/352: write d4/ff [1685344,104865] 0 2024-04-26T21:08:04.944 INFO:tasks.workunit.client.0.smithi055.stdout:2/353: write d4/db/d1f/d46/f64 [4672581,7583] 0 2024-04-26T21:08:04.947 INFO:tasks.workunit.client.0.smithi055.stdout:3/347: mknod d0/d4/d5/d73/d13/d27/d3b/c7f 0 2024-04-26T21:08:04.947 INFO:tasks.workunit.client.0.smithi055.stdout:3/348: chown d0/d4/d5/cb 1 1 2024-04-26T21:08:04.949 INFO:tasks.workunit.client.0.smithi055.stdout:9/306: getdents d2/d14/d33/d5f 0 2024-04-26T21:08:04.949 INFO:tasks.workunit.client.1.smithi064.stdout:8/382: dwrite d10/d41/d44/f51 [4194304,4194304] 0 2024-04-26T21:08:04.949 INFO:tasks.workunit.client.1.smithi064.stdout:3/464: dread d1/d27/d29/d6f/d72/da5/f44 [0,4194304] 0 2024-04-26T21:08:04.949 INFO:tasks.workunit.client.1.smithi064.stdout:8/383: chown d10/d2f 222348055 1 2024-04-26T21:08:04.957 INFO:tasks.workunit.client.0.smithi055.stdout:7/297: dwrite d5/f21 [0,4194304] 0 2024-04-26T21:08:04.957 INFO:tasks.workunit.client.0.smithi055.stdout:7/298: write d5/f21 [4763625,71289] 0 2024-04-26T21:08:04.957 INFO:tasks.workunit.client.0.smithi055.stdout:1/297: write d8/df/d11/f37 [525485,66141] 0 2024-04-26T21:08:04.957 INFO:tasks.workunit.client.0.smithi055.stdout:1/298: write d8/f12 [4367425,10225] 0 2024-04-26T21:08:04.960 INFO:tasks.workunit.client.0.smithi055.stdout:0/328: rename d9/fa to d9/dc/d1c/d54/d4b/d68/f6d 0 2024-04-26T21:08:04.960 INFO:tasks.workunit.client.0.smithi055.stdout:0/329: write d9/f64 [683745,124764] 0 2024-04-26T21:08:04.961 INFO:tasks.workunit.client.0.smithi055.stdout:0/330: chown l3 1690 1 2024-04-26T21:08:04.961 INFO:tasks.workunit.client.0.smithi055.stdout:0/331: creat d9/dc/d1c/d3b/f6e x:0 0 0 2024-04-26T21:08:04.962 INFO:tasks.workunit.client.0.smithi055.stdout:8/243: write d3/f18 [3111075,111840] 0 2024-04-26T21:08:04.967 INFO:tasks.workunit.client.0.smithi055.stdout:5/213: dwrite d4/df/f23 [0,4194304] 0 2024-04-26T21:08:04.968 INFO:tasks.workunit.client.1.smithi064.stdout:2/483: dwrite d12/d41/d73/d83/d94/d3a/d46/d6a/f5a [0,4194304] 0 2024-04-26T21:08:04.986 INFO:tasks.workunit.client.0.smithi055.stdout:7/299: write d5/d6/d24/f27 [2791602,123305] 0 2024-04-26T21:08:04.990 INFO:tasks.workunit.client.0.smithi055.stdout:3/349: rmdir d0/d4/d5/d73/d47/d37 39 2024-04-26T21:08:04.990 INFO:tasks.workunit.client.0.smithi055.stdout:3/350: truncate d0/d4/d5/f62 807344 0 2024-04-26T21:08:04.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/299: creat d8/d17/d1b/d41/f68 x:0 0 0 2024-04-26T21:08:04.991 INFO:tasks.workunit.client.0.smithi055.stdout:3/351: write d0/d4/d5/f6 [6910453,20252] 0 2024-04-26T21:08:04.991 INFO:tasks.workunit.client.0.smithi055.stdout:3/352: write d0/d4/d5/d73/d13/f7e [758741,122974] 0 2024-04-26T21:08:04.991 INFO:tasks.workunit.client.0.smithi055.stdout:4/224: dwrite d4/f30 [0,4194304] 0 2024-04-26T21:08:05.029 INFO:tasks.workunit.client.0.smithi055.stdout:9/307: dwrite d2/d11/f26 [0,4194304] 0 2024-04-26T21:08:05.032 INFO:tasks.workunit.client.0.smithi055.stdout:6/320: dwrite d3/d17/f32 [0,4194304] 0 2024-04-26T21:08:05.032 INFO:tasks.workunit.client.0.smithi055.stdout:1/300: dread d8/df/d11/d27/f3f [0,4194304] 0 2024-04-26T21:08:05.044 INFO:tasks.workunit.client.0.smithi055.stdout:1/301: dread d8/df/f24 [0,4194304] 0 2024-04-26T21:08:05.053 INFO:tasks.workunit.client.0.smithi055.stdout:7/300: dwrite d5/d6/d24/f27 [0,4194304] 0 2024-04-26T21:08:05.071 INFO:tasks.workunit.client.0.smithi055.stdout:9/308: dwrite d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:05.079 INFO:tasks.workunit.client.0.smithi055.stdout:6/321: dwrite f0 [0,4194304] 0 2024-04-26T21:08:05.094 INFO:tasks.workunit.client.0.smithi055.stdout:6/322: read d3/d17/f32 [904897,33789] 0 2024-04-26T21:08:05.096 INFO:tasks.workunit.client.0.smithi055.stdout:1/302: dwrite d8/d17/d1b/f62 [0,4194304] 0 2024-04-26T21:08:05.097 INFO:tasks.workunit.client.0.smithi055.stdout:1/303: creat d8/df/d11/f69 x:0 0 0 2024-04-26T21:08:05.097 INFO:tasks.workunit.client.0.smithi055.stdout:1/304: readlink d8/d17/d36/l5b 0 2024-04-26T21:08:05.110 INFO:tasks.workunit.client.0.smithi055.stdout:9/309: dwrite d2/f22 [4194304,4194304] 0 2024-04-26T21:08:05.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/310: write d2/d14/d33/f62 [157571,115624] 0 2024-04-26T21:08:05.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/311: fdatasync d2/d46/f54 0 2024-04-26T21:08:05.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/312: write d2/d14/d33/d5f/f69 [262346,117255] 0 2024-04-26T21:08:05.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/313: fdatasync d2/f1a 0 2024-04-26T21:08:05.112 INFO:tasks.workunit.client.0.smithi055.stdout:9/314: stat d2/d11/l3e 0 2024-04-26T21:08:05.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/315: dread - d2/f41 zero size 2024-04-26T21:08:05.172 INFO:tasks.workunit.client.1.smithi064.stdout:3/465: mkdir d1/d27/d29/d5e/da9 0 2024-04-26T21:08:05.172 INFO:tasks.workunit.client.1.smithi064.stdout:3/466: read - d1/d27/d29/d6f/d72/da5/f7c zero size 2024-04-26T21:08:05.175 INFO:tasks.workunit.client.1.smithi064.stdout:8/384: unlink d10/d41/d4e/d54/c5c 0 2024-04-26T21:08:05.178 INFO:tasks.workunit.client.0.smithi055.stdout:0/332: getdents d9/d27 0 2024-04-26T21:08:05.183 INFO:tasks.workunit.client.1.smithi064.stdout:9/496: rename d0/d4/d28/d4f/d74 to d0/d4/da/d26/d47/d9d 0 2024-04-26T21:08:05.185 INFO:tasks.workunit.client.1.smithi064.stdout:2/484: mkdir d12/da9 0 2024-04-26T21:08:05.190 INFO:tasks.workunit.client.0.smithi055.stdout:8/244: link d3/d9/d1d/l3c d3/d9/d1f/d2e/l4c 0 2024-04-26T21:08:05.207 INFO:tasks.workunit.client.1.smithi064.stdout:2/485: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f [0,4194304] 0 2024-04-26T21:08:05.219 INFO:tasks.workunit.client.1.smithi064.stdout:3/467: symlink d1/d27/d29/d6f/d72/d7a/d84/laa 0 2024-04-26T21:08:05.224 INFO:tasks.workunit.client.1.smithi064.stdout:9/497: creat d0/d4/f9e x:0 0 0 2024-04-26T21:08:05.224 INFO:tasks.workunit.client.1.smithi064.stdout:9/498: stat d0/d4/da/d26/d47/l6c 0 2024-04-26T21:08:05.229 INFO:tasks.workunit.client.1.smithi064.stdout:2/486: rename d12/c1b to d12/d41/d73/d83/caa 0 2024-04-26T21:08:05.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/499: write d0/d4/d7/f9 [13081723,13150] 0 2024-04-26T21:08:05.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/500: fsync d0/f8a 0 2024-04-26T21:08:05.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/501: truncate d0/d4/da/d26/d5d/f6d 1289837 0 2024-04-26T21:08:05.234 INFO:tasks.workunit.client.0.smithi055.stdout:3/353: mkdir d0/d4/d16/d18/d80 0 2024-04-26T21:08:05.234 INFO:tasks.workunit.client.0.smithi055.stdout:3/354: write d0/d4/d16/f70 [207886,24675] 0 2024-04-26T21:08:05.237 INFO:tasks.workunit.client.1.smithi064.stdout:2/487: mknod d12/d41/d61/d75/cab 0 2024-04-26T21:08:05.237 INFO:tasks.workunit.client.1.smithi064.stdout:2/488: chown d12/d41/d61/d75/c5e 4 1 2024-04-26T21:08:05.242 INFO:tasks.workunit.client.0.smithi055.stdout:4/225: mkdir d4/d18/d1a/d49 0 2024-04-26T21:08:05.244 INFO:tasks.workunit.client.1.smithi064.stdout:9/502: dread d0/d4/f53 [0,4194304] 0 2024-04-26T21:08:05.247 INFO:tasks.workunit.client.1.smithi064.stdout:2/489: unlink d12/d88/fa0 0 2024-04-26T21:08:05.248 INFO:tasks.workunit.client.1.smithi064.stdout:4/535: sync 2024-04-26T21:08:05.248 INFO:tasks.workunit.client.1.smithi064.stdout:6/448: sync 2024-04-26T21:08:05.248 INFO:tasks.workunit.client.1.smithi064.stdout:0/442: sync 2024-04-26T21:08:05.248 INFO:tasks.workunit.client.1.smithi064.stdout:7/488: sync 2024-04-26T21:08:05.250 INFO:tasks.workunit.client.1.smithi064.stdout:9/503: unlink d0/f3b 0 2024-04-26T21:08:05.251 INFO:tasks.workunit.client.1.smithi064.stdout:9/504: creat d0/d4/da/d31/d34/d87/f9f x:0 0 0 2024-04-26T21:08:05.254 INFO:tasks.workunit.client.1.smithi064.stdout:2/490: mknod d12/d41/d73/d83/d94/d3a/cac 0 2024-04-26T21:08:05.254 INFO:tasks.workunit.client.1.smithi064.stdout:2/491: fsync d12/d41/d61/d6c/f9b 0 2024-04-26T21:08:05.255 INFO:tasks.workunit.client.1.smithi064.stdout:1/588: sync 2024-04-26T21:08:05.255 INFO:tasks.workunit.client.1.smithi064.stdout:5/476: sync 2024-04-26T21:08:05.263 INFO:tasks.workunit.client.1.smithi064.stdout:7/489: mkdir d6/db/d34/da7 0 2024-04-26T21:08:05.268 INFO:tasks.workunit.client.0.smithi055.stdout:7/301: mkdir d5/d6/d24/d3b/d56 0 2024-04-26T21:08:05.268 INFO:tasks.workunit.client.0.smithi055.stdout:7/302: dread - d5/d6/d24/f47 zero size 2024-04-26T21:08:05.273 INFO:tasks.workunit.client.1.smithi064.stdout:6/449: mknod d4/d7/d12/d49/d4b/d5a/d79/c94 0 2024-04-26T21:08:05.273 INFO:tasks.workunit.client.1.smithi064.stdout:6/450: fsync d4/d7/f62 0 2024-04-26T21:08:05.273 INFO:tasks.workunit.client.1.smithi064.stdout:6/451: truncate d4/d7/d33/f8c 293029 0 2024-04-26T21:08:05.273 INFO:tasks.workunit.client.1.smithi064.stdout:6/452: write d4/f16 [424944,22245] 0 2024-04-26T21:08:05.275 INFO:tasks.workunit.client.0.smithi055.stdout:6/323: symlink d3/d17/d46/d54/d66/d6a/d3e/l70 0 2024-04-26T21:08:05.285 INFO:tasks.workunit.client.1.smithi064.stdout:9/505: truncate d0/d4/d7/f2f 1168708 0 2024-04-26T21:08:05.291 INFO:tasks.workunit.client.1.smithi064.stdout:2/492: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/c5b d12/d41/d73/d83/d94/d3a/d46/d91/d96/cad 0 2024-04-26T21:08:05.291 INFO:tasks.workunit.client.1.smithi064.stdout:2/493: creat d12/d41/d73/d83/fae x:0 0 0 2024-04-26T21:08:05.291 INFO:tasks.workunit.client.1.smithi064.stdout:2/494: chown d12/d41/d73/d83/d94/d3a/c95 1770 1 2024-04-26T21:08:05.292 INFO:tasks.workunit.client.1.smithi064.stdout:2/495: chown d12/c18 182 1 2024-04-26T21:08:05.292 INFO:tasks.workunit.client.1.smithi064.stdout:2/496: fsync d12/f78 0 2024-04-26T21:08:05.292 INFO:tasks.workunit.client.1.smithi064.stdout:2/497: dread - d12/d41/d73/d83/d94/d3a/d46/d48/fa1 zero size 2024-04-26T21:08:05.295 INFO:tasks.workunit.client.1.smithi064.stdout:5/477: symlink dd/d12/l97 0 2024-04-26T21:08:05.295 INFO:tasks.workunit.client.1.smithi064.stdout:5/478: truncate dd/d12/d18/d33/d48/d88/d8a/f92 317903 0 2024-04-26T21:08:05.312 INFO:tasks.workunit.client.1.smithi064.stdout:0/443: unlink dd/d10/d18/c3f 0 2024-04-26T21:08:05.313 INFO:tasks.workunit.client.0.smithi055.stdout:9/316: symlink d2/d46/d51/l6a 0 2024-04-26T21:08:05.317 INFO:tasks.workunit.client.1.smithi064.stdout:3/468: dwrite d1/d27/d29/d6f/f86 [0,4194304] 0 2024-04-26T21:08:05.317 INFO:tasks.workunit.client.1.smithi064.stdout:3/469: truncate d1/d27/d50/f5b 795732 0 2024-04-26T21:08:05.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/506: creat d0/d4/d7/df/fa0 x:0 0 0 2024-04-26T21:08:05.322 INFO:tasks.workunit.client.0.smithi055.stdout:7/303: dread d5/f49 [0,4194304] 0 2024-04-26T21:08:05.322 INFO:tasks.workunit.client.0.smithi055.stdout:7/304: fdatasync d5/d6/d24/f27 0 2024-04-26T21:08:05.325 INFO:tasks.workunit.client.0.smithi055.stdout:0/333: link d9/dc/d17/f30 d9/dc/f6f 0 2024-04-26T21:08:05.325 INFO:tasks.workunit.client.0.smithi055.stdout:0/334: fsync d9/dc/d17/f1e 0 2024-04-26T21:08:05.326 INFO:tasks.workunit.client.0.smithi055.stdout:0/335: chown d9/dc/d1c/d3b 19440 1 2024-04-26T21:08:05.329 INFO:tasks.workunit.client.1.smithi064.stdout:2/498: creat d12/d41/d61/faf x:0 0 0 2024-04-26T21:08:05.332 INFO:tasks.workunit.client.1.smithi064.stdout:9/507: dread d0/f18 [0,4194304] 0 2024-04-26T21:08:05.333 INFO:tasks.workunit.client.1.smithi064.stdout:4/536: dwrite d0/d1d/d17/f25 [4194304,4194304] 0 2024-04-26T21:08:05.333 INFO:tasks.workunit.client.1.smithi064.stdout:4/537: chown d0/d5/d13/d6d/l4a 26008 1 2024-04-26T21:08:05.334 INFO:tasks.workunit.client.1.smithi064.stdout:5/479: creat dd/d12/d18/d33/f98 x:0 0 0 2024-04-26T21:08:05.338 INFO:tasks.workunit.client.1.smithi064.stdout:6/453: dread d4/d7/d33/f44 [0,4194304] 0 2024-04-26T21:08:05.343 INFO:tasks.workunit.client.1.smithi064.stdout:7/490: dwrite d6/d70/d74/f85 [0,4194304] 0 2024-04-26T21:08:05.345 INFO:tasks.workunit.client.1.smithi064.stdout:1/589: dwrite d0/d6/d11/d1e/d27/f50 [0,4194304] 0 2024-04-26T21:08:05.346 INFO:tasks.workunit.client.0.smithi055.stdout:0/336: dread d9/dc/f6f [0,4194304] 0 2024-04-26T21:08:05.346 INFO:tasks.workunit.client.0.smithi055.stdout:0/337: truncate d9/dc/d1c/d3b/f6e 856958 0 2024-04-26T21:08:05.348 INFO:tasks.workunit.client.1.smithi064.stdout:3/470: rename d1/d27/d29/d6f/d72/d73/ca6 to d1/d27/d50/d35/d4c/d7b/d82/cab 0 2024-04-26T21:08:05.350 INFO:tasks.workunit.client.1.smithi064.stdout:0/444: dread dd/d10/d1a/d31/f3c [0,4194304] 0 2024-04-26T21:08:05.350 INFO:tasks.workunit.client.1.smithi064.stdout:9/508: mknod d0/d4/da/d26/d45/d90/ca1 0 2024-04-26T21:08:05.354 INFO:tasks.workunit.client.1.smithi064.stdout:4/538: link d0/d2f/d7d/f94 d0/d2f/d7d/faf 0 2024-04-26T21:08:05.361 INFO:tasks.workunit.client.1.smithi064.stdout:5/480: write dd/d12/d18/d25/d32/f80 [1535473,109329] 0 2024-04-26T21:08:05.363 INFO:tasks.workunit.client.1.smithi064.stdout:1/590: symlink d0/d6/d11/d1e/lb7 0 2024-04-26T21:08:05.363 INFO:tasks.workunit.client.1.smithi064.stdout:1/591: fdatasync d0/d6/d11/d1e/d2a/d34/d57/faa 0 2024-04-26T21:08:05.373 INFO:tasks.workunit.client.0.smithi055.stdout:8/245: symlink d3/d9/d1d/d48/l4d 0 2024-04-26T21:08:05.376 INFO:tasks.workunit.client.0.smithi055.stdout:3/355: symlink d0/d4/d5/d73/l81 0 2024-04-26T21:08:05.376 INFO:tasks.workunit.client.0.smithi055.stdout:3/356: creat d0/d4/d5/d73/d13/d1a/d46/d72/f82 x:0 0 0 2024-04-26T21:08:05.380 INFO:tasks.workunit.client.0.smithi055.stdout:4/226: symlink d4/d26/d42/d2d/l4a 0 2024-04-26T21:08:05.380 INFO:tasks.workunit.client.0.smithi055.stdout:4/227: chown d4/ff 2308 1 2024-04-26T21:08:05.381 INFO:tasks.workunit.client.1.smithi064.stdout:7/491: dread d6/d9/f39 [0,4194304] 0 2024-04-26T21:08:05.385 INFO:tasks.workunit.client.1.smithi064.stdout:0/445: rename dd/d10/d74/d1d/c44 to dd/d10/d18/d64/c91 0 2024-04-26T21:08:05.385 INFO:tasks.workunit.client.1.smithi064.stdout:0/446: creat dd/d10/d74/f92 x:0 0 0 2024-04-26T21:08:05.388 INFO:tasks.workunit.client.1.smithi064.stdout:4/539: getdents d0/d1d/d17/d44 0 2024-04-26T21:08:05.393 INFO:tasks.workunit.client.0.smithi055.stdout:9/317: symlink d2/d14/l6b 0 2024-04-26T21:08:05.394 INFO:tasks.workunit.client.1.smithi064.stdout:5/481: mknod dd/c99 0 2024-04-26T21:08:05.395 INFO:tasks.workunit.client.1.smithi064.stdout:5/482: chown dd/d12/d18/d1a/d1f/c42 222239 1 2024-04-26T21:08:05.396 INFO:tasks.workunit.client.0.smithi055.stdout:7/305: creat d5/f57 x:0 0 0 2024-04-26T21:08:05.396 INFO:tasks.workunit.client.0.smithi055.stdout:7/306: dread - d5/d6/d24/d3b/f4e zero size 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.1.smithi064.stdout:1/592: symlink d0/d6/d11/d1e/d2a/d34/d57/d66/lb8 0 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.0.smithi055.stdout:7/307: write d5/d6/d24/f4b [407895,69593] 0 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.0.smithi055.stdout:7/308: dread - d5/d6/d24/f47 zero size 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.0.smithi055.stdout:7/309: dread - d5/d6/f4c zero size 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.0.smithi055.stdout:7/310: read - d5/d6/d24/d4d/f55 zero size 2024-04-26T21:08:05.398 INFO:tasks.workunit.client.0.smithi055.stdout:7/311: fsync d5/d6/d24/f50 0 2024-04-26T21:08:05.401 INFO:tasks.workunit.client.0.smithi055.stdout:0/338: link d9/dc/d1c/d3b/c50 d9/dc/d1c/d3e/c70 0 2024-04-26T21:08:05.401 INFO:tasks.workunit.client.0.smithi055.stdout:0/339: write d9/dc/d1c/d3b/f6e [999222,8009] 0 2024-04-26T21:08:05.401 INFO:tasks.workunit.client.0.smithi055.stdout:0/340: readlink d9/dc/d19/l22 0 2024-04-26T21:08:05.405 INFO:tasks.workunit.client.0.smithi055.stdout:9/318: dread d2/d14/d33/d5f/f67 [0,4194304] 0 2024-04-26T21:08:05.405 INFO:tasks.workunit.client.0.smithi055.stdout:8/246: symlink d3/d9/d1d/d48/d4b/l4e 0 2024-04-26T21:08:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:05 smithi064 ceph-mon[33404]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 265 op/s 2024-04-26T21:08:05.409 INFO:tasks.workunit.client.1.smithi064.stdout:7/492: mkdir d6/d70/da8 0 2024-04-26T21:08:05.409 INFO:tasks.workunit.client.1.smithi064.stdout:7/493: write d6/d70/d74/f85 [4267391,130347] 0 2024-04-26T21:08:05.414 INFO:tasks.workunit.client.1.smithi064.stdout:6/454: dwrite d4/d7/d33/f50 [0,4194304] 0 2024-04-26T21:08:05.415 INFO:tasks.workunit.client.0.smithi055.stdout:3/357: mkdir d0/d4/d5/d73/d13/d27/d50/d6b/d83 0 2024-04-26T21:08:05.415 INFO:tasks.workunit.client.0.smithi055.stdout:3/358: fsync d0/f34 0 2024-04-26T21:08:05.416 INFO:tasks.workunit.client.1.smithi064.stdout:4/540: symlink d0/d1d/d21/lb0 0 2024-04-26T21:08:05.416 INFO:tasks.workunit.client.1.smithi064.stdout:4/541: chown d0/d5/d79/la5 3 1 2024-04-26T21:08:05.417 INFO:tasks.workunit.client.1.smithi064.stdout:4/542: fsync d0/d5/d13/d6d/f4b 0 2024-04-26T21:08:05.418 INFO:tasks.workunit.client.0.smithi055.stdout:7/312: dread d5/d11/f1a [4194304,4194304] 0 2024-04-26T21:08:05.418 INFO:tasks.workunit.client.0.smithi055.stdout:4/228: creat d4/f4b x:0 0 0 2024-04-26T21:08:05.420 INFO:tasks.workunit.client.1.smithi064.stdout:5/483: mkdir dd/d12/d9a 0 2024-04-26T21:08:05.421 INFO:tasks.workunit.client.1.smithi064.stdout:5/484: creat dd/d12/d18/d33/d48/d6a/f9b x:0 0 0 2024-04-26T21:08:05.422 INFO:tasks.workunit.client.0.smithi055.stdout:1/305: rename d8/df/d11/d27/d28/d3d to d8/d17/d6a 0 2024-04-26T21:08:05.425 INFO:tasks.workunit.client.0.smithi055.stdout:0/341: symlink d9/dc/d1c/d54/l71 0 2024-04-26T21:08:05.428 INFO:tasks.workunit.client.0.smithi055.stdout:9/319: link d2/d14/d33/l4c d2/d14/d33/l6c 0 2024-04-26T21:08:05.429 INFO:tasks.workunit.client.0.smithi055.stdout:9/320: fsync d2/d46/f50 0 2024-04-26T21:08:05.429 INFO:tasks.workunit.client.0.smithi055.stdout:9/321: dread - d2/d46/d51/f61 zero size 2024-04-26T21:08:05.431 INFO:tasks.workunit.client.1.smithi064.stdout:3/471: dwrite d1/d27/d29/d6f/d72/d73/f85 [0,4194304] 0 2024-04-26T21:08:05.431 INFO:tasks.workunit.client.1.smithi064.stdout:2/499: dwrite d12/d41/d61/faf [0,4194304] 0 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.1.smithi064.stdout:6/455: mkdir d4/d7/d12/d49/d4b/d56/d95 0 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.1.smithi064.stdout:6/456: truncate d4/d7/d12/f68 520375 0 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.1.smithi064.stdout:6/457: creat d4/d7/d12/d49/d4b/d56/f96 x:0 0 0 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.1.smithi064.stdout:6/458: chown d4/d7/d12/d38/f61 4 1 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.1.smithi064.stdout:6/459: write d4/d7/f35 [2674893,8572] 0 2024-04-26T21:08:05.433 INFO:tasks.workunit.client.0.smithi055.stdout:7/313: mkdir d5/d6/d24/d48/d58 0 2024-04-26T21:08:05.434 INFO:tasks.workunit.client.1.smithi064.stdout:4/543: mknod d0/d5/d13/cb1 0 2024-04-26T21:08:05.435 INFO:tasks.workunit.client.0.smithi055.stdout:4/229: symlink d4/d26/d42/d28/l4c 0 2024-04-26T21:08:05.435 INFO:tasks.workunit.client.0.smithi055.stdout:4/230: fsync d4/f36 0 2024-04-26T21:08:05.437 INFO:tasks.workunit.client.0.smithi055.stdout:6/324: rename d3/d17/d46/d54/d66/d6a/d3e to d3/d17/d19/d71 0 2024-04-26T21:08:05.438 INFO:tasks.workunit.client.1.smithi064.stdout:0/447: dwrite dd/d10/d74/d1d/f8a [0,4194304] 0 2024-04-26T21:08:05.440 INFO:tasks.workunit.client.1.smithi064.stdout:5/485: mkdir dd/d12/d4f/d9c 0 2024-04-26T21:08:05.441 INFO:tasks.workunit.client.0.smithi055.stdout:1/306: unlink d8/d17/d1b/f20 0 2024-04-26T21:08:05.441 INFO:tasks.workunit.client.0.smithi055.stdout:1/307: dread - d8/d17/d6a/f52 zero size 2024-04-26T21:08:05.441 INFO:tasks.workunit.client.1.smithi064.stdout:9/509: dwrite d0/d4/da/d31/f80 [0,4194304] 0 2024-04-26T21:08:05.443 INFO:tasks.workunit.client.1.smithi064.stdout:7/494: mknod d6/d5a/ca9 0 2024-04-26T21:08:05.443 INFO:tasks.workunit.client.1.smithi064.stdout:7/495: readlink d6/d15/d1c/l46 0 2024-04-26T21:08:05.444 INFO:tasks.workunit.client.0.smithi055.stdout:9/322: symlink d2/d14/l6d 0 2024-04-26T21:08:05.445 INFO:tasks.workunit.client.0.smithi055.stdout:0/342: write d9/dc/d17/f3f [1290577,12166] 0 2024-04-26T21:08:05.447 INFO:tasks.workunit.client.0.smithi055.stdout:8/247: symlink d3/d9/l4f 0 2024-04-26T21:08:05.447 INFO:tasks.workunit.client.1.smithi064.stdout:3/472: write d1/d27/d50/d35/d4c/d55/f7e [521185,43024] 0 2024-04-26T21:08:05.447 INFO:tasks.workunit.client.1.smithi064.stdout:3/473: stat d1/fc 0 2024-04-26T21:08:05.449 INFO:tasks.workunit.client.0.smithi055.stdout:7/314: mknod d5/d6/d24/d3b/c59 0 2024-04-26T21:08:05.449 INFO:tasks.workunit.client.0.smithi055.stdout:7/315: fdatasync d5/d6/d24/d3b/f3c 0 2024-04-26T21:08:05.449 INFO:tasks.workunit.client.0.smithi055.stdout:7/316: chown d5/d11/f2f 42 1 2024-04-26T21:08:05.450 INFO:tasks.workunit.client.1.smithi064.stdout:8/385: sync 2024-04-26T21:08:05.456 INFO:tasks.workunit.client.1.smithi064.stdout:1/593: dwrite d0/d6/d11/d1e/f4f [0,4194304] 0 2024-04-26T21:08:05.457 INFO:tasks.workunit.client.0.smithi055.stdout:6/325: symlink d3/d17/d46/d54/d66/d6a/d6b/l72 0 2024-04-26T21:08:05.461 INFO:tasks.workunit.client.0.smithi055.stdout:9/323: rename d2/d14/d33/f45 to d2/d11/f6e 0 2024-04-26T21:08:05.464 INFO:tasks.workunit.client.0.smithi055.stdout:9/324: write d2/f8 [3735821,33961] 0 2024-04-26T21:08:05.473 INFO:tasks.workunit.client.0.smithi055.stdout:8/248: link d3/d9/d1f/l20 d3/d9/d1f/d2e/l50 0 2024-04-26T21:08:05.473 INFO:tasks.workunit.client.0.smithi055.stdout:8/249: write d3/f18 [1194417,108538] 0 2024-04-26T21:08:05.481 INFO:tasks.workunit.client.0.smithi055.stdout:4/231: symlink d4/d26/d42/l4d 0 2024-04-26T21:08:05.482 INFO:tasks.workunit.client.1.smithi064.stdout:4/544: mknod d0/d5/d79/cb2 0 2024-04-26T21:08:05.491 INFO:tasks.workunit.client.1.smithi064.stdout:0/448: creat dd/d10/d18/d58/f93 x:0 0 0 2024-04-26T21:08:05.491 INFO:tasks.workunit.client.1.smithi064.stdout:0/449: dread - dd/d10/d1a/d31/d5c/f78 zero size 2024-04-26T21:08:05.493 INFO:tasks.workunit.client.0.smithi055.stdout:9/325: write d2/f55 [3993399,67990] 0 2024-04-26T21:08:05.494 INFO:tasks.workunit.client.0.smithi055.stdout:9/326: chown d2/d14/d33/d5f/l68 6 1 2024-04-26T21:08:05.494 INFO:tasks.workunit.client.0.smithi055.stdout:0/343: write d9/d27/f42 [3691659,98331] 0 2024-04-26T21:08:05.496 INFO:tasks.workunit.client.1.smithi064.stdout:5/486: unlink dd/d12/d18/d25/d74/f90 0 2024-04-26T21:08:05.498 INFO:tasks.workunit.client.0.smithi055.stdout:5/214: sync 2024-04-26T21:08:05.498 INFO:tasks.workunit.client.0.smithi055.stdout:2/354: sync 2024-04-26T21:08:05.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:05 smithi055 ceph-mon[25475]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 265 op/s 2024-04-26T21:08:05.506 INFO:tasks.workunit.client.1.smithi064.stdout:3/474: mkdir d1/d27/dac 0 2024-04-26T21:08:05.509 INFO:tasks.workunit.client.0.smithi055.stdout:3/359: dwrite d0/d4/d5/d73/d13/d1a/d46/d72/f82 [0,4194304] 0 2024-04-26T21:08:05.509 INFO:tasks.workunit.client.0.smithi055.stdout:3/360: write d0/d4/d5/f2c [1153960,27049] 0 2024-04-26T21:08:05.510 INFO:tasks.workunit.client.0.smithi055.stdout:0/344: link d9/dc/d1c/d3e/c70 d9/dc/d1c/d54/d4b/c72 0 2024-04-26T21:08:05.510 INFO:tasks.workunit.client.0.smithi055.stdout:0/345: fsync d9/dc/d1c/d54/f44 0 2024-04-26T21:08:05.510 INFO:tasks.workunit.client.0.smithi055.stdout:0/346: dread - d9/dc/d1c/d3b/f60 zero size 2024-04-26T21:08:05.514 INFO:tasks.workunit.client.1.smithi064.stdout:8/386: mkdir d10/d41/d53/d7a 0 2024-04-26T21:08:05.517 INFO:tasks.workunit.client.0.smithi055.stdout:2/355: rename d4/d14/d33/f4b to d4/db/d26/f7b 0 2024-04-26T21:08:05.517 INFO:tasks.workunit.client.0.smithi055.stdout:2/356: creat d4/db/d56/f7c x:0 0 0 2024-04-26T21:08:05.519 INFO:tasks.workunit.client.0.smithi055.stdout:2/357: write d4/d14/d33/f59 [312644,28021] 0 2024-04-26T21:08:05.519 INFO:tasks.workunit.client.0.smithi055.stdout:2/358: read - d4/d1e/d2a/f6b zero size 2024-04-26T21:08:05.520 INFO:tasks.workunit.client.0.smithi055.stdout:9/327: dread d2/d11/f1f [0,4194304] 0 2024-04-26T21:08:05.520 INFO:tasks.workunit.client.0.smithi055.stdout:9/328: readlink d2/d11/l35 0 2024-04-26T21:08:05.521 INFO:tasks.workunit.client.1.smithi064.stdout:9/510: write d0/d4/da/d26/d47/f62 [1018360,44652] 0 2024-04-26T21:08:05.522 INFO:tasks.workunit.client.0.smithi055.stdout:1/308: dwrite d8/f35 [0,4194304] 0 2024-04-26T21:08:05.526 INFO:tasks.workunit.client.1.smithi064.stdout:6/460: dwrite d4/f2f [4194304,4194304] 0 2024-04-26T21:08:05.526 INFO:tasks.workunit.client.1.smithi064.stdout:6/461: stat d4/d7/d12/d1e/c6c 0 2024-04-26T21:08:05.528 INFO:tasks.workunit.client.1.smithi064.stdout:1/594: symlink d0/d6/d29/d31/lb9 0 2024-04-26T21:08:05.529 INFO:tasks.workunit.client.0.smithi055.stdout:3/361: symlink d0/d4/l84 0 2024-04-26T21:08:05.529 INFO:tasks.workunit.client.0.smithi055.stdout:3/362: write d0/d4/f5f [3810945,53109] 0 2024-04-26T21:08:05.531 INFO:tasks.workunit.client.1.smithi064.stdout:2/500: getdents d12/d41/d73/d83 0 2024-04-26T21:08:05.531 INFO:tasks.workunit.client.1.smithi064.stdout:4/545: mknod d0/d1d/d17/d44/dac/d54/cb3 0 2024-04-26T21:08:05.533 INFO:tasks.workunit.client.0.smithi055.stdout:0/347: mknod d9/d11/d5b/d5e/d6c/c73 0 2024-04-26T21:08:05.536 INFO:tasks.workunit.client.0.smithi055.stdout:8/250: dwrite d3/d9/d1f/f23 [0,4194304] 0 2024-04-26T21:08:05.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/496: mknod d6/caa 0 2024-04-26T21:08:05.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/497: readlink d6/l10 0 2024-04-26T21:08:05.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/498: chown d6/db/d34/d41/d5c/la5 1788876 1 2024-04-26T21:08:05.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/499: fsync d6/d15/f5d 0 2024-04-26T21:08:05.537 INFO:tasks.workunit.client.1.smithi064.stdout:9/511: dread d0/d4/da/d31/d34/d87/f8b [0,4194304] 0 2024-04-26T21:08:05.538 INFO:tasks.workunit.client.0.smithi055.stdout:9/329: mkdir d2/d14/d33/d6f 0 2024-04-26T21:08:05.539 INFO:tasks.workunit.client.1.smithi064.stdout:8/387: creat d10/d2f/d56/f7b x:0 0 0 2024-04-26T21:08:05.539 INFO:tasks.workunit.client.1.smithi064.stdout:8/388: fdatasync d10/d2f/f36 0 2024-04-26T21:08:05.539 INFO:tasks.workunit.client.1.smithi064.stdout:8/389: truncate d10/f24 1100697 0 2024-04-26T21:08:05.539 INFO:tasks.workunit.client.1.smithi064.stdout:8/390: dread - d10/d1d/d38/f71 zero size 2024-04-26T21:08:05.546 INFO:tasks.workunit.client.0.smithi055.stdout:3/363: link d0/d4/d5/d73/d13/d27/d50/l52 d0/d4/d16/d18/l85 0 2024-04-26T21:08:05.546 INFO:tasks.workunit.client.0.smithi055.stdout:3/364: read d0/d4/d16/d18/f30 [4028103,3274] 0 2024-04-26T21:08:05.547 INFO:tasks.workunit.client.0.smithi055.stdout:3/365: write d0/d4/d5/d73/d13/d1a/d46/d51/f5e [657115,108695] 0 2024-04-26T21:08:05.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/595: mkdir d0/d6/d91/dba 0 2024-04-26T21:08:05.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/596: fsync d0/d6/d11/d1e/d2a/d34/d57/d66/f7e 0 2024-04-26T21:08:05.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/597: chown d0/d22/c25 321373344 1 2024-04-26T21:08:05.549 INFO:tasks.workunit.client.0.smithi055.stdout:0/348: rename d9/dc/d1c/d3b/d41 to d9/d11/d5b/d74 0 2024-04-26T21:08:05.552 INFO:tasks.workunit.client.1.smithi064.stdout:4/546: unlink d0/d5/d79/da1/cae 0 2024-04-26T21:08:05.558 INFO:tasks.workunit.client.0.smithi055.stdout:9/330: rmdir d2/d14/d33/d6f 0 2024-04-26T21:08:05.564 INFO:tasks.workunit.client.0.smithi055.stdout:3/366: symlink d0/d4/d5/d73/d13/l86 0 2024-04-26T21:08:05.564 INFO:tasks.workunit.client.0.smithi055.stdout:3/367: truncate d0/d4/f64 357438 0 2024-04-26T21:08:05.566 INFO:tasks.workunit.client.1.smithi064.stdout:1/598: unlink d0/d6/c14 0 2024-04-26T21:08:05.568 INFO:tasks.workunit.client.1.smithi064.stdout:5/487: getdents dd/d12/d18/d25/d74 0 2024-04-26T21:08:05.568 INFO:tasks.workunit.client.1.smithi064.stdout:5/488: write dd/d12/d18/d1a/f57 [1026161,95404] 0 2024-04-26T21:08:05.570 INFO:tasks.workunit.client.0.smithi055.stdout:8/251: mknod d3/d9/c51 0 2024-04-26T21:08:05.570 INFO:tasks.workunit.client.0.smithi055.stdout:4/232: dwrite d4/d26/d42/d28/f32 [0,4194304] 0 2024-04-26T21:08:05.571 INFO:tasks.workunit.client.0.smithi055.stdout:5/215: dread d4/df/f30 [0,4194304] 0 2024-04-26T21:08:05.571 INFO:tasks.workunit.client.1.smithi064.stdout:2/501: write d12/d41/d61/faf [33066,60307] 0 2024-04-26T21:08:05.572 INFO:tasks.workunit.client.0.smithi055.stdout:6/326: dwrite d3/d17/d25/f2b [0,4194304] 0 2024-04-26T21:08:05.572 INFO:tasks.workunit.client.1.smithi064.stdout:9/512: symlink d0/d4/da/d26/d45/la2 0 2024-04-26T21:08:05.572 INFO:tasks.workunit.client.0.smithi055.stdout:8/252: write d3/f18 [3238776,124471] 0 2024-04-26T21:08:05.573 INFO:tasks.workunit.client.1.smithi064.stdout:7/500: dread d6/db/d34/f96 [0,4194304] 0 2024-04-26T21:08:05.573 INFO:tasks.workunit.client.0.smithi055.stdout:9/331: rmdir d2/d14/d33/d5f 39 2024-04-26T21:08:05.576 INFO:tasks.workunit.client.0.smithi055.stdout:3/368: mknod d0/d4/d5/d73/d13/d1a/d46/d72/d69/c87 0 2024-04-26T21:08:05.578 INFO:tasks.workunit.client.1.smithi064.stdout:1/599: unlink d0/d6/d11/d1e/d27/f2d 0 2024-04-26T21:08:05.581 INFO:tasks.workunit.client.0.smithi055.stdout:0/349: truncate d9/d27/f42 1128349 0 2024-04-26T21:08:05.581 INFO:tasks.workunit.client.0.smithi055.stdout:0/350: stat d9/dc/d17/l62 0 2024-04-26T21:08:05.583 INFO:tasks.workunit.client.1.smithi064.stdout:5/489: getdents dd 0 2024-04-26T21:08:05.584 INFO:tasks.workunit.client.1.smithi064.stdout:4/547: dread d0/d5/d13/d6d/f59 [0,4194304] 0 2024-04-26T21:08:05.584 INFO:tasks.workunit.client.1.smithi064.stdout:4/548: dread - d0/d1d/d17/d44/dac/d54/f58 zero size 2024-04-26T21:08:05.584 INFO:tasks.workunit.client.1.smithi064.stdout:7/501: mknod d6/d15/d67/d65/cab 0 2024-04-26T21:08:05.586 INFO:tasks.workunit.client.0.smithi055.stdout:5/216: rename d4/df/d13/d26/d3c/f42 to d4/d18/d3f/f46 0 2024-04-26T21:08:05.589 INFO:tasks.workunit.client.1.smithi064.stdout:3/475: dwrite d1/d27/d50/f2d [4194304,4194304] 0 2024-04-26T21:08:05.590 INFO:tasks.workunit.client.1.smithi064.stdout:0/450: dwrite dd/d10/d1a/d31/f3c [0,4194304] 0 2024-04-26T21:08:05.590 INFO:tasks.workunit.client.1.smithi064.stdout:0/451: creat dd/d10/d18/d64/f94 x:0 0 0 2024-04-26T21:08:05.590 INFO:tasks.workunit.client.1.smithi064.stdout:0/452: creat dd/d10/d18/d64/f95 x:0 0 0 2024-04-26T21:08:05.592 INFO:tasks.workunit.client.0.smithi055.stdout:0/351: truncate d9/dc/d17/f1e 3175419 0 2024-04-26T21:08:05.595 INFO:tasks.workunit.client.0.smithi055.stdout:8/253: rename d3/l4a to d3/d9/d1d/l52 0 2024-04-26T21:08:05.599 INFO:tasks.workunit.client.0.smithi055.stdout:0/352: symlink d9/d11/d5b/d5e/l75 0 2024-04-26T21:08:05.600 INFO:tasks.workunit.client.0.smithi055.stdout:8/254: creat d3/d9/d1d/f53 x:0 0 0 2024-04-26T21:08:05.602 INFO:tasks.workunit.client.0.smithi055.stdout:0/353: symlink d9/dc/d17/d5d/l76 0 2024-04-26T21:08:05.604 INFO:tasks.workunit.client.1.smithi064.stdout:4/549: symlink d0/d1d/d17/d44/d45/da0/lb4 0 2024-04-26T21:08:05.604 INFO:tasks.workunit.client.1.smithi064.stdout:3/476: creat d1/d27/d29/d6f/d72/da5/d7d/fad x:0 0 0 2024-04-26T21:08:05.606 INFO:tasks.workunit.client.0.smithi055.stdout:0/354: unlink d9/d11/c48 0 2024-04-26T21:08:05.611 INFO:tasks.workunit.client.0.smithi055.stdout:0/355: getdents d9/dc/d19 0 2024-04-26T21:08:05.617 INFO:tasks.workunit.client.0.smithi055.stdout:1/309: dwrite d8/df/d11/f69 [0,4194304] 0 2024-04-26T21:08:05.617 INFO:tasks.workunit.client.0.smithi055.stdout:2/359: dwrite d4/db/d56/f7c [0,4194304] 0 2024-04-26T21:08:05.617 INFO:tasks.workunit.client.0.smithi055.stdout:2/360: chown d4/d1e/c48 3 1 2024-04-26T21:08:05.617 INFO:tasks.workunit.client.1.smithi064.stdout:3/477: write d1/d27/d50/fb [540566,69065] 0 2024-04-26T21:08:05.624 INFO:tasks.workunit.client.0.smithi055.stdout:8/255: dread f1 [0,4194304] 0 2024-04-26T21:08:05.624 INFO:tasks.workunit.client.0.smithi055.stdout:1/310: unlink d8/df/d11/d27/f3f 0 2024-04-26T21:08:05.624 INFO:tasks.workunit.client.0.smithi055.stdout:1/311: chown d8/f12 28074688 1 2024-04-26T21:08:05.624 INFO:tasks.workunit.client.0.smithi055.stdout:1/312: dread - d8/df/d11/d27/d63/f66 zero size 2024-04-26T21:08:05.626 INFO:tasks.workunit.client.0.smithi055.stdout:8/256: symlink d3/d9/d1d/d48/d4b/l54 0 2024-04-26T21:08:05.628 INFO:tasks.workunit.client.0.smithi055.stdout:8/257: symlink d3/d9/d1f/d2e/l55 0 2024-04-26T21:08:05.628 INFO:tasks.workunit.client.0.smithi055.stdout:8/258: stat d3/d9/d1d/d48/d4b/l54 0 2024-04-26T21:08:05.629 INFO:tasks.workunit.client.0.smithi055.stdout:8/259: chown d3/d9/d1d/d48/d4b/l54 12 1 2024-04-26T21:08:05.630 INFO:tasks.workunit.client.0.smithi055.stdout:8/260: creat d3/d9/d1f/d2e/f56 x:0 0 0 2024-04-26T21:08:05.642 INFO:tasks.workunit.client.0.smithi055.stdout:0/356: write d9/dc/d1c/d54/f44 [1724022,115522] 0 2024-04-26T21:08:05.642 INFO:tasks.workunit.client.0.smithi055.stdout:0/357: fsync d9/dc/f57 0 2024-04-26T21:08:05.644 INFO:tasks.workunit.client.0.smithi055.stdout:0/358: mknod d9/dc/d1c/c77 0 2024-04-26T21:08:05.649 INFO:tasks.workunit.client.0.smithi055.stdout:0/359: unlink d9/d11/d5b/d5e/d6c/c73 0 2024-04-26T21:08:05.649 INFO:tasks.workunit.client.0.smithi055.stdout:0/360: readlink d9/dc/d17/l18 0 2024-04-26T21:08:05.649 INFO:tasks.workunit.client.0.smithi055.stdout:0/361: stat d9/dc/d1c/c77 0 2024-04-26T21:08:05.664 INFO:tasks.workunit.client.0.smithi055.stdout:6/327: dwrite d3/d17/d25/f39 [0,4194304] 0 2024-04-26T21:08:05.666 INFO:tasks.workunit.client.0.smithi055.stdout:6/328: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d73 0 2024-04-26T21:08:05.666 INFO:tasks.workunit.client.0.smithi055.stdout:6/329: fsync d3/d17/d19/d71/f4d 0 2024-04-26T21:08:05.668 INFO:tasks.workunit.client.0.smithi055.stdout:6/330: link d3/f9 d3/d17/d46/d54/d66/d6a/d51/f74 0 2024-04-26T21:08:05.673 INFO:tasks.workunit.client.0.smithi055.stdout:3/369: getdents d0/d4/d5/d73/d13/d1a/d46/d72/d69 0 2024-04-26T21:08:05.673 INFO:tasks.workunit.client.0.smithi055.stdout:3/370: dread - d0/d4/d5/d73/d13/d1a/d46/d72/f60 zero size 2024-04-26T21:08:05.673 INFO:tasks.workunit.client.0.smithi055.stdout:3/371: chown d0/d4/d5/d73/c9 6473 1 2024-04-26T21:08:05.673 INFO:tasks.workunit.client.0.smithi055.stdout:3/372: truncate d0/d4/d5/d73/d47/f77 614467 0 2024-04-26T21:08:05.678 INFO:tasks.workunit.client.1.smithi064.stdout:2/502: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/f19 [2613819,54602] 0 2024-04-26T21:08:05.680 INFO:tasks.workunit.client.0.smithi055.stdout:3/373: mknod d0/d4/d5/d73/d13/d27/c88 0 2024-04-26T21:08:05.680 INFO:tasks.workunit.client.0.smithi055.stdout:3/374: chown d0/d4/d16/d18/d4b/d57 52441040 1 2024-04-26T21:08:05.680 INFO:tasks.workunit.client.0.smithi055.stdout:3/375: chown d0/d4/d16/c1e 0 1 2024-04-26T21:08:05.680 INFO:tasks.workunit.client.1.smithi064.stdout:6/462: dwrite d4/f16 [0,4194304] 0 2024-04-26T21:08:05.681 INFO:tasks.workunit.client.1.smithi064.stdout:2/503: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f2d [759986,126336] 0 2024-04-26T21:08:05.681 INFO:tasks.workunit.client.1.smithi064.stdout:6/463: write d4/d7/d12/d38/f51 [853141,46611] 0 2024-04-26T21:08:05.686 INFO:tasks.workunit.client.0.smithi055.stdout:0/362: fsync d9/dc/d17/f1e 0 2024-04-26T21:08:05.687 INFO:tasks.workunit.client.0.smithi055.stdout:9/332: dwrite d2/f22 [0,4194304] 0 2024-04-26T21:08:05.691 INFO:tasks.workunit.client.1.smithi064.stdout:6/464: truncate d4/d7/fd 635120 0 2024-04-26T21:08:05.692 INFO:tasks.workunit.client.1.smithi064.stdout:2/504: rmdir d12/d45 39 2024-04-26T21:08:05.694 INFO:tasks.workunit.client.0.smithi055.stdout:9/333: truncate d2/d14/f43 2070731 0 2024-04-26T21:08:05.695 INFO:tasks.workunit.client.1.smithi064.stdout:2/505: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/lb0 0 2024-04-26T21:08:05.696 INFO:tasks.workunit.client.0.smithi055.stdout:9/334: write d2/d14/f47 [487322,119993] 0 2024-04-26T21:08:05.697 INFO:tasks.workunit.client.0.smithi055.stdout:0/363: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:05.697 INFO:tasks.workunit.client.0.smithi055.stdout:0/364: fdatasync d9/dc/d1c/f4f 0 2024-04-26T21:08:05.698 INFO:tasks.workunit.client.1.smithi064.stdout:2/506: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fa7 [2335803,2950] 0 2024-04-26T21:08:05.699 INFO:tasks.workunit.client.0.smithi055.stdout:0/365: unlink d9/dc/d1c/d54/d4b/l5c 0 2024-04-26T21:08:05.700 INFO:tasks.workunit.client.0.smithi055.stdout:0/366: write d9/dc/d17/f45 [4429683,19678] 0 2024-04-26T21:08:05.702 INFO:tasks.workunit.client.0.smithi055.stdout:0/367: mkdir d9/d11/d59/d78 0 2024-04-26T21:08:05.702 INFO:tasks.workunit.client.0.smithi055.stdout:0/368: read d9/d27/f37 [2895407,4703] 0 2024-04-26T21:08:05.709 INFO:tasks.workunit.client.1.smithi064.stdout:5/490: dwrite dd/d12/d18/f1d [4194304,4194304] 0 2024-04-26T21:08:05.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/513: dwrite d0/d4/d7/f2f [0,4194304] 0 2024-04-26T21:08:05.712 INFO:tasks.workunit.client.0.smithi055.stdout:8/261: rmdir d3 39 2024-04-26T21:08:05.723 INFO:tasks.workunit.client.1.smithi064.stdout:5/491: mknod dd/d12/d4f/d9c/c9d 0 2024-04-26T21:08:05.724 INFO:tasks.workunit.client.1.smithi064.stdout:9/514: mkdir d0/d4/da/da3 0 2024-04-26T21:08:05.726 INFO:tasks.workunit.client.0.smithi055.stdout:9/335: write d2/f3f [1048821,40898] 0 2024-04-26T21:08:05.735 INFO:tasks.workunit.client.1.smithi064.stdout:0/453: dwrite dd/f67 [0,4194304] 0 2024-04-26T21:08:05.735 INFO:tasks.workunit.client.1.smithi064.stdout:0/454: creat dd/d10/d18/d64/f96 x:0 0 0 2024-04-26T21:08:05.747 INFO:tasks.workunit.client.0.smithi055.stdout:2/361: dwrite d4/d14/d17/f2e [4194304,4194304] 0 2024-04-26T21:08:05.750 INFO:tasks.workunit.client.0.smithi055.stdout:4/233: dwrite d4/f30 [4194304,4194304] 0 2024-04-26T21:08:05.751 INFO:tasks.workunit.client.0.smithi055.stdout:1/313: dwrite d8/df/d11/d44/f54 [0,4194304] 0 2024-04-26T21:08:05.752 INFO:tasks.workunit.client.1.smithi064.stdout:3/478: dwrite d1/d27/d50/d35/d4c/d55/f7e [0,4194304] 0 2024-04-26T21:08:05.752 INFO:tasks.workunit.client.1.smithi064.stdout:4/550: dwrite d0/d1d/d21/f62 [0,4194304] 0 2024-04-26T21:08:05.752 INFO:tasks.workunit.client.1.smithi064.stdout:1/600: dwrite d0/d6/d11/d1e/fb5 [0,4194304] 0 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.1.smithi064.stdout:1/601: chown d0/d6 448 1 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.1.smithi064.stdout:3/479: creat d1/d27/d29/d6f/d72/da5/fae x:0 0 0 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.1.smithi064.stdout:3/480: chown d1/d27/d50/d35/d4c/c94 308785207 1 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.1.smithi064.stdout:3/481: read - d1/d27/d50/f91 zero size 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.0.smithi055.stdout:3/376: dwrite d0/f34 [0,4194304] 0 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.0.smithi055.stdout:3/377: fsync d0/d4/d5/d73/d13/d1a/d46/d72/f53 0 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.0.smithi055.stdout:3/378: chown d0/d4/l84 0 1 2024-04-26T21:08:05.753 INFO:tasks.workunit.client.0.smithi055.stdout:3/379: truncate d0/d4/d5/d73/d13/d1a/d46/d72/f53 1203805 0 2024-04-26T21:08:05.756 INFO:tasks.workunit.client.0.smithi055.stdout:2/362: getdents d4/db/d1f/d32 0 2024-04-26T21:08:05.756 INFO:tasks.workunit.client.0.smithi055.stdout:4/234: symlink d4/d12/d17/d3d/l4e 0 2024-04-26T21:08:05.759 INFO:tasks.workunit.client.0.smithi055.stdout:9/336: dread d2/d11/f1f [0,4194304] 0 2024-04-26T21:08:05.759 INFO:tasks.workunit.client.0.smithi055.stdout:9/337: creat d2/d14/d33/f70 x:0 0 0 2024-04-26T21:08:05.759 INFO:tasks.workunit.client.0.smithi055.stdout:5/217: dwrite d4/df/d13/d26/f31 [0,4194304] 0 2024-04-26T21:08:05.759 INFO:tasks.workunit.client.0.smithi055.stdout:5/218: write d4/df/f3b [3489402,58245] 0 2024-04-26T21:08:05.763 INFO:tasks.workunit.client.0.smithi055.stdout:0/369: dwrite d9/dc/f57 [0,4194304] 0 2024-04-26T21:08:05.771 INFO:tasks.workunit.client.0.smithi055.stdout:3/380: creat d0/d4/d16/d18/d4b/f89 x:0 0 0 2024-04-26T21:08:05.771 INFO:tasks.workunit.client.1.smithi064.stdout:6/465: dwrite d4/d7/d12/d49/d4b/d7d/f91 [0,4194304] 0 2024-04-26T21:08:05.778 INFO:tasks.workunit.client.0.smithi055.stdout:4/235: creat d4/d26/d42/d2d/f4f x:0 0 0 2024-04-26T21:08:05.782 INFO:tasks.workunit.client.1.smithi064.stdout:2/507: dwrite d12/d41/d61/d75/f2b [0,4194304] 0 2024-04-26T21:08:05.782 INFO:tasks.workunit.client.1.smithi064.stdout:2/508: readlink d12/d41/d73/l7b 0 2024-04-26T21:08:05.786 INFO:tasks.workunit.client.0.smithi055.stdout:9/338: stat d2/d14/c32 0 2024-04-26T21:08:05.786 INFO:tasks.workunit.client.0.smithi055.stdout:9/339: fdatasync d2/f8 0 2024-04-26T21:08:05.786 INFO:tasks.workunit.client.0.smithi055.stdout:9/340: creat d2/d46/d51/f71 x:0 0 0 2024-04-26T21:08:05.790 INFO:tasks.workunit.client.0.smithi055.stdout:5/219: creat d4/df/f47 x:0 0 0 2024-04-26T21:08:05.790 INFO:tasks.workunit.client.0.smithi055.stdout:5/220: fsync d4/d18/d3f/f2c 0 2024-04-26T21:08:05.795 INFO:tasks.workunit.client.1.smithi064.stdout:1/602: rmdir d0/d6/d76 39 2024-04-26T21:08:05.795 INFO:tasks.workunit.client.1.smithi064.stdout:1/603: read - d0/d6/d11/d6c/fab zero size 2024-04-26T21:08:05.798 INFO:tasks.workunit.client.1.smithi064.stdout:3/482: rmdir d1/d27/d50 39 2024-04-26T21:08:05.799 INFO:tasks.workunit.client.1.smithi064.stdout:2/509: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f2d [0,4194304] 0 2024-04-26T21:08:05.800 INFO:tasks.workunit.client.0.smithi055.stdout:0/370: creat d9/dc/d17/f79 x:0 0 0 2024-04-26T21:08:05.801 INFO:tasks.workunit.client.0.smithi055.stdout:8/262: dwrite d3/d9/d1f/f23 [0,4194304] 0 2024-04-26T21:08:05.805 INFO:tasks.workunit.client.1.smithi064.stdout:6/466: rename d4/d7/d12/d38/f4a to d4/d7/d12/d38/f97 0 2024-04-26T21:08:05.805 INFO:tasks.workunit.client.0.smithi055.stdout:1/314: creat d8/d17/d6a/f6b x:0 0 0 2024-04-26T21:08:05.809 INFO:tasks.workunit.client.1.smithi064.stdout:0/455: dwrite dd/d10/d74/f80 [0,4194304] 0 2024-04-26T21:08:05.809 INFO:tasks.workunit.client.1.smithi064.stdout:0/456: dread - dd/d10/d18/d64/f94 zero size 2024-04-26T21:08:05.809 INFO:tasks.workunit.client.1.smithi064.stdout:0/457: truncate dd/d10/d74/d1d/f79 437572 0 2024-04-26T21:08:05.809 INFO:tasks.workunit.client.1.smithi064.stdout:0/458: creat dd/d10/d74/f97 x:0 0 0 2024-04-26T21:08:05.810 INFO:tasks.workunit.client.1.smithi064.stdout:2/510: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fb1 x:0 0 0 2024-04-26T21:08:05.811 INFO:tasks.workunit.client.1.smithi064.stdout:2/511: dread - d12/d41/d73/d83/d94/d3a/f79 zero size 2024-04-26T21:08:05.813 INFO:tasks.workunit.client.0.smithi055.stdout:2/363: rmdir d4/dc 39 2024-04-26T21:08:05.814 INFO:tasks.workunit.client.1.smithi064.stdout:6/467: rmdir d4/d7/d12/d38 39 2024-04-26T21:08:05.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/483: rmdir d1/d14 39 2024-04-26T21:08:05.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/484: fsync d1/d27/d29/d6f/d72/da5/f93 0 2024-04-26T21:08:05.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/485: fdatasync d1/d38/f49 0 2024-04-26T21:08:05.822 INFO:tasks.workunit.client.0.smithi055.stdout:5/221: dread d4/df/f23 [0,4194304] 0 2024-04-26T21:08:05.823 INFO:tasks.workunit.client.0.smithi055.stdout:8/263: mkdir d3/d9/d1d/d48/d57 0 2024-04-26T21:08:05.825 INFO:tasks.workunit.client.1.smithi064.stdout:4/551: dwrite d0/d1d/f49 [0,4194304] 0 2024-04-26T21:08:05.828 INFO:tasks.workunit.client.0.smithi055.stdout:1/315: mkdir d8/df/d11/d6c 0 2024-04-26T21:08:05.831 INFO:tasks.workunit.client.0.smithi055.stdout:3/381: getdents d0/d4/d5 0 2024-04-26T21:08:05.831 INFO:tasks.workunit.client.0.smithi055.stdout:3/382: chown d0/d4/d16/d18/d4b/f89 0 1 2024-04-26T21:08:05.833 INFO:tasks.workunit.client.1.smithi064.stdout:0/459: mknod dd/d10/d1a/d31/d5c/c98 0 2024-04-26T21:08:05.835 INFO:tasks.workunit.client.0.smithi055.stdout:2/364: mkdir d4/d49/d4c/d5e/d7d 0 2024-04-26T21:08:05.837 INFO:tasks.workunit.client.1.smithi064.stdout:2/512: creat d12/d41/d73/d83/fb2 x:0 0 0 2024-04-26T21:08:05.840 INFO:tasks.workunit.client.0.smithi055.stdout:1/316: fdatasync d8/d17/f18 0 2024-04-26T21:08:05.840 INFO:tasks.workunit.client.0.smithi055.stdout:1/317: fdatasync d8/f19 0 2024-04-26T21:08:05.840 INFO:tasks.workunit.client.0.smithi055.stdout:1/318: creat d8/df/d11/d27/d28/f6d x:0 0 0 2024-04-26T21:08:05.841 INFO:tasks.workunit.client.0.smithi055.stdout:8/264: dread f1 [0,4194304] 0 2024-04-26T21:08:05.841 INFO:tasks.workunit.client.0.smithi055.stdout:2/365: mkdir d4/db/d56/d4a/d7e 0 2024-04-26T21:08:05.844 INFO:tasks.workunit.client.1.smithi064.stdout:6/468: unlink d4/d7/f71 0 2024-04-26T21:08:05.844 INFO:tasks.workunit.client.1.smithi064.stdout:8/391: sync 2024-04-26T21:08:05.844 INFO:tasks.workunit.client.1.smithi064.stdout:8/392: creat d10/d41/d44/f7c x:0 0 0 2024-04-26T21:08:05.845 INFO:tasks.workunit.client.1.smithi064.stdout:7/502: sync 2024-04-26T21:08:05.845 INFO:tasks.workunit.client.1.smithi064.stdout:3/486: unlink d1/d27/d50/l33 0 2024-04-26T21:08:05.846 INFO:tasks.workunit.client.1.smithi064.stdout:3/487: write d1/d27/d50/d35/d4c/f83 [1082230,92186] 0 2024-04-26T21:08:05.846 INFO:tasks.workunit.client.1.smithi064.stdout:3/488: readlink d1/d27/d50/l3f 0 2024-04-26T21:08:05.853 INFO:tasks.workunit.client.0.smithi055.stdout:2/366: dread d4/d1e/d2a/f62 [0,4194304] 0 2024-04-26T21:08:05.853 INFO:tasks.workunit.client.0.smithi055.stdout:2/367: write d4/d1e/d2a/f30 [372948,110585] 0 2024-04-26T21:08:05.854 INFO:tasks.workunit.client.0.smithi055.stdout:1/319: rename d8/df/d11/f69 to d8/df/f6e 0 2024-04-26T21:08:05.854 INFO:tasks.workunit.client.1.smithi064.stdout:6/469: dread d4/d7/d33/f8c [0,4194304] 0 2024-04-26T21:08:05.855 INFO:tasks.workunit.client.0.smithi055.stdout:8/265: truncate d3/d9/d1f/f32 669229 0 2024-04-26T21:08:05.857 INFO:tasks.workunit.client.0.smithi055.stdout:1/320: symlink d8/df/d11/d44/l6f 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/489: mknod d1/d27/d29/d6f/d72/d95/caf 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/513: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/l66 d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/lb3 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/514: write d12/d41/d73/d83/fa6 [96375,129213] 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/515: truncate d12/d41/d73/d83/d94/d3a/f79 675457 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/516: fsync d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fa7 0 2024-04-26T21:08:05.862 INFO:tasks.workunit.client.1.smithi064.stdout:2/517: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l8c 987 1 2024-04-26T21:08:05.863 INFO:tasks.workunit.client.1.smithi064.stdout:4/552: dread d0/d1d/f2e [0,4194304] 0 2024-04-26T21:08:05.863 INFO:tasks.workunit.client.1.smithi064.stdout:4/553: fdatasync d0/d1d/f49 0 2024-04-26T21:08:05.863 INFO:tasks.workunit.client.0.smithi055.stdout:8/266: creat d3/d9/d44/f58 x:0 0 0 2024-04-26T21:08:05.863 INFO:tasks.workunit.client.1.smithi064.stdout:6/470: creat d4/d7/d12/f98 x:0 0 0 2024-04-26T21:08:05.865 INFO:tasks.workunit.client.1.smithi064.stdout:0/460: rename dd/d10/d1a/d31/d47/d61/f81 to dd/d10/d18/f99 0 2024-04-26T21:08:05.865 INFO:tasks.workunit.client.1.smithi064.stdout:0/461: write dd/d10/d1a/d31/f41 [2148970,67150] 0 2024-04-26T21:08:05.866 INFO:tasks.workunit.client.1.smithi064.stdout:3/490: truncate d1/d27/d50/d35/d4c/d55/f7e 212486 0 2024-04-26T21:08:05.866 INFO:tasks.workunit.client.1.smithi064.stdout:3/491: fdatasync d1/d27/d29/f92 0 2024-04-26T21:08:05.869 INFO:tasks.workunit.client.1.smithi064.stdout:2/518: mknod d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/cb4 0 2024-04-26T21:08:05.869 INFO:tasks.workunit.client.1.smithi064.stdout:2/519: fsync d12/d41/d61/d75/f9f 0 2024-04-26T21:08:05.869 INFO:tasks.workunit.client.1.smithi064.stdout:2/520: truncate d12/d88/fa8 476302 0 2024-04-26T21:08:05.869 INFO:tasks.workunit.client.1.smithi064.stdout:4/554: mkdir d0/d2f/d69/db5 0 2024-04-26T21:08:05.869 INFO:tasks.workunit.client.1.smithi064.stdout:6/471: mkdir d4/d99 0 2024-04-26T21:08:05.871 INFO:tasks.workunit.client.1.smithi064.stdout:0/462: creat dd/d10/f9a x:0 0 0 2024-04-26T21:08:05.871 INFO:tasks.workunit.client.1.smithi064.stdout:0/463: write dd/d10/d74/f92 [125206,65776] 0 2024-04-26T21:08:05.873 INFO:tasks.workunit.client.1.smithi064.stdout:7/503: rename l4 to d6/d15/d1c/lac 0 2024-04-26T21:08:05.874 INFO:tasks.workunit.client.1.smithi064.stdout:4/555: mkdir d0/d1d/d17/d9b/db6 0 2024-04-26T21:08:05.874 INFO:tasks.workunit.client.1.smithi064.stdout:4/556: dread - d0/d1d/d17/fab zero size 2024-04-26T21:08:05.877 INFO:tasks.workunit.client.1.smithi064.stdout:0/464: mknod dd/d10/d1a/d31/d43/c9b 0 2024-04-26T21:08:05.883 INFO:tasks.workunit.client.1.smithi064.stdout:4/557: mkdir d0/d5/d13/d10/db7 0 2024-04-26T21:08:05.883 INFO:tasks.workunit.client.1.smithi064.stdout:4/558: write d0/d1d/d56/d89/f8f [4376845,95654] 0 2024-04-26T21:08:05.896 INFO:tasks.workunit.client.1.smithi064.stdout:4/559: rename d0/d1d/d21/f47 to d0/d2f/d7d/fb8 0 2024-04-26T21:08:05.897 INFO:tasks.workunit.client.1.smithi064.stdout:4/560: getdents d0/d5/d79/da1 0 2024-04-26T21:08:05.897 INFO:tasks.workunit.client.1.smithi064.stdout:4/561: chown d0/d1d/d17/d44/dac/d54/cb3 59079 1 2024-04-26T21:08:05.897 INFO:tasks.workunit.client.1.smithi064.stdout:4/562: fdatasync d0/d5/d13/f3d 0 2024-04-26T21:08:05.897 INFO:tasks.workunit.client.1.smithi064.stdout:4/563: chown d0/d1d/d21/c40 199 1 2024-04-26T21:08:05.898 INFO:tasks.workunit.client.1.smithi064.stdout:4/564: creat d0/d2f/d87/fb9 x:0 0 0 2024-04-26T21:08:05.900 INFO:tasks.workunit.client.0.smithi055.stdout:5/222: dread d4/df/d13/d26/f31 [0,4194304] 0 2024-04-26T21:08:05.902 INFO:tasks.workunit.client.0.smithi055.stdout:5/223: truncate d4/df/d13/f37 2434898 0 2024-04-26T21:08:05.903 INFO:tasks.workunit.client.1.smithi064.stdout:4/565: mkdir d0/d2f/d69/db5/dba 0 2024-04-26T21:08:05.903 INFO:tasks.workunit.client.1.smithi064.stdout:4/566: creat d0/d1d/d17/d44/dac/d54/fbb x:0 0 0 2024-04-26T21:08:05.906 INFO:tasks.workunit.client.0.smithi055.stdout:1/321: dwrite d8/d17/d36/f59 [0,4194304] 0 2024-04-26T21:08:05.906 INFO:tasks.workunit.client.0.smithi055.stdout:5/224: fdatasync d4/fd 0 2024-04-26T21:08:05.908 INFO:tasks.workunit.client.0.smithi055.stdout:1/322: rename d8/df/l3b to d8/df/d11/d27/d63/l70 0 2024-04-26T21:08:05.911 INFO:tasks.workunit.client.0.smithi055.stdout:5/225: link d4/l12 d4/df/d13/d26/l48 0 2024-04-26T21:08:05.911 INFO:tasks.workunit.client.0.smithi055.stdout:5/226: readlink d4/l38 0 2024-04-26T21:08:05.912 INFO:tasks.workunit.client.1.smithi064.stdout:2/521: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/f19 [4194304,4194304] 0 2024-04-26T21:08:05.917 INFO:tasks.workunit.client.0.smithi055.stdout:9/341: write d2/d11/f4b [2908766,129151] 0 2024-04-26T21:08:05.925 INFO:tasks.workunit.client.1.smithi064.stdout:1/604: dwrite d0/d6/d11/f23 [0,4194304] 0 2024-04-26T21:08:05.938 INFO:tasks.workunit.client.0.smithi055.stdout:1/323: read d8/f35 [2174388,13166] 0 2024-04-26T21:08:05.944 INFO:tasks.workunit.client.1.smithi064.stdout:0/465: getdents dd/d10/d1a/d31/d47/d61 0 2024-04-26T21:08:05.944 INFO:tasks.workunit.client.1.smithi064.stdout:0/466: write dd/f85 [463675,86081] 0 2024-04-26T21:08:05.946 INFO:tasks.workunit.client.0.smithi055.stdout:5/227: dread d4/f9 [0,4194304] 0 2024-04-26T21:08:05.951 INFO:tasks.workunit.client.0.smithi055.stdout:5/228: chown d4/l29 12 1 2024-04-26T21:08:05.962 INFO:tasks.workunit.client.0.smithi055.stdout:2/368: dread d4/db/d56/d4a/f53 [0,4194304] 0 2024-04-26T21:08:05.962 INFO:tasks.workunit.client.0.smithi055.stdout:4/236: dwrite d4/f11 [4194304,4194304] 0 2024-04-26T21:08:05.962 INFO:tasks.workunit.client.1.smithi064.stdout:4/567: write d0/d5/d13/f60 [741172,87257] 0 2024-04-26T21:08:05.962 INFO:tasks.workunit.client.1.smithi064.stdout:4/568: fdatasync d0/d1d/d17/d44/f78 0 2024-04-26T21:08:05.964 INFO:tasks.workunit.client.1.smithi064.stdout:1/605: dread d0/f12 [0,4194304] 0 2024-04-26T21:08:05.965 INFO:tasks.workunit.client.1.smithi064.stdout:6/472: dwrite d4/f16 [4194304,4194304] 0 2024-04-26T21:08:05.967 INFO:tasks.workunit.client.1.smithi064.stdout:8/393: dwrite d10/d2f/f36 [0,4194304] 0 2024-04-26T21:08:05.968 INFO:tasks.workunit.client.0.smithi055.stdout:2/369: mkdir d4/d7f 0 2024-04-26T21:08:05.968 INFO:tasks.workunit.client.0.smithi055.stdout:2/370: chown d4/d1e/d2a/f6b 52097798 1 2024-04-26T21:08:05.969 INFO:tasks.workunit.client.1.smithi064.stdout:0/467: creat dd/d10/d1a/f9c x:0 0 0 2024-04-26T21:08:05.971 INFO:tasks.workunit.client.0.smithi055.stdout:2/371: mkdir d4/d49/d4c/d5e/d7d/d80 0 2024-04-26T21:08:05.977 INFO:tasks.workunit.client.0.smithi055.stdout:5/229: dread f2 [0,4194304] 0 2024-04-26T21:08:05.978 INFO:tasks.workunit.client.0.smithi055.stdout:8/267: dwrite d3/d9/d1f/d2e/f56 [0,4194304] 0 2024-04-26T21:08:05.979 INFO:tasks.workunit.client.1.smithi064.stdout:4/569: write d0/d1d/d17/d44/d45/f5c [7393782,50365] 0 2024-04-26T21:08:05.980 INFO:tasks.workunit.client.0.smithi055.stdout:2/372: truncate d4/dc/f11 110320 0 2024-04-26T21:08:05.983 INFO:tasks.workunit.client.0.smithi055.stdout:4/237: dread d4/f1d [0,4194304] 0 2024-04-26T21:08:05.983 INFO:tasks.workunit.client.1.smithi064.stdout:1/606: rename d0/d6/d11/d1e/f1b to d0/d22/d9f/fbb 0 2024-04-26T21:08:05.987 INFO:tasks.workunit.client.0.smithi055.stdout:5/230: mknod d4/df/d13/d26/d3c/c49 0 2024-04-26T21:08:05.988 INFO:tasks.workunit.client.1.smithi064.stdout:8/394: mkdir d10/d41/d44/d7d 0 2024-04-26T21:08:05.988 INFO:tasks.workunit.client.1.smithi064.stdout:8/395: write d10/d1d/d38/f5e [710290,46044] 0 2024-04-26T21:08:05.989 INFO:tasks.workunit.client.1.smithi064.stdout:8/396: write d10/d41/d53/f64 [292454,97308] 0 2024-04-26T21:08:05.989 INFO:tasks.workunit.client.1.smithi064.stdout:7/504: dwrite d6/d9/d3d/f6e [0,4194304] 0 2024-04-26T21:08:05.989 INFO:tasks.workunit.client.1.smithi064.stdout:7/505: chown d6/d9/f1a 724 1 2024-04-26T21:08:05.991 INFO:tasks.workunit.client.0.smithi055.stdout:8/268: mknod d3/d9/d1d/d48/d57/c59 0 2024-04-26T21:08:05.997 INFO:tasks.workunit.client.1.smithi064.stdout:3/492: dwrite d1/d27/d50/f21 [0,4194304] 0 2024-04-26T21:08:05.997 INFO:tasks.workunit.client.0.smithi055.stdout:4/238: rmdir d4/d26 39 2024-04-26T21:08:05.998 INFO:tasks.workunit.client.1.smithi064.stdout:4/570: dread d0/d1d/d21/f3a [0,4194304] 0 2024-04-26T21:08:06.001 INFO:tasks.workunit.client.0.smithi055.stdout:5/231: unlink d4/d18/f20 0 2024-04-26T21:08:06.007 INFO:tasks.workunit.client.0.smithi055.stdout:8/269: mkdir d3/d9/d1f/d5a 0 2024-04-26T21:08:06.008 INFO:tasks.workunit.client.0.smithi055.stdout:8/270: fdatasync d3/d9/d44/f58 0 2024-04-26T21:08:06.008 INFO:tasks.workunit.client.0.smithi055.stdout:8/271: fdatasync d3/d9/d1f/f32 0 2024-04-26T21:08:06.009 INFO:tasks.workunit.client.1.smithi064.stdout:7/506: write d6/f24 [113459,71158] 0 2024-04-26T21:08:06.009 INFO:tasks.workunit.client.1.smithi064.stdout:7/507: dread - d6/d15/d67/f94 zero size 2024-04-26T21:08:06.009 INFO:tasks.workunit.client.1.smithi064.stdout:1/607: mkdir d0/d6/d11/d2c/d9c/dbc 0 2024-04-26T21:08:06.015 INFO:tasks.workunit.client.1.smithi064.stdout:5/492: sync 2024-04-26T21:08:06.015 INFO:tasks.workunit.client.1.smithi064.stdout:9/515: sync 2024-04-26T21:08:06.015 INFO:tasks.workunit.client.1.smithi064.stdout:9/516: chown d0/d4/da/f14 31943315 1 2024-04-26T21:08:06.016 INFO:tasks.workunit.client.1.smithi064.stdout:6/473: truncate d4/f28 2509584 0 2024-04-26T21:08:06.020 INFO:tasks.workunit.client.0.smithi055.stdout:4/239: rename d4/le to d4/d12/d17/d3d/l50 0 2024-04-26T21:08:06.023 INFO:tasks.workunit.client.1.smithi064.stdout:0/468: dwrite dd/d10/d74/f80 [0,4194304] 0 2024-04-26T21:08:06.031 INFO:tasks.workunit.client.0.smithi055.stdout:8/272: dread d3/d9/d1f/f31 [0,4194304] 0 2024-04-26T21:08:06.031 INFO:tasks.workunit.client.1.smithi064.stdout:5/493: read dd/d12/d18/d1a/d1f/d20/f2d [2645856,83699] 0 2024-04-26T21:08:06.031 INFO:tasks.workunit.client.1.smithi064.stdout:5/494: readlink dd/d12/d18/d1a/d1b/l50 0 2024-04-26T21:08:06.034 INFO:tasks.workunit.client.1.smithi064.stdout:8/397: creat d10/f7e x:0 0 0 2024-04-26T21:08:06.035 INFO:tasks.workunit.client.1.smithi064.stdout:8/398: write d10/d41/d53/f64 [1254548,105796] 0 2024-04-26T21:08:06.035 INFO:tasks.workunit.client.0.smithi055.stdout:3/383: dwrite d0/f22 [0,4194304] 0 2024-04-26T21:08:06.039 INFO:tasks.workunit.client.0.smithi055.stdout:2/373: dwrite d4/dc/f71 [0,4194304] 0 2024-04-26T21:08:06.042 INFO:tasks.workunit.client.1.smithi064.stdout:3/493: rmdir d1/d27/d29/d6f/d72/d95 39 2024-04-26T21:08:06.046 INFO:tasks.workunit.client.0.smithi055.stdout:3/384: creat d0/d4/d5/d73/d13/d5c/f8a x:0 0 0 2024-04-26T21:08:06.048 INFO:tasks.workunit.client.1.smithi064.stdout:7/508: link d6/d9/d3d/c60 d6/db/d1f/d50/cad 0 2024-04-26T21:08:06.050 INFO:tasks.workunit.client.1.smithi064.stdout:1/608: mknod d0/cbd 0 2024-04-26T21:08:06.051 INFO:tasks.workunit.client.1.smithi064.stdout:1/609: read - d0/d6/d11/d1e/d2a/d34/f75 zero size 2024-04-26T21:08:06.051 INFO:tasks.workunit.client.1.smithi064.stdout:1/610: chown d0/d22/d87/fb4 2 1 2024-04-26T21:08:06.051 INFO:tasks.workunit.client.1.smithi064.stdout:1/611: write d0/d6/d11/fb2 [2518665,60887] 0 2024-04-26T21:08:06.051 INFO:tasks.workunit.client.1.smithi064.stdout:1/612: write d0/d6/d11/d1e/d2a/d34/f75 [725706,24116] 0 2024-04-26T21:08:06.051 INFO:tasks.workunit.client.0.smithi055.stdout:8/273: mkdir d3/d9/d5b 0 2024-04-26T21:08:06.052 INFO:tasks.workunit.client.0.smithi055.stdout:8/274: dread - d3/f41 zero size 2024-04-26T21:08:06.052 INFO:tasks.workunit.client.0.smithi055.stdout:4/240: dread d4/f11 [0,4194304] 0 2024-04-26T21:08:06.056 INFO:tasks.workunit.client.0.smithi055.stdout:5/232: rename d4/d18 to d4/df/d13/d26/d3c/d4a 0 2024-04-26T21:08:06.056 INFO:tasks.workunit.client.0.smithi055.stdout:5/233: fdatasync d4/df/d13/f21 0 2024-04-26T21:08:06.059 INFO:tasks.workunit.client.0.smithi055.stdout:9/342: dwrite d2/d11/f4b [0,4194304] 0 2024-04-26T21:08:06.059 INFO:tasks.workunit.client.0.smithi055.stdout:9/343: truncate d2/d46/f54 464023 0 2024-04-26T21:08:06.059 INFO:tasks.workunit.client.0.smithi055.stdout:9/344: fdatasync d2/f10 0 2024-04-26T21:08:06.059 INFO:tasks.workunit.client.0.smithi055.stdout:9/345: dread - d2/d46/f50 zero size 2024-04-26T21:08:06.059 INFO:tasks.workunit.client.0.smithi055.stdout:9/346: fdatasync d2/d46/f50 0 2024-04-26T21:08:06.060 INFO:tasks.workunit.client.1.smithi064.stdout:6/474: creat d4/d7/d12/d49/d4b/d56/d95/f9a x:0 0 0 2024-04-26T21:08:06.060 INFO:tasks.workunit.client.0.smithi055.stdout:4/241: mknod d4/d18/d1a/c51 0 2024-04-26T21:08:06.060 INFO:tasks.workunit.client.0.smithi055.stdout:4/242: stat d4/cb 0 2024-04-26T21:08:06.063 INFO:tasks.workunit.client.0.smithi055.stdout:5/234: rename d4/l38 to d4/df/d13/d26/d3c/d4a/l4b 0 2024-04-26T21:08:06.066 INFO:tasks.workunit.client.0.smithi055.stdout:2/374: read d4/d1e/f4f [3970309,4189] 0 2024-04-26T21:08:06.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/469: creat dd/d10/d1a/d31/d47/d61/f9d x:0 0 0 2024-04-26T21:08:06.070 INFO:tasks.workunit.client.1.smithi064.stdout:5/495: mkdir dd/d12/d18/d33/d48/d6a/d9e 0 2024-04-26T21:08:06.070 INFO:tasks.workunit.client.1.smithi064.stdout:5/496: read - dd/d12/d18/d1a/d1f/d20/f4e zero size 2024-04-26T21:08:06.070 INFO:tasks.workunit.client.0.smithi055.stdout:9/347: mknod d2/d46/c72 0 2024-04-26T21:08:06.070 INFO:tasks.workunit.client.0.smithi055.stdout:8/275: read d3/d9/d1f/f23 [3410563,48134] 0 2024-04-26T21:08:06.073 INFO:tasks.workunit.client.1.smithi064.stdout:8/399: creat d10/d41/d44/d7d/f7f x:0 0 0 2024-04-26T21:08:06.074 INFO:tasks.workunit.client.1.smithi064.stdout:8/400: chown d10/d41/d44/d5a/f62 6110921 1 2024-04-26T21:08:06.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/517: read d0/d4/d7/df/f5a [1285556,54199] 0 2024-04-26T21:08:06.074 INFO:tasks.workunit.client.1.smithi064.stdout:7/509: getdents d6/db 0 2024-04-26T21:08:06.075 INFO:tasks.workunit.client.0.smithi055.stdout:4/243: mknod d4/d26/d42/d28/c52 0 2024-04-26T21:08:06.075 INFO:tasks.workunit.client.0.smithi055.stdout:4/244: truncate d4/d26/d42/d2d/f41 1617488 0 2024-04-26T21:08:06.075 INFO:tasks.workunit.client.0.smithi055.stdout:4/245: chown d4/d18/d1a/d49 1 1 2024-04-26T21:08:06.076 INFO:tasks.workunit.client.0.smithi055.stdout:5/235: truncate d4/df/d13/d26/f31 2812339 0 2024-04-26T21:08:06.076 INFO:tasks.workunit.client.1.smithi064.stdout:0/470: creat dd/d10/f9e x:0 0 0 2024-04-26T21:08:06.077 INFO:tasks.workunit.client.0.smithi055.stdout:5/236: read d4/df/d13/d26/f2f [28968,114189] 0 2024-04-26T21:08:06.078 INFO:tasks.workunit.client.0.smithi055.stdout:2/375: mkdir d4/d14/d17/d6d/d81 0 2024-04-26T21:08:06.078 INFO:tasks.workunit.client.0.smithi055.stdout:2/376: chown d4/dc/d21/f43 10 1 2024-04-26T21:08:06.079 INFO:tasks.workunit.client.1.smithi064.stdout:5/497: mknod dd/c9f 0 2024-04-26T21:08:06.080 INFO:tasks.workunit.client.0.smithi055.stdout:9/348: creat d2/d11/f73 x:0 0 0 2024-04-26T21:08:06.081 INFO:tasks.workunit.client.1.smithi064.stdout:8/401: symlink d10/d1d/d38/l80 0 2024-04-26T21:08:06.085 INFO:tasks.workunit.client.0.smithi055.stdout:8/276: truncate d3/d9/d1f/f23 483663 0 2024-04-26T21:08:06.089 INFO:tasks.workunit.client.0.smithi055.stdout:4/246: mkdir d4/d26/d42/d28/d53 0 2024-04-26T21:08:06.089 INFO:tasks.workunit.client.0.smithi055.stdout:4/247: write d4/f11 [8770437,125675] 0 2024-04-26T21:08:06.089 INFO:tasks.workunit.client.0.smithi055.stdout:4/248: stat d4/f1d 0 2024-04-26T21:08:06.089 INFO:tasks.workunit.client.1.smithi064.stdout:8/402: dread d10/f24 [0,4194304] 0 2024-04-26T21:08:06.090 INFO:tasks.workunit.client.0.smithi055.stdout:9/349: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:06.090 INFO:tasks.workunit.client.0.smithi055.stdout:9/350: chown d2/c5 646759 1 2024-04-26T21:08:06.090 INFO:tasks.workunit.client.1.smithi064.stdout:7/510: link d6/d9/f76 d6/db/d34/d6f/d81/fae 0 2024-04-26T21:08:06.092 INFO:tasks.workunit.client.0.smithi055.stdout:5/237: rename d4/df/f23 to d4/df/d13/f4c 0 2024-04-26T21:08:06.093 INFO:tasks.workunit.client.1.smithi064.stdout:0/471: creat dd/d10/d74/d4f/d7b/f9f x:0 0 0 2024-04-26T21:08:06.094 INFO:tasks.workunit.client.0.smithi055.stdout:8/277: creat d3/d9/f5c x:0 0 0 2024-04-26T21:08:06.094 INFO:tasks.workunit.client.0.smithi055.stdout:8/278: stat d3/d9/d1f/f31 0 2024-04-26T21:08:06.098 INFO:tasks.workunit.client.1.smithi064.stdout:5/498: creat dd/d12/fa0 x:0 0 0 2024-04-26T21:08:06.099 INFO:tasks.workunit.client.0.smithi055.stdout:9/351: symlink d2/d14/d33/l74 0 2024-04-26T21:08:06.099 INFO:tasks.workunit.client.0.smithi055.stdout:7/317: sync 2024-04-26T21:08:06.099 INFO:tasks.workunit.client.0.smithi055.stdout:5/238: truncate d4/fd 2069003 0 2024-04-26T21:08:06.099 INFO:tasks.workunit.client.1.smithi064.stdout:9/518: mkdir d0/d4/d7/df/da4 0 2024-04-26T21:08:06.101 INFO:tasks.workunit.client.1.smithi064.stdout:8/403: rename d10/d41/d4e/c34 to d10/d41/c81 0 2024-04-26T21:08:06.101 INFO:tasks.workunit.client.1.smithi064.stdout:8/404: dread - d10/d41/d44/d5a/f62 zero size 2024-04-26T21:08:06.106 INFO:tasks.workunit.client.0.smithi055.stdout:9/352: symlink d2/d11/l75 0 2024-04-26T21:08:06.107 INFO:tasks.workunit.client.1.smithi064.stdout:7/511: symlink d6/d70/d74/d99/laf 0 2024-04-26T21:08:06.107 INFO:tasks.workunit.client.0.smithi055.stdout:9/353: stat d2/d14/l30 0 2024-04-26T21:08:06.108 INFO:tasks.workunit.client.1.smithi064.stdout:0/472: mknod dd/ca0 0 2024-04-26T21:08:06.109 INFO:tasks.workunit.client.1.smithi064.stdout:0/473: write dd/d10/d1a/d31/d43/f55 [214547,78637] 0 2024-04-26T21:08:06.109 INFO:tasks.workunit.client.1.smithi064.stdout:0/474: creat dd/d10/d18/d64/fa1 x:0 0 0 2024-04-26T21:08:06.110 INFO:tasks.workunit.client.0.smithi055.stdout:7/318: getdents d5/d6/d39 0 2024-04-26T21:08:06.111 INFO:tasks.workunit.client.0.smithi055.stdout:7/319: getdents d5/d6/d39 0 2024-04-26T21:08:06.114 INFO:tasks.workunit.client.1.smithi064.stdout:8/405: rename d10/d1d/l32 to d10/d1d/d38/l82 0 2024-04-26T21:08:06.115 INFO:tasks.workunit.client.0.smithi055.stdout:5/239: creat d4/f4d x:0 0 0 2024-04-26T21:08:06.115 INFO:tasks.workunit.client.0.smithi055.stdout:5/240: stat d4/df/d13/d26/d3c/d4a/d3f/d2e 0 2024-04-26T21:08:06.115 INFO:tasks.workunit.client.0.smithi055.stdout:5/241: chown d4/l12 24616993 1 2024-04-26T21:08:06.118 INFO:tasks.workunit.client.0.smithi055.stdout:9/354: rename d2/d46/d51/f71 to d2/d14/d33/f76 0 2024-04-26T21:08:06.118 INFO:tasks.workunit.client.0.smithi055.stdout:9/355: write d2/d11/f73 [391488,14772] 0 2024-04-26T21:08:06.119 INFO:tasks.workunit.client.1.smithi064.stdout:7/512: mknod d6/db/d1f/d50/cb0 0 2024-04-26T21:08:06.132 INFO:tasks.workunit.client.0.smithi055.stdout:3/385: dwrite d0/d4/d5/d73/d47/d37/f6f [0,4194304] 0 2024-04-26T21:08:06.136 INFO:tasks.workunit.client.1.smithi064.stdout:8/406: read d10/d1d/f43 [1215386,19740] 0 2024-04-26T21:08:06.137 INFO:tasks.workunit.client.1.smithi064.stdout:8/407: chown d10/d2f/f3a 19107315 1 2024-04-26T21:08:06.146 INFO:tasks.workunit.client.1.smithi064.stdout:6/475: write d4/d7/d12/d38/f3f [167132,5296] 0 2024-04-26T21:08:06.146 INFO:tasks.workunit.client.1.smithi064.stdout:6/476: dread - d4/d7/d12/d49/d4b/d56/f70 zero size 2024-04-26T21:08:06.146 INFO:tasks.workunit.client.1.smithi064.stdout:6/477: readlink d4/d7/l1b 0 2024-04-26T21:08:06.146 INFO:tasks.workunit.client.1.smithi064.stdout:8/408: mkdir d10/d41/d4e/d59/d83 0 2024-04-26T21:08:06.151 INFO:tasks.workunit.client.0.smithi055.stdout:5/242: write d4/fd [2655456,104865] 0 2024-04-26T21:08:06.151 INFO:tasks.workunit.client.1.smithi064.stdout:7/513: dread d6/db/f2d [0,4194304] 0 2024-04-26T21:08:06.155 INFO:tasks.workunit.client.1.smithi064.stdout:8/409: unlink d10/d1d/f3d 0 2024-04-26T21:08:06.155 INFO:tasks.workunit.client.1.smithi064.stdout:6/478: dread d4/d7/d12/d38/f3c [0,4194304] 0 2024-04-26T21:08:06.156 INFO:tasks.workunit.client.0.smithi055.stdout:3/386: dread d0/d4/d5/d73/d13/d1a/d46/d51/f5e [0,4194304] 0 2024-04-26T21:08:06.156 INFO:tasks.workunit.client.1.smithi064.stdout:5/499: dwrite dd/d12/d18/d1a/d1b/f6c [0,4194304] 0 2024-04-26T21:08:06.157 INFO:tasks.workunit.client.1.smithi064.stdout:9/519: dwrite d0/d4/d7/f46 [0,4194304] 0 2024-04-26T21:08:06.160 INFO:tasks.workunit.client.1.smithi064.stdout:1/613: dwrite d0/d6/d29/d31/f51 [4194304,4194304] 0 2024-04-26T21:08:06.168 INFO:tasks.workunit.client.1.smithi064.stdout:7/514: mknod d6/d70/cb1 0 2024-04-26T21:08:06.174 INFO:tasks.workunit.client.1.smithi064.stdout:6/479: mkdir d4/d7/d12/d49/d4b/d5a/d79/d9b 0 2024-04-26T21:08:06.175 INFO:tasks.workunit.client.1.smithi064.stdout:0/475: write dd/d10/f2e [3209890,64793] 0 2024-04-26T21:08:06.175 INFO:tasks.workunit.client.1.smithi064.stdout:0/476: fdatasync dd/d10/d18/d64/f65 0 2024-04-26T21:08:06.178 INFO:tasks.workunit.client.0.smithi055.stdout:9/356: rename d2/d14/d33 to d2/d46/d77 0 2024-04-26T21:08:06.182 INFO:tasks.workunit.client.1.smithi064.stdout:1/614: creat d0/d22/d9f/fbe x:0 0 0 2024-04-26T21:08:06.182 INFO:tasks.workunit.client.1.smithi064.stdout:1/615: fdatasync d0/d6/d11/d1e/f21 0 2024-04-26T21:08:06.183 INFO:tasks.workunit.client.0.smithi055.stdout:9/357: symlink d2/d46/l78 0 2024-04-26T21:08:06.183 INFO:tasks.workunit.client.0.smithi055.stdout:9/358: write d2/d14/f59 [370822,82287] 0 2024-04-26T21:08:06.184 INFO:tasks.workunit.client.1.smithi064.stdout:9/520: creat d0/d4/da/d26/d5d/fa5 x:0 0 0 2024-04-26T21:08:06.186 INFO:tasks.workunit.client.1.smithi064.stdout:1/616: creat d0/d6/d91/d92/fbf x:0 0 0 2024-04-26T21:08:06.186 INFO:tasks.workunit.client.1.smithi064.stdout:1/617: chown d0/d6/d11/d6c 13268 1 2024-04-26T21:08:06.187 INFO:tasks.workunit.client.0.smithi055.stdout:3/387: rename d0/d4/d5/d73/d13/d1a/d46/d55/l56 to d0/d4/d5/d73/d13/d27/d3b/l8b 0 2024-04-26T21:08:06.188 INFO:tasks.workunit.client.0.smithi055.stdout:3/388: write d0/d4/d16/f26 [1813440,115606] 0 2024-04-26T21:08:06.189 INFO:tasks.workunit.client.1.smithi064.stdout:1/618: symlink d0/d6b/d9e/lc0 0 2024-04-26T21:08:06.189 INFO:tasks.workunit.client.1.smithi064.stdout:1/619: stat d0/d6/d11/fb2 0 2024-04-26T21:08:06.189 INFO:tasks.workunit.client.0.smithi055.stdout:3/389: mknod d0/d4/d16/d18/d4b/d57/c8c 0 2024-04-26T21:08:06.190 INFO:tasks.workunit.client.1.smithi064.stdout:1/620: creat d0/d6/d11/d2c/d9c/dbc/fc1 x:0 0 0 2024-04-26T21:08:06.192 INFO:tasks.workunit.client.0.smithi055.stdout:3/390: symlink d0/d4/l8d 0 2024-04-26T21:08:06.193 INFO:tasks.workunit.client.0.smithi055.stdout:3/391: mkdir d0/d4/d16/d18/d4b/d57/d8e 0 2024-04-26T21:08:06.194 INFO:tasks.workunit.client.1.smithi064.stdout:1/621: creat d0/d6/d11/d1e/d2a/d34/d57/fc2 x:0 0 0 2024-04-26T21:08:06.208 INFO:tasks.workunit.client.1.smithi064.stdout:9/521: dread d0/d4/d7/df/f40 [4194304,4194304] 0 2024-04-26T21:08:06.211 INFO:tasks.workunit.client.1.smithi064.stdout:7/515: write d6/db/d34/f5b [2819959,12239] 0 2024-04-26T21:08:06.214 INFO:tasks.workunit.client.0.smithi055.stdout:7/320: dwrite d5/d6/d24/d3b/f45 [0,4194304] 0 2024-04-26T21:08:06.217 INFO:tasks.workunit.client.0.smithi055.stdout:7/321: symlink d5/d6/d39/l5a 0 2024-04-26T21:08:06.220 INFO:tasks.workunit.client.1.smithi064.stdout:9/522: mkdir d0/da6 0 2024-04-26T21:08:06.223 INFO:tasks.workunit.client.0.smithi055.stdout:9/359: write d2/d11/f73 [162999,90617] 0 2024-04-26T21:08:06.227 INFO:tasks.workunit.client.0.smithi055.stdout:7/322: unlink d5/d6/d24/d4d/l51 0 2024-04-26T21:08:06.228 INFO:tasks.workunit.client.0.smithi055.stdout:3/392: dread d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:06.229 INFO:tasks.workunit.client.1.smithi064.stdout:8/410: dwrite d10/f47 [0,4194304] 0 2024-04-26T21:08:06.230 INFO:tasks.workunit.client.0.smithi055.stdout:8/279: dwrite d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:06.234 INFO:tasks.workunit.client.0.smithi055.stdout:5/243: dwrite d4/df/d13/f22 [0,4194304] 0 2024-04-26T21:08:06.234 INFO:tasks.workunit.client.0.smithi055.stdout:5/244: chown d4/d15 614670 1 2024-04-26T21:08:06.234 INFO:tasks.workunit.client.0.smithi055.stdout:5/245: creat d4/df/d13/d26/f4e x:0 0 0 2024-04-26T21:08:06.236 INFO:tasks.workunit.client.1.smithi064.stdout:6/480: dwrite d4/d7/d12/d49/d4b/d5a/d79/f90 [0,4194304] 0 2024-04-26T21:08:06.236 INFO:tasks.workunit.client.1.smithi064.stdout:7/516: getdents d6/d5a 0 2024-04-26T21:08:06.236 INFO:tasks.workunit.client.1.smithi064.stdout:9/523: unlink d0/d4/da/d31/c7a 0 2024-04-26T21:08:06.237 INFO:tasks.workunit.client.1.smithi064.stdout:4/571: sync 2024-04-26T21:08:06.239 INFO:tasks.workunit.client.0.smithi055.stdout:3/393: mknod d0/d4/d5/d73/d13/d1a/d46/d72/d69/c8f 0 2024-04-26T21:08:06.239 INFO:tasks.workunit.client.0.smithi055.stdout:3/394: rename d0 to d0/d4/d5/d73/d13/d27/d50/d90 22 2024-04-26T21:08:06.239 INFO:tasks.workunit.client.0.smithi055.stdout:3/395: chown d0/d4/d5/d73/d13/l7b 9568 1 2024-04-26T21:08:06.242 INFO:tasks.workunit.client.1.smithi064.stdout:2/522: sync 2024-04-26T21:08:06.248 INFO:tasks.workunit.client.1.smithi064.stdout:8/411: mknod d10/d41/d4e/d60/c84 0 2024-04-26T21:08:06.249 INFO:tasks.workunit.client.1.smithi064.stdout:6/481: dread d4/d7/f4d [0,4194304] 0 2024-04-26T21:08:06.253 INFO:tasks.workunit.client.0.smithi055.stdout:8/280: dread d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:06.255 INFO:tasks.workunit.client.1.smithi064.stdout:6/482: creat d4/d7/f9c x:0 0 0 2024-04-26T21:08:06.256 INFO:tasks.workunit.client.0.smithi055.stdout:5/246: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f 0 2024-04-26T21:08:06.256 INFO:tasks.workunit.client.0.smithi055.stdout:5/247: write d4/df/d13/d26/f4e [772834,10180] 0 2024-04-26T21:08:06.256 INFO:tasks.workunit.client.1.smithi064.stdout:6/483: write d4/f41 [1210786,42714] 0 2024-04-26T21:08:06.257 INFO:tasks.workunit.client.1.smithi064.stdout:2/523: dread d12/d41/d73/d83/fa6 [0,4194304] 0 2024-04-26T21:08:06.258 INFO:tasks.workunit.client.1.smithi064.stdout:7/517: unlink d6/d9/f37 0 2024-04-26T21:08:06.259 INFO:tasks.workunit.client.0.smithi055.stdout:8/281: creat d3/d9/d1f/f5d x:0 0 0 2024-04-26T21:08:06.259 INFO:tasks.workunit.client.0.smithi055.stdout:8/282: write d3/d9/d44/f58 [852749,64556] 0 2024-04-26T21:08:06.261 INFO:tasks.workunit.client.0.smithi055.stdout:5/248: mknod d4/d15/c50 0 2024-04-26T21:08:06.261 INFO:tasks.workunit.client.1.smithi064.stdout:6/484: unlink d4/d7/d12/c27 0 2024-04-26T21:08:06.261 INFO:tasks.workunit.client.1.smithi064.stdout:6/485: stat d4/d99 0 2024-04-26T21:08:06.262 INFO:tasks.workunit.client.0.smithi055.stdout:5/249: creat d4/df/d13/d26/d3c/f51 x:0 0 0 2024-04-26T21:08:06.262 INFO:tasks.workunit.client.0.smithi055.stdout:5/250: write d4/f11 [4789675,76067] 0 2024-04-26T21:08:06.264 INFO:tasks.workunit.client.1.smithi064.stdout:0/477: dwrite dd/d10/d1a/d31/f3c [0,4194304] 0 2024-04-26T21:08:06.264 INFO:tasks.workunit.client.1.smithi064.stdout:0/478: fdatasync dd/d10/d74/f80 0 2024-04-26T21:08:06.264 INFO:tasks.workunit.client.1.smithi064.stdout:9/524: creat d0/d4/da/d26/d5e/fa7 x:0 0 0 2024-04-26T21:08:06.264 INFO:tasks.workunit.client.1.smithi064.stdout:9/525: write d0/d4/d28/f30 [1035666,58545] 0 2024-04-26T21:08:06.264 INFO:tasks.workunit.client.1.smithi064.stdout:9/526: creat d0/d4/da/d26/d5d/fa8 x:0 0 0 2024-04-26T21:08:06.265 INFO:tasks.workunit.client.1.smithi064.stdout:2/524: truncate d12/d41/f4b 4060 0 2024-04-26T21:08:06.265 INFO:tasks.workunit.client.1.smithi064.stdout:2/525: chown d12/d41/d73/d83/d94/f35 73363533 1 2024-04-26T21:08:06.269 INFO:tasks.workunit.client.1.smithi064.stdout:0/479: mknod dd/d10/d74/d4f/ca2 0 2024-04-26T21:08:06.277 INFO:tasks.workunit.client.1.smithi064.stdout:0/480: symlink dd/d10/d1a/d31/d5c/la3 0 2024-04-26T21:08:06.279 INFO:tasks.workunit.client.1.smithi064.stdout:0/481: mknod dd/d10/d1a/d31/d5c/ca4 0 2024-04-26T21:08:06.279 INFO:tasks.workunit.client.1.smithi064.stdout:0/482: chown dd/d10/d1a/d31/c59 61192 1 2024-04-26T21:08:06.280 INFO:tasks.workunit.client.0.smithi055.stdout:1/324: sync 2024-04-26T21:08:06.280 INFO:tasks.workunit.client.0.smithi055.stdout:1/325: readlink d8/df/d11/d44/l6f 0 2024-04-26T21:08:06.281 INFO:tasks.workunit.client.1.smithi064.stdout:9/527: dread d0/d4/d7/fd [4194304,4194304] 0 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:9/528: fdatasync d0/d4/d7/f46 0 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:9/529: chown d0/d4/da/d31/d34/c35 0 1 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:0/483: creat dd/d10/d74/d4f/fa5 x:0 0 0 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:2/526: dread d12/d41/d73/d83/d94/f37 [0,4194304] 0 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:2/527: fdatasync d12/d41/d73/d83/d94/d3a/d46/d6a/f5a 0 2024-04-26T21:08:06.282 INFO:tasks.workunit.client.1.smithi064.stdout:2/528: getdents d12/da9 0 2024-04-26T21:08:06.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/484: creat dd/d10/d1a/d31/d43/fa6 x:0 0 0 2024-04-26T21:08:06.290 INFO:tasks.workunit.client.0.smithi055.stdout:3/396: dread d0/d4/d5/d73/d13/f1d [0,4194304] 0 2024-04-26T21:08:06.290 INFO:tasks.workunit.client.0.smithi055.stdout:3/397: read - d0/d4/d16/d18/d4b/f89 zero size 2024-04-26T21:08:06.292 INFO:tasks.workunit.client.0.smithi055.stdout:0/371: sync 2024-04-26T21:08:06.292 INFO:tasks.workunit.client.0.smithi055.stdout:0/372: write d9/dc/d17/f61 [685774,97292] 0 2024-04-26T21:08:06.292 INFO:tasks.workunit.client.0.smithi055.stdout:0/373: chown d9/c6b 3270815 1 2024-04-26T21:08:06.293 INFO:tasks.workunit.client.0.smithi055.stdout:6/331: sync 2024-04-26T21:08:06.293 INFO:tasks.workunit.client.0.smithi055.stdout:6/332: write d3/d17/d19/f1e [1220835,95902] 0 2024-04-26T21:08:06.295 INFO:tasks.workunit.client.0.smithi055.stdout:1/326: getdents d8/d17/d33 0 2024-04-26T21:08:06.297 INFO:tasks.workunit.client.0.smithi055.stdout:3/398: mknod d0/d4/d5/d73/d47/d37/d3d/c91 0 2024-04-26T21:08:06.303 INFO:tasks.workunit.client.0.smithi055.stdout:6/333: symlink d3/d17/d46/d54/d66/d6a/d51/d58/d73/l75 0 2024-04-26T21:08:06.304 INFO:tasks.workunit.client.0.smithi055.stdout:3/399: mkdir d0/d4/d5/d73/d13/d5c/d92 0 2024-04-26T21:08:06.304 INFO:tasks.workunit.client.0.smithi055.stdout:3/400: chown d0/d4/d5/d73/f14 7370 1 2024-04-26T21:08:06.307 INFO:tasks.workunit.client.0.smithi055.stdout:9/360: dwrite d2/f5e [0,4194304] 0 2024-04-26T21:08:06.307 INFO:tasks.workunit.client.0.smithi055.stdout:9/361: fdatasync d2/d11/f2f 0 2024-04-26T21:08:06.310 INFO:tasks.workunit.client.0.smithi055.stdout:5/251: read d4/df/d13/f17 [5573116,58547] 0 2024-04-26T21:08:06.310 INFO:tasks.workunit.client.0.smithi055.stdout:5/252: write d4/df/f3b [4318247,111945] 0 2024-04-26T21:08:06.310 INFO:tasks.workunit.client.1.smithi064.stdout:4/572: dwrite d0/d14/f95 [0,4194304] 0 2024-04-26T21:08:06.312 INFO:tasks.workunit.client.0.smithi055.stdout:0/374: dread d9/dc/d1c/d3b/f36 [0,4194304] 0 2024-04-26T21:08:06.312 INFO:tasks.workunit.client.1.smithi064.stdout:1/622: dwrite d0/d22/d9f/fbb [8388608,4194304] 0 2024-04-26T21:08:06.318 INFO:tasks.workunit.client.0.smithi055.stdout:6/334: unlink d3/d17/d19/d71/c50 0 2024-04-26T21:08:06.319 INFO:tasks.workunit.client.0.smithi055.stdout:7/323: dwrite d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:06.323 INFO:tasks.workunit.client.0.smithi055.stdout:1/327: rmdir d8/df 39 2024-04-26T21:08:06.324 INFO:tasks.workunit.client.1.smithi064.stdout:4/573: creat d0/d1d/d17/d9b/fbc x:0 0 0 2024-04-26T21:08:06.325 INFO:tasks.workunit.client.0.smithi055.stdout:1/328: dread - d8/df/d11/d27/d28/f6d zero size 2024-04-26T21:08:06.325 INFO:tasks.workunit.client.0.smithi055.stdout:3/401: mkdir d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93 0 2024-04-26T21:08:06.325 INFO:tasks.workunit.client.0.smithi055.stdout:7/324: write d5/d6/d24/f4b [184956,27519] 0 2024-04-26T21:08:06.325 INFO:tasks.workunit.client.0.smithi055.stdout:8/283: dwrite d3/d9/d1f/f5d [0,4194304] 0 2024-04-26T21:08:06.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/623: mkdir d0/d6/d11/d2c/d9c/dbc/dc3 0 2024-04-26T21:08:06.328 INFO:tasks.workunit.client.1.smithi064.stdout:1/624: fsync d0/d6b/f9d 0 2024-04-26T21:08:06.330 INFO:tasks.workunit.client.1.smithi064.stdout:4/574: creat d0/d5/d13/d10/fbd x:0 0 0 2024-04-26T21:08:06.330 INFO:tasks.workunit.client.1.smithi064.stdout:4/575: readlink d0/d2f/l7b 0 2024-04-26T21:08:06.332 INFO:tasks.workunit.client.0.smithi055.stdout:9/362: mkdir d2/d46/d77/d79 0 2024-04-26T21:08:06.332 INFO:tasks.workunit.client.0.smithi055.stdout:9/363: stat d2/d46/f50 0 2024-04-26T21:08:06.338 INFO:tasks.workunit.client.0.smithi055.stdout:5/253: rename d4/df/d13/f17 to d4/d15/f52 0 2024-04-26T21:08:06.340 INFO:tasks.workunit.client.1.smithi064.stdout:3/494: sync 2024-04-26T21:08:06.341 INFO:tasks.workunit.client.1.smithi064.stdout:8/412: dwrite d10/f12 [0,4194304] 0 2024-04-26T21:08:06.341 INFO:tasks.workunit.client.0.smithi055.stdout:0/375: dread d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:06.343 INFO:tasks.workunit.client.1.smithi064.stdout:3/495: truncate d1/d27/d29/d6f/d72/d26/f58 3447801 0 2024-04-26T21:08:06.349 INFO:tasks.workunit.client.1.smithi064.stdout:8/413: creat d10/d1d/f85 x:0 0 0 2024-04-26T21:08:06.352 INFO:tasks.workunit.client.0.smithi055.stdout:6/335: read d3/d17/d25/f47 [1406362,5940] 0 2024-04-26T21:08:06.355 INFO:tasks.workunit.client.0.smithi055.stdout:3/402: dread d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:06.355 INFO:tasks.workunit.client.1.smithi064.stdout:8/414: mkdir d10/d2f/d56/d86 0 2024-04-26T21:08:06.360 INFO:tasks.workunit.client.0.smithi055.stdout:7/325: truncate d5/db/f14 128761 0 2024-04-26T21:08:06.363 INFO:tasks.workunit.client.1.smithi064.stdout:8/415: mknod d10/d1d/c87 0 2024-04-26T21:08:06.367 INFO:tasks.workunit.client.0.smithi055.stdout:8/284: symlink d3/d9/d1f/l5e 0 2024-04-26T21:08:06.367 INFO:tasks.workunit.client.0.smithi055.stdout:8/285: write d3/d9/d1d/f35 [4636605,60030] 0 2024-04-26T21:08:06.368 INFO:tasks.workunit.client.1.smithi064.stdout:8/416: creat d10/d2f/d61/f88 x:0 0 0 2024-04-26T21:08:06.369 INFO:tasks.workunit.client.0.smithi055.stdout:5/254: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53 0 2024-04-26T21:08:06.372 INFO:tasks.workunit.client.0.smithi055.stdout:0/376: unlink d9/dc/d1c/c77 0 2024-04-26T21:08:06.374 INFO:tasks.workunit.client.0.smithi055.stdout:0/377: write d9/f64 [1090677,97688] 0 2024-04-26T21:08:06.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/417: rename d10/d1d/d38/l45 to d10/d41/d4e/d60/l89 0 2024-04-26T21:08:06.385 INFO:tasks.workunit.client.1.smithi064.stdout:6/486: dwrite d4/d7/f1f [0,4194304] 0 2024-04-26T21:08:06.387 INFO:tasks.workunit.client.1.smithi064.stdout:9/530: dwrite d0/d4/da/fc [0,4194304] 0 2024-04-26T21:08:06.389 INFO:tasks.workunit.client.0.smithi055.stdout:8/286: dread d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:06.389 INFO:tasks.workunit.client.0.smithi055.stdout:6/336: creat d3/d17/d46/d54/d66/d6a/d6b/f76 x:0 0 0 2024-04-26T21:08:06.389 INFO:tasks.workunit.client.0.smithi055.stdout:2/377: sync 2024-04-26T21:08:06.390 INFO:tasks.workunit.client.0.smithi055.stdout:4/249: sync 2024-04-26T21:08:06.394 INFO:tasks.workunit.client.0.smithi055.stdout:7/326: rmdir d5/d53 39 2024-04-26T21:08:06.395 INFO:tasks.workunit.client.1.smithi064.stdout:8/418: rmdir d10/d41/d44/d5a 39 2024-04-26T21:08:06.395 INFO:tasks.workunit.client.1.smithi064.stdout:8/419: chown d10/d41/l74 422 1 2024-04-26T21:08:06.398 INFO:tasks.workunit.client.0.smithi055.stdout:5/255: creat d4/df/d13/d26/d3c/d4a/d3f/d2e/f54 x:0 0 0 2024-04-26T21:08:06.398 INFO:tasks.workunit.client.0.smithi055.stdout:5/256: readlink d4/df/l34 0 2024-04-26T21:08:06.399 INFO:tasks.workunit.client.0.smithi055.stdout:8/287: symlink d3/d9/d44/l5f 0 2024-04-26T21:08:06.403 INFO:tasks.workunit.client.1.smithi064.stdout:6/487: truncate d4/d7/d12/d1e/f63 7537895 0 2024-04-26T21:08:06.406 INFO:tasks.workunit.client.1.smithi064.stdout:6/488: write d4/d7/d12/d49/d4b/f74 [378705,130368] 0 2024-04-26T21:08:06.407 INFO:tasks.workunit.client.0.smithi055.stdout:4/250: creat d4/d18/d1a/f54 x:0 0 0 2024-04-26T21:08:06.407 INFO:tasks.workunit.client.0.smithi055.stdout:4/251: fsync d4/d18/d1a/f37 0 2024-04-26T21:08:06.408 INFO:tasks.workunit.client.0.smithi055.stdout:4/252: creat d4/d18/f55 x:0 0 0 2024-04-26T21:08:06.408 INFO:tasks.workunit.client.0.smithi055.stdout:6/337: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d73/d77 0 2024-04-26T21:08:06.408 INFO:tasks.workunit.client.1.smithi064.stdout:8/420: truncate d10/d1d/f30 4127062 0 2024-04-26T21:08:06.409 INFO:tasks.workunit.client.0.smithi055.stdout:5/257: rename d4/f11 to d4/df/d13/d26/d3c/d4a/f55 0 2024-04-26T21:08:06.409 INFO:tasks.workunit.client.0.smithi055.stdout:5/258: write d4/f6 [1641935,114438] 0 2024-04-26T21:08:06.409 INFO:tasks.workunit.client.0.smithi055.stdout:8/288: truncate d3/d9/f2b 2148837 0 2024-04-26T21:08:06.410 INFO:tasks.workunit.client.1.smithi064.stdout:6/489: rename d4/d7/l1b to d4/d7/l9d 0 2024-04-26T21:08:06.411 INFO:tasks.workunit.client.0.smithi055.stdout:6/338: unlink d3/d17/d46/d54/d66/d6a/d51/d58/d6d/c6f 0 2024-04-26T21:08:06.411 INFO:tasks.workunit.client.0.smithi055.stdout:6/339: fsync d3/d17/f29 0 2024-04-26T21:08:06.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/340: creat d3/d17/d46/d54/d66/d6a/d51/d58/d62/f78 x:0 0 0 2024-04-26T21:08:06.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/341: fsync d3/d17/d25/f47 0 2024-04-26T21:08:06.413 INFO:tasks.workunit.client.1.smithi064.stdout:8/421: unlink d10/d1d/d38/f71 0 2024-04-26T21:08:06.413 INFO:tasks.workunit.client.1.smithi064.stdout:8/422: write d10/f12 [5107173,40671] 0 2024-04-26T21:08:06.414 INFO:tasks.workunit.client.0.smithi055.stdout:2/378: write d4/db/d56/d4a/f53 [1356300,26644] 0 2024-04-26T21:08:06.415 INFO:tasks.workunit.client.0.smithi055.stdout:8/289: mknod d3/d9/d1f/c60 0 2024-04-26T21:08:06.416 INFO:tasks.workunit.client.0.smithi055.stdout:4/253: mkdir d4/d26/d42/d56 0 2024-04-26T21:08:06.417 INFO:tasks.workunit.client.1.smithi064.stdout:3/496: dwrite d1/d27/d29/d6f/d72/da5/d7d/fad [0,4194304] 0 2024-04-26T21:08:06.417 INFO:tasks.workunit.client.0.smithi055.stdout:2/379: rmdir d4/d55 39 2024-04-26T21:08:06.417 INFO:tasks.workunit.client.0.smithi055.stdout:4/254: mkdir d4/d12/d57 0 2024-04-26T21:08:06.419 INFO:tasks.workunit.client.0.smithi055.stdout:2/380: symlink d4/d14/d17/d36/l82 0 2024-04-26T21:08:06.419 INFO:tasks.workunit.client.0.smithi055.stdout:4/255: mknod d4/d23/c58 0 2024-04-26T21:08:06.419 INFO:tasks.workunit.client.0.smithi055.stdout:4/256: fdatasync d4/f30 0 2024-04-26T21:08:06.419 INFO:tasks.workunit.client.0.smithi055.stdout:4/257: creat d4/d26/d42/d2d/f59 x:0 0 0 2024-04-26T21:08:06.424 INFO:tasks.workunit.client.0.smithi055.stdout:7/327: write d5/d6/d24/d3b/f3c [1645635,96693] 0 2024-04-26T21:08:06.426 INFO:tasks.workunit.client.1.smithi064.stdout:9/531: dread d0/d4/da/d26/d47/f73 [0,4194304] 0 2024-04-26T21:08:06.430 INFO:tasks.workunit.client.0.smithi055.stdout:7/328: symlink d5/d6/d24/d3b/l5b 0 2024-04-26T21:08:06.431 INFO:tasks.workunit.client.1.smithi064.stdout:3/497: symlink d1/d27/d50/d35/d4c/lb0 0 2024-04-26T21:08:06.436 INFO:tasks.workunit.client.0.smithi055.stdout:0/378: dread d9/f64 [0,4194304] 0 2024-04-26T21:08:06.442 INFO:tasks.workunit.client.0.smithi055.stdout:0/379: mkdir d9/d11/d5b/d5e/d6c/d7a 0 2024-04-26T21:08:06.446 INFO:tasks.workunit.client.0.smithi055.stdout:0/380: readlink d9/dc/d17/l1b 0 2024-04-26T21:08:06.446 INFO:tasks.workunit.client.0.smithi055.stdout:0/381: fdatasync d9/d27/f37 0 2024-04-26T21:08:06.446 INFO:tasks.workunit.client.0.smithi055.stdout:0/382: fdatasync d9/dc/d19/f24 0 2024-04-26T21:08:06.447 INFO:tasks.workunit.client.0.smithi055.stdout:2/381: read d4/dc/f12 [623172,20050] 0 2024-04-26T21:08:06.447 INFO:tasks.workunit.client.0.smithi055.stdout:3/403: dwrite d0/d4/d5/d73/d13/d5c/f8a [0,4194304] 0 2024-04-26T21:08:06.450 INFO:tasks.workunit.client.0.smithi055.stdout:2/382: mknod d4/db/d1f/d46/c83 0 2024-04-26T21:08:06.451 INFO:tasks.workunit.client.0.smithi055.stdout:2/383: creat d4/d14/d17/d36/f84 x:0 0 0 2024-04-26T21:08:06.452 INFO:tasks.workunit.client.0.smithi055.stdout:1/329: dwrite d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:06.461 INFO:tasks.workunit.client.1.smithi064.stdout:0/485: dwrite dd/d10/f84 [0,4194304] 0 2024-04-26T21:08:06.461 INFO:tasks.workunit.client.1.smithi064.stdout:0/486: dread - dd/d10/d74/d1d/f6d zero size 2024-04-26T21:08:06.461 INFO:tasks.workunit.client.1.smithi064.stdout:0/487: write dd/d10/d18/f29 [575648,71482] 0 2024-04-26T21:08:06.461 INFO:tasks.workunit.client.1.smithi064.stdout:0/488: dread - dd/d10/d74/f97 zero size 2024-04-26T21:08:06.461 INFO:tasks.workunit.client.1.smithi064.stdout:0/489: write dd/d10/d18/d58/f93 [824860,17356] 0 2024-04-26T21:08:06.483 INFO:tasks.workunit.client.0.smithi055.stdout:2/384: creat d4/d1e/d69/f85 x:0 0 0 2024-04-26T21:08:06.483 INFO:tasks.workunit.client.0.smithi055.stdout:2/385: fdatasync d4/dc/f1d 0 2024-04-26T21:08:06.483 INFO:tasks.workunit.client.0.smithi055.stdout:2/386: readlink d4/d14/l54 0 2024-04-26T21:08:06.483 INFO:tasks.workunit.client.0.smithi055.stdout:1/330: unlink d8/df/d11/d27/d28/d2a/l3c 0 2024-04-26T21:08:06.485 INFO:tasks.workunit.client.0.smithi055.stdout:2/387: symlink d4/l86 0 2024-04-26T21:08:06.488 INFO:tasks.workunit.client.0.smithi055.stdout:8/290: write f1 [2831581,61675] 0 2024-04-26T21:08:06.489 INFO:tasks.workunit.client.0.smithi055.stdout:1/331: creat d8/d17/d64/d65/f71 x:0 0 0 2024-04-26T21:08:06.491 INFO:tasks.workunit.client.0.smithi055.stdout:2/388: creat d4/d49/f87 x:0 0 0 2024-04-26T21:08:06.491 INFO:tasks.workunit.client.0.smithi055.stdout:2/389: fsync d4/dc/d21/f43 0 2024-04-26T21:08:06.491 INFO:tasks.workunit.client.0.smithi055.stdout:2/390: write d4/d1e/d2a/f30 [666613,105650] 0 2024-04-26T21:08:06.493 INFO:tasks.workunit.client.0.smithi055.stdout:8/291: mkdir d3/d9/d1d/d48/d57/d61 0 2024-04-26T21:08:06.500 INFO:tasks.workunit.client.0.smithi055.stdout:1/332: creat d8/df/d11/d27/d28/f72 x:0 0 0 2024-04-26T21:08:06.501 INFO:tasks.workunit.client.0.smithi055.stdout:8/292: rmdir d3/d9/d1d 39 2024-04-26T21:08:06.501 INFO:tasks.workunit.client.1.smithi064.stdout:8/423: dread d10/d2f/f36 [0,4194304] 0 2024-04-26T21:08:06.504 INFO:tasks.workunit.client.1.smithi064.stdout:9/532: dwrite d0/d4/d7/f46 [0,4194304] 0 2024-04-26T21:08:06.510 INFO:tasks.workunit.client.0.smithi055.stdout:1/333: creat d8/df/d11/d6c/f73 x:0 0 0 2024-04-26T21:08:06.511 INFO:tasks.workunit.client.0.smithi055.stdout:1/334: fdatasync d8/df/f55 0 2024-04-26T21:08:06.511 INFO:tasks.workunit.client.0.smithi055.stdout:1/335: write d8/d17/f18 [5091857,123555] 0 2024-04-26T21:08:06.511 INFO:tasks.workunit.client.1.smithi064.stdout:9/533: write d0/d4/da/d31/f82 [916275,81342] 0 2024-04-26T21:08:06.511 INFO:tasks.workunit.client.1.smithi064.stdout:6/490: dwrite d4/d7/d12/d38/f3f [0,4194304] 0 2024-04-26T21:08:06.511 INFO:tasks.workunit.client.1.smithi064.stdout:6/491: fsync d4/f31 0 2024-04-26T21:08:06.521 INFO:tasks.workunit.client.0.smithi055.stdout:0/383: dwrite d9/f64 [0,4194304] 0 2024-04-26T21:08:06.523 INFO:tasks.workunit.client.1.smithi064.stdout:6/492: getdents d4/d7/d12/d49/d4b/d56 0 2024-04-26T21:08:06.527 INFO:tasks.workunit.client.0.smithi055.stdout:3/404: dwrite d0/d4/d5/d73/d13/d1a/d46/d72/f60 [0,4194304] 0 2024-04-26T21:08:06.531 INFO:tasks.workunit.client.0.smithi055.stdout:7/329: dwrite d5/d6/d24/f27 [0,4194304] 0 2024-04-26T21:08:06.531 INFO:tasks.workunit.client.1.smithi064.stdout:5/500: sync 2024-04-26T21:08:06.533 INFO:tasks.workunit.client.0.smithi055.stdout:0/384: unlink d9/dc/f6f 0 2024-04-26T21:08:06.533 INFO:tasks.workunit.client.0.smithi055.stdout:0/385: write d9/dc/d1c/d54/d4b/d68/f6d [8401364,78592] 0 2024-04-26T21:08:06.533 INFO:tasks.workunit.client.1.smithi064.stdout:8/424: dread d10/d41/d44/f51 [4194304,4194304] 0 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:2/529: sync 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:4/576: sync 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:1/625: sync 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:4/577: dread - d0/d1d/d56/f8b zero size 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:4/578: fsync d0/d1d/d17/fab 0 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/518: sync 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:4/579: write d0/d5/d13/f36 [4973610,73769] 0 2024-04-26T21:08:06.537 INFO:tasks.workunit.client.1.smithi064.stdout:4/580: chown d0/d5/d13/d10/f4c 2310488 1 2024-04-26T21:08:06.538 INFO:tasks.workunit.client.1.smithi064.stdout:4/581: write d0/d1d/d56/f65 [3613215,100452] 0 2024-04-26T21:08:06.543 INFO:tasks.workunit.client.1.smithi064.stdout:9/534: write d0/d4/d7/f9 [7520877,64462] 0 2024-04-26T21:08:06.545 INFO:tasks.workunit.client.1.smithi064.stdout:5/501: truncate dd/d12/d18/d33/d48/f4c 611779 0 2024-04-26T21:08:06.545 INFO:tasks.workunit.client.0.smithi055.stdout:7/330: rename d5/c43 to d5/d6/d24/d48/d58/c5c 0 2024-04-26T21:08:06.548 INFO:tasks.workunit.client.1.smithi064.stdout:3/498: dwrite d1/d27/d29/d6f/d72/da5/f44 [0,4194304] 0 2024-04-26T21:08:06.548 INFO:tasks.workunit.client.1.smithi064.stdout:1/626: mknod d0/d6/d11/d1e/d2a/d34/d57/d9b/cc4 0 2024-04-26T21:08:06.551 INFO:tasks.workunit.client.1.smithi064.stdout:0/490: dwrite dd/d10/d18/d64/f86 [0,4194304] 0 2024-04-26T21:08:06.551 INFO:tasks.workunit.client.1.smithi064.stdout:0/491: write dd/d10/d74/d1d/f8a [4670789,116029] 0 2024-04-26T21:08:06.553 INFO:tasks.workunit.client.0.smithi055.stdout:4/258: dwrite d4/d12/f43 [0,4194304] 0 2024-04-26T21:08:06.556 INFO:tasks.workunit.client.0.smithi055.stdout:0/386: write d9/dc/d1c/d3e/f47 [2822429,121575] 0 2024-04-26T21:08:06.558 INFO:tasks.workunit.client.1.smithi064.stdout:2/530: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fb5 x:0 0 0 2024-04-26T21:08:06.558 INFO:tasks.workunit.client.1.smithi064.stdout:2/531: fsync d12/d41/d73/d83/d94/d3a/f79 0 2024-04-26T21:08:06.558 INFO:tasks.workunit.client.1.smithi064.stdout:2/532: creat d12/d41/d73/d83/d94/d3a/d46/d48/fb6 x:0 0 0 2024-04-26T21:08:06.563 INFO:tasks.workunit.client.1.smithi064.stdout:6/493: dread d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:06.573 INFO:tasks.workunit.client.0.smithi055.stdout:7/331: creat d5/d11/f5d x:0 0 0 2024-04-26T21:08:06.577 INFO:tasks.workunit.client.0.smithi055.stdout:1/336: getdents d8/df/d11/d6c 0 2024-04-26T21:08:06.577 INFO:tasks.workunit.client.0.smithi055.stdout:1/337: dread - d8/df/d11/d27/d63/f66 zero size 2024-04-26T21:08:06.581 INFO:tasks.workunit.client.0.smithi055.stdout:2/391: dwrite d4/db/d1f/f3d [0,4194304] 0 2024-04-26T21:08:06.601 INFO:tasks.workunit.client.1.smithi064.stdout:3/499: read d1/d27/d50/f39 [99194,116392] 0 2024-04-26T21:08:06.605 INFO:tasks.workunit.client.1.smithi064.stdout:4/582: truncate d0/d5/d13/f60 2904964 0 2024-04-26T21:08:06.607 INFO:tasks.workunit.client.1.smithi064.stdout:4/583: creat d0/d5/d79/fbe x:0 0 0 2024-04-26T21:08:06.609 INFO:tasks.workunit.client.0.smithi055.stdout:4/259: mknod d4/d12/d17/d3d/c5a 0 2024-04-26T21:08:06.609 INFO:tasks.workunit.client.0.smithi055.stdout:4/260: write d4/f4b [260758,101490] 0 2024-04-26T21:08:06.616 INFO:tasks.workunit.client.1.smithi064.stdout:5/502: mkdir dd/d12/d4f/d9c/da1 0 2024-04-26T21:08:06.617 INFO:tasks.workunit.client.1.smithi064.stdout:5/503: creat dd/d12/d18/d33/d48/fa2 x:0 0 0 2024-04-26T21:08:06.617 INFO:tasks.workunit.client.1.smithi064.stdout:5/504: fsync dd/d12/d18/d1a/d1f/d20/f4e 0 2024-04-26T21:08:06.619 INFO:tasks.workunit.client.0.smithi055.stdout:8/293: dwrite f1 [0,4194304] 0 2024-04-26T21:08:06.619 INFO:tasks.workunit.client.0.smithi055.stdout:8/294: stat d3/f46 0 2024-04-26T21:08:06.619 INFO:tasks.workunit.client.0.smithi055.stdout:2/392: rmdir d4/db/d26 39 2024-04-26T21:08:06.622 INFO:tasks.workunit.client.0.smithi055.stdout:3/405: dwrite d0/d4/d5/d73/d47/d37/d3d/d4c/f63 [0,4194304] 0 2024-04-26T21:08:06.624 INFO:tasks.workunit.client.1.smithi064.stdout:7/519: dwrite d6/d8c/f7f [0,4194304] 0 2024-04-26T21:08:06.624 INFO:tasks.workunit.client.1.smithi064.stdout:6/494: dwrite d4/d7/d12/d1e/f63 [0,4194304] 0 2024-04-26T21:08:06.625 INFO:tasks.workunit.client.1.smithi064.stdout:0/492: symlink dd/d10/d18/d64/la7 0 2024-04-26T21:08:06.625 INFO:tasks.workunit.client.1.smithi064.stdout:0/493: creat dd/d10/d74/d4f/fa8 x:0 0 0 2024-04-26T21:08:06.625 INFO:tasks.workunit.client.1.smithi064.stdout:0/494: chown dd/d10/d1a/d31/d43/c9b 267658099 1 2024-04-26T21:08:06.625 INFO:tasks.workunit.client.1.smithi064.stdout:0/495: fdatasync dd/f67 0 2024-04-26T21:08:06.628 INFO:tasks.workunit.client.1.smithi064.stdout:9/535: dwrite d0/d39/f3e [0,4194304] 0 2024-04-26T21:08:06.629 INFO:tasks.workunit.client.0.smithi055.stdout:0/387: dwrite d9/dc/d17/f79 [0,4194304] 0 2024-04-26T21:08:06.632 INFO:tasks.workunit.client.0.smithi055.stdout:1/338: symlink d8/l74 0 2024-04-26T21:08:06.632 INFO:tasks.workunit.client.0.smithi055.stdout:2/393: mknod d4/d14/c88 0 2024-04-26T21:08:06.632 INFO:tasks.workunit.client.0.smithi055.stdout:2/394: fsync d4/db/f15 0 2024-04-26T21:08:06.632 INFO:tasks.workunit.client.0.smithi055.stdout:3/406: rename d0/d4/d5/d73/d13/d27/d3b/c33 to d0/d4/d5/d73/d13/d27/c94 0 2024-04-26T21:08:06.636 INFO:tasks.workunit.client.1.smithi064.stdout:2/533: symlink d12/d41/d73/d83/d94/d3a/d5d/lb7 0 2024-04-26T21:08:06.639 INFO:tasks.workunit.client.0.smithi055.stdout:4/261: link d4/d12/d17/d3d/l4e d4/d26/d42/l5b 0 2024-04-26T21:08:06.639 INFO:tasks.workunit.client.0.smithi055.stdout:8/295: write d3/d9/d1f/f5d [2508492,106258] 0 2024-04-26T21:08:06.643 INFO:tasks.workunit.client.1.smithi064.stdout:2/534: dread d12/d41/d73/d83/d94/f3f [0,4194304] 0 2024-04-26T21:08:06.643 INFO:tasks.workunit.client.1.smithi064.stdout:2/535: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/f4d [1976923,64309] 0 2024-04-26T21:08:06.643 INFO:tasks.workunit.client.1.smithi064.stdout:2/536: write d12/d88/fa8 [879515,27399] 0 2024-04-26T21:08:06.649 INFO:tasks.workunit.client.0.smithi055.stdout:3/407: write d0/d4/d5/d73/f14 [7865579,20568] 0 2024-04-26T21:08:06.649 INFO:tasks.workunit.client.1.smithi064.stdout:3/500: truncate d1/d27/d50/f2d 7328459 0 2024-04-26T21:08:06.668 INFO:tasks.workunit.client.1.smithi064.stdout:3/501: write d1/fc [3438195,31971] 0 2024-04-26T21:08:06.674 INFO:tasks.workunit.client.1.smithi064.stdout:1/627: rmdir d0/d6/d11/d1e 39 2024-04-26T21:08:06.677 INFO:tasks.workunit.client.1.smithi064.stdout:5/505: truncate dd/d12/d18/d33/d48/d6a/f79 84716 0 2024-04-26T21:08:06.677 INFO:tasks.workunit.client.1.smithi064.stdout:5/506: creat dd/d12/d18/d25/d32/fa3 x:0 0 0 2024-04-26T21:08:06.677 INFO:tasks.workunit.client.1.smithi064.stdout:5/507: fsync dd/d12/d18/d33/d63/f84 0 2024-04-26T21:08:06.681 INFO:tasks.workunit.client.1.smithi064.stdout:4/584: dwrite d0/d1d/f1b [4194304,4194304] 0 2024-04-26T21:08:06.688 INFO:tasks.workunit.client.1.smithi064.stdout:7/520: creat d6/d70/da8/fb2 x:0 0 0 2024-04-26T21:08:06.689 INFO:tasks.workunit.client.1.smithi064.stdout:7/521: write d6/db/d34/d6f/d81/f84 [946122,83532] 0 2024-04-26T21:08:06.689 INFO:tasks.workunit.client.0.smithi055.stdout:0/388: symlink d9/d11/d5b/d74/l7b 0 2024-04-26T21:08:06.690 INFO:tasks.workunit.client.0.smithi055.stdout:7/332: dwrite d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:06.693 INFO:tasks.workunit.client.0.smithi055.stdout:1/339: getdents d8/df/d11 0 2024-04-26T21:08:06.699 INFO:tasks.workunit.client.0.smithi055.stdout:9/364: sync 2024-04-26T21:08:06.699 INFO:tasks.workunit.client.0.smithi055.stdout:6/342: sync 2024-04-26T21:08:06.699 INFO:tasks.workunit.client.0.smithi055.stdout:6/343: creat d3/f79 x:0 0 0 2024-04-26T21:08:06.699 INFO:tasks.workunit.client.0.smithi055.stdout:5/259: sync 2024-04-26T21:08:06.704 INFO:tasks.workunit.client.0.smithi055.stdout:2/395: link d4/db/f25 d4/f89 0 2024-04-26T21:08:06.709 INFO:tasks.workunit.client.1.smithi064.stdout:0/496: link dd/d10/d1a/d31/d43/l71 dd/d10/d1a/d31/d43/la9 0 2024-04-26T21:08:06.717 INFO:tasks.workunit.client.0.smithi055.stdout:3/408: rmdir d0/d4/d16/d18/d80 0 2024-04-26T21:08:06.717 INFO:tasks.workunit.client.0.smithi055.stdout:3/409: chown d0/d4/d5/d73/d47/d37/d3d/d4c/f63 18 1 2024-04-26T21:08:06.731 INFO:tasks.workunit.client.0.smithi055.stdout:7/333: unlink d5/d11/f25 0 2024-04-26T21:08:06.732 INFO:tasks.workunit.client.1.smithi064.stdout:9/536: getdents d0/d4/da 0 2024-04-26T21:08:06.732 INFO:tasks.workunit.client.1.smithi064.stdout:9/537: chown d0/d4/da/d31/d34/c35 144 1 2024-04-26T21:08:06.733 INFO:tasks.workunit.client.0.smithi055.stdout:1/340: mkdir d8/df/d11/d27/d75 0 2024-04-26T21:08:06.742 INFO:tasks.workunit.client.0.smithi055.stdout:8/296: dwrite d3/d9/f5c [0,4194304] 0 2024-04-26T21:08:06.746 INFO:tasks.workunit.client.1.smithi064.stdout:6/495: dwrite d4/f28 [0,4194304] 0 2024-04-26T21:08:06.746 INFO:tasks.workunit.client.1.smithi064.stdout:5/508: dwrite dd/d12/d18/d33/d48/d6a/f8d [0,4194304] 0 2024-04-26T21:08:06.750 INFO:tasks.workunit.client.1.smithi064.stdout:2/537: rename d12/f24 to d12/fb8 0 2024-04-26T21:08:06.750 INFO:tasks.workunit.client.1.smithi064.stdout:2/538: truncate d12/fb8 5353158 0 2024-04-26T21:08:06.751 INFO:tasks.workunit.client.0.smithi055.stdout:4/262: dwrite d4/d23/f3b [0,4194304] 0 2024-04-26T21:08:06.755 INFO:tasks.workunit.client.0.smithi055.stdout:7/334: write d5/d11/f2f [4977174,23014] 0 2024-04-26T21:08:06.758 INFO:tasks.workunit.client.0.smithi055.stdout:6/344: truncate d3/f12 1534155 0 2024-04-26T21:08:06.762 INFO:tasks.workunit.client.1.smithi064.stdout:6/496: dread d4/d7/fd [0,4194304] 0 2024-04-26T21:08:06.766 INFO:tasks.workunit.client.1.smithi064.stdout:7/522: dwrite d6/d8c/f9f [0,4194304] 0 2024-04-26T21:08:06.766 INFO:tasks.workunit.client.1.smithi064.stdout:7/523: creat d6/d9/d38/fb3 x:0 0 0 2024-04-26T21:08:06.766 INFO:tasks.workunit.client.1.smithi064.stdout:7/524: creat d6/d9/d38/fb4 x:0 0 0 2024-04-26T21:08:06.766 INFO:tasks.workunit.client.1.smithi064.stdout:7/525: fsync d6/d15/d67/d4d/f6a 0 2024-04-26T21:08:06.767 INFO:tasks.workunit.client.0.smithi055.stdout:9/365: dwrite d2/f3f [0,4194304] 0 2024-04-26T21:08:06.767 INFO:tasks.workunit.client.0.smithi055.stdout:2/396: mknod d4/db/d56/c8a 0 2024-04-26T21:08:06.771 INFO:tasks.workunit.client.1.smithi064.stdout:9/538: dread d0/d4/d7/df/f40 [4194304,4194304] 0 2024-04-26T21:08:06.771 INFO:tasks.workunit.client.1.smithi064.stdout:3/502: rename d1/d27/d50/d35/d4c/d7b/d82/l4d to d1/d27/d29/d6f/lb1 0 2024-04-26T21:08:06.772 INFO:tasks.workunit.client.0.smithi055.stdout:3/410: symlink d0/d4/d16/l95 0 2024-04-26T21:08:06.774 INFO:tasks.workunit.client.1.smithi064.stdout:1/628: creat d0/d6/d11/d1e/d2a/d34/fc5 x:0 0 0 2024-04-26T21:08:06.780 INFO:tasks.workunit.client.0.smithi055.stdout:9/366: dread d2/f5a [0,4194304] 0 2024-04-26T21:08:06.780 INFO:tasks.workunit.client.0.smithi055.stdout:9/367: fsync d2/f53 0 2024-04-26T21:08:06.780 INFO:tasks.workunit.client.0.smithi055.stdout:9/368: chown d2/d14/f47 3 1 2024-04-26T21:08:06.782 INFO:tasks.workunit.client.0.smithi055.stdout:1/341: unlink l3 0 2024-04-26T21:08:06.784 INFO:tasks.workunit.client.1.smithi064.stdout:4/585: getdents d0/d5/d13/d6d/d97 0 2024-04-26T21:08:06.784 INFO:tasks.workunit.client.1.smithi064.stdout:4/586: fsync d0/d1d/d56/d89/f96 0 2024-04-26T21:08:06.784 INFO:tasks.workunit.client.0.smithi055.stdout:8/297: dread d3/d9/d1f/f31 [0,4194304] 0 2024-04-26T21:08:06.784 INFO:tasks.workunit.client.0.smithi055.stdout:8/298: chown d3/d9/c37 948280 1 2024-04-26T21:08:06.787 INFO:tasks.workunit.client.0.smithi055.stdout:7/335: creat d5/d6/d24/d52/f5e x:0 0 0 2024-04-26T21:08:06.790 INFO:tasks.workunit.client.0.smithi055.stdout:6/345: symlink d3/d17/d46/l7a 0 2024-04-26T21:08:06.792 INFO:tasks.workunit.client.0.smithi055.stdout:2/397: creat d4/dc/f8b x:0 0 0 2024-04-26T21:08:06.794 INFO:tasks.workunit.client.1.smithi064.stdout:5/509: truncate dd/d12/d18/d1a/d1f/d20/f3b 72242 0 2024-04-26T21:08:06.795 INFO:tasks.workunit.client.0.smithi055.stdout:3/411: creat d0/d4/d5/d73/d13/d1a/d46/d55/f96 x:0 0 0 2024-04-26T21:08:06.797 INFO:tasks.workunit.client.0.smithi055.stdout:0/389: dwrite d9/dc/d1c/d3e/f47 [4194304,4194304] 0 2024-04-26T21:08:06.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/497: mkdir d4/d7/d12/d49/d9e 0 2024-04-26T21:08:06.798 INFO:tasks.workunit.client.0.smithi055.stdout:0/390: read d9/dc/d17/f3a [229217,37419] 0 2024-04-26T21:08:06.803 INFO:tasks.workunit.client.0.smithi055.stdout:9/369: symlink d2/d46/d77/d79/l7a 0 2024-04-26T21:08:06.809 INFO:tasks.workunit.client.0.smithi055.stdout:8/299: creat d3/d9/d1f/d2e/f62 x:0 0 0 2024-04-26T21:08:06.810 INFO:tasks.workunit.client.0.smithi055.stdout:7/336: dread d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:06.813 INFO:tasks.workunit.client.0.smithi055.stdout:6/346: mkdir d3/d17/d19/d7b 0 2024-04-26T21:08:06.814 INFO:tasks.workunit.client.1.smithi064.stdout:7/526: mkdir d6/db/d34/d41/d5c/db5 0 2024-04-26T21:08:06.814 INFO:tasks.workunit.client.1.smithi064.stdout:7/527: write d6/d70/da8/fb2 [190119,86557] 0 2024-04-26T21:08:06.814 INFO:tasks.workunit.client.1.smithi064.stdout:7/528: chown d6/db/d1f/f4c 568616 1 2024-04-26T21:08:06.817 INFO:tasks.workunit.client.1.smithi064.stdout:0/497: rename dd/ce to dd/d10/d18/caa 0 2024-04-26T21:08:06.820 INFO:tasks.workunit.client.1.smithi064.stdout:1/629: creat d0/d6b/d9e/da2/fc6 x:0 0 0 2024-04-26T21:08:06.820 INFO:tasks.workunit.client.1.smithi064.stdout:1/630: chown d0/d6/d11/f5e 318721570 1 2024-04-26T21:08:06.821 INFO:tasks.workunit.client.0.smithi055.stdout:2/398: mknod d4/db/d56/d4a/d7e/c8c 0 2024-04-26T21:08:06.822 INFO:tasks.workunit.client.0.smithi055.stdout:3/412: symlink d0/d4/d5/d73/d13/d1a/d46/l97 0 2024-04-26T21:08:06.822 INFO:tasks.workunit.client.0.smithi055.stdout:3/413: write d0/d4/d5/d73/d13/d27/d50/d6b/f7d [995080,106409] 0 2024-04-26T21:08:06.822 INFO:tasks.workunit.client.0.smithi055.stdout:3/414: rename d0/d4 to d0/d4/d5/d73/d13/d98 22 2024-04-26T21:08:06.831 INFO:tasks.workunit.client.1.smithi064.stdout:5/510: truncate dd/d12/d18/d1a/d1f/d20/f38 2951505 0 2024-04-26T21:08:06.832 INFO:tasks.workunit.client.0.smithi055.stdout:7/337: dread d5/d6/d24/d3b/f45 [0,4194304] 0 2024-04-26T21:08:06.832 INFO:tasks.workunit.client.0.smithi055.stdout:7/338: stat d5/f32 0 2024-04-26T21:08:06.833 INFO:tasks.workunit.client.1.smithi064.stdout:7/529: symlink d6/d70/d74/d99/lb6 0 2024-04-26T21:08:06.833 INFO:tasks.workunit.client.1.smithi064.stdout:7/530: creat d6/d15/d67/d4d/fb7 x:0 0 0 2024-04-26T21:08:06.833 INFO:tasks.workunit.client.1.smithi064.stdout:8/425: sync 2024-04-26T21:08:06.834 INFO:tasks.workunit.client.0.smithi055.stdout:0/391: creat d9/dc/d17/d5d/f7c x:0 0 0 2024-04-26T21:08:06.837 INFO:tasks.workunit.client.1.smithi064.stdout:2/539: rename d12/d45/f98 to d12/d41/d73/d83/fb9 0 2024-04-26T21:08:06.838 INFO:tasks.workunit.client.0.smithi055.stdout:9/370: symlink d2/d46/d51/l7b 0 2024-04-26T21:08:06.842 INFO:tasks.workunit.client.0.smithi055.stdout:9/371: read d2/d46/d77/f58 [522226,77066] 0 2024-04-26T21:08:06.847 INFO:tasks.workunit.client.1.smithi064.stdout:0/498: link dd/d10/d1a/d31/d5c/c87 dd/d10/d1a/d31/d47/d61/cab 0 2024-04-26T21:08:06.847 INFO:tasks.workunit.client.1.smithi064.stdout:0/499: chown dd/d10/d74/f68 30 1 2024-04-26T21:08:06.851 INFO:tasks.workunit.client.0.smithi055.stdout:1/342: mknod d8/d17/c76 0 2024-04-26T21:08:06.851 INFO:tasks.workunit.client.0.smithi055.stdout:1/343: chown d8/d17/d6a 3433 1 2024-04-26T21:08:06.856 INFO:tasks.workunit.client.1.smithi064.stdout:1/631: mkdir d0/d6/d91/d92/dc7 0 2024-04-26T21:08:06.856 INFO:tasks.workunit.client.1.smithi064.stdout:1/632: dread - d0/d6b/d9e/da2/fc6 zero size 2024-04-26T21:08:06.860 INFO:tasks.workunit.client.1.smithi064.stdout:3/503: dwrite d1/d14/f1c [0,4194304] 0 2024-04-26T21:08:06.873 INFO:tasks.workunit.client.1.smithi064.stdout:4/587: dwrite d0/d5/d13/d6d/d97/f5e [0,4194304] 0 2024-04-26T21:08:06.873 INFO:tasks.workunit.client.1.smithi064.stdout:4/588: chown d0/d5/d13 241839079 1 2024-04-26T21:08:06.873 INFO:tasks.workunit.client.0.smithi055.stdout:6/347: unlink d3/d17/d46/d54/d66/d6a/d51/d58/c5d 0 2024-04-26T21:08:06.876 INFO:tasks.workunit.client.1.smithi064.stdout:8/426: symlink d10/d1d/d38/l8a 0 2024-04-26T21:08:06.885 INFO:tasks.workunit.client.1.smithi064.stdout:9/539: rename d0/d4/l1d to d0/da6/la9 0 2024-04-26T21:08:06.890 INFO:tasks.workunit.client.1.smithi064.stdout:1/633: write d0/d6/d11/f5e [1766636,120038] 0 2024-04-26T21:08:06.890 INFO:tasks.workunit.client.1.smithi064.stdout:1/634: creat d0/d6/d91/d92/fc8 x:0 0 0 2024-04-26T21:08:06.890 INFO:tasks.workunit.client.1.smithi064.stdout:1/635: readlink d0/d6b/l71 0 2024-04-26T21:08:06.891 INFO:tasks.workunit.client.1.smithi064.stdout:2/540: mkdir d12/d41/d73/d83/d94/d3a/dba 0 2024-04-26T21:08:06.892 INFO:tasks.workunit.client.0.smithi055.stdout:0/392: mkdir d9/dc/d1c/d3e/d7d 0 2024-04-26T21:08:06.894 INFO:tasks.workunit.client.0.smithi055.stdout:2/399: dwrite d4/d14/d17/d36/f4e [0,4194304] 0 2024-04-26T21:08:06.894 INFO:tasks.workunit.client.0.smithi055.stdout:2/400: chown d4/d14/d17/d36/f4e 6 1 2024-04-26T21:08:06.896 INFO:tasks.workunit.client.0.smithi055.stdout:8/300: symlink d3/d9/l63 0 2024-04-26T21:08:06.896 INFO:tasks.workunit.client.0.smithi055.stdout:8/301: chown d3/d9/d1f/f5d 215846899 1 2024-04-26T21:08:06.897 INFO:tasks.workunit.client.1.smithi064.stdout:7/531: dwrite d6/d15/d67/d4d/f9b [0,4194304] 0 2024-04-26T21:08:06.898 INFO:tasks.workunit.client.1.smithi064.stdout:5/511: dwrite dd/d12/d18/d1a/d1f/d20/f8b [0,4194304] 0 2024-04-26T21:08:06.900 INFO:tasks.workunit.client.0.smithi055.stdout:9/372: dwrite d2/d46/d77/f58 [0,4194304] 0 2024-04-26T21:08:06.901 INFO:tasks.workunit.client.0.smithi055.stdout:6/348: link d3/d17/d19/c2f d3/d17/d46/d54/d66/d6a/c7c 0 2024-04-26T21:08:06.908 INFO:tasks.workunit.client.1.smithi064.stdout:6/498: rename d4/d7/d12/d49/d4b/d5a/f5d to d4/d7/d12/d38/f9f 0 2024-04-26T21:08:06.908 INFO:tasks.workunit.client.1.smithi064.stdout:6/499: creat d4/d7/fa0 x:0 0 0 2024-04-26T21:08:06.909 INFO:tasks.workunit.client.0.smithi055.stdout:3/415: getdents d0/d4/d5/d73/d13 0 2024-04-26T21:08:06.909 INFO:tasks.workunit.client.0.smithi055.stdout:3/416: chown d0/d4/d5/f6 924448328 1 2024-04-26T21:08:06.912 INFO:tasks.workunit.client.0.smithi055.stdout:3/417: write d0/d4/d5/d73/d13/d27/d50/d6b/f7d [536496,102688] 0 2024-04-26T21:08:06.912 INFO:tasks.workunit.client.0.smithi055.stdout:3/418: stat d0/d4/d5/d73/d13/d1a/d46/d72/f7c 0 2024-04-26T21:08:06.912 INFO:tasks.workunit.client.0.smithi055.stdout:3/419: truncate d0/d4/d16/d18/d4b/f89 182284 0 2024-04-26T21:08:06.913 INFO:tasks.workunit.client.0.smithi055.stdout:3/420: write d0/d4/d5/d73/d13/d1a/f24 [4459370,61623] 0 2024-04-26T21:08:06.918 INFO:tasks.workunit.client.0.smithi055.stdout:7/339: getdents d5/d6 0 2024-04-26T21:08:06.918 INFO:tasks.workunit.client.0.smithi055.stdout:3/421: write d0/d4/d5/f21 [4691639,11051] 0 2024-04-26T21:08:06.918 INFO:tasks.workunit.client.0.smithi055.stdout:3/422: readlink d0/d4/d16/l1c 0 2024-04-26T21:08:06.920 INFO:tasks.workunit.client.0.smithi055.stdout:0/393: mknod d9/dc/c7e 0 2024-04-26T21:08:06.923 INFO:tasks.workunit.client.1.smithi064.stdout:1/636: truncate d0/d22/d9f/fbb 5493525 0 2024-04-26T21:08:06.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/541: symlink d12/d45/lbb 0 2024-04-26T21:08:06.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/542: fdatasync d12/d41/d61/d75/f2b 0 2024-04-26T21:08:06.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/543: write d12/d41/d73/d83/d94/d3a/d46/d6a/f7e [1043739,108656] 0 2024-04-26T21:08:06.930 INFO:tasks.workunit.client.1.smithi064.stdout:2/544: truncate d12/d41/d61/d75/f60 5053073 0 2024-04-26T21:08:06.932 INFO:tasks.workunit.client.0.smithi055.stdout:2/401: rename d4/d1e/d69/f85 to d4/db/d26/f8d 0 2024-04-26T21:08:06.932 INFO:tasks.workunit.client.0.smithi055.stdout:2/402: dread - d4/d49/f50 zero size 2024-04-26T21:08:06.932 INFO:tasks.workunit.client.0.smithi055.stdout:2/403: dread - d4/d49/f87 zero size 2024-04-26T21:08:06.936 INFO:tasks.workunit.client.1.smithi064.stdout:5/512: link dd/d12/d18/d1a/d1f/d20/f3b dd/d12/d18/d25/d32/fa4 0 2024-04-26T21:08:06.937 INFO:tasks.workunit.client.1.smithi064.stdout:5/513: read dd/d12/d18/d1a/d1f/d20/f3b [52029,45981] 0 2024-04-26T21:08:06.937 INFO:tasks.workunit.client.1.smithi064.stdout:7/532: getdents d6/db/d34 0 2024-04-26T21:08:06.940 INFO:tasks.workunit.client.1.smithi064.stdout:8/427: rename d10/d2f/d56/f6a to d10/d41/d53/f8b 0 2024-04-26T21:08:06.943 INFO:tasks.workunit.client.1.smithi064.stdout:6/500: symlink d4/d7/d12/d38/la1 0 2024-04-26T21:08:06.945 INFO:tasks.workunit.client.0.smithi055.stdout:7/340: creat d5/d6/d24/d48/d58/f5f x:0 0 0 2024-04-26T21:08:06.946 INFO:tasks.workunit.client.1.smithi064.stdout:3/504: dwrite d1/d27/d29/d5e/f6d [0,4194304] 0 2024-04-26T21:08:06.948 INFO:tasks.workunit.client.1.smithi064.stdout:1/637: mkdir d0/d6b/d9e/da2/dc9 0 2024-04-26T21:08:06.949 INFO:tasks.workunit.client.1.smithi064.stdout:0/500: dwrite dd/d10/d1a/d31/f37 [4194304,4194304] 0 2024-04-26T21:08:06.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/394: creat d9/d11/d59/f7f x:0 0 0 2024-04-26T21:08:06.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/395: chown d9/dc 0 1 2024-04-26T21:08:06.952 INFO:tasks.workunit.client.1.smithi064.stdout:5/514: mkdir dd/d12/d4f/da5 0 2024-04-26T21:08:06.953 INFO:tasks.workunit.client.1.smithi064.stdout:5/515: dread - dd/d12/d18/d33/d48/fa2 zero size 2024-04-26T21:08:06.955 INFO:tasks.workunit.client.0.smithi055.stdout:1/344: dwrite d8/df/d11/f37 [0,4194304] 0 2024-04-26T21:08:06.955 INFO:tasks.workunit.client.1.smithi064.stdout:4/589: dwrite d0/d5/d13/d6d/f64 [0,4194304] 0 2024-04-26T21:08:06.956 INFO:tasks.workunit.client.0.smithi055.stdout:8/302: rename d3/d9/d1d/c33 to d3/d9/d1d/d48/d4b/c64 0 2024-04-26T21:08:06.957 INFO:tasks.workunit.client.1.smithi064.stdout:8/428: rmdir d10/d41/d4e/d60 39 2024-04-26T21:08:06.961 INFO:tasks.workunit.client.0.smithi055.stdout:2/404: symlink d4/d1e/d2a/l8e 0 2024-04-26T21:08:06.961 INFO:tasks.workunit.client.0.smithi055.stdout:2/405: truncate d4/d14/d17/f2e 8501321 0 2024-04-26T21:08:06.963 INFO:tasks.workunit.client.1.smithi064.stdout:9/540: rename d0/f64 to d0/d4/da/faa 0 2024-04-26T21:08:06.966 INFO:tasks.workunit.client.1.smithi064.stdout:6/501: symlink d4/d7/d12/d49/d4b/d5a/la2 0 2024-04-26T21:08:06.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/396: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:08:06.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/397: write d9/f5a [1245991,109004] 0 2024-04-26T21:08:06.969 INFO:tasks.workunit.client.0.smithi055.stdout:6/349: rmdir d3/d17/d46/d54/d66/d6a/d51/d58 39 2024-04-26T21:08:06.974 INFO:tasks.workunit.client.1.smithi064.stdout:3/505: symlink d1/d27/d29/d6f/d72/da5/lb2 0 2024-04-26T21:08:06.979 INFO:tasks.workunit.client.0.smithi055.stdout:8/303: read f1 [3546639,78235] 0 2024-04-26T21:08:06.979 INFO:tasks.workunit.client.0.smithi055.stdout:8/304: truncate d3/d9/f2b 2843971 0 2024-04-26T21:08:06.983 INFO:tasks.workunit.client.0.smithi055.stdout:2/406: dread d4/dc/f71 [0,4194304] 0 2024-04-26T21:08:06.986 INFO:tasks.workunit.client.0.smithi055.stdout:1/345: rmdir d8/d17/d64 39 2024-04-26T21:08:06.986 INFO:tasks.workunit.client.0.smithi055.stdout:1/346: truncate d8/d17/d6a/f4c 1157414 0 2024-04-26T21:08:06.995 INFO:tasks.workunit.client.0.smithi055.stdout:6/350: dread f0 [0,4194304] 0 2024-04-26T21:08:06.995 INFO:tasks.workunit.client.0.smithi055.stdout:6/351: chown f1 98 1 2024-04-26T21:08:06.997 INFO:tasks.workunit.client.0.smithi055.stdout:8/305: dread d3/d9/d1f/f29 [0,4194304] 0 2024-04-26T21:08:07.000 INFO:tasks.workunit.client.1.smithi064.stdout:0/501: dwrite dd/d10/f9a [0,4194304] 0 2024-04-26T21:08:07.000 INFO:tasks.workunit.client.1.smithi064.stdout:0/502: creat dd/fac x:0 0 0 2024-04-26T21:08:07.001 INFO:tasks.workunit.client.0.smithi055.stdout:0/398: link d9/d27/c2f d9/d11/d59/d78/c80 0 2024-04-26T21:08:07.001 INFO:tasks.workunit.client.0.smithi055.stdout:0/399: chown d9/dc/d17/f1e 39184 1 2024-04-26T21:08:07.001 INFO:tasks.workunit.client.0.smithi055.stdout:4/263: sync 2024-04-26T21:08:07.002 INFO:tasks.workunit.client.0.smithi055.stdout:4/264: creat d4/d18/f5c x:0 0 0 2024-04-26T21:08:07.003 INFO:tasks.workunit.client.1.smithi064.stdout:2/545: rmdir d12/d41/d73/d83/d94 39 2024-04-26T21:08:07.003 INFO:tasks.workunit.client.1.smithi064.stdout:2/546: chown d12/d41/d73/d83/d94/l6f 146 1 2024-04-26T21:08:07.004 INFO:tasks.workunit.client.0.smithi055.stdout:5/260: sync 2024-04-26T21:08:07.005 INFO:tasks.workunit.client.0.smithi055.stdout:7/341: getdents d5/d6/d24/d3b 0 2024-04-26T21:08:07.014 INFO:tasks.workunit.client.1.smithi064.stdout:0/503: read dd/d10/d1a/d31/f7a [3815709,58441] 0 2024-04-26T21:08:07.014 INFO:tasks.workunit.client.1.smithi064.stdout:5/516: mkdir dd/d12/d18/d33/d48/d88/da6 0 2024-04-26T21:08:07.014 INFO:tasks.workunit.client.1.smithi064.stdout:5/517: chown dd/f11 391808 1 2024-04-26T21:08:07.015 INFO:tasks.workunit.client.1.smithi064.stdout:5/518: dread - dd/d12/d18/d25/d67/f94 zero size 2024-04-26T21:08:07.015 INFO:tasks.workunit.client.1.smithi064.stdout:5/519: write dd/d12/d18/d25/d32/f8c [369718,80767] 0 2024-04-26T21:08:07.015 INFO:tasks.workunit.client.0.smithi055.stdout:2/407: mkdir d4/db/d8f 0 2024-04-26T21:08:07.023 INFO:tasks.workunit.client.1.smithi064.stdout:2/547: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/f6d [4112720,106264] 0 2024-04-26T21:08:07.024 INFO:tasks.workunit.client.0.smithi055.stdout:6/352: rename d3/d17/d25/c35 to d3/d17/d46/d54/d66/d6a/d51/d58/c7d 0 2024-04-26T21:08:07.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/520: read dd/d12/d18/f2b [423719,52363] 0 2024-04-26T21:08:07.028 INFO:tasks.workunit.client.1.smithi064.stdout:4/590: getdents d0/d1d/d17/d44/d45 0 2024-04-26T21:08:07.028 INFO:tasks.workunit.client.1.smithi064.stdout:5/521: write dd/d12/d18/d33/d48/fa2 [1032961,68914] 0 2024-04-26T21:08:07.028 INFO:tasks.workunit.client.1.smithi064.stdout:4/591: write d0/d1d/d56/f8b [648924,59554] 0 2024-04-26T21:08:07.028 INFO:tasks.workunit.client.1.smithi064.stdout:5/522: truncate dd/d12/d18/d1a/d1f/f4b 311257 0 2024-04-26T21:08:07.028 INFO:tasks.workunit.client.1.smithi064.stdout:5/523: truncate dd/d12/f49 478339 0 2024-04-26T21:08:07.031 INFO:tasks.workunit.client.0.smithi055.stdout:8/306: creat d3/d9/d1d/f65 x:0 0 0 2024-04-26T21:08:07.031 INFO:tasks.workunit.client.0.smithi055.stdout:8/307: chown d3/d9/d1d/f25 4 1 2024-04-26T21:08:07.032 INFO:tasks.workunit.client.1.smithi064.stdout:8/429: creat d10/d41/d4e/d60/f8c x:0 0 0 2024-04-26T21:08:07.037 INFO:tasks.workunit.client.0.smithi055.stdout:4/265: creat d4/d26/d42/d28/f5d x:0 0 0 2024-04-26T21:08:07.037 INFO:tasks.workunit.client.0.smithi055.stdout:4/266: creat d4/d12/f5e x:0 0 0 2024-04-26T21:08:07.037 INFO:tasks.workunit.client.0.smithi055.stdout:4/267: chown d4/d26/d42/d28/c29 219 1 2024-04-26T21:08:07.037 INFO:tasks.workunit.client.0.smithi055.stdout:4/268: truncate d4/d26/d42/d2d/f59 59311 0 2024-04-26T21:08:07.038 INFO:tasks.workunit.client.1.smithi064.stdout:9/541: mknod d0/d4/da/d31/cab 0 2024-04-26T21:08:07.038 INFO:tasks.workunit.client.1.smithi064.stdout:9/542: truncate d0/d4/da/f57 4736367 0 2024-04-26T21:08:07.038 INFO:tasks.workunit.client.1.smithi064.stdout:9/543: truncate d0/d4/d28/d4f/f61 1690167 0 2024-04-26T21:08:07.039 INFO:tasks.workunit.client.1.smithi064.stdout:9/544: fdatasync d0/d4/da/d26/d5e/fa7 0 2024-04-26T21:08:07.045 INFO:tasks.workunit.client.0.smithi055.stdout:2/408: truncate d4/db/d1f/d46/f64 1815005 0 2024-04-26T21:08:07.046 INFO:tasks.workunit.client.0.smithi055.stdout:2/409: stat d4/d14/d17/d36/c3c 0 2024-04-26T21:08:07.048 INFO:tasks.workunit.client.1.smithi064.stdout:6/502: link d4/l7c d4/d99/la3 0 2024-04-26T21:08:07.048 INFO:tasks.workunit.client.1.smithi064.stdout:6/503: truncate d4/d7/f62 1737680 0 2024-04-26T21:08:07.057 INFO:tasks.workunit.client.0.smithi055.stdout:0/400: rename d9/dc/d19/l22 to d9/d11/d5b/d74/l81 0 2024-04-26T21:08:07.065 INFO:tasks.workunit.client.0.smithi055.stdout:6/353: dread d3/d17/d46/d54/d66/d6a/d51/f74 [0,4194304] 0 2024-04-26T21:08:07.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/308: symlink d3/d9/d1d/d48/d4b/l66 0 2024-04-26T21:08:07.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/309: write d3/d9/d1d/f25 [744572,106755] 0 2024-04-26T21:08:07.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/310: chown d3/d9/d1d/c3a 0 1 2024-04-26T21:08:07.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/311: creat d3/d9/d44/f67 x:0 0 0 2024-04-26T21:08:07.067 INFO:tasks.workunit.client.1.smithi064.stdout:3/506: dwrite d1/d27/d29/d6f/f86 [0,4194304] 0 2024-04-26T21:08:07.070 INFO:tasks.workunit.client.0.smithi055.stdout:9/373: dwrite d2/d14/f4f [4194304,4194304] 0 2024-04-26T21:08:07.077 INFO:tasks.workunit.client.0.smithi055.stdout:5/261: dwrite d4/d15/f1a [0,4194304] 0 2024-04-26T21:08:07.078 INFO:tasks.workunit.client.0.smithi055.stdout:9/374: dread d2/f3f [4194304,4194304] 0 2024-04-26T21:08:07.078 INFO:tasks.workunit.client.0.smithi055.stdout:9/375: dread - d2/f53 zero size 2024-04-26T21:08:07.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/548: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f [0,4194304] 0 2024-04-26T21:08:07.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/549: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/l38 0 2024-04-26T21:08:07.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/550: write d12/f34 [924158,127228] 0 2024-04-26T21:08:07.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/551: write d12/d41/d61/d75/f2c [718044,68861] 0 2024-04-26T21:08:07.083 INFO:tasks.workunit.client.0.smithi055.stdout:4/269: mknod d4/d12/d17/c5f 0 2024-04-26T21:08:07.087 INFO:tasks.workunit.client.0.smithi055.stdout:2/410: mkdir d4/d1e/d90 0 2024-04-26T21:08:07.090 INFO:tasks.workunit.client.1.smithi064.stdout:2/552: dread d12/d41/d73/d83/d94/f37 [0,4194304] 0 2024-04-26T21:08:07.093 INFO:tasks.workunit.client.0.smithi055.stdout:6/354: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e 0 2024-04-26T21:08:07.103 INFO:tasks.workunit.client.0.smithi055.stdout:8/312: rename d3/d9/c16 to d3/d9/d1d/d48/d57/c68 0 2024-04-26T21:08:07.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/504: mkdir dd/d10/d1a/d31/d47/dad 0 2024-04-26T21:08:07.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/505: chown dd/d10 5460379 1 2024-04-26T21:08:07.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/506: fdatasync dd/d10/d1a/d31/d47/d61/d42/f5b 0 2024-04-26T21:08:07.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/507: truncate dd/d10/d1a/d31/d47/d61/d42/f51 732304 0 2024-04-26T21:08:07.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/508: creat dd/d10/d74/fae x:0 0 0 2024-04-26T21:08:07.107 INFO:tasks.workunit.client.1.smithi064.stdout:4/592: symlink d0/d5/d13/d6d/lbf 0 2024-04-26T21:08:07.108 INFO:tasks.workunit.client.1.smithi064.stdout:4/593: fdatasync d0/d1d/d17/d44/dac/f67 0 2024-04-26T21:08:07.110 INFO:tasks.workunit.client.1.smithi064.stdout:2/553: dread d12/d41/d73/d83/d94/d3a/f58 [0,4194304] 0 2024-04-26T21:08:07.112 INFO:tasks.workunit.client.1.smithi064.stdout:5/524: creat dd/d12/d4f/da5/fa7 x:0 0 0 2024-04-26T21:08:07.114 INFO:tasks.workunit.client.0.smithi055.stdout:4/270: mknod d4/d18/c60 0 2024-04-26T21:08:07.116 INFO:tasks.workunit.client.1.smithi064.stdout:8/430: symlink d10/d41/d4e/d59/d5d/l8d 0 2024-04-26T21:08:07.116 INFO:tasks.workunit.client.0.smithi055.stdout:7/342: dwrite d5/d6/d24/f38 [0,4194304] 0 2024-04-26T21:08:07.117 INFO:tasks.workunit.client.1.smithi064.stdout:9/545: creat d0/d4/d7/df/fac x:0 0 0 2024-04-26T21:08:07.127 INFO:tasks.workunit.client.1.smithi064.stdout:6/504: link d4/d7/d12/d49/d4b/d56/f70 d4/d99/fa4 0 2024-04-26T21:08:07.128 INFO:tasks.workunit.client.0.smithi055.stdout:5/262: write d4/fd [2425377,36704] 0 2024-04-26T21:08:07.128 INFO:tasks.workunit.client.0.smithi055.stdout:5/263: read d4/f9 [3958231,36772] 0 2024-04-26T21:08:07.135 INFO:tasks.workunit.client.1.smithi064.stdout:6/505: dread d4/d7/fd [0,4194304] 0 2024-04-26T21:08:07.137 INFO:tasks.workunit.client.1.smithi064.stdout:3/507: rmdir d1/d27/d50/d35/d4c 39 2024-04-26T21:08:07.137 INFO:tasks.workunit.client.1.smithi064.stdout:3/508: fsync d1/d27/d29/d5e/f6d 0 2024-04-26T21:08:07.139 INFO:tasks.workunit.client.1.smithi064.stdout:8/431: dread d10/f4d [0,4194304] 0 2024-04-26T21:08:07.140 INFO:tasks.workunit.client.0.smithi055.stdout:2/411: dread d4/db/d26/f4d [0,4194304] 0 2024-04-26T21:08:07.154 INFO:tasks.workunit.client.0.smithi055.stdout:6/355: creat d3/d17/d46/f7f x:0 0 0 2024-04-26T21:08:07.154 INFO:tasks.workunit.client.0.smithi055.stdout:8/313: mknod d3/d9/d1f/d2e/c69 0 2024-04-26T21:08:07.157 INFO:tasks.workunit.client.0.smithi055.stdout:4/271: mkdir d4/d12/d61 0 2024-04-26T21:08:07.158 INFO:tasks.workunit.client.0.smithi055.stdout:4/272: creat d4/d12/d17/f62 x:0 0 0 2024-04-26T21:08:07.158 INFO:tasks.workunit.client.0.smithi055.stdout:7/343: creat d5/d6/d24/d4d/f60 x:0 0 0 2024-04-26T21:08:07.164 INFO:tasks.workunit.client.0.smithi055.stdout:2/412: creat d4/db/d56/d4a/d7e/f91 x:0 0 0 2024-04-26T21:08:07.171 INFO:tasks.workunit.client.0.smithi055.stdout:4/273: unlink d4/ld 0 2024-04-26T21:08:07.171 INFO:tasks.workunit.client.0.smithi055.stdout:4/274: stat c2 0 2024-04-26T21:08:07.172 INFO:tasks.workunit.client.0.smithi055.stdout:4/275: truncate d4/d12/f5e 133967 0 2024-04-26T21:08:07.177 INFO:tasks.workunit.client.1.smithi064.stdout:0/509: creat dd/d10/d1a/d31/d47/dad/faf x:0 0 0 2024-04-26T21:08:07.177 INFO:tasks.workunit.client.0.smithi055.stdout:1/347: dwrite d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:07.178 INFO:tasks.workunit.client.0.smithi055.stdout:1/348: fsync d8/f12 0 2024-04-26T21:08:07.178 INFO:tasks.workunit.client.1.smithi064.stdout:4/594: getdents d0/d1d/d17/d44/d45/da0 0 2024-04-26T21:08:07.178 INFO:tasks.workunit.client.1.smithi064.stdout:2/554: rmdir d12/d41/d73 39 2024-04-26T21:08:07.179 INFO:tasks.workunit.client.1.smithi064.stdout:5/525: symlink dd/la8 0 2024-04-26T21:08:07.180 INFO:tasks.workunit.client.1.smithi064.stdout:5/526: stat dd/d12/d18/d25/d74/c7d 0 2024-04-26T21:08:07.180 INFO:tasks.workunit.client.0.smithi055.stdout:9/376: dwrite d2/d14/f21 [0,4194304] 0 2024-04-26T21:08:07.185 INFO:tasks.workunit.client.1.smithi064.stdout:0/510: readlink dd/d21/l4d 0 2024-04-26T21:08:07.186 INFO:tasks.workunit.client.0.smithi055.stdout:7/344: mknod d5/d6/d24/d52/c61 0 2024-04-26T21:08:07.186 INFO:tasks.workunit.client.0.smithi055.stdout:7/345: dread - d5/d6/f41 zero size 2024-04-26T21:08:07.188 INFO:tasks.workunit.client.1.smithi064.stdout:4/595: rmdir d0/d1d/d17/d9b/db6 0 2024-04-26T21:08:07.188 INFO:tasks.workunit.client.1.smithi064.stdout:4/596: truncate d0/d1d/d17/fab 399618 0 2024-04-26T21:08:07.189 INFO:tasks.workunit.client.1.smithi064.stdout:2/555: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/f77 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc 0 2024-04-26T21:08:07.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/556: creat d12/d41/d61/fbd x:0 0 0 2024-04-26T21:08:07.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/557: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/lb3 0 2024-04-26T21:08:07.190 INFO:tasks.workunit.client.1.smithi064.stdout:8/432: getdents d10 0 2024-04-26T21:08:07.194 INFO:tasks.workunit.client.1.smithi064.stdout:4/597: creat d0/d1d/d17/d44/d45/fc0 x:0 0 0 2024-04-26T21:08:07.203 INFO:tasks.workunit.client.1.smithi064.stdout:2/558: unlink d12/d41/d73/d83/d94/d3a/d46/d6a/l7c 0 2024-04-26T21:08:07.203 INFO:tasks.workunit.client.1.smithi064.stdout:8/433: creat d10/d2f/f8e x:0 0 0 2024-04-26T21:08:07.203 INFO:tasks.workunit.client.1.smithi064.stdout:8/434: write d10/d2f/d61/f88 [632297,1069] 0 2024-04-26T21:08:07.217 INFO:tasks.workunit.client.0.smithi055.stdout:4/276: dread d4/d26/d42/d28/f32 [0,4194304] 0 2024-04-26T21:08:07.233 INFO:tasks.workunit.client.0.smithi055.stdout:2/413: dread d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:07.233 INFO:tasks.workunit.client.0.smithi055.stdout:2/414: truncate d4/db/d1f/f29 1309164 0 2024-04-26T21:08:07.233 INFO:tasks.workunit.client.0.smithi055.stdout:2/415: chown d4/d14/d17/f5d 11929962 1 2024-04-26T21:08:07.237 INFO:tasks.workunit.client.1.smithi064.stdout:3/509: dwrite d1/d27/d29/d6f/d72/da5/fae [0,4194304] 0 2024-04-26T21:08:07.244 INFO:tasks.workunit.client.1.smithi064.stdout:4/598: dread d0/d5/d13/fa4 [0,4194304] 0 2024-04-26T21:08:07.249 INFO:tasks.workunit.client.0.smithi055.stdout:9/377: dread d2/d11/f1f [0,4194304] 0 2024-04-26T21:08:07.250 INFO:tasks.workunit.client.0.smithi055.stdout:4/277: symlink d4/d12/l63 0 2024-04-26T21:08:07.252 INFO:tasks.workunit.client.0.smithi055.stdout:8/314: dwrite d3/d9/fe [4194304,4194304] 0 2024-04-26T21:08:07.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/559: truncate d12/d41/d61/d75/f60 5488257 0 2024-04-26T21:08:07.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/560: write d12/d41/d61/d75/f42 [4344324,109777] 0 2024-04-26T21:08:07.264 INFO:tasks.workunit.client.0.smithi055.stdout:2/416: truncate d4/db/d56/f7c 3591175 0 2024-04-26T21:08:07.264 INFO:tasks.workunit.client.0.smithi055.stdout:2/417: write d4/d14/d17/d36/f84 [452737,9822] 0 2024-04-26T21:08:07.266 INFO:tasks.workunit.client.0.smithi055.stdout:6/356: dwrite d3/d17/d46/d54/f5e [0,4194304] 0 2024-04-26T21:08:07.268 INFO:tasks.workunit.client.1.smithi064.stdout:2/561: write d12/d41/d73/d83/d94/d3a/d46/d6a/f7e [512984,35822] 0 2024-04-26T21:08:07.269 INFO:tasks.workunit.client.0.smithi055.stdout:4/278: symlink d4/l64 0 2024-04-26T21:08:07.269 INFO:tasks.workunit.client.0.smithi055.stdout:4/279: read - d4/d12/d17/d3d/f45 zero size 2024-04-26T21:08:07.270 INFO:tasks.workunit.client.0.smithi055.stdout:4/280: write d4/f1d [1709727,36796] 0 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:1/349: dwrite d8/df/f24 [0,4194304] 0 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:1/350: read - d8/df/f5c zero size 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:1/351: chown d8/d17/d36/l38 308430 1 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:5/264: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:8/315: creat d3/d9/d1f/d5a/f6a x:0 0 0 2024-04-26T21:08:07.276 INFO:tasks.workunit.client.0.smithi055.stdout:5/265: write d4/df/d13/d26/f32 [434088,50241] 0 2024-04-26T21:08:07.277 INFO:tasks.workunit.client.1.smithi064.stdout:0/511: dwrite dd/d10/d18/f49 [4194304,4194304] 0 2024-04-26T21:08:07.277 INFO:tasks.workunit.client.1.smithi064.stdout:0/512: chown dd/d10/d1a/d31/d47/d61/c5d 7832 1 2024-04-26T21:08:07.277 INFO:tasks.workunit.client.1.smithi064.stdout:0/513: fsync fc 0 2024-04-26T21:08:07.277 INFO:tasks.workunit.client.1.smithi064.stdout:0/514: fsync dd/d10/f84 0 2024-04-26T21:08:07.278 INFO:tasks.workunit.client.0.smithi055.stdout:2/418: getdents d4/d55 0 2024-04-26T21:08:07.278 INFO:tasks.workunit.client.0.smithi055.stdout:2/419: creat d4/d1e/f92 x:0 0 0 2024-04-26T21:08:07.280 INFO:tasks.workunit.client.1.smithi064.stdout:3/510: rmdir d1/d27/d29/d6f/d72 39 2024-04-26T21:08:07.280 INFO:tasks.workunit.client.1.smithi064.stdout:4/599: creat d0/d2f/d7d/fc1 x:0 0 0 2024-04-26T21:08:07.284 INFO:tasks.workunit.client.1.smithi064.stdout:7/533: sync 2024-04-26T21:08:07.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/638: sync 2024-04-26T21:08:07.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/639: stat d0/d6/d11/d1e/d2a/d34 0 2024-04-26T21:08:07.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/640: write d0/f12 [41028,106854] 0 2024-04-26T21:08:07.287 INFO:tasks.workunit.client.0.smithi055.stdout:7/346: dwrite d5/d11/f1a [12582912,4194304] 0 2024-04-26T21:08:07.287 INFO:tasks.workunit.client.0.smithi055.stdout:7/347: read - d5/d6/f41 zero size 2024-04-26T21:08:07.288 INFO:tasks.workunit.client.1.smithi064.stdout:5/527: rename dd/d12/d18/d33 to dd/da9 0 2024-04-26T21:08:07.291 INFO:tasks.workunit.client.0.smithi055.stdout:6/357: dread d3/d17/d25/f2b [0,4194304] 0 2024-04-26T21:08:07.293 INFO:tasks.workunit.client.1.smithi064.stdout:2/562: rmdir d12/d41/d73/d83/d94 39 2024-04-26T21:08:07.295 INFO:tasks.workunit.client.0.smithi055.stdout:4/281: mknod d4/d18/d1a/d49/c65 0 2024-04-26T21:08:07.295 INFO:tasks.workunit.client.0.smithi055.stdout:4/282: creat d4/f66 x:0 0 0 2024-04-26T21:08:07.297 INFO:tasks.workunit.client.1.smithi064.stdout:0/515: dread dd/f30 [0,4194304] 0 2024-04-26T21:08:07.297 INFO:tasks.workunit.client.1.smithi064.stdout:0/516: chown dd/d10/d1a/d31/d47 10 1 2024-04-26T21:08:07.297 INFO:tasks.workunit.client.1.smithi064.stdout:0/517: fsync dd/d10/d1a/f2f 0 2024-04-26T21:08:07.300 INFO:tasks.workunit.client.0.smithi055.stdout:2/420: dread d4/d14/d17/d36/f4e [0,4194304] 0 2024-04-26T21:08:07.301 INFO:tasks.workunit.client.0.smithi055.stdout:2/421: dread - d4/d14/d17/d6d/f77 zero size 2024-04-26T21:08:07.303 INFO:tasks.workunit.client.0.smithi055.stdout:9/378: dwrite d2/f5a [0,4194304] 0 2024-04-26T21:08:07.307 INFO:tasks.workunit.client.0.smithi055.stdout:6/358: dread d3/d17/d19/d71/f44 [0,4194304] 0 2024-04-26T21:08:07.308 INFO:tasks.workunit.client.0.smithi055.stdout:6/359: chown d3/d17/d19/f49 1297188347 1 2024-04-26T21:08:07.308 INFO:tasks.workunit.client.0.smithi055.stdout:6/360: fdatasync d3/d17/d46/d54/d66/d6a/f56 0 2024-04-26T21:08:07.308 INFO:tasks.workunit.client.0.smithi055.stdout:6/361: fdatasync d3/d4f/f69 0 2024-04-26T21:08:07.317 INFO:tasks.workunit.client.0.smithi055.stdout:1/352: creat d8/d17/f77 x:0 0 0 2024-04-26T21:08:07.320 INFO:tasks.workunit.client.0.smithi055.stdout:9/379: dread d2/d14/f21 [0,4194304] 0 2024-04-26T21:08:07.322 INFO:tasks.workunit.client.0.smithi055.stdout:8/316: creat d3/d9/d1d/d48/d4b/f6b x:0 0 0 2024-04-26T21:08:07.322 INFO:tasks.workunit.client.0.smithi055.stdout:8/317: readlink d3/d9/d1d/d48/d4b/l66 0 2024-04-26T21:08:07.322 INFO:tasks.workunit.client.0.smithi055.stdout:8/318: chown d3/d9/d1f/c60 35 1 2024-04-26T21:08:07.322 INFO:tasks.workunit.client.0.smithi055.stdout:8/319: chown d3/d9/f2d 269 1 2024-04-26T21:08:07.326 INFO:tasks.workunit.client.0.smithi055.stdout:3/423: sync 2024-04-26T21:08:07.331 INFO:tasks.workunit.client.0.smithi055.stdout:5/266: creat d4/df/d13/d26/d3c/d4a/f56 x:0 0 0 2024-04-26T21:08:07.331 INFO:tasks.workunit.client.0.smithi055.stdout:5/267: write d4/fd [2578684,81017] 0 2024-04-26T21:08:07.331 INFO:tasks.workunit.client.0.smithi055.stdout:5/268: fsync d4/f9 0 2024-04-26T21:08:07.331 INFO:tasks.workunit.client.0.smithi055.stdout:5/269: stat d4/df/d13/d26/d3c/d4a/f56 0 2024-04-26T21:08:07.337 INFO:tasks.workunit.client.1.smithi064.stdout:3/511: mknod d1/d27/d29/d6f/d72/d7a/cb3 0 2024-04-26T21:08:07.346 INFO:tasks.workunit.client.1.smithi064.stdout:4/600: mknod d0/d1d/d17/d44/cc2 0 2024-04-26T21:08:07.348 INFO:tasks.workunit.client.0.smithi055.stdout:3/424: write d0/d4/d5/d73/d47/d37/d3d/d4c/f63 [4183746,98339] 0 2024-04-26T21:08:07.350 INFO:tasks.workunit.client.0.smithi055.stdout:7/348: dwrite d5/d6/f4c [0,4194304] 0 2024-04-26T21:08:07.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/534: mkdir d6/db/d1f/d50/db8 0 2024-04-26T21:08:07.363 INFO:tasks.workunit.client.1.smithi064.stdout:1/641: creat d0/d6/d29/fca x:0 0 0 2024-04-26T21:08:07.377 INFO:tasks.workunit.client.1.smithi064.stdout:8/435: rename d10/d41/d44/c50 to d10/d41/d4e/d59/d83/c8f 0 2024-04-26T21:08:07.377 INFO:tasks.workunit.client.1.smithi064.stdout:8/436: dread - d10/d41/d4e/d59/d5d/f63 zero size 2024-04-26T21:08:07.381 INFO:tasks.workunit.client.1.smithi064.stdout:5/528: mkdir dd/da9/d48/d56/daa 0 2024-04-26T21:08:07.395 INFO:tasks.workunit.client.1.smithi064.stdout:4/601: mknod d0/d2f/d69/db5/dba/cc3 0 2024-04-26T21:08:07.395 INFO:tasks.workunit.client.1.smithi064.stdout:4/602: chown d0/d2f/d69/db5 0 1 2024-04-26T21:08:07.402 INFO:tasks.workunit.client.1.smithi064.stdout:7/535: mkdir d6/d15/d67/d65/db9 0 2024-04-26T21:08:07.404 INFO:tasks.workunit.client.1.smithi064.stdout:1/642: symlink d0/d6/d11/d1e/d2a/lcb 0 2024-04-26T21:08:07.405 INFO:tasks.workunit.client.0.smithi055.stdout:4/283: unlink c2 0 2024-04-26T21:08:07.405 INFO:tasks.workunit.client.0.smithi055.stdout:4/284: creat d4/d12/d15/f67 x:0 0 0 2024-04-26T21:08:07.406 INFO:tasks.workunit.client.0.smithi055.stdout:4/285: dread - d4/d12/d17/f62 zero size 2024-04-26T21:08:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:07 smithi064 ceph-mon[33404]: pgmap v36: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 265 op/s 2024-04-26T21:08:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:07 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:07 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:07.409 INFO:tasks.workunit.client.1.smithi064.stdout:2/563: rename d12/d41/d73/d83/d94/d3a/d46/d6a/f89 to d12/d41/d73/d83/d94/d3a/d46/d48/fbe 0 2024-04-26T21:08:07.409 INFO:tasks.workunit.client.0.smithi055.stdout:2/422: unlink d4/db/d56/d4a/d7e/c8c 0 2024-04-26T21:08:07.410 INFO:tasks.workunit.client.0.smithi055.stdout:2/423: creat d4/db/d56/d4a/d7e/f93 x:0 0 0 2024-04-26T21:08:07.410 INFO:tasks.workunit.client.0.smithi055.stdout:2/424: write d4/d14/d17/d36/f84 [1318541,80036] 0 2024-04-26T21:08:07.411 INFO:tasks.workunit.client.1.smithi064.stdout:8/437: mkdir d10/d2f/d90 0 2024-04-26T21:08:07.414 INFO:tasks.workunit.client.1.smithi064.stdout:5/529: creat dd/da9/d48/d6a/d81/fab x:0 0 0 2024-04-26T21:08:07.415 INFO:tasks.workunit.client.1.smithi064.stdout:4/603: truncate d0/d1d/d21/f4e 681153 0 2024-04-26T21:08:07.416 INFO:tasks.workunit.client.0.smithi055.stdout:8/320: dwrite d3/d9/d1f/d5a/f6a [0,4194304] 0 2024-04-26T21:08:07.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/321: fsync d3/d9/d1f/f5d 0 2024-04-26T21:08:07.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/322: chown d3/d9/d1f/d2e/f56 29227 1 2024-04-26T21:08:07.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/323: write d3/d9/d1d/f25 [8537382,40755] 0 2024-04-26T21:08:07.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/324: creat d3/d9/d1f/d5a/f6c x:0 0 0 2024-04-26T21:08:07.417 INFO:tasks.workunit.client.1.smithi064.stdout:9/546: sync 2024-04-26T21:08:07.418 INFO:tasks.workunit.client.1.smithi064.stdout:6/506: sync 2024-04-26T21:08:07.418 INFO:tasks.workunit.client.1.smithi064.stdout:9/547: chown d0/d4/da/c78 21236378 1 2024-04-26T21:08:07.418 INFO:tasks.workunit.client.1.smithi064.stdout:9/548: stat d0/d4/da/d26/d47/l6c 0 2024-04-26T21:08:07.418 INFO:tasks.workunit.client.1.smithi064.stdout:9/549: chown d0/d4/da/d26/d45/f9a 298 1 2024-04-26T21:08:07.421 INFO:tasks.workunit.client.0.smithi055.stdout:9/380: mknod d2/d46/d77/d5f/c7c 0 2024-04-26T21:08:07.421 INFO:tasks.workunit.client.0.smithi055.stdout:9/381: stat d2/d46/d77/d5f 0 2024-04-26T21:08:07.433 INFO:tasks.workunit.client.0.smithi055.stdout:5/270: rename d4/d15/f24 to d4/df/d13/d26/d3c/d4a/f57 0 2024-04-26T21:08:07.433 INFO:tasks.workunit.client.0.smithi055.stdout:5/271: creat d4/df/d13/d26/f58 x:0 0 0 2024-04-26T21:08:07.435 INFO:tasks.workunit.client.1.smithi064.stdout:0/518: rename dd/d10/d1a/d31/d47/d61/d42/f5b to dd/d10/d18/d64/fb0 0 2024-04-26T21:08:07.437 INFO:tasks.workunit.client.0.smithi055.stdout:3/425: dwrite d0/d4/f64 [0,4194304] 0 2024-04-26T21:08:07.439 INFO:tasks.workunit.client.1.smithi064.stdout:2/564: unlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/l39 0 2024-04-26T21:08:07.442 INFO:tasks.workunit.client.1.smithi064.stdout:8/438: symlink d10/d41/d4e/l91 0 2024-04-26T21:08:07.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/349: mknod d5/d6/d24/d52/c62 0 2024-04-26T21:08:07.445 INFO:tasks.workunit.client.1.smithi064.stdout:5/530: rename dd/da9/d48/d88 to dd/da9/d48/dac 0 2024-04-26T21:08:07.451 INFO:tasks.workunit.client.1.smithi064.stdout:6/507: unlink d4/d7/d12/d49/d4b/c58 0 2024-04-26T21:08:07.452 INFO:tasks.workunit.client.1.smithi064.stdout:6/508: stat d4/d7/d12/d1e/l37 0 2024-04-26T21:08:07.454 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:07 smithi055 ceph-mon[25475]: pgmap v36: 65 pgs: 65 active+clean; 1.3 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 178 MiB/s wr, 265 op/s 2024-04-26T21:08:07.454 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:07 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:07.454 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:07 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:07.455 INFO:tasks.workunit.client.0.smithi055.stdout:0/401: sync 2024-04-26T21:08:07.455 INFO:tasks.workunit.client.0.smithi055.stdout:0/402: chown d9/l14 36803103 1 2024-04-26T21:08:07.461 INFO:tasks.workunit.client.1.smithi064.stdout:1/643: rmdir d0/d6b/d9e/da2 39 2024-04-26T21:08:07.464 INFO:tasks.workunit.client.0.smithi055.stdout:2/425: link d4/d49/f87 d4/d55/d6c/f94 0 2024-04-26T21:08:07.465 INFO:tasks.workunit.client.0.smithi055.stdout:2/426: read d4/f5 [1683277,126362] 0 2024-04-26T21:08:07.465 INFO:tasks.workunit.client.0.smithi055.stdout:2/427: fsync d4/d1e/d2a/f62 0 2024-04-26T21:08:07.466 INFO:tasks.workunit.client.1.smithi064.stdout:4/604: dwrite d0/d1d/d17/d44/dac/d54/fbb [0,4194304] 0 2024-04-26T21:08:07.466 INFO:tasks.workunit.client.1.smithi064.stdout:4/605: truncate d0/d1d/d21/f62 4286056 0 2024-04-26T21:08:07.467 INFO:tasks.workunit.client.1.smithi064.stdout:4/606: write d0/d5/d13/d6d/d97/f81 [4967232,56950] 0 2024-04-26T21:08:07.467 INFO:tasks.workunit.client.1.smithi064.stdout:3/512: rename d1/d27/d29/c45 to d1/d27/d50/d35/d4c/d55/cb4 0 2024-04-26T21:08:07.468 INFO:tasks.workunit.client.1.smithi064.stdout:0/519: mkdir dd/d10/d74/d1d/db1 0 2024-04-26T21:08:07.468 INFO:tasks.workunit.client.0.smithi055.stdout:0/403: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:07.469 INFO:tasks.workunit.client.0.smithi055.stdout:0/404: write d9/dc/d17/f3a [1009073,46547] 0 2024-04-26T21:08:07.469 INFO:tasks.workunit.client.0.smithi055.stdout:1/353: mknod d8/d17/c78 0 2024-04-26T21:08:07.470 INFO:tasks.workunit.client.1.smithi064.stdout:2/565: link d12/c2e d12/d41/d73/d83/d94/d3a/d46/d48/d85/cbf 0 2024-04-26T21:08:07.470 INFO:tasks.workunit.client.1.smithi064.stdout:2/566: write d12/d41/d61/d75/f93 [783350,83372] 0 2024-04-26T21:08:07.471 INFO:tasks.workunit.client.1.smithi064.stdout:9/550: write d0/d4/d7/df/f3a [2054175,95763] 0 2024-04-26T21:08:07.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/439: getdents d10/d41/d4e/d59/d83 0 2024-04-26T21:08:07.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/440: chown d10/d41/d44/d5a/f62 4 1 2024-04-26T21:08:07.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/441: readlink d10/d41/d4e/l40 0 2024-04-26T21:08:07.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/442: chown d10/d1d/d38/l82 35858127 1 2024-04-26T21:08:07.475 INFO:tasks.workunit.client.1.smithi064.stdout:6/509: mknod d4/d7/d12/d49/d4b/d5a/d79/d9b/ca5 0 2024-04-26T21:08:07.479 INFO:tasks.workunit.client.0.smithi055.stdout:4/286: dwrite d4/d12/d15/f39 [0,4194304] 0 2024-04-26T21:08:07.482 INFO:tasks.workunit.client.0.smithi055.stdout:9/382: mkdir d2/d46/d77/d7d 0 2024-04-26T21:08:07.482 INFO:tasks.workunit.client.0.smithi055.stdout:9/383: fdatasync d2/f55 0 2024-04-26T21:08:07.483 INFO:tasks.workunit.client.1.smithi064.stdout:1/644: dread d0/d6/d11/d1e/f54 [0,4194304] 0 2024-04-26T21:08:07.483 INFO:tasks.workunit.client.1.smithi064.stdout:1/645: stat d0/d6/d29/d31/c95 0 2024-04-26T21:08:07.483 INFO:tasks.workunit.client.1.smithi064.stdout:1/646: truncate d0/d6/d11/fa5 299996 0 2024-04-26T21:08:07.483 INFO:tasks.workunit.client.1.smithi064.stdout:1/647: write d0/d6/d11/d1e/d27/f65 [1868304,116815] 0 2024-04-26T21:08:07.493 INFO:tasks.workunit.client.1.smithi064.stdout:4/607: mknod d0/d1d/d17/d44/d45/da0/cc4 0 2024-04-26T21:08:07.493 INFO:tasks.workunit.client.1.smithi064.stdout:4/608: chown d0/d5/d13/d33 73513 1 2024-04-26T21:08:07.496 INFO:tasks.workunit.client.0.smithi055.stdout:5/272: symlink d4/df/d13/d26/d3c/d4a/l59 0 2024-04-26T21:08:07.496 INFO:tasks.workunit.client.0.smithi055.stdout:4/287: write d4/f9 [2776489,16442] 0 2024-04-26T21:08:07.496 INFO:tasks.workunit.client.0.smithi055.stdout:4/288: creat d4/d12/d17/d3d/f68 x:0 0 0 2024-04-26T21:08:07.500 INFO:tasks.workunit.client.1.smithi064.stdout:7/536: rename d6/d15/d67/d4d/f6a to d6/d9/d3d/fba 0 2024-04-26T21:08:07.500 INFO:tasks.workunit.client.1.smithi064.stdout:7/537: fsync d6/d8c/f9c 0 2024-04-26T21:08:07.502 INFO:tasks.workunit.client.1.smithi064.stdout:3/513: link d1/d27/d50/f21 d1/d27/d29/d6f/d72/fb5 0 2024-04-26T21:08:07.502 INFO:tasks.workunit.client.1.smithi064.stdout:3/514: chown d1/d27/d29/d5e/f76 6309 1 2024-04-26T21:08:07.514 INFO:tasks.workunit.client.1.smithi064.stdout:0/520: truncate dd/d10/f9a 1223391 0 2024-04-26T21:08:07.516 INFO:tasks.workunit.client.0.smithi055.stdout:3/426: creat d0/d4/d5/d73/d13/d1a/d46/d72/d69/f99 x:0 0 0 2024-04-26T21:08:07.516 INFO:tasks.workunit.client.0.smithi055.stdout:3/427: write d0/d4/d16/f26 [4575094,124852] 0 2024-04-26T21:08:07.518 INFO:tasks.workunit.client.0.smithi055.stdout:7/350: truncate d5/d6/d24/f4b 248095 0 2024-04-26T21:08:07.518 INFO:tasks.workunit.client.0.smithi055.stdout:7/351: truncate d5/d6/d24/d4d/f55 927939 0 2024-04-26T21:08:07.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/567: getdents d12/d41/d73/d83/d94/d3a/d46/d91/d96 0 2024-04-26T21:08:07.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/568: truncate d12/d41/d61/d75/f93 1301450 0 2024-04-26T21:08:07.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/569: write d12/f34 [1432712,127860] 0 2024-04-26T21:08:07.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/570: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l59 2 1 2024-04-26T21:08:07.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/571: readlink d12/d41/d73/d83/d94/l4f 0 2024-04-26T21:08:07.537 INFO:tasks.workunit.client.0.smithi055.stdout:2/428: creat d4/d49/d4c/d5e/f95 x:0 0 0 2024-04-26T21:08:07.543 INFO:tasks.workunit.client.0.smithi055.stdout:1/354: fdatasync d8/d17/d1b/f62 0 2024-04-26T21:08:07.543 INFO:tasks.workunit.client.0.smithi055.stdout:1/355: read - d8/df/d11/d27/d28/d2a/f58 zero size 2024-04-26T21:08:07.553 INFO:tasks.workunit.client.1.smithi064.stdout:7/538: read d6/db/d1f/f6c [541508,62770] 0 2024-04-26T21:08:07.555 INFO:tasks.workunit.client.1.smithi064.stdout:6/510: dwrite d4/d7/d33/f50 [0,4194304] 0 2024-04-26T21:08:07.556 INFO:tasks.workunit.client.0.smithi055.stdout:0/405: mkdir d9/dc/d1c/d54/d4b/d68/d82 0 2024-04-26T21:08:07.566 INFO:tasks.workunit.client.0.smithi055.stdout:2/429: write d4/db/d56/f7c [83318,61976] 0 2024-04-26T21:08:07.566 INFO:tasks.workunit.client.1.smithi064.stdout:1/648: creat d0/d6/d11/d1e/d2a/fcc x:0 0 0 2024-04-26T21:08:07.572 INFO:tasks.workunit.client.0.smithi055.stdout:9/384: truncate d2/d46/d77/f62 4113357 0 2024-04-26T21:08:07.572 INFO:tasks.workunit.client.0.smithi055.stdout:9/385: fdatasync d2/f5a 0 2024-04-26T21:08:07.573 INFO:tasks.workunit.client.0.smithi055.stdout:9/386: write d2/d14/f59 [868811,5555] 0 2024-04-26T21:08:07.579 INFO:tasks.workunit.client.1.smithi064.stdout:4/609: link d0/d1d/d17/d44/d45/da0/cc4 d0/d5/d79/da1/cc5 0 2024-04-26T21:08:07.581 INFO:tasks.workunit.client.1.smithi064.stdout:3/515: dwrite d1/d14/f1c [0,4194304] 0 2024-04-26T21:08:07.583 INFO:tasks.workunit.client.1.smithi064.stdout:6/511: read d4/f16 [5123328,60282] 0 2024-04-26T21:08:07.584 INFO:tasks.workunit.client.0.smithi055.stdout:0/406: read d9/dc/d17/f45 [1803996,28779] 0 2024-04-26T21:08:07.585 INFO:tasks.workunit.client.0.smithi055.stdout:5/273: mknod d4/df/d13/d26/c5a 0 2024-04-26T21:08:07.587 INFO:tasks.workunit.client.0.smithi055.stdout:3/428: dwrite d0/d4/d5/d73/f14 [0,4194304] 0 2024-04-26T21:08:07.591 INFO:tasks.workunit.client.0.smithi055.stdout:4/289: dwrite d4/f13 [0,4194304] 0 2024-04-26T21:08:07.592 INFO:tasks.workunit.client.1.smithi064.stdout:2/572: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fc0 x:0 0 0 2024-04-26T21:08:07.592 INFO:tasks.workunit.client.1.smithi064.stdout:2/573: creat d12/d41/d73/d83/fc1 x:0 0 0 2024-04-26T21:08:07.592 INFO:tasks.workunit.client.1.smithi064.stdout:2/574: write d12/d41/d73/d83/d94/d3a/d46/d91/d96/fa3 [325920,13104] 0 2024-04-26T21:08:07.592 INFO:tasks.workunit.client.1.smithi064.stdout:2/575: fdatasync d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f 0 2024-04-26T21:08:07.608 INFO:tasks.workunit.client.0.smithi055.stdout:7/352: link d5/d6/d24/d3b/c3d d5/d6/d24/d48/c63 0 2024-04-26T21:08:07.608 INFO:tasks.workunit.client.0.smithi055.stdout:7/353: readlink d5/d6/d24/l26 0 2024-04-26T21:08:07.608 INFO:tasks.workunit.client.0.smithi055.stdout:7/354: fdatasync d5/d6/d24/d52/f5e 0 2024-04-26T21:08:07.608 INFO:tasks.workunit.client.0.smithi055.stdout:3/429: dread d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:07.610 INFO:tasks.workunit.client.0.smithi055.stdout:1/356: unlink d8/d17/d36/f59 0 2024-04-26T21:08:07.611 INFO:tasks.workunit.client.1.smithi064.stdout:8/443: getdents d10/d41/d4e/d54 0 2024-04-26T21:08:07.612 INFO:tasks.workunit.client.0.smithi055.stdout:5/274: write d4/df/d13/f22 [3757452,61212] 0 2024-04-26T21:08:07.615 INFO:tasks.workunit.client.1.smithi064.stdout:4/610: mkdir d0/d2f/d7d/dc6 0 2024-04-26T21:08:07.616 INFO:tasks.workunit.client.0.smithi055.stdout:2/430: creat d4/dc/d21/f96 x:0 0 0 2024-04-26T21:08:07.616 INFO:tasks.workunit.client.0.smithi055.stdout:2/431: read - d4/db/d1f/d46/f75 zero size 2024-04-26T21:08:07.619 INFO:tasks.workunit.client.0.smithi055.stdout:0/407: symlink d9/d27/l83 0 2024-04-26T21:08:07.620 INFO:tasks.workunit.client.0.smithi055.stdout:0/408: chown d9/dc/d17/d5d/f7c 1647 1 2024-04-26T21:08:07.620 INFO:tasks.workunit.client.0.smithi055.stdout:0/409: fdatasync d9/dc/d17/f3a 0 2024-04-26T21:08:07.628 INFO:tasks.workunit.client.1.smithi064.stdout:3/516: mknod d1/d27/d50/d35/d4c/d7b/d82/cb6 0 2024-04-26T21:08:07.629 INFO:tasks.workunit.client.1.smithi064.stdout:3/517: getdents d1/d27/d29/d9d 0 2024-04-26T21:08:07.631 INFO:tasks.workunit.client.0.smithi055.stdout:7/355: write d5/d6/f4c [2570933,72191] 0 2024-04-26T21:08:07.632 INFO:tasks.workunit.client.0.smithi055.stdout:9/387: dwrite d2/d46/d77/f76 [0,4194304] 0 2024-04-26T21:08:07.632 INFO:tasks.workunit.client.0.smithi055.stdout:9/388: creat d2/d11/f7e x:0 0 0 2024-04-26T21:08:07.633 INFO:tasks.workunit.client.1.smithi064.stdout:6/512: mknod d4/d7/d12/d49/d4b/d56/d95/ca6 0 2024-04-26T21:08:07.633 INFO:tasks.workunit.client.1.smithi064.stdout:6/513: chown d4/d7/d12/f4f 456 1 2024-04-26T21:08:07.633 INFO:tasks.workunit.client.1.smithi064.stdout:9/551: rename d0/d4/da/d26/d47/f62 to d0/d4/da/d26/fad 0 2024-04-26T21:08:07.635 INFO:tasks.workunit.client.0.smithi055.stdout:4/290: getdents d4/d26/d42 0 2024-04-26T21:08:07.638 INFO:tasks.workunit.client.1.smithi064.stdout:0/521: getdents dd/d10/d1a/d31/d47/dad 0 2024-04-26T21:08:07.639 INFO:tasks.workunit.client.0.smithi055.stdout:3/430: unlink d0/d4/d5/d73/l32 0 2024-04-26T21:08:07.645 INFO:tasks.workunit.client.1.smithi064.stdout:2/576: mknod d12/d41/d73/d83/d94/d3a/d46/cc2 0 2024-04-26T21:08:07.645 INFO:tasks.workunit.client.1.smithi064.stdout:2/577: chown d12/d41/d73/d83/d94/d3a/c4a 618 1 2024-04-26T21:08:07.645 INFO:tasks.workunit.client.1.smithi064.stdout:2/578: fdatasync d12/d41/d61/d75/f60 0 2024-04-26T21:08:07.645 INFO:tasks.workunit.client.0.smithi055.stdout:5/275: mkdir d4/df/d13/d26/d3c/d5b 0 2024-04-26T21:08:07.651 INFO:tasks.workunit.client.1.smithi064.stdout:7/539: getdents d6/d9/d3d/d43 0 2024-04-26T21:08:07.651 INFO:tasks.workunit.client.0.smithi055.stdout:9/389: write d2/f22 [6932063,75398] 0 2024-04-26T21:08:07.652 INFO:tasks.workunit.client.0.smithi055.stdout:9/390: fsync d2/f3f 0 2024-04-26T21:08:07.652 INFO:tasks.workunit.client.0.smithi055.stdout:9/391: chown d2/d11 13244 1 2024-04-26T21:08:07.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/291: write d4/f36 [824336,103887] 0 2024-04-26T21:08:07.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/292: chown d4/f36 389324 1 2024-04-26T21:08:07.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/293: fdatasync d4/f66 0 2024-04-26T21:08:07.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/294: write d4/f1d [2783610,92603] 0 2024-04-26T21:08:07.657 INFO:tasks.workunit.client.0.smithi055.stdout:2/432: rename d4/d49/d4c/d5e/d7d/d80 to d4/d1e/d69/d97 0 2024-04-26T21:08:07.657 INFO:tasks.workunit.client.1.smithi064.stdout:4/611: link d0/d1d/d21/f8e d0/fc7 0 2024-04-26T21:08:07.660 INFO:tasks.workunit.client.0.smithi055.stdout:0/410: creat d9/d11/d5b/d5e/d6c/f84 x:0 0 0 2024-04-26T21:08:07.660 INFO:tasks.workunit.client.1.smithi064.stdout:9/552: read d0/d4/d7/f2f [3546436,112054] 0 2024-04-26T21:08:07.662 INFO:tasks.workunit.client.0.smithi055.stdout:0/411: fsync d9/dc/d1c/f29 0 2024-04-26T21:08:07.663 INFO:tasks.workunit.client.1.smithi064.stdout:6/514: unlink d4/l43 0 2024-04-26T21:08:07.663 INFO:tasks.workunit.client.1.smithi064.stdout:2/579: dread d12/d41/d61/d75/f2b [0,4194304] 0 2024-04-26T21:08:07.663 INFO:tasks.workunit.client.1.smithi064.stdout:3/518: write d1/d27/d29/f4b [1999347,41595] 0 2024-04-26T21:08:07.667 INFO:tasks.workunit.client.1.smithi064.stdout:1/649: rename d0/d6/d11/d1e/f9a to d0/d6/d91/fcd 0 2024-04-26T21:08:07.667 INFO:tasks.workunit.client.1.smithi064.stdout:1/650: write d0/d6/d11/d1e/d2a/d34/f75 [1552681,50157] 0 2024-04-26T21:08:07.671 INFO:tasks.workunit.client.1.smithi064.stdout:5/531: sync 2024-04-26T21:08:07.671 INFO:tasks.workunit.client.1.smithi064.stdout:5/532: chown dd/d12/d18/d1a/d1f/d20/f47 30 1 2024-04-26T21:08:07.674 INFO:tasks.workunit.client.1.smithi064.stdout:0/522: getdents dd/d10/d1a/d31/d47/d61/d42 0 2024-04-26T21:08:07.675 INFO:tasks.workunit.client.0.smithi055.stdout:8/325: sync 2024-04-26T21:08:07.675 INFO:tasks.workunit.client.0.smithi055.stdout:6/362: sync 2024-04-26T21:08:07.675 INFO:tasks.workunit.client.0.smithi055.stdout:8/326: write d3/d9/d44/f67 [501204,82012] 0 2024-04-26T21:08:07.675 INFO:tasks.workunit.client.0.smithi055.stdout:8/327: fdatasync d3/d9/d1d/f65 0 2024-04-26T21:08:07.676 INFO:tasks.workunit.client.0.smithi055.stdout:8/328: write f1 [4194482,91849] 0 2024-04-26T21:08:07.678 INFO:tasks.workunit.client.0.smithi055.stdout:0/412: dread d9/d11/f46 [0,4194304] 0 2024-04-26T21:08:07.683 INFO:tasks.workunit.client.1.smithi064.stdout:7/540: symlink d6/d9/d3d/d43/lbb 0 2024-04-26T21:08:07.697 INFO:tasks.workunit.client.0.smithi055.stdout:7/356: creat d5/d6/d24/d3b/d56/f64 x:0 0 0 2024-04-26T21:08:07.703 INFO:tasks.workunit.client.1.smithi064.stdout:9/553: dread d0/d4/d28/d4f/f61 [0,4194304] 0 2024-04-26T21:08:07.703 INFO:tasks.workunit.client.1.smithi064.stdout:9/554: write d0/d4/da/f29 [4707493,11185] 0 2024-04-26T21:08:07.704 INFO:tasks.workunit.client.1.smithi064.stdout:9/555: chown d0/d4/da/l1c 416 1 2024-04-26T21:08:07.704 INFO:tasks.workunit.client.1.smithi064.stdout:9/556: fsync d0/d4/da/d26/d47/d9d/f8c 0 2024-04-26T21:08:07.714 INFO:tasks.workunit.client.1.smithi064.stdout:4/612: link d0/d5/d13/d6d/lbf d0/d5/d79/lc8 0 2024-04-26T21:08:07.716 INFO:tasks.workunit.client.0.smithi055.stdout:3/431: mknod d0/c9a 0 2024-04-26T21:08:07.720 INFO:tasks.workunit.client.1.smithi064.stdout:6/515: mkdir d4/d7/d12/da7 0 2024-04-26T21:08:07.720 INFO:tasks.workunit.client.1.smithi064.stdout:6/516: truncate d4/d7/d33/f8c 846805 0 2024-04-26T21:08:07.721 INFO:tasks.workunit.client.1.smithi064.stdout:6/517: creat d4/d7/fa8 x:0 0 0 2024-04-26T21:08:07.721 INFO:tasks.workunit.client.1.smithi064.stdout:6/518: fdatasync d4/d99/fa4 0 2024-04-26T21:08:07.724 INFO:tasks.workunit.client.0.smithi055.stdout:1/357: link d8/d17/f18 d8/df/d11/d44/f79 0 2024-04-26T21:08:07.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/276: mkdir d4/df/d13/d26/d3c/d4a/d3f/d5c 0 2024-04-26T21:08:07.729 INFO:tasks.workunit.client.0.smithi055.stdout:5/277: readlink d4/df/d13/d26/d3c/d4a/d3f/l2d 0 2024-04-26T21:08:07.730 INFO:tasks.workunit.client.1.smithi064.stdout:3/519: dwrite d1/d38/f9c [0,4194304] 0 2024-04-26T21:08:07.730 INFO:tasks.workunit.client.1.smithi064.stdout:8/444: dwrite d10/d2f/d56/f7b [0,4194304] 0 2024-04-26T21:08:07.735 INFO:tasks.workunit.client.1.smithi064.stdout:0/523: rename dd/d10/d74/l6c to dd/d10/d1a/d31/d47/lb2 0 2024-04-26T21:08:07.736 INFO:tasks.workunit.client.1.smithi064.stdout:9/557: read d0/d39/f3e [792363,118132] 0 2024-04-26T21:08:07.736 INFO:tasks.workunit.client.1.smithi064.stdout:9/558: chown d0/d4/da/d26/d45/l8e 5478838 1 2024-04-26T21:08:07.743 INFO:tasks.workunit.client.1.smithi064.stdout:2/580: dwrite d12/d41/d73/d83/d94/f33 [0,4194304] 0 2024-04-26T21:08:07.743 INFO:tasks.workunit.client.0.smithi055.stdout:2/433: symlink d4/d1e/d69/l98 0 2024-04-26T21:08:07.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/295: dwrite d4/d26/d42/d2d/f59 [0,4194304] 0 2024-04-26T21:08:07.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/363: symlink d3/d17/d46/l80 0 2024-04-26T21:08:07.743 INFO:tasks.workunit.client.1.smithi064.stdout:7/541: link d6/db/d1f/f4c d6/db/fbc 0 2024-04-26T21:08:07.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/613: truncate d0/d5/d13/f60 120969 0 2024-04-26T21:08:07.744 INFO:tasks.workunit.client.0.smithi055.stdout:9/392: dwrite d2/d11/f26 [0,4194304] 0 2024-04-26T21:08:07.745 INFO:tasks.workunit.client.0.smithi055.stdout:9/393: chown d2/d14/l24 43 1 2024-04-26T21:08:07.745 INFO:tasks.workunit.client.0.smithi055.stdout:9/394: truncate d2/d11/f3b 4373921 0 2024-04-26T21:08:07.745 INFO:tasks.workunit.client.0.smithi055.stdout:9/395: write d2/f41 [1030107,7974] 0 2024-04-26T21:08:07.745 INFO:tasks.workunit.client.0.smithi055.stdout:9/396: readlink d2/d11/l35 0 2024-04-26T21:08:07.745 INFO:tasks.workunit.client.0.smithi055.stdout:9/397: write d2/f55 [3375635,102850] 0 2024-04-26T21:08:07.749 INFO:tasks.workunit.client.0.smithi055.stdout:0/413: creat d9/dc/d1c/f85 x:0 0 0 2024-04-26T21:08:07.749 INFO:tasks.workunit.client.0.smithi055.stdout:0/414: chown d9/d27/f42 7 1 2024-04-26T21:08:07.750 INFO:tasks.workunit.client.1.smithi064.stdout:5/533: dread f0 [0,4194304] 0 2024-04-26T21:08:07.750 INFO:tasks.workunit.client.0.smithi055.stdout:0/415: write d9/dc/d1c/d54/d4b/d68/f6d [9974674,110105] 0 2024-04-26T21:08:07.750 INFO:tasks.workunit.client.0.smithi055.stdout:1/358: truncate d8/f31 1324540 0 2024-04-26T21:08:07.750 INFO:tasks.workunit.client.0.smithi055.stdout:0/416: fsync d9/dc/d17/f1e 0 2024-04-26T21:08:07.752 INFO:tasks.workunit.client.0.smithi055.stdout:5/278: rename d4/d15/f1a to d4/df/f5d 0 2024-04-26T21:08:07.753 INFO:tasks.workunit.client.1.smithi064.stdout:6/519: write d4/d7/d33/f44 [2108077,12222] 0 2024-04-26T21:08:07.754 INFO:tasks.workunit.client.1.smithi064.stdout:1/651: dwrite d0/d6/d29/fca [0,4194304] 0 2024-04-26T21:08:07.755 INFO:tasks.workunit.client.0.smithi055.stdout:8/329: dwrite d3/f41 [0,4194304] 0 2024-04-26T21:08:07.762 INFO:tasks.workunit.client.1.smithi064.stdout:3/520: rename d1/f2f to d1/fb7 0 2024-04-26T21:08:07.766 INFO:tasks.workunit.client.1.smithi064.stdout:8/445: symlink d10/d41/d4e/d59/l92 0 2024-04-26T21:08:07.766 INFO:tasks.workunit.client.1.smithi064.stdout:8/446: fdatasync d10/d41/d4e/d59/f6e 0 2024-04-26T21:08:07.766 INFO:tasks.workunit.client.1.smithi064.stdout:8/447: write d10/d41/d44/f7c [285827,107573] 0 2024-04-26T21:08:07.768 INFO:tasks.workunit.client.0.smithi055.stdout:4/296: mknod d4/d12/d17/d3d/c69 0 2024-04-26T21:08:07.771 INFO:tasks.workunit.client.1.smithi064.stdout:0/524: symlink dd/d10/d18/lb3 0 2024-04-26T21:08:07.771 INFO:tasks.workunit.client.1.smithi064.stdout:0/525: truncate dd/d10/d18/d64/f95 914948 0 2024-04-26T21:08:07.774 INFO:tasks.workunit.client.0.smithi055.stdout:7/357: dwrite d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:07.776 INFO:tasks.workunit.client.1.smithi064.stdout:9/559: unlink d0/d4/da/d31/d34/c97 0 2024-04-26T21:08:07.776 INFO:tasks.workunit.client.0.smithi055.stdout:3/432: rmdir d0/d4/d16/d18 39 2024-04-26T21:08:07.778 INFO:tasks.workunit.client.1.smithi064.stdout:2/581: creat d12/d41/d73/d83/d94/d3a/d5d/fc3 x:0 0 0 2024-04-26T21:08:07.778 INFO:tasks.workunit.client.1.smithi064.stdout:2/582: dread - d12/d41/d61/fbd zero size 2024-04-26T21:08:07.780 INFO:tasks.workunit.client.1.smithi064.stdout:7/542: link d6/db/d34/f96 d6/db/d1f/d50/db8/fbd 0 2024-04-26T21:08:07.781 INFO:tasks.workunit.client.1.smithi064.stdout:7/543: read d6/db/d34/f96 [238490,129096] 0 2024-04-26T21:08:07.782 INFO:tasks.workunit.client.0.smithi055.stdout:1/359: chown d8/df/d11/d6c/f73 12093 1 2024-04-26T21:08:07.784 INFO:tasks.workunit.client.1.smithi064.stdout:4/614: creat d0/d5/d13/fc9 x:0 0 0 2024-04-26T21:08:07.786 INFO:tasks.workunit.client.0.smithi055.stdout:9/398: rename d2/d11/l75 to d2/d46/d77/d5f/l7f 0 2024-04-26T21:08:07.790 INFO:tasks.workunit.client.0.smithi055.stdout:2/434: getdents d4/dc 0 2024-04-26T21:08:07.791 INFO:tasks.workunit.client.1.smithi064.stdout:5/534: symlink dd/da9/d48/d6a/d9e/lad 0 2024-04-26T21:08:07.791 INFO:tasks.workunit.client.1.smithi064.stdout:5/535: truncate dd/d12/d18/d1a/d1f/f4b 1154386 0 2024-04-26T21:08:07.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/520: rmdir d4/d7/d33 39 2024-04-26T21:08:07.799 INFO:tasks.workunit.client.1.smithi064.stdout:9/560: dread d0/d4/da/d31/f80 [0,4194304] 0 2024-04-26T21:08:07.807 INFO:tasks.workunit.client.1.smithi064.stdout:6/521: dread d4/d7/d12/d38/f9f [0,4194304] 0 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.1.smithi064.stdout:3/521: rmdir d1/d27/d50/d35/d4c/d7b 39 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.1.smithi064.stdout:8/448: creat d10/d2f/d90/f93 x:0 0 0 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.1.smithi064.stdout:0/526: mkdir dd/d10/d1a/d31/d43/db4 0 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.1.smithi064.stdout:8/449: fdatasync d10/d1d/d38/f39 0 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.0.smithi055.stdout:8/330: creat d3/d9/d5b/f6d x:0 0 0 2024-04-26T21:08:07.808 INFO:tasks.workunit.client.0.smithi055.stdout:8/331: truncate d3/d9/d1d/f53 1011128 0 2024-04-26T21:08:07.809 INFO:tasks.workunit.client.1.smithi064.stdout:2/583: rename d12/d41/d61/d75/c21 to d12/d41/d73/d83/d94/d3a/d46/d6a/cc4 0 2024-04-26T21:08:07.809 INFO:tasks.workunit.client.1.smithi064.stdout:2/584: readlink d12/d41/d61/l87 0 2024-04-26T21:08:07.814 INFO:tasks.workunit.client.1.smithi064.stdout:4/615: dread d0/d1d/d17/d44/d45/f5c [4194304,4194304] 0 2024-04-26T21:08:07.828 INFO:tasks.workunit.client.0.smithi055.stdout:7/358: mkdir d5/d6/d24/d3b/d56/d65 0 2024-04-26T21:08:07.833 INFO:tasks.workunit.client.0.smithi055.stdout:4/297: rename d4/d23/c58 to d4/d12/d57/c6a 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:9/561: creat d0/d4/d7/df/fae x:0 0 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:5/536: dread f9 [0,4194304] 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/585: write d12/d41/d61/d75/f2b [853443,111004] 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/586: write d12/d41/d73/d83/fb9 [586160,21511] 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/587: chown d12/d41/d73/d83/d94/d3a/d46/d6a 14 1 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/588: read - d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fc0 zero size 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:6/522: creat d4/d7/d12/d49/d4b/d7d/fa9 x:0 0 0 2024-04-26T21:08:07.835 INFO:tasks.workunit.client.1.smithi064.stdout:8/450: write d10/d41/d44/f66 [4051680,48042] 0 2024-04-26T21:08:07.836 INFO:tasks.workunit.client.1.smithi064.stdout:1/652: dwrite d0/d6/d91/f94 [0,4194304] 0 2024-04-26T21:08:07.836 INFO:tasks.workunit.client.0.smithi055.stdout:2/435: unlink d4/d49/l78 0 2024-04-26T21:08:07.836 INFO:tasks.workunit.client.1.smithi064.stdout:0/527: write dd/d10/d1a/d31/f37 [7540192,76792] 0 2024-04-26T21:08:07.837 INFO:tasks.workunit.client.1.smithi064.stdout:0/528: write dd/d10/f7d [4504429,65152] 0 2024-04-26T21:08:07.839 INFO:tasks.workunit.client.1.smithi064.stdout:7/544: mknod d6/d9/d3d/d43/cbe 0 2024-04-26T21:08:07.842 INFO:tasks.workunit.client.1.smithi064.stdout:2/589: creat d12/d45/fc5 x:0 0 0 2024-04-26T21:08:07.843 INFO:tasks.workunit.client.1.smithi064.stdout:5/537: rename dd/d12/d18/d1a/d1f/d20/f4e to dd/da9/d48/d56/fae 0 2024-04-26T21:08:07.843 INFO:tasks.workunit.client.0.smithi055.stdout:4/298: dread d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:07.848 INFO:tasks.workunit.client.0.smithi055.stdout:7/359: truncate d5/d6/f4c 1796719 0 2024-04-26T21:08:07.848 INFO:tasks.workunit.client.0.smithi055.stdout:7/360: dread - d5/d6/d24/d4d/f60 zero size 2024-04-26T21:08:07.854 INFO:tasks.workunit.client.0.smithi055.stdout:8/332: rename d3/d9/d1f/f23 to d3/d9/d1d/f6e 0 2024-04-26T21:08:07.855 INFO:tasks.workunit.client.1.smithi064.stdout:1/653: unlink d0/d6/d11/d1e/d2a/d34/d57/faa 0 2024-04-26T21:08:07.855 INFO:tasks.workunit.client.1.smithi064.stdout:1/654: truncate d0/d6/d29/d31/f83 991685 0 2024-04-26T21:08:07.855 INFO:tasks.workunit.client.1.smithi064.stdout:1/655: fsync d0/d6/d11/fb0 0 2024-04-26T21:08:07.856 INFO:tasks.workunit.client.0.smithi055.stdout:1/360: dwrite d8/df/d11/d27/d28/f72 [0,4194304] 0 2024-04-26T21:08:07.856 INFO:tasks.workunit.client.0.smithi055.stdout:3/433: dwrite d0/d4/d5/d73/d13/d1a/d46/d55/f96 [0,4194304] 0 2024-04-26T21:08:07.856 INFO:tasks.workunit.client.0.smithi055.stdout:3/434: dread - d0/d4/d5/d73/d47/f76 zero size 2024-04-26T21:08:07.859 INFO:tasks.workunit.client.0.smithi055.stdout:2/436: creat d4/d49/d4c/f99 x:0 0 0 2024-04-26T21:08:07.860 INFO:tasks.workunit.client.1.smithi064.stdout:6/523: rename d4/lf to d4/d7/d12/d49/d9e/laa 0 2024-04-26T21:08:07.861 INFO:tasks.workunit.client.1.smithi064.stdout:5/538: symlink dd/da9/d63/laf 0 2024-04-26T21:08:07.866 INFO:tasks.workunit.client.0.smithi055.stdout:4/299: mkdir d4/d12/d61/d6b 0 2024-04-26T21:08:07.869 INFO:tasks.workunit.client.0.smithi055.stdout:7/361: symlink d5/d6/d24/d4d/l66 0 2024-04-26T21:08:07.873 INFO:tasks.workunit.client.1.smithi064.stdout:1/656: rmdir d0/d6/d11/d2c/d9c/dbc/dc3 0 2024-04-26T21:08:07.874 INFO:tasks.workunit.client.0.smithi055.stdout:8/333: creat d3/d9/d1d/d48/d57/f6f x:0 0 0 2024-04-26T21:08:07.879 INFO:tasks.workunit.client.1.smithi064.stdout:7/545: rename d6/d9/d3d/d58/la0 to d6/d15/d67/d65/lbf 0 2024-04-26T21:08:07.879 INFO:tasks.workunit.client.1.smithi064.stdout:7/546: chown d6/db/d1f/c4b 500 1 2024-04-26T21:08:07.879 INFO:tasks.workunit.client.1.smithi064.stdout:7/547: fsync d6/db/d34/d41/f49 0 2024-04-26T21:08:07.879 INFO:tasks.workunit.client.1.smithi064.stdout:9/562: read d0/d4/da/fc [8421747,87620] 0 2024-04-26T21:08:07.880 INFO:tasks.workunit.client.1.smithi064.stdout:4/616: dwrite d0/d1d/d17/d44/dac/d54/f58 [0,4194304] 0 2024-04-26T21:08:07.883 INFO:tasks.workunit.client.1.smithi064.stdout:1/657: dread d0/d6/d11/d1e/d2a/d34/d57/d66/f6a [0,4194304] 0 2024-04-26T21:08:07.884 INFO:tasks.workunit.client.1.smithi064.stdout:6/524: creat d4/d7/d12/d49/d4b/fab x:0 0 0 2024-04-26T21:08:07.884 INFO:tasks.workunit.client.1.smithi064.stdout:6/525: chown d4/d7/d12/da7 537221 1 2024-04-26T21:08:07.884 INFO:tasks.workunit.client.1.smithi064.stdout:6/526: creat d4/d7/d12/d49/d4b/d56/d95/fac x:0 0 0 2024-04-26T21:08:07.885 INFO:tasks.workunit.client.1.smithi064.stdout:8/451: dwrite d10/d1d/f30 [0,4194304] 0 2024-04-26T21:08:07.887 INFO:tasks.workunit.client.0.smithi055.stdout:1/361: creat d8/df/d11/d44/f7a x:0 0 0 2024-04-26T21:08:07.890 INFO:tasks.workunit.client.1.smithi064.stdout:3/522: dwrite d1/d27/d29/d6f/d72/da5/f7c [0,4194304] 0 2024-04-26T21:08:07.890 INFO:tasks.workunit.client.1.smithi064.stdout:7/548: dread f5 [0,4194304] 0 2024-04-26T21:08:07.896 INFO:tasks.workunit.client.1.smithi064.stdout:5/539: link dd/da9/d63/f89 dd/da9/d48/dac/d8a/fb0 0 2024-04-26T21:08:07.898 INFO:tasks.workunit.client.0.smithi055.stdout:3/435: mknod d0/d4/d5/d73/d13/c9b 0 2024-04-26T21:08:07.901 INFO:tasks.workunit.client.0.smithi055.stdout:2/437: mkdir d4/db/d26/d9a 0 2024-04-26T21:08:07.901 INFO:tasks.workunit.client.0.smithi055.stdout:2/438: chown d4/d14/d33 43060950 1 2024-04-26T21:08:07.903 INFO:tasks.workunit.client.0.smithi055.stdout:4/300: symlink d4/d12/d17/d3d/l6c 0 2024-04-26T21:08:07.908 INFO:tasks.workunit.client.0.smithi055.stdout:9/399: truncate d2/d11/f3b 3732889 0 2024-04-26T21:08:07.908 INFO:tasks.workunit.client.0.smithi055.stdout:7/362: mkdir d5/d53/d67 0 2024-04-26T21:08:07.908 INFO:tasks.workunit.client.0.smithi055.stdout:8/334: mknod d3/d9/d44/c70 0 2024-04-26T21:08:07.919 INFO:tasks.workunit.client.1.smithi064.stdout:2/590: rename d12/d41/d61/d6c/d71 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/dc6 0 2024-04-26T21:08:07.921 INFO:tasks.workunit.client.0.smithi055.stdout:3/436: mknod d0/de/c9c 0 2024-04-26T21:08:07.927 INFO:tasks.workunit.client.0.smithi055.stdout:9/400: dread d2/d11/f73 [0,4194304] 0 2024-04-26T21:08:07.931 INFO:tasks.workunit.client.0.smithi055.stdout:2/439: dread d4/f5 [0,4194304] 0 2024-04-26T21:08:07.933 INFO:tasks.workunit.client.0.smithi055.stdout:7/363: mknod d5/d6/d24/d4d/c68 0 2024-04-26T21:08:07.934 INFO:tasks.workunit.client.0.smithi055.stdout:8/335: write d3/d9/f2b [2103279,20126] 0 2024-04-26T21:08:07.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/658: dwrite d0/d6/d11/d1e/d27/f65 [0,4194304] 0 2024-04-26T21:08:07.940 INFO:tasks.workunit.client.1.smithi064.stdout:1/659: dread - d0/d6/d11/d1e/d2a/f8a zero size 2024-04-26T21:08:07.942 INFO:tasks.workunit.client.0.smithi055.stdout:1/362: rename d8/d17/d64 to d8/d17/d1b/d7b 0 2024-04-26T21:08:07.943 INFO:tasks.workunit.client.1.smithi064.stdout:8/452: dwrite d10/d41/d44/f51 [4194304,4194304] 0 2024-04-26T21:08:07.944 INFO:tasks.workunit.client.1.smithi064.stdout:8/453: write d10/f7e [463473,72763] 0 2024-04-26T21:08:07.944 INFO:tasks.workunit.client.0.smithi055.stdout:9/401: write d2/d46/d77/f58 [7165868,125581] 0 2024-04-26T21:08:07.945 INFO:tasks.workunit.client.0.smithi055.stdout:9/402: creat d2/d14/f80 x:0 0 0 2024-04-26T21:08:07.945 INFO:tasks.workunit.client.1.smithi064.stdout:6/527: dwrite d4/d7/d12/d38/f73 [0,4194304] 0 2024-04-26T21:08:07.945 INFO:tasks.workunit.client.1.smithi064.stdout:4/617: mknod d0/d1d/d56/d89/cca 0 2024-04-26T21:08:07.955 INFO:tasks.workunit.client.0.smithi055.stdout:3/437: truncate d0/d4/d5/d73/d13/d1a/d46/d72/f82 2908615 0 2024-04-26T21:08:07.955 INFO:tasks.workunit.client.0.smithi055.stdout:3/438: chown d0/d4/d5/f21 64185795 1 2024-04-26T21:08:07.963 INFO:tasks.workunit.client.0.smithi055.stdout:2/440: dread d4/ff [0,4194304] 0 2024-04-26T21:08:07.967 INFO:tasks.workunit.client.1.smithi064.stdout:3/523: truncate d1/d27/d50/f10 5704877 0 2024-04-26T21:08:07.967 INFO:tasks.workunit.client.1.smithi064.stdout:3/524: read - d1/d27/d50/f74 zero size 2024-04-26T21:08:07.967 INFO:tasks.workunit.client.1.smithi064.stdout:3/525: stat d1/d27/d29/d6f/d72/da5/l3a 0 2024-04-26T21:08:07.970 INFO:tasks.workunit.client.0.smithi055.stdout:1/363: mkdir d8/d17/d36/d7c 0 2024-04-26T21:08:07.977 INFO:tasks.workunit.client.0.smithi055.stdout:9/403: link d2/d11/c20 d2/d46/d51/c81 0 2024-04-26T21:08:07.977 INFO:tasks.workunit.client.0.smithi055.stdout:9/404: chown d2/d14/c16 512 1 2024-04-26T21:08:07.978 INFO:tasks.workunit.client.1.smithi064.stdout:6/528: dwrite d4/d7/d12/d49/d4b/d7d/fa9 [0,4194304] 0 2024-04-26T21:08:07.979 INFO:tasks.workunit.client.0.smithi055.stdout:3/439: getdents d0/d4/d5/d73/d13/d27/d3b 0 2024-04-26T21:08:07.979 INFO:tasks.workunit.client.0.smithi055.stdout:3/440: stat d0/d4/d5/d73/d13/d1a/c45 0 2024-04-26T21:08:07.993 INFO:tasks.workunit.client.0.smithi055.stdout:1/364: dread d8/df/d11/d44/f54 [0,4194304] 0 2024-04-26T21:08:07.994 INFO:tasks.workunit.client.1.smithi064.stdout:7/549: mkdir d6/d15/dc0 0 2024-04-26T21:08:07.996 INFO:tasks.workunit.client.1.smithi064.stdout:5/540: creat dd/da9/d48/d56/fb1 x:0 0 0 2024-04-26T21:08:07.996 INFO:tasks.workunit.client.1.smithi064.stdout:5/541: readlink dd/da9/d48/dac/d8a/l96 0 2024-04-26T21:08:07.998 INFO:tasks.workunit.client.1.smithi064.stdout:9/563: symlink d0/d4/da/d26/laf 0 2024-04-26T21:08:07.998 INFO:tasks.workunit.client.1.smithi064.stdout:9/564: creat d0/d4/da/d26/d5d/fb0 x:0 0 0 2024-04-26T21:08:08.000 INFO:tasks.workunit.client.0.smithi055.stdout:7/364: rmdir d5/d6/d24 39 2024-04-26T21:08:08.002 INFO:tasks.workunit.client.0.smithi055.stdout:2/441: symlink d4/db/d26/d9a/l9b 0 2024-04-26T21:08:08.002 INFO:tasks.workunit.client.0.smithi055.stdout:2/442: fsync d4/db/d1f/f29 0 2024-04-26T21:08:08.003 INFO:tasks.workunit.client.1.smithi064.stdout:6/529: read d4/d7/f69 [3849954,964] 0 2024-04-26T21:08:08.005 INFO:tasks.workunit.client.0.smithi055.stdout:8/336: link d3/d9/d1d/l52 d3/l71 0 2024-04-26T21:08:08.005 INFO:tasks.workunit.client.0.smithi055.stdout:8/337: fsync d3/f46 0 2024-04-26T21:08:08.011 INFO:tasks.workunit.client.0.smithi055.stdout:9/405: mknod d2/c82 0 2024-04-26T21:08:08.011 INFO:tasks.workunit.client.0.smithi055.stdout:9/406: readlink d2/d14/l24 0 2024-04-26T21:08:08.011 INFO:tasks.workunit.client.0.smithi055.stdout:9/407: write d2/d46/d77/f70 [344488,66414] 0 2024-04-26T21:08:08.016 INFO:tasks.workunit.client.1.smithi064.stdout:4/618: dwrite d0/d2f/d7d/f94 [0,4194304] 0 2024-04-26T21:08:08.017 INFO:tasks.workunit.client.1.smithi064.stdout:1/660: unlink d0/d22/l90 0 2024-04-26T21:08:08.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/365: link d5/d6/d24/d3b/d56/f64 d5/d6/d24/f69 0 2024-04-26T21:08:08.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/366: dread - d5/d6/d24/d3b/f42 zero size 2024-04-26T21:08:08.028 INFO:tasks.workunit.client.0.smithi055.stdout:8/338: write d3/d9/d1f/d5a/f6a [3912981,38062] 0 2024-04-26T21:08:08.029 INFO:tasks.workunit.client.0.smithi055.stdout:8/339: readlink d3/d9/d1d/d48/l4d 0 2024-04-26T21:08:08.029 INFO:tasks.workunit.client.0.smithi055.stdout:8/340: write d3/d9/d1d/d48/d57/f6f [241549,111892] 0 2024-04-26T21:08:08.029 INFO:tasks.workunit.client.0.smithi055.stdout:8/341: truncate d3/d9/f24 4703408 0 2024-04-26T21:08:08.031 INFO:tasks.workunit.client.0.smithi055.stdout:2/443: unlink d4/ff 0 2024-04-26T21:08:08.032 INFO:tasks.workunit.client.0.smithi055.stdout:2/444: chown d4/c9 10 1 2024-04-26T21:08:08.034 INFO:tasks.workunit.client.0.smithi055.stdout:1/365: dwrite d8/df/d11/d27/d28/d2a/f58 [0,4194304] 0 2024-04-26T21:08:08.036 INFO:tasks.workunit.client.0.smithi055.stdout:9/408: creat d2/d46/d77/d7d/f83 x:0 0 0 2024-04-26T21:08:08.036 INFO:tasks.workunit.client.0.smithi055.stdout:9/409: readlink d2/d11/l35 0 2024-04-26T21:08:08.036 INFO:tasks.workunit.client.0.smithi055.stdout:9/410: dread - d2/d14/f80 zero size 2024-04-26T21:08:08.038 INFO:tasks.workunit.client.0.smithi055.stdout:3/441: getdents d0 0 2024-04-26T21:08:08.038 INFO:tasks.workunit.client.0.smithi055.stdout:3/442: read d0/d4/d5/d73/d13/d27/d50/d6b/f7d [855971,127810] 0 2024-04-26T21:08:08.040 INFO:tasks.workunit.client.1.smithi064.stdout:4/619: write d0/d14/f50 [1830645,18250] 0 2024-04-26T21:08:08.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/454: creat d10/f94 x:0 0 0 2024-04-26T21:08:08.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/455: write d10/d1d/d38/f5e [1083162,96571] 0 2024-04-26T21:08:08.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/456: chown d10/d41/d44/d5a 89987 1 2024-04-26T21:08:08.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/457: stat d10 0 2024-04-26T21:08:08.041 INFO:tasks.workunit.client.0.smithi055.stdout:7/367: rename d5/c2c to d5/d6/d24/d3b/d56/c6a 0 2024-04-26T21:08:08.045 INFO:tasks.workunit.client.0.smithi055.stdout:7/368: write d5/d6/d24/d4d/f55 [758503,75020] 0 2024-04-26T21:08:08.045 INFO:tasks.workunit.client.0.smithi055.stdout:7/369: dread - d5/d6/d24/f50 zero size 2024-04-26T21:08:08.045 INFO:tasks.workunit.client.0.smithi055.stdout:7/370: write d5/d11/f2f [5436338,36312] 0 2024-04-26T21:08:08.047 INFO:tasks.workunit.client.1.smithi064.stdout:3/526: rename d1/d27/d29/d6f/d72/da5/d7d/f81 to d1/d27/d29/d6f/d72/d95/fb8 0 2024-04-26T21:08:08.054 INFO:tasks.workunit.client.0.smithi055.stdout:2/445: mknod d4/d1e/d2a/c9c 0 2024-04-26T21:08:08.054 INFO:tasks.workunit.client.0.smithi055.stdout:2/446: truncate d4/d55/d6c/f94 494441 0 2024-04-26T21:08:08.059 INFO:tasks.workunit.client.1.smithi064.stdout:7/550: rmdir d6/d15/d67/d65/db9 0 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:0/417: sync 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:5/279: sync 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:5/280: stat d4/df/d13/d26/f4e 0 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:6/364: sync 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:0/418: write d9/dc/f10 [3080578,11586] 0 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:0/419: write d9/dc/d1c/f29 [303814,77624] 0 2024-04-26T21:08:08.060 INFO:tasks.workunit.client.0.smithi055.stdout:0/420: fsync d9/f5a 0 2024-04-26T21:08:08.061 INFO:tasks.workunit.client.1.smithi064.stdout:5/542: getdents dd/d12/d18/d1a/d1f 0 2024-04-26T21:08:08.068 INFO:tasks.workunit.client.0.smithi055.stdout:1/366: unlink f1 0 2024-04-26T21:08:08.068 INFO:tasks.workunit.client.0.smithi055.stdout:1/367: dread - d8/d17/d6a/f6b zero size 2024-04-26T21:08:08.069 INFO:tasks.workunit.client.0.smithi055.stdout:9/411: symlink d2/d46/d51/l84 0 2024-04-26T21:08:08.070 INFO:tasks.workunit.client.0.smithi055.stdout:9/412: write d2/d46/f54 [544800,119656] 0 2024-04-26T21:08:08.070 INFO:tasks.workunit.client.1.smithi064.stdout:6/530: dwrite d4/d7/fa0 [0,4194304] 0 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/565: mknod d0/d4/da/d26/d5d/cb1 0 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/566: read d0/d4/d7/fd [3054103,127510] 0 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/567: chown d0/d4/da/l13 491347 1 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/568: chown d0/d4/da/l13 4394 1 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/569: chown d0/d4/da/d26/d47/l6c 130782198 1 2024-04-26T21:08:08.074 INFO:tasks.workunit.client.1.smithi064.stdout:9/570: truncate d0/d4/da/d26/d47/f65 4616584 0 2024-04-26T21:08:08.077 INFO:tasks.workunit.client.0.smithi055.stdout:8/342: getdents d3/d9/d44 0 2024-04-26T21:08:08.078 INFO:tasks.workunit.client.1.smithi064.stdout:2/591: rmdir d12/d41/d73/d83/d94/d3a/d46/d6a 39 2024-04-26T21:08:08.078 INFO:tasks.workunit.client.1.smithi064.stdout:0/529: sync 2024-04-26T21:08:08.079 INFO:tasks.workunit.client.0.smithi055.stdout:2/447: rename d4/d14/d17/d36/l82 to d4/db/d1f/d32/d57/l9d 0 2024-04-26T21:08:08.079 INFO:tasks.workunit.client.0.smithi055.stdout:2/448: readlink d4/dc/l40 0 2024-04-26T21:08:08.082 INFO:tasks.workunit.client.1.smithi064.stdout:4/620: link d0/d5/d79/cb2 d0/d2f/d87/ccb 0 2024-04-26T21:08:08.084 INFO:tasks.workunit.client.0.smithi055.stdout:5/281: unlink d4/df/l33 0 2024-04-26T21:08:08.084 INFO:tasks.workunit.client.0.smithi055.stdout:5/282: creat d4/df/d13/d26/d3c/d4a/f5e x:0 0 0 2024-04-26T21:08:08.084 INFO:tasks.workunit.client.0.smithi055.stdout:5/283: read d4/f10 [366169,73435] 0 2024-04-26T21:08:08.085 INFO:tasks.workunit.client.1.smithi064.stdout:8/458: creat d10/d41/d4e/d54/f95 x:0 0 0 2024-04-26T21:08:08.085 INFO:tasks.workunit.client.1.smithi064.stdout:8/459: getdents d10/d41/d4e/d59/d83 0 2024-04-26T21:08:08.091 INFO:tasks.workunit.client.0.smithi055.stdout:6/365: creat d3/d17/f81 x:0 0 0 2024-04-26T21:08:08.092 INFO:tasks.workunit.client.1.smithi064.stdout:1/661: dwrite d0/d6/d11/f23 [0,4194304] 0 2024-04-26T21:08:08.096 INFO:tasks.workunit.client.1.smithi064.stdout:2/592: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/f6d [0,4194304] 0 2024-04-26T21:08:08.106 INFO:tasks.workunit.client.0.smithi055.stdout:8/343: dread d3/d9/fe [0,4194304] 0 2024-04-26T21:08:08.108 INFO:tasks.workunit.client.0.smithi055.stdout:8/344: read d3/d9/f3b [369114,30437] 0 2024-04-26T21:08:08.111 INFO:tasks.workunit.client.0.smithi055.stdout:0/421: creat d9/dc/d1c/d3e/d7d/f86 x:0 0 0 2024-04-26T21:08:08.112 INFO:tasks.workunit.client.0.smithi055.stdout:1/368: rmdir d8/d17/d36/d7c 0 2024-04-26T21:08:08.114 INFO:tasks.workunit.client.1.smithi064.stdout:7/551: rmdir d6/d15/dc0 0 2024-04-26T21:08:08.115 INFO:tasks.workunit.client.1.smithi064.stdout:7/552: write d6/d5a/f3b [4919312,9686] 0 2024-04-26T21:08:08.117 INFO:tasks.workunit.client.1.smithi064.stdout:5/543: creat dd/d12/d4f/d64/fb2 x:0 0 0 2024-04-26T21:08:08.120 INFO:tasks.workunit.client.1.smithi064.stdout:2/593: read d12/d41/d73/d83/d94/d3a/d46/d6a/f5a [328891,116160] 0 2024-04-26T21:08:08.121 INFO:tasks.workunit.client.0.smithi055.stdout:9/413: symlink d2/d46/d77/l85 0 2024-04-26T21:08:08.128 INFO:tasks.workunit.client.1.smithi064.stdout:9/571: creat d0/d4/da/d26/d45/d90/fb2 x:0 0 0 2024-04-26T21:08:08.129 INFO:tasks.workunit.client.0.smithi055.stdout:3/443: getdents d0/d4/d5/d73/d13/d27/d50/d6b 0 2024-04-26T21:08:08.133 INFO:tasks.workunit.client.1.smithi064.stdout:4/621: dwrite d0/d2f/d7d/fc1 [0,4194304] 0 2024-04-26T21:08:08.140 INFO:tasks.workunit.client.0.smithi055.stdout:6/366: read d3/d17/d25/f2b [751824,110249] 0 2024-04-26T21:08:08.149 INFO:tasks.workunit.client.0.smithi055.stdout:7/371: dwrite d5/d6/d24/d4d/f55 [0,4194304] 0 2024-04-26T21:08:08.154 INFO:tasks.workunit.client.1.smithi064.stdout:5/544: write dd/da9/d63/f89 [2540196,29067] 0 2024-04-26T21:08:08.158 INFO:tasks.workunit.client.0.smithi055.stdout:7/372: dread d5/d6/d24/f28 [0,4194304] 0 2024-04-26T21:08:08.163 INFO:tasks.workunit.client.1.smithi064.stdout:6/531: dwrite d4/d7/d12/d49/d4b/d56/f82 [0,4194304] 0 2024-04-26T21:08:08.190 INFO:tasks.workunit.client.0.smithi055.stdout:7/373: write d5/f49 [2093601,35391] 0 2024-04-26T21:08:08.197 INFO:tasks.workunit.client.0.smithi055.stdout:5/284: symlink d4/df/l5f 0 2024-04-26T21:08:08.198 INFO:tasks.workunit.client.0.smithi055.stdout:2/449: dwrite d4/d1e/d2a/f62 [0,4194304] 0 2024-04-26T21:08:08.199 INFO:tasks.workunit.client.0.smithi055.stdout:2/450: chown d4/db 475 1 2024-04-26T21:08:08.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/662: dwrite d0/d6/d11/d2c/f85 [0,4194304] 0 2024-04-26T21:08:08.206 INFO:tasks.workunit.client.0.smithi055.stdout:0/422: symlink d9/d11/d5b/d5e/d6c/d7a/l87 0 2024-04-26T21:08:08.207 INFO:tasks.workunit.client.0.smithi055.stdout:8/345: dwrite d3/d9/d1d/f25 [4194304,4194304] 0 2024-04-26T21:08:08.209 INFO:tasks.workunit.client.1.smithi064.stdout:7/553: dwrite d6/d70/fa6 [0,4194304] 0 2024-04-26T21:08:08.209 INFO:tasks.workunit.client.1.smithi064.stdout:7/554: readlink d6/d15/d67/l73 0 2024-04-26T21:08:08.209 INFO:tasks.workunit.client.1.smithi064.stdout:7/555: read - d6/d9/d38/fb3 zero size 2024-04-26T21:08:08.209 INFO:tasks.workunit.client.1.smithi064.stdout:7/556: write d6/d9/d3d/f6e [2877073,40784] 0 2024-04-26T21:08:08.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/369: creat d8/d17/d1b/d7b/d65/f7d x:0 0 0 2024-04-26T21:08:08.212 INFO:tasks.workunit.client.0.smithi055.stdout:1/370: chown d8/d17/d1b/d7b 29532803 1 2024-04-26T21:08:08.212 INFO:tasks.workunit.client.0.smithi055.stdout:1/371: dread - d8/df/d11/d6c/f73 zero size 2024-04-26T21:08:08.212 INFO:tasks.workunit.client.1.smithi064.stdout:1/663: dread d0/d6/d11/d1e/f54 [0,4194304] 0 2024-04-26T21:08:08.212 INFO:tasks.workunit.client.1.smithi064.stdout:1/664: truncate d0/d6/d11/d1e/d2a/d34/d57/d66/f6a 921956 0 2024-04-26T21:08:08.218 INFO:tasks.workunit.client.1.smithi064.stdout:0/530: link dd/d10/d74/d1d/c6a dd/d21/cb5 0 2024-04-26T21:08:08.218 INFO:tasks.workunit.client.1.smithi064.stdout:0/531: write dd/d10/d1a/d31/f4b [535817,35607] 0 2024-04-26T21:08:08.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/444: mknod d0/d4/d5/d73/d13/d1a/d46/d72/d69/c9d 0 2024-04-26T21:08:08.230 INFO:tasks.workunit.client.1.smithi064.stdout:9/572: creat d0/d4/d7/df/da4/fb3 x:0 0 0 2024-04-26T21:08:08.230 INFO:tasks.workunit.client.1.smithi064.stdout:9/573: readlink d0/l8 0 2024-04-26T21:08:08.237 INFO:tasks.workunit.client.0.smithi055.stdout:6/367: rmdir d3/d17/d46/d54/d66/d6a/d51/d58/d73/d77 0 2024-04-26T21:08:08.242 INFO:tasks.workunit.client.1.smithi064.stdout:4/622: link d0/d1d/d21/lb0 d0/d5/d13/d10/db7/lcc 0 2024-04-26T21:08:08.246 INFO:tasks.workunit.client.1.smithi064.stdout:6/532: dwrite d4/d7/d12/d49/f5c [0,4194304] 0 2024-04-26T21:08:08.262 INFO:tasks.workunit.client.1.smithi064.stdout:3/527: dwrite d1/d27/d29/d6f/d72/d26/f58 [0,4194304] 0 2024-04-26T21:08:08.262 INFO:tasks.workunit.client.1.smithi064.stdout:3/528: fsync d1/d27/d50/f91 0 2024-04-26T21:08:08.268 INFO:tasks.workunit.client.1.smithi064.stdout:6/533: dread d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:08.332 INFO:tasks.workunit.client.0.smithi055.stdout:7/374: creat d5/d6/d24/d3b/d56/f6b x:0 0 0 2024-04-26T21:08:08.353 INFO:tasks.workunit.client.0.smithi055.stdout:5/285: link d4/df/f30 d4/df/d13/d26/d3c/d4a/d3f/d4f/f60 0 2024-04-26T21:08:08.353 INFO:tasks.workunit.client.0.smithi055.stdout:5/286: chown f2 648699 1 2024-04-26T21:08:08.359 INFO:tasks.workunit.client.0.smithi055.stdout:0/423: creat d9/d11/d5b/d5e/d67/f88 x:0 0 0 2024-04-26T21:08:08.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/445: link d0/d4/d5/d73/d13/d1a/d46/d72/f82 d0/d4/d5/d73/d13/d27/d50/d6b/f9e 0 2024-04-26T21:08:08.377 INFO:tasks.workunit.client.0.smithi055.stdout:7/375: getdents d5/d6/d24/d48 0 2024-04-26T21:08:08.380 INFO:tasks.workunit.client.0.smithi055.stdout:3/446: mknod d0/d4/d16/d18/d4b/d57/d8e/c9f 0 2024-04-26T21:08:08.381 INFO:tasks.workunit.client.1.smithi064.stdout:7/557: mkdir d6/db/dc1 0 2024-04-26T21:08:08.383 INFO:tasks.workunit.client.1.smithi064.stdout:1/665: getdents d0/d6/d76 0 2024-04-26T21:08:08.386 INFO:tasks.workunit.client.0.smithi055.stdout:7/376: mkdir d5/d6/d24/d3b/d56/d6c 0 2024-04-26T21:08:08.386 INFO:tasks.workunit.client.0.smithi055.stdout:3/447: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 x:0 0 0 2024-04-26T21:08:08.386 INFO:tasks.workunit.client.0.smithi055.stdout:3/448: chown d0/d4/d5/d73/d47/d37 23811 1 2024-04-26T21:08:08.391 INFO:tasks.workunit.client.0.smithi055.stdout:3/449: rmdir d0/d4/d5/d73/d13/d5c 39 2024-04-26T21:08:08.395 INFO:tasks.workunit.client.0.smithi055.stdout:3/450: write d0/d4/d16/f26 [5316586,73651] 0 2024-04-26T21:08:08.395 INFO:tasks.workunit.client.0.smithi055.stdout:3/451: chown d0/d4/d5/d73/d13/d1a/d46/d72/d69/c9d 19160421 1 2024-04-26T21:08:08.395 INFO:tasks.workunit.client.0.smithi055.stdout:3/452: fsync d0/d4/d16/d18/d4b/f89 0 2024-04-26T21:08:08.406 INFO:tasks.workunit.client.0.smithi055.stdout:3/453: dread d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:08.406 INFO:tasks.workunit.client.0.smithi055.stdout:3/454: stat d0/f34 0 2024-04-26T21:08:08.427 INFO:tasks.workunit.client.0.smithi055.stdout:5/287: dwrite d4/df/d13/d26/d3c/d4a/f5e [0,4194304] 0 2024-04-26T21:08:08.427 INFO:tasks.workunit.client.0.smithi055.stdout:5/288: chown d4/df/d13/d26 4 1 2024-04-26T21:08:08.473 INFO:tasks.workunit.client.0.smithi055.stdout:3/455: unlink d0/d4/d5/d73/d13/d1a/d46/d72/d69/f99 0 2024-04-26T21:08:08.478 INFO:tasks.workunit.client.1.smithi064.stdout:6/534: symlink d4/d7/d12/d49/d9e/lad 0 2024-04-26T21:08:08.484 INFO:tasks.workunit.client.0.smithi055.stdout:5/289: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f61 x:0 0 0 2024-04-26T21:08:08.484 INFO:tasks.workunit.client.0.smithi055.stdout:5/290: chown d4/df/d13/d26/d3c/d4a 621 1 2024-04-26T21:08:08.493 INFO:tasks.workunit.client.0.smithi055.stdout:3/456: symlink d0/d4/d5/d73/d13/d1a/la1 0 2024-04-26T21:08:08.495 INFO:tasks.workunit.client.0.smithi055.stdout:5/291: chown d4/df/f1b 0 1 2024-04-26T21:08:08.501 INFO:tasks.workunit.client.0.smithi055.stdout:3/457: write d0/d4/f44 [340388,50470] 0 2024-04-26T21:08:08.501 INFO:tasks.workunit.client.0.smithi055.stdout:5/292: truncate d4/df/d13/d26/d3c/d4a/f55 1514419 0 2024-04-26T21:08:08.502 INFO:tasks.workunit.client.0.smithi055.stdout:5/293: fsync d4/df/d13/f21 0 2024-04-26T21:08:08.502 INFO:tasks.workunit.client.0.smithi055.stdout:5/294: write d4/df/d13/d26/f58 [548347,75435] 0 2024-04-26T21:08:08.502 INFO:tasks.workunit.client.0.smithi055.stdout:5/295: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f62 x:0 0 0 2024-04-26T21:08:08.503 INFO:tasks.workunit.client.1.smithi064.stdout:3/529: mkdir d1/d27/d50/d35/db9 0 2024-04-26T21:08:08.503 INFO:tasks.workunit.client.1.smithi064.stdout:3/530: dread - d1/d27/d50/f74 zero size 2024-04-26T21:08:08.503 INFO:tasks.workunit.client.1.smithi064.stdout:3/531: readlink d1/d27/d29/d6f/d72/d7a/l65 0 2024-04-26T21:08:08.504 INFO:tasks.workunit.client.1.smithi064.stdout:7/558: mknod d6/db/d34/d41/d5c/cc2 0 2024-04-26T21:08:08.507 INFO:tasks.workunit.client.0.smithi055.stdout:3/458: creat d0/d4/d5/d73/d47/d37/d3d/fa2 x:0 0 0 2024-04-26T21:08:08.508 INFO:tasks.workunit.client.1.smithi064.stdout:1/666: mknod d0/d6b/d9e/da2/cce 0 2024-04-26T21:08:08.510 INFO:tasks.workunit.client.1.smithi064.stdout:4/623: getdents d0/d2f/d7d 0 2024-04-26T21:08:08.512 INFO:tasks.workunit.client.1.smithi064.stdout:6/535: symlink d4/d7/d12/d49/d4b/d5a/d79/lae 0 2024-04-26T21:08:08.512 INFO:tasks.workunit.client.1.smithi064.stdout:6/536: chown d4/d7/d12 52814195 1 2024-04-26T21:08:08.513 INFO:tasks.workunit.client.0.smithi055.stdout:5/296: mkdir d4/df/d13/d26/d63 0 2024-04-26T21:08:08.518 INFO:tasks.workunit.client.0.smithi055.stdout:3/459: mknod d0/d4/d5/d73/d13/d1a/ca3 0 2024-04-26T21:08:08.520 INFO:tasks.workunit.client.0.smithi055.stdout:5/297: mknod d4/df/d13/d26/c64 0 2024-04-26T21:08:08.522 INFO:tasks.workunit.client.0.smithi055.stdout:8/346: link d3/f46 d3/d9/d1f/f72 0 2024-04-26T21:08:08.524 INFO:tasks.workunit.client.1.smithi064.stdout:2/594: rmdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/dc6 0 2024-04-26T21:08:08.524 INFO:tasks.workunit.client.1.smithi064.stdout:1/667: dread d0/d6/d76/faf [0,4194304] 0 2024-04-26T21:08:08.524 INFO:tasks.workunit.client.1.smithi064.stdout:1/668: chown d0/d6/d91 24 1 2024-04-26T21:08:08.527 INFO:tasks.workunit.client.0.smithi055.stdout:5/298: link d4/df/d13/d26/d3c/d4a/l59 d4/df/d13/d26/d63/l65 0 2024-04-26T21:08:08.533 INFO:tasks.workunit.client.1.smithi064.stdout:7/559: creat d6/db/d8e/d90/fc3 x:0 0 0 2024-04-26T21:08:08.538 INFO:tasks.workunit.client.1.smithi064.stdout:6/537: mkdir d4/d7/d12/d49/d4b/d5a/daf 0 2024-04-26T21:08:08.540 INFO:tasks.workunit.client.1.smithi064.stdout:2/595: symlink d12/d41/d61/d75/lc7 0 2024-04-26T21:08:08.541 INFO:tasks.workunit.client.1.smithi064.stdout:2/596: stat d12/d41/d73/d83/d94/d3a/d5d/fc3 0 2024-04-26T21:08:08.541 INFO:tasks.workunit.client.1.smithi064.stdout:2/597: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fb1 [609870,10842] 0 2024-04-26T21:08:08.541 INFO:tasks.workunit.client.1.smithi064.stdout:2/598: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc [825922,10169] 0 2024-04-26T21:08:08.541 INFO:tasks.workunit.client.1.smithi064.stdout:2/599: creat d12/d41/d61/d6c/fc8 x:0 0 0 2024-04-26T21:08:08.541 INFO:tasks.workunit.client.1.smithi064.stdout:2/600: creat d12/d88/fc9 x:0 0 0 2024-04-26T21:08:08.543 INFO:tasks.workunit.client.1.smithi064.stdout:1/669: creat d0/d6/d76/fcf x:0 0 0 2024-04-26T21:08:08.543 INFO:tasks.workunit.client.1.smithi064.stdout:1/670: chown d0/d22/d9f 2446 1 2024-04-26T21:08:08.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/671: write d0/d6/d11/d1e/f82 [767463,61398] 0 2024-04-26T21:08:08.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/672: truncate d0/d6/d11/d1e/d27/f81 562606 0 2024-04-26T21:08:08.547 INFO:tasks.workunit.client.1.smithi064.stdout:7/560: truncate d6/d15/d1c/f25 873497 0 2024-04-26T21:08:08.548 INFO:tasks.workunit.client.1.smithi064.stdout:6/538: creat d4/d7/d12/d1e/fb0 x:0 0 0 2024-04-26T21:08:08.549 INFO:tasks.workunit.client.1.smithi064.stdout:6/539: chown d4/f2f 1 1 2024-04-26T21:08:08.550 INFO:tasks.workunit.client.1.smithi064.stdout:5/545: rmdir dd/d12/d18/d1a/d1f/d20/d87 0 2024-04-26T21:08:08.551 INFO:tasks.workunit.client.0.smithi055.stdout:5/299: dread d4/df/f30 [0,4194304] 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:3/532: read d1/d27/d50/f10 [996250,50490] 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:8/460: link d10/f47 d10/d41/d4e/d59/f96 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:8/461: readlink d10/d2f/l70 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:8/462: chown d10/d41/d44/c6b 1 1 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:2/601: unlink d12/d41/d61/d75/l36 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:2/602: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc 882091 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:2/603: stat d12/d41/d61/d6c/f9b 0 2024-04-26T21:08:08.556 INFO:tasks.workunit.client.1.smithi064.stdout:2/604: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l8c 0 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/540: rmdir d4/d7/d12/d49/d9e 39 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/541: write d4/d7/f69 [2330538,18855] 0 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/542: creat d4/d7/d12/d49/d4b/d5a/d79/fb1 x:0 0 0 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/543: readlink d4/d7/d33/l8a 0 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/544: truncate d4/d99/fa4 585764 0 2024-04-26T21:08:08.564 INFO:tasks.workunit.client.1.smithi064.stdout:2/605: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fa7 to d12/d41/d73/d83/d94/d3a/d46/d91/fca 0 2024-04-26T21:08:08.566 INFO:tasks.workunit.client.1.smithi064.stdout:4/624: write d0/d14/f6c [3051803,85101] 0 2024-04-26T21:08:08.566 INFO:tasks.workunit.client.1.smithi064.stdout:4/625: write d0/d14/f6c [2710492,80935] 0 2024-04-26T21:08:08.568 INFO:tasks.workunit.client.1.smithi064.stdout:2/606: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/lcb 0 2024-04-26T21:08:08.571 INFO:tasks.workunit.client.1.smithi064.stdout:4/626: mkdir d0/d1d/d17/d44/d45/da0/dcd 0 2024-04-26T21:08:08.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/607: creat d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fcc x:0 0 0 2024-04-26T21:08:08.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/608: chown d12/d45/fc5 63961 1 2024-04-26T21:08:08.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/609: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/c74 72816320 1 2024-04-26T21:08:08.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/610: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/c3b 496784 1 2024-04-26T21:08:08.578 INFO:tasks.workunit.client.1.smithi064.stdout:4/627: dread d0/d2f/d69/f77 [0,4194304] 0 2024-04-26T21:08:08.598 INFO:tasks.workunit.client.0.smithi055.stdout:2/451: unlink d4/d14/c5c 0 2024-04-26T21:08:08.598 INFO:tasks.workunit.client.0.smithi055.stdout:2/452: write d4/db/d1f/d46/f75 [779703,102474] 0 2024-04-26T21:08:08.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/414: rename d2/f53 to d2/d14/f86 0 2024-04-26T21:08:08.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/415: readlink d2/d11/l31 0 2024-04-26T21:08:08.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/416: write d2/d46/d51/f61 [298143,106641] 0 2024-04-26T21:08:08.602 INFO:tasks.workunit.client.0.smithi055.stdout:0/424: rename d9/dc/d17/f30 to d9/dc/d1c/d3e/f89 0 2024-04-26T21:08:08.604 INFO:tasks.workunit.client.0.smithi055.stdout:0/425: mknod d9/d11/d5b/d5e/d6c/d7a/c8a 0 2024-04-26T21:08:08.604 INFO:tasks.workunit.client.0.smithi055.stdout:0/426: fdatasync d9/dc/d17/f3f 0 2024-04-26T21:08:08.604 INFO:tasks.workunit.client.0.smithi055.stdout:0/427: rmdir d9/dc/d19 39 2024-04-26T21:08:08.606 INFO:tasks.workunit.client.1.smithi064.stdout:7/561: dwrite d6/f51 [8388608,4194304] 0 2024-04-26T21:08:08.606 INFO:tasks.workunit.client.1.smithi064.stdout:7/562: creat d6/d15/d67/d4d/fc4 x:0 0 0 2024-04-26T21:08:08.606 INFO:tasks.workunit.client.0.smithi055.stdout:0/428: write d9/dc/d1c/f85 [812393,64210] 0 2024-04-26T21:08:08.615 INFO:tasks.workunit.client.1.smithi064.stdout:3/533: dread d1/d27/f59 [0,4194304] 0 2024-04-26T21:08:08.615 INFO:tasks.workunit.client.1.smithi064.stdout:3/534: dread - d1/d38/fa7 zero size 2024-04-26T21:08:08.617 INFO:tasks.workunit.client.0.smithi055.stdout:5/300: dwrite d4/d15/f1f [0,4194304] 0 2024-04-26T21:08:08.617 INFO:tasks.workunit.client.0.smithi055.stdout:5/301: chown d4/df/d13/d26/d3c/d4a/f56 20 1 2024-04-26T21:08:08.618 INFO:tasks.workunit.client.1.smithi064.stdout:0/532: sync 2024-04-26T21:08:08.618 INFO:tasks.workunit.client.1.smithi064.stdout:9/574: sync 2024-04-26T21:08:08.622 INFO:tasks.workunit.client.0.smithi055.stdout:3/460: dwrite d0/d4/d5/d73/d47/f77 [0,4194304] 0 2024-04-26T21:08:08.628 INFO:tasks.workunit.client.1.smithi064.stdout:9/575: mknod d0/d4/da/d26/d47/cb4 0 2024-04-26T21:08:08.631 INFO:tasks.workunit.client.1.smithi064.stdout:3/535: dread d1/d27/d50/d35/d4c/f83 [0,4194304] 0 2024-04-26T21:08:08.634 INFO:tasks.workunit.client.0.smithi055.stdout:5/302: unlink d4/f27 0 2024-04-26T21:08:08.634 INFO:tasks.workunit.client.1.smithi064.stdout:3/536: fsync d1/d27/d50/f5b 0 2024-04-26T21:08:08.638 INFO:tasks.workunit.client.1.smithi064.stdout:9/576: creat d0/d4/d7/fb5 x:0 0 0 2024-04-26T21:08:08.642 INFO:tasks.workunit.client.0.smithi055.stdout:3/461: symlink d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/la4 0 2024-04-26T21:08:08.645 INFO:tasks.workunit.client.0.smithi055.stdout:5/303: symlink d4/d15/l66 0 2024-04-26T21:08:08.649 INFO:tasks.workunit.client.0.smithi055.stdout:1/372: sync 2024-04-26T21:08:08.649 INFO:tasks.workunit.client.0.smithi055.stdout:4/301: sync 2024-04-26T21:08:08.649 INFO:tasks.workunit.client.0.smithi055.stdout:6/368: sync 2024-04-26T21:08:08.655 INFO:tasks.workunit.client.0.smithi055.stdout:6/369: rename d3/d17/d19/d71/c45 to d3/d17/d46/d54/d66/d6a/d51/d58/d62/c82 0 2024-04-26T21:08:08.662 INFO:tasks.workunit.client.0.smithi055.stdout:6/370: rmdir d3/d17/d25 39 2024-04-26T21:08:08.669 INFO:tasks.workunit.client.1.smithi064.stdout:1/673: dwrite d0/d6/d11/fb0 [0,4194304] 0 2024-04-26T21:08:08.669 INFO:tasks.workunit.client.0.smithi055.stdout:1/373: rename d8/df/d11/c46 to d8/d17/c7e 0 2024-04-26T21:08:08.669 INFO:tasks.workunit.client.0.smithi055.stdout:1/374: creat d8/d17/d1b/d41/f7f x:0 0 0 2024-04-26T21:08:08.673 INFO:tasks.workunit.client.1.smithi064.stdout:6/545: dwrite d4/d7/d33/f81 [0,4194304] 0 2024-04-26T21:08:08.673 INFO:tasks.workunit.client.1.smithi064.stdout:6/546: chown d4/l15 2303908 1 2024-04-26T21:08:08.673 INFO:tasks.workunit.client.1.smithi064.stdout:6/547: stat d4/d7/d12/d49/d4b/fab 0 2024-04-26T21:08:08.673 INFO:tasks.workunit.client.1.smithi064.stdout:6/548: fdatasync d4/d7/f3a 0 2024-04-26T21:08:08.677 INFO:tasks.workunit.client.0.smithi055.stdout:2/453: dwrite d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:08.677 INFO:tasks.workunit.client.0.smithi055.stdout:2/454: dread - d4/d14/d33/f42 zero size 2024-04-26T21:08:08.677 INFO:tasks.workunit.client.0.smithi055.stdout:2/455: fsync d4/d1e/f6e 0 2024-04-26T21:08:08.683 INFO:tasks.workunit.client.0.smithi055.stdout:1/375: truncate d8/df/d11/d44/f79 3097639 0 2024-04-26T21:08:08.683 INFO:tasks.workunit.client.0.smithi055.stdout:1/376: write d8/df/d11/d6c/f73 [137865,22412] 0 2024-04-26T21:08:08.683 INFO:tasks.workunit.client.0.smithi055.stdout:1/377: truncate d8/df/d11/d27/d28/f4a 596727 0 2024-04-26T21:08:08.687 INFO:tasks.workunit.client.0.smithi055.stdout:2/456: creat d4/d55/d6c/f9e x:0 0 0 2024-04-26T21:08:08.695 INFO:tasks.workunit.client.0.smithi055.stdout:4/302: dread d4/f13 [0,4194304] 0 2024-04-26T21:08:08.695 INFO:tasks.workunit.client.0.smithi055.stdout:4/303: chown d4/d23/f25 49 1 2024-04-26T21:08:08.695 INFO:tasks.workunit.client.0.smithi055.stdout:4/304: write d4/d18/f47 [706118,91443] 0 2024-04-26T21:08:08.695 INFO:tasks.workunit.client.0.smithi055.stdout:4/305: fsync d4/d12/f43 0 2024-04-26T21:08:08.695 INFO:tasks.workunit.client.0.smithi055.stdout:4/306: readlink d4/d12/d15/l2a 0 2024-04-26T21:08:08.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/307: chown d4/ff 5929053 1 2024-04-26T21:08:08.696 INFO:tasks.workunit.client.1.smithi064.stdout:9/577: dread d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:08.698 INFO:tasks.workunit.client.0.smithi055.stdout:3/462: dread d0/f68 [0,4194304] 0 2024-04-26T21:08:08.699 INFO:tasks.workunit.client.0.smithi055.stdout:4/308: truncate d4/d12/f43 2596207 0 2024-04-26T21:08:08.703 INFO:tasks.workunit.client.1.smithi064.stdout:9/578: symlink d0/d4/da/lb6 0 2024-04-26T21:08:08.704 INFO:tasks.workunit.client.0.smithi055.stdout:5/304: read d4/d15/f1f [1979199,54669] 0 2024-04-26T21:08:08.705 INFO:tasks.workunit.client.0.smithi055.stdout:5/305: write d4/df/d13/f37 [2734002,88195] 0 2024-04-26T21:08:08.705 INFO:tasks.workunit.client.0.smithi055.stdout:5/306: dread - d4/f4d zero size 2024-04-26T21:08:08.710 INFO:tasks.workunit.client.1.smithi064.stdout:0/533: dwrite dd/d10/d18/d64/fa1 [0,4194304] 0 2024-04-26T21:08:08.712 INFO:tasks.workunit.client.1.smithi064.stdout:2/611: dwrite d12/d41/d73/d83/d94/f33 [4194304,4194304] 0 2024-04-26T21:08:08.712 INFO:tasks.workunit.client.0.smithi055.stdout:6/371: write d3/d17/d19/f3d [177309,43978] 0 2024-04-26T21:08:08.717 INFO:tasks.workunit.client.1.smithi064.stdout:7/563: dwrite d6/d15/d67/f94 [0,4194304] 0 2024-04-26T21:08:08.718 INFO:tasks.workunit.client.1.smithi064.stdout:9/579: symlink d0/d4/da/d26/d5d/lb7 0 2024-04-26T21:08:08.720 INFO:tasks.workunit.client.0.smithi055.stdout:7/377: sync 2024-04-26T21:08:08.720 INFO:tasks.workunit.client.0.smithi055.stdout:4/309: symlink d4/d26/d42/d56/l6d 0 2024-04-26T21:08:08.725 INFO:tasks.workunit.client.0.smithi055.stdout:5/307: readlink d4/df/l43 0 2024-04-26T21:08:08.729 INFO:tasks.workunit.client.0.smithi055.stdout:0/429: dwrite d9/dc/d1c/f85 [0,4194304] 0 2024-04-26T21:08:08.729 INFO:tasks.workunit.client.0.smithi055.stdout:0/430: truncate d9/dc/d1c/d3e/d7d/f86 698573 0 2024-04-26T21:08:08.730 INFO:tasks.workunit.client.0.smithi055.stdout:0/431: write d9/d11/d5b/d74/f2e [7455612,131030] 0 2024-04-26T21:08:08.730 INFO:tasks.workunit.client.0.smithi055.stdout:0/432: chown d9/dc/d1c/d3b/f6e 70574099 1 2024-04-26T21:08:08.730 INFO:tasks.workunit.client.0.smithi055.stdout:0/433: truncate d9/d11/d59/f7f 592219 0 2024-04-26T21:08:08.730 INFO:tasks.workunit.client.0.smithi055.stdout:0/434: write d9/dc/d17/d5d/f7c [964206,128838] 0 2024-04-26T21:08:08.730 INFO:tasks.workunit.client.0.smithi055.stdout:6/372: mkdir d3/d17/d46/d54/d66/d6a/d67/d83 0 2024-04-26T21:08:08.731 INFO:tasks.workunit.client.1.smithi064.stdout:6/549: dwrite d4/d7/d12/f68 [0,4194304] 0 2024-04-26T21:08:08.731 INFO:tasks.workunit.client.0.smithi055.stdout:0/435: truncate d9/d11/d5b/d5e/d6c/f84 820493 0 2024-04-26T21:08:08.732 INFO:tasks.workunit.client.0.smithi055.stdout:7/378: symlink d5/d6/d24/l6d 0 2024-04-26T21:08:08.734 INFO:tasks.workunit.client.1.smithi064.stdout:0/534: symlink dd/d10/d1a/d31/d43/lb6 0 2024-04-26T21:08:08.734 INFO:tasks.workunit.client.1.smithi064.stdout:0/535: chown dd/l56 4941493 1 2024-04-26T21:08:08.734 INFO:tasks.workunit.client.1.smithi064.stdout:0/536: creat dd/d10/d18/d64/fb7 x:0 0 0 2024-04-26T21:08:08.736 INFO:tasks.workunit.client.1.smithi064.stdout:7/564: getdents d6 0 2024-04-26T21:08:08.743 INFO:tasks.workunit.client.1.smithi064.stdout:1/674: dwrite d0/d6/d11/f7a [0,4194304] 0 2024-04-26T21:08:08.743 INFO:tasks.workunit.client.0.smithi055.stdout:9/417: dwrite d2/f55 [0,4194304] 0 2024-04-26T21:08:08.748 INFO:tasks.workunit.client.1.smithi064.stdout:3/537: dwrite d1/d27/d29/d6f/d72/d73/f90 [0,4194304] 0 2024-04-26T21:08:08.748 INFO:tasks.workunit.client.1.smithi064.stdout:3/538: chown d1/d27/l4a 102 1 2024-04-26T21:08:08.748 INFO:tasks.workunit.client.1.smithi064.stdout:3/539: creat d1/d27/fba x:0 0 0 2024-04-26T21:08:08.750 INFO:tasks.workunit.client.0.smithi055.stdout:6/373: symlink d3/d17/d46/d54/d66/d6a/d6b/l84 0 2024-04-26T21:08:08.757 INFO:tasks.workunit.client.1.smithi064.stdout:7/565: dread d6/db/d34/f5b [0,4194304] 0 2024-04-26T21:08:08.757 INFO:tasks.workunit.client.1.smithi064.stdout:7/566: stat d6/d9/d3d/f6e 0 2024-04-26T21:08:08.758 INFO:tasks.workunit.client.1.smithi064.stdout:7/567: fsync d6/d9/d38/fb4 0 2024-04-26T21:08:08.758 INFO:tasks.workunit.client.0.smithi055.stdout:0/436: mkdir d9/d8b 0 2024-04-26T21:08:08.770 INFO:tasks.workunit.client.0.smithi055.stdout:3/463: dwrite d0/d4/d5/d73/d13/f7e [0,4194304] 0 2024-04-26T21:08:08.771 INFO:tasks.workunit.client.0.smithi055.stdout:3/464: write d0/d4/d5/d73/d13/f1d [720752,45945] 0 2024-04-26T21:08:08.778 INFO:tasks.workunit.client.1.smithi064.stdout:6/550: mkdir d4/d7/d12/d49/d4b/d5a/daf/db2 0 2024-04-26T21:08:08.781 INFO:tasks.workunit.client.0.smithi055.stdout:6/374: dread d3/d17/d25/f2b [0,4194304] 0 2024-04-26T21:08:08.781 INFO:tasks.workunit.client.1.smithi064.stdout:3/540: write d1/d14/f3e [3624873,8303] 0 2024-04-26T21:08:08.785 INFO:tasks.workunit.client.0.smithi055.stdout:0/437: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:08:08.786 INFO:tasks.workunit.client.0.smithi055.stdout:2/457: dwrite d4/db/d1f/d46/f64 [0,4194304] 0 2024-04-26T21:08:08.786 INFO:tasks.workunit.client.0.smithi055.stdout:1/378: dread d8/df/d11/d6c/f73 [0,4194304] 0 2024-04-26T21:08:08.791 INFO:tasks.workunit.client.0.smithi055.stdout:5/308: write d4/df/f3b [2901409,93351] 0 2024-04-26T21:08:08.798 INFO:tasks.workunit.client.1.smithi064.stdout:1/675: unlink d0/d22/l80 0 2024-04-26T21:08:08.798 INFO:tasks.workunit.client.1.smithi064.stdout:1/676: dread - d0/d6/d91/d92/fbf zero size 2024-04-26T21:08:08.801 INFO:tasks.workunit.client.0.smithi055.stdout:9/418: dwrite d2/d11/f7e [0,4194304] 0 2024-04-26T21:08:08.801 INFO:tasks.workunit.client.0.smithi055.stdout:9/419: fsync d2/f5e 0 2024-04-26T21:08:08.808 INFO:tasks.workunit.client.0.smithi055.stdout:4/310: dwrite d4/d26/d42/d28/f44 [0,4194304] 0 2024-04-26T21:08:08.808 INFO:tasks.workunit.client.0.smithi055.stdout:4/311: creat d4/d12/d17/f6e x:0 0 0 2024-04-26T21:08:08.812 INFO:tasks.workunit.client.1.smithi064.stdout:7/568: creat d6/db/d34/d6f/d81/fc5 x:0 0 0 2024-04-26T21:08:08.812 INFO:tasks.workunit.client.1.smithi064.stdout:7/569: write d6/db/d34/d41/d5c/f7b [2089238,4682] 0 2024-04-26T21:08:08.812 INFO:tasks.workunit.client.1.smithi064.stdout:7/570: chown d6/d15/d67/d65/l79 2 1 2024-04-26T21:08:08.812 INFO:tasks.workunit.client.1.smithi064.stdout:7/571: fsync d6/d15/d67/d4d/fc4 0 2024-04-26T21:08:08.812 INFO:tasks.workunit.client.1.smithi064.stdout:7/572: write f5 [205726,115163] 0 2024-04-26T21:08:08.816 INFO:tasks.workunit.client.1.smithi064.stdout:6/551: symlink d4/d7/d12/lb3 0 2024-04-26T21:08:08.816 INFO:tasks.workunit.client.1.smithi064.stdout:6/552: read - d4/d7/d12/d49/d4b/fab zero size 2024-04-26T21:08:08.821 INFO:tasks.workunit.client.1.smithi064.stdout:0/537: mkdir dd/d21/db8 0 2024-04-26T21:08:08.822 INFO:tasks.workunit.client.0.smithi055.stdout:3/465: truncate d0/d4/d5/d73/d47/d37/f6f 830745 0 2024-04-26T21:08:08.827 INFO:tasks.workunit.client.1.smithi064.stdout:1/677: rename d0/d6/d76/fcf to d0/d6/d11/d1e/d2a/d34/d57/d66/fd0 0 2024-04-26T21:08:08.832 INFO:tasks.workunit.client.1.smithi064.stdout:8/463: sync 2024-04-26T21:08:08.833 INFO:tasks.workunit.client.1.smithi064.stdout:4/628: sync 2024-04-26T21:08:08.839 INFO:tasks.workunit.client.0.smithi055.stdout:2/458: creat d4/db/d26/f9f x:0 0 0 2024-04-26T21:08:08.840 INFO:tasks.workunit.client.0.smithi055.stdout:2/459: creat d4/d55/d6c/fa0 x:0 0 0 2024-04-26T21:08:08.840 INFO:tasks.workunit.client.0.smithi055.stdout:2/460: write d4/d55/d6c/fa0 [117779,13812] 0 2024-04-26T21:08:08.840 INFO:tasks.workunit.client.0.smithi055.stdout:2/461: chown d4/d14/d17/c5b 13 1 2024-04-26T21:08:08.842 INFO:tasks.workunit.client.1.smithi064.stdout:6/553: symlink d4/d7/d33/lb4 0 2024-04-26T21:08:08.842 INFO:tasks.workunit.client.1.smithi064.stdout:6/554: dread - d4/d7/d12/d49/d4b/d56/d95/fac zero size 2024-04-26T21:08:08.843 INFO:tasks.workunit.client.1.smithi064.stdout:1/678: write d0/d6/d11/d1e/f4f [841699,6103] 0 2024-04-26T21:08:08.843 INFO:tasks.workunit.client.1.smithi064.stdout:1/679: dread - d0/d6/f63 zero size 2024-04-26T21:08:08.844 INFO:tasks.workunit.client.0.smithi055.stdout:1/379: symlink d8/df/l80 0 2024-04-26T21:08:08.845 INFO:tasks.workunit.client.0.smithi055.stdout:1/380: creat d8/d17/d36/f81 x:0 0 0 2024-04-26T21:08:08.847 INFO:tasks.workunit.client.1.smithi064.stdout:7/573: rename d6/d15/f5d to d6/db/d34/d41/fc6 0 2024-04-26T21:08:08.847 INFO:tasks.workunit.client.1.smithi064.stdout:5/546: sync 2024-04-26T21:08:08.847 INFO:tasks.workunit.client.1.smithi064.stdout:5/547: fdatasync dd/d12/d18/d25/d32/f4a 0 2024-04-26T21:08:08.849 INFO:tasks.workunit.client.1.smithi064.stdout:8/464: mknod d10/d41/d4e/d59/c97 0 2024-04-26T21:08:08.858 INFO:tasks.workunit.client.1.smithi064.stdout:4/629: truncate d0/d1d/f2e 1896874 0 2024-04-26T21:08:08.868 INFO:tasks.workunit.client.1.smithi064.stdout:6/555: getdents d4/d7/d12/d38 0 2024-04-26T21:08:08.868 INFO:tasks.workunit.client.1.smithi064.stdout:6/556: chown d4/d7/f4d 13 1 2024-04-26T21:08:08.877 INFO:tasks.workunit.client.1.smithi064.stdout:8/465: read d10/d1d/f30 [927071,121560] 0 2024-04-26T21:08:08.877 INFO:tasks.workunit.client.1.smithi064.stdout:8/466: truncate d10/d41/d44/f6d 652489 0 2024-04-26T21:08:08.877 INFO:tasks.workunit.client.1.smithi064.stdout:8/467: creat d10/d1d/d38/f98 x:0 0 0 2024-04-26T21:08:08.879 INFO:tasks.workunit.client.1.smithi064.stdout:1/680: mkdir d0/d6/d29/d31/dd1 0 2024-04-26T21:08:08.881 INFO:tasks.workunit.client.0.smithi055.stdout:4/312: rename d4/d12/d15/f39 to d4/d12/d15/f6f 0 2024-04-26T21:08:08.881 INFO:tasks.workunit.client.0.smithi055.stdout:4/313: write d4/d12/d17/f6e [79545,103809] 0 2024-04-26T21:08:08.883 INFO:tasks.workunit.client.0.smithi055.stdout:5/309: dwrite d4/df/d13/d26/d3c/f3e [0,4194304] 0 2024-04-26T21:08:08.883 INFO:tasks.workunit.client.0.smithi055.stdout:7/379: rename d5/d6/d24/d3b/d56 to d5/d53/d6e 0 2024-04-26T21:08:08.883 INFO:tasks.workunit.client.0.smithi055.stdout:7/380: fsync d5/d6/d24/d3b/f3c 0 2024-04-26T21:08:08.883 INFO:tasks.workunit.client.0.smithi055.stdout:7/381: fdatasync d5/d6/d24/f47 0 2024-04-26T21:08:08.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/580: sync 2024-04-26T21:08:08.888 INFO:tasks.workunit.client.1.smithi064.stdout:2/612: sync 2024-04-26T21:08:08.888 INFO:tasks.workunit.client.1.smithi064.stdout:2/613: truncate d12/f9d 35600 0 2024-04-26T21:08:08.891 INFO:tasks.workunit.client.1.smithi064.stdout:4/630: creat d0/d5/fce x:0 0 0 2024-04-26T21:08:08.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/557: truncate d4/d7/f4d 67268 0 2024-04-26T21:08:08.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/558: stat d4/l4c 0 2024-04-26T21:08:08.895 INFO:tasks.workunit.client.1.smithi064.stdout:6/559: creat d4/d7/d12/d49/d4b/d5a/d79/fb5 x:0 0 0 2024-04-26T21:08:08.896 INFO:tasks.workunit.client.0.smithi055.stdout:6/375: rmdir d3/d17/d46 39 2024-04-26T21:08:08.896 INFO:tasks.workunit.client.0.smithi055.stdout:6/376: stat d3/d17/d19/d71/l70 0 2024-04-26T21:08:08.898 INFO:tasks.workunit.client.1.smithi064.stdout:7/574: dwrite d6/d9/f76 [0,4194304] 0 2024-04-26T21:08:08.898 INFO:tasks.workunit.client.1.smithi064.stdout:8/468: mknod d10/d2f/c99 0 2024-04-26T21:08:08.899 INFO:tasks.workunit.client.1.smithi064.stdout:5/548: dwrite dd/d12/d18/f36 [0,4194304] 0 2024-04-26T21:08:08.901 INFO:tasks.workunit.client.0.smithi055.stdout:2/462: mkdir d4/d55/da1 0 2024-04-26T21:08:08.908 INFO:tasks.workunit.client.1.smithi064.stdout:1/681: link d0/d6/d11/d1e/d2a/d34/f75 d0/d6/d11/d2c/d9c/dbc/fd2 0 2024-04-26T21:08:08.911 INFO:tasks.workunit.client.0.smithi055.stdout:1/381: link d8/df/f6e d8/d17/d33/f82 0 2024-04-26T21:08:08.911 INFO:tasks.workunit.client.0.smithi055.stdout:0/438: dwrite d9/dc/d1c/d54/d4b/d68/f6d [0,4194304] 0 2024-04-26T21:08:08.912 INFO:tasks.workunit.client.0.smithi055.stdout:8/347: sync 2024-04-26T21:08:08.917 INFO:tasks.workunit.client.0.smithi055.stdout:4/314: truncate d4/f13 3777378 0 2024-04-26T21:08:08.920 INFO:tasks.workunit.client.0.smithi055.stdout:7/382: mkdir d5/d53/d67/d6f 0 2024-04-26T21:08:08.920 INFO:tasks.workunit.client.0.smithi055.stdout:7/383: truncate d5/d6/ff 659013 0 2024-04-26T21:08:08.920 INFO:tasks.workunit.client.1.smithi064.stdout:2/614: creat d12/fcd x:0 0 0 2024-04-26T21:08:08.920 INFO:tasks.workunit.client.1.smithi064.stdout:4/631: mkdir d0/d5/d13/d33/dcf 0 2024-04-26T21:08:08.923 INFO:tasks.workunit.client.0.smithi055.stdout:6/377: creat d3/d17/d46/d54/d66/d6a/d51/f85 x:0 0 0 2024-04-26T21:08:08.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/382: truncate d8/df/f24 2263660 0 2024-04-26T21:08:08.929 INFO:tasks.workunit.client.1.smithi064.stdout:7/575: mkdir d6/db/d34/dc7 0 2024-04-26T21:08:08.929 INFO:tasks.workunit.client.1.smithi064.stdout:8/469: mknod d10/d2f/d61/c9a 0 2024-04-26T21:08:08.929 INFO:tasks.workunit.client.1.smithi064.stdout:8/470: creat d10/d41/d53/f9b x:0 0 0 2024-04-26T21:08:08.930 INFO:tasks.workunit.client.0.smithi055.stdout:8/348: link d3/d9/d1f/d2e/c69 d3/d9/d44/c73 0 2024-04-26T21:08:08.930 INFO:tasks.workunit.client.0.smithi055.stdout:8/349: write d3/d9/f2b [1545941,44593] 0 2024-04-26T21:08:08.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/439: symlink d9/d11/d5b/d5e/d67/l8c 0 2024-04-26T21:08:08.935 INFO:tasks.workunit.client.1.smithi064.stdout:5/549: unlink f0 0 2024-04-26T21:08:08.936 INFO:tasks.workunit.client.0.smithi055.stdout:7/384: symlink d5/d6/d24/d48/l70 0 2024-04-26T21:08:08.936 INFO:tasks.workunit.client.0.smithi055.stdout:6/378: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86 0 2024-04-26T21:08:08.942 INFO:tasks.workunit.client.1.smithi064.stdout:4/632: mkdir d0/d5/d13/d33/dd0 0 2024-04-26T21:08:08.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/615: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l90 to d12/d41/d73/d83/d94/d3a/d46/d91/d96/lce 0 2024-04-26T21:08:08.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/616: write d12/d41/d73/d83/d94/d3a/d46/f80 [266561,110474] 0 2024-04-26T21:08:08.953 INFO:tasks.workunit.client.0.smithi055.stdout:3/466: write d0/d4/d16/d18/f5d [984756,120369] 0 2024-04-26T21:08:08.955 INFO:tasks.workunit.client.0.smithi055.stdout:9/420: dwrite d2/d46/d77/d5f/f67 [0,4194304] 0 2024-04-26T21:08:08.958 INFO:tasks.workunit.client.1.smithi064.stdout:7/576: rmdir d6/d15/d1c 39 2024-04-26T21:08:08.961 INFO:tasks.workunit.client.0.smithi055.stdout:8/350: symlink d3/l74 0 2024-04-26T21:08:08.966 INFO:tasks.workunit.client.0.smithi055.stdout:3/467: rename d0/d4/d5/d73/d13/l86 to d0/la5 0 2024-04-26T21:08:08.966 INFO:tasks.workunit.client.0.smithi055.stdout:2/463: write d4/db/f25 [3176076,127240] 0 2024-04-26T21:08:08.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/471: symlink d10/d1d/d38/l9c 0 2024-04-26T21:08:08.978 INFO:tasks.workunit.client.0.smithi055.stdout:6/379: read d3/d17/d25/f39 [2658976,59050] 0 2024-04-26T21:08:08.986 INFO:tasks.workunit.client.1.smithi064.stdout:5/550: mkdir dd/d12/d18/d25/d67/db3 0 2024-04-26T21:08:08.987 INFO:tasks.workunit.client.0.smithi055.stdout:2/464: link d4/d1e/f4f d4/d55/d6c/fa2 0 2024-04-26T21:08:08.988 INFO:tasks.workunit.client.1.smithi064.stdout:6/560: dwrite d4/d7/d12/d49/d4b/d56/d95/f9a [0,4194304] 0 2024-04-26T21:08:08.988 INFO:tasks.workunit.client.1.smithi064.stdout:1/682: dwrite d0/d6/d11/d1e/d2a/d34/d57/f96 [0,4194304] 0 2024-04-26T21:08:08.989 INFO:tasks.workunit.client.0.smithi055.stdout:1/383: dwrite d8/df/d11/d27/d28/f72 [4194304,4194304] 0 2024-04-26T21:08:08.991 INFO:tasks.workunit.client.1.smithi064.stdout:3/541: sync 2024-04-26T21:08:08.991 INFO:tasks.workunit.client.1.smithi064.stdout:9/581: link d0/d4/d7/df/l66 d0/d4/da/d26/lb8 0 2024-04-26T21:08:08.991 INFO:tasks.workunit.client.1.smithi064.stdout:9/582: stat d0/d4/d7/df/da4 0 2024-04-26T21:08:08.992 INFO:tasks.workunit.client.1.smithi064.stdout:0/538: sync 2024-04-26T21:08:08.992 INFO:tasks.workunit.client.0.smithi055.stdout:6/380: creat d3/d4f/f87 x:0 0 0 2024-04-26T21:08:08.992 INFO:tasks.workunit.client.0.smithi055.stdout:6/381: chown d3/d17/d19/f36 91885408 1 2024-04-26T21:08:08.994 INFO:tasks.workunit.client.1.smithi064.stdout:2/617: unlink d12/f9d 0 2024-04-26T21:08:08.994 INFO:tasks.workunit.client.1.smithi064.stdout:2/618: stat d12/d41/d73/d83/d94/d3a/c95 0 2024-04-26T21:08:08.996 INFO:tasks.workunit.client.0.smithi055.stdout:8/351: rmdir d3/d9/d1f/d2e 39 2024-04-26T21:08:08.998 INFO:tasks.workunit.client.1.smithi064.stdout:7/577: link d6/db/c3c d6/cc8 0 2024-04-26T21:08:09.001 INFO:tasks.workunit.client.0.smithi055.stdout:2/465: symlink d4/d55/la3 0 2024-04-26T21:08:09.001 INFO:tasks.workunit.client.0.smithi055.stdout:2/466: chown d4/d55 57 1 2024-04-26T21:08:09.002 INFO:tasks.workunit.client.1.smithi064.stdout:8/472: rmdir d10 39 2024-04-26T21:08:09.003 INFO:tasks.workunit.client.0.smithi055.stdout:5/310: dwrite d4/fd [0,4194304] 0 2024-04-26T21:08:09.010 INFO:tasks.workunit.client.1.smithi064.stdout:6/561: write d4/d7/d12/d1e/f63 [2534034,44412] 0 2024-04-26T21:08:09.011 INFO:tasks.workunit.client.0.smithi055.stdout:1/384: chown d8/df/d11/l1c 773703561 1 2024-04-26T21:08:09.011 INFO:tasks.workunit.client.0.smithi055.stdout:0/440: dread d9/dc/d1c/f85 [0,4194304] 0 2024-04-26T21:08:09.011 INFO:tasks.workunit.client.0.smithi055.stdout:0/441: write d9/dc/d17/f79 [4673452,125353] 0 2024-04-26T21:08:09.015 INFO:tasks.workunit.client.0.smithi055.stdout:6/382: truncate d3/d17/d19/f1e 509739 0 2024-04-26T21:08:09.017 INFO:tasks.workunit.client.0.smithi055.stdout:9/421: write d2/d46/d77/d5f/f69 [1843422,3072] 0 2024-04-26T21:08:09.018 INFO:tasks.workunit.client.0.smithi055.stdout:4/315: dwrite d4/f4b [0,4194304] 0 2024-04-26T21:08:09.018 INFO:tasks.workunit.client.0.smithi055.stdout:4/316: chown d4/d26/d42/d2d/f3a 13834523 1 2024-04-26T21:08:09.021 INFO:tasks.workunit.client.0.smithi055.stdout:2/467: unlink d4/db/d1f/c22 0 2024-04-26T21:08:09.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/385: dwrite d5/d11/f1a [0,4194304] 0 2024-04-26T21:08:09.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/386: write d5/d6/d24/f4b [914220,40111] 0 2024-04-26T21:08:09.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/387: write d5/d6/d24/d52/f5e [990604,114489] 0 2024-04-26T21:08:09.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/388: dread - d5/d6/d24/d48/d58/f5f zero size 2024-04-26T21:08:09.027 INFO:tasks.workunit.client.1.smithi064.stdout:1/683: creat d0/fd3 x:0 0 0 2024-04-26T21:08:09.027 INFO:tasks.workunit.client.1.smithi064.stdout:1/684: dread - d0/d6/dd/f97 zero size 2024-04-26T21:08:09.028 INFO:tasks.workunit.client.1.smithi064.stdout:1/685: creat d0/d22/d9f/fd4 x:0 0 0 2024-04-26T21:08:09.028 INFO:tasks.workunit.client.1.smithi064.stdout:1/686: fsync d0/d6/d11/d1e/d2a/d34/f8e 0 2024-04-26T21:08:09.028 INFO:tasks.workunit.client.1.smithi064.stdout:1/687: fdatasync d0/d6/d11/d1e/d2a/d34/f79 0 2024-04-26T21:08:09.028 INFO:tasks.workunit.client.0.smithi055.stdout:5/311: symlink d4/df/d13/d26/d3c/d4a/d3f/d5c/l67 0 2024-04-26T21:08:09.031 INFO:tasks.workunit.client.1.smithi064.stdout:3/542: unlink d1/fb7 0 2024-04-26T21:08:09.033 INFO:tasks.workunit.client.1.smithi064.stdout:0/539: rename fc to dd/d10/d1a/d31/d43/fb9 0 2024-04-26T21:08:09.034 INFO:tasks.workunit.client.0.smithi055.stdout:0/442: mknod d9/d11/d5b/d5e/d6c/c8d 0 2024-04-26T21:08:09.037 INFO:tasks.workunit.client.1.smithi064.stdout:2/619: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/lcf 0 2024-04-26T21:08:09.038 INFO:tasks.workunit.client.0.smithi055.stdout:6/383: symlink d3/d17/d46/d54/d66/d6a/d51/l88 0 2024-04-26T21:08:09.038 INFO:tasks.workunit.client.0.smithi055.stdout:6/384: write d3/d17/f18 [4883831,93343] 0 2024-04-26T21:08:09.040 INFO:tasks.workunit.client.1.smithi064.stdout:7/578: creat d6/d8c/d9e/fc9 x:0 0 0 2024-04-26T21:08:09.040 INFO:tasks.workunit.client.0.smithi055.stdout:1/385: read d8/df/d11/d44/f54 [3008455,130890] 0 2024-04-26T21:08:09.040 INFO:tasks.workunit.client.0.smithi055.stdout:1/386: truncate d8/d17/f77 919985 0 2024-04-26T21:08:09.041 INFO:tasks.workunit.client.0.smithi055.stdout:1/387: fdatasync d8/d17/d1b/d7b/d65/f71 0 2024-04-26T21:08:09.043 INFO:tasks.workunit.client.0.smithi055.stdout:1/388: dread - d8/df/d11/d27/d28/f6d zero size 2024-04-26T21:08:09.044 INFO:tasks.workunit.client.0.smithi055.stdout:3/468: dwrite d0/d4/f64 [0,4194304] 0 2024-04-26T21:08:09.044 INFO:tasks.workunit.client.0.smithi055.stdout:3/469: readlink d0/d4/d5/d73/d13/d27/d3b/l3e 0 2024-04-26T21:08:09.045 INFO:tasks.workunit.client.1.smithi064.stdout:5/551: rmdir dd 39 2024-04-26T21:08:09.048 INFO:tasks.workunit.client.1.smithi064.stdout:8/473: symlink d10/d41/d44/d5a/l9d 0 2024-04-26T21:08:09.050 INFO:tasks.workunit.client.0.smithi055.stdout:6/385: dread d3/f9 [0,4194304] 0 2024-04-26T21:08:09.051 INFO:tasks.workunit.client.0.smithi055.stdout:9/422: unlink d2/d11/f7e 0 2024-04-26T21:08:09.051 INFO:tasks.workunit.client.0.smithi055.stdout:6/386: write d3/d17/d19/f41 [302729,5232] 0 2024-04-26T21:08:09.051 INFO:tasks.workunit.client.0.smithi055.stdout:6/387: chown d3/d4f 64280 1 2024-04-26T21:08:09.051 INFO:tasks.workunit.client.1.smithi064.stdout:3/543: write d1/d27/d29/f67 [1965221,97850] 0 2024-04-26T21:08:09.055 INFO:tasks.workunit.client.1.smithi064.stdout:6/562: creat d4/d7/d12/d49/d9e/fb6 x:0 0 0 2024-04-26T21:08:09.056 INFO:tasks.workunit.client.0.smithi055.stdout:4/317: mkdir d4/d26/d42/d28/d53/d70 0 2024-04-26T21:08:09.056 INFO:tasks.workunit.client.0.smithi055.stdout:4/318: chown d4/d23/f3b 464 1 2024-04-26T21:08:09.064 INFO:tasks.workunit.client.0.smithi055.stdout:2/468: mkdir d4/db/d26/da4 0 2024-04-26T21:08:09.064 INFO:tasks.workunit.client.0.smithi055.stdout:2/469: truncate d4/db/d56/f7c 3882809 0 2024-04-26T21:08:09.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/540: truncate dd/d10/f7d 2159842 0 2024-04-26T21:08:09.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/541: fdatasync dd/d10/d18/d64/fb0 0 2024-04-26T21:08:09.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/542: read - dd/d10/d1a/f9c zero size 2024-04-26T21:08:09.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/543: chown dd/d10/d1a/d31/d47/d61 3992 1 2024-04-26T21:08:09.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/544: fsync dd/d10/d1a/d31/f7a 0 2024-04-26T21:08:09.074 INFO:tasks.workunit.client.1.smithi064.stdout:2/620: mknod d12/d41/d61/d6c/cd0 0 2024-04-26T21:08:09.074 INFO:tasks.workunit.client.1.smithi064.stdout:2/621: readlink d12/d41/d73/l7a 0 2024-04-26T21:08:09.079 INFO:tasks.workunit.client.0.smithi055.stdout:7/389: mknod d5/d6/c71 0 2024-04-26T21:08:09.085 INFO:tasks.workunit.client.0.smithi055.stdout:5/312: mknod d4/df/d13/d26/d63/c68 0 2024-04-26T21:08:09.085 INFO:tasks.workunit.client.0.smithi055.stdout:5/313: chown d4/df/d13/d26/c5a 947633 1 2024-04-26T21:08:09.085 INFO:tasks.workunit.client.0.smithi055.stdout:5/314: readlink d4/df/d13/d26/d63/l65 0 2024-04-26T21:08:09.088 INFO:tasks.workunit.client.0.smithi055.stdout:1/389: dwrite d8/df/d11/f37 [0,4194304] 0 2024-04-26T21:08:09.088 INFO:tasks.workunit.client.0.smithi055.stdout:1/390: readlink d8/l1a 0 2024-04-26T21:08:09.097 INFO:tasks.workunit.client.0.smithi055.stdout:0/443: creat d9/d11/d5b/d5e/f8e x:0 0 0 2024-04-26T21:08:09.097 INFO:tasks.workunit.client.0.smithi055.stdout:0/444: write d9/dc/f10 [15988,108050] 0 2024-04-26T21:08:09.100 INFO:tasks.workunit.client.1.smithi064.stdout:6/563: getdents d4/d7/d12/d49/d4b/d5a/d79/d9b 0 2024-04-26T21:08:09.100 INFO:tasks.workunit.client.1.smithi064.stdout:6/564: readlink d4/l7c 0 2024-04-26T21:08:09.100 INFO:tasks.workunit.client.1.smithi064.stdout:3/544: write d1/d27/d50/f21 [2725042,110284] 0 2024-04-26T21:08:09.100 INFO:tasks.workunit.client.1.smithi064.stdout:1/688: write d0/d6/f8f [2025144,24944] 0 2024-04-26T21:08:09.101 INFO:tasks.workunit.client.1.smithi064.stdout:1/689: write d0/d6/d11/d1e/d2a/d34/d57/d66/f6a [686865,95600] 0 2024-04-26T21:08:09.101 INFO:tasks.workunit.client.1.smithi064.stdout:1/690: stat d0/d6/d11/l6f 0 2024-04-26T21:08:09.102 INFO:tasks.workunit.client.0.smithi055.stdout:9/423: creat d2/d46/d77/d79/f87 x:0 0 0 2024-04-26T21:08:09.102 INFO:tasks.workunit.client.0.smithi055.stdout:9/424: chown d2/d11/c20 3350 1 2024-04-26T21:08:09.102 INFO:tasks.workunit.client.1.smithi064.stdout:0/545: mkdir dd/d10/d18/d58/dba 0 2024-04-26T21:08:09.105 INFO:tasks.workunit.client.0.smithi055.stdout:6/388: truncate d3/d17/f32 1924615 0 2024-04-26T21:08:09.106 INFO:tasks.workunit.client.1.smithi064.stdout:7/579: dwrite d6/db/d34/d41/f49 [0,4194304] 0 2024-04-26T21:08:09.106 INFO:tasks.workunit.client.1.smithi064.stdout:7/580: chown d6/d9/d3d/f6e 15884451 1 2024-04-26T21:08:09.106 INFO:tasks.workunit.client.1.smithi064.stdout:7/581: write d6/d9/f36 [563186,122792] 0 2024-04-26T21:08:09.106 INFO:tasks.workunit.client.1.smithi064.stdout:7/582: fdatasync d6/d9/d3d/fba 0 2024-04-26T21:08:09.108 INFO:tasks.workunit.client.0.smithi055.stdout:4/319: mkdir d4/d26/d42/d28/d53/d71 0 2024-04-26T21:08:09.111 INFO:tasks.workunit.client.0.smithi055.stdout:8/352: rename d3/d9/d1f/d5a to d3/d9/d1f/d2e/d75 0 2024-04-26T21:08:09.115 INFO:tasks.workunit.client.1.smithi064.stdout:5/552: link dd/d12/d18/d25/d32/f8c dd/da9/d48/d56/fb4 0 2024-04-26T21:08:09.115 INFO:tasks.workunit.client.1.smithi064.stdout:8/474: dwrite d10/f24 [0,4194304] 0 2024-04-26T21:08:09.117 INFO:tasks.workunit.client.0.smithi055.stdout:1/391: symlink d8/d17/d1b/d7b/d65/l83 0 2024-04-26T21:08:09.121 INFO:tasks.workunit.client.1.smithi064.stdout:9/583: dwrite d0/d4/d7/df/fac [0,4194304] 0 2024-04-26T21:08:09.121 INFO:tasks.workunit.client.1.smithi064.stdout:9/584: chown d0/d4/da/d26/d45/d90/ca1 993783 1 2024-04-26T21:08:09.121 INFO:tasks.workunit.client.1.smithi064.stdout:9/585: rename d0/d4 to d0/d4/da/d26/d45/d90/db9 22 2024-04-26T21:08:09.123 INFO:tasks.workunit.client.0.smithi055.stdout:9/425: mknod d2/d46/d77/d5f/c88 0 2024-04-26T21:08:09.128 INFO:tasks.workunit.client.0.smithi055.stdout:8/353: write d3/d9/d44/f58 [533663,18214] 0 2024-04-26T21:08:09.128 INFO:tasks.workunit.client.0.smithi055.stdout:8/354: fdatasync d3/d9/d1f/f29 0 2024-04-26T21:08:09.128 INFO:tasks.workunit.client.0.smithi055.stdout:3/470: rename d0/d4/d5/d73/d13/d5c/d92 to d0/d4/d5/d73/d47/d37/da6 0 2024-04-26T21:08:09.128 INFO:tasks.workunit.client.1.smithi064.stdout:3/545: symlink d1/d38/lbb 0 2024-04-26T21:08:09.129 INFO:tasks.workunit.client.1.smithi064.stdout:1/691: creat d0/d6b/fd5 x:0 0 0 2024-04-26T21:08:09.135 INFO:tasks.workunit.client.0.smithi055.stdout:1/392: mkdir d8/df/d11/d27/d84 0 2024-04-26T21:08:09.135 INFO:tasks.workunit.client.0.smithi055.stdout:1/393: fsync d8/f35 0 2024-04-26T21:08:09.139 INFO:tasks.workunit.client.0.smithi055.stdout:0/445: dread d9/dc/d17/f5f [0,4194304] 0 2024-04-26T21:08:09.143 INFO:tasks.workunit.client.1.smithi064.stdout:8/475: write d10/d41/d44/f6d [106851,53698] 0 2024-04-26T21:08:09.143 INFO:tasks.workunit.client.1.smithi064.stdout:8/476: chown d10/l2a 1731 1 2024-04-26T21:08:09.147 INFO:tasks.workunit.client.0.smithi055.stdout:9/426: getdents d2 0 2024-04-26T21:08:09.147 INFO:tasks.workunit.client.0.smithi055.stdout:9/427: chown d2/d46/d77/f58 10 1 2024-04-26T21:08:09.153 INFO:tasks.workunit.client.1.smithi064.stdout:7/583: getdents d6/db/d34/d6f 0 2024-04-26T21:08:09.162 INFO:tasks.workunit.client.0.smithi055.stdout:3/471: mkdir d0/d4/d5/d73/d13/d1a/d46/d72/d69/da7 0 2024-04-26T21:08:09.164 INFO:tasks.workunit.client.0.smithi055.stdout:8/355: mkdir d3/d9/d1f/d2e/d75/d76 0 2024-04-26T21:08:09.171 INFO:tasks.workunit.client.0.smithi055.stdout:1/394: link d8/df/l80 d8/d17/d6a/l85 0 2024-04-26T21:08:09.171 INFO:tasks.workunit.client.0.smithi055.stdout:1/395: readlink d8/l1a 0 2024-04-26T21:08:09.171 INFO:tasks.workunit.client.0.smithi055.stdout:1/396: truncate d8/df/d11/d27/d63/f66 575894 0 2024-04-26T21:08:09.173 INFO:tasks.workunit.client.0.smithi055.stdout:0/446: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:09.173 INFO:tasks.workunit.client.0.smithi055.stdout:0/447: dread - d9/dc/d1c/d3b/f60 zero size 2024-04-26T21:08:09.173 INFO:tasks.workunit.client.0.smithi055.stdout:0/448: write d9/dc/d17/f45 [5366010,115201] 0 2024-04-26T21:08:09.173 INFO:tasks.workunit.client.0.smithi055.stdout:0/449: chown d9/dc/d17/d5d/f7c 6 1 2024-04-26T21:08:09.174 INFO:tasks.workunit.client.1.smithi064.stdout:2/622: dwrite d12/d41/d73/d83/d94/d3a/f79 [0,4194304] 0 2024-04-26T21:08:09.178 INFO:tasks.workunit.client.0.smithi055.stdout:4/320: dwrite d4/d12/f3e [0,4194304] 0 2024-04-26T21:08:09.178 INFO:tasks.workunit.client.0.smithi055.stdout:4/321: write d4/f9 [1908575,75530] 0 2024-04-26T21:08:09.180 INFO:tasks.workunit.client.0.smithi055.stdout:2/470: dwrite d4/d49/d4c/f99 [0,4194304] 0 2024-04-26T21:08:09.183 INFO:tasks.workunit.client.0.smithi055.stdout:9/428: rename d2/d14/f43 to d2/d46/d77/f89 0 2024-04-26T21:08:09.188 INFO:tasks.workunit.client.0.smithi055.stdout:5/315: dwrite d4/df/d13/d26/d3c/d4a/d3f/d4f/f60 [0,4194304] 0 2024-04-26T21:08:09.188 INFO:tasks.workunit.client.0.smithi055.stdout:5/316: write d4/f4d [553042,16058] 0 2024-04-26T21:08:09.190 INFO:tasks.workunit.client.1.smithi064.stdout:9/586: symlink d0/d4/da/d26/d47/d9d/d76/lba 0 2024-04-26T21:08:09.190 INFO:tasks.workunit.client.1.smithi064.stdout:9/587: creat d0/d4/da/d26/d45/fbb x:0 0 0 2024-04-26T21:08:09.190 INFO:tasks.workunit.client.1.smithi064.stdout:6/565: dwrite d4/d7/fe [0,4194304] 0 2024-04-26T21:08:09.191 INFO:tasks.workunit.client.1.smithi064.stdout:6/566: fsync d4/d7/d12/d49/f5c 0 2024-04-26T21:08:09.191 INFO:tasks.workunit.client.1.smithi064.stdout:6/567: dread - d4/d7/d12/d49/d4b/d56/f96 zero size 2024-04-26T21:08:09.191 INFO:tasks.workunit.client.1.smithi064.stdout:6/568: write d4/d7/d12/d49/d4b/d56/f70 [100515,47332] 0 2024-04-26T21:08:09.194 INFO:tasks.workunit.client.1.smithi064.stdout:3/546: symlink d1/d27/d29/d6f/d72/d7a/d84/lbc 0 2024-04-26T21:08:09.194 INFO:tasks.workunit.client.0.smithi055.stdout:3/472: write d0/d4/d5/d73/d13/f7e [1972664,39155] 0 2024-04-26T21:08:09.195 INFO:tasks.workunit.client.0.smithi055.stdout:3/473: write d0/f68 [4558945,118134] 0 2024-04-26T21:08:09.195 INFO:tasks.workunit.client.0.smithi055.stdout:3/474: write d0/d4/d16/d18/d4b/f89 [955364,40003] 0 2024-04-26T21:08:09.199 INFO:tasks.workunit.client.0.smithi055.stdout:1/397: creat d8/f86 x:0 0 0 2024-04-26T21:08:09.199 INFO:tasks.workunit.client.0.smithi055.stdout:1/398: fsync d8/f12 0 2024-04-26T21:08:09.202 INFO:tasks.workunit.client.1.smithi064.stdout:1/692: rename d0/fd3 to d0/d6/dd/fd6 0 2024-04-26T21:08:09.203 INFO:tasks.workunit.client.1.smithi064.stdout:1/693: stat d0/d6/d11/d1e/d2a/d34/d57 0 2024-04-26T21:08:09.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/450: creat d9/dc/f8f x:0 0 0 2024-04-26T21:08:09.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/451: chown d9/dc/d17/l1b 314568 1 2024-04-26T21:08:09.206 INFO:tasks.workunit.client.0.smithi055.stdout:0/452: dread - d9/d11/d5b/d5e/f8e zero size 2024-04-26T21:08:09.206 INFO:tasks.workunit.client.0.smithi055.stdout:0/453: chown d9/d8b 214802736 1 2024-04-26T21:08:09.210 INFO:tasks.workunit.client.1.smithi064.stdout:0/546: symlink dd/d21/lbb 0 2024-04-26T21:08:09.227 INFO:tasks.workunit.client.1.smithi064.stdout:8/477: creat d10/f9e x:0 0 0 2024-04-26T21:08:09.228 INFO:tasks.workunit.client.1.smithi064.stdout:7/584: unlink d6/d70/d74/d99/lb6 0 2024-04-26T21:08:09.238 INFO:tasks.workunit.client.1.smithi064.stdout:2/623: symlink d12/da9/ld1 0 2024-04-26T21:08:09.239 INFO:tasks.workunit.client.0.smithi055.stdout:5/317: symlink d4/df/d13/l69 0 2024-04-26T21:08:09.244 INFO:tasks.workunit.client.1.smithi064.stdout:4/633: sync 2024-04-26T21:08:09.246 INFO:tasks.workunit.client.1.smithi064.stdout:6/569: stat d4/d7/d33/c57 0 2024-04-26T21:08:09.246 INFO:tasks.workunit.client.1.smithi064.stdout:6/570: truncate d4/d7/d12/d49/d4b/d5a/d79/fb5 124975 0 2024-04-26T21:08:09.247 INFO:tasks.workunit.client.0.smithi055.stdout:3/475: dwrite d0/d4/f44 [0,4194304] 0 2024-04-26T21:08:09.247 INFO:tasks.workunit.client.0.smithi055.stdout:8/356: mkdir d3/d77 0 2024-04-26T21:08:09.250 INFO:tasks.workunit.client.0.smithi055.stdout:7/390: dwrite d5/f32 [0,4194304] 0 2024-04-26T21:08:09.251 INFO:tasks.workunit.client.1.smithi064.stdout:3/547: truncate d1/d38/f8f 482970 0 2024-04-26T21:08:09.251 INFO:tasks.workunit.client.1.smithi064.stdout:3/548: creat d1/d27/d29/d5e/fbd x:0 0 0 2024-04-26T21:08:09.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:09 smithi055 ceph-mon[25475]: pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 230 MiB/s rd, 276 MiB/s wr, 403 op/s 2024-04-26T21:08:09.259 INFO:tasks.workunit.client.1.smithi064.stdout:7/585: rename d6/db/d34/d41 to d6/d15/d88/dca 0 2024-04-26T21:08:09.259 INFO:tasks.workunit.client.1.smithi064.stdout:7/586: chown d6/db/d1f/d50/f57 5665 1 2024-04-26T21:08:09.261 INFO:tasks.workunit.client.1.smithi064.stdout:2/624: getdents d12/d41/d73/d83/d94/d3a/d46/d6a 0 2024-04-26T21:08:09.261 INFO:tasks.workunit.client.1.smithi064.stdout:2/625: stat d12/d41/d73/d83/d94/d3a/d46/d91/d96/f9e 0 2024-04-26T21:08:09.269 INFO:tasks.workunit.client.1.smithi064.stdout:8/478: rmdir d10/d41/d4e/d60 39 2024-04-26T21:08:09.269 INFO:tasks.workunit.client.1.smithi064.stdout:8/479: creat d10/d41/d4e/d54/f9f x:0 0 0 2024-04-26T21:08:09.269 INFO:tasks.workunit.client.0.smithi055.stdout:0/454: creat d9/d11/d5b/f90 x:0 0 0 2024-04-26T21:08:09.270 INFO:tasks.workunit.client.0.smithi055.stdout:2/471: getdents d4/d1e/d69 0 2024-04-26T21:08:09.273 INFO:tasks.workunit.client.0.smithi055.stdout:5/318: unlink d4/df/d13/f21 0 2024-04-26T21:08:09.279 INFO:tasks.workunit.client.1.smithi064.stdout:4/634: dread d0/d2f/d7d/fb8 [0,4194304] 0 2024-04-26T21:08:09.279 INFO:tasks.workunit.client.1.smithi064.stdout:7/587: rmdir d6/d15/d67/d65 39 2024-04-26T21:08:09.279 INFO:tasks.workunit.client.1.smithi064.stdout:6/571: write d4/d7/d12/d38/f73 [2846197,22532] 0 2024-04-26T21:08:09.279 INFO:tasks.workunit.client.1.smithi064.stdout:2/626: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/dd2 0 2024-04-26T21:08:09.280 INFO:tasks.workunit.client.0.smithi055.stdout:3/476: symlink d0/d4/d5/d73/d13/d1a/d46/d55/la8 0 2024-04-26T21:08:09.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/357: rename d3/d9/d1f/f29 to d3/d77/f78 0 2024-04-26T21:08:09.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/358: creat d3/d9/d5b/f79 x:0 0 0 2024-04-26T21:08:09.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/359: chown d3/f41 15030 1 2024-04-26T21:08:09.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/360: write d3/d9/d44/f58 [376791,98588] 0 2024-04-26T21:08:09.283 INFO:tasks.workunit.client.0.smithi055.stdout:4/322: dwrite d4/f36 [0,4194304] 0 2024-04-26T21:08:09.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/694: dwrite d0/d6/d11/d1e/d2a/d34/d57/d66/f6e [0,4194304] 0 2024-04-26T21:08:09.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/695: read - d0/d6/f63 zero size 2024-04-26T21:08:09.284 INFO:tasks.workunit.client.1.smithi064.stdout:1/696: write d0/d6b/d9e/fa4 [661209,4294] 0 2024-04-26T21:08:09.285 INFO:tasks.workunit.client.1.smithi064.stdout:1/697: chown d0/d6/c9 522417 1 2024-04-26T21:08:09.285 INFO:tasks.workunit.client.1.smithi064.stdout:1/698: dread - d0/d6/d11/d1e/d2a/d34/d57/d66/fd0 zero size 2024-04-26T21:08:09.286 INFO:tasks.workunit.client.1.smithi064.stdout:0/547: dwrite dd/d10/d74/d1d/f38 [4194304,4194304] 0 2024-04-26T21:08:09.286 INFO:tasks.workunit.client.1.smithi064.stdout:0/548: write dd/d10/d18/d64/f96 [194591,83583] 0 2024-04-26T21:08:09.286 INFO:tasks.workunit.client.1.smithi064.stdout:8/480: rmdir d10/d41/d4e/d59 39 2024-04-26T21:08:09.288 INFO:tasks.workunit.client.1.smithi064.stdout:2/627: dread d12/d41/d73/d83/d94/d3a/d46/d91/d96/fa3 [0,4194304] 0 2024-04-26T21:08:09.288 INFO:tasks.workunit.client.1.smithi064.stdout:2/628: truncate d12/d41/d61/fbd 379144 0 2024-04-26T21:08:09.288 INFO:tasks.workunit.client.1.smithi064.stdout:2/629: write d12/d41/d73/d83/d94/f35 [4506745,78094] 0 2024-04-26T21:08:09.289 INFO:tasks.workunit.client.1.smithi064.stdout:6/572: rename d4/d7/d12/d49/d4b/d5a/d79/lae to d4/d7/lb7 0 2024-04-26T21:08:09.289 INFO:tasks.workunit.client.1.smithi064.stdout:6/573: fdatasync d4/d7/d12/f68 0 2024-04-26T21:08:09.291 INFO:tasks.workunit.client.0.smithi055.stdout:7/391: unlink d5/d6/d24/f47 0 2024-04-26T21:08:09.291 INFO:tasks.workunit.client.0.smithi055.stdout:7/392: write d5/d11/f5d [534867,42539] 0 2024-04-26T21:08:09.294 INFO:tasks.workunit.client.0.smithi055.stdout:1/399: getdents d8/d17/d6a 0 2024-04-26T21:08:09.294 INFO:tasks.workunit.client.0.smithi055.stdout:1/400: chown d8/df/d11/d27/d28/f72 51856531 1 2024-04-26T21:08:09.294 INFO:tasks.workunit.client.0.smithi055.stdout:1/401: dread - d8/d17/d6a/f52 zero size 2024-04-26T21:08:09.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/455: rmdir d9/d27 39 2024-04-26T21:08:09.298 INFO:tasks.workunit.client.0.smithi055.stdout:0/456: write d9/d27/f42 [1379896,55023] 0 2024-04-26T21:08:09.303 INFO:tasks.workunit.client.0.smithi055.stdout:5/319: creat d4/df/d13/d26/d3c/d4a/d3f/f6a x:0 0 0 2024-04-26T21:08:09.307 INFO:tasks.workunit.client.1.smithi064.stdout:1/699: truncate d0/d6/d29/d31/f4c 1156633 0 2024-04-26T21:08:09.307 INFO:tasks.workunit.client.1.smithi064.stdout:2/630: link d12/da9/ld1 d12/da9/ld3 0 2024-04-26T21:08:09.309 INFO:tasks.workunit.client.0.smithi055.stdout:3/477: rename d0/d4/d5/d73/d13/d1a/d46/d72/d69/c8f to d0/d4/d5/d73/d13/d1a/d46/d55/ca9 0 2024-04-26T21:08:09.314 INFO:tasks.workunit.client.1.smithi064.stdout:8/481: rmdir d10/d41/d44/d7d 39 2024-04-26T21:08:09.314 INFO:tasks.workunit.client.1.smithi064.stdout:4/635: dread d0/d2f/f30 [0,4194304] 0 2024-04-26T21:08:09.318 INFO:tasks.workunit.client.1.smithi064.stdout:2/631: mkdir d12/d41/d73/d83/d94/d3a/d46/d91/d92/dd4 0 2024-04-26T21:08:09.318 INFO:tasks.workunit.client.1.smithi064.stdout:2/632: dread - d12/d88/fc9 zero size 2024-04-26T21:08:09.320 INFO:tasks.workunit.client.0.smithi055.stdout:4/323: truncate d4/d23/f3b 2230376 0 2024-04-26T21:08:09.320 INFO:tasks.workunit.client.0.smithi055.stdout:7/393: symlink d5/db/l72 0 2024-04-26T21:08:09.320 INFO:tasks.workunit.client.0.smithi055.stdout:7/394: truncate d5/d53/d6e/f64 22310 0 2024-04-26T21:08:09.322 INFO:tasks.workunit.client.1.smithi064.stdout:1/700: dread d0/d6/d11/d1e/f54 [0,4194304] 0 2024-04-26T21:08:09.324 INFO:tasks.workunit.client.1.smithi064.stdout:8/482: mkdir d10/d2f/d90/da0 0 2024-04-26T21:08:09.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/483: truncate d10/d1d/f30 4415545 0 2024-04-26T21:08:09.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/484: write d10/d1d/d38/f5e [2099241,105153] 0 2024-04-26T21:08:09.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/485: fsync d10/d2f/f4c 0 2024-04-26T21:08:09.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/486: creat d10/d41/d53/fa1 x:0 0 0 2024-04-26T21:08:09.325 INFO:tasks.workunit.client.1.smithi064.stdout:8/487: dread - d10/d41/d44/d7d/f7f zero size 2024-04-26T21:08:09.331 INFO:tasks.workunit.client.0.smithi055.stdout:0/457: mkdir d9/d11/d5b/d5e/d6c/d7a/d91 0 2024-04-26T21:08:09.331 INFO:tasks.workunit.client.0.smithi055.stdout:0/458: fdatasync d9/dc/d1c/f85 0 2024-04-26T21:08:09.336 INFO:tasks.workunit.client.1.smithi064.stdout:2/633: mkdir d12/d41/d61/dd5 0 2024-04-26T21:08:09.336 INFO:tasks.workunit.client.1.smithi064.stdout:2/634: write d12/d41/d73/d83/fc1 [303026,29638] 0 2024-04-26T21:08:09.337 INFO:tasks.workunit.client.1.smithi064.stdout:2/635: creat d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fd6 x:0 0 0 2024-04-26T21:08:09.337 INFO:tasks.workunit.client.1.smithi064.stdout:2/636: readlink d12/d41/d73/d83/d94/l6f 0 2024-04-26T21:08:09.337 INFO:tasks.workunit.client.1.smithi064.stdout:7/588: dwrite d6/d70/da8/fb2 [0,4194304] 0 2024-04-26T21:08:09.337 INFO:tasks.workunit.client.1.smithi064.stdout:7/589: creat d6/d15/d67/d4d/fcb x:0 0 0 2024-04-26T21:08:09.339 INFO:tasks.workunit.client.0.smithi055.stdout:2/472: truncate d4/db/d26/f4d 824023 0 2024-04-26T21:08:09.340 INFO:tasks.workunit.client.0.smithi055.stdout:2/473: write d4/d1e/f6e [861246,2258] 0 2024-04-26T21:08:09.340 INFO:tasks.workunit.client.0.smithi055.stdout:8/361: rename d3/d9/d44/l5f to d3/d9/d1f/d2e/d75/l7a 0 2024-04-26T21:08:09.340 INFO:tasks.workunit.client.0.smithi055.stdout:8/362: chown d3/d9/d1d/d48/d4b/f6b 56 1 2024-04-26T21:08:09.342 INFO:tasks.workunit.client.1.smithi064.stdout:0/549: dwrite dd/d10/d74/fae [0,4194304] 0 2024-04-26T21:08:09.344 INFO:tasks.workunit.client.1.smithi064.stdout:0/550: write dd/d10/d74/d1d/f8a [4397490,118289] 0 2024-04-26T21:08:09.350 INFO:tasks.workunit.client.0.smithi055.stdout:4/324: symlink d4/d12/d57/l72 0 2024-04-26T21:08:09.355 INFO:tasks.workunit.client.1.smithi064.stdout:8/488: dread d10/d41/d53/f8b [0,4194304] 0 2024-04-26T21:08:09.356 INFO:tasks.workunit.client.0.smithi055.stdout:3/478: dwrite d0/d4/f64 [4194304,4194304] 0 2024-04-26T21:08:09.356 INFO:tasks.workunit.client.0.smithi055.stdout:1/402: getdents d8/d17 0 2024-04-26T21:08:09.358 INFO:tasks.workunit.client.1.smithi064.stdout:1/701: getdents d0/d6/d11/d1e/d2a/d34 0 2024-04-26T21:08:09.360 INFO:tasks.workunit.client.0.smithi055.stdout:0/459: link d9/dc/d1c/d3e/f89 d9/dc/d1c/d54/f92 0 2024-04-26T21:08:09.368 INFO:tasks.workunit.client.0.smithi055.stdout:5/320: creat d4/df/f6b x:0 0 0 2024-04-26T21:08:09.368 INFO:tasks.workunit.client.1.smithi064.stdout:2/637: mkdir d12/d45/dd7 0 2024-04-26T21:08:09.368 INFO:tasks.workunit.client.1.smithi064.stdout:2/638: write d12/d41/d61/fbd [796139,30294] 0 2024-04-26T21:08:09.369 INFO:tasks.workunit.client.0.smithi055.stdout:3/479: getdents d0/d4/d5/d73/d47/d37 0 2024-04-26T21:08:09.375 INFO:tasks.workunit.client.0.smithi055.stdout:1/403: symlink d8/df/d11/d44/l87 0 2024-04-26T21:08:09.378 INFO:tasks.workunit.client.1.smithi064.stdout:4/636: rename d0/d1d/d17/d44/d45 to d0/d5/d79/dd1 0 2024-04-26T21:08:09.378 INFO:tasks.workunit.client.1.smithi064.stdout:4/637: truncate d0/d5/d13/fc9 269893 0 2024-04-26T21:08:09.378 INFO:tasks.workunit.client.1.smithi064.stdout:4/638: chown d0/d5/d13 164507277 1 2024-04-26T21:08:09.381 INFO:tasks.workunit.client.1.smithi064.stdout:1/702: dread d0/d6/ff [0,4194304] 0 2024-04-26T21:08:09.382 INFO:tasks.workunit.client.0.smithi055.stdout:3/480: mknod d0/d4/d5/d73/d13/d1a/d46/d55/caa 0 2024-04-26T21:08:09.384 INFO:tasks.workunit.client.1.smithi064.stdout:4/639: unlink d0/d5/d13/d6d/d97/f5e 0 2024-04-26T21:08:09.387 INFO:tasks.workunit.client.0.smithi055.stdout:5/321: rename d4/l12 to d4/df/d13/d26/d63/l6c 0 2024-04-26T21:08:09.387 INFO:tasks.workunit.client.0.smithi055.stdout:5/322: write d4/df/d13/d26/f32 [1076020,67016] 0 2024-04-26T21:08:09.390 INFO:tasks.workunit.client.0.smithi055.stdout:1/404: dread d8/d17/d6a/f4c [0,4194304] 0 2024-04-26T21:08:09.390 INFO:tasks.workunit.client.1.smithi064.stdout:1/703: symlink d0/d6/d91/ld7 0 2024-04-26T21:08:09.391 INFO:tasks.workunit.client.1.smithi064.stdout:1/704: write d0/d6/d11/d2c/d9c/dbc/fc1 [256176,8970] 0 2024-04-26T21:08:09.395 INFO:tasks.workunit.client.0.smithi055.stdout:3/481: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/fab x:0 0 0 2024-04-26T21:08:09.399 INFO:tasks.workunit.client.1.smithi064.stdout:2/639: rename d12/d41/d61/d75/f9f to d12/d41/d73/d83/d94/fd8 0 2024-04-26T21:08:09.399 INFO:tasks.workunit.client.1.smithi064.stdout:2/640: chown d12/l26 13 1 2024-04-26T21:08:09.399 INFO:tasks.workunit.client.1.smithi064.stdout:6/574: dwrite d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:09.404 INFO:tasks.workunit.client.1.smithi064.stdout:4/640: link d0/d1d/d17/d44/f78 d0/d1d/d56/d89/fd2 0 2024-04-26T21:08:09.409 INFO:tasks.workunit.client.1.smithi064.stdout:1/705: creat d0/d6/d11/d1e/d2a/d34/fd8 x:0 0 0 2024-04-26T21:08:09.412 INFO:tasks.workunit.client.0.smithi055.stdout:1/405: unlink d8/df/d11/d44/l57 0 2024-04-26T21:08:09.412 INFO:tasks.workunit.client.0.smithi055.stdout:1/406: creat d8/df/d11/d44/f88 x:0 0 0 2024-04-26T21:08:09.413 INFO:tasks.workunit.client.0.smithi055.stdout:1/407: chown d8/d17/d1b/d41/c49 32618 1 2024-04-26T21:08:09.416 INFO:tasks.workunit.client.1.smithi064.stdout:4/641: truncate d0/d1d/d21/f62 445782 0 2024-04-26T21:08:09.417 INFO:tasks.workunit.client.1.smithi064.stdout:4/642: write d0/fc7 [351856,82509] 0 2024-04-26T21:08:09.421 INFO:tasks.workunit.client.0.smithi055.stdout:1/408: rename d8/d17/d6a/f51 to d8/d17/d33/f89 0 2024-04-26T21:08:09.423 INFO:tasks.workunit.client.1.smithi064.stdout:4/643: getdents d0/d1d/d17/d44/dac 0 2024-04-26T21:08:09.428 INFO:tasks.workunit.client.1.smithi064.stdout:4/644: mkdir d0/d5/d13/d6d/dd3 0 2024-04-26T21:08:09.430 INFO:tasks.workunit.client.1.smithi064.stdout:8/489: dwrite d10/f4d [0,4194304] 0 2024-04-26T21:08:09.432 INFO:tasks.workunit.client.0.smithi055.stdout:0/460: dread d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:09.434 INFO:tasks.workunit.client.0.smithi055.stdout:7/395: dwrite d5/f29 [0,4194304] 0 2024-04-26T21:08:09.437 INFO:tasks.workunit.client.1.smithi064.stdout:7/590: dwrite d6/d8c/f9f [0,4194304] 0 2024-04-26T21:08:09.440 INFO:tasks.workunit.client.0.smithi055.stdout:3/482: fdatasync d0/d4/d16/d18/d4b/f89 0 2024-04-26T21:08:09.445 INFO:tasks.workunit.client.1.smithi064.stdout:8/490: mkdir d10/d41/d44/d5a/da2 0 2024-04-26T21:08:09.448 INFO:tasks.workunit.client.1.smithi064.stdout:2/641: dread d12/d41/d73/d83/d94/d3a/d46/d91/d96/fa3 [0,4194304] 0 2024-04-26T21:08:09.449 INFO:tasks.workunit.client.0.smithi055.stdout:0/461: unlink d9/d11/d5b/d5e/l75 0 2024-04-26T21:08:09.449 INFO:tasks.workunit.client.0.smithi055.stdout:0/462: creat d9/d11/d5b/d5e/d67/f93 x:0 0 0 2024-04-26T21:08:09.450 INFO:tasks.workunit.client.0.smithi055.stdout:0/463: fsync d9/dc/f10 0 2024-04-26T21:08:09.450 INFO:tasks.workunit.client.0.smithi055.stdout:0/464: fsync d9/dc/d17/f3f 0 2024-04-26T21:08:09.461 INFO:tasks.workunit.client.1.smithi064.stdout:7/591: link d6/d9/l68 d6/d15/d88/dca/lcc 0 2024-04-26T21:08:09.462 INFO:tasks.workunit.client.1.smithi064.stdout:1/706: rmdir d0/d6/d11/d1e/d2a 39 2024-04-26T21:08:09.462 INFO:tasks.workunit.client.1.smithi064.stdout:1/707: creat d0/fd9 x:0 0 0 2024-04-26T21:08:09.462 INFO:tasks.workunit.client.1.smithi064.stdout:1/708: write d0/d6b/d9e/da2/fc6 [606660,30874] 0 2024-04-26T21:08:09.466 INFO:tasks.workunit.client.0.smithi055.stdout:7/396: read d5/f32 [3858853,32079] 0 2024-04-26T21:08:09.466 INFO:tasks.workunit.client.0.smithi055.stdout:3/483: dread d0/d4/f64 [4194304,4194304] 0 2024-04-26T21:08:09.471 INFO:tasks.workunit.client.1.smithi064.stdout:9/588: dwrite d0/d4/d7/f33 [0,4194304] 0 2024-04-26T21:08:09.471 INFO:tasks.workunit.client.1.smithi064.stdout:9/589: truncate d0/d4/da/d26/d5e/fa7 374846 0 2024-04-26T21:08:09.471 INFO:tasks.workunit.client.1.smithi064.stdout:2/642: creat d12/d41/d73/d83/d94/fd9 x:0 0 0 2024-04-26T21:08:09.475 INFO:tasks.workunit.client.1.smithi064.stdout:0/551: dwrite dd/d10/d74/f92 [0,4194304] 0 2024-04-26T21:08:09.475 INFO:tasks.workunit.client.1.smithi064.stdout:0/552: truncate dd/d10/f9e 509740 0 2024-04-26T21:08:09.476 INFO:tasks.workunit.client.0.smithi055.stdout:4/325: dwrite d4/d26/d42/d2d/f59 [0,4194304] 0 2024-04-26T21:08:09.480 INFO:tasks.workunit.client.0.smithi055.stdout:3/484: dread d0/d4/d5/d73/d47/d37/d3d/d4c/f63 [0,4194304] 0 2024-04-26T21:08:09.480 INFO:tasks.workunit.client.0.smithi055.stdout:2/474: dwrite d4/d1e/d2a/f30 [0,4194304] 0 2024-04-26T21:08:09.483 INFO:tasks.workunit.client.1.smithi064.stdout:7/592: mknod d6/d5a/ccd 0 2024-04-26T21:08:09.483 INFO:tasks.workunit.client.1.smithi064.stdout:1/709: mkdir d0/d6/d11/d6c/dda 0 2024-04-26T21:08:09.486 INFO:tasks.workunit.client.0.smithi055.stdout:5/323: dwrite d4/df/d13/d26/d3c/d4a/f55 [0,4194304] 0 2024-04-26T21:08:09.486 INFO:tasks.workunit.client.0.smithi055.stdout:1/409: truncate d8/df/d11/d27/d63/f66 360299 0 2024-04-26T21:08:09.486 INFO:tasks.workunit.client.0.smithi055.stdout:1/410: dread - d8/d17/d1b/d41/f68 zero size 2024-04-26T21:08:09.486 INFO:tasks.workunit.client.0.smithi055.stdout:5/324: chown d4/df/d13/d26/f32 112701 1 2024-04-26T21:08:09.497 INFO:tasks.workunit.client.1.smithi064.stdout:8/491: dwrite d10/d41/d4e/d54/f95 [0,4194304] 0 2024-04-26T21:08:09.497 INFO:tasks.workunit.client.1.smithi064.stdout:8/492: dread - d10/d41/d4e/d54/f9f zero size 2024-04-26T21:08:09.515 INFO:tasks.workunit.client.0.smithi055.stdout:7/397: dwrite d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:09.515 INFO:tasks.workunit.client.0.smithi055.stdout:7/398: write d5/d6/d24/d48/d58/f5f [873452,118409] 0 2024-04-26T21:08:09.520 INFO:tasks.workunit.client.1.smithi064.stdout:2/643: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fb5 [0,4194304] 0 2024-04-26T21:08:09.520 INFO:tasks.workunit.client.1.smithi064.stdout:2/644: dread - d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fd6 zero size 2024-04-26T21:08:09.520 INFO:tasks.workunit.client.1.smithi064.stdout:2/645: stat d12/d41/d73/d83/d94/d3a/d46/l72 0 2024-04-26T21:08:09.524 INFO:tasks.workunit.client.1.smithi064.stdout:4/645: dwrite d0/d1d/d21/f62 [0,4194304] 0 2024-04-26T21:08:09.524 INFO:tasks.workunit.client.1.smithi064.stdout:4/646: fdatasync d0/d2f/d7d/fb8 0 2024-04-26T21:08:09.525 INFO:tasks.workunit.client.1.smithi064.stdout:4/647: truncate d0/d5/d79/dd1/fc0 826445 0 2024-04-26T21:08:09.535 INFO:tasks.workunit.client.0.smithi055.stdout:2/475: dwrite d4/dc/d21/f24 [0,4194304] 0 2024-04-26T21:08:09.536 INFO:tasks.workunit.client.1.smithi064.stdout:8/493: dwrite d10/d2f/f3a [4194304,4194304] 0 2024-04-26T21:08:09.544 INFO:tasks.workunit.client.0.smithi055.stdout:0/465: creat d9/dc/d1c/d3b/f94 x:0 0 0 2024-04-26T21:08:09.552 INFO:tasks.workunit.client.0.smithi055.stdout:4/326: creat d4/d26/d42/d28/d53/d71/f73 x:0 0 0 2024-04-26T21:08:09.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/485: creat d0/d4/d5/d73/d13/d27/d50/fac x:0 0 0 2024-04-26T21:08:09.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/486: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad x:0 0 0 2024-04-26T21:08:09.561 INFO:tasks.workunit.client.1.smithi064.stdout:9/590: truncate d0/d4/da/fc 5549992 0 2024-04-26T21:08:09.562 INFO:tasks.workunit.client.1.smithi064.stdout:9/591: creat d0/d4/da/d26/d45/d90/fbc x:0 0 0 2024-04-26T21:08:09.562 INFO:tasks.workunit.client.0.smithi055.stdout:7/399: creat d5/d6/d24/d4d/f73 x:0 0 0 2024-04-26T21:08:09.567 INFO:tasks.workunit.client.1.smithi064.stdout:9/592: dread d0/d4/da/d26/d5d/f68 [0,4194304] 0 2024-04-26T21:08:09.568 INFO:tasks.workunit.client.1.smithi064.stdout:0/553: mknod dd/d10/d18/cbc 0 2024-04-26T21:08:09.573 INFO:tasks.workunit.client.0.smithi055.stdout:4/327: dread d4/f11 [4194304,4194304] 0 2024-04-26T21:08:09.573 INFO:tasks.workunit.client.0.smithi055.stdout:4/328: read - d4/d26/d42/d28/d53/d71/f73 zero size 2024-04-26T21:08:09.574 INFO:tasks.workunit.client.1.smithi064.stdout:7/593: mkdir d6/db/d1f/d50/db8/dce 0 2024-04-26T21:08:09.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/476: symlink d4/d55/d6c/la5 0 2024-04-26T21:08:09.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/477: chown d4/dc/d21 119298997 1 2024-04-26T21:08:09.580 INFO:tasks.workunit.client.0.smithi055.stdout:3/487: creat d0/d4/d5/d73/d13/d1a/d46/fae x:0 0 0 2024-04-26T21:08:09.586 INFO:tasks.workunit.client.0.smithi055.stdout:5/325: rmdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53 39 2024-04-26T21:08:09.587 INFO:tasks.workunit.client.1.smithi064.stdout:5/553: sync 2024-04-26T21:08:09.592 INFO:tasks.workunit.client.1.smithi064.stdout:2/646: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/lda 0 2024-04-26T21:08:09.594 INFO:tasks.workunit.client.0.smithi055.stdout:0/466: dwrite d9/dc/d1c/d3e/d7d/f86 [0,4194304] 0 2024-04-26T21:08:09.597 INFO:tasks.workunit.client.0.smithi055.stdout:4/329: truncate d4/d26/d42/d28/f32 3797907 0 2024-04-26T21:08:09.601 INFO:tasks.workunit.client.1.smithi064.stdout:4/648: rename d0/d1d/d17/d44/dac/d54/f58 to d0/d1d/d56/fd4 0 2024-04-26T21:08:09.602 INFO:tasks.workunit.client.0.smithi055.stdout:0/467: truncate d9/dc/d1c/f85 1987311 0 2024-04-26T21:08:09.606 INFO:tasks.workunit.client.0.smithi055.stdout:4/330: unlink c0 0 2024-04-26T21:08:09.606 INFO:tasks.workunit.client.0.smithi055.stdout:4/331: chown d4/d23/f25 0 1 2024-04-26T21:08:09.609 INFO:tasks.workunit.client.1.smithi064.stdout:0/554: rmdir dd/d10/d1a/d31/d47 39 2024-04-26T21:08:09.609 INFO:tasks.workunit.client.0.smithi055.stdout:7/400: dread d5/db/f14 [0,4194304] 0 2024-04-26T21:08:09.611 INFO:tasks.workunit.client.0.smithi055.stdout:4/332: mkdir d4/d12/d61/d74 0 2024-04-26T21:08:09.613 INFO:tasks.workunit.client.1.smithi064.stdout:1/710: rmdir d0/d6/d11/d6c 39 2024-04-26T21:08:09.613 INFO:tasks.workunit.client.1.smithi064.stdout:1/711: readlink d0/d6/dd/l1c 0 2024-04-26T21:08:09.613 INFO:tasks.workunit.client.1.smithi064.stdout:1/712: chown d0/d6/d11/d1e/d2a/d34/f75 6 1 2024-04-26T21:08:09.614 INFO:tasks.workunit.client.0.smithi055.stdout:7/401: symlink d5/db/l74 0 2024-04-26T21:08:09.616 INFO:tasks.workunit.client.1.smithi064.stdout:7/594: getdents d6/db/d1f/d50 0 2024-04-26T21:08:09.620 INFO:tasks.workunit.client.1.smithi064.stdout:6/575: sync 2024-04-26T21:08:09.620 INFO:tasks.workunit.client.1.smithi064.stdout:3/549: sync 2024-04-26T21:08:09.623 INFO:tasks.workunit.client.0.smithi055.stdout:4/333: creat d4/d26/d42/d28/d53/d70/f75 x:0 0 0 2024-04-26T21:08:09.623 INFO:tasks.workunit.client.1.smithi064.stdout:5/554: symlink dd/d12/d18/d25/d67/lb5 0 2024-04-26T21:08:09.624 INFO:tasks.workunit.client.1.smithi064.stdout:5/555: creat dd/da9/d48/d6a/d81/fb6 x:0 0 0 2024-04-26T21:08:09.625 INFO:tasks.workunit.client.0.smithi055.stdout:7/402: mkdir d5/d6/d24/d48/d75 0 2024-04-26T21:08:09.631 INFO:tasks.workunit.client.1.smithi064.stdout:1/713: dread d0/d6/d11/d1e/f54 [0,4194304] 0 2024-04-26T21:08:09.631 INFO:tasks.workunit.client.1.smithi064.stdout:9/593: dwrite d0/d4/d28/f2d [0,4194304] 0 2024-04-26T21:08:09.635 INFO:tasks.workunit.client.0.smithi055.stdout:4/334: dread d4/d26/d42/d2d/f3a [0,4194304] 0 2024-04-26T21:08:09.637 INFO:tasks.workunit.client.0.smithi055.stdout:7/403: unlink d5/d6/d24/f28 0 2024-04-26T21:08:09.640 INFO:tasks.workunit.client.1.smithi064.stdout:8/494: rename d10/d2f/d56/d86 to d10/d1d/da3 0 2024-04-26T21:08:09.644 INFO:tasks.workunit.client.0.smithi055.stdout:4/335: symlink d4/d26/d42/d28/d53/l76 0 2024-04-26T21:08:09.646 INFO:tasks.workunit.client.1.smithi064.stdout:7/595: symlink d6/db/d34/da7/lcf 0 2024-04-26T21:08:09.646 INFO:tasks.workunit.client.1.smithi064.stdout:7/596: chown d6/d15/d67/d65/lbf 1707739 1 2024-04-26T21:08:09.651 INFO:tasks.workunit.client.0.smithi055.stdout:7/404: mknod d5/d53/d67/c76 0 2024-04-26T21:08:09.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/550: mknod d1/d27/d29/d6f/d72/cbe 0 2024-04-26T21:08:09.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/551: fdatasync d1/f11 0 2024-04-26T21:08:09.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/552: read d1/d14/f3e [4152836,105] 0 2024-04-26T21:08:09.655 INFO:tasks.workunit.client.1.smithi064.stdout:4/649: dwrite d0/d5/d13/d6d/f4b [0,4194304] 0 2024-04-26T21:08:09.656 INFO:tasks.workunit.client.1.smithi064.stdout:4/650: chown d0/d1d/d17/d44/dac/d54/f5f 2 1 2024-04-26T21:08:09.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:09 smithi064 ceph-mon[33404]: pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 230 MiB/s rd, 276 MiB/s wr, 403 op/s 2024-04-26T21:08:09.656 INFO:tasks.workunit.client.0.smithi055.stdout:4/336: unlink d4/d12/d15/l1b 0 2024-04-26T21:08:09.662 INFO:tasks.workunit.client.0.smithi055.stdout:0/468: dwrite d9/d11/d5b/d5e/d67/f88 [0,4194304] 0 2024-04-26T21:08:09.662 INFO:tasks.workunit.client.0.smithi055.stdout:0/469: dread - d9/d11/d5b/d5e/d67/f93 zero size 2024-04-26T21:08:09.662 INFO:tasks.workunit.client.0.smithi055.stdout:7/405: unlink d5/d6/c71 0 2024-04-26T21:08:09.665 INFO:tasks.workunit.client.1.smithi064.stdout:5/556: truncate dd/da9/d48/d56/fb4 317512 0 2024-04-26T21:08:09.676 INFO:tasks.workunit.client.1.smithi064.stdout:6/576: dwrite d4/d7/d12/d49/d4b/d56/d95/fac [0,4194304] 0 2024-04-26T21:08:09.679 INFO:tasks.workunit.client.1.smithi064.stdout:4/651: dread d0/d5/d79/dd1/f5c [0,4194304] 0 2024-04-26T21:08:09.685 INFO:tasks.workunit.client.1.smithi064.stdout:2/647: rmdir d12/d41/d73/d83 39 2024-04-26T21:08:09.687 INFO:tasks.workunit.client.0.smithi055.stdout:2/478: dwrite d4/db/d1f/f67 [0,4194304] 0 2024-04-26T21:08:09.689 INFO:tasks.workunit.client.1.smithi064.stdout:1/714: unlink d0/d6/d29/c93 0 2024-04-26T21:08:09.689 INFO:tasks.workunit.client.1.smithi064.stdout:9/594: mknod d0/d4/da/d26/d47/d9d/cbd 0 2024-04-26T21:08:09.690 INFO:tasks.workunit.client.1.smithi064.stdout:0/555: rename dd/f67 to dd/d10/d1a/d31/d47/fbd 0 2024-04-26T21:08:09.696 INFO:tasks.workunit.client.1.smithi064.stdout:7/597: creat d6/d15/d88/dca/fd0 x:0 0 0 2024-04-26T21:08:09.697 INFO:tasks.workunit.client.1.smithi064.stdout:5/557: getdents dd/da9/d48 0 2024-04-26T21:08:09.702 INFO:tasks.workunit.client.1.smithi064.stdout:6/577: creat d4/d7/d12/d49/d4b/fb8 x:0 0 0 2024-04-26T21:08:09.703 INFO:tasks.workunit.client.1.smithi064.stdout:4/652: symlink d0/d5/d79/dd1/da0/dcd/ld5 0 2024-04-26T21:08:09.704 INFO:tasks.workunit.client.1.smithi064.stdout:9/595: creat d0/d4/d28/d4f/fbe x:0 0 0 2024-04-26T21:08:09.709 INFO:tasks.workunit.client.1.smithi064.stdout:3/553: getdents d1/d38 0 2024-04-26T21:08:09.711 INFO:tasks.workunit.client.1.smithi064.stdout:2/648: write d12/d41/d73/d83/d94/d3a/f79 [891046,78834] 0 2024-04-26T21:08:09.712 INFO:tasks.workunit.client.1.smithi064.stdout:6/578: symlink d4/d7/d12/d49/d4b/d5a/d79/d9b/lb9 0 2024-04-26T21:08:09.714 INFO:tasks.workunit.client.1.smithi064.stdout:4/653: creat d0/d2f/fd6 x:0 0 0 2024-04-26T21:08:09.715 INFO:tasks.workunit.client.1.smithi064.stdout:9/596: mknod d0/d4/d28/cbf 0 2024-04-26T21:08:09.719 INFO:tasks.workunit.client.1.smithi064.stdout:3/554: getdents d1/d27/d50/d35/d4c/d7b/d82 0 2024-04-26T21:08:09.722 INFO:tasks.workunit.client.0.smithi055.stdout:3/488: dwrite d0/d4/d5/d73/d47/d37/f6f [0,4194304] 0 2024-04-26T21:08:09.722 INFO:tasks.workunit.client.1.smithi064.stdout:2/649: creat d12/d41/d61/fdb x:0 0 0 2024-04-26T21:08:09.723 INFO:tasks.workunit.client.0.smithi055.stdout:6/389: sync 2024-04-26T21:08:09.724 INFO:tasks.workunit.client.1.smithi064.stdout:9/597: chown d0/d4/d7/df/f32 3951 1 2024-04-26T21:08:09.727 INFO:tasks.workunit.client.0.smithi055.stdout:6/390: write d3/d17/f32 [2898059,55206] 0 2024-04-26T21:08:09.731 INFO:tasks.workunit.client.1.smithi064.stdout:3/555: mknod d1/d27/d50/d35/d4c/d7b/d82/d9b/cbf 0 2024-04-26T21:08:09.732 INFO:tasks.workunit.client.0.smithi055.stdout:3/489: creat d0/d4/d5/d73/d13/d27/d3b/faf x:0 0 0 2024-04-26T21:08:09.737 INFO:tasks.workunit.client.1.smithi064.stdout:4/654: rmdir d0/d5/d79 39 2024-04-26T21:08:09.738 INFO:tasks.workunit.client.1.smithi064.stdout:9/598: link d0/d4/da/d26/d45/f7d d0/d4/da/d31/fc0 0 2024-04-26T21:08:09.738 INFO:tasks.workunit.client.0.smithi055.stdout:2/479: read d4/d14/d17/f2e [6636258,91532] 0 2024-04-26T21:08:09.738 INFO:tasks.workunit.client.0.smithi055.stdout:3/490: rmdir d0/d4/d16/d18/d4b/d57/d8e 39 2024-04-26T21:08:09.739 INFO:tasks.workunit.client.0.smithi055.stdout:3/491: read d0/d4/d16/d18/f5d [972611,77715] 0 2024-04-26T21:08:09.739 INFO:tasks.workunit.client.0.smithi055.stdout:3/492: chown d0/d4/d5/d73/d13/d1a/f24 244 1 2024-04-26T21:08:09.740 INFO:tasks.workunit.client.1.smithi064.stdout:4/655: mkdir d0/d5/d13/d10/dd7 0 2024-04-26T21:08:09.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/556: dwrite dd/d10/d74/d1d/f38 [4194304,4194304] 0 2024-04-26T21:08:09.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/557: write dd/d10/d1a/f9c [422211,82242] 0 2024-04-26T21:08:09.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/558: fdatasync dd/d10/f2e 0 2024-04-26T21:08:09.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/656: mkdir d0/d5/d13/d33/dd0/dd8 0 2024-04-26T21:08:09.745 INFO:tasks.workunit.client.1.smithi064.stdout:4/657: readlink d0/d5/d13/d6d/d97/la7 0 2024-04-26T21:08:09.746 INFO:tasks.workunit.client.0.smithi055.stdout:2/480: rename d4/d1e/d69 to d4/db/d8f/da6 0 2024-04-26T21:08:09.746 INFO:tasks.workunit.client.1.smithi064.stdout:0/559: write dd/d10/f16 [4047445,50197] 0 2024-04-26T21:08:09.747 INFO:tasks.workunit.client.0.smithi055.stdout:0/470: dwrite d9/dc/d17/f45 [0,4194304] 0 2024-04-26T21:08:09.747 INFO:tasks.workunit.client.0.smithi055.stdout:0/471: write d9/d11/d5b/d5e/f8e [456689,19285] 0 2024-04-26T21:08:09.748 INFO:tasks.workunit.client.1.smithi064.stdout:0/560: truncate dd/d10/d18/d64/f65 1984039 0 2024-04-26T21:08:09.749 INFO:tasks.workunit.client.1.smithi064.stdout:0/561: chown dd/d10/d1a/d31/d5c 1363 1 2024-04-26T21:08:09.751 INFO:tasks.workunit.client.1.smithi064.stdout:0/562: mknod dd/d10/d18/d58/dba/cbe 0 2024-04-26T21:08:09.752 INFO:tasks.workunit.client.1.smithi064.stdout:0/563: mknod dd/d21/db8/cbf 0 2024-04-26T21:08:09.755 INFO:tasks.workunit.client.1.smithi064.stdout:0/564: creat dd/d10/d18/fc0 x:0 0 0 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:3/493: dread d0/d4/d5/d73/f2e [0,4194304] 0 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:9/429: sync 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:9/430: chown d2/d11/c4e 649809 1 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:9/431: chown d2/d11/f3b 655550045 1 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:9/432: chown d2/d46/d51/c56 601774169 1 2024-04-26T21:08:09.761 INFO:tasks.workunit.client.0.smithi055.stdout:8/363: sync 2024-04-26T21:08:09.766 INFO:tasks.workunit.client.0.smithi055.stdout:9/433: creat d2/d46/d77/d5f/f8a x:0 0 0 2024-04-26T21:08:09.766 INFO:tasks.workunit.client.0.smithi055.stdout:8/364: symlink d3/d9/d1d/d48/d57/l7b 0 2024-04-26T21:08:09.771 INFO:tasks.workunit.client.1.smithi064.stdout:2/650: dread d12/d41/d73/d83/d94/d3a/d46/d91/fca [0,4194304] 0 2024-04-26T21:08:09.772 INFO:tasks.workunit.client.1.smithi064.stdout:9/599: read d0/d4/da/d26/d47/f73 [284162,7358] 0 2024-04-26T21:08:09.772 INFO:tasks.workunit.client.1.smithi064.stdout:9/600: truncate d0/d4/d7/df/fa0 892531 0 2024-04-26T21:08:09.772 INFO:tasks.workunit.client.1.smithi064.stdout:9/601: chown d0/d4/da/d26/d45/d90/ca1 19 1 2024-04-26T21:08:09.772 INFO:tasks.workunit.client.0.smithi055.stdout:3/494: getdents d0/d4/d5/d73/d13/d27/d50 0 2024-04-26T21:08:09.772 INFO:tasks.workunit.client.1.smithi064.stdout:1/715: dwrite d0/d6b/f9d [0,4194304] 0 2024-04-26T21:08:09.773 INFO:tasks.workunit.client.0.smithi055.stdout:7/406: dwrite d5/d11/f5d [0,4194304] 0 2024-04-26T21:08:09.782 INFO:tasks.workunit.client.1.smithi064.stdout:2/651: rename d12/d41/d73/d83/d94/d3a/d46/d91/d96 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc 0 2024-04-26T21:08:09.790 INFO:tasks.workunit.client.0.smithi055.stdout:3/495: rmdir d0/de 39 2024-04-26T21:08:09.791 INFO:tasks.workunit.client.1.smithi064.stdout:0/565: write dd/d21/f45 [1890496,124088] 0 2024-04-26T21:08:09.791 INFO:tasks.workunit.client.1.smithi064.stdout:0/566: chown dd/d10/d1a/d31/d43/fb9 572 1 2024-04-26T21:08:09.791 INFO:tasks.workunit.client.1.smithi064.stdout:1/716: mknod d0/d22/d9f/cdb 0 2024-04-26T21:08:09.791 INFO:tasks.workunit.client.1.smithi064.stdout:2/652: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/ldd 0 2024-04-26T21:08:09.792 INFO:tasks.workunit.client.0.smithi055.stdout:8/365: mkdir d3/d7c 0 2024-04-26T21:08:09.792 INFO:tasks.workunit.client.0.smithi055.stdout:9/434: write d2/f22 [3397880,22290] 0 2024-04-26T21:08:09.792 INFO:tasks.workunit.client.0.smithi055.stdout:9/435: truncate d2/d14/f4f 9271781 0 2024-04-26T21:08:09.794 INFO:tasks.workunit.client.0.smithi055.stdout:8/366: unlink d3/d9/d1f/f31 0 2024-04-26T21:08:09.799 INFO:tasks.workunit.client.0.smithi055.stdout:3/496: link d0/d4/d16/d18/d4b/d57/d8e/c9f d0/d4/d5/d73/d13/d1a/d46/d72/d69/da7/cb0 0 2024-04-26T21:08:09.799 INFO:tasks.workunit.client.0.smithi055.stdout:3/497: chown d0/d4/d5/d73/d47/d37/d3d/d4c 2312127 1 2024-04-26T21:08:09.800 INFO:tasks.workunit.client.1.smithi064.stdout:2/653: mknod d12/d41/d73/d83/d94/d3a/d46/cde 0 2024-04-26T21:08:09.801 INFO:tasks.workunit.client.0.smithi055.stdout:9/436: mknod d2/c8b 0 2024-04-26T21:08:09.804 INFO:tasks.workunit.client.0.smithi055.stdout:8/367: link d3/d9/d1d/d48/l4d d3/d9/d1d/d48/l7d 0 2024-04-26T21:08:09.804 INFO:tasks.workunit.client.0.smithi055.stdout:8/368: write d3/d9/d1d/d48/d4b/f6b [675948,129321] 0 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:5/558: dwrite dd/da9/d48/d56/fae [0,4194304] 0 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:5/559: dread - dd/d12/f7c zero size 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:5/560: stat dd/d12/d18/d25/d74/f82 0 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:5/561: truncate dd/da9/d48/d6a/f79 1132267 0 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:2/654: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fc0 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/fdf 0 2024-04-26T21:08:09.805 INFO:tasks.workunit.client.1.smithi064.stdout:2/655: creat d12/d88/fe0 x:0 0 0 2024-04-26T21:08:09.806 INFO:tasks.workunit.client.1.smithi064.stdout:9/602: dread d0/d4/da/d26/d47/d6b/f70 [0,4194304] 0 2024-04-26T21:08:09.806 INFO:tasks.workunit.client.1.smithi064.stdout:7/598: dwrite d6/d8c/f9c [0,4194304] 0 2024-04-26T21:08:09.806 INFO:tasks.workunit.client.1.smithi064.stdout:7/599: dread - d6/d9/d38/f95 zero size 2024-04-26T21:08:09.806 INFO:tasks.workunit.client.1.smithi064.stdout:6/579: dwrite d4/d7/d12/f68 [0,4194304] 0 2024-04-26T21:08:09.806 INFO:tasks.workunit.client.1.smithi064.stdout:7/600: write d6/d9/f8d [327356,84802] 0 2024-04-26T21:08:09.808 INFO:tasks.workunit.client.0.smithi055.stdout:3/498: mkdir d0/d4/d16/d18/d4b/d57/d8e/db1 0 2024-04-26T21:08:09.808 INFO:tasks.workunit.client.0.smithi055.stdout:3/499: stat d0/d4/d5/d73/d13/d1a/d46/fae 0 2024-04-26T21:08:09.809 INFO:tasks.workunit.client.1.smithi064.stdout:1/717: write d0/d6/d29/fca [3994409,127807] 0 2024-04-26T21:08:09.810 INFO:tasks.workunit.client.1.smithi064.stdout:0/567: dread dd/d10/d1a/d31/d47/f66 [0,4194304] 0 2024-04-26T21:08:09.811 INFO:tasks.workunit.client.0.smithi055.stdout:9/437: symlink d2/d46/d77/d5f/l8c 0 2024-04-26T21:08:09.812 INFO:tasks.workunit.client.0.smithi055.stdout:6/391: dwrite d3/d4f/f69 [0,4194304] 0 2024-04-26T21:08:09.815 INFO:tasks.workunit.client.1.smithi064.stdout:5/562: rename dd/d12/d18/d1a/d1f/f4b to dd/d12/d4f/d9c/da1/fb7 0 2024-04-26T21:08:09.815 INFO:tasks.workunit.client.1.smithi064.stdout:5/563: creat dd/da9/d48/d6a/d81/fb8 x:0 0 0 2024-04-26T21:08:09.817 INFO:tasks.workunit.client.0.smithi055.stdout:3/500: creat d0/d4/fb2 x:0 0 0 2024-04-26T21:08:09.821 INFO:tasks.workunit.client.0.smithi055.stdout:9/438: link d2/d14/c64 d2/d46/c8d 0 2024-04-26T21:08:09.823 INFO:tasks.workunit.client.1.smithi064.stdout:2/656: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l8c d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/le1 0 2024-04-26T21:08:09.826 INFO:tasks.workunit.client.0.smithi055.stdout:3/501: link d0/d4/f44 d0/d4/d5/d73/d13/d1a/d46/d72/d69/fb3 0 2024-04-26T21:08:09.826 INFO:tasks.workunit.client.0.smithi055.stdout:3/502: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad zero size 2024-04-26T21:08:09.826 INFO:tasks.workunit.client.0.smithi055.stdout:3/503: stat d0/d4/d5/d73/d13/d1a/d46/d72/d69/c79 0 2024-04-26T21:08:09.827 INFO:tasks.workunit.client.0.smithi055.stdout:3/504: fsync d0/d4/d5/d73/d13/d1a/d46/fae 0 2024-04-26T21:08:09.834 INFO:tasks.workunit.client.0.smithi055.stdout:9/439: link d2/c5 d2/d46/d51/c8e 0 2024-04-26T21:08:09.834 INFO:tasks.workunit.client.0.smithi055.stdout:9/440: truncate d2/d14/f47 1074286 0 2024-04-26T21:08:09.841 INFO:tasks.workunit.client.0.smithi055.stdout:3/505: mknod d0/d4/d5/d73/d13/d1a/d46/d72/cb4 0 2024-04-26T21:08:09.845 INFO:tasks.workunit.client.0.smithi055.stdout:0/472: dwrite d9/dc/d1c/d3e/f47 [4194304,4194304] 0 2024-04-26T21:08:09.845 INFO:tasks.workunit.client.0.smithi055.stdout:0/473: fdatasync d9/dc/f10 0 2024-04-26T21:08:09.846 INFO:tasks.workunit.client.0.smithi055.stdout:9/441: rename d2/d46/l78 to d2/d46/d77/d7d/l8f 0 2024-04-26T21:08:09.850 INFO:tasks.workunit.client.1.smithi064.stdout:6/580: stat d4/d7/lb7 0 2024-04-26T21:08:09.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/581: readlink d4/d7/d33/l88 0 2024-04-26T21:08:09.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/582: truncate d4/d7/fd 703989 0 2024-04-26T21:08:09.851 INFO:tasks.workunit.client.1.smithi064.stdout:7/601: mkdir d6/d70/da8/dd1 0 2024-04-26T21:08:09.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/583: chown d4/c20 53 1 2024-04-26T21:08:09.855 INFO:tasks.workunit.client.0.smithi055.stdout:7/407: dwrite d5/d6/d24/d3b/f44 [0,4194304] 0 2024-04-26T21:08:09.855 INFO:tasks.workunit.client.0.smithi055.stdout:3/506: link d0/d4/d5/d73/c9 d0/d4/d5/d73/d13/d27/d50/d6b/cb5 0 2024-04-26T21:08:09.856 INFO:tasks.workunit.client.0.smithi055.stdout:3/507: readlink d0/d4/d16/d18/d4b/l78 0 2024-04-26T21:08:09.856 INFO:tasks.workunit.client.0.smithi055.stdout:3/508: truncate d0/d4/d5/d73/d13/d27/d50/d6b/f7d 1816310 0 2024-04-26T21:08:09.856 INFO:tasks.workunit.client.0.smithi055.stdout:3/509: write d0/d4/d5/f2c [1214583,110606] 0 2024-04-26T21:08:09.859 INFO:tasks.workunit.client.0.smithi055.stdout:8/369: dwrite d3/d77/f78 [0,4194304] 0 2024-04-26T21:08:09.859 INFO:tasks.workunit.client.0.smithi055.stdout:8/370: dread - d3/d9/d1d/f65 zero size 2024-04-26T21:08:09.867 INFO:tasks.workunit.client.1.smithi064.stdout:1/718: creat d0/d6/d11/d1e/d2a/d34/fdc x:0 0 0 2024-04-26T21:08:09.867 INFO:tasks.workunit.client.1.smithi064.stdout:1/719: chown d0/d6/d11/d1e/fb5 4 1 2024-04-26T21:08:09.867 INFO:tasks.workunit.client.1.smithi064.stdout:1/720: truncate d0/d6/d11/d1e/d2a/d34/fdc 707013 0 2024-04-26T21:08:09.867 INFO:tasks.workunit.client.1.smithi064.stdout:1/721: write d0/d6/d11/d2c/f85 [4334690,53998] 0 2024-04-26T21:08:09.870 INFO:tasks.workunit.client.1.smithi064.stdout:7/602: dread d6/d15/d1c/f2e [0,4194304] 0 2024-04-26T21:08:09.870 INFO:tasks.workunit.client.1.smithi064.stdout:7/603: fsync d6/d70/fa6 0 2024-04-26T21:08:09.870 INFO:tasks.workunit.client.0.smithi055.stdout:0/474: creat d9/d11/d5b/d5e/d6c/d7a/f95 x:0 0 0 2024-04-26T21:08:09.871 INFO:tasks.workunit.client.0.smithi055.stdout:0/475: write d9/d11/d59/f7f [1011212,110854] 0 2024-04-26T21:08:09.872 INFO:tasks.workunit.client.1.smithi064.stdout:0/568: symlink dd/d10/d74/d1d/db1/lc1 0 2024-04-26T21:08:09.879 INFO:tasks.workunit.client.0.smithi055.stdout:7/408: mknod d5/d53/d67/c77 0 2024-04-26T21:08:09.881 INFO:tasks.workunit.client.1.smithi064.stdout:8/495: sync 2024-04-26T21:08:09.885 INFO:tasks.workunit.client.0.smithi055.stdout:8/371: mknod d3/d9/d1f/c7e 0 2024-04-26T21:08:09.887 INFO:tasks.workunit.client.0.smithi055.stdout:0/476: rmdir d9/d11/d5b/d74 39 2024-04-26T21:08:09.889 INFO:tasks.workunit.client.1.smithi064.stdout:0/569: read dd/d10/d74/f68 [3093490,26571] 0 2024-04-26T21:08:09.889 INFO:tasks.workunit.client.1.smithi064.stdout:9/603: rename d0/d4/da/d26/lb8 to d0/d4/da/d26/lc1 0 2024-04-26T21:08:09.889 INFO:tasks.workunit.client.1.smithi064.stdout:9/604: fdatasync d0/f59 0 2024-04-26T21:08:09.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/584: symlink d4/d7/d12/d49/d4b/d5a/d79/lba 0 2024-04-26T21:08:09.895 INFO:tasks.workunit.client.0.smithi055.stdout:9/442: dwrite d2/f1c [0,4194304] 0 2024-04-26T21:08:09.896 INFO:tasks.workunit.client.0.smithi055.stdout:1/411: sync 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.0.smithi055.stdout:7/409: symlink d5/d53/l78 0 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.0.smithi055.stdout:7/410: stat d5/d6/d24/d4d/l66 0 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.0.smithi055.stdout:8/372: symlink d3/d9/d1d/d48/d57/d61/l7f 0 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.1.smithi064.stdout:1/722: symlink d0/d6/d11/d2c/d9c/dbc/ldd 0 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.1.smithi064.stdout:3/556: sync 2024-04-26T21:08:09.903 INFO:tasks.workunit.client.1.smithi064.stdout:7/604: mknod d6/d15/d67/d65/cd2 0 2024-04-26T21:08:09.905 INFO:tasks.workunit.client.1.smithi064.stdout:7/605: read d6/d9/f39 [664861,98035] 0 2024-04-26T21:08:09.905 INFO:tasks.workunit.client.0.smithi055.stdout:0/477: rmdir d9/d11/d5b/d5e/d6c/d7a/d91 0 2024-04-26T21:08:09.908 INFO:tasks.workunit.client.1.smithi064.stdout:7/606: read d6/d9/f8d [99686,34878] 0 2024-04-26T21:08:09.911 INFO:tasks.workunit.client.0.smithi055.stdout:1/412: mknod d8/d17/d36/c8a 0 2024-04-26T21:08:09.912 INFO:tasks.workunit.client.1.smithi064.stdout:4/658: sync 2024-04-26T21:08:09.912 INFO:tasks.workunit.client.1.smithi064.stdout:4/659: chown d0/d5/d79/fbe 29142107 1 2024-04-26T21:08:09.912 INFO:tasks.workunit.client.1.smithi064.stdout:2/657: truncate d12/d41/d61/d75/f42 2069662 0 2024-04-26T21:08:09.913 INFO:tasks.workunit.client.0.smithi055.stdout:8/373: mkdir d3/d9/d1d/d48/d80 0 2024-04-26T21:08:09.913 INFO:tasks.workunit.client.0.smithi055.stdout:8/374: readlink d3/d9/d1d/d48/d4b/l66 0 2024-04-26T21:08:09.917 INFO:tasks.workunit.client.1.smithi064.stdout:8/496: rename d10/d41/d4e/d60/c72 to d10/d41/d4e/d59/d5d/ca4 0 2024-04-26T21:08:09.919 INFO:tasks.workunit.client.0.smithi055.stdout:0/478: link d9/d27/l83 d9/dc/d17/l96 0 2024-04-26T21:08:09.920 INFO:tasks.workunit.client.1.smithi064.stdout:0/570: mkdir dd/d10/d1a/d31/d43/db4/dc2 0 2024-04-26T21:08:09.922 INFO:tasks.workunit.client.0.smithi055.stdout:9/443: getdents d2/d46/d77/d7d 0 2024-04-26T21:08:09.923 INFO:tasks.workunit.client.1.smithi064.stdout:0/571: read dd/f85 [424923,21419] 0 2024-04-26T21:08:09.924 INFO:tasks.workunit.client.0.smithi055.stdout:9/444: write d2/d14/f47 [640695,64886] 0 2024-04-26T21:08:09.926 INFO:tasks.workunit.client.0.smithi055.stdout:1/413: symlink d8/d17/d1b/l8b 0 2024-04-26T21:08:09.929 INFO:tasks.workunit.client.0.smithi055.stdout:8/375: creat d3/d9/d1f/d2e/d75/d76/f81 x:0 0 0 2024-04-26T21:08:09.930 INFO:tasks.workunit.client.1.smithi064.stdout:5/564: sync 2024-04-26T21:08:09.930 INFO:tasks.workunit.client.1.smithi064.stdout:5/565: write dd/d12/d18/d25/d32/f80 [1485627,50669] 0 2024-04-26T21:08:09.931 INFO:tasks.workunit.client.0.smithi055.stdout:3/510: dwrite d0/d4/d5/d73/d13/d1a/f54 [0,4194304] 0 2024-04-26T21:08:09.931 INFO:tasks.workunit.client.0.smithi055.stdout:3/511: fdatasync d0/d4/d5/d73/d47/f77 0 2024-04-26T21:08:09.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/723: symlink d0/d6/d11/lde 0 2024-04-26T21:08:09.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/724: write d0/d6/dd/fd6 [294163,109773] 0 2024-04-26T21:08:09.932 INFO:tasks.workunit.client.0.smithi055.stdout:0/479: mkdir d9/dc/d1c/d54/d4b/d68/d97 0 2024-04-26T21:08:09.932 INFO:tasks.workunit.client.0.smithi055.stdout:0/480: fsync d9/dc/d17/f5f 0 2024-04-26T21:08:09.935 INFO:tasks.workunit.client.1.smithi064.stdout:7/607: symlink d6/db/d34/d6f/d81/ld3 0 2024-04-26T21:08:09.936 INFO:tasks.workunit.client.1.smithi064.stdout:7/608: write d6/db/d1f/f6c [4858907,100997] 0 2024-04-26T21:08:09.938 INFO:tasks.workunit.client.1.smithi064.stdout:4/660: mknod d0/d1d/d56/cd9 0 2024-04-26T21:08:09.940 INFO:tasks.workunit.client.0.smithi055.stdout:9/445: rmdir d2/d14 39 2024-04-26T21:08:09.940 INFO:tasks.workunit.client.0.smithi055.stdout:0/481: dread d9/d11/d5b/d5e/d6c/f84 [0,4194304] 0 2024-04-26T21:08:09.942 INFO:tasks.workunit.client.1.smithi064.stdout:2/658: link d12/d41/d73/d83/d94/d3a/d46/d6a/f7e d12/da9/fe2 0 2024-04-26T21:08:09.949 INFO:tasks.workunit.client.1.smithi064.stdout:6/585: rename d4/d7/d12/d49/d4b/d5a/d79/d9b/lb9 to d4/d7/d12/d49/d4b/d5a/d79/lbb 0 2024-04-26T21:08:09.949 INFO:tasks.workunit.client.1.smithi064.stdout:6/586: write d4/d7/d12/d38/f9f [725387,112887] 0 2024-04-26T21:08:09.949 INFO:tasks.workunit.client.1.smithi064.stdout:6/587: truncate d4/d7/f62 2365053 0 2024-04-26T21:08:09.954 INFO:tasks.workunit.client.1.smithi064.stdout:0/572: mknod dd/d10/d1a/d31/d47/dad/cc3 0 2024-04-26T21:08:09.954 INFO:tasks.workunit.client.1.smithi064.stdout:0/573: fdatasync dd/f85 0 2024-04-26T21:08:09.954 INFO:tasks.workunit.client.1.smithi064.stdout:0/574: creat dd/d10/d74/d4f/d7b/fc4 x:0 0 0 2024-04-26T21:08:09.955 INFO:tasks.workunit.client.1.smithi064.stdout:9/605: getdents d0/d39 0 2024-04-26T21:08:09.956 INFO:tasks.workunit.client.0.smithi055.stdout:1/414: rmdir d8/df/d11/d27/d84 0 2024-04-26T21:08:09.956 INFO:tasks.workunit.client.0.smithi055.stdout:8/376: truncate d3/d9/d1d/f25 1584181 0 2024-04-26T21:08:09.956 INFO:tasks.workunit.client.0.smithi055.stdout:8/377: read d3/d9/d1f/d2e/d75/f6a [2247891,70395] 0 2024-04-26T21:08:09.956 INFO:tasks.workunit.client.0.smithi055.stdout:7/411: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:09.956 INFO:tasks.workunit.client.0.smithi055.stdout:7/412: rename d5/d53 to d5/d53/d67/d79 22 2024-04-26T21:08:09.960 INFO:tasks.workunit.client.1.smithi064.stdout:5/566: mkdir dd/da9/d48/d6a/d9e/db9 0 2024-04-26T21:08:09.960 INFO:tasks.workunit.client.1.smithi064.stdout:5/567: read dd/d12/d18/d25/d32/fa4 [3134,16715] 0 2024-04-26T21:08:09.960 INFO:tasks.workunit.client.1.smithi064.stdout:5/568: read dd/d12/d18/d25/d32/f4a [228329,47526] 0 2024-04-26T21:08:09.961 INFO:tasks.workunit.client.0.smithi055.stdout:3/512: mknod d0/d4/d5/d73/d13/d27/d50/cb6 0 2024-04-26T21:08:09.964 INFO:tasks.workunit.client.0.smithi055.stdout:0/482: symlink d9/dc/d1c/d3e/d7d/l98 0 2024-04-26T21:08:09.966 INFO:tasks.workunit.client.0.smithi055.stdout:8/378: unlink d3/d9/ld 0 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:8/497: dwrite d10/d41/d4e/d59/f96 [0,4194304] 0 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:8/498: dread - d10/f9e zero size 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:1/725: unlink d0/cbd 0 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:7/609: creat d6/db/dc1/fd4 x:0 0 0 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:2/659: write d12/d45/f56 [2226659,5577] 0 2024-04-26T21:08:09.971 INFO:tasks.workunit.client.1.smithi064.stdout:4/661: unlink d0/d1d/c24 0 2024-04-26T21:08:09.972 INFO:tasks.workunit.client.1.smithi064.stdout:6/588: mkdir d4/d7/d12/dbc 0 2024-04-26T21:08:09.973 INFO:tasks.workunit.client.0.smithi055.stdout:7/413: mkdir d5/d53/d6e/d6c/d7a 0 2024-04-26T21:08:09.973 INFO:tasks.workunit.client.0.smithi055.stdout:7/414: chown d5/d6/c19 0 1 2024-04-26T21:08:09.976 INFO:tasks.workunit.client.1.smithi064.stdout:0/575: symlink dd/lc5 0 2024-04-26T21:08:09.977 INFO:tasks.workunit.client.1.smithi064.stdout:0/576: chown dd/d10/d1a/d31/d5c/f6f 7 1 2024-04-26T21:08:09.977 INFO:tasks.workunit.client.1.smithi064.stdout:0/577: write dd/d10/d74/f68 [3583608,54383] 0 2024-04-26T21:08:09.977 INFO:tasks.workunit.client.0.smithi055.stdout:3/513: creat d0/d4/d5/d73/d47/fb7 x:0 0 0 2024-04-26T21:08:09.979 INFO:tasks.workunit.client.1.smithi064.stdout:9/606: mkdir d0/d4/da/d31/dc2 0 2024-04-26T21:08:09.979 INFO:tasks.workunit.client.1.smithi064.stdout:9/607: getdents d0/d4/da/d31/dc2 0 2024-04-26T21:08:09.980 INFO:tasks.workunit.client.0.smithi055.stdout:0/483: symlink d9/d11/l99 0 2024-04-26T21:08:09.985 INFO:tasks.workunit.client.1.smithi064.stdout:1/726: write d0/d22/d87/f88 [4502110,126020] 0 2024-04-26T21:08:09.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/608: write d0/d4/da/d26/d5e/fa7 [256612,112874] 0 2024-04-26T21:08:09.986 INFO:tasks.workunit.client.1.smithi064.stdout:9/609: chown d0/d4/da/d26/d5e/f69 1403180 1 2024-04-26T21:08:09.986 INFO:tasks.workunit.client.1.smithi064.stdout:9/610: write d0/d4/da/d26/d45/f9a [4254531,73204] 0 2024-04-26T21:08:09.986 INFO:tasks.workunit.client.1.smithi064.stdout:9/611: read - d0/d4/da/d26/d5d/f7b zero size 2024-04-26T21:08:09.986 INFO:tasks.workunit.client.1.smithi064.stdout:2/660: dread d12/d41/d73/d83/d94/d3a/d46/d6a/f9c [0,4194304] 0 2024-04-26T21:08:09.987 INFO:tasks.workunit.client.1.smithi064.stdout:5/569: symlink dd/d12/lba 0 2024-04-26T21:08:09.987 INFO:tasks.workunit.client.0.smithi055.stdout:3/514: mkdir d0/d4/d5/db8 0 2024-04-26T21:08:09.987 INFO:tasks.workunit.client.0.smithi055.stdout:3/515: fdatasync d0/f22 0 2024-04-26T21:08:09.988 INFO:tasks.workunit.client.0.smithi055.stdout:3/516: write d0/d4/fb2 [29579,83426] 0 2024-04-26T21:08:09.989 INFO:tasks.workunit.client.0.smithi055.stdout:3/517: chown d0/d4/d16/d18/d4b/d57/c8c 1 1 2024-04-26T21:08:09.995 INFO:tasks.workunit.client.0.smithi055.stdout:0/484: unlink d9/d11/d5b/d5e/d67/l8c 0 2024-04-26T21:08:09.995 INFO:tasks.workunit.client.1.smithi064.stdout:8/499: mknod d10/d41/d44/d7d/ca5 0 2024-04-26T21:08:09.995 INFO:tasks.workunit.client.1.smithi064.stdout:8/500: write d10/f7e [114569,55467] 0 2024-04-26T21:08:09.996 INFO:tasks.workunit.client.0.smithi055.stdout:8/379: symlink d3/l82 0 2024-04-26T21:08:09.996 INFO:tasks.workunit.client.0.smithi055.stdout:8/380: read f1 [3518178,90201] 0 2024-04-26T21:08:09.996 INFO:tasks.workunit.client.1.smithi064.stdout:7/610: link d6/d9/d3d/d43/lbb d6/db/d34/d6f/ld5 0 2024-04-26T21:08:09.997 INFO:tasks.workunit.client.1.smithi064.stdout:7/611: fdatasync d6/d8c/f9f 0 2024-04-26T21:08:09.997 INFO:tasks.workunit.client.1.smithi064.stdout:7/612: dread - d6/d8c/d9e/fc9 zero size 2024-04-26T21:08:09.997 INFO:tasks.workunit.client.0.smithi055.stdout:0/485: mkdir d9/dc/d17/d9a 0 2024-04-26T21:08:09.998 INFO:tasks.workunit.client.0.smithi055.stdout:0/486: creat d9/d11/d5b/d5e/d6c/d7a/f9b x:0 0 0 2024-04-26T21:08:09.998 INFO:tasks.workunit.client.0.smithi055.stdout:0/487: fsync d9/dc/d1c/f85 0 2024-04-26T21:08:10.001 INFO:tasks.workunit.client.1.smithi064.stdout:4/662: mkdir d0/d1d/d56/d89/dda 0 2024-04-26T21:08:10.002 INFO:tasks.workunit.client.0.smithi055.stdout:8/381: symlink d3/d77/l83 0 2024-04-26T21:08:10.005 INFO:tasks.workunit.client.1.smithi064.stdout:6/589: unlink d4/d7/d12/d49/d4b/f74 0 2024-04-26T21:08:10.007 INFO:tasks.workunit.client.1.smithi064.stdout:0/578: dread dd/f30 [0,4194304] 0 2024-04-26T21:08:10.011 INFO:tasks.workunit.client.1.smithi064.stdout:1/727: write d0/d6/d11/d1e/d2a/d34/d57/f96 [231088,25271] 0 2024-04-26T21:08:10.011 INFO:tasks.workunit.client.1.smithi064.stdout:1/728: getdents d0/d6/d91/d92/dc7 0 2024-04-26T21:08:10.011 INFO:tasks.workunit.client.0.smithi055.stdout:3/518: dread d0/d4/d5/d73/d13/d27/d50/d6b/f7d [0,4194304] 0 2024-04-26T21:08:10.011 INFO:tasks.workunit.client.0.smithi055.stdout:8/382: mkdir d3/d9/d1f/d84 0 2024-04-26T21:08:10.012 INFO:tasks.workunit.client.0.smithi055.stdout:8/383: read d3/d9/d1d/f6e [289457,81393] 0 2024-04-26T21:08:10.012 INFO:tasks.workunit.client.0.smithi055.stdout:5/326: sync 2024-04-26T21:08:10.012 INFO:tasks.workunit.client.0.smithi055.stdout:4/337: sync 2024-04-26T21:08:10.012 INFO:tasks.workunit.client.0.smithi055.stdout:8/384: write d3/d9/d1f/d2e/f40 [168719,55774] 0 2024-04-26T21:08:10.012 INFO:tasks.workunit.client.0.smithi055.stdout:4/338: write d4/d12/d17/d3d/f68 [273295,41890] 0 2024-04-26T21:08:10.013 INFO:tasks.workunit.client.0.smithi055.stdout:8/385: creat d3/d9/d1d/f85 x:0 0 0 2024-04-26T21:08:10.013 INFO:tasks.workunit.client.0.smithi055.stdout:8/386: truncate d3/d9/d1d/f65 516698 0 2024-04-26T21:08:10.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/612: creat d0/d4/da/d67/fc3 x:0 0 0 2024-04-26T21:08:10.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/613: read - d0/d39/f5c zero size 2024-04-26T21:08:10.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/614: fsync d0/d39/f3e 0 2024-04-26T21:08:10.014 INFO:tasks.workunit.client.1.smithi064.stdout:9/615: fsync d0/d4/d7/df/f32 0 2024-04-26T21:08:10.014 INFO:tasks.workunit.client.1.smithi064.stdout:9/616: chown d0/d4/f53 1412 1 2024-04-26T21:08:10.014 INFO:tasks.workunit.client.1.smithi064.stdout:2/661: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/lb0 d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/le3 0 2024-04-26T21:08:10.015 INFO:tasks.workunit.client.0.smithi055.stdout:3/519: unlink d0/d4/d5/d73/d13/d1a/d46/d55/la8 0 2024-04-26T21:08:10.015 INFO:tasks.workunit.client.1.smithi064.stdout:5/570: read f9 [953137,38858] 0 2024-04-26T21:08:10.016 INFO:tasks.workunit.client.0.smithi055.stdout:1/415: write d8/d17/d1b/f62 [2791832,85809] 0 2024-04-26T21:08:10.016 INFO:tasks.workunit.client.0.smithi055.stdout:3/520: creat d0/d4/d5/d73/d47/d37/d3d/fb9 x:0 0 0 2024-04-26T21:08:10.016 INFO:tasks.workunit.client.0.smithi055.stdout:3/521: chown d0/d4/d5/d73/d13/d1a/d46/d55/f59 1 1 2024-04-26T21:08:10.016 INFO:tasks.workunit.client.0.smithi055.stdout:9/446: dwrite d2/d46/d77/d7d/f83 [0,4194304] 0 2024-04-26T21:08:10.017 INFO:tasks.workunit.client.0.smithi055.stdout:5/327: chown d4/df/f47 290 1 2024-04-26T21:08:10.017 INFO:tasks.workunit.client.0.smithi055.stdout:5/328: dread - d4/df/f6b zero size 2024-04-26T21:08:10.021 INFO:tasks.workunit.client.0.smithi055.stdout:8/387: creat d3/d9/d1f/f86 x:0 0 0 2024-04-26T21:08:10.025 INFO:tasks.workunit.client.0.smithi055.stdout:0/488: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:08:10.025 INFO:tasks.workunit.client.0.smithi055.stdout:0/489: readlink d9/d11/d5b/d74/l3c 0 2024-04-26T21:08:10.030 INFO:tasks.workunit.client.0.smithi055.stdout:5/329: write d4/df/d13/d26/f31 [203934,428] 0 2024-04-26T21:08:10.037 INFO:tasks.workunit.client.0.smithi055.stdout:0/490: dread d9/d11/f46 [0,4194304] 0 2024-04-26T21:08:10.037 INFO:tasks.workunit.client.0.smithi055.stdout:7/415: dwrite d5/d53/d6e/f64 [0,4194304] 0 2024-04-26T21:08:10.038 INFO:tasks.workunit.client.1.smithi064.stdout:8/501: creat d10/d2f/fa6 x:0 0 0 2024-04-26T21:08:10.039 INFO:tasks.workunit.client.1.smithi064.stdout:8/502: truncate d10/d2f/d90/f93 710289 0 2024-04-26T21:08:10.039 INFO:tasks.workunit.client.1.smithi064.stdout:8/503: fsync d10/d41/d53/f9b 0 2024-04-26T21:08:10.041 INFO:tasks.workunit.client.1.smithi064.stdout:4/663: dread d0/d1d/f49 [0,4194304] 0 2024-04-26T21:08:10.041 INFO:tasks.workunit.client.1.smithi064.stdout:7/613: mknod d6/db/d34/d6f/d81/cd6 0 2024-04-26T21:08:10.048 INFO:tasks.workunit.client.1.smithi064.stdout:6/590: mknod d4/d7/d12/d49/d4b/d7d/d83/cbd 0 2024-04-26T21:08:10.048 INFO:tasks.workunit.client.1.smithi064.stdout:0/579: link dd/d10/d74/l20 dd/d10/d1a/lc6 0 2024-04-26T21:08:10.049 INFO:tasks.workunit.client.0.smithi055.stdout:3/522: mknod d0/d4/d16/cba 0 2024-04-26T21:08:10.049 INFO:tasks.workunit.client.0.smithi055.stdout:3/523: dread - d0/d4/d5/d73/d13/d1a/d46/d72/f7c zero size 2024-04-26T21:08:10.051 INFO:tasks.workunit.client.1.smithi064.stdout:2/662: creat d12/d41/fe4 x:0 0 0 2024-04-26T21:08:10.055 INFO:tasks.workunit.client.0.smithi055.stdout:9/447: creat d2/d46/d77/d7d/f90 x:0 0 0 2024-04-26T21:08:10.057 INFO:tasks.workunit.client.1.smithi064.stdout:5/571: unlink dd/da9/d63/f89 0 2024-04-26T21:08:10.057 INFO:tasks.workunit.client.1.smithi064.stdout:5/572: dread - dd/da9/d48/d6a/d81/fb8 zero size 2024-04-26T21:08:10.060 INFO:tasks.workunit.client.0.smithi055.stdout:1/416: truncate d8/df/d11/f37 78042 0 2024-04-26T21:08:10.060 INFO:tasks.workunit.client.0.smithi055.stdout:1/417: fsync d8/d17/d6a/f52 0 2024-04-26T21:08:10.060 INFO:tasks.workunit.client.0.smithi055.stdout:1/418: write d8/d17/f5a [331718,127335] 0 2024-04-26T21:08:10.062 INFO:tasks.workunit.client.1.smithi064.stdout:8/504: rmdir d10/d41/d53/d7a 0 2024-04-26T21:08:10.066 INFO:tasks.workunit.client.1.smithi064.stdout:6/591: dread d4/d7/d12/d38/f3f [0,4194304] 0 2024-04-26T21:08:10.066 INFO:tasks.workunit.client.1.smithi064.stdout:6/592: truncate d4/d7/d12/d38/f51 918976 0 2024-04-26T21:08:10.068 INFO:tasks.workunit.client.0.smithi055.stdout:8/388: rename d3/d9/d1f/c3f to d3/d9/d1d/d48/c87 0 2024-04-26T21:08:10.069 INFO:tasks.workunit.client.1.smithi064.stdout:0/580: symlink dd/d10/d74/lc7 0 2024-04-26T21:08:10.069 INFO:tasks.workunit.client.1.smithi064.stdout:2/663: dread d12/d41/d61/d75/f42 [0,4194304] 0 2024-04-26T21:08:10.070 INFO:tasks.workunit.client.1.smithi064.stdout:1/729: dwrite d0/d6/dd/fd6 [0,4194304] 0 2024-04-26T21:08:10.070 INFO:tasks.workunit.client.1.smithi064.stdout:9/617: dwrite d0/d4/d7/f89 [0,4194304] 0 2024-04-26T21:08:10.071 INFO:tasks.workunit.client.0.smithi055.stdout:6/392: sync 2024-04-26T21:08:10.071 INFO:tasks.workunit.client.0.smithi055.stdout:2/481: sync 2024-04-26T21:08:10.073 INFO:tasks.workunit.client.1.smithi064.stdout:8/505: mknod d10/d41/d44/d7d/ca7 0 2024-04-26T21:08:10.074 INFO:tasks.workunit.client.1.smithi064.stdout:3/557: sync 2024-04-26T21:08:10.074 INFO:tasks.workunit.client.1.smithi064.stdout:3/558: write d1/d27/d50/f5b [1634897,24574] 0 2024-04-26T21:08:10.076 INFO:tasks.workunit.client.0.smithi055.stdout:0/491: getdents d9/dc/d1c/d54/d4b/d68 0 2024-04-26T21:08:10.083 INFO:tasks.workunit.client.0.smithi055.stdout:7/416: mknod d5/d6/d24/d48/d75/c7b 0 2024-04-26T21:08:10.083 INFO:tasks.workunit.client.0.smithi055.stdout:7/417: fdatasync d5/d6/f41 0 2024-04-26T21:08:10.084 INFO:tasks.workunit.client.1.smithi064.stdout:2/664: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/f19 7414375 0 2024-04-26T21:08:10.084 INFO:tasks.workunit.client.1.smithi064.stdout:2/665: read - d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fd6 zero size 2024-04-26T21:08:10.086 INFO:tasks.workunit.client.0.smithi055.stdout:9/448: mknod d2/d46/c91 0 2024-04-26T21:08:10.086 INFO:tasks.workunit.client.0.smithi055.stdout:9/449: chown d2/d11/l3e 15073 1 2024-04-26T21:08:10.088 INFO:tasks.workunit.client.0.smithi055.stdout:1/419: mknod d8/d17/c8c 0 2024-04-26T21:08:10.091 INFO:tasks.workunit.client.1.smithi064.stdout:1/730: mknod d0/d6/d11/d6c/dda/cdf 0 2024-04-26T21:08:10.091 INFO:tasks.workunit.client.1.smithi064.stdout:5/573: dread dd/d12/d18/d25/d74/f82 [0,4194304] 0 2024-04-26T21:08:10.092 INFO:tasks.workunit.client.0.smithi055.stdout:5/330: rename d4/df/d13/d26/c5a to d4/df/d13/d26/d3c/d4a/d3f/c6d 0 2024-04-26T21:08:10.093 INFO:tasks.workunit.client.1.smithi064.stdout:8/506: read d10/d1d/f29 [347466,53684] 0 2024-04-26T21:08:10.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/450: dread d2/f1a [0,4194304] 0 2024-04-26T21:08:10.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/451: stat d2/d46/d77/d7d/f83 0 2024-04-26T21:08:10.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/452: fdatasync d2/d11/f26 0 2024-04-26T21:08:10.104 INFO:tasks.workunit.client.0.smithi055.stdout:2/482: unlink d4/db/d1f/f3d 0 2024-04-26T21:08:10.113 INFO:tasks.workunit.client.0.smithi055.stdout:7/418: dread d5/d6/d24/d3b/f44 [0,4194304] 0 2024-04-26T21:08:10.114 INFO:tasks.workunit.client.0.smithi055.stdout:7/419: fdatasync d5/d6/d24/d3b/f45 0 2024-04-26T21:08:10.119 INFO:tasks.workunit.client.1.smithi064.stdout:4/664: dwrite d0/d5/d79/fbe [0,4194304] 0 2024-04-26T21:08:10.120 INFO:tasks.workunit.client.1.smithi064.stdout:4/665: creat d0/d2f/d87/fdb x:0 0 0 2024-04-26T21:08:10.121 INFO:tasks.workunit.client.0.smithi055.stdout:0/492: mkdir d9/dc/d1c/d54/d9c 0 2024-04-26T21:08:10.126 INFO:tasks.workunit.client.0.smithi055.stdout:5/331: mknod d4/df/d13/d26/d3c/d4a/d3f/c6e 0 2024-04-26T21:08:10.126 INFO:tasks.workunit.client.0.smithi055.stdout:5/332: write d4/df/d13/f25 [567526,86829] 0 2024-04-26T21:08:10.126 INFO:tasks.workunit.client.0.smithi055.stdout:5/333: write d4/df/f1b [1980441,89995] 0 2024-04-26T21:08:10.127 INFO:tasks.workunit.client.1.smithi064.stdout:2/666: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/fe5 x:0 0 0 2024-04-26T21:08:10.128 INFO:tasks.workunit.client.1.smithi064.stdout:2/667: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l59 0 2024-04-26T21:08:10.128 INFO:tasks.workunit.client.1.smithi064.stdout:1/731: mkdir d0/d6/de0 0 2024-04-26T21:08:10.130 INFO:tasks.workunit.client.0.smithi055.stdout:2/483: rmdir d4/dc 39 2024-04-26T21:08:10.132 INFO:tasks.workunit.client.0.smithi055.stdout:6/393: dread d3/d4f/f69 [0,4194304] 0 2024-04-26T21:08:10.132 INFO:tasks.workunit.client.0.smithi055.stdout:6/394: read - d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e zero size 2024-04-26T21:08:10.134 INFO:tasks.workunit.client.0.smithi055.stdout:7/420: getdents d5/d6/d24/d48/d75 0 2024-04-26T21:08:10.143 INFO:tasks.workunit.client.0.smithi055.stdout:0/493: unlink d9/dc/d1c/f29 0 2024-04-26T21:08:10.152 INFO:tasks.workunit.client.0.smithi055.stdout:6/395: rename d3/f15 to d3/d17/d46/d54/d66/d6a/d67/f89 0 2024-04-26T21:08:10.157 INFO:tasks.workunit.client.1.smithi064.stdout:1/732: unlink d0/d6/d11/d1e/d2a/d34/fc5 0 2024-04-26T21:08:10.160 INFO:tasks.workunit.client.0.smithi055.stdout:0/494: mknod d9/d11/d5b/d5e/d6c/c9d 0 2024-04-26T21:08:10.160 INFO:tasks.workunit.client.0.smithi055.stdout:6/396: truncate d3/f64 25969 0 2024-04-26T21:08:10.161 INFO:tasks.workunit.client.1.smithi064.stdout:0/581: rename dd/d10/d1a to dd/d21/dc8 0 2024-04-26T21:08:10.162 INFO:tasks.workunit.client.1.smithi064.stdout:2/668: rmdir d12/d45 39 2024-04-26T21:08:10.162 INFO:tasks.workunit.client.1.smithi064.stdout:2/669: dread - d12/d41/d61/fdb zero size 2024-04-26T21:08:10.167 INFO:tasks.workunit.client.1.smithi064.stdout:7/614: dwrite d6/d15/d88/dca/f5e [0,4194304] 0 2024-04-26T21:08:10.167 INFO:tasks.workunit.client.1.smithi064.stdout:1/733: link d0/d6/c2e d0/d6/d11/d1e/d2a/d34/d57/ce1 0 2024-04-26T21:08:10.167 INFO:tasks.workunit.client.1.smithi064.stdout:1/734: fsync d0/d6/d11/d1e/d2a/d72/f84 0 2024-04-26T21:08:10.168 INFO:tasks.workunit.client.1.smithi064.stdout:3/559: rename d1/d27/d50/d35/d4c/d7b/d82/f57 to d1/d27/d50/d35/d4c/fc0 0 2024-04-26T21:08:10.169 INFO:tasks.workunit.client.1.smithi064.stdout:0/582: creat dd/fc9 x:0 0 0 2024-04-26T21:08:10.171 INFO:tasks.workunit.client.0.smithi055.stdout:6/397: creat d3/d17/d46/d54/d66/d6a/d67/d83/f8a x:0 0 0 2024-04-26T21:08:10.171 INFO:tasks.workunit.client.0.smithi055.stdout:8/389: dwrite d3/d9/d44/f67 [0,4194304] 0 2024-04-26T21:08:10.178 INFO:tasks.workunit.client.0.smithi055.stdout:4/339: dwrite d4/f1d [0,4194304] 0 2024-04-26T21:08:10.182 INFO:tasks.workunit.client.1.smithi064.stdout:6/593: dwrite d4/d7/d12/d1e/f2b [0,4194304] 0 2024-04-26T21:08:10.182 INFO:tasks.workunit.client.1.smithi064.stdout:6/594: stat l3 0 2024-04-26T21:08:10.182 INFO:tasks.workunit.client.1.smithi064.stdout:6/595: chown d4/d7/d12/d49/d4b/d5a/d79/lbb 132 1 2024-04-26T21:08:10.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/670: creat d12/d41/d73/d83/d94/d3a/d46/d91/fe6 x:0 0 0 2024-04-26T21:08:10.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/671: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/fe5 308111 0 2024-04-26T21:08:10.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/672: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l8c 0 2024-04-26T21:08:10.190 INFO:tasks.workunit.client.1.smithi064.stdout:2/673: creat d12/d41/d73/d83/d94/d3a/d46/d91/fe7 x:0 0 0 2024-04-26T21:08:10.192 INFO:tasks.workunit.client.1.smithi064.stdout:7/615: mkdir d6/d70/da8/dd7 0 2024-04-26T21:08:10.192 INFO:tasks.workunit.client.1.smithi064.stdout:7/616: chown d6/d15/d88/dca/d5c/f7b 4709131 1 2024-04-26T21:08:10.192 INFO:tasks.workunit.client.1.smithi064.stdout:7/617: creat d6/d15/d67/d4d/fd8 x:0 0 0 2024-04-26T21:08:10.193 INFO:tasks.workunit.client.1.smithi064.stdout:7/618: dread - d6/d9/d38/fb3 zero size 2024-04-26T21:08:10.195 INFO:tasks.workunit.client.0.smithi055.stdout:3/524: dwrite d0/d4/d5/d73/d13/d1a/f35 [0,4194304] 0 2024-04-26T21:08:10.195 INFO:tasks.workunit.client.0.smithi055.stdout:3/525: stat d0/d4/d5/d73/d47/d37/c39 0 2024-04-26T21:08:10.199 INFO:tasks.workunit.client.1.smithi064.stdout:1/735: symlink d0/d6/d11/d1e/d2a/d34/d57/d9b/le2 0 2024-04-26T21:08:10.199 INFO:tasks.workunit.client.1.smithi064.stdout:1/736: stat d0/d6/d11/l5a 0 2024-04-26T21:08:10.199 INFO:tasks.workunit.client.1.smithi064.stdout:1/737: chown d0/d6/d29/d31/c95 9204875 1 2024-04-26T21:08:10.199 INFO:tasks.workunit.client.1.smithi064.stdout:1/738: truncate d0/d6b/fa8 914467 0 2024-04-26T21:08:10.204 INFO:tasks.workunit.client.0.smithi055.stdout:8/390: symlink d3/d9/d1d/d48/d57/d61/l88 0 2024-04-26T21:08:10.204 INFO:tasks.workunit.client.0.smithi055.stdout:8/391: chown d3/d9/c37 7517515 1 2024-04-26T21:08:10.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/420: read d8/f19 [221663,27570] 0 2024-04-26T21:08:10.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/421: fsync d8/df/d11/d27/d28/d2a/f58 0 2024-04-26T21:08:10.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/422: stat d8/d17/d1b/d7b 0 2024-04-26T21:08:10.211 INFO:tasks.workunit.client.0.smithi055.stdout:1/423: chown d8/f86 30 1 2024-04-26T21:08:10.213 INFO:tasks.workunit.client.1.smithi064.stdout:9/618: dwrite d0/d4/d7/df/fa0 [0,4194304] 0 2024-04-26T21:08:10.216 INFO:tasks.workunit.client.1.smithi064.stdout:3/560: mkdir d1/d27/d50/d35/d4c/d7b/dc1 0 2024-04-26T21:08:10.220 INFO:tasks.workunit.client.0.smithi055.stdout:4/340: mknod d4/d26/d42/d56/c77 0 2024-04-26T21:08:10.220 INFO:tasks.workunit.client.1.smithi064.stdout:6/596: rename d4/d7/d12/f98 to d4/d7/d12/fbe 0 2024-04-26T21:08:10.223 INFO:tasks.workunit.client.0.smithi055.stdout:9/453: dwrite d2/d46/d77/d7d/f90 [0,4194304] 0 2024-04-26T21:08:10.225 INFO:tasks.workunit.client.1.smithi064.stdout:2/674: symlink d12/d41/d73/d83/d94/d3a/d46/le8 0 2024-04-26T21:08:10.226 INFO:tasks.workunit.client.0.smithi055.stdout:5/334: dwrite d4/d15/f52 [4194304,4194304] 0 2024-04-26T21:08:10.227 INFO:tasks.workunit.client.0.smithi055.stdout:4/341: rename d4/l14 to d4/d12/d17/l78 0 2024-04-26T21:08:10.228 INFO:tasks.workunit.client.0.smithi055.stdout:4/342: creat d4/d12/d15/f79 x:0 0 0 2024-04-26T21:08:10.230 INFO:tasks.workunit.client.1.smithi064.stdout:5/574: dwrite dd/da9/d48/f4c [0,4194304] 0 2024-04-26T21:08:10.230 INFO:tasks.workunit.client.1.smithi064.stdout:5/575: chown dd/d12/d18/d1a/d1f/d20/f95 1663383 1 2024-04-26T21:08:10.230 INFO:tasks.workunit.client.1.smithi064.stdout:4/666: dwrite d0/d14/f95 [0,4194304] 0 2024-04-26T21:08:10.233 INFO:tasks.workunit.client.0.smithi055.stdout:9/454: rmdir d2 39 2024-04-26T21:08:10.241 INFO:tasks.workunit.client.1.smithi064.stdout:9/619: mkdir d0/d4/da/d26/d45/dc4 0 2024-04-26T21:08:10.250 INFO:tasks.workunit.client.0.smithi055.stdout:5/335: mknod d4/df/d13/d26/d3c/d4a/d3f/d4f/c6f 0 2024-04-26T21:08:10.257 INFO:tasks.workunit.client.0.smithi055.stdout:7/421: dwrite d5/f57 [0,4194304] 0 2024-04-26T21:08:10.257 INFO:tasks.workunit.client.0.smithi055.stdout:7/422: fsync d5/d6/d24/f38 0 2024-04-26T21:08:10.259 INFO:tasks.workunit.client.0.smithi055.stdout:9/455: dread d2/f1a [0,4194304] 0 2024-04-26T21:08:10.261 INFO:tasks.workunit.client.1.smithi064.stdout:3/561: dread d1/d14/f6a [0,4194304] 0 2024-04-26T21:08:10.262 INFO:tasks.workunit.client.1.smithi064.stdout:3/562: fdatasync d1/d27/d29/d6f/d72/d26/f9a 0 2024-04-26T21:08:10.262 INFO:tasks.workunit.client.1.smithi064.stdout:3/563: fsync d1/d27/d29/d6f/d72/d73/f90 0 2024-04-26T21:08:10.265 INFO:tasks.workunit.client.1.smithi064.stdout:0/583: dwrite dd/d10/f7d [0,4194304] 0 2024-04-26T21:08:10.265 INFO:tasks.workunit.client.1.smithi064.stdout:0/584: fdatasync dd/d21/dc8/d31/d47/d61/f70 0 2024-04-26T21:08:10.266 INFO:tasks.workunit.client.0.smithi055.stdout:2/484: dwrite d4/db/d1f/d46/f64 [4194304,4194304] 0 2024-04-26T21:08:10.267 INFO:tasks.workunit.client.1.smithi064.stdout:0/585: chown dd/d10/d18/d64/fa1 20465476 1 2024-04-26T21:08:10.269 INFO:tasks.workunit.client.1.smithi064.stdout:7/619: dwrite d6/d9/d38/fb3 [0,4194304] 0 2024-04-26T21:08:10.269 INFO:tasks.workunit.client.1.smithi064.stdout:7/620: read d6/d9/d3d/f6e [1240743,13189] 0 2024-04-26T21:08:10.272 INFO:tasks.workunit.client.1.smithi064.stdout:1/739: dwrite d0/d6/d91/d92/fbf [0,4194304] 0 2024-04-26T21:08:10.275 INFO:tasks.workunit.client.0.smithi055.stdout:5/336: creat d4/df/d13/d26/d3c/d5b/f70 x:0 0 0 2024-04-26T21:08:10.279 INFO:tasks.workunit.client.0.smithi055.stdout:7/423: creat d5/d53/d6e/d65/f7c x:0 0 0 2024-04-26T21:08:10.279 INFO:tasks.workunit.client.0.smithi055.stdout:7/424: chown d5/d11/f5d 799 1 2024-04-26T21:08:10.280 INFO:tasks.workunit.client.1.smithi064.stdout:9/620: dread d0/f59 [0,4194304] 0 2024-04-26T21:08:10.285 INFO:tasks.workunit.client.1.smithi064.stdout:5/576: rename dd/da9/d48/fa2 to dd/d12/d18/d25/d74/fbb 0 2024-04-26T21:08:10.287 INFO:tasks.workunit.client.1.smithi064.stdout:4/667: creat d0/d2f/d69/db5/fdc x:0 0 0 2024-04-26T21:08:10.289 INFO:tasks.workunit.client.0.smithi055.stdout:5/337: rename d4/df/d13/d26/d3c/d4a/f57 to d4/df/d13/d26/d3c/f71 0 2024-04-26T21:08:10.289 INFO:tasks.workunit.client.1.smithi064.stdout:0/586: symlink dd/d21/dc8/d31/d47/d61/d42/lca 0 2024-04-26T21:08:10.290 INFO:tasks.workunit.client.0.smithi055.stdout:2/485: read d4/d14/d17/d36/f4e [2500868,51580] 0 2024-04-26T21:08:10.296 INFO:tasks.workunit.client.1.smithi064.stdout:7/621: rename d6/d15/d67/d65/cab to d6/d15/d88/dca/cd9 0 2024-04-26T21:08:10.297 INFO:tasks.workunit.client.1.smithi064.stdout:3/564: getdents d1/d27/d29/d5e 0 2024-04-26T21:08:10.297 INFO:tasks.workunit.client.1.smithi064.stdout:3/565: write d1/d27/d29/d6f/d72/f40 [3280041,36429] 0 2024-04-26T21:08:10.297 INFO:tasks.workunit.client.1.smithi064.stdout:3/566: chown d1/d27/d29/d6f/d72/d7a/d84/laa 4 1 2024-04-26T21:08:10.302 INFO:tasks.workunit.client.1.smithi064.stdout:4/668: mkdir d0/d2f/d69/db5/ddd 0 2024-04-26T21:08:10.304 INFO:tasks.workunit.client.1.smithi064.stdout:0/587: unlink dd/d21/dc8/l3d 0 2024-04-26T21:08:10.307 INFO:tasks.workunit.client.0.smithi055.stdout:4/343: dwrite d4/f21 [0,4194304] 0 2024-04-26T21:08:10.309 INFO:tasks.workunit.client.0.smithi055.stdout:3/526: dwrite d0/d4/d5/d73/d13/d1a/f24 [0,4194304] 0 2024-04-26T21:08:10.316 INFO:tasks.workunit.client.0.smithi055.stdout:6/398: dwrite d3/d17/d46/d54/d66/d6a/f28 [0,4194304] 0 2024-04-26T21:08:10.317 INFO:tasks.workunit.client.1.smithi064.stdout:6/597: dwrite d4/d7/d12/d49/d4b/d56/d95/fac [0,4194304] 0 2024-04-26T21:08:10.318 INFO:tasks.workunit.client.1.smithi064.stdout:7/622: link d6/db/d34/f5b d6/d9/d38/fda 0 2024-04-26T21:08:10.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/621: dread d0/d4/da/d26/f6f [0,4194304] 0 2024-04-26T21:08:10.318 INFO:tasks.workunit.client.1.smithi064.stdout:9/622: stat d0/d4/da/d26 0 2024-04-26T21:08:10.318 INFO:tasks.workunit.client.0.smithi055.stdout:5/338: dread d4/df/d13/d26/f58 [0,4194304] 0 2024-04-26T21:08:10.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/486: rmdir d4/db/d26 39 2024-04-26T21:08:10.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/487: write d4/f89 [1239231,16664] 0 2024-04-26T21:08:10.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/488: truncate d4/d49/f87 1467387 0 2024-04-26T21:08:10.328 INFO:tasks.workunit.client.1.smithi064.stdout:2/675: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fb1 [0,4194304] 0 2024-04-26T21:08:10.329 INFO:tasks.workunit.client.1.smithi064.stdout:3/567: creat d1/d27/d29/d6f/d72/da5/d7d/fc2 x:0 0 0 2024-04-26T21:08:10.334 INFO:tasks.workunit.client.1.smithi064.stdout:4/669: symlink d0/d5/d13/d33/dd0/lde 0 2024-04-26T21:08:10.339 INFO:tasks.workunit.client.0.smithi055.stdout:1/424: dwrite d8/d17/d6a/f52 [0,4194304] 0 2024-04-26T21:08:10.339 INFO:tasks.workunit.client.0.smithi055.stdout:1/425: write d8/df/d11/d27/d28/f40 [531713,10361] 0 2024-04-26T21:08:10.351 INFO:tasks.workunit.client.1.smithi064.stdout:5/577: write dd/d12/f2e [2626595,77564] 0 2024-04-26T21:08:10.351 INFO:tasks.workunit.client.1.smithi064.stdout:5/578: stat dd/d12/d18/d25/d67/db3 0 2024-04-26T21:08:10.351 INFO:tasks.workunit.client.1.smithi064.stdout:0/588: link dd/d21/dc8/d31/d47/f53 dd/d10/d18/d58/fcb 0 2024-04-26T21:08:10.351 INFO:tasks.workunit.client.1.smithi064.stdout:1/740: dwrite d0/d6/d11/d1e/d2a/d72/f84 [0,4194304] 0 2024-04-26T21:08:10.351 INFO:tasks.workunit.client.1.smithi064.stdout:0/589: write dd/d10/d74/d4f/d7b/f9f [60807,73812] 0 2024-04-26T21:08:10.357 INFO:tasks.workunit.client.0.smithi055.stdout:6/399: rename d3/d17/d46/d54/d66/d6a/f28 to d3/f8b 0 2024-04-26T21:08:10.357 INFO:tasks.workunit.client.0.smithi055.stdout:6/400: chown d3/d17/d46/d54/d66/d6a/d67/d83/f8a 3 1 2024-04-26T21:08:10.357 INFO:tasks.workunit.client.0.smithi055.stdout:6/401: truncate d3/d17/d19/f3d 4853822 0 2024-04-26T21:08:10.357 INFO:tasks.workunit.client.0.smithi055.stdout:7/425: write d5/d6/d24/d3b/f44 [582026,101934] 0 2024-04-26T21:08:10.357 INFO:tasks.workunit.client.0.smithi055.stdout:6/402: rename d3 to d3/d17/d25/d8c 22 2024-04-26T21:08:10.359 INFO:tasks.workunit.client.0.smithi055.stdout:5/339: link d4/df/d13/d26/d3c/d4a/d3f/d4f/c6f d4/df/d13/d26/c72 0 2024-04-26T21:08:10.360 INFO:tasks.workunit.client.1.smithi064.stdout:2/676: fsync d12/d41/d61/d75/f2b 0 2024-04-26T21:08:10.361 INFO:tasks.workunit.client.1.smithi064.stdout:2/677: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/f67 [1524349,103445] 0 2024-04-26T21:08:10.361 INFO:tasks.workunit.client.1.smithi064.stdout:2/678: chown d12/c2e 129924 1 2024-04-26T21:08:10.361 INFO:tasks.workunit.client.0.smithi055.stdout:2/489: mknod d4/dc/d21/ca7 0 2024-04-26T21:08:10.362 INFO:tasks.workunit.client.0.smithi055.stdout:4/344: rmdir d4/d26/d42/d28/d53/d70 39 2024-04-26T21:08:10.365 INFO:tasks.workunit.client.1.smithi064.stdout:4/670: rename d0/ff to d0/d5/d79/dd1/fdf 0 2024-04-26T21:08:10.375 INFO:tasks.workunit.client.1.smithi064.stdout:5/579: creat dd/da9/d48/d6a/d9e/db9/fbc x:0 0 0 2024-04-26T21:08:10.375 INFO:tasks.workunit.client.1.smithi064.stdout:5/580: write dd/d12/d18/d1a/d1b/f5b [284166,115270] 0 2024-04-26T21:08:10.376 INFO:tasks.workunit.client.0.smithi055.stdout:7/426: rmdir d5/d53/d6e 39 2024-04-26T21:08:10.376 INFO:tasks.workunit.client.0.smithi055.stdout:7/427: truncate d5/d6/d24/d4d/f60 137111 0 2024-04-26T21:08:10.379 INFO:tasks.workunit.client.0.smithi055.stdout:6/403: creat d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d x:0 0 0 2024-04-26T21:08:10.379 INFO:tasks.workunit.client.1.smithi064.stdout:0/590: getdents dd/d21/dc8/d31/d47/dad 0 2024-04-26T21:08:10.381 INFO:tasks.workunit.client.0.smithi055.stdout:5/340: mknod d4/df/d13/d26/d3c/c73 0 2024-04-26T21:08:10.382 INFO:tasks.workunit.client.1.smithi064.stdout:6/598: dwrite d4/d7/d12/d1e/f63 [4194304,4194304] 0 2024-04-26T21:08:10.383 INFO:tasks.workunit.client.0.smithi055.stdout:9/456: dwrite d2/d46/d77/f70 [0,4194304] 0 2024-04-26T21:08:10.384 INFO:tasks.workunit.client.0.smithi055.stdout:3/527: dwrite d0/d4/d5/d73/d13/d1a/f24 [0,4194304] 0 2024-04-26T21:08:10.385 INFO:tasks.workunit.client.0.smithi055.stdout:1/426: rmdir d8/df/d11/d27/d28/d2a 39 2024-04-26T21:08:10.387 INFO:tasks.workunit.client.1.smithi064.stdout:7/623: mknod d6/d9/d3d/d43/cdb 0 2024-04-26T21:08:10.389 INFO:tasks.workunit.client.0.smithi055.stdout:6/404: rmdir d3/d17/d46/d54/d66 39 2024-04-26T21:08:10.389 INFO:tasks.workunit.client.0.smithi055.stdout:6/405: chown d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e 12045608 1 2024-04-26T21:08:10.393 INFO:tasks.workunit.client.1.smithi064.stdout:9/623: getdents d0/d4/d7 0 2024-04-26T21:08:10.395 INFO:tasks.workunit.client.1.smithi064.stdout:5/581: dread dd/da9/d48/f4c [0,4194304] 0 2024-04-26T21:08:10.395 INFO:tasks.workunit.client.1.smithi064.stdout:5/582: write dd/d12/d18/d25/d74/fbb [1223623,40868] 0 2024-04-26T21:08:10.395 INFO:tasks.workunit.client.0.smithi055.stdout:7/428: dread d5/d6/d24/d52/f5e [0,4194304] 0 2024-04-26T21:08:10.399 INFO:tasks.workunit.client.1.smithi064.stdout:2/679: mknod d12/d41/d73/d83/d94/d3a/dba/ce9 0 2024-04-26T21:08:10.407 INFO:tasks.workunit.client.1.smithi064.stdout:4/671: mknod d0/d1d/d56/d89/ce0 0 2024-04-26T21:08:10.407 INFO:tasks.workunit.client.1.smithi064.stdout:1/741: rmdir d0/d6/d76 39 2024-04-26T21:08:10.407 INFO:tasks.workunit.client.1.smithi064.stdout:1/742: creat d0/d6/d11/d2c/d9c/dbc/fe3 x:0 0 0 2024-04-26T21:08:10.407 INFO:tasks.workunit.client.0.smithi055.stdout:9/457: creat d2/f92 x:0 0 0 2024-04-26T21:08:10.407 INFO:tasks.workunit.client.0.smithi055.stdout:4/345: dwrite d4/d12/d15/f79 [0,4194304] 0 2024-04-26T21:08:10.409 INFO:tasks.workunit.client.1.smithi064.stdout:6/599: rename d4/d7/d12/d38/f51 to d4/d7/d12/fbf 0 2024-04-26T21:08:10.411 INFO:tasks.workunit.client.0.smithi055.stdout:2/490: read d4/db/d1f/d32/f3e [597047,50651] 0 2024-04-26T21:08:10.412 INFO:tasks.workunit.client.1.smithi064.stdout:7/624: unlink d6/d15/d67/d65/l79 0 2024-04-26T21:08:10.414 INFO:tasks.workunit.client.0.smithi055.stdout:3/528: dread d0/f34 [0,4194304] 0 2024-04-26T21:08:10.414 INFO:tasks.workunit.client.0.smithi055.stdout:3/529: read - d0/d4/d5/d73/d47/fb7 zero size 2024-04-26T21:08:10.414 INFO:tasks.workunit.client.0.smithi055.stdout:3/530: creat d0/d4/d5/d73/d13/d1a/d46/d72/d69/fbb x:0 0 0 2024-04-26T21:08:10.415 INFO:tasks.workunit.client.0.smithi055.stdout:5/341: link d4/df/d13/d26/d3c/d4a/d3f/d2e/l44 d4/df/l74 0 2024-04-26T21:08:10.416 INFO:tasks.workunit.client.1.smithi064.stdout:9/624: mknod d0/d4/d28/d4f/cc5 0 2024-04-26T21:08:10.418 INFO:tasks.workunit.client.0.smithi055.stdout:9/458: mknod d2/d11/c93 0 2024-04-26T21:08:10.418 INFO:tasks.workunit.client.0.smithi055.stdout:6/406: read d3/d17/d46/d54/d66/d6a/d67/f89 [8147367,105457] 0 2024-04-26T21:08:10.418 INFO:tasks.workunit.client.0.smithi055.stdout:6/407: truncate d3/d4f/f87 235203 0 2024-04-26T21:08:10.420 INFO:tasks.workunit.client.1.smithi064.stdout:8/507: sync 2024-04-26T21:08:10.422 INFO:tasks.workunit.client.1.smithi064.stdout:5/583: mkdir dd/d12/d4f/dbd 0 2024-04-26T21:08:10.424 INFO:tasks.workunit.client.1.smithi064.stdout:0/591: dwrite dd/d10/d18/f49 [4194304,4194304] 0 2024-04-26T21:08:10.426 INFO:tasks.workunit.client.1.smithi064.stdout:2/680: unlink d12/d41/d73/d83/d94/fd8 0 2024-04-26T21:08:10.428 INFO:tasks.workunit.client.0.smithi055.stdout:4/346: symlink d4/d26/d42/d28/d53/l7a 0 2024-04-26T21:08:10.435 INFO:tasks.workunit.client.1.smithi064.stdout:1/743: mknod d0/d6b/d9e/ce4 0 2024-04-26T21:08:10.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/459: dread d2/d46/d77/d5f/f67 [0,4194304] 0 2024-04-26T21:08:10.436 INFO:tasks.workunit.client.0.smithi055.stdout:9/460: read d2/f10 [1863382,55896] 0 2024-04-26T21:08:10.438 INFO:tasks.workunit.client.1.smithi064.stdout:6/600: link d4/d7/f3a d4/d7/d12/d49/d9e/fc0 0 2024-04-26T21:08:10.440 INFO:tasks.workunit.client.0.smithi055.stdout:2/491: rename d4/db/d26/da4 to d4/db/d26/da8 0 2024-04-26T21:08:10.442 INFO:tasks.workunit.client.1.smithi064.stdout:7/625: mknod d6/d15/d1c/d45/cdc 0 2024-04-26T21:08:10.442 INFO:tasks.workunit.client.1.smithi064.stdout:7/626: chown d6/d9/f8d 85583735 1 2024-04-26T21:08:10.442 INFO:tasks.workunit.client.1.smithi064.stdout:4/672: dwrite d0/d5/fce [0,4194304] 0 2024-04-26T21:08:10.442 INFO:tasks.workunit.client.1.smithi064.stdout:4/673: chown d0/d5/d13/d33/dd0 500220724 1 2024-04-26T21:08:10.442 INFO:tasks.workunit.client.1.smithi064.stdout:4/674: write d0/d2f/d7d/faf [5023495,1903] 0 2024-04-26T21:08:10.443 INFO:tasks.workunit.client.1.smithi064.stdout:9/625: rmdir d0/d4/da/d26/d47/d9d 39 2024-04-26T21:08:10.446 INFO:tasks.workunit.client.1.smithi064.stdout:8/508: link d10/d41/d44/d5a/l9d d10/la8 0 2024-04-26T21:08:10.446 INFO:tasks.workunit.client.1.smithi064.stdout:8/509: stat d10/d41/d4e/l91 0 2024-04-26T21:08:10.446 INFO:tasks.workunit.client.1.smithi064.stdout:8/510: fdatasync d10/d1d/d38/f5e 0 2024-04-26T21:08:10.446 INFO:tasks.workunit.client.1.smithi064.stdout:8/511: fdatasync d10/d1d/f43 0 2024-04-26T21:08:10.447 INFO:tasks.workunit.client.0.smithi055.stdout:3/531: creat d0/de/fbc x:0 0 0 2024-04-26T21:08:10.448 INFO:tasks.workunit.client.1.smithi064.stdout:5/584: mkdir dd/d12/d4f/dbe 0 2024-04-26T21:08:10.448 INFO:tasks.workunit.client.0.smithi055.stdout:5/342: rmdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53 39 2024-04-26T21:08:10.449 INFO:tasks.workunit.client.0.smithi055.stdout:5/343: dread - d4/df/f47 zero size 2024-04-26T21:08:10.453 INFO:tasks.workunit.client.1.smithi064.stdout:2/681: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/cad d12/d45/dd7/cea 0 2024-04-26T21:08:10.455 INFO:tasks.workunit.client.0.smithi055.stdout:6/408: symlink d3/d17/d19/l8e 0 2024-04-26T21:08:10.456 INFO:tasks.workunit.client.1.smithi064.stdout:1/744: mknod d0/d6/de0/ce5 0 2024-04-26T21:08:10.456 INFO:tasks.workunit.client.1.smithi064.stdout:1/745: dread - d0/d6/d91/d92/fc8 zero size 2024-04-26T21:08:10.457 INFO:tasks.workunit.client.1.smithi064.stdout:1/746: getdents d0/d6b/d9e/da2/dc9 0 2024-04-26T21:08:10.458 INFO:tasks.workunit.client.0.smithi055.stdout:4/347: creat d4/d12/d61/d74/f7b x:0 0 0 2024-04-26T21:08:10.462 INFO:tasks.workunit.client.0.smithi055.stdout:1/427: rename d8/df/d11/d44 to d8/d17/d1b/d7b/d8d 0 2024-04-26T21:08:10.469 INFO:tasks.workunit.client.0.smithi055.stdout:9/461: mkdir d2/d46/d77/d7d/d94 0 2024-04-26T21:08:10.472 INFO:tasks.workunit.client.0.smithi055.stdout:2/492: rmdir d4/dc 39 2024-04-26T21:08:10.476 INFO:tasks.workunit.client.0.smithi055.stdout:3/532: mkdir d0/d4/d5/d73/d47/d37/dbd 0 2024-04-26T21:08:10.477 INFO:tasks.workunit.client.0.smithi055.stdout:3/533: chown d0/d4/d5/d73/d13/d27/d50 0 1 2024-04-26T21:08:10.477 INFO:tasks.workunit.client.0.smithi055.stdout:3/534: chown d0/d4/l8d 61920 1 2024-04-26T21:08:10.483 INFO:tasks.workunit.client.0.smithi055.stdout:6/409: mkdir d3/d17/d19/d7b/d8f 0 2024-04-26T21:08:10.485 INFO:tasks.workunit.client.1.smithi064.stdout:7/627: unlink d6/d15/d88/dca/fd0 0 2024-04-26T21:08:10.485 INFO:tasks.workunit.client.1.smithi064.stdout:7/628: creat d6/db/dc1/fdd x:0 0 0 2024-04-26T21:08:10.485 INFO:tasks.workunit.client.1.smithi064.stdout:7/629: chown d6/db/d34/d6f/d81/fae 14745 1 2024-04-26T21:08:10.488 INFO:tasks.workunit.client.0.smithi055.stdout:1/428: creat d8/df/f8e x:0 0 0 2024-04-26T21:08:10.489 INFO:tasks.workunit.client.1.smithi064.stdout:4/675: truncate d0/d1d/d17/f2c 5840311 0 2024-04-26T21:08:10.489 INFO:tasks.workunit.client.1.smithi064.stdout:4/676: truncate d0/d1d/d17/d44/dac/d54/fa8 4436649 0 2024-04-26T21:08:10.492 INFO:tasks.workunit.client.1.smithi064.stdout:9/626: mknod d0/d4/da/d31/d34/cc6 0 2024-04-26T21:08:10.493 INFO:tasks.workunit.client.0.smithi055.stdout:9/462: write d2/d46/d77/f70 [2546028,49145] 0 2024-04-26T21:08:10.494 INFO:tasks.workunit.client.1.smithi064.stdout:6/601: dwrite d4/d7/d12/f4f [4194304,4194304] 0 2024-04-26T21:08:10.494 INFO:tasks.workunit.client.1.smithi064.stdout:6/602: readlink d4/d7/d12/d38/l52 0 2024-04-26T21:08:10.494 INFO:tasks.workunit.client.1.smithi064.stdout:6/603: truncate d4/d7/f9c 745323 0 2024-04-26T21:08:10.495 INFO:tasks.workunit.client.1.smithi064.stdout:0/592: rmdir dd/d10/d74/d1d 39 2024-04-26T21:08:10.502 INFO:tasks.workunit.client.1.smithi064.stdout:2/682: unlink d12/d41/d61/d75/f2b 0 2024-04-26T21:08:10.509 INFO:tasks.workunit.client.0.smithi055.stdout:2/493: rename d4/db/d26/da8 to d4/d14/d17/d6d/d81/da9 0 2024-04-26T21:08:10.509 INFO:tasks.workunit.client.0.smithi055.stdout:2/494: dread - d4/db/d1f/d46/f5a zero size 2024-04-26T21:08:10.509 INFO:tasks.workunit.client.0.smithi055.stdout:2/495: write d4/d55/d6c/fa2 [3476968,59431] 0 2024-04-26T21:08:10.509 INFO:tasks.workunit.client.1.smithi064.stdout:1/747: dwrite d0/d6/d11/d1e/d2a/d34/fd8 [0,4194304] 0 2024-04-26T21:08:10.509 INFO:tasks.workunit.client.1.smithi064.stdout:1/748: chown d0/d6/d11/d1e/d2a/d34 717 1 2024-04-26T21:08:10.510 INFO:tasks.workunit.client.1.smithi064.stdout:1/749: chown d0/d6/d11/d1e/d2a/d34/f8e 363 1 2024-04-26T21:08:10.511 INFO:tasks.workunit.client.0.smithi055.stdout:3/535: getdents d0/d4/d16/d18 0 2024-04-26T21:08:10.512 INFO:tasks.workunit.client.1.smithi064.stdout:7/630: symlink d6/db/d34/d6f/lde 0 2024-04-26T21:08:10.513 INFO:tasks.workunit.client.1.smithi064.stdout:4/677: dread d0/d14/f50 [0,4194304] 0 2024-04-26T21:08:10.514 INFO:tasks.workunit.client.0.smithi055.stdout:5/344: truncate d4/fd 2240322 0 2024-04-26T21:08:10.514 INFO:tasks.workunit.client.1.smithi064.stdout:8/512: dwrite d10/d2f/f8e [0,4194304] 0 2024-04-26T21:08:10.514 INFO:tasks.workunit.client.1.smithi064.stdout:8/513: stat d10/d1d/f30 0 2024-04-26T21:08:10.514 INFO:tasks.workunit.client.1.smithi064.stdout:8/514: readlink d10/la8 0 2024-04-26T21:08:10.517 INFO:tasks.workunit.client.1.smithi064.stdout:3/568: sync 2024-04-26T21:08:10.518 INFO:tasks.workunit.client.0.smithi055.stdout:6/410: unlink d3/d17/d46/d54/d66/d6a/d51/f74 0 2024-04-26T21:08:10.518 INFO:tasks.workunit.client.0.smithi055.stdout:6/411: fdatasync d3/d17/d19/d71/f53 0 2024-04-26T21:08:10.523 INFO:tasks.workunit.client.1.smithi064.stdout:9/627: creat d0/fc7 x:0 0 0 2024-04-26T21:08:10.525 INFO:tasks.workunit.client.0.smithi055.stdout:1/429: truncate d8/f19 1906886 0 2024-04-26T21:08:10.526 INFO:tasks.workunit.client.0.smithi055.stdout:1/430: creat d8/d17/d1b/d41/f8f x:0 0 0 2024-04-26T21:08:10.526 INFO:tasks.workunit.client.0.smithi055.stdout:1/431: chown d8/d17/d1b/d7b/d8d/l87 70502428 1 2024-04-26T21:08:10.526 INFO:tasks.workunit.client.0.smithi055.stdout:1/432: write d8/df/d11/d27/d28/f6d [35226,32559] 0 2024-04-26T21:08:10.530 INFO:tasks.workunit.client.1.smithi064.stdout:6/604: mkdir d4/d7/d12/d8d/dc1 0 2024-04-26T21:08:10.530 INFO:tasks.workunit.client.1.smithi064.stdout:6/605: stat d4/d7/d12/d38/f5b 0 2024-04-26T21:08:10.532 INFO:tasks.workunit.client.0.smithi055.stdout:9/463: getdents d2/d46/d77 0 2024-04-26T21:08:10.533 INFO:tasks.workunit.client.1.smithi064.stdout:5/585: dwrite dd/f16 [0,4194304] 0 2024-04-26T21:08:10.534 INFO:tasks.workunit.client.1.smithi064.stdout:0/593: rename dd/d10/d18/d64/c91 to dd/d10/d18/d58/dba/ccc 0 2024-04-26T21:08:10.534 INFO:tasks.workunit.client.1.smithi064.stdout:0/594: chown dd/d21/dc8/d31/d47/lb2 1772729 1 2024-04-26T21:08:10.535 INFO:tasks.workunit.client.0.smithi055.stdout:4/348: dwrite d4/f66 [0,4194304] 0 2024-04-26T21:08:10.538 INFO:tasks.workunit.client.1.smithi064.stdout:2/683: creat d12/da9/feb x:0 0 0 2024-04-26T21:08:10.538 INFO:tasks.workunit.client.1.smithi064.stdout:2/684: readlink d12/d41/d73/l7b 0 2024-04-26T21:08:10.540 INFO:tasks.workunit.client.0.smithi055.stdout:3/536: rename d0/d4/d5/d73/d47/f77 to d0/d4/d5/d73/d47/d37/dbd/fbe 0 2024-04-26T21:08:10.540 INFO:tasks.workunit.client.0.smithi055.stdout:3/537: chown d0/d4/d5/f36 287005790 1 2024-04-26T21:08:10.540 INFO:tasks.workunit.client.0.smithi055.stdout:3/538: chown d0/d4/d5/d73/d13/d27/d50/d6b/f7d 2281955 1 2024-04-26T21:08:10.549 INFO:tasks.workunit.client.1.smithi064.stdout:1/750: rmdir d0/d6/d11/d1e 39 2024-04-26T21:08:10.549 INFO:tasks.workunit.client.1.smithi064.stdout:6/606: write d4/d7/d12/d38/f61 [2182428,87082] 0 2024-04-26T21:08:10.552 INFO:tasks.workunit.client.1.smithi064.stdout:7/631: link d6/d9/f39 d6/db/d1f/fdf 0 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:1/433: creat d8/d17/d1b/d7b/f90 x:0 0 0 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:1/434: fsync d8/d17/d1b/d7b/d8d/f88 0 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:1/435: dread - d8/d17/d1b/d7b/d8d/f7a zero size 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:9/464: truncate d2/d14/f47 873160 0 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:9/465: fdatasync d2/d46/d77/f89 0 2024-04-26T21:08:10.554 INFO:tasks.workunit.client.0.smithi055.stdout:9/466: chown d2/d46/d51 787176 1 2024-04-26T21:08:10.556 INFO:tasks.workunit.client.1.smithi064.stdout:6/607: dread d4/d7/d33/f8c [0,4194304] 0 2024-04-26T21:08:10.558 INFO:tasks.workunit.client.0.smithi055.stdout:2/496: dwrite d4/d1e/d2a/f6b [0,4194304] 0 2024-04-26T21:08:10.559 INFO:tasks.workunit.client.1.smithi064.stdout:3/569: truncate d1/d27/d29/d6f/d72/fb5 1023787 0 2024-04-26T21:08:10.559 INFO:tasks.workunit.client.1.smithi064.stdout:3/570: fsync d1/d27/d29/f4b 0 2024-04-26T21:08:10.559 INFO:tasks.workunit.client.1.smithi064.stdout:3/571: write d1/d27/f98 [707734,42040] 0 2024-04-26T21:08:10.564 INFO:tasks.workunit.client.1.smithi064.stdout:5/586: truncate dd/d12/f2e 6553871 0 2024-04-26T21:08:10.564 INFO:tasks.workunit.client.1.smithi064.stdout:2/685: rmdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e 39 2024-04-26T21:08:10.568 INFO:tasks.workunit.client.0.smithi055.stdout:4/349: mkdir d4/d18/d1a/d49/d7c 0 2024-04-26T21:08:10.575 INFO:tasks.workunit.client.1.smithi064.stdout:8/515: dread d10/d41/d44/f7c [0,4194304] 0 2024-04-26T21:08:10.577 INFO:tasks.workunit.client.1.smithi064.stdout:4/678: dwrite d0/d2f/d87/fb9 [0,4194304] 0 2024-04-26T21:08:10.577 INFO:tasks.workunit.client.1.smithi064.stdout:4/679: fdatasync d0/d2f/fd6 0 2024-04-26T21:08:10.579 INFO:tasks.workunit.client.1.smithi064.stdout:1/751: read d0/d6/d91/f94 [3443078,63220] 0 2024-04-26T21:08:10.583 INFO:tasks.workunit.client.0.smithi055.stdout:1/436: dread d8/d17/d1b/d7b/d8d/f79 [0,4194304] 0 2024-04-26T21:08:10.584 INFO:tasks.workunit.client.0.smithi055.stdout:8/392: sync 2024-04-26T21:08:10.584 INFO:tasks.workunit.client.0.smithi055.stdout:0/495: sync 2024-04-26T21:08:10.584 INFO:tasks.workunit.client.0.smithi055.stdout:0/496: creat d9/dc/d17/d5d/f9e x:0 0 0 2024-04-26T21:08:10.584 INFO:tasks.workunit.client.0.smithi055.stdout:0/497: write d9/d11/d59/f7f [1827903,93380] 0 2024-04-26T21:08:10.585 INFO:tasks.workunit.client.1.smithi064.stdout:3/572: dread d1/d27/d50/f13 [0,4194304] 0 2024-04-26T21:08:10.585 INFO:tasks.workunit.client.1.smithi064.stdout:3/573: truncate d1/d27/d50/f74 834317 0 2024-04-26T21:08:10.585 INFO:tasks.workunit.client.0.smithi055.stdout:2/497: dread d4/d14/d17/d6d/f72 [0,4194304] 0 2024-04-26T21:08:10.586 INFO:tasks.workunit.client.1.smithi064.stdout:7/632: getdents d6/d70/d74/d99 0 2024-04-26T21:08:10.586 INFO:tasks.workunit.client.1.smithi064.stdout:6/608: read d4/d7/fe [3941518,16811] 0 2024-04-26T21:08:10.587 INFO:tasks.workunit.client.1.smithi064.stdout:2/686: unlink d12/d88/fc9 0 2024-04-26T21:08:10.587 INFO:tasks.workunit.client.1.smithi064.stdout:5/587: dread dd/f13 [0,4194304] 0 2024-04-26T21:08:10.587 INFO:tasks.workunit.client.1.smithi064.stdout:6/609: creat d4/d7/d12/fc2 x:0 0 0 2024-04-26T21:08:10.587 INFO:tasks.workunit.client.1.smithi064.stdout:6/610: chown d4/d7/d12/d49/d4b/d7d/d83 58687 1 2024-04-26T21:08:10.588 INFO:tasks.workunit.client.1.smithi064.stdout:6/611: write d4/d7/d12/d1e/f2b [4657254,75150] 0 2024-04-26T21:08:10.588 INFO:tasks.workunit.client.1.smithi064.stdout:6/612: chown d4/d7/d12/d49/d4b/d5a/d79/lbb 3305370 1 2024-04-26T21:08:10.588 INFO:tasks.workunit.client.1.smithi064.stdout:6/613: readlink d4/l7c 0 2024-04-26T21:08:10.588 INFO:tasks.workunit.client.0.smithi055.stdout:5/345: link d4/f10 d4/df/d13/d26/d3c/d4a/d3f/d4f/f75 0 2024-04-26T21:08:10.589 INFO:tasks.workunit.client.0.smithi055.stdout:5/346: chown d4/df/d13/d26/d3c/d4a/c3a 2289874 1 2024-04-26T21:08:10.589 INFO:tasks.workunit.client.0.smithi055.stdout:5/347: chown d4/df/d13/l69 3629640 1 2024-04-26T21:08:10.591 INFO:tasks.workunit.client.1.smithi064.stdout:8/516: unlink d10/d2f/c52 0 2024-04-26T21:08:10.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/467: symlink d2/d14/l95 0 2024-04-26T21:08:10.604 INFO:tasks.workunit.client.0.smithi055.stdout:9/468: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:10.604 INFO:tasks.workunit.client.0.smithi055.stdout:9/469: dread - d2/d46/d77/d79/f87 zero size 2024-04-26T21:08:10.605 INFO:tasks.workunit.client.0.smithi055.stdout:3/539: getdents d0/d4 0 2024-04-26T21:08:10.605 INFO:tasks.workunit.client.0.smithi055.stdout:1/437: dread d8/d17/d6a/f52 [0,4194304] 0 2024-04-26T21:08:10.606 INFO:tasks.workunit.client.0.smithi055.stdout:3/540: write d0/d4/d5/d73/d13/d1a/d46/d72/f53 [522245,45353] 0 2024-04-26T21:08:10.608 INFO:tasks.workunit.client.1.smithi064.stdout:4/680: creat d0/d5/d79/fe1 x:0 0 0 2024-04-26T21:08:10.609 INFO:tasks.workunit.client.1.smithi064.stdout:1/752: rename d0/f4d to d0/d6b/d9e/da2/dc9/fe6 0 2024-04-26T21:08:10.611 INFO:tasks.workunit.client.0.smithi055.stdout:0/498: link d9/dc/d1c/d54/d4b/d68/f6d d9/dc/d1c/f9f 0 2024-04-26T21:08:10.615 INFO:tasks.workunit.client.1.smithi064.stdout:0/595: dwrite dd/d21/dc8/d31/d5c/f78 [0,4194304] 0 2024-04-26T21:08:10.615 INFO:tasks.workunit.client.1.smithi064.stdout:0/596: fsync dd/d21/dc8/d31/f41 0 2024-04-26T21:08:10.615 INFO:tasks.workunit.client.1.smithi064.stdout:6/614: dread d4/d7/d12/d49/d4b/d56/f70 [0,4194304] 0 2024-04-26T21:08:10.615 INFO:tasks.workunit.client.1.smithi064.stdout:6/615: read d4/d7/d33/f8c [383454,53493] 0 2024-04-26T21:08:10.617 INFO:tasks.workunit.client.1.smithi064.stdout:7/633: link d6/d15/d67/d65/lbf d6/d70/da8/le0 0 2024-04-26T21:08:10.631 INFO:tasks.workunit.client.1.smithi064.stdout:5/588: link dd/d12/d4f/d64/fb2 dd/d12/d18/d25/d67/db3/fbf 0 2024-04-26T21:08:10.631 INFO:tasks.workunit.client.1.smithi064.stdout:5/589: fsync dd/d12/d18/d1a/f6e 0 2024-04-26T21:08:10.634 INFO:tasks.workunit.client.0.smithi055.stdout:9/470: unlink d2/d14/l6d 0 2024-04-26T21:08:10.634 INFO:tasks.workunit.client.0.smithi055.stdout:9/471: read d2/d11/f73 [192374,120200] 0 2024-04-26T21:08:10.635 INFO:tasks.workunit.client.0.smithi055.stdout:9/472: write d2/d14/f86 [81881,27245] 0 2024-04-26T21:08:10.638 INFO:tasks.workunit.client.1.smithi064.stdout:1/753: dread d0/d6/d29/d31/f51 [4194304,4194304] 0 2024-04-26T21:08:10.640 INFO:tasks.workunit.client.1.smithi064.stdout:3/574: dwrite d1/fc [8388608,4194304] 0 2024-04-26T21:08:10.640 INFO:tasks.workunit.client.1.smithi064.stdout:8/517: mknod d10/d41/ca9 0 2024-04-26T21:08:10.641 INFO:tasks.workunit.client.0.smithi055.stdout:6/412: rename d3/d4f to d3/d17/d25/d5f/d90 0 2024-04-26T21:08:10.641 INFO:tasks.workunit.client.0.smithi055.stdout:3/541: rename d0/d4/d5/d73/d13/d27 to d0/d4/d5/d73/d13/d27/dbf 22 2024-04-26T21:08:10.642 INFO:tasks.workunit.client.0.smithi055.stdout:3/542: fdatasync d0/d4/d5/d73/d47/d37/d3d/fb9 0 2024-04-26T21:08:10.646 INFO:tasks.workunit.client.0.smithi055.stdout:6/413: stat d3/d17/d46/d54/d66/d6a/d6b/l72 0 2024-04-26T21:08:10.648 INFO:tasks.workunit.client.0.smithi055.stdout:8/393: mkdir d3/d89 0 2024-04-26T21:08:10.648 INFO:tasks.workunit.client.0.smithi055.stdout:9/473: mkdir d2/d46/d77/d5f/d96 0 2024-04-26T21:08:10.648 INFO:tasks.workunit.client.0.smithi055.stdout:8/394: chown d3/d9/d1f/d2e/l50 17596 1 2024-04-26T21:08:10.648 INFO:tasks.workunit.client.0.smithi055.stdout:8/395: write d3/d9/d1f/d2e/f40 [694816,56920] 0 2024-04-26T21:08:10.650 INFO:tasks.workunit.client.1.smithi064.stdout:4/681: stat d0/d1d/d17/d44/dac/da9/cad 0 2024-04-26T21:08:10.650 INFO:tasks.workunit.client.0.smithi055.stdout:1/438: link d8/d17/d1b/d41/f8f d8/f91 0 2024-04-26T21:08:10.652 INFO:tasks.workunit.client.0.smithi055.stdout:3/543: creat d0/d4/d5/d73/d47/d37/da6/fc0 x:0 0 0 2024-04-26T21:08:10.652 INFO:tasks.workunit.client.0.smithi055.stdout:3/544: fsync d0/d4/d5/d73/d13/d1a/f54 0 2024-04-26T21:08:10.657 INFO:tasks.workunit.client.0.smithi055.stdout:9/474: rename d2/d46/d77/d5f/d96 to d2/d14/d97 0 2024-04-26T21:08:10.657 INFO:tasks.workunit.client.1.smithi064.stdout:6/616: symlink d4/d7/d12/d38/lc3 0 2024-04-26T21:08:10.660 INFO:tasks.workunit.client.1.smithi064.stdout:7/634: creat d6/d9/d3d/fe1 x:0 0 0 2024-04-26T21:08:10.661 INFO:tasks.workunit.client.1.smithi064.stdout:2/687: dwrite d12/d41/d73/d83/d94/d3a/f58 [0,4194304] 0 2024-04-26T21:08:10.661 INFO:tasks.workunit.client.1.smithi064.stdout:2/688: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fb1 4531263 1 2024-04-26T21:08:10.661 INFO:tasks.workunit.client.0.smithi055.stdout:0/499: dwrite d9/dc/d1c/d3e/d7d/f86 [0,4194304] 0 2024-04-26T21:08:10.665 INFO:tasks.workunit.client.0.smithi055.stdout:1/439: creat d8/d17/d1b/d7b/d8d/f92 x:0 0 0 2024-04-26T21:08:10.665 INFO:tasks.workunit.client.0.smithi055.stdout:3/545: creat d0/d4/d5/d73/d13/d27/d50/d6b/fc1 x:0 0 0 2024-04-26T21:08:10.665 INFO:tasks.workunit.client.0.smithi055.stdout:7/429: sync 2024-04-26T21:08:10.665 INFO:tasks.workunit.client.0.smithi055.stdout:1/440: truncate d8/d17/d1b/d41/f68 390203 0 2024-04-26T21:08:10.666 INFO:tasks.workunit.client.0.smithi055.stdout:6/414: write d3/d17/d19/d71/f4d [608417,88788] 0 2024-04-26T21:08:10.666 INFO:tasks.workunit.client.1.smithi064.stdout:5/590: creat dd/d12/d4f/d9c/da1/fc0 x:0 0 0 2024-04-26T21:08:10.666 INFO:tasks.workunit.client.1.smithi064.stdout:5/591: dread - dd/d12/d18/d25/d32/fa3 zero size 2024-04-26T21:08:10.666 INFO:tasks.workunit.client.1.smithi064.stdout:5/592: read - dd/d12/d18/d25/d32/fa3 zero size 2024-04-26T21:08:10.667 INFO:tasks.workunit.client.0.smithi055.stdout:2/498: dwrite d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:10.668 INFO:tasks.workunit.client.1.smithi064.stdout:1/754: mkdir d0/d6/d76/de7 0 2024-04-26T21:08:10.668 INFO:tasks.workunit.client.0.smithi055.stdout:2/499: creat d4/d49/d4c/faa x:0 0 0 2024-04-26T21:08:10.668 INFO:tasks.workunit.client.0.smithi055.stdout:8/396: mknod d3/d7c/c8a 0 2024-04-26T21:08:10.668 INFO:tasks.workunit.client.0.smithi055.stdout:8/397: fdatasync d3/d9/fe 0 2024-04-26T21:08:10.671 INFO:tasks.workunit.client.1.smithi064.stdout:3/575: link d1/d27/l4a d1/d27/d50/d35/d4c/d7b/d82/lc3 0 2024-04-26T21:08:10.671 INFO:tasks.workunit.client.1.smithi064.stdout:0/597: dwrite dd/d10/d18/d64/fb7 [0,4194304] 0 2024-04-26T21:08:10.671 INFO:tasks.workunit.client.1.smithi064.stdout:0/598: fsync dd/d10/d74/f92 0 2024-04-26T21:08:10.672 INFO:tasks.workunit.client.1.smithi064.stdout:0/599: chown dd/d10/d74/f1f 686910 1 2024-04-26T21:08:10.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/518: creat d10/d41/faa x:0 0 0 2024-04-26T21:08:10.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/519: truncate d10/f9e 936655 0 2024-04-26T21:08:10.677 INFO:tasks.workunit.client.1.smithi064.stdout:4/682: unlink d0/d1d/l8d 0 2024-04-26T21:08:10.681 INFO:tasks.workunit.client.1.smithi064.stdout:7/635: symlink d6/d15/d88/dca/d5c/le2 0 2024-04-26T21:08:10.685 INFO:tasks.workunit.client.0.smithi055.stdout:3/546: write d0/d4/d5/d73/d13/d1a/d46/d72/f82 [2236010,25828] 0 2024-04-26T21:08:10.686 INFO:tasks.workunit.client.1.smithi064.stdout:6/617: dread d4/d7/d12/f4f [0,4194304] 0 2024-04-26T21:08:10.686 INFO:tasks.workunit.client.1.smithi064.stdout:6/618: write d4/d7/d12/d49/d4b/fb8 [496595,83497] 0 2024-04-26T21:08:10.686 INFO:tasks.workunit.client.1.smithi064.stdout:6/619: write d4/f16 [4387352,76027] 0 2024-04-26T21:08:10.696 INFO:tasks.workunit.client.1.smithi064.stdout:5/593: write dd/d12/d18/d1a/d1b/f6c [1544928,12935] 0 2024-04-26T21:08:10.696 INFO:tasks.workunit.client.1.smithi064.stdout:6/620: dread d4/d7/d12/d38/f3c [0,4194304] 0 2024-04-26T21:08:10.702 INFO:tasks.workunit.client.0.smithi055.stdout:6/415: symlink d3/d17/d25/l91 0 2024-04-26T21:08:10.703 INFO:tasks.workunit.client.1.smithi064.stdout:3/576: creat d1/d27/d50/d35/fc4 x:0 0 0 2024-04-26T21:08:10.707 INFO:tasks.workunit.client.1.smithi064.stdout:7/636: creat d6/d15/d88/dca/d5c/fe3 x:0 0 0 2024-04-26T21:08:10.709 INFO:tasks.workunit.client.0.smithi055.stdout:2/500: creat d4/d14/d17/fab x:0 0 0 2024-04-26T21:08:10.709 INFO:tasks.workunit.client.0.smithi055.stdout:2/501: creat d4/d14/d17/d36/fac x:0 0 0 2024-04-26T21:08:10.712 INFO:tasks.workunit.client.1.smithi064.stdout:8/520: read d10/d2f/d90/f93 [288989,96138] 0 2024-04-26T21:08:10.714 INFO:tasks.workunit.client.0.smithi055.stdout:8/398: unlink d3/d9/d44/c73 0 2024-04-26T21:08:10.715 INFO:tasks.workunit.client.1.smithi064.stdout:2/689: dwrite d12/d41/d73/d83/d94/d3a/d46/d91/fca [0,4194304] 0 2024-04-26T21:08:10.715 INFO:tasks.workunit.client.1.smithi064.stdout:0/600: dread dd/d21/dc8/d31/f4b [0,4194304] 0 2024-04-26T21:08:10.718 INFO:tasks.workunit.client.0.smithi055.stdout:0/500: dwrite d9/dc/f8f [0,4194304] 0 2024-04-26T21:08:10.726 INFO:tasks.workunit.client.1.smithi064.stdout:6/621: symlink d4/d7/d12/d8d/dc1/lc4 0 2024-04-26T21:08:10.728 INFO:tasks.workunit.client.1.smithi064.stdout:3/577: symlink d1/d27/d29/d6f/d72/da5/d7d/lc5 0 2024-04-26T21:08:10.728 INFO:tasks.workunit.client.0.smithi055.stdout:9/475: rmdir d2/d46/d77/d7d 39 2024-04-26T21:08:10.728 INFO:tasks.workunit.client.0.smithi055.stdout:9/476: stat d2/d46/d77/f62 0 2024-04-26T21:08:10.728 INFO:tasks.workunit.client.0.smithi055.stdout:9/477: write d2/f8 [201086,36422] 0 2024-04-26T21:08:10.728 INFO:tasks.workunit.client.0.smithi055.stdout:9/478: chown d2/d46/d77/l85 322 1 2024-04-26T21:08:10.733 INFO:tasks.workunit.client.0.smithi055.stdout:7/430: write d5/d6/ff [654601,26386] 0 2024-04-26T21:08:10.733 INFO:tasks.workunit.client.1.smithi064.stdout:7/637: mknod d6/d70/d74/d99/ce4 0 2024-04-26T21:08:10.741 INFO:tasks.workunit.client.0.smithi055.stdout:8/399: mkdir d3/d9/d1d/d48/d4b/d8b 0 2024-04-26T21:08:10.741 INFO:tasks.workunit.client.0.smithi055.stdout:8/400: chown d3 13 1 2024-04-26T21:08:10.744 INFO:tasks.workunit.client.1.smithi064.stdout:8/521: creat d10/d1d/da3/fab x:0 0 0 2024-04-26T21:08:10.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/601: creat dd/d10/fcd x:0 0 0 2024-04-26T21:08:10.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/602: truncate dd/d10/d18/d64/fa1 4683417 0 2024-04-26T21:08:10.744 INFO:tasks.workunit.client.1.smithi064.stdout:0/603: readlink dd/d21/dc8/d31/l40 0 2024-04-26T21:08:10.747 INFO:tasks.workunit.client.1.smithi064.stdout:6/622: creat d4/d7/d12/d49/d4b/d56/fc5 x:0 0 0 2024-04-26T21:08:10.750 INFO:tasks.workunit.client.0.smithi055.stdout:0/501: creat d9/dc/d1c/d54/d4b/d68/d97/fa0 x:0 0 0 2024-04-26T21:08:10.757 INFO:tasks.workunit.client.1.smithi064.stdout:7/638: mknod d6/db/d1f/d50/db8/ce5 0 2024-04-26T21:08:10.758 INFO:tasks.workunit.client.1.smithi064.stdout:8/522: rename d10/d1d/d38/f5e to d10/d2f/fac 0 2024-04-26T21:08:10.758 INFO:tasks.workunit.client.1.smithi064.stdout:0/604: mkdir dd/d21/dc8/d31/d47/dad/dce 0 2024-04-26T21:08:10.758 INFO:tasks.workunit.client.1.smithi064.stdout:0/605: truncate dd/d10/d74/d4f/d7b/f9f 600636 0 2024-04-26T21:08:10.758 INFO:tasks.workunit.client.1.smithi064.stdout:0/606: dread - dd/d21/dc8/d31/d43/fa6 zero size 2024-04-26T21:08:10.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/683: dwrite d0/d1d/d56/d89/f8f [0,4194304] 0 2024-04-26T21:08:10.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/684: fsync d0/f1a 0 2024-04-26T21:08:10.789 INFO:tasks.workunit.client.1.smithi064.stdout:2/690: dwrite d12/f78 [0,4194304] 0 2024-04-26T21:08:10.789 INFO:tasks.workunit.client.1.smithi064.stdout:2/691: write d12/d41/d73/d83/d94/d3a/d46/d48/fa1 [240509,111513] 0 2024-04-26T21:08:10.790 INFO:tasks.workunit.client.1.smithi064.stdout:5/594: dwrite dd/d12/d18/d25/d32/f37 [0,4194304] 0 2024-04-26T21:08:10.791 INFO:tasks.workunit.client.1.smithi064.stdout:5/595: write dd/d12/d18/d25/d32/f5d [376675,23919] 0 2024-04-26T21:08:10.793 INFO:tasks.workunit.client.1.smithi064.stdout:4/685: creat d0/d5/d13/d33/dcf/fe2 x:0 0 0 2024-04-26T21:08:10.797 INFO:tasks.workunit.client.1.smithi064.stdout:2/692: getdents d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99 0 2024-04-26T21:08:10.798 INFO:tasks.workunit.client.1.smithi064.stdout:6/623: dwrite d4/d7/f4d [0,4194304] 0 2024-04-26T21:08:10.801 INFO:tasks.workunit.client.0.smithi055.stdout:7/431: write d5/d11/f1a [9954016,34437] 0 2024-04-26T21:08:10.801 INFO:tasks.workunit.client.0.smithi055.stdout:3/547: dwrite d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:10.814 INFO:tasks.workunit.client.1.smithi064.stdout:3/578: dwrite d1/d27/d29/d6f/d72/da5/d7d/fad [0,4194304] 0 2024-04-26T21:08:10.817 INFO:tasks.workunit.client.0.smithi055.stdout:0/502: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:10.827 INFO:tasks.workunit.client.1.smithi064.stdout:5/596: getdents dd/da9/d48/d6a/d9e 0 2024-04-26T21:08:10.829 INFO:tasks.workunit.client.1.smithi064.stdout:4/686: truncate d0/d1d/d17/d9b/fbc 694685 0 2024-04-26T21:08:10.829 INFO:tasks.workunit.client.1.smithi064.stdout:4/687: creat d0/d5/d13/d33/fe3 x:0 0 0 2024-04-26T21:08:10.831 INFO:tasks.workunit.client.1.smithi064.stdout:2/693: getdents d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e 0 2024-04-26T21:08:10.831 INFO:tasks.workunit.client.1.smithi064.stdout:2/694: dread - d12/d41/d73/d83/d94/fd9 zero size 2024-04-26T21:08:10.833 INFO:tasks.workunit.client.0.smithi055.stdout:0/503: dread d9/dc/d17/f79 [4194304,4194304] 0 2024-04-26T21:08:10.839 INFO:tasks.workunit.client.0.smithi055.stdout:0/504: creat d9/fa1 x:0 0 0 2024-04-26T21:08:10.841 INFO:tasks.workunit.client.1.smithi064.stdout:3/579: truncate d1/d27/f98 337893 0 2024-04-26T21:08:10.841 INFO:tasks.workunit.client.1.smithi064.stdout:3/580: write d1/d27/d50/fb [2205150,30041] 0 2024-04-26T21:08:10.841 INFO:tasks.workunit.client.0.smithi055.stdout:2/502: dwrite d4/d14/f20 [0,4194304] 0 2024-04-26T21:08:10.842 INFO:tasks.workunit.client.1.smithi064.stdout:2/695: link d12/d41/d73/c8f d12/d41/d73/d83/d94/d3a/dba/cec 0 2024-04-26T21:08:10.844 INFO:tasks.workunit.client.0.smithi055.stdout:6/416: dwrite d3/f9 [0,4194304] 0 2024-04-26T21:08:10.844 INFO:tasks.workunit.client.0.smithi055.stdout:0/505: link d9/d11/d59/f7f d9/dc/d1c/d3e/fa2 0 2024-04-26T21:08:10.845 INFO:tasks.workunit.client.0.smithi055.stdout:0/506: stat d9/dc/d17 0 2024-04-26T21:08:10.846 INFO:tasks.workunit.client.0.smithi055.stdout:0/507: write d9/d11/d5b/d5e/d6c/d7a/f95 [721249,89288] 0 2024-04-26T21:08:10.846 INFO:tasks.workunit.client.0.smithi055.stdout:0/508: chown d9/dc/d17 0 1 2024-04-26T21:08:10.851 INFO:tasks.workunit.client.1.smithi064.stdout:2/696: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f 218659 0 2024-04-26T21:08:10.852 INFO:tasks.workunit.client.0.smithi055.stdout:3/548: dread d0/d4/d16/d18/d4b/f89 [0,4194304] 0 2024-04-26T21:08:10.859 INFO:tasks.workunit.client.0.smithi055.stdout:2/503: creat d4/db/d26/d9a/fad x:0 0 0 2024-04-26T21:08:10.859 INFO:tasks.workunit.client.0.smithi055.stdout:2/504: readlink d4/dc/l66 0 2024-04-26T21:08:10.860 INFO:tasks.workunit.client.1.smithi064.stdout:2/697: mknod d12/d41/d73/d83/d94/d3a/d46/d48/d85/ced 0 2024-04-26T21:08:10.862 INFO:tasks.workunit.client.0.smithi055.stdout:6/417: symlink d3/d17/d46/d54/d66/l92 0 2024-04-26T21:08:10.862 INFO:tasks.workunit.client.0.smithi055.stdout:6/418: chown d3/d17/d19/l6c 1 1 2024-04-26T21:08:10.863 INFO:tasks.workunit.client.0.smithi055.stdout:9/479: dwrite d2/d11/f4b [0,4194304] 0 2024-04-26T21:08:10.865 INFO:tasks.workunit.client.0.smithi055.stdout:6/419: truncate d3/d17/d46/d54/f5e 2819822 0 2024-04-26T21:08:10.865 INFO:tasks.workunit.client.0.smithi055.stdout:6/420: chown d3/d17/d46/d54/d66/d6a/l33 79364 1 2024-04-26T21:08:10.867 INFO:tasks.workunit.client.0.smithi055.stdout:0/509: rename d9/dc/d1c/d54/d4b/d68 to d9/dc/d1c/d3e/d7d/da3 0 2024-04-26T21:08:10.869 INFO:tasks.workunit.client.1.smithi064.stdout:9/628: sync 2024-04-26T21:08:10.869 INFO:tasks.workunit.client.1.smithi064.stdout:9/629: truncate d0/d4/da/d31/d34/d87/f99 397950 0 2024-04-26T21:08:10.871 INFO:tasks.workunit.client.1.smithi064.stdout:9/630: symlink d0/d4/da/d26/d47/d88/lc8 0 2024-04-26T21:08:10.871 INFO:tasks.workunit.client.1.smithi064.stdout:9/631: chown d0/d4/d7/df/f32 61746042 1 2024-04-26T21:08:10.872 INFO:tasks.workunit.client.0.smithi055.stdout:6/421: symlink d3/d17/d19/d7b/d8f/l93 0 2024-04-26T21:08:10.872 INFO:tasks.workunit.client.0.smithi055.stdout:8/401: dwrite d3/d9/d5b/f79 [0,4194304] 0 2024-04-26T21:08:10.872 INFO:tasks.workunit.client.0.smithi055.stdout:8/402: write d3/d9/d1f/f32 [976335,19554] 0 2024-04-26T21:08:10.875 INFO:tasks.workunit.client.1.smithi064.stdout:9/632: getdents d0/d4/da/d26/d5e 0 2024-04-26T21:08:10.877 INFO:tasks.workunit.client.1.smithi064.stdout:1/755: sync 2024-04-26T21:08:10.880 INFO:tasks.workunit.client.1.smithi064.stdout:4/688: dread d0/d1d/d56/d89/f8f [0,4194304] 0 2024-04-26T21:08:10.880 INFO:tasks.workunit.client.1.smithi064.stdout:4/689: chown d0/d5/d79/f80 113 1 2024-04-26T21:08:10.880 INFO:tasks.workunit.client.1.smithi064.stdout:4/690: write d0/d5/d13/d33/fe3 [614631,41834] 0 2024-04-26T21:08:10.881 INFO:tasks.workunit.client.0.smithi055.stdout:0/510: symlink d9/dc/d1c/d54/la4 0 2024-04-26T21:08:10.883 INFO:tasks.workunit.client.0.smithi055.stdout:3/549: write d0/d4/d5/d73/d13/d1a/f24 [802600,56081] 0 2024-04-26T21:08:10.885 INFO:tasks.workunit.client.1.smithi064.stdout:2/698: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/f6d [0,4194304] 0 2024-04-26T21:08:10.885 INFO:tasks.workunit.client.0.smithi055.stdout:6/422: rename d3/d17/f32 to d3/d17/f94 0 2024-04-26T21:08:10.887 INFO:tasks.workunit.client.0.smithi055.stdout:8/403: dread d3/d9/d44/f58 [0,4194304] 0 2024-04-26T21:08:10.890 INFO:tasks.workunit.client.1.smithi064.stdout:6/624: dwrite d4/d7/f3b [0,4194304] 0 2024-04-26T21:08:10.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/625: read d4/d7/f69 [3135427,32886] 0 2024-04-26T21:08:10.891 INFO:tasks.workunit.client.1.smithi064.stdout:5/597: dwrite dd/d12/d18/d1a/d1f/d20/f3b [0,4194304] 0 2024-04-26T21:08:10.892 INFO:tasks.workunit.client.1.smithi064.stdout:9/633: mknod d0/d4/da/d26/d47/d88/cc9 0 2024-04-26T21:08:10.892 INFO:tasks.workunit.client.1.smithi064.stdout:9/634: write d0/d39/f91 [1565171,52426] 0 2024-04-26T21:08:10.892 INFO:tasks.workunit.client.1.smithi064.stdout:9/635: stat d0/d4/da/d26/d47/d9d 0 2024-04-26T21:08:10.892 INFO:tasks.workunit.client.0.smithi055.stdout:7/432: dwrite d5/f29 [0,4194304] 0 2024-04-26T21:08:10.900 INFO:tasks.workunit.client.1.smithi064.stdout:1/756: write d0/d6/d11/d2c/f85 [2933945,2698] 0 2024-04-26T21:08:10.905 INFO:tasks.workunit.client.0.smithi055.stdout:0/511: creat d9/dc/d19/fa5 x:0 0 0 2024-04-26T21:08:10.914 INFO:tasks.workunit.client.0.smithi055.stdout:9/480: dwrite d2/d46/d77/f62 [0,4194304] 0 2024-04-26T21:08:10.914 INFO:tasks.workunit.client.0.smithi055.stdout:9/481: chown d2/f8 59 1 2024-04-26T21:08:10.918 INFO:tasks.workunit.client.1.smithi064.stdout:4/691: mkdir d0/d5/d13/d6d/de4 0 2024-04-26T21:08:10.927 INFO:tasks.workunit.client.1.smithi064.stdout:2/699: readlink d12/d41/d61/d75/l50 0 2024-04-26T21:08:10.928 INFO:tasks.workunit.client.1.smithi064.stdout:2/700: write d12/d41/d73/d83/fa6 [174786,122379] 0 2024-04-26T21:08:10.932 INFO:tasks.workunit.client.0.smithi055.stdout:3/550: creat d0/d4/d5/d73/d13/d27/fc2 x:0 0 0 2024-04-26T21:08:10.932 INFO:tasks.workunit.client.0.smithi055.stdout:3/551: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/fab zero size 2024-04-26T21:08:10.932 INFO:tasks.workunit.client.0.smithi055.stdout:3/552: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/fc3 x:0 0 0 2024-04-26T21:08:10.935 INFO:tasks.workunit.client.1.smithi064.stdout:6/626: unlink d4/d7/lb7 0 2024-04-26T21:08:10.936 INFO:tasks.workunit.client.1.smithi064.stdout:6/627: chown d4/d7/d12/d1e/f45 60009 1 2024-04-26T21:08:10.941 INFO:tasks.workunit.client.1.smithi064.stdout:5/598: rename dd/d12/f61 to dd/d12/d18/d25/fc1 0 2024-04-26T21:08:10.946 INFO:tasks.workunit.client.0.smithi055.stdout:7/433: symlink d5/d6/d24/d3b/l7d 0 2024-04-26T21:08:10.947 INFO:tasks.workunit.client.1.smithi064.stdout:4/692: symlink d0/d2f/d7d/le5 0 2024-04-26T21:08:10.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/701: getdents d12/d41/d73/d83 0 2024-04-26T21:08:10.952 INFO:tasks.workunit.client.1.smithi064.stdout:9/636: dwrite d0/d4/da/d26/d5e/f9b [4194304,4194304] 0 2024-04-26T21:08:10.952 INFO:tasks.workunit.client.1.smithi064.stdout:9/637: fdatasync d0/d4/da/d31/d34/d87/f8b 0 2024-04-26T21:08:10.952 INFO:tasks.workunit.client.1.smithi064.stdout:9/638: chown d0/d4/d7/df/f5a 0 1 2024-04-26T21:08:10.953 INFO:tasks.workunit.client.1.smithi064.stdout:5/599: mkdir dd/da9/d48/d6a/d9e/dc2 0 2024-04-26T21:08:10.953 INFO:tasks.workunit.client.1.smithi064.stdout:5/600: write dd/d12/d18/d1a/d1f/f7b [198619,17847] 0 2024-04-26T21:08:10.953 INFO:tasks.workunit.client.1.smithi064.stdout:5/601: chown dd/da9/c34 96983190 1 2024-04-26T21:08:10.956 INFO:tasks.workunit.client.0.smithi055.stdout:3/553: link d0/d4/d5/d73/d13/d1a/c4e d0/d4/d5/d73/d13/d27/d50/d6b/d83/cc4 0 2024-04-26T21:08:10.956 INFO:tasks.workunit.client.0.smithi055.stdout:3/554: readlink d0/d4/ld 0 2024-04-26T21:08:10.957 INFO:tasks.workunit.client.1.smithi064.stdout:1/757: rename d0/d6/d91/dba to d0/d6/d11/d2c/de8 0 2024-04-26T21:08:10.957 INFO:tasks.workunit.client.1.smithi064.stdout:1/758: stat d0/d6/d11/fa5 0 2024-04-26T21:08:10.958 INFO:tasks.workunit.client.0.smithi055.stdout:7/434: creat d5/db/f7e x:0 0 0 2024-04-26T21:08:10.958 INFO:tasks.workunit.client.0.smithi055.stdout:7/435: chown d5/d6/d24/d3b 106936611 1 2024-04-26T21:08:10.958 INFO:tasks.workunit.client.0.smithi055.stdout:7/436: fdatasync d5/d6/d24/d3b/f44 0 2024-04-26T21:08:10.960 INFO:tasks.workunit.client.0.smithi055.stdout:5/348: sync 2024-04-26T21:08:10.961 INFO:tasks.workunit.client.0.smithi055.stdout:4/350: sync 2024-04-26T21:08:10.961 INFO:tasks.workunit.client.1.smithi064.stdout:2/702: mkdir d12/d41/d73/d83/d94/d3a/d46/dee 0 2024-04-26T21:08:10.961 INFO:tasks.workunit.client.1.smithi064.stdout:6/628: dread d4/d7/d12/f18 [4194304,4194304] 0 2024-04-26T21:08:10.962 INFO:tasks.workunit.client.0.smithi055.stdout:0/512: write d9/dc/d1c/d3b/f36 [893166,64212] 0 2024-04-26T21:08:10.964 INFO:tasks.workunit.client.0.smithi055.stdout:5/349: creat d4/df/d13/d26/f76 x:0 0 0 2024-04-26T21:08:10.968 INFO:tasks.workunit.client.1.smithi064.stdout:1/759: creat d0/d6/d11/d1e/d2a/d72/fe9 x:0 0 0 2024-04-26T21:08:10.968 INFO:tasks.workunit.client.0.smithi055.stdout:8/404: dwrite d3/d9/d1f/d2e/f56 [0,4194304] 0 2024-04-26T21:08:10.968 INFO:tasks.workunit.client.0.smithi055.stdout:2/505: dwrite d4/d55/d6c/f94 [0,4194304] 0 2024-04-26T21:08:10.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/513: mknod d9/d11/d5b/d5e/d6c/ca6 0 2024-04-26T21:08:10.974 INFO:tasks.workunit.client.0.smithi055.stdout:5/350: link d4/f9 d4/df/d13/d26/d3c/d4a/d3f/d4f/f77 0 2024-04-26T21:08:10.975 INFO:tasks.workunit.client.1.smithi064.stdout:4/693: rename d0/d2f/d69/f77 to d0/d1d/d17/d44/dac/da9/fe6 0 2024-04-26T21:08:10.975 INFO:tasks.workunit.client.0.smithi055.stdout:8/405: getdents d3/d9/d5b 0 2024-04-26T21:08:10.978 INFO:tasks.workunit.client.0.smithi055.stdout:0/514: symlink d9/d11/d59/d78/la7 0 2024-04-26T21:08:10.978 INFO:tasks.workunit.client.1.smithi064.stdout:1/760: mkdir d0/d6b/d9e/dea 0 2024-04-26T21:08:10.979 INFO:tasks.workunit.client.1.smithi064.stdout:1/761: write d0/d6/d11/d1e/d2a/d34/d57/d66/f6a [1553946,51639] 0 2024-04-26T21:08:10.983 INFO:tasks.workunit.client.1.smithi064.stdout:1/762: mkdir d0/d6b/d9e/deb 0 2024-04-26T21:08:10.983 INFO:tasks.workunit.client.1.smithi064.stdout:1/763: write d0/d6/d11/d1e/d2a/d34/d57/f96 [1768856,30160] 0 2024-04-26T21:08:10.985 INFO:tasks.workunit.client.1.smithi064.stdout:9/639: dread d0/d4/da/d26/f6f [0,4194304] 0 2024-04-26T21:08:10.990 INFO:tasks.workunit.client.0.smithi055.stdout:5/351: symlink d4/df/l78 0 2024-04-26T21:08:10.995 INFO:tasks.workunit.client.1.smithi064.stdout:4/694: rename d0/d5/d13/d10/fbd to d0/d14/fe7 0 2024-04-26T21:08:10.995 INFO:tasks.workunit.client.0.smithi055.stdout:7/437: read d5/f57 [2773476,116598] 0 2024-04-26T21:08:10.997 INFO:tasks.workunit.client.0.smithi055.stdout:5/352: link d4/df/d13/f4c d4/df/d13/d26/d3c/f79 0 2024-04-26T21:08:11.001 INFO:tasks.workunit.client.1.smithi064.stdout:8/523: sync 2024-04-26T21:08:11.002 INFO:tasks.workunit.client.1.smithi064.stdout:0/607: sync 2024-04-26T21:08:11.002 INFO:tasks.workunit.client.1.smithi064.stdout:3/581: sync 2024-04-26T21:08:11.002 INFO:tasks.workunit.client.1.smithi064.stdout:7/639: sync 2024-04-26T21:08:11.002 INFO:tasks.workunit.client.1.smithi064.stdout:7/640: truncate d6/d15/d67/d4d/fd8 1012547 0 2024-04-26T21:08:11.002 INFO:tasks.workunit.client.1.smithi064.stdout:7/641: chown d6/db/dc1/fdd 75428339 1 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:4/695: link d0/d14/l51 d0/d5/d13/d33/le8 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/524: unlink d10/d41/l74 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/525: truncate d10/d41/d4e/d60/f8c 475088 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/526: chown d10/d41/d44/c4a 49124 1 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/527: readlink d10/d1d/d38/l82 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/528: stat d10/d2f/f4c 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:8/529: write d10/f24 [4773746,52263] 0 2024-04-26T21:08:11.008 INFO:tasks.workunit.client.1.smithi064.stdout:3/582: mknod d1/d27/cc6 0 2024-04-26T21:08:11.009 INFO:tasks.workunit.client.0.smithi055.stdout:5/353: truncate d4/df/f5d 4092212 0 2024-04-26T21:08:11.010 INFO:tasks.workunit.client.0.smithi055.stdout:6/423: dwrite d3/d17/f29 [0,4194304] 0 2024-04-26T21:08:11.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/640: rename d0/d4/da/d31/f80 to d0/d4/d7/df/fca 0 2024-04-26T21:08:11.022 INFO:tasks.workunit.client.1.smithi064.stdout:8/530: creat d10/d41/d4e/d60/fad x:0 0 0 2024-04-26T21:08:11.025 INFO:tasks.workunit.client.0.smithi055.stdout:5/354: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f7a x:0 0 0 2024-04-26T21:08:11.026 INFO:tasks.workunit.client.0.smithi055.stdout:6/424: link d3/l4b d3/l95 0 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/531: unlink d10/d1d/d38/l82 0 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/532: write d10/d1d/da3/fab [353998,33687] 0 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/533: dread - d10/d41/d44/d7d/f7f zero size 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/534: stat d10/d41/d53/f8b 0 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/535: creat d10/d2f/d56/fae x:0 0 0 2024-04-26T21:08:11.030 INFO:tasks.workunit.client.1.smithi064.stdout:8/536: creat d10/d41/d4e/d54/faf x:0 0 0 2024-04-26T21:08:11.033 INFO:tasks.workunit.client.0.smithi055.stdout:6/425: mkdir d3/d17/d46/d54/d66/d6a/d67/d83/d96 0 2024-04-26T21:08:11.035 INFO:tasks.workunit.client.1.smithi064.stdout:2/703: dwrite d12/d41/d73/d83/d94/d3a/d46/d6a/f7e [0,4194304] 0 2024-04-26T21:08:11.038 INFO:tasks.workunit.client.0.smithi055.stdout:6/426: stat d3/l4b 0 2024-04-26T21:08:11.042 INFO:tasks.workunit.client.0.smithi055.stdout:6/427: mknod d3/d17/d19/d71/c97 0 2024-04-26T21:08:11.042 INFO:tasks.workunit.client.0.smithi055.stdout:6/428: getdents d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:3/583: write d1/d27/d50/f24 [2829371,39836] 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:6/629: dwrite d4/d7/d12/d49/d4b/d56/f96 [0,4194304] 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:6/630: read d4/d7/d12/d38/f9f [16587,124448] 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:0/608: dread dd/d10/d18/d64/fa1 [0,4194304] 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:8/537: dread d10/d41/d4e/d60/f8c [0,4194304] 0 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:8/538: dread - d10/d41/faa zero size 2024-04-26T21:08:11.045 INFO:tasks.workunit.client.1.smithi064.stdout:2/704: mkdir d12/d41/d73/d83/d94/d3a/d46/d91/def 0 2024-04-26T21:08:11.048 INFO:tasks.workunit.client.1.smithi064.stdout:5/602: dwrite dd/d12/d4f/f66 [0,4194304] 0 2024-04-26T21:08:11.048 INFO:tasks.workunit.client.1.smithi064.stdout:3/584: symlink d1/d27/d50/d35/d4c/lc7 0 2024-04-26T21:08:11.048 INFO:tasks.workunit.client.1.smithi064.stdout:9/641: dread d0/d4/da/d31/d34/d87/f99 [0,4194304] 0 2024-04-26T21:08:11.048 INFO:tasks.workunit.client.1.smithi064.stdout:9/642: fsync d0/d4/d7/df/fac 0 2024-04-26T21:08:11.049 INFO:tasks.workunit.client.1.smithi064.stdout:6/631: creat d4/d7/d12/d49/d4b/d5a/d8f/fc6 x:0 0 0 2024-04-26T21:08:11.050 INFO:tasks.workunit.client.1.smithi064.stdout:5/603: symlink dd/d12/lc3 0 2024-04-26T21:08:11.052 INFO:tasks.workunit.client.0.smithi055.stdout:6/429: creat d3/d17/d46/d54/d66/d6a/d51/d58/d6d/f98 x:0 0 0 2024-04-26T21:08:11.055 INFO:tasks.workunit.client.1.smithi064.stdout:3/585: truncate d1/d14/f3e 2122614 0 2024-04-26T21:08:11.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/642: write d6/db/d1f/f4c [3596105,66514] 0 2024-04-26T21:08:11.055 INFO:tasks.workunit.client.1.smithi064.stdout:7/643: fsync d6/d15/d88/dca/fc6 0 2024-04-26T21:08:11.058 INFO:tasks.workunit.client.1.smithi064.stdout:1/764: dwrite d0/d6/d11/d2c/d9c/dbc/fc1 [0,4194304] 0 2024-04-26T21:08:11.058 INFO:tasks.workunit.client.1.smithi064.stdout:1/765: fsync d0/d6/d11/d1e/d27/f89 0 2024-04-26T21:08:11.061 INFO:tasks.workunit.client.1.smithi064.stdout:9/643: creat d0/d4/da/d26/d47/d6b/fcb x:0 0 0 2024-04-26T21:08:11.061 INFO:tasks.workunit.client.1.smithi064.stdout:9/644: truncate d0/d4/d7/df/f5f 815683 0 2024-04-26T21:08:11.062 INFO:tasks.workunit.client.1.smithi064.stdout:6/632: link d4/d7/d33/l84 d4/d7/d12/d8d/lc7 0 2024-04-26T21:08:11.064 INFO:tasks.workunit.client.1.smithi064.stdout:5/604: mknod dd/d12/d18/d25/cc4 0 2024-04-26T21:08:11.067 INFO:tasks.workunit.client.0.smithi055.stdout:2/506: dwrite d4/d14/f20 [0,4194304] 0 2024-04-26T21:08:11.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/441: sync 2024-04-26T21:08:11.073 INFO:tasks.workunit.client.0.smithi055.stdout:2/507: mknod d4/db/d56/cae 0 2024-04-26T21:08:11.075 INFO:tasks.workunit.client.0.smithi055.stdout:1/442: creat d8/df/d11/d27/d28/d2a/f93 x:0 0 0 2024-04-26T21:08:11.075 INFO:tasks.workunit.client.0.smithi055.stdout:1/443: write d8/d17/d33/f89 [1051484,2911] 0 2024-04-26T21:08:11.075 INFO:tasks.workunit.client.0.smithi055.stdout:1/444: dread - d8/d17/d1b/d7b/d65/f71 zero size 2024-04-26T21:08:11.076 INFO:tasks.workunit.client.1.smithi064.stdout:8/539: write d10/f4d [95504,54432] 0 2024-04-26T21:08:11.076 INFO:tasks.workunit.client.1.smithi064.stdout:7/644: symlink d6/d5a/d8f/le6 0 2024-04-26T21:08:11.076 INFO:tasks.workunit.client.1.smithi064.stdout:6/633: symlink d4/d7/d12/da7/lc8 0 2024-04-26T21:08:11.080 INFO:tasks.workunit.client.0.smithi055.stdout:6/430: dread d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:11.081 INFO:tasks.workunit.client.1.smithi064.stdout:3/586: dread d1/d14/f3b [0,4194304] 0 2024-04-26T21:08:11.082 INFO:tasks.workunit.client.0.smithi055.stdout:0/515: dwrite d9/dc/d1c/d3e/f47 [4194304,4194304] 0 2024-04-26T21:08:11.083 INFO:tasks.workunit.client.0.smithi055.stdout:3/555: dwrite d0/d4/d5/d73/d13/d27/d50/d6b/f9e [0,4194304] 0 2024-04-26T21:08:11.085 INFO:tasks.workunit.client.0.smithi055.stdout:6/431: creat d3/d17/d46/d54/d66/d6a/d67/f99 x:0 0 0 2024-04-26T21:08:11.085 INFO:tasks.workunit.client.0.smithi055.stdout:5/355: dwrite d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f7a [0,4194304] 0 2024-04-26T21:08:11.086 INFO:tasks.workunit.client.1.smithi064.stdout:0/609: dread dd/d10/d18/d64/fb7 [0,4194304] 0 2024-04-26T21:08:11.086 INFO:tasks.workunit.client.1.smithi064.stdout:0/610: write dd/d10/d74/f97 [594713,18325] 0 2024-04-26T21:08:11.087 INFO:tasks.workunit.client.1.smithi064.stdout:0/611: chown dd/d10/d18/d58/fcb 26 1 2024-04-26T21:08:11.087 INFO:tasks.workunit.client.1.smithi064.stdout:0/612: readlink dd/d10/d18/lb3 0 2024-04-26T21:08:11.087 INFO:tasks.workunit.client.0.smithi055.stdout:0/516: mknod d9/dc/d1c/d3e/d7d/da3/d82/ca8 0 2024-04-26T21:08:11.088 INFO:tasks.workunit.client.1.smithi064.stdout:4/696: dwrite d0/d1d/d17/d44/dac/d54/fa8 [0,4194304] 0 2024-04-26T21:08:11.088 INFO:tasks.workunit.client.0.smithi055.stdout:3/556: truncate d0/f68 2219984 0 2024-04-26T21:08:11.088 INFO:tasks.workunit.client.0.smithi055.stdout:3/557: readlink d0/de/l2d 0 2024-04-26T21:08:11.089 INFO:tasks.workunit.client.1.smithi064.stdout:2/705: dread d12/d41/d61/fbd [0,4194304] 0 2024-04-26T21:08:11.089 INFO:tasks.workunit.client.0.smithi055.stdout:8/406: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:11.090 INFO:tasks.workunit.client.0.smithi055.stdout:6/432: write d3/d17/d19/f41 [232396,34452] 0 2024-04-26T21:08:11.098 INFO:tasks.workunit.client.1.smithi064.stdout:3/587: symlink d1/d38/d68/lc8 0 2024-04-26T21:08:11.098 INFO:tasks.workunit.client.1.smithi064.stdout:0/613: getdents dd/d21/db8 0 2024-04-26T21:08:11.100 INFO:tasks.workunit.client.0.smithi055.stdout:5/356: symlink d4/df/d13/d26/d3c/d4a/l7b 0 2024-04-26T21:08:11.103 INFO:tasks.workunit.client.0.smithi055.stdout:8/407: dread d3/d9/d1f/d2e/f40 [0,4194304] 0 2024-04-26T21:08:11.105 INFO:tasks.workunit.client.1.smithi064.stdout:2/706: link d12/f34 d12/da9/ff0 0 2024-04-26T21:08:11.107 INFO:tasks.workunit.client.1.smithi064.stdout:5/605: read dd/d12/d18/d1a/d1f/f5a [562293,96331] 0 2024-04-26T21:08:11.111 INFO:tasks.workunit.client.0.smithi055.stdout:5/357: symlink d4/df/d13/d26/d3c/d4a/d3f/d2e/l7c 0 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:4/697: mknod d0/d1d/d21/d9c/ce9 0 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:4/698: chown d0/d5/d79/dd1/fdf 1 1 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:4/699: getdents d0/d5/d13/d6d/de4 0 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:2/707: symlink d12/d88/lf1 0 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:7/645: rename d6/d15/d67/d65 to d6/d15/de7 0 2024-04-26T21:08:11.112 INFO:tasks.workunit.client.1.smithi064.stdout:3/588: symlink d1/d27/d50/d35/d4c/d7b/lc9 0 2024-04-26T21:08:11.113 INFO:tasks.workunit.client.1.smithi064.stdout:7/646: readlink d6/lf 0 2024-04-26T21:08:11.113 INFO:tasks.workunit.client.1.smithi064.stdout:3/589: creat d1/d27/d29/d6f/d72/d73/fca x:0 0 0 2024-04-26T21:08:11.113 INFO:tasks.workunit.client.0.smithi055.stdout:6/433: dread d3/d17/d19/f1e [0,4194304] 0 2024-04-26T21:08:11.114 INFO:tasks.workunit.client.0.smithi055.stdout:6/434: fsync d3/d17/d19/d71/f44 0 2024-04-26T21:08:11.114 INFO:tasks.workunit.client.0.smithi055.stdout:6/435: truncate d3/d17/d19/f49 1158662 0 2024-04-26T21:08:11.114 INFO:tasks.workunit.client.0.smithi055.stdout:8/408: creat d3/d9/d1d/d48/d57/d61/f8c x:0 0 0 2024-04-26T21:08:11.118 INFO:tasks.workunit.client.1.smithi064.stdout:4/700: mknod d0/d1d/d56/d89/cea 0 2024-04-26T21:08:11.118 INFO:tasks.workunit.client.1.smithi064.stdout:4/701: dread - d0/d1d/d21/f48 zero size 2024-04-26T21:08:11.118 INFO:tasks.workunit.client.0.smithi055.stdout:5/358: symlink d4/df/d13/d26/d3c/d4a/d3f/d4f/l7d 0 2024-04-26T21:08:11.119 INFO:tasks.workunit.client.0.smithi055.stdout:5/359: write d4/f10 [1492616,17883] 0 2024-04-26T21:08:11.119 INFO:tasks.workunit.client.0.smithi055.stdout:5/360: creat d4/df/d13/d26/f7e x:0 0 0 2024-04-26T21:08:11.119 INFO:tasks.workunit.client.0.smithi055.stdout:5/361: read d4/df/d13/d26/f31 [2155284,29307] 0 2024-04-26T21:08:11.119 INFO:tasks.workunit.client.0.smithi055.stdout:1/445: dread d8/df/f55 [0,4194304] 0 2024-04-26T21:08:11.119 INFO:tasks.workunit.client.0.smithi055.stdout:6/436: mkdir d3/d17/d19/d7b/d9a 0 2024-04-26T21:08:11.120 INFO:tasks.workunit.client.0.smithi055.stdout:6/437: write d3/d17/d46/d54/d66/d6a/d6b/f76 [253452,32169] 0 2024-04-26T21:08:11.122 INFO:tasks.workunit.client.1.smithi064.stdout:2/708: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/lf2 0 2024-04-26T21:08:11.124 INFO:tasks.workunit.client.1.smithi064.stdout:0/614: dread dd/d10/d74/d1d/f8a [0,4194304] 0 2024-04-26T21:08:11.124 INFO:tasks.workunit.client.1.smithi064.stdout:0/615: chown dd/d10/d18/f29 15853721 1 2024-04-26T21:08:11.124 INFO:tasks.workunit.client.1.smithi064.stdout:0/616: truncate dd/d10/d18/d64/f7c 602432 0 2024-04-26T21:08:11.126 INFO:tasks.workunit.client.1.smithi064.stdout:6/634: rename d4/d7/d12/d49/d4b/d5a/d79/d9b to d4/d7/d12/d49/d4b/dc9 0 2024-04-26T21:08:11.126 INFO:tasks.workunit.client.0.smithi055.stdout:8/409: symlink d3/d9/d1f/d2e/d75/d76/l8d 0 2024-04-26T21:08:11.133 INFO:tasks.workunit.client.1.smithi064.stdout:3/590: mknod d1/d27/d29/d5e/da9/ccb 0 2024-04-26T21:08:11.135 INFO:tasks.workunit.client.0.smithi055.stdout:5/362: rename d4/df/d13/l69 to d4/df/d13/d26/d3c/d4a/d3f/d5c/l7f 0 2024-04-26T21:08:11.137 INFO:tasks.workunit.client.0.smithi055.stdout:5/363: mknod d4/df/d13/d26/c80 0 2024-04-26T21:08:11.138 INFO:tasks.workunit.client.1.smithi064.stdout:0/617: rmdir dd/d21/dc8/d31 39 2024-04-26T21:08:11.138 INFO:tasks.workunit.client.1.smithi064.stdout:0/618: creat dd/d10/d74/d4f/fcf x:0 0 0 2024-04-26T21:08:11.139 INFO:tasks.workunit.client.0.smithi055.stdout:1/446: mkdir d8/d94 0 2024-04-26T21:08:11.139 INFO:tasks.workunit.client.0.smithi055.stdout:1/447: chown d8/d17/d36/c4b 1326838679 1 2024-04-26T21:08:11.139 INFO:tasks.workunit.client.0.smithi055.stdout:1/448: read - d8/d17/d1b/d41/f8f zero size 2024-04-26T21:08:11.139 INFO:tasks.workunit.client.1.smithi064.stdout:6/635: creat d4/d7/d12/dbc/fca x:0 0 0 2024-04-26T21:08:11.140 INFO:tasks.workunit.client.1.smithi064.stdout:7/647: write d6/d15/d88/dca/f49 [3166656,53950] 0 2024-04-26T21:08:11.140 INFO:tasks.workunit.client.1.smithi064.stdout:6/636: creat d4/d7/d12/d49/d4b/d56/d95/fcb x:0 0 0 2024-04-26T21:08:11.140 INFO:tasks.workunit.client.1.smithi064.stdout:4/702: dread d0/d2f/d69/f9a [0,4194304] 0 2024-04-26T21:08:11.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/364: creat d4/df/d13/f81 x:0 0 0 2024-04-26T21:08:11.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/365: dread - d4/df/d13/d26/d3c/d4a/d3f/d2e/f54 zero size 2024-04-26T21:08:11.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/366: chown d4/df/d13/d26/d63/c68 727 1 2024-04-26T21:08:11.146 INFO:tasks.workunit.client.0.smithi055.stdout:5/367: dread - d4/df/d13/d26/d3c/d4a/d3f/f6a zero size 2024-04-26T21:08:11.157 INFO:tasks.workunit.client.1.smithi064.stdout:3/591: symlink d1/d27/d29/d6f/d72/da5/d7d/d8d/lcc 0 2024-04-26T21:08:11.157 INFO:tasks.workunit.client.1.smithi064.stdout:5/606: dread dd/d12/d18/d25/d32/f4a [0,4194304] 0 2024-04-26T21:08:11.157 INFO:tasks.workunit.client.1.smithi064.stdout:5/607: getdents dd/da9/d48/dac/da6 0 2024-04-26T21:08:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:10 smithi064 ceph-mon[33404]: pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 159 MiB/s rd, 201 MiB/s wr, 282 op/s 2024-04-26T21:08:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:10 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:11.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:10 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:11.159 INFO:tasks.workunit.client.1.smithi064.stdout:9/645: dwrite d0/d4/da/d26/d47/f65 [0,4194304] 0 2024-04-26T21:08:11.159 INFO:tasks.workunit.client.1.smithi064.stdout:9/646: dread - d0/d39/f5c zero size 2024-04-26T21:08:11.159 INFO:tasks.workunit.client.0.smithi055.stdout:1/449: symlink d8/df/d11/d27/l95 0 2024-04-26T21:08:11.164 INFO:tasks.workunit.client.1.smithi064.stdout:1/766: dwrite d0/d6/d11/d2c/f55 [0,4194304] 0 2024-04-26T21:08:11.165 INFO:tasks.workunit.client.1.smithi064.stdout:1/767: dread - d0/d6/d11/d2c/d9c/fb6 zero size 2024-04-26T21:08:11.166 INFO:tasks.workunit.client.1.smithi064.stdout:8/540: dwrite d10/f12 [4194304,4194304] 0 2024-04-26T21:08:11.167 INFO:tasks.workunit.client.1.smithi064.stdout:8/541: creat d10/d1d/d38/fb0 x:0 0 0 2024-04-26T21:08:11.167 INFO:tasks.workunit.client.1.smithi064.stdout:8/542: chown d10/d2f/f8e 212357017 1 2024-04-26T21:08:11.173 INFO:tasks.workunit.client.0.smithi055.stdout:0/517: dwrite d9/d11/d5b/d5e/d6c/d7a/f95 [0,4194304] 0 2024-04-26T21:08:11.179 INFO:tasks.workunit.client.0.smithi055.stdout:5/368: mkdir d4/df/d13/d26/d3c/d4a/d3f/d2e/d82 0 2024-04-26T21:08:11.184 INFO:tasks.workunit.client.0.smithi055.stdout:3/558: dwrite d0/d4/d5/d73/d13/d1a/d46/d72/f7c [0,4194304] 0 2024-04-26T21:08:11.194 INFO:tasks.workunit.client.0.smithi055.stdout:0/518: getdents d9/d27 0 2024-04-26T21:08:11.194 INFO:tasks.workunit.client.1.smithi064.stdout:4/703: creat d0/d14/feb x:0 0 0 2024-04-26T21:08:11.198 INFO:tasks.workunit.client.1.smithi064.stdout:5/608: creat dd/da9/fc5 x:0 0 0 2024-04-26T21:08:11.199 INFO:tasks.workunit.client.1.smithi064.stdout:8/543: creat d10/d41/d4e/d59/d5d/d79/fb1 x:0 0 0 2024-04-26T21:08:11.200 INFO:tasks.workunit.client.1.smithi064.stdout:8/544: write d10/d1d/f29 [3084428,100196] 0 2024-04-26T21:08:11.204 INFO:tasks.workunit.client.1.smithi064.stdout:3/592: read d1/d27/d29/d6f/d72/da5/f7c [3265292,124235] 0 2024-04-26T21:08:11.207 INFO:tasks.workunit.client.1.smithi064.stdout:5/609: dread dd/d12/d18/d25/d67/f93 [0,4194304] 0 2024-04-26T21:08:11.207 INFO:tasks.workunit.client.1.smithi064.stdout:5/610: chown dd/da9/c34 266774670 1 2024-04-26T21:08:11.214 INFO:tasks.workunit.client.1.smithi064.stdout:4/704: dread d0/fc7 [0,4194304] 0 2024-04-26T21:08:11.225 INFO:tasks.workunit.client.1.smithi064.stdout:3/593: truncate d1/d14/f3b 3464051 0 2024-04-26T21:08:11.225 INFO:tasks.workunit.client.1.smithi064.stdout:5/611: mknod dd/da9/d48/dac/da6/cc6 0 2024-04-26T21:08:11.225 INFO:tasks.workunit.client.1.smithi064.stdout:5/612: chown dd 25890 1 2024-04-26T21:08:11.225 INFO:tasks.workunit.client.1.smithi064.stdout:4/705: chown d0/d14/c6e 2 1 2024-04-26T21:08:11.226 INFO:tasks.workunit.client.1.smithi064.stdout:4/706: chown d0/d5/d13/f3d 483516837 1 2024-04-26T21:08:11.226 INFO:tasks.workunit.client.0.smithi055.stdout:0/519: read d9/dc/f8f [2996303,82789] 0 2024-04-26T21:08:11.227 INFO:tasks.workunit.client.0.smithi055.stdout:8/410: dwrite d3/d9/d1f/d2e/f56 [0,4194304] 0 2024-04-26T21:08:11.229 INFO:tasks.workunit.client.1.smithi064.stdout:4/707: rename d0/d5/d79/lc8 to d0/d2f/d69/db5/ddd/lec 0 2024-04-26T21:08:11.236 INFO:tasks.workunit.client.1.smithi064.stdout:3/594: dread d1/d27/d50/d35/d4c/d55/f7e [0,4194304] 0 2024-04-26T21:08:11.236 INFO:tasks.workunit.client.1.smithi064.stdout:3/595: dread - d1/d27/fba zero size 2024-04-26T21:08:11.237 INFO:tasks.workunit.client.1.smithi064.stdout:3/596: truncate d1/d27/d50/f74 1299512 0 2024-04-26T21:08:11.238 INFO:tasks.workunit.client.1.smithi064.stdout:3/597: mkdir d1/d27/d50/d35/d4c/d7b/dcd 0 2024-04-26T21:08:11.239 INFO:tasks.workunit.client.1.smithi064.stdout:4/708: dread d0/d5/d13/f60 [0,4194304] 0 2024-04-26T21:08:11.243 INFO:tasks.workunit.client.1.smithi064.stdout:4/709: creat d0/d14/fed x:0 0 0 2024-04-26T21:08:11.248 INFO:tasks.workunit.client.1.smithi064.stdout:6/637: getdents d4/d7/d12/d49/d4b/d5a/d79 0 2024-04-26T21:08:11.249 INFO:tasks.workunit.client.1.smithi064.stdout:8/545: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:08:11.253 INFO:tasks.workunit.client.1.smithi064.stdout:0/619: dwrite dd/d10/d74/d1d/f79 [0,4194304] 0 2024-04-26T21:08:11.253 INFO:tasks.workunit.client.1.smithi064.stdout:0/620: write dd/d10/f16 [2089346,110026] 0 2024-04-26T21:08:11.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:10 smithi055 ceph-mon[25475]: pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 159 MiB/s rd, 201 MiB/s wr, 282 op/s 2024-04-26T21:08:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:10 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:10 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:11.263 INFO:tasks.workunit.client.1.smithi064.stdout:4/710: write d0/d5/f7c [1319230,59005] 0 2024-04-26T21:08:11.264 INFO:tasks.workunit.client.1.smithi064.stdout:1/768: dwrite d0/d6/d11/d1e/d2a/d34/d57/fc2 [0,4194304] 0 2024-04-26T21:08:11.266 INFO:tasks.workunit.client.0.smithi055.stdout:6/438: dwrite d3/d17/d19/f3d [4194304,4194304] 0 2024-04-26T21:08:11.266 INFO:tasks.workunit.client.0.smithi055.stdout:6/439: write d3/d17/d46/f7f [191853,16089] 0 2024-04-26T21:08:11.266 INFO:tasks.workunit.client.0.smithi055.stdout:6/440: chown d3/f79 3 1 2024-04-26T21:08:11.279 INFO:tasks.workunit.client.1.smithi064.stdout:5/613: dwrite dd/d12/d18/d1a/d1b/f52 [0,4194304] 0 2024-04-26T21:08:11.280 INFO:tasks.workunit.client.0.smithi055.stdout:6/441: mkdir d3/d9b 0 2024-04-26T21:08:11.281 INFO:tasks.workunit.client.0.smithi055.stdout:0/520: dread d9/f5a [0,4194304] 0 2024-04-26T21:08:11.281 INFO:tasks.workunit.client.1.smithi064.stdout:0/621: mkdir dd/d10/d74/dd0 0 2024-04-26T21:08:11.282 INFO:tasks.workunit.client.1.smithi064.stdout:8/546: write d10/d41/d44/f66 [4241141,55829] 0 2024-04-26T21:08:11.283 INFO:tasks.workunit.client.0.smithi055.stdout:5/369: dwrite d4/df/d13/f25 [0,4194304] 0 2024-04-26T21:08:11.283 INFO:tasks.workunit.client.0.smithi055.stdout:8/411: dwrite d3/d9/d1f/f86 [0,4194304] 0 2024-04-26T21:08:11.285 INFO:tasks.workunit.client.0.smithi055.stdout:6/442: creat d3/d17/d25/f9c x:0 0 0 2024-04-26T21:08:11.288 INFO:tasks.workunit.client.0.smithi055.stdout:1/450: dwrite d8/df/f55 [0,4194304] 0 2024-04-26T21:08:11.288 INFO:tasks.workunit.client.0.smithi055.stdout:1/451: creat d8/df/d11/d27/d28/d2a/f96 x:0 0 0 2024-04-26T21:08:11.288 INFO:tasks.workunit.client.0.smithi055.stdout:1/452: read d8/d17/d1b/f62 [2435153,66070] 0 2024-04-26T21:08:11.288 INFO:tasks.workunit.client.0.smithi055.stdout:0/521: unlink d9/d27/f37 0 2024-04-26T21:08:11.293 INFO:tasks.workunit.client.1.smithi064.stdout:1/769: rename d0/d6/d11/d2c/l8d to d0/d22/d9f/lec 0 2024-04-26T21:08:11.310 INFO:tasks.workunit.client.1.smithi064.stdout:6/638: dwrite d4/d7/d12/d38/f3c [0,4194304] 0 2024-04-26T21:08:11.310 INFO:tasks.workunit.client.1.smithi064.stdout:6/639: creat d4/d7/d12/d49/d4b/d56/d95/fcc x:0 0 0 2024-04-26T21:08:11.312 INFO:tasks.workunit.client.1.smithi064.stdout:5/614: getdents dd/d12/d18/d1a/d1f 0 2024-04-26T21:08:11.312 INFO:tasks.workunit.client.1.smithi064.stdout:5/615: fdatasync dd/d12/f49 0 2024-04-26T21:08:11.315 INFO:tasks.workunit.client.1.smithi064.stdout:0/622: rename dd/d10/d74/f97 to dd/d21/dc8/d31/d47/fd1 0 2024-04-26T21:08:11.315 INFO:tasks.workunit.client.1.smithi064.stdout:0/623: stat dd/d21/dc8 0 2024-04-26T21:08:11.315 INFO:tasks.workunit.client.0.smithi055.stdout:8/412: unlink d3/d9/d1f/d2e/f40 0 2024-04-26T21:08:11.316 INFO:tasks.workunit.client.1.smithi064.stdout:6/640: dread d4/d7/d12/d49/d4b/d5a/d79/fb5 [0,4194304] 0 2024-04-26T21:08:11.316 INFO:tasks.workunit.client.1.smithi064.stdout:6/641: chown d4/d7/d12/d49/d9e/fc0 1441813423 1 2024-04-26T21:08:11.320 INFO:tasks.workunit.client.0.smithi055.stdout:5/370: mkdir d4/df/d13/d26/d3c/d5b/d83 0 2024-04-26T21:08:11.321 INFO:tasks.workunit.client.1.smithi064.stdout:6/642: dread d4/d7/d12/d1e/f45 [0,4194304] 0 2024-04-26T21:08:11.322 INFO:tasks.workunit.client.1.smithi064.stdout:6/643: creat d4/d7/d12/dbc/fcd x:0 0 0 2024-04-26T21:08:11.322 INFO:tasks.workunit.client.1.smithi064.stdout:6/644: chown d4/d7/d12/d49/d4b/d56/d95/fcc 62622804 1 2024-04-26T21:08:11.322 INFO:tasks.workunit.client.0.smithi055.stdout:6/443: truncate d3/d17/d46/d54/f5e 146878 0 2024-04-26T21:08:11.322 INFO:tasks.workunit.client.0.smithi055.stdout:6/444: stat d3/d17/l4a 0 2024-04-26T21:08:11.322 INFO:tasks.workunit.client.1.smithi064.stdout:1/770: mknod d0/d6/d11/d2c/d9c/ced 0 2024-04-26T21:08:11.329 INFO:tasks.workunit.client.0.smithi055.stdout:6/445: dread d3/d17/d19/f1e [0,4194304] 0 2024-04-26T21:08:11.330 INFO:tasks.workunit.client.1.smithi064.stdout:4/711: dwrite d0/d5/d13/d10/f4c [0,4194304] 0 2024-04-26T21:08:11.332 INFO:tasks.workunit.client.1.smithi064.stdout:8/547: dwrite d10/d2f/f3a [4194304,4194304] 0 2024-04-26T21:08:11.332 INFO:tasks.workunit.client.1.smithi064.stdout:8/548: chown d10/d1d/f30 440 1 2024-04-26T21:08:11.338 INFO:tasks.workunit.client.1.smithi064.stdout:5/616: rmdir dd/d12/d4f/dbe 0 2024-04-26T21:08:11.338 INFO:tasks.workunit.client.1.smithi064.stdout:0/624: creat dd/d21/dc8/d31/d47/dad/dce/fd2 x:0 0 0 2024-04-26T21:08:11.338 INFO:tasks.workunit.client.1.smithi064.stdout:5/617: dread - dd/da9/d48/f7e zero size 2024-04-26T21:08:11.346 INFO:tasks.workunit.client.1.smithi064.stdout:1/771: rename d0/d6/d29/d31/c95 to d0/d6/de0/cee 0 2024-04-26T21:08:11.346 INFO:tasks.workunit.client.1.smithi064.stdout:1/772: getdents d0/d6/d11/d2c/de8 0 2024-04-26T21:08:11.351 INFO:tasks.workunit.client.1.smithi064.stdout:4/712: creat d0/fee x:0 0 0 2024-04-26T21:08:11.353 INFO:tasks.workunit.client.1.smithi064.stdout:2/709: sync 2024-04-26T21:08:11.353 INFO:tasks.workunit.client.1.smithi064.stdout:7/648: sync 2024-04-26T21:08:11.353 INFO:tasks.workunit.client.1.smithi064.stdout:9/647: sync 2024-04-26T21:08:11.353 INFO:tasks.workunit.client.1.smithi064.stdout:2/710: fsync d12/d41/d73/d83/fa6 0 2024-04-26T21:08:11.357 INFO:tasks.workunit.client.1.smithi064.stdout:8/549: symlink d10/d41/d44/lb2 0 2024-04-26T21:08:11.357 INFO:tasks.workunit.client.1.smithi064.stdout:8/550: chown d10/d2f/d56/f7b 1845 1 2024-04-26T21:08:11.359 INFO:tasks.workunit.client.1.smithi064.stdout:5/618: mkdir dd/da9/d48/dac/dc7 0 2024-04-26T21:08:11.359 INFO:tasks.workunit.client.1.smithi064.stdout:5/619: dread - dd/d12/d18/d1a/f6e zero size 2024-04-26T21:08:11.361 INFO:tasks.workunit.client.1.smithi064.stdout:6/645: getdents d4/d7/d12/d1e 0 2024-04-26T21:08:11.366 INFO:tasks.workunit.client.1.smithi064.stdout:0/625: rename dd/d10/d18/d64/f7c to dd/d21/dc8/d31/d43/db4/fd3 0 2024-04-26T21:08:11.367 INFO:tasks.workunit.client.1.smithi064.stdout:1/773: rmdir d0/d6/d11/d2c 39 2024-04-26T21:08:11.367 INFO:tasks.workunit.client.1.smithi064.stdout:1/774: chown d0/d6/d29/d31/dd1 36 1 2024-04-26T21:08:11.368 INFO:tasks.workunit.client.1.smithi064.stdout:4/713: rmdir d0/d2f/d7d/dc6 0 2024-04-26T21:08:11.368 INFO:tasks.workunit.client.1.smithi064.stdout:4/714: readlink d0/d2f/d69/l7a 0 2024-04-26T21:08:11.369 INFO:tasks.workunit.client.0.smithi055.stdout:4/351: sync 2024-04-26T21:08:11.369 INFO:tasks.workunit.client.1.smithi064.stdout:7/649: truncate d6/d15/d1c/d45/f4f 184853 0 2024-04-26T21:08:11.369 INFO:tasks.workunit.client.1.smithi064.stdout:7/650: write d6/db/dc1/fdd [744858,110510] 0 2024-04-26T21:08:11.369 INFO:tasks.workunit.client.1.smithi064.stdout:7/651: chown d6/d5a/f3b 0 1 2024-04-26T21:08:11.371 INFO:tasks.workunit.client.1.smithi064.stdout:9/648: creat d0/d4/da/d31/d34/fcc x:0 0 0 2024-04-26T21:08:11.371 INFO:tasks.workunit.client.1.smithi064.stdout:9/649: fsync d0/d4/d28/f30 0 2024-04-26T21:08:11.372 INFO:tasks.workunit.client.0.smithi055.stdout:4/352: rename d4/d18/f47 to d4/d18/d1a/f7d 0 2024-04-26T21:08:11.374 INFO:tasks.workunit.client.1.smithi064.stdout:2/711: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/lf3 0 2024-04-26T21:08:11.374 INFO:tasks.workunit.client.1.smithi064.stdout:2/712: fdatasync d12/d41/d73/d83/d94/fa5 0 2024-04-26T21:08:11.374 INFO:tasks.workunit.client.1.smithi064.stdout:2/713: write d12/da9/feb [823816,114133] 0 2024-04-26T21:08:11.375 INFO:tasks.workunit.client.1.smithi064.stdout:8/551: rmdir d10/d41/d4e/d59/d83 39 2024-04-26T21:08:11.375 INFO:tasks.workunit.client.0.smithi055.stdout:7/438: sync 2024-04-26T21:08:11.375 INFO:tasks.workunit.client.0.smithi055.stdout:9/482: sync 2024-04-26T21:08:11.375 INFO:tasks.workunit.client.0.smithi055.stdout:9/483: write d2/d11/f6e [175234,39980] 0 2024-04-26T21:08:11.375 INFO:tasks.workunit.client.0.smithi055.stdout:9/484: write d2/d46/d77/d5f/f67 [3145128,63329] 0 2024-04-26T21:08:11.377 INFO:tasks.workunit.client.0.smithi055.stdout:6/446: dwrite d3/d17/d19/f3d [4194304,4194304] 0 2024-04-26T21:08:11.379 INFO:tasks.workunit.client.1.smithi064.stdout:0/626: rename dd/d21/dc8/d31/d43/f55 to dd/d10/d18/d58/dba/fd4 0 2024-04-26T21:08:11.385 INFO:tasks.workunit.client.0.smithi055.stdout:7/439: rename d5/d53/d67 to d5/d6/d24/d48/d7f 0 2024-04-26T21:08:11.386 INFO:tasks.workunit.client.1.smithi064.stdout:7/652: mknod d6/d15/d88/dca/d5c/ce8 0 2024-04-26T21:08:11.388 INFO:tasks.workunit.client.0.smithi055.stdout:9/485: mknod d2/d46/d77/c98 0 2024-04-26T21:08:11.392 INFO:tasks.workunit.client.0.smithi055.stdout:0/522: dwrite d9/f5a [0,4194304] 0 2024-04-26T21:08:11.392 INFO:tasks.workunit.client.0.smithi055.stdout:0/523: fsync d9/dc/d1c/d3e/d7d/f86 0 2024-04-26T21:08:11.393 INFO:tasks.workunit.client.1.smithi064.stdout:2/714: getdents d12/d41/d73/d83/d94/d3a/d46 0 2024-04-26T21:08:11.394 INFO:tasks.workunit.client.0.smithi055.stdout:4/353: write d4/f4b [1980440,91447] 0 2024-04-26T21:08:11.394 INFO:tasks.workunit.client.0.smithi055.stdout:4/354: write d4/f11 [1818625,60241] 0 2024-04-26T21:08:11.395 INFO:tasks.workunit.client.0.smithi055.stdout:6/447: rename d3/d17/d19/d71/l70 to d3/d17/d19/d7b/l9d 0 2024-04-26T21:08:11.395 INFO:tasks.workunit.client.1.smithi064.stdout:3/598: sync 2024-04-26T21:08:11.396 INFO:tasks.workunit.client.1.smithi064.stdout:4/715: dread d0/d5/d13/d33/f86 [0,4194304] 0 2024-04-26T21:08:11.398 INFO:tasks.workunit.client.0.smithi055.stdout:9/486: link d2/d46/c91 d2/d46/d51/c99 0 2024-04-26T21:08:11.406 INFO:tasks.workunit.client.1.smithi064.stdout:1/775: getdents d0/d6/dd 0 2024-04-26T21:08:11.409 INFO:tasks.workunit.client.0.smithi055.stdout:7/440: dread d5/d6/d24/f38 [0,4194304] 0 2024-04-26T21:08:11.412 INFO:tasks.workunit.client.1.smithi064.stdout:9/650: getdents d0/d4/da/d31 0 2024-04-26T21:08:11.412 INFO:tasks.workunit.client.1.smithi064.stdout:9/651: creat d0/fcd x:0 0 0 2024-04-26T21:08:11.417 INFO:tasks.workunit.client.1.smithi064.stdout:2/715: rmdir d12/d41/d73/d83/d94/d3a/d46 39 2024-04-26T21:08:11.424 INFO:tasks.workunit.client.0.smithi055.stdout:6/448: mkdir d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e 0 2024-04-26T21:08:11.425 INFO:tasks.workunit.client.1.smithi064.stdout:7/653: dread d6/db/fbc [0,4194304] 0 2024-04-26T21:08:11.427 INFO:tasks.workunit.client.0.smithi055.stdout:9/487: mkdir d2/d46/d9a 0 2024-04-26T21:08:11.430 INFO:tasks.workunit.client.1.smithi064.stdout:3/599: truncate d1/d27/d50/d35/d4c/fc0 54482 0 2024-04-26T21:08:11.431 INFO:tasks.workunit.client.0.smithi055.stdout:4/355: dread d4/ff [0,4194304] 0 2024-04-26T21:08:11.431 INFO:tasks.workunit.client.1.smithi064.stdout:8/552: dwrite d10/d2f/f4c [0,4194304] 0 2024-04-26T21:08:11.433 INFO:tasks.workunit.client.1.smithi064.stdout:2/716: rename d12/d88/fa8 to d12/d41/d73/d83/d94/d3a/dba/ff4 0 2024-04-26T21:08:11.433 INFO:tasks.workunit.client.1.smithi064.stdout:2/717: dread - d12/fcd zero size 2024-04-26T21:08:11.434 INFO:tasks.workunit.client.1.smithi064.stdout:4/716: rmdir d0/d2f/d7d 39 2024-04-26T21:08:11.434 INFO:tasks.workunit.client.0.smithi055.stdout:4/356: creat d4/d12/d17/f7e x:0 0 0 2024-04-26T21:08:11.447 INFO:tasks.workunit.client.1.smithi064.stdout:8/553: mkdir d10/d41/d4e/d54/db3 0 2024-04-26T21:08:11.447 INFO:tasks.workunit.client.1.smithi064.stdout:8/554: fsync d10/d41/d4e/d54/f95 0 2024-04-26T21:08:11.447 INFO:tasks.workunit.client.1.smithi064.stdout:8/555: write d10/d2f/fa6 [236439,122293] 0 2024-04-26T21:08:11.448 INFO:tasks.workunit.client.1.smithi064.stdout:2/718: mknod d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/cf5 0 2024-04-26T21:08:11.449 INFO:tasks.workunit.client.1.smithi064.stdout:2/719: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/fa3 431683 0 2024-04-26T21:08:11.452 INFO:tasks.workunit.client.1.smithi064.stdout:4/717: truncate d0/d5/d79/dd1/f5c 301176 0 2024-04-26T21:08:11.454 INFO:tasks.workunit.client.0.smithi055.stdout:9/488: dread d2/f3f [0,4194304] 0 2024-04-26T21:08:11.454 INFO:tasks.workunit.client.0.smithi055.stdout:9/489: truncate d2/d14/f47 956351 0 2024-04-26T21:08:11.454 INFO:tasks.workunit.client.0.smithi055.stdout:6/449: symlink d3/d17/d46/d54/d66/d6a/d51/d58/l9f 0 2024-04-26T21:08:11.460 INFO:tasks.workunit.client.1.smithi064.stdout:8/556: symlink d10/d41/d4e/d54/lb4 0 2024-04-26T21:08:11.460 INFO:tasks.workunit.client.1.smithi064.stdout:2/720: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/lf6 0 2024-04-26T21:08:11.460 INFO:tasks.workunit.client.1.smithi064.stdout:2/721: fsync d12/d41/d61/fdb 0 2024-04-26T21:08:11.461 INFO:tasks.workunit.client.1.smithi064.stdout:3/600: dread d1/d27/d29/d6f/d72/d73/f90 [0,4194304] 0 2024-04-26T21:08:11.461 INFO:tasks.workunit.client.1.smithi064.stdout:3/601: truncate d1/d27/d29/f92 828763 0 2024-04-26T21:08:11.464 INFO:tasks.workunit.client.0.smithi055.stdout:4/357: write d4/d12/d15/f79 [1372253,5717] 0 2024-04-26T21:08:11.464 INFO:tasks.workunit.client.0.smithi055.stdout:9/490: mkdir d2/d14/d97/d9b 0 2024-04-26T21:08:11.464 INFO:tasks.workunit.client.0.smithi055.stdout:9/491: truncate d2/d14/f86 826363 0 2024-04-26T21:08:11.465 INFO:tasks.workunit.client.1.smithi064.stdout:7/654: dread d6/d15/d1c/d45/f4f [0,4194304] 0 2024-04-26T21:08:11.466 INFO:tasks.workunit.client.1.smithi064.stdout:8/557: creat d10/d41/d44/fb5 x:0 0 0 2024-04-26T21:08:11.469 INFO:tasks.workunit.client.1.smithi064.stdout:0/627: dwrite dd/d10/d18/d58/fcb [0,4194304] 0 2024-04-26T21:08:11.469 INFO:tasks.workunit.client.1.smithi064.stdout:0/628: write dd/d10/d18/d64/f95 [1076397,4426] 0 2024-04-26T21:08:11.469 INFO:tasks.workunit.client.0.smithi055.stdout:0/524: dwrite d9/dc/f10 [0,4194304] 0 2024-04-26T21:08:11.469 INFO:tasks.workunit.client.0.smithi055.stdout:0/525: readlink d9/dc/d1c/d54/la4 0 2024-04-26T21:08:11.470 INFO:tasks.workunit.client.0.smithi055.stdout:0/526: creat d9/d11/d5b/d5e/d67/fa9 x:0 0 0 2024-04-26T21:08:11.470 INFO:tasks.workunit.client.1.smithi064.stdout:3/602: truncate d1/d38/f9c 1853848 0 2024-04-26T21:08:11.470 INFO:tasks.workunit.client.1.smithi064.stdout:4/718: getdents d0/d2f/d69 0 2024-04-26T21:08:11.471 INFO:tasks.workunit.client.0.smithi055.stdout:4/358: mkdir d4/d26/d42/d28/d53/d71/d7f 0 2024-04-26T21:08:11.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/776: dwrite d0/d6b/fd5 [0,4194304] 0 2024-04-26T21:08:11.474 INFO:tasks.workunit.client.0.smithi055.stdout:9/492: symlink d2/d14/d97/d9b/l9c 0 2024-04-26T21:08:11.476 INFO:tasks.workunit.client.1.smithi064.stdout:7/655: link d6/db/d34/f5b d6/db/d34/dc7/fe9 0 2024-04-26T21:08:11.476 INFO:tasks.workunit.client.1.smithi064.stdout:7/656: write d6/d9/d38/fda [1746635,87220] 0 2024-04-26T21:08:11.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/558: truncate d10/d41/d4e/d59/f6e 3245957 0 2024-04-26T21:08:11.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/559: fsync d10/d1d/da3/fab 0 2024-04-26T21:08:11.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/560: fdatasync d10/f9e 0 2024-04-26T21:08:11.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/561: creat d10/d2f/d61/fb6 x:0 0 0 2024-04-26T21:08:11.479 INFO:tasks.workunit.client.1.smithi064.stdout:9/652: dwrite d0/d4/da/d26/d5d/fa5 [0,4194304] 0 2024-04-26T21:08:11.485 INFO:tasks.workunit.client.0.smithi055.stdout:6/450: write d3/d17/f29 [6065648,45567] 0 2024-04-26T21:08:11.486 INFO:tasks.workunit.client.0.smithi055.stdout:4/359: truncate d4/d26/d42/d28/f32 283849 0 2024-04-26T21:08:11.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/629: creat dd/d10/fd5 x:0 0 0 2024-04-26T21:08:11.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/630: fsync dd/d21/dc8/d31/d47/d61/f83 0 2024-04-26T21:08:11.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/631: chown dd/d21/dc8/d31/d43/l71 1966761907 1 2024-04-26T21:08:11.488 INFO:tasks.workunit.client.0.smithi055.stdout:0/527: write d9/dc/d17/f79 [3272218,106881] 0 2024-04-26T21:08:11.489 INFO:tasks.workunit.client.0.smithi055.stdout:9/493: rename d2/c5 to d2/d14/d97/d9b/c9d 0 2024-04-26T21:08:11.490 INFO:tasks.workunit.client.0.smithi055.stdout:9/494: creat d2/f9e x:0 0 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:4/719: dread d0/d14/f50 [0,4194304] 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:3/603: mknod d1/d27/d29/d6f/d72/d7a/d84/cce 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:1/777: dread d0/d6/d11/d1e/f46 [0,4194304] 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:3/604: truncate d1/d27/d29/d6f/d72/da5/f93 718296 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:5/620: dwrite dd/f1e [0,4194304] 0 2024-04-26T21:08:11.494 INFO:tasks.workunit.client.1.smithi064.stdout:1/778: creat d0/d6/d11/d2c/d9c/fef x:0 0 0 2024-04-26T21:08:11.495 INFO:tasks.workunit.client.0.smithi055.stdout:6/451: mknod d3/d17/d19/d7b/ca0 0 2024-04-26T21:08:11.495 INFO:tasks.workunit.client.0.smithi055.stdout:6/452: read - d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d zero size 2024-04-26T21:08:11.500 INFO:tasks.workunit.client.0.smithi055.stdout:4/360: rename d4/d26/d42/d28/l4c to d4/d26/d42/d28/d53/d71/l80 0 2024-04-26T21:08:11.504 INFO:tasks.workunit.client.1.smithi064.stdout:7/657: mknod d6/db/d34/d6f/cea 0 2024-04-26T21:08:11.504 INFO:tasks.workunit.client.1.smithi064.stdout:7/658: truncate d6/d9/f11 4879399 0 2024-04-26T21:08:11.505 INFO:tasks.workunit.client.0.smithi055.stdout:6/453: mkdir d3/da1 0 2024-04-26T21:08:11.509 INFO:tasks.workunit.client.0.smithi055.stdout:0/528: truncate d9/dc/d1c/f26 4011511 0 2024-04-26T21:08:11.510 INFO:tasks.workunit.client.1.smithi064.stdout:8/562: truncate d10/d41/d4e/d59/f96 4149593 0 2024-04-26T21:08:11.513 INFO:tasks.workunit.client.0.smithi055.stdout:4/361: mknod d4/d26/d42/d2d/c81 0 2024-04-26T21:08:11.513 INFO:tasks.workunit.client.0.smithi055.stdout:4/362: read d4/d12/d15/f16 [2685133,116298] 0 2024-04-26T21:08:11.517 INFO:tasks.workunit.client.1.smithi064.stdout:9/653: rmdir d0/d4/da/d31 39 2024-04-26T21:08:11.518 INFO:tasks.workunit.client.0.smithi055.stdout:4/363: chown d4/cb 45465 1 2024-04-26T21:08:11.518 INFO:tasks.workunit.client.0.smithi055.stdout:4/364: chown d4/d12 1198021 1 2024-04-26T21:08:11.518 INFO:tasks.workunit.client.0.smithi055.stdout:6/454: rename d3/f79 to d3/d9b/fa2 0 2024-04-26T21:08:11.518 INFO:tasks.workunit.client.0.smithi055.stdout:6/455: write d3/d17/d25/f39 [4857454,124590] 0 2024-04-26T21:08:11.522 INFO:tasks.workunit.client.1.smithi064.stdout:0/632: rmdir dd/d10/d74/dd0 0 2024-04-26T21:08:11.523 INFO:tasks.workunit.client.0.smithi055.stdout:7/441: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:08:11.523 INFO:tasks.workunit.client.1.smithi064.stdout:1/779: dread d0/d6/d11/d2c/d9c/dbc/fc1 [0,4194304] 0 2024-04-26T21:08:11.523 INFO:tasks.workunit.client.1.smithi064.stdout:1/780: chown d0/d6/d11/d1e/d2a/d34/f79 415655396 1 2024-04-26T21:08:11.525 INFO:tasks.workunit.client.0.smithi055.stdout:0/529: symlink d9/dc/d1c/d3e/d7d/da3/d82/laa 0 2024-04-26T21:08:11.525 INFO:tasks.workunit.client.1.smithi064.stdout:2/722: dwrite d12/d41/d73/d83/d94/f33 [4194304,4194304] 0 2024-04-26T21:08:11.526 INFO:tasks.workunit.client.1.smithi064.stdout:3/605: dread d1/d38/f9c [0,4194304] 0 2024-04-26T21:08:11.526 INFO:tasks.workunit.client.1.smithi064.stdout:3/606: dread - d1/d27/d29/d6f/d72/d26/f9a zero size 2024-04-26T21:08:11.532 INFO:tasks.workunit.client.1.smithi064.stdout:5/621: mknod dd/d12/d4f/da5/cc8 0 2024-04-26T21:08:11.536 INFO:tasks.workunit.client.1.smithi064.stdout:4/720: rename d0/d1d/d21/c71 to d0/d5/d13/d33/dd0/cef 0 2024-04-26T21:08:11.543 INFO:tasks.workunit.client.1.smithi064.stdout:7/659: unlink d6/d9/d3d/f92 0 2024-04-26T21:08:11.543 INFO:tasks.workunit.client.0.smithi055.stdout:2/508: sync 2024-04-26T21:08:11.543 INFO:tasks.workunit.client.0.smithi055.stdout:3/559: sync 2024-04-26T21:08:11.545 INFO:tasks.workunit.client.0.smithi055.stdout:6/456: dread d3/d17/f29 [0,4194304] 0 2024-04-26T21:08:11.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/563: mknod d10/d41/d4e/d54/cb7 0 2024-04-26T21:08:11.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/564: chown d10/d2f/d56/f7b 1 1 2024-04-26T21:08:11.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/565: write d10/f7e [443732,56933] 0 2024-04-26T21:08:11.549 INFO:tasks.workunit.client.0.smithi055.stdout:7/442: truncate d5/d11/f1a 7494 0 2024-04-26T21:08:11.550 INFO:tasks.workunit.client.0.smithi055.stdout:7/443: getdents d5/d6/d24/d48/d75 0 2024-04-26T21:08:11.552 INFO:tasks.workunit.client.1.smithi064.stdout:9/654: mknod d0/d4/d28/d4f/cce 0 2024-04-26T21:08:11.552 INFO:tasks.workunit.client.1.smithi064.stdout:9/655: chown d0/d4/da/d67/fc3 211852 1 2024-04-26T21:08:11.553 INFO:tasks.workunit.client.0.smithi055.stdout:0/530: mkdir d9/dab 0 2024-04-26T21:08:11.557 INFO:tasks.workunit.client.0.smithi055.stdout:2/509: unlink d4/d14/d17/d36/f84 0 2024-04-26T21:08:11.557 INFO:tasks.workunit.client.0.smithi055.stdout:2/510: readlink d4/dc/l40 0 2024-04-26T21:08:11.558 INFO:tasks.workunit.client.0.smithi055.stdout:9/495: dwrite d2/d46/d77/f89 [0,4194304] 0 2024-04-26T21:08:11.558 INFO:tasks.workunit.client.0.smithi055.stdout:9/496: fdatasync d2/f9e 0 2024-04-26T21:08:11.559 INFO:tasks.workunit.client.0.smithi055.stdout:6/457: truncate d3/d17/d19/d71/f44 1049170 0 2024-04-26T21:08:11.559 INFO:tasks.workunit.client.0.smithi055.stdout:6/458: chown d3/d17/d19/d71/f44 677 1 2024-04-26T21:08:11.559 INFO:tasks.workunit.client.0.smithi055.stdout:6/459: fdatasync d3/d17/d19/f41 0 2024-04-26T21:08:11.564 INFO:tasks.workunit.client.0.smithi055.stdout:7/444: unlink d5/d6/d24/d4d/c68 0 2024-04-26T21:08:11.564 INFO:tasks.workunit.client.0.smithi055.stdout:7/445: chown d5/d6/c2b 3168 1 2024-04-26T21:08:11.564 INFO:tasks.workunit.client.0.smithi055.stdout:7/446: chown d5/d53 0 1 2024-04-26T21:08:11.568 INFO:tasks.workunit.client.1.smithi064.stdout:1/781: dread d0/d6/d91/fcd [0,4194304] 0 2024-04-26T21:08:11.569 INFO:tasks.workunit.client.1.smithi064.stdout:1/782: creat d0/d6/d11/d2c/d9c/ff0 x:0 0 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/560: write d0/d4/d5/d73/d13/d1a/f35 [756655,55192] 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/561: chown d0/d4/d5/f62 506592741 1 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/562: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/fc3 zero size 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/563: truncate d0/d4/d5/d73/d13/d1a/f54 5236886 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/564: write d0/f22 [5170754,119542] 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:3/565: write d0/d4/d5/d73/d47/d37/d3d/fa2 [900038,6563] 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:2/511: creat d4/db/d1f/d46/d51/faf x:0 0 0 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:2/512: chown d4/c9 0 1 2024-04-26T21:08:11.570 INFO:tasks.workunit.client.0.smithi055.stdout:2/513: truncate d4/db/d26/f9f 369836 0 2024-04-26T21:08:11.573 INFO:tasks.workunit.client.0.smithi055.stdout:9/497: unlink d2/d11/c42 0 2024-04-26T21:08:11.576 INFO:tasks.workunit.client.0.smithi055.stdout:6/460: symlink d3/d17/d25/d5f/d90/la3 0 2024-04-26T21:08:11.578 INFO:tasks.workunit.client.0.smithi055.stdout:7/447: write d5/d6/f31 [3708343,1844] 0 2024-04-26T21:08:11.579 INFO:tasks.workunit.client.1.smithi064.stdout:7/660: mkdir d6/db/d1f/d50/db8/deb 0 2024-04-26T21:08:11.579 INFO:tasks.workunit.client.1.smithi064.stdout:7/661: truncate d6/db/d8e/d90/fc3 294149 0 2024-04-26T21:08:11.579 INFO:tasks.workunit.client.1.smithi064.stdout:7/662: chown d6/d15/d88/dca/d5c/f7b 11 1 2024-04-26T21:08:11.581 INFO:tasks.workunit.client.1.smithi064.stdout:8/566: symlink d10/d41/d4e/d59/d5d/d79/lb8 0 2024-04-26T21:08:11.581 INFO:tasks.workunit.client.1.smithi064.stdout:8/567: creat d10/d1d/d38/fb9 x:0 0 0 2024-04-26T21:08:11.582 INFO:tasks.workunit.client.0.smithi055.stdout:0/531: rmdir d9/dc/d17 39 2024-04-26T21:08:11.588 INFO:tasks.workunit.client.1.smithi064.stdout:4/721: write d0/d5/fce [511872,123605] 0 2024-04-26T21:08:11.590 INFO:tasks.workunit.client.1.smithi064.stdout:2/723: rmdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f 39 2024-04-26T21:08:11.593 INFO:tasks.workunit.client.0.smithi055.stdout:3/566: mknod d0/d4/d5/d73/d13/d1a/cc5 0 2024-04-26T21:08:11.593 INFO:tasks.workunit.client.0.smithi055.stdout:3/567: stat d0/de/c9c 0 2024-04-26T21:08:11.596 INFO:tasks.workunit.client.0.smithi055.stdout:2/514: symlink d4/db/d8f/da6/d97/lb0 0 2024-04-26T21:08:11.596 INFO:tasks.workunit.client.1.smithi064.stdout:0/633: dwrite dd/d21/dc8/d31/d47/f66 [0,4194304] 0 2024-04-26T21:08:11.598 INFO:tasks.workunit.client.1.smithi064.stdout:8/568: dread d10/d2f/d61/f88 [0,4194304] 0 2024-04-26T21:08:11.598 INFO:tasks.workunit.client.1.smithi064.stdout:9/656: write d0/d4/da/d26/f6f [4151528,92848] 0 2024-04-26T21:08:11.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/498: creat d2/d14/f9f x:0 0 0 2024-04-26T21:08:11.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/499: truncate d2/d11/f3b 4573551 0 2024-04-26T21:08:11.601 INFO:tasks.workunit.client.0.smithi055.stdout:6/461: rename d3/f12 to d3/d17/d46/d54/d66/d6a/d51/d58/d62/fa4 0 2024-04-26T21:08:11.601 INFO:tasks.workunit.client.1.smithi064.stdout:7/663: unlink d6/d9/f30 0 2024-04-26T21:08:11.602 INFO:tasks.workunit.client.1.smithi064.stdout:7/664: chown d6/d15/d67/d4d/fcb 1 1 2024-04-26T21:08:11.602 INFO:tasks.workunit.client.1.smithi064.stdout:7/665: truncate d6/d15/d67/d4d/fb7 581268 0 2024-04-26T21:08:11.602 INFO:tasks.workunit.client.0.smithi055.stdout:7/448: mkdir d5/d6/d39/d80 0 2024-04-26T21:08:11.604 INFO:tasks.workunit.client.0.smithi055.stdout:0/532: truncate d9/dc/d17/f45 3610433 0 2024-04-26T21:08:11.604 INFO:tasks.workunit.client.1.smithi064.stdout:8/569: dread d10/d41/d44/f6d [0,4194304] 0 2024-04-26T21:08:11.606 INFO:tasks.workunit.client.1.smithi064.stdout:0/634: mkdir dd/d21/dc8/d31/d47/d61/dd6 0 2024-04-26T21:08:11.606 INFO:tasks.workunit.client.1.smithi064.stdout:0/635: fsync dd/d10/d74/fae 0 2024-04-26T21:08:11.606 INFO:tasks.workunit.client.1.smithi064.stdout:3/607: dwrite d1/d27/d50/d35/d4c/f83 [0,4194304] 0 2024-04-26T21:08:11.608 INFO:tasks.workunit.client.0.smithi055.stdout:3/568: creat d0/d4/d5/d73/d47/d37/dbd/fc6 x:0 0 0 2024-04-26T21:08:11.608 INFO:tasks.workunit.client.1.smithi064.stdout:6/646: sync 2024-04-26T21:08:11.609 INFO:tasks.workunit.client.1.smithi064.stdout:9/657: mkdir d0/d4/da/d31/d34/dcf 0 2024-04-26T21:08:11.610 INFO:tasks.workunit.client.0.smithi055.stdout:2/515: symlink d4/db/d8f/da6/lb1 0 2024-04-26T21:08:11.612 INFO:tasks.workunit.client.1.smithi064.stdout:4/722: write d0/d1d/d17/d44/dac/d54/fbb [4169927,63495] 0 2024-04-26T21:08:11.612 INFO:tasks.workunit.client.1.smithi064.stdout:4/723: write d0/d1d/d17/d44/dac/d54/f72 [396161,15711] 0 2024-04-26T21:08:11.612 INFO:tasks.workunit.client.0.smithi055.stdout:9/500: mkdir d2/d46/d77/d7d/da0 0 2024-04-26T21:08:11.613 INFO:tasks.workunit.client.1.smithi064.stdout:2/724: getdents d12/d41/d61 0 2024-04-26T21:08:11.613 INFO:tasks.workunit.client.1.smithi064.stdout:2/725: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l5c 70225 1 2024-04-26T21:08:11.613 INFO:tasks.workunit.client.1.smithi064.stdout:7/666: mknod d6/d70/d74/d99/cec 0 2024-04-26T21:08:11.615 INFO:tasks.workunit.client.1.smithi064.stdout:5/622: dwrite dd/d12/f7c [0,4194304] 0 2024-04-26T21:08:11.615 INFO:tasks.workunit.client.1.smithi064.stdout:5/623: write dd/da9/d63/f84 [222491,113870] 0 2024-04-26T21:08:11.615 INFO:tasks.workunit.client.0.smithi055.stdout:6/462: unlink d3/d17/d46/d54/d66/d6a/d51/l88 0 2024-04-26T21:08:11.617 INFO:tasks.workunit.client.0.smithi055.stdout:7/449: mknod d5/d11/c81 0 2024-04-26T21:08:11.620 INFO:tasks.workunit.client.0.smithi055.stdout:3/569: link d0/d4/d5/d73/d13/d27/d50/cb6 d0/d4/d16/d18/d4b/cc7 0 2024-04-26T21:08:11.621 INFO:tasks.workunit.client.0.smithi055.stdout:0/533: dread d9/f5a [0,4194304] 0 2024-04-26T21:08:11.622 INFO:tasks.workunit.client.1.smithi064.stdout:0/636: link dd/d10/d74/d4f/fa8 dd/d10/d18/d58/dba/fd7 0 2024-04-26T21:08:11.626 INFO:tasks.workunit.client.0.smithi055.stdout:2/516: getdents d4/d49/d4c/d5e/d7d 0 2024-04-26T21:08:11.626 INFO:tasks.workunit.client.0.smithi055.stdout:2/517: chown d4/d1e/f4f 12479382 1 2024-04-26T21:08:11.629 INFO:tasks.workunit.client.1.smithi064.stdout:1/783: dwrite d0/d6/d11/d1e/d2a/d34/f69 [0,4194304] 0 2024-04-26T21:08:11.629 INFO:tasks.workunit.client.1.smithi064.stdout:1/784: stat d0/d6/d29/f68 0 2024-04-26T21:08:11.629 INFO:tasks.workunit.client.1.smithi064.stdout:6/647: mkdir d4/d7/dce 0 2024-04-26T21:08:11.630 INFO:tasks.workunit.client.0.smithi055.stdout:9/501: mkdir d2/d46/d77/da1 0 2024-04-26T21:08:11.632 INFO:tasks.workunit.client.0.smithi055.stdout:6/463: mkdir d3/da5 0 2024-04-26T21:08:11.632 INFO:tasks.workunit.client.0.smithi055.stdout:6/464: creat d3/d17/d46/d54/d66/d6a/d67/d83/fa6 x:0 0 0 2024-04-26T21:08:11.635 INFO:tasks.workunit.client.1.smithi064.stdout:4/724: mknod d0/d2f/d69/db5/dba/cf0 0 2024-04-26T21:08:11.636 INFO:tasks.workunit.client.0.smithi055.stdout:7/450: getdents d5/d53/d6e 0 2024-04-26T21:08:11.640 INFO:tasks.workunit.client.1.smithi064.stdout:2/726: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/f4d d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/ff7 0 2024-04-26T21:08:11.641 INFO:tasks.workunit.client.0.smithi055.stdout:3/570: write d0/d4/f44 [1344050,78581] 0 2024-04-26T21:08:11.643 INFO:tasks.workunit.client.1.smithi064.stdout:7/667: mkdir d6/d15/d88/dca/d5c/ded 0 2024-04-26T21:08:11.643 INFO:tasks.workunit.client.1.smithi064.stdout:7/668: write d6/d8c/f89 [655822,70040] 0 2024-04-26T21:08:11.647 INFO:tasks.workunit.client.0.smithi055.stdout:9/502: creat d2/d14/d97/fa2 x:0 0 0 2024-04-26T21:08:11.651 INFO:tasks.workunit.client.1.smithi064.stdout:5/624: symlink dd/da9/d48/d6a/lc9 0 2024-04-26T21:08:11.652 INFO:tasks.workunit.client.0.smithi055.stdout:6/465: truncate d3/d17/d46/d54/d66/d6a/f56 3225148 0 2024-04-26T21:08:11.655 INFO:tasks.workunit.client.1.smithi064.stdout:0/637: mknod dd/cd8 0 2024-04-26T21:08:11.655 INFO:tasks.workunit.client.1.smithi064.stdout:0/638: stat dd/d21/dc8/d31/f3c 0 2024-04-26T21:08:11.656 INFO:tasks.workunit.client.0.smithi055.stdout:7/451: mknod d5/d6/d39/c82 0 2024-04-26T21:08:11.656 INFO:tasks.workunit.client.0.smithi055.stdout:7/452: write d5/d6/d24/d3b/f3c [5152328,16977] 0 2024-04-26T21:08:11.657 INFO:tasks.workunit.client.0.smithi055.stdout:7/453: creat d5/f83 x:0 0 0 2024-04-26T21:08:11.658 INFO:tasks.workunit.client.1.smithi064.stdout:8/570: dwrite d10/d41/d4e/d59/d5d/f63 [0,4194304] 0 2024-04-26T21:08:11.658 INFO:tasks.workunit.client.1.smithi064.stdout:8/571: readlink d10/d1d/l37 0 2024-04-26T21:08:11.664 INFO:tasks.workunit.client.0.smithi055.stdout:2/518: dwrite d4/db/d1f/d46/f75 [0,4194304] 0 2024-04-26T21:08:11.664 INFO:tasks.workunit.client.0.smithi055.stdout:2/519: chown d4/d55/d6c/fa2 227141 1 2024-04-26T21:08:11.664 INFO:tasks.workunit.client.0.smithi055.stdout:2/520: chown d4/db/d8f 253333275 1 2024-04-26T21:08:11.664 INFO:tasks.workunit.client.1.smithi064.stdout:1/785: mkdir d0/d22/d9f/df1 0 2024-04-26T21:08:11.667 INFO:tasks.workunit.client.1.smithi064.stdout:6/648: unlink d4/d7/d12/f4f 0 2024-04-26T21:08:11.667 INFO:tasks.workunit.client.1.smithi064.stdout:6/649: truncate d4/d7/d12/d49/d9e/fb6 489558 0 2024-04-26T21:08:11.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/658: rmdir d0/d4/d7/df/da4 39 2024-04-26T21:08:11.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/659: chown d0/d4/da/d31/fc0 4 1 2024-04-26T21:08:11.670 INFO:tasks.workunit.client.1.smithi064.stdout:8/572: dread d10/d2f/fac [0,4194304] 0 2024-04-26T21:08:11.672 INFO:tasks.workunit.client.1.smithi064.stdout:4/725: mkdir d0/d2f/df1 0 2024-04-26T21:08:11.676 INFO:tasks.workunit.client.1.smithi064.stdout:2/727: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/ff8 x:0 0 0 2024-04-26T21:08:11.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/608: dwrite d1/f1b [4194304,4194304] 0 2024-04-26T21:08:11.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/609: creat d1/d27/d29/d6f/d72/d26/fcf x:0 0 0 2024-04-26T21:08:11.678 INFO:tasks.workunit.client.1.smithi064.stdout:7/669: read d6/d9/f11 [3120638,79219] 0 2024-04-26T21:08:11.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/610: stat d1/d27/d29/d6f/d72/da5/f44 0 2024-04-26T21:08:11.678 INFO:tasks.workunit.client.1.smithi064.stdout:3/611: read - d1/d27/d29/d5e/f76 zero size 2024-04-26T21:08:11.680 INFO:tasks.workunit.client.0.smithi055.stdout:9/503: rmdir d2/d46/d77/da1 0 2024-04-26T21:08:11.680 INFO:tasks.workunit.client.0.smithi055.stdout:9/504: chown d2/d46/d51/c81 2 1 2024-04-26T21:08:11.680 INFO:tasks.workunit.client.0.smithi055.stdout:9/505: readlink d2/d46/d51/l84 0 2024-04-26T21:08:11.682 INFO:tasks.workunit.client.0.smithi055.stdout:6/466: creat d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86/fa7 x:0 0 0 2024-04-26T21:08:11.682 INFO:tasks.workunit.client.0.smithi055.stdout:6/467: write d3/d17/d46/f7f [549741,4779] 0 2024-04-26T21:08:11.684 INFO:tasks.workunit.client.1.smithi064.stdout:1/786: write d0/d6b/fd5 [2921304,26308] 0 2024-04-26T21:08:11.688 INFO:tasks.workunit.client.0.smithi055.stdout:7/454: truncate d5/d11/f5d 3477169 0 2024-04-26T21:08:11.688 INFO:tasks.workunit.client.1.smithi064.stdout:5/625: mkdir dd/d12/d18/d1a/d1f/dca 0 2024-04-26T21:08:11.689 INFO:tasks.workunit.client.1.smithi064.stdout:8/573: dread d10/d41/d4e/d59/f96 [0,4194304] 0 2024-04-26T21:08:11.689 INFO:tasks.workunit.client.1.smithi064.stdout:8/574: fdatasync d10/d41/d4e/d59/d5d/d79/fb1 0 2024-04-26T21:08:11.695 INFO:tasks.workunit.client.1.smithi064.stdout:6/650: mkdir d4/d7/d12/d49/d4b/d56/dcf 0 2024-04-26T21:08:11.696 INFO:tasks.workunit.client.1.smithi064.stdout:6/651: readlink d4/d7/d12/d1e/l30 0 2024-04-26T21:08:11.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/660: mkdir d0/d4/da/d67/dd0 0 2024-04-26T21:08:11.704 INFO:tasks.workunit.client.1.smithi064.stdout:4/726: rename d0/l22 to d0/d2f/df1/lf2 0 2024-04-26T21:08:11.706 INFO:tasks.workunit.client.1.smithi064.stdout:2/728: mkdir d12/d45/dd7/df9 0 2024-04-26T21:08:11.706 INFO:tasks.workunit.client.1.smithi064.stdout:2/729: chown d12 70492512 1 2024-04-26T21:08:11.707 INFO:tasks.workunit.client.0.smithi055.stdout:9/506: symlink d2/d14/d97/d9b/la3 0 2024-04-26T21:08:11.708 INFO:tasks.workunit.client.0.smithi055.stdout:9/507: creat d2/d11/fa4 x:0 0 0 2024-04-26T21:08:11.708 INFO:tasks.workunit.client.0.smithi055.stdout:6/468: dread d3/d17/d19/f3d [4194304,4194304] 0 2024-04-26T21:08:11.710 INFO:tasks.workunit.client.1.smithi064.stdout:1/787: dread d0/d6/f74 [0,4194304] 0 2024-04-26T21:08:11.710 INFO:tasks.workunit.client.1.smithi064.stdout:1/788: stat d0/d6/d11/l6f 0 2024-04-26T21:08:11.711 INFO:tasks.workunit.client.1.smithi064.stdout:7/670: mknod d6/db/d34/dc7/cee 0 2024-04-26T21:08:11.714 INFO:tasks.workunit.client.0.smithi055.stdout:3/571: dwrite d0/d4/d5/d73/d13/d27/d50/fac [0,4194304] 0 2024-04-26T21:08:11.714 INFO:tasks.workunit.client.0.smithi055.stdout:3/572: write d0/d4/f40 [5956490,51155] 0 2024-04-26T21:08:11.714 INFO:tasks.workunit.client.0.smithi055.stdout:7/455: write d5/d6/d24/f69 [4131010,112111] 0 2024-04-26T21:08:11.714 INFO:tasks.workunit.client.0.smithi055.stdout:7/456: chown d5/d6/d24/d3b/l5b 175986 1 2024-04-26T21:08:11.715 INFO:tasks.workunit.client.0.smithi055.stdout:2/521: rmdir d4/d14/d33 39 2024-04-26T21:08:11.718 INFO:tasks.workunit.client.1.smithi064.stdout:5/626: link dd/d12/d18/d25/fc1 dd/d12/d18/d25/d32/fcb 0 2024-04-26T21:08:11.718 INFO:tasks.workunit.client.1.smithi064.stdout:8/575: link d10/d41/d53/f9b d10/d41/d4e/d59/fba 0 2024-04-26T21:08:11.722 INFO:tasks.workunit.client.0.smithi055.stdout:6/469: rename d3/l6 to d3/d17/d25/la8 0 2024-04-26T21:08:11.728 INFO:tasks.workunit.client.1.smithi064.stdout:0/639: mkdir dd/d21/dd9 0 2024-04-26T21:08:11.728 INFO:tasks.workunit.client.1.smithi064.stdout:0/640: write dd/d10/f84 [5084284,47786] 0 2024-04-26T21:08:11.730 INFO:tasks.workunit.client.1.smithi064.stdout:1/789: write d0/d6/d11/f23 [1753024,124617] 0 2024-04-26T21:08:11.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/573: dread d0/d4/d5/d73/d13/f7e [0,4194304] 0 2024-04-26T21:08:11.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/574: fdatasync d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 0 2024-04-26T21:08:11.733 INFO:tasks.workunit.client.0.smithi055.stdout:7/457: creat d5/d53/d6e/d6c/f84 x:0 0 0 2024-04-26T21:08:11.733 INFO:tasks.workunit.client.0.smithi055.stdout:7/458: dread - d5/d6/d24/d4d/f73 zero size 2024-04-26T21:08:11.734 INFO:tasks.workunit.client.1.smithi064.stdout:9/661: creat d0/d4/da/d26/d47/d88/fd1 x:0 0 0 2024-04-26T21:08:11.735 INFO:tasks.workunit.client.0.smithi055.stdout:6/470: getdents d3/d17/d46/d54/d66/d6a 0 2024-04-26T21:08:11.735 INFO:tasks.workunit.client.0.smithi055.stdout:6/471: dread - d3/d17/d25/f9c zero size 2024-04-26T21:08:11.737 INFO:tasks.workunit.client.0.smithi055.stdout:7/459: write d5/d6/d24/d48/d58/f5f [111544,125852] 0 2024-04-26T21:08:11.738 INFO:tasks.workunit.client.0.smithi055.stdout:3/575: mknod d0/d4/d5/d73/d13/d1a/d46/d72/d69/cc8 0 2024-04-26T21:08:11.740 INFO:tasks.workunit.client.1.smithi064.stdout:6/652: rename d4/d7/d12/d49/c8e to d4/d7/cd0 0 2024-04-26T21:08:11.741 INFO:tasks.workunit.client.0.smithi055.stdout:6/472: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/da9 0 2024-04-26T21:08:11.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/473: write d3/d17/d46/f7f [357024,58845] 0 2024-04-26T21:08:11.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/474: stat d3/d9b/fa2 0 2024-04-26T21:08:11.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/475: creat d3/d17/faa x:0 0 0 2024-04-26T21:08:11.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/476: chown d3/d17/f94 5336007 1 2024-04-26T21:08:11.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/727: unlink d0/d2f/df1/lf2 0 2024-04-26T21:08:11.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/728: truncate d0/d1d/d21/f48 238418 0 2024-04-26T21:08:11.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/729: stat d0/d2f/fd6 0 2024-04-26T21:08:11.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/730: write d0/d14/f6c [3868428,108930] 0 2024-04-26T21:08:11.747 INFO:tasks.workunit.client.0.smithi055.stdout:7/460: truncate d5/f57 2160350 0 2024-04-26T21:08:11.748 INFO:tasks.workunit.client.0.smithi055.stdout:3/576: creat d0/d4/fc9 x:0 0 0 2024-04-26T21:08:11.750 INFO:tasks.workunit.client.1.smithi064.stdout:2/730: write d12/d41/d73/d83/d94/d3a/d46/d91/fca [1509161,33610] 0 2024-04-26T21:08:11.752 INFO:tasks.workunit.client.1.smithi064.stdout:8/576: truncate d10/d41/d4e/d59/f6e 2702238 0 2024-04-26T21:08:11.755 INFO:tasks.workunit.client.0.smithi055.stdout:6/477: creat d3/d17/d46/d54/d66/d6a/fab x:0 0 0 2024-04-26T21:08:11.758 INFO:tasks.workunit.client.1.smithi064.stdout:0/641: readlink dd/d21/l26 0 2024-04-26T21:08:11.758 INFO:tasks.workunit.client.0.smithi055.stdout:7/461: symlink d5/d53/l85 0 2024-04-26T21:08:11.760 INFO:tasks.workunit.client.0.smithi055.stdout:3/577: truncate d0/d4/d5/d73/d47/d37/d3d/d4c/f63 2983905 0 2024-04-26T21:08:11.760 INFO:tasks.workunit.client.1.smithi064.stdout:7/671: dwrite d6/d8c/d9e/fc9 [0,4194304] 0 2024-04-26T21:08:11.762 INFO:tasks.workunit.client.0.smithi055.stdout:7/462: mknod d5/db/c86 0 2024-04-26T21:08:11.765 INFO:tasks.workunit.client.1.smithi064.stdout:1/790: creat d0/d6/d11/d1e/d2a/ff2 x:0 0 0 2024-04-26T21:08:11.765 INFO:tasks.workunit.client.1.smithi064.stdout:1/791: chown d0/d6/c17 621529 1 2024-04-26T21:08:11.766 INFO:tasks.workunit.client.0.smithi055.stdout:3/578: link d0/d4/fc9 d0/d4/d5/d73/d47/d37/d3d/d4c/fca 0 2024-04-26T21:08:11.767 INFO:tasks.workunit.client.0.smithi055.stdout:3/579: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad zero size 2024-04-26T21:08:11.769 INFO:tasks.workunit.client.0.smithi055.stdout:6/478: dread d3/d17/d19/d71/f44 [0,4194304] 0 2024-04-26T21:08:11.769 INFO:tasks.workunit.client.0.smithi055.stdout:6/479: chown d3/d17/d46/d54/d66/d6a/d51/d58/c7d 269433365 1 2024-04-26T21:08:11.773 INFO:tasks.workunit.client.0.smithi055.stdout:7/463: mknod d5/d6/c87 0 2024-04-26T21:08:11.777 INFO:tasks.workunit.client.0.smithi055.stdout:6/480: unlink d3/d17/d46/d54/d66/d6a/d67/d83/fa6 0 2024-04-26T21:08:11.781 INFO:tasks.workunit.client.0.smithi055.stdout:6/481: unlink d3/ce 0 2024-04-26T21:08:11.783 INFO:tasks.workunit.client.1.smithi064.stdout:7/672: write d6/db/f2a [9554,86586] 0 2024-04-26T21:08:11.784 INFO:tasks.workunit.client.1.smithi064.stdout:9/662: unlink d0/d39/f91 0 2024-04-26T21:08:11.786 INFO:tasks.workunit.client.0.smithi055.stdout:6/482: creat d3/d17/d46/d54/d66/fac x:0 0 0 2024-04-26T21:08:11.788 INFO:tasks.workunit.client.1.smithi064.stdout:5/627: rename dd/d12/d18/l6b to dd/d12/d4f/dbd/lcc 0 2024-04-26T21:08:11.798 INFO:tasks.workunit.client.0.smithi055.stdout:9/508: dwrite d2/d46/d77/d7d/f83 [0,4194304] 0 2024-04-26T21:08:11.806 INFO:tasks.workunit.client.1.smithi064.stdout:6/653: mknod d4/d7/d12/d8d/cd1 0 2024-04-26T21:08:11.809 INFO:tasks.workunit.client.1.smithi064.stdout:4/731: symlink d0/d2f/d7d/lf3 0 2024-04-26T21:08:11.812 INFO:tasks.workunit.client.1.smithi064.stdout:2/731: getdents d12/d41/d73/d83/d94/d3a/d46/d91/d92 0 2024-04-26T21:08:11.814 INFO:tasks.workunit.client.1.smithi064.stdout:8/577: stat d10/d1d/c23 0 2024-04-26T21:08:11.816 INFO:tasks.workunit.client.1.smithi064.stdout:0/642: rmdir dd/d21/dc8/d31/d47/d61/dd6 0 2024-04-26T21:08:11.816 INFO:tasks.workunit.client.1.smithi064.stdout:0/643: chown dd/d21/dc8/d31/d47/d61/d42/l8d 22 1 2024-04-26T21:08:11.821 INFO:tasks.workunit.client.1.smithi064.stdout:1/792: symlink d0/lf3 0 2024-04-26T21:08:11.821 INFO:tasks.workunit.client.1.smithi064.stdout:1/793: truncate d0/d6/d76/faf 977528 0 2024-04-26T21:08:11.821 INFO:tasks.workunit.client.1.smithi064.stdout:1/794: readlink d0/d6/d11/d1e/d2a/d34/d57/d9b/le2 0 2024-04-26T21:08:11.826 INFO:tasks.workunit.client.0.smithi055.stdout:7/464: dwrite d5/d6/d24/d3b/f42 [0,4194304] 0 2024-04-26T21:08:11.829 INFO:tasks.workunit.client.1.smithi064.stdout:7/673: creat d6/d9/d3d/d58/fef x:0 0 0 2024-04-26T21:08:11.835 INFO:tasks.workunit.client.1.smithi064.stdout:1/795: dread d0/d6/d11/d2c/d9c/dbc/fc1 [0,4194304] 0 2024-04-26T21:08:11.836 INFO:tasks.workunit.client.0.smithi055.stdout:2/522: dwrite d4/db/f25 [0,4194304] 0 2024-04-26T21:08:11.839 INFO:tasks.workunit.client.1.smithi064.stdout:4/732: link d0/d2f/d7d/f8a d0/d5/d13/d33/dd0/ff4 0 2024-04-26T21:08:11.839 INFO:tasks.workunit.client.1.smithi064.stdout:4/733: fdatasync d0/d5/d13/d33/f85 0 2024-04-26T21:08:11.844 INFO:tasks.workunit.client.1.smithi064.stdout:2/732: creat d12/d41/d73/d83/d94/d3a/d46/dee/ffa x:0 0 0 2024-04-26T21:08:11.844 INFO:tasks.workunit.client.1.smithi064.stdout:2/733: write d12/f34 [443235,26121] 0 2024-04-26T21:08:11.848 INFO:tasks.workunit.client.0.smithi055.stdout:7/465: read d5/d6/d24/f30 [2640377,41415] 0 2024-04-26T21:08:11.848 INFO:tasks.workunit.client.1.smithi064.stdout:0/644: mkdir dd/d10/d18/d64/dda 0 2024-04-26T21:08:11.848 INFO:tasks.workunit.client.1.smithi064.stdout:0/645: chown dd/d21/cb5 3 1 2024-04-26T21:08:11.849 INFO:tasks.workunit.client.1.smithi064.stdout:0/646: stat dd/d21/dc8/d31/d47/d61 0 2024-04-26T21:08:11.849 INFO:tasks.workunit.client.1.smithi064.stdout:0/647: fdatasync dd/d21/dc8/d31/d47/d61/d42/f51 0 2024-04-26T21:08:11.851 INFO:tasks.workunit.client.1.smithi064.stdout:5/628: rmdir dd/da9/d48/d6a/d81 39 2024-04-26T21:08:11.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/509: dwrite d2/f8 [0,4194304] 0 2024-04-26T21:08:11.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/510: creat d2/d11/fa5 x:0 0 0 2024-04-26T21:08:11.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/511: write d2/f9e [693407,107724] 0 2024-04-26T21:08:11.855 INFO:tasks.workunit.client.0.smithi055.stdout:9/512: fdatasync d2/d11/f73 0 2024-04-26T21:08:11.859 INFO:tasks.workunit.client.0.smithi055.stdout:1/453: sync 2024-04-26T21:08:11.859 INFO:tasks.workunit.client.0.smithi055.stdout:8/413: sync 2024-04-26T21:08:11.860 INFO:tasks.workunit.client.0.smithi055.stdout:9/513: symlink d2/d46/d77/d7d/da0/la6 0 2024-04-26T21:08:11.862 INFO:tasks.workunit.client.1.smithi064.stdout:1/796: creat d0/d6b/d9e/dea/ff4 x:0 0 0 2024-04-26T21:08:11.862 INFO:tasks.workunit.client.1.smithi064.stdout:8/578: rmdir d10/d41/d4e/d59/d5d 39 2024-04-26T21:08:11.862 INFO:tasks.workunit.client.1.smithi064.stdout:9/663: rename d0/d4/da/d31/d34/d87 to d0/d4/da/d67/dd0/dd2 0 2024-04-26T21:08:11.864 INFO:tasks.workunit.client.0.smithi055.stdout:1/454: rename d8/l1a to d8/df/d11/d27/l97 0 2024-04-26T21:08:11.864 INFO:tasks.workunit.client.0.smithi055.stdout:1/455: write d8/df/d11/d27/d28/f40 [1259853,124100] 0 2024-04-26T21:08:11.864 INFO:tasks.workunit.client.0.smithi055.stdout:1/456: fdatasync d8/d17/f77 0 2024-04-26T21:08:11.865 INFO:tasks.workunit.client.1.smithi064.stdout:5/629: creat dd/da9/d48/dac/da6/fcd x:0 0 0 2024-04-26T21:08:11.865 INFO:tasks.workunit.client.1.smithi064.stdout:5/630: read dd/d12/d18/d1a/d1b/f29 [7558858,31693] 0 2024-04-26T21:08:11.866 INFO:tasks.workunit.client.1.smithi064.stdout:1/797: stat d0/d6/d29/d31/f4c 0 2024-04-26T21:08:11.866 INFO:tasks.workunit.client.0.smithi055.stdout:7/466: dread d5/d6/f4c [0,4194304] 0 2024-04-26T21:08:11.866 INFO:tasks.workunit.client.1.smithi064.stdout:0/648: dread dd/d21/dc8/d31/d47/f53 [0,4194304] 0 2024-04-26T21:08:11.868 INFO:tasks.workunit.client.1.smithi064.stdout:4/734: mknod d0/d5/d79/dd1/da0/dcd/cf5 0 2024-04-26T21:08:11.869 INFO:tasks.workunit.client.1.smithi064.stdout:8/579: stat d10/d41/d4e/d59/d5d/ca4 0 2024-04-26T21:08:11.871 INFO:tasks.workunit.client.0.smithi055.stdout:8/414: rename d3/f46 to d3/d9/f8e 0 2024-04-26T21:08:11.871 INFO:tasks.workunit.client.0.smithi055.stdout:1/457: rename d8/df to d8/df/d11/d27/d98 22 2024-04-26T21:08:11.873 INFO:tasks.workunit.client.1.smithi064.stdout:6/654: rename d4/d7/d12/d49/d4b/d7d/d83/cbd to d4/d7/d12/cd2 0 2024-04-26T21:08:11.873 INFO:tasks.workunit.client.1.smithi064.stdout:1/798: write d0/d6b/d9e/da2/fc6 [44471,45321] 0 2024-04-26T21:08:11.876 INFO:tasks.workunit.client.1.smithi064.stdout:9/664: getdents d0/d4/da 0 2024-04-26T21:08:11.876 INFO:tasks.workunit.client.1.smithi064.stdout:5/631: truncate dd/d12/d18/d1a/d1b/f2c 815965 0 2024-04-26T21:08:11.879 INFO:tasks.workunit.client.0.smithi055.stdout:8/415: getdents d3/d9/d1d 0 2024-04-26T21:08:11.880 INFO:tasks.workunit.client.1.smithi064.stdout:0/649: unlink dd/d21/cb5 0 2024-04-26T21:08:11.884 INFO:tasks.workunit.client.0.smithi055.stdout:9/514: write d2/d11/f4b [2717954,92512] 0 2024-04-26T21:08:11.885 INFO:tasks.workunit.client.1.smithi064.stdout:4/735: mkdir d0/d5/d13/d6d/d97/df6 0 2024-04-26T21:08:11.887 INFO:tasks.workunit.client.1.smithi064.stdout:7/674: rename d6/db/c20 to d6/db/d34/d6f/d81/cf0 0 2024-04-26T21:08:11.887 INFO:tasks.workunit.client.1.smithi064.stdout:7/675: write d6/d9/d3d/d58/fef [10645,48159] 0 2024-04-26T21:08:11.888 INFO:tasks.workunit.client.0.smithi055.stdout:8/416: stat d3/d9/d1f/d2e/l50 0 2024-04-26T21:08:11.889 INFO:tasks.workunit.client.1.smithi064.stdout:6/655: symlink d4/d7/d12/d49/d4b/d7d/ld3 0 2024-04-26T21:08:11.889 INFO:tasks.workunit.client.0.smithi055.stdout:7/467: dread d5/d6/d24/f30 [0,4194304] 0 2024-04-26T21:08:11.896 INFO:tasks.workunit.client.1.smithi064.stdout:3/612: sync 2024-04-26T21:08:11.897 INFO:tasks.workunit.client.1.smithi064.stdout:4/736: creat d0/d1d/ff7 x:0 0 0 2024-04-26T21:08:11.901 INFO:tasks.workunit.client.1.smithi064.stdout:1/799: rename d0/d6/d29/d31/c37 to d0/d6/d11/d1e/d2a/d34/d57/d9b/cf5 0 2024-04-26T21:08:11.905 INFO:tasks.workunit.client.1.smithi064.stdout:3/613: creat d1/d27/d29/d6f/d72/d7a/d99/fd0 x:0 0 0 2024-04-26T21:08:11.906 INFO:tasks.workunit.client.1.smithi064.stdout:3/614: truncate d1/d27/d29/d6f/d72/fb5 1399522 0 2024-04-26T21:08:11.906 INFO:tasks.workunit.client.1.smithi064.stdout:3/615: chown d1/d27 131455469 1 2024-04-26T21:08:11.906 INFO:tasks.workunit.client.1.smithi064.stdout:1/800: symlink d0/d6/d11/d2c/d9c/lf6 0 2024-04-26T21:08:11.906 INFO:tasks.workunit.client.1.smithi064.stdout:1/801: chown d0/d6/d29/d31/lb9 11320 1 2024-04-26T21:08:11.907 INFO:tasks.workunit.client.1.smithi064.stdout:8/580: getdents d10 0 2024-04-26T21:08:11.910 INFO:tasks.workunit.client.1.smithi064.stdout:3/616: rename d1/d27/d50/d35/d4c/d55 to d1/d27/d50/d35/d4c/dd1 0 2024-04-26T21:08:11.910 INFO:tasks.workunit.client.1.smithi064.stdout:3/617: write d1/d27/d29/d6f/d72/d95/fb8 [692565,107651] 0 2024-04-26T21:08:11.913 INFO:tasks.workunit.client.0.smithi055.stdout:2/523: dwrite d4/dc/d21/f43 [0,4194304] 0 2024-04-26T21:08:11.914 INFO:tasks.workunit.client.0.smithi055.stdout:2/524: rename d4/d55/la3 to d4/d55/da1/lb2 0 2024-04-26T21:08:11.931 INFO:tasks.workunit.client.1.smithi064.stdout:2/734: dwrite d12/d41/d73/d83/d94/d3a/dba/ff4 [0,4194304] 0 2024-04-26T21:08:11.931 INFO:tasks.workunit.client.1.smithi064.stdout:2/735: fsync d12/d41/d61/d6c/f9b 0 2024-04-26T21:08:11.931 INFO:tasks.workunit.client.1.smithi064.stdout:2/736: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/l38 0 2024-04-26T21:08:11.931 INFO:tasks.workunit.client.1.smithi064.stdout:0/650: write dd/d10/d74/fae [1605738,22763] 0 2024-04-26T21:08:11.939 INFO:tasks.workunit.client.1.smithi064.stdout:2/737: symlink d12/d41/d73/d83/d94/d3a/d46/d91/def/lfb 0 2024-04-26T21:08:11.940 INFO:tasks.workunit.client.1.smithi064.stdout:0/651: truncate dd/d10/f16 1872164 0 2024-04-26T21:08:11.946 INFO:tasks.workunit.client.0.smithi055.stdout:2/525: getdents d4/d55/da1 0 2024-04-26T21:08:11.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/738: write d12/d41/d61/d75/f93 [1515709,40575] 0 2024-04-26T21:08:11.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/739: fdatasync d12/d41/d73/d83/d94/d3a/dba/ff4 0 2024-04-26T21:08:11.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/740: rename d12/d41/d73/d83/d94 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/dfc 22 2024-04-26T21:08:11.950 INFO:tasks.workunit.client.1.smithi064.stdout:0/652: rmdir dd/d21/dc8/d31/d47 39 2024-04-26T21:08:11.953 INFO:tasks.workunit.client.1.smithi064.stdout:0/653: symlink dd/d10/d74/d4f/d7b/ldb 0 2024-04-26T21:08:11.953 INFO:tasks.workunit.client.1.smithi064.stdout:0/654: dread - dd/d10/d18/fc0 zero size 2024-04-26T21:08:11.955 INFO:tasks.workunit.client.1.smithi064.stdout:0/655: truncate dd/d10/d18/f99 1335074 0 2024-04-26T21:08:11.955 INFO:tasks.workunit.client.1.smithi064.stdout:2/741: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/ffd x:0 0 0 2024-04-26T21:08:11.955 INFO:tasks.workunit.client.1.smithi064.stdout:2/742: fdatasync d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/f9e 0 2024-04-26T21:08:11.956 INFO:tasks.workunit.client.1.smithi064.stdout:2/743: mknod d12/d88/cfe 0 2024-04-26T21:08:11.958 INFO:tasks.workunit.client.1.smithi064.stdout:2/744: symlink d12/d41/d73/d83/d94/d3a/d46/d91/lff 0 2024-04-26T21:08:11.958 INFO:tasks.workunit.client.1.smithi064.stdout:2/745: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f 14209013 1 2024-04-26T21:08:11.958 INFO:tasks.workunit.client.1.smithi064.stdout:2/746: dread - d12/d41/d73/d83/d94/f4c zero size 2024-04-26T21:08:11.960 INFO:tasks.workunit.client.1.smithi064.stdout:2/747: link d12/l1d d12/d88/l100 0 2024-04-26T21:08:11.982 INFO:tasks.workunit.client.1.smithi064.stdout:7/676: dwrite d6/d70/fa6 [0,4194304] 0 2024-04-26T21:08:11.987 INFO:tasks.workunit.client.1.smithi064.stdout:4/737: dwrite d0/d5/d13/d6d/f83 [0,4194304] 0 2024-04-26T21:08:11.987 INFO:tasks.workunit.client.1.smithi064.stdout:4/738: chown d0/d5/c4 115872 1 2024-04-26T21:08:11.988 INFO:tasks.workunit.client.1.smithi064.stdout:4/739: write d0/d2f/d87/fdb [830599,19506] 0 2024-04-26T21:08:11.988 INFO:tasks.workunit.client.1.smithi064.stdout:0/656: dread dd/d21/dc8/d31/d43/fb9 [0,4194304] 0 2024-04-26T21:08:11.988 INFO:tasks.workunit.client.1.smithi064.stdout:0/657: chown dd/d21/dc8/d31/d47/dad/cc3 897 1 2024-04-26T21:08:11.989 INFO:tasks.workunit.client.0.smithi055.stdout:7/468: dwrite d5/f57 [0,4194304] 0 2024-04-26T21:08:11.990 INFO:tasks.workunit.client.1.smithi064.stdout:5/632: dwrite dd/da9/d48/d6a/d81/f77 [0,4194304] 0 2024-04-26T21:08:11.990 INFO:tasks.workunit.client.1.smithi064.stdout:4/740: truncate d0/d14/f6c 1599695 0 2024-04-26T21:08:11.992 INFO:tasks.workunit.client.0.smithi055.stdout:8/417: dwrite d3/d9/d1d/f6e [0,4194304] 0 2024-04-26T21:08:11.994 INFO:tasks.workunit.client.0.smithi055.stdout:9/515: dwrite d2/d46/d77/d7d/f90 [0,4194304] 0 2024-04-26T21:08:11.994 INFO:tasks.workunit.client.1.smithi064.stdout:1/802: dwrite d0/d6/d11/d1e/f20 [0,4194304] 0 2024-04-26T21:08:11.994 INFO:tasks.workunit.client.1.smithi064.stdout:1/803: chown d0/d6/d11/d1e/d2a/d34/f79 132875 1 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:5/633: creat dd/fce x:0 0 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:5/634: truncate dd/d12/d18/d1a/d1f/f7b 1079746 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:0/658: write dd/d10/f16 [236207,31985] 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:2/748: dread d12/da9/feb [0,4194304] 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:2/749: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/ff8 [216037,10148] 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:4/741: link d0/d2f/d69/db5/fdc d0/d2f/d69/db5/ddd/ff8 0 2024-04-26T21:08:11.999 INFO:tasks.workunit.client.1.smithi064.stdout:4/742: fdatasync d0/fee 0 2024-04-26T21:08:12.000 INFO:tasks.workunit.client.1.smithi064.stdout:0/659: truncate dd/d21/dc8/d31/d47/d61/f83 940538 0 2024-04-26T21:08:12.001 INFO:tasks.workunit.client.0.smithi055.stdout:8/418: mkdir d3/d9/d1f/d84/d8f 0 2024-04-26T21:08:12.001 INFO:tasks.workunit.client.0.smithi055.stdout:8/419: fdatasync f1 0 2024-04-26T21:08:12.002 INFO:tasks.workunit.client.1.smithi064.stdout:4/743: unlink d0/d2f/d69/f9a 0 2024-04-26T21:08:12.006 INFO:tasks.workunit.client.1.smithi064.stdout:4/744: symlink d0/d5/d79/dd1/da0/lf9 0 2024-04-26T21:08:12.006 INFO:tasks.workunit.client.1.smithi064.stdout:4/745: readlink d0/d5/d13/d33/le8 0 2024-04-26T21:08:12.008 INFO:tasks.workunit.client.1.smithi064.stdout:4/746: link d0/d1d/d21/f62 d0/d2f/d69/db5/ffa 0 2024-04-26T21:08:12.010 INFO:tasks.workunit.client.1.smithi064.stdout:4/747: truncate d0/d5/d13/d10/f4c 1638908 0 2024-04-26T21:08:12.011 INFO:tasks.workunit.client.1.smithi064.stdout:4/748: symlink d0/d2f/d87/lfb 0 2024-04-26T21:08:12.015 INFO:tasks.workunit.client.1.smithi064.stdout:4/749: rename d0/d5/fce to d0/d1d/d56/d89/dda/ffc 0 2024-04-26T21:08:12.016 INFO:tasks.workunit.client.1.smithi064.stdout:4/750: dread - d0/d2f/d69/db5/fdc zero size 2024-04-26T21:08:12.016 INFO:tasks.workunit.client.1.smithi064.stdout:4/751: write d0/d1d/d21/f8e [1479430,120299] 0 2024-04-26T21:08:12.019 INFO:tasks.workunit.client.0.smithi055.stdout:8/420: dread f1 [0,4194304] 0 2024-04-26T21:08:12.020 INFO:tasks.workunit.client.1.smithi064.stdout:8/581: dwrite d10/d41/d44/f66 [4194304,4194304] 0 2024-04-26T21:08:12.020 INFO:tasks.workunit.client.1.smithi064.stdout:4/752: truncate d0/d1d/d21/f4e 787560 0 2024-04-26T21:08:12.022 INFO:tasks.workunit.client.1.smithi064.stdout:1/804: dread d0/d6/d11/d2c/f55 [0,4194304] 0 2024-04-26T21:08:12.022 INFO:tasks.workunit.client.0.smithi055.stdout:7/469: write d5/d6/d24/d4d/f55 [3185613,22275] 0 2024-04-26T21:08:12.024 INFO:tasks.workunit.client.0.smithi055.stdout:2/526: dwrite d4/db/d26/d9a/fad [0,4194304] 0 2024-04-26T21:08:12.024 INFO:tasks.workunit.client.0.smithi055.stdout:2/527: fsync d4/dc/d21/f24 0 2024-04-26T21:08:12.025 INFO:tasks.workunit.client.1.smithi064.stdout:8/582: truncate d10/f24 2353288 0 2024-04-26T21:08:12.025 INFO:tasks.workunit.client.1.smithi064.stdout:8/583: write d10/d1d/f30 [4491833,108321] 0 2024-04-26T21:08:12.025 INFO:tasks.workunit.client.1.smithi064.stdout:8/584: fsync d10/d41/d44/f66 0 2024-04-26T21:08:12.025 INFO:tasks.workunit.client.1.smithi064.stdout:3/618: dwrite d1/d27/d50/d35/fc4 [0,4194304] 0 2024-04-26T21:08:12.025 INFO:tasks.workunit.client.1.smithi064.stdout:0/660: dread dd/d21/dc8/d31/f41 [0,4194304] 0 2024-04-26T21:08:12.026 INFO:tasks.workunit.client.0.smithi055.stdout:9/516: read d2/f10 [433244,122040] 0 2024-04-26T21:08:12.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/421: mkdir d3/d7c/d90 0 2024-04-26T21:08:12.031 INFO:tasks.workunit.client.1.smithi064.stdout:1/805: mknod d0/d22/d87/cf7 0 2024-04-26T21:08:12.031 INFO:tasks.workunit.client.1.smithi064.stdout:1/806: chown d0/d6b/fa0 62 1 2024-04-26T21:08:12.031 INFO:tasks.workunit.client.1.smithi064.stdout:1/807: write d0/d6/d91/f94 [4426321,110754] 0 2024-04-26T21:08:12.031 INFO:tasks.workunit.client.1.smithi064.stdout:1/808: truncate d0/d6/d11/d2c/d9c/ff0 288478 0 2024-04-26T21:08:12.031 INFO:tasks.workunit.client.1.smithi064.stdout:1/809: write d0/d6/d11/d2c/d9c/fef [109546,13053] 0 2024-04-26T21:08:12.032 INFO:tasks.workunit.client.1.smithi064.stdout:1/810: read - d0/d6/d11/d1e/d2a/d34/fac zero size 2024-04-26T21:08:12.043 INFO:tasks.workunit.client.1.smithi064.stdout:3/619: creat d1/d38/fd2 x:0 0 0 2024-04-26T21:08:12.046 INFO:tasks.workunit.client.1.smithi064.stdout:4/753: read d0/d5/d13/d6d/f59 [3536091,33711] 0 2024-04-26T21:08:12.048 INFO:tasks.workunit.client.1.smithi064.stdout:7/677: dwrite d6/d9/f76 [0,4194304] 0 2024-04-26T21:08:12.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/470: write d5/db/f14 [3928599,130246] 0 2024-04-26T21:08:12.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/471: dread - d5/d6/d24/d4d/f73 zero size 2024-04-26T21:08:12.051 INFO:tasks.workunit.client.0.smithi055.stdout:9/517: dread d2/d46/d77/f76 [0,4194304] 0 2024-04-26T21:08:12.059 INFO:tasks.workunit.client.1.smithi064.stdout:5/635: dwrite dd/da9/f98 [0,4194304] 0 2024-04-26T21:08:12.059 INFO:tasks.workunit.client.1.smithi064.stdout:5/636: fdatasync dd/f1e 0 2024-04-26T21:08:12.059 INFO:tasks.workunit.client.1.smithi064.stdout:5/637: creat dd/d12/fcf x:0 0 0 2024-04-26T21:08:12.059 INFO:tasks.workunit.client.1.smithi064.stdout:5/638: chown dd/d12/d18/d25/d32/f78 585285886 1 2024-04-26T21:08:12.060 INFO:tasks.workunit.client.0.smithi055.stdout:8/422: symlink d3/d9/d1d/d48/d57/d61/l91 0 2024-04-26T21:08:12.062 INFO:tasks.workunit.client.1.smithi064.stdout:1/811: dread d0/d6/dd/fd6 [0,4194304] 0 2024-04-26T21:08:12.065 INFO:tasks.workunit.client.0.smithi055.stdout:7/472: creat d5/d6/d24/d48/d58/f88 x:0 0 0 2024-04-26T21:08:12.066 INFO:tasks.workunit.client.1.smithi064.stdout:4/754: dread d0/d1d/d17/f25 [0,4194304] 0 2024-04-26T21:08:12.069 INFO:tasks.workunit.client.0.smithi055.stdout:9/518: mkdir d2/d46/d9a/da7 0 2024-04-26T21:08:12.078 INFO:tasks.workunit.client.1.smithi064.stdout:7/678: write d6/d70/da8/fb2 [2747962,856] 0 2024-04-26T21:08:12.078 INFO:tasks.workunit.client.1.smithi064.stdout:5/639: mkdir dd/dd0 0 2024-04-26T21:08:12.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/750: dwrite d12/d41/fe4 [0,4194304] 0 2024-04-26T21:08:12.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/751: write d12/d41/d61/d6c/fc8 [1014368,74327] 0 2024-04-26T21:08:12.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/752: truncate d12/d41/d61/d6c/f9b 941848 0 2024-04-26T21:08:12.079 INFO:tasks.workunit.client.1.smithi064.stdout:1/812: link d0/d6/d11/d1e/d2a/d34/d57/d66/f7e d0/d6/d91/ff8 0 2024-04-26T21:08:12.081 INFO:tasks.workunit.client.1.smithi064.stdout:4/755: creat d0/d5/d13/d6d/dd3/ffd x:0 0 0 2024-04-26T21:08:12.082 INFO:tasks.workunit.client.0.smithi055.stdout:8/423: dread d3/d9/f2b [0,4194304] 0 2024-04-26T21:08:12.088 INFO:tasks.workunit.client.0.smithi055.stdout:2/528: dwrite d4/d55/d6c/f94 [4194304,4194304] 0 2024-04-26T21:08:12.099 INFO:tasks.workunit.client.1.smithi064.stdout:7/679: mknod d6/d70/da8/dd1/cf1 0 2024-04-26T21:08:12.100 INFO:tasks.workunit.client.1.smithi064.stdout:3/620: dwrite d1/ff [4194304,4194304] 0 2024-04-26T21:08:12.100 INFO:tasks.workunit.client.1.smithi064.stdout:4/756: dread d0/d1d/d56/d89/dda/ffc [0,4194304] 0 2024-04-26T21:08:12.100 INFO:tasks.workunit.client.1.smithi064.stdout:5/640: unlink dd/d12/c54 0 2024-04-26T21:08:12.101 INFO:tasks.workunit.client.0.smithi055.stdout:2/529: creat d4/d55/da1/fb3 x:0 0 0 2024-04-26T21:08:12.103 INFO:tasks.workunit.client.0.smithi055.stdout:4/365: sync 2024-04-26T21:08:12.103 INFO:tasks.workunit.client.0.smithi055.stdout:4/366: truncate d4/d12/d17/f62 270454 0 2024-04-26T21:08:12.105 INFO:tasks.workunit.client.1.smithi064.stdout:1/813: mkdir d0/d6/dd/df9 0 2024-04-26T21:08:12.105 INFO:tasks.workunit.client.1.smithi064.stdout:1/814: chown d0/l3e 210730426 1 2024-04-26T21:08:12.105 INFO:tasks.workunit.client.1.smithi064.stdout:1/815: dread - d0/d6/d11/d2c/d9c/fb6 zero size 2024-04-26T21:08:12.105 INFO:tasks.workunit.client.1.smithi064.stdout:1/816: write d0/d6/d11/d1e/d2a/f77 [20431,95156] 0 2024-04-26T21:08:12.108 INFO:tasks.workunit.client.0.smithi055.stdout:7/473: fsync d5/d6/d24/d48/d58/f88 0 2024-04-26T21:08:12.113 INFO:tasks.workunit.client.1.smithi064.stdout:4/757: dread d0/fc7 [0,4194304] 0 2024-04-26T21:08:12.116 INFO:tasks.workunit.client.0.smithi055.stdout:2/530: creat d4/db/d8f/da6/fb4 x:0 0 0 2024-04-26T21:08:12.116 INFO:tasks.workunit.client.0.smithi055.stdout:2/531: truncate d4/d49/d4c/faa 335198 0 2024-04-26T21:08:12.123 INFO:tasks.workunit.client.1.smithi064.stdout:4/758: dread d0/d1d/d56/d89/f96 [0,4194304] 0 2024-04-26T21:08:12.127 INFO:tasks.workunit.client.1.smithi064.stdout:7/680: unlink d6/d15/d67/d4d/c82 0 2024-04-26T21:08:12.127 INFO:tasks.workunit.client.1.smithi064.stdout:7/681: chown d6/d5a/l13 99412133 1 2024-04-26T21:08:12.128 INFO:tasks.workunit.client.1.smithi064.stdout:3/621: mknod d1/d38/cd3 0 2024-04-26T21:08:12.128 INFO:tasks.workunit.client.1.smithi064.stdout:3/622: creat d1/d27/d50/d35/fd4 x:0 0 0 2024-04-26T21:08:12.130 INFO:tasks.workunit.client.1.smithi064.stdout:5/641: creat dd/d12/d18/d25/d74/fd1 x:0 0 0 2024-04-26T21:08:12.130 INFO:tasks.workunit.client.1.smithi064.stdout:5/642: stat dd/d12/d18/d1a/d1f/d20/c71 0 2024-04-26T21:08:12.131 INFO:tasks.workunit.client.0.smithi055.stdout:2/532: read d4/d55/d6c/f94 [5136043,51155] 0 2024-04-26T21:08:12.132 INFO:tasks.workunit.client.1.smithi064.stdout:7/682: symlink d6/db/d8e/lf2 0 2024-04-26T21:08:12.132 INFO:tasks.workunit.client.1.smithi064.stdout:7/683: fsync d6/d15/d1c/f25 0 2024-04-26T21:08:12.136 INFO:tasks.workunit.client.0.smithi055.stdout:9/519: dwrite d2/d11/f1f [0,4194304] 0 2024-04-26T21:08:12.140 INFO:tasks.workunit.client.0.smithi055.stdout:2/533: mknod d4/db/d1f/d46/cb5 0 2024-04-26T21:08:12.142 INFO:tasks.workunit.client.1.smithi064.stdout:3/623: symlink d1/d27/d29/d6f/d72/ld5 0 2024-04-26T21:08:12.144 INFO:tasks.workunit.client.1.smithi064.stdout:4/759: dread d0/d1d/d21/f3a [0,4194304] 0 2024-04-26T21:08:12.144 INFO:tasks.workunit.client.1.smithi064.stdout:4/760: chown d0/d5/d13/d10/f4c 9517556 1 2024-04-26T21:08:12.151 INFO:tasks.workunit.client.1.smithi064.stdout:7/684: rmdir d6/d70/d74/d99 39 2024-04-26T21:08:12.151 INFO:tasks.workunit.client.0.smithi055.stdout:9/520: truncate d2/d14/f47 8947 0 2024-04-26T21:08:12.152 INFO:tasks.workunit.client.0.smithi055.stdout:2/534: unlink d4/db/d26/d9a/l9b 0 2024-04-26T21:08:12.153 INFO:tasks.workunit.client.0.smithi055.stdout:2/535: read d4/d49/f87 [4327151,109920] 0 2024-04-26T21:08:12.154 INFO:tasks.workunit.client.1.smithi064.stdout:3/624: mkdir d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6 0 2024-04-26T21:08:12.159 INFO:tasks.workunit.client.0.smithi055.stdout:2/536: truncate d4/dc/f1d 333813 0 2024-04-26T21:08:12.159 INFO:tasks.workunit.client.1.smithi064.stdout:7/685: creat d6/d9/d3d/d43/ff3 x:0 0 0 2024-04-26T21:08:12.160 INFO:tasks.workunit.client.1.smithi064.stdout:3/625: creat d1/d27/d50/d35/d4c/d7b/d82/fd7 x:0 0 0 2024-04-26T21:08:12.162 INFO:tasks.workunit.client.1.smithi064.stdout:9/665: sync 2024-04-26T21:08:12.163 INFO:tasks.workunit.client.1.smithi064.stdout:4/761: link d0/d1d/c66 d0/d1d/d17/d44/dac/da9/cfe 0 2024-04-26T21:08:12.163 INFO:tasks.workunit.client.1.smithi064.stdout:6/656: sync 2024-04-26T21:08:12.163 INFO:tasks.workunit.client.1.smithi064.stdout:7/686: getdents d6/d70/da8/dd1 0 2024-04-26T21:08:12.164 INFO:tasks.workunit.client.0.smithi055.stdout:9/521: dread d2/f41 [0,4194304] 0 2024-04-26T21:08:12.164 INFO:tasks.workunit.client.0.smithi055.stdout:9/522: fdatasync d2/f1a 0 2024-04-26T21:08:12.165 INFO:tasks.workunit.client.1.smithi064.stdout:4/762: creat d0/d1d/d17/fff x:0 0 0 2024-04-26T21:08:12.165 INFO:tasks.workunit.client.1.smithi064.stdout:4/763: chown d0/d2f/fd6 13986 1 2024-04-26T21:08:12.167 INFO:tasks.workunit.client.0.smithi055.stdout:9/523: mkdir d2/d46/d77/d7d/da8 0 2024-04-26T21:08:12.167 INFO:tasks.workunit.client.0.smithi055.stdout:9/524: readlink d2/d11/l38 0 2024-04-26T21:08:12.167 INFO:tasks.workunit.client.0.smithi055.stdout:8/424: dwrite d3/d9/fe [0,4194304] 0 2024-04-26T21:08:12.168 INFO:tasks.workunit.client.0.smithi055.stdout:4/367: dwrite d4/f11 [0,4194304] 0 2024-04-26T21:08:12.169 INFO:tasks.workunit.client.0.smithi055.stdout:5/371: sync 2024-04-26T21:08:12.169 INFO:tasks.workunit.client.0.smithi055.stdout:0/534: sync 2024-04-26T21:08:12.169 INFO:tasks.workunit.client.0.smithi055.stdout:0/535: fsync d9/dc/d19/fa5 0 2024-04-26T21:08:12.169 INFO:tasks.workunit.client.0.smithi055.stdout:0/536: fsync d9/dc/d1c/f4f 0 2024-04-26T21:08:12.169 INFO:tasks.workunit.client.0.smithi055.stdout:0/537: chown d9/d11/d5b/d74 27143630 1 2024-04-26T21:08:12.171 INFO:tasks.workunit.client.1.smithi064.stdout:6/657: getdents d4/d7/d12/d49 0 2024-04-26T21:08:12.171 INFO:tasks.workunit.client.1.smithi064.stdout:1/817: dwrite d0/d6/f7d [4194304,4194304] 0 2024-04-26T21:08:12.171 INFO:tasks.workunit.client.1.smithi064.stdout:1/818: write d0/d6/d91/fcd [5239219,67895] 0 2024-04-26T21:08:12.172 INFO:tasks.workunit.client.0.smithi055.stdout:3/580: sync 2024-04-26T21:08:12.173 INFO:tasks.workunit.client.1.smithi064.stdout:4/764: stat d0/d1d/l26 0 2024-04-26T21:08:12.173 INFO:tasks.workunit.client.0.smithi055.stdout:7/474: dwrite d5/d6/d24/f50 [0,4194304] 0 2024-04-26T21:08:12.180 INFO:tasks.workunit.client.0.smithi055.stdout:9/525: creat d2/d46/d9a/da7/fa9 x:0 0 0 2024-04-26T21:08:12.181 INFO:tasks.workunit.client.0.smithi055.stdout:2/537: dread d4/d14/f20 [0,4194304] 0 2024-04-26T21:08:12.182 INFO:tasks.workunit.client.1.smithi064.stdout:3/626: read d1/d27/d29/d6f/d72/d73/f90 [1515805,34550] 0 2024-04-26T21:08:12.182 INFO:tasks.workunit.client.0.smithi055.stdout:2/538: write d4/dc/f11 [572447,29757] 0 2024-04-26T21:08:12.183 INFO:tasks.workunit.client.0.smithi055.stdout:8/425: mkdir d3/d9/d1f/d2e/d75/d76/d92 0 2024-04-26T21:08:12.184 INFO:tasks.workunit.client.1.smithi064.stdout:4/765: symlink d0/d5/d13/d10/db7/l100 0 2024-04-26T21:08:12.187 INFO:tasks.workunit.client.0.smithi055.stdout:4/368: symlink d4/d26/d42/d28/d53/l82 0 2024-04-26T21:08:12.187 INFO:tasks.workunit.client.0.smithi055.stdout:4/369: write d4/d12/d17/f7e [897604,37359] 0 2024-04-26T21:08:12.188 INFO:tasks.workunit.client.0.smithi055.stdout:5/372: creat d4/df/d13/d26/d3c/d4a/d3f/d2e/d82/f84 x:0 0 0 2024-04-26T21:08:12.189 INFO:tasks.workunit.client.0.smithi055.stdout:3/581: symlink d0/d4/d5/lcb 0 2024-04-26T21:08:12.189 INFO:tasks.workunit.client.0.smithi055.stdout:3/582: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 zero size 2024-04-26T21:08:12.191 INFO:tasks.workunit.client.0.smithi055.stdout:7/475: rmdir d5/d6/d24/d48/d7f 39 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.0.smithi055.stdout:8/426: creat d3/d9/d1d/d48/d4b/d8b/f93 x:0 0 0 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.0.smithi055.stdout:4/370: mknod d4/d26/d42/d2d/c83 0 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.0.smithi055.stdout:9/526: write d2/f55 [3132539,45956] 0 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.1.smithi064.stdout:1/819: dread d0/d6/d11/d1e/d2a/d34/d57/d66/f7e [0,4194304] 0 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.1.smithi064.stdout:1/820: chown d0/d6/dd/c99 178276956 1 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.1.smithi064.stdout:1/821: chown d0/d6/d91/f94 52111 1 2024-04-26T21:08:12.198 INFO:tasks.workunit.client.1.smithi064.stdout:9/666: dread d0/d4/d7/f2e [0,4194304] 0 2024-04-26T21:08:12.200 INFO:tasks.workunit.client.0.smithi055.stdout:3/583: rename d0/d4/d5/d73/d13/d1a/d46/d72/d69/da7 to d0/d4/d16/d18/d4b/d57/d8e/dcc 0 2024-04-26T21:08:12.200 INFO:tasks.workunit.client.0.smithi055.stdout:3/584: chown d0/d4/d5/d73/d13/d1a/d46/d72/d69/fbb 39 1 2024-04-26T21:08:12.200 INFO:tasks.workunit.client.0.smithi055.stdout:2/539: dread d4/db/d26/f9f [0,4194304] 0 2024-04-26T21:08:12.200 INFO:tasks.workunit.client.0.smithi055.stdout:2/540: chown d4/d55/d6c 418849 1 2024-04-26T21:08:12.200 INFO:tasks.workunit.client.0.smithi055.stdout:2/541: chown d4/d14/d17/d36/c3c 40 1 2024-04-26T21:08:12.201 INFO:tasks.workunit.client.0.smithi055.stdout:7/476: creat d5/d6/f89 x:0 0 0 2024-04-26T21:08:12.203 INFO:tasks.workunit.client.1.smithi064.stdout:5/643: dwrite dd/da9/d48/f72 [0,4194304] 0 2024-04-26T21:08:12.205 INFO:tasks.workunit.client.0.smithi055.stdout:8/427: creat d3/d89/f94 x:0 0 0 2024-04-26T21:08:12.205 INFO:tasks.workunit.client.0.smithi055.stdout:8/428: write d3/d9/d1f/d2e/f62 [834967,2547] 0 2024-04-26T21:08:12.205 INFO:tasks.workunit.client.1.smithi064.stdout:3/627: dread d1/d27/d29/d6f/d72/d73/f90 [0,4194304] 0 2024-04-26T21:08:12.207 INFO:tasks.workunit.client.1.smithi064.stdout:1/822: rmdir d0/d6/d11/d1e/d2a/d34/d57/d66 39 2024-04-26T21:08:12.210 INFO:tasks.workunit.client.0.smithi055.stdout:4/371: symlink d4/d12/d17/d3d/l84 0 2024-04-26T21:08:12.210 INFO:tasks.workunit.client.0.smithi055.stdout:4/372: stat d4/d18/d1a/f7d 0 2024-04-26T21:08:12.212 INFO:tasks.workunit.client.1.smithi064.stdout:9/667: symlink d0/d4/d28/d4f/ld3 0 2024-04-26T21:08:12.217 INFO:tasks.workunit.client.0.smithi055.stdout:9/527: mknod d2/d46/d77/d7d/caa 0 2024-04-26T21:08:12.219 INFO:tasks.workunit.client.1.smithi064.stdout:6/658: dwrite d4/d7/d12/d49/d4b/fb8 [0,4194304] 0 2024-04-26T21:08:12.219 INFO:tasks.workunit.client.0.smithi055.stdout:0/538: dwrite d9/fa1 [0,4194304] 0 2024-04-26T21:08:12.220 INFO:tasks.workunit.client.1.smithi064.stdout:7/687: dwrite d6/d15/d88/dca/f9d [0,4194304] 0 2024-04-26T21:08:12.220 INFO:tasks.workunit.client.0.smithi055.stdout:5/373: symlink d4/l85 0 2024-04-26T21:08:12.221 INFO:tasks.workunit.client.0.smithi055.stdout:5/374: creat d4/df/d13/d26/d3c/d5b/f86 x:0 0 0 2024-04-26T21:08:12.221 INFO:tasks.workunit.client.0.smithi055.stdout:5/375: chown d4/df/d13/d26 13673927 1 2024-04-26T21:08:12.222 INFO:tasks.workunit.client.1.smithi064.stdout:8/585: sync 2024-04-26T21:08:12.222 INFO:tasks.workunit.client.1.smithi064.stdout:0/661: sync 2024-04-26T21:08:12.222 INFO:tasks.workunit.client.1.smithi064.stdout:0/662: creat dd/fdc x:0 0 0 2024-04-26T21:08:12.223 INFO:tasks.workunit.client.0.smithi055.stdout:3/585: mkdir d0/d4/d5/d73/d13/d27/d3b/dcd 0 2024-04-26T21:08:12.224 INFO:tasks.workunit.client.0.smithi055.stdout:6/483: sync 2024-04-26T21:08:12.225 INFO:tasks.workunit.client.1.smithi064.stdout:5/644: creat dd/d12/d9a/fd2 x:0 0 0 2024-04-26T21:08:12.225 INFO:tasks.workunit.client.1.smithi064.stdout:2/753: sync 2024-04-26T21:08:12.228 INFO:tasks.workunit.client.1.smithi064.stdout:3/628: creat d1/d27/d29/d9d/fd8 x:0 0 0 2024-04-26T21:08:12.228 INFO:tasks.workunit.client.1.smithi064.stdout:3/629: write d1/d27/d50/f39 [1881076,68236] 0 2024-04-26T21:08:12.231 INFO:tasks.workunit.client.0.smithi055.stdout:1/458: sync 2024-04-26T21:08:12.233 INFO:tasks.workunit.client.1.smithi064.stdout:1/823: rename d0/d6/dd/df9 to d0/d22/d9f/df1/dfa 0 2024-04-26T21:08:12.235 INFO:tasks.workunit.client.1.smithi064.stdout:8/586: dread d10/d2f/f33 [0,4194304] 0 2024-04-26T21:08:12.235 INFO:tasks.workunit.client.0.smithi055.stdout:7/477: truncate d5/f21 2883289 0 2024-04-26T21:08:12.236 INFO:tasks.workunit.client.1.smithi064.stdout:9/668: symlink d0/d4/da/d67/ld4 0 2024-04-26T21:08:12.236 INFO:tasks.workunit.client.1.smithi064.stdout:9/669: write d0/d4/d7/df/f3a [676665,128084] 0 2024-04-26T21:08:12.243 INFO:tasks.workunit.client.0.smithi055.stdout:9/528: unlink d2/d14/l95 0 2024-04-26T21:08:12.244 INFO:tasks.workunit.client.1.smithi064.stdout:6/659: mkdir d4/d7/d12/d1e/dd4 0 2024-04-26T21:08:12.244 INFO:tasks.workunit.client.1.smithi064.stdout:6/660: creat d4/d7/d12/d49/d4b/fd5 x:0 0 0 2024-04-26T21:08:12.245 INFO:tasks.workunit.client.0.smithi055.stdout:0/539: unlink d9/dc/d1c/d54/d4b/c72 0 2024-04-26T21:08:12.245 INFO:tasks.workunit.client.0.smithi055.stdout:0/540: chown d9/dc/d1c/d54/la4 184 1 2024-04-26T21:08:12.249 INFO:tasks.workunit.client.1.smithi064.stdout:7/688: getdents d6/db/d1f 0 2024-04-26T21:08:12.249 INFO:tasks.workunit.client.1.smithi064.stdout:7/689: fsync d6/d9/f11 0 2024-04-26T21:08:12.253 INFO:tasks.workunit.client.0.smithi055.stdout:3/586: creat d0/d4/d5/d73/d47/d37/fce x:0 0 0 2024-04-26T21:08:12.257 INFO:tasks.workunit.client.0.smithi055.stdout:1/459: rename d8/d17/d1b/d41/f68 to d8/d17/d6a/f99 0 2024-04-26T21:08:12.257 INFO:tasks.workunit.client.0.smithi055.stdout:1/460: dread - d8/d17/d1b/d7b/d65/f71 zero size 2024-04-26T21:08:12.261 INFO:tasks.workunit.client.1.smithi064.stdout:2/754: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/lcb d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/l101 0 2024-04-26T21:08:12.261 INFO:tasks.workunit.client.1.smithi064.stdout:2/755: creat d12/d88/f102 x:0 0 0 2024-04-26T21:08:12.262 INFO:tasks.workunit.client.0.smithi055.stdout:8/429: symlink d3/d9/l95 0 2024-04-26T21:08:12.286 INFO:tasks.workunit.client.1.smithi064.stdout:1/824: truncate d0/d22/d9f/fbb 408160 0 2024-04-26T21:08:12.292 INFO:tasks.workunit.client.1.smithi064.stdout:8/587: rename d10/d41/d4e/d54/f95 to d10/d41/d4e/fbb 0 2024-04-26T21:08:12.292 INFO:tasks.workunit.client.1.smithi064.stdout:8/588: creat d10/d1d/fbc x:0 0 0 2024-04-26T21:08:12.296 INFO:tasks.workunit.client.0.smithi055.stdout:3/587: rename d0/d4/d5/d73/d13/d1a/d46/d51 to d0/d4/d5/d73/d47/dcf 0 2024-04-26T21:08:12.299 INFO:tasks.workunit.client.0.smithi055.stdout:1/461: symlink d8/d17/d36/l9a 0 2024-04-26T21:08:12.300 INFO:tasks.workunit.client.1.smithi064.stdout:6/661: creat d4/d7/d12/d49/d4b/d5a/daf/db2/fd6 x:0 0 0 2024-04-26T21:08:12.300 INFO:tasks.workunit.client.1.smithi064.stdout:6/662: chown d4/d7/d12/d38/lc3 1288 1 2024-04-26T21:08:12.302 INFO:tasks.workunit.client.1.smithi064.stdout:7/690: creat d6/db/ff4 x:0 0 0 2024-04-26T21:08:12.304 INFO:tasks.workunit.client.0.smithi055.stdout:8/430: symlink d3/d9/d1f/d2e/d75/d76/d92/l96 0 2024-04-26T21:08:12.304 INFO:tasks.workunit.client.0.smithi055.stdout:8/431: truncate d3/d9/d1d/d48/d4b/f6b 843233 0 2024-04-26T21:08:12.304 INFO:tasks.workunit.client.0.smithi055.stdout:8/432: creat d3/d9/d1d/d48/d57/d61/f97 x:0 0 0 2024-04-26T21:08:12.304 INFO:tasks.workunit.client.0.smithi055.stdout:8/433: write d3/d9/f8e [804974,109581] 0 2024-04-26T21:08:12.304 INFO:tasks.workunit.client.0.smithi055.stdout:4/373: dwrite d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:08:12.310 INFO:tasks.workunit.client.0.smithi055.stdout:4/374: read d4/d12/d17/f19 [608458,42119] 0 2024-04-26T21:08:12.310 INFO:tasks.workunit.client.0.smithi055.stdout:4/375: write d4/d12/d17/f6e [441329,79833] 0 2024-04-26T21:08:12.310 INFO:tasks.workunit.client.0.smithi055.stdout:6/484: dwrite d3/f9 [0,4194304] 0 2024-04-26T21:08:12.314 INFO:tasks.workunit.client.1.smithi064.stdout:0/663: dwrite dd/f85 [0,4194304] 0 2024-04-26T21:08:12.314 INFO:tasks.workunit.client.1.smithi064.stdout:5/645: rmdir dd/d12/d18/d1a/d1b 39 2024-04-26T21:08:12.316 INFO:tasks.workunit.client.0.smithi055.stdout:9/529: dwrite d2/f55 [0,4194304] 0 2024-04-26T21:08:12.321 INFO:tasks.workunit.client.0.smithi055.stdout:5/376: dwrite d4/df/d13/d26/d3c/d5b/f70 [0,4194304] 0 2024-04-26T21:08:12.323 INFO:tasks.workunit.client.0.smithi055.stdout:0/541: rmdir d9/d11/d5b/d5e/d6c 39 2024-04-26T21:08:12.327 INFO:tasks.workunit.client.0.smithi055.stdout:8/434: dread d3/d9/d1d/d48/d57/f6f [0,4194304] 0 2024-04-26T21:08:12.333 INFO:tasks.workunit.client.0.smithi055.stdout:3/588: getdents d0/d4/d16/d18/d4b/d57 0 2024-04-26T21:08:12.333 INFO:tasks.workunit.client.0.smithi055.stdout:3/589: creat d0/d4/d5/d73/d13/d27/d50/d6b/fd0 x:0 0 0 2024-04-26T21:08:12.333 INFO:tasks.workunit.client.0.smithi055.stdout:3/590: stat d0/d4/d5/f2c 0 2024-04-26T21:08:12.333 INFO:tasks.workunit.client.0.smithi055.stdout:3/591: write d0/d4/d5/d73/d47/d37/da6/fc0 [416625,11928] 0 2024-04-26T21:08:12.335 INFO:tasks.workunit.client.0.smithi055.stdout:3/592: creat d0/d4/d5/d73/d13/d1a/d46/d72/fd1 x:0 0 0 2024-04-26T21:08:12.335 INFO:tasks.workunit.client.0.smithi055.stdout:3/593: readlink d0/d4/d5/d73/d47/dcf/l65 0 2024-04-26T21:08:12.335 INFO:tasks.workunit.client.1.smithi064.stdout:2/756: getdents d12/d41/d73/d83/d94/d3a/d3e 0 2024-04-26T21:08:12.335 INFO:tasks.workunit.client.1.smithi064.stdout:2/757: truncate d12/d41/d73/d83/fa6 1326209 0 2024-04-26T21:08:12.336 INFO:tasks.workunit.client.0.smithi055.stdout:2/542: dwrite d4/d55/d6c/fa0 [0,4194304] 0 2024-04-26T21:08:12.341 INFO:tasks.workunit.client.1.smithi064.stdout:1/825: creat d0/d22/d9f/df1/ffb x:0 0 0 2024-04-26T21:08:12.345 INFO:tasks.workunit.client.1.smithi064.stdout:3/630: dwrite d1/d27/d29/d6f/f86 [0,4194304] 0 2024-04-26T21:08:12.345 INFO:tasks.workunit.client.1.smithi064.stdout:3/631: read d1/d27/d29/f67 [1681767,8092] 0 2024-04-26T21:08:12.345 INFO:tasks.workunit.client.1.smithi064.stdout:3/632: getdents d1/d27/d29/d5e 0 2024-04-26T21:08:12.345 INFO:tasks.workunit.client.1.smithi064.stdout:9/670: rename d0/d4/d7/df/f40 to d0/d4/da/d26/d47/d9d/fd5 0 2024-04-26T21:08:12.350 INFO:tasks.workunit.client.1.smithi064.stdout:8/589: dwrite d10/f24 [0,4194304] 0 2024-04-26T21:08:12.350 INFO:tasks.workunit.client.1.smithi064.stdout:8/590: fsync d10/d41/d4e/d59/fba 0 2024-04-26T21:08:12.350 INFO:tasks.workunit.client.1.smithi064.stdout:8/591: fsync d10/d2f/f8e 0 2024-04-26T21:08:12.350 INFO:tasks.workunit.client.1.smithi064.stdout:8/592: write d10/d2f/f36 [5094832,129482] 0 2024-04-26T21:08:12.353 INFO:tasks.workunit.client.0.smithi055.stdout:9/530: rename d2/d46/d77/f58 to d2/d46/d77/d7d/da8/fab 0 2024-04-26T21:08:12.358 INFO:tasks.workunit.client.1.smithi064.stdout:6/663: stat d4/l7c 0 2024-04-26T21:08:12.358 INFO:tasks.workunit.client.1.smithi064.stdout:6/664: truncate d4/d7/d12/d49/d4b/d56/d95/fcc 130752 0 2024-04-26T21:08:12.358 INFO:tasks.workunit.client.1.smithi064.stdout:6/665: creat d4/d7/fd7 x:0 0 0 2024-04-26T21:08:12.359 INFO:tasks.workunit.client.1.smithi064.stdout:6/666: write d4/d7/d12/d49/d4b/d5a/d79/f86 [1042819,117401] 0 2024-04-26T21:08:12.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/691: truncate d6/d9/f36 5914425 0 2024-04-26T21:08:12.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/692: chown d6/d15/d1c/lac 5012626 1 2024-04-26T21:08:12.359 INFO:tasks.workunit.client.1.smithi064.stdout:7/693: write d6/d15/d1c/f25 [1352146,112829] 0 2024-04-26T21:08:12.368 INFO:tasks.workunit.client.0.smithi055.stdout:0/542: write d9/d11/f46 [8016,6793] 0 2024-04-26T21:08:12.380 INFO:tasks.workunit.client.0.smithi055.stdout:5/377: dread d4/fd [0,4194304] 0 2024-04-26T21:08:12.381 INFO:tasks.workunit.client.0.smithi055.stdout:5/378: fdatasync d4/df/d13/d26/d3c/d4a/d3f/d2e/d82/f84 0 2024-04-26T21:08:12.381 INFO:tasks.workunit.client.0.smithi055.stdout:5/379: chown d4/df/d13/d26/d3c/f3e 257377 1 2024-04-26T21:08:12.383 INFO:tasks.workunit.client.1.smithi064.stdout:8/593: write d10/d1d/d38/f5b [3400388,82584] 0 2024-04-26T21:08:12.389 INFO:tasks.workunit.client.1.smithi064.stdout:0/664: fsync dd/d21/f3a 0 2024-04-26T21:08:12.391 INFO:tasks.workunit.client.0.smithi055.stdout:3/594: truncate d0/d4/d5/d73/d47/d37/dbd/fbe 1558073 0 2024-04-26T21:08:12.395 INFO:tasks.workunit.client.1.smithi064.stdout:2/758: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/l3c d12/d41/d61/d6c/l103 0 2024-04-26T21:08:12.395 INFO:tasks.workunit.client.1.smithi064.stdout:2/759: stat d12/d41/d73/d83/fa6 0 2024-04-26T21:08:12.395 INFO:tasks.workunit.client.1.smithi064.stdout:2/760: creat d12/da9/f104 x:0 0 0 2024-04-26T21:08:12.397 INFO:tasks.workunit.client.0.smithi055.stdout:6/485: dwrite d3/d17/d46/d54/d66/d6a/fab [0,4194304] 0 2024-04-26T21:08:12.399 INFO:tasks.workunit.client.0.smithi055.stdout:4/376: dwrite d4/d12/d15/f6f [0,4194304] 0 2024-04-26T21:08:12.400 INFO:tasks.workunit.client.1.smithi064.stdout:2/761: dread d12/da9/ff0 [4194304,4194304] 0 2024-04-26T21:08:12.400 INFO:tasks.workunit.client.0.smithi055.stdout:8/435: dread d3/f14 [0,4194304] 0 2024-04-26T21:08:12.405 INFO:tasks.workunit.client.0.smithi055.stdout:2/543: getdents d4/db 0 2024-04-26T21:08:12.405 INFO:tasks.workunit.client.0.smithi055.stdout:2/544: truncate d4/d14/d33/f42 274169 0 2024-04-26T21:08:12.407 INFO:tasks.workunit.client.1.smithi064.stdout:2/762: dread d12/d41/d73/d83/d94/d3a/d46/f80 [0,4194304] 0 2024-04-26T21:08:12.407 INFO:tasks.workunit.client.0.smithi055.stdout:8/436: write d3/d9/d1f/f32 [950835,34865] 0 2024-04-26T21:08:12.413 INFO:tasks.workunit.client.0.smithi055.stdout:1/462: dwrite d8/d17/d1b/d7b/d8d/f88 [0,4194304] 0 2024-04-26T21:08:12.413 INFO:tasks.workunit.client.1.smithi064.stdout:6/667: dwrite d4/d7/d33/f50 [0,4194304] 0 2024-04-26T21:08:12.414 INFO:tasks.workunit.client.1.smithi064.stdout:6/668: stat d4/d7/d12/d49/d4b/d5a/la2 0 2024-04-26T21:08:12.416 INFO:tasks.workunit.client.0.smithi055.stdout:0/543: symlink d9/d11/d5b/d5e/d67/lac 0 2024-04-26T21:08:12.418 INFO:tasks.workunit.client.0.smithi055.stdout:4/377: dread d4/d23/f3b [0,4194304] 0 2024-04-26T21:08:12.419 INFO:tasks.workunit.client.0.smithi055.stdout:5/380: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87 0 2024-04-26T21:08:12.422 INFO:tasks.workunit.client.0.smithi055.stdout:8/437: dread d3/d9/d1d/d48/d4b/f6b [0,4194304] 0 2024-04-26T21:08:12.423 INFO:tasks.workunit.client.1.smithi064.stdout:5/646: rename dd/d12/lc3 to dd/da9/d48/d6a/d81/ld3 0 2024-04-26T21:08:12.424 INFO:tasks.workunit.client.1.smithi064.stdout:3/633: dwrite d1/d27/d29/d6f/d72/da5/d7d/fad [0,4194304] 0 2024-04-26T21:08:12.424 INFO:tasks.workunit.client.0.smithi055.stdout:9/531: dwrite d2/d11/f26 [0,4194304] 0 2024-04-26T21:08:12.424 INFO:tasks.workunit.client.0.smithi055.stdout:9/532: dread - d2/d14/f80 zero size 2024-04-26T21:08:12.425 INFO:tasks.workunit.client.1.smithi064.stdout:1/826: dwrite d0/d6/d91/ff8 [0,4194304] 0 2024-04-26T21:08:12.425 INFO:tasks.workunit.client.1.smithi064.stdout:1/827: write d0/d6/d11/d1e/d2a/d34/f79 [4413616,25754] 0 2024-04-26T21:08:12.426 INFO:tasks.workunit.client.0.smithi055.stdout:6/486: rename d3/d17/d25/d5f/d90/la3 to d3/d17/d25/d5f/d90/lad 0 2024-04-26T21:08:12.427 INFO:tasks.workunit.client.1.smithi064.stdout:9/671: creat d0/d4/da/d26/d47/fd6 x:0 0 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/672: chown d0/d4/da/d26/d45/la2 715842812 1 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/673: stat d0/d4/da/d67/dd0/dd2/f99 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/674: truncate d0/d4/da/d26/d47/fd6 353219 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/675: creat d0/d4/da/d26/d45/d90/fd7 x:0 0 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/676: readlink d0/d4/da/d67/ld4 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/677: fdatasync d0/d39/f5c 0 2024-04-26T21:08:12.428 INFO:tasks.workunit.client.1.smithi064.stdout:9/678: stat d0/d4/d7/f9 0 2024-04-26T21:08:12.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/694: mknod d6/d9/d3d/cf5 0 2024-04-26T21:08:12.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/695: chown d6/d9/f11 8 1 2024-04-26T21:08:12.434 INFO:tasks.workunit.client.1.smithi064.stdout:7/696: write d6/d9/f36 [495162,108535] 0 2024-04-26T21:08:12.437 INFO:tasks.workunit.client.1.smithi064.stdout:8/594: creat d10/d41/d44/d7d/fbd x:0 0 0 2024-04-26T21:08:12.437 INFO:tasks.workunit.client.1.smithi064.stdout:8/595: dread - d10/d41/d44/d5a/f62 zero size 2024-04-26T21:08:12.437 INFO:tasks.workunit.client.1.smithi064.stdout:0/665: link dd/d10/d74/d1d/f38 dd/d10/d74/d4f/fdd 0 2024-04-26T21:08:12.439 INFO:tasks.workunit.client.1.smithi064.stdout:2/763: rmdir d12/d41/d73/d83/d94/d3a/d46/d6a 39 2024-04-26T21:08:12.441 INFO:tasks.workunit.client.1.smithi064.stdout:5/647: write dd/f13 [3391642,23976] 0 2024-04-26T21:08:12.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/634: dread d1/d27/d29/d6f/d72/f2e [4194304,4194304] 0 2024-04-26T21:08:12.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/635: fsync d1/d14/f1c 0 2024-04-26T21:08:12.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/636: chown d1/d27/d50/f74 2643 1 2024-04-26T21:08:12.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/637: fsync d1/d27/d50/d35/d4c/f83 0 2024-04-26T21:08:12.444 INFO:tasks.workunit.client.1.smithi064.stdout:6/669: rename d4/d7/d33/c57 to d4/d7/d12/d49/d4b/dc9/cd8 0 2024-04-26T21:08:12.444 INFO:tasks.workunit.client.1.smithi064.stdout:7/697: dread d6/db/d8e/d90/fc3 [0,4194304] 0 2024-04-26T21:08:12.449 INFO:tasks.workunit.client.1.smithi064.stdout:1/828: creat d0/d6/de0/ffc x:0 0 0 2024-04-26T21:08:12.449 INFO:tasks.workunit.client.1.smithi064.stdout:1/829: readlink d0/d6/d11/l5a 0 2024-04-26T21:08:12.449 INFO:tasks.workunit.client.1.smithi064.stdout:1/830: creat d0/d6/d11/d2c/d9c/ffd x:0 0 0 2024-04-26T21:08:12.449 INFO:tasks.workunit.client.1.smithi064.stdout:1/831: readlink d0/l24 0 2024-04-26T21:08:12.449 INFO:tasks.workunit.client.1.smithi064.stdout:1/832: chown d0/d6/d11/d1e/d2a/d72/f84 69717409 1 2024-04-26T21:08:12.451 INFO:tasks.workunit.client.0.smithi055.stdout:6/487: dread d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:12.456 INFO:tasks.workunit.client.1.smithi064.stdout:9/679: truncate d0/d4/d7/fd 8075921 0 2024-04-26T21:08:12.456 INFO:tasks.workunit.client.1.smithi064.stdout:9/680: write d0/d4/da/f14 [1220172,103135] 0 2024-04-26T21:08:12.456 INFO:tasks.workunit.client.1.smithi064.stdout:0/666: dread dd/d21/dc8/d31/d5c/f6f [0,4194304] 0 2024-04-26T21:08:12.456 INFO:tasks.workunit.client.1.smithi064.stdout:0/667: creat dd/d10/d18/d58/fde x:0 0 0 2024-04-26T21:08:12.461 INFO:tasks.workunit.client.1.smithi064.stdout:3/638: mkdir d1/d27/d29/d6f/d72/d95/dd9 0 2024-04-26T21:08:12.462 INFO:tasks.workunit.client.0.smithi055.stdout:1/463: mkdir d8/d94/d9b 0 2024-04-26T21:08:12.465 INFO:tasks.workunit.client.1.smithi064.stdout:8/596: rename d10/f12 to d10/d41/d4e/d54/fbe 0 2024-04-26T21:08:12.470 INFO:tasks.workunit.client.1.smithi064.stdout:6/670: link d4/d7/d12/d49/d4b/d5a/d79/fb1 d4/d7/d12/fd9 0 2024-04-26T21:08:12.471 INFO:tasks.workunit.client.1.smithi064.stdout:7/698: dread d6/db/d34/dc7/fe9 [0,4194304] 0 2024-04-26T21:08:12.471 INFO:tasks.workunit.client.1.smithi064.stdout:2/764: dread d12/d41/d73/d83/f8d [0,4194304] 0 2024-04-26T21:08:12.475 INFO:tasks.workunit.client.1.smithi064.stdout:9/681: mkdir d0/d4/da/d26/d5e/dd8 0 2024-04-26T21:08:12.476 INFO:tasks.workunit.client.0.smithi055.stdout:4/378: mknod d4/d18/d1a/d49/c85 0 2024-04-26T21:08:12.476 INFO:tasks.workunit.client.0.smithi055.stdout:4/379: read d4/d12/d17/f19 [129650,97778] 0 2024-04-26T21:08:12.484 INFO:tasks.workunit.client.0.smithi055.stdout:5/381: mknod d4/df/d13/d26/c88 0 2024-04-26T21:08:12.486 INFO:tasks.workunit.client.1.smithi064.stdout:4/766: sync 2024-04-26T21:08:12.486 INFO:tasks.workunit.client.1.smithi064.stdout:4/767: creat d0/d5/d13/d6d/f101 x:0 0 0 2024-04-26T21:08:12.488 INFO:tasks.workunit.client.1.smithi064.stdout:0/668: chown dd/d21/f36 280 1 2024-04-26T21:08:12.489 INFO:tasks.workunit.client.0.smithi055.stdout:8/438: creat d3/d9/d44/f98 x:0 0 0 2024-04-26T21:08:12.491 INFO:tasks.workunit.client.0.smithi055.stdout:9/533: symlink d2/d46/d77/d7d/lac 0 2024-04-26T21:08:12.492 INFO:tasks.workunit.client.1.smithi064.stdout:6/671: mknod d4/d7/d12/d49/d4b/cda 0 2024-04-26T21:08:12.495 INFO:tasks.workunit.client.1.smithi064.stdout:2/765: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/l105 0 2024-04-26T21:08:12.495 INFO:tasks.workunit.client.1.smithi064.stdout:2/766: read - d12/d45/fc5 zero size 2024-04-26T21:08:12.495 INFO:tasks.workunit.client.1.smithi064.stdout:2/767: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f106 x:0 0 0 2024-04-26T21:08:12.497 INFO:tasks.workunit.client.0.smithi055.stdout:0/544: dread d9/dc/d1c/f26 [0,4194304] 0 2024-04-26T21:08:12.501 INFO:tasks.workunit.client.0.smithi055.stdout:2/545: rmdir d4/d49 39 2024-04-26T21:08:12.512 INFO:tasks.workunit.client.0.smithi055.stdout:6/488: mknod d3/d17/d46/d54/d66/d6a/d51/d58/cae 0 2024-04-26T21:08:12.512 INFO:tasks.workunit.client.1.smithi064.stdout:9/682: dread d0/d4/d7/df/fac [0,4194304] 0 2024-04-26T21:08:12.515 INFO:tasks.workunit.client.0.smithi055.stdout:4/380: rename d4/d18/d1a/d49/d7c to d4/d18/d86 0 2024-04-26T21:08:12.516 INFO:tasks.workunit.client.0.smithi055.stdout:4/381: chown d4/d12/d17/f7e 122107 1 2024-04-26T21:08:12.520 INFO:tasks.workunit.client.1.smithi064.stdout:5/648: dwrite dd/d12/d18/d25/d67/f94 [0,4194304] 0 2024-04-26T21:08:12.522 INFO:tasks.workunit.client.0.smithi055.stdout:5/382: link d4/df/d13/d26/f31 d4/d15/f89 0 2024-04-26T21:08:12.523 INFO:tasks.workunit.client.0.smithi055.stdout:9/534: creat d2/d46/d9a/fad x:0 0 0 2024-04-26T21:08:12.524 INFO:tasks.workunit.client.0.smithi055.stdout:0/545: truncate d9/dc/d1c/d3e/fa2 1544792 0 2024-04-26T21:08:12.524 INFO:tasks.workunit.client.0.smithi055.stdout:0/546: chown d9/dc/d17/f79 1023772 1 2024-04-26T21:08:12.524 INFO:tasks.workunit.client.0.smithi055.stdout:0/547: fsync d9/dc/d19/fa5 0 2024-04-26T21:08:12.525 INFO:tasks.workunit.client.1.smithi064.stdout:4/768: write d0/d1d/f2e [748930,119122] 0 2024-04-26T21:08:12.525 INFO:tasks.workunit.client.1.smithi064.stdout:4/769: fdatasync d0/d5/d13/d33/dd0/ff4 0 2024-04-26T21:08:12.530 INFO:tasks.workunit.client.0.smithi055.stdout:4/382: mknod d4/d26/d42/c87 0 2024-04-26T21:08:12.535 INFO:tasks.workunit.client.1.smithi064.stdout:3/639: dwrite d1/d38/fa7 [0,4194304] 0 2024-04-26T21:08:12.535 INFO:tasks.workunit.client.1.smithi064.stdout:3/640: getdents d1/d27/d50/d35/db9 0 2024-04-26T21:08:12.535 INFO:tasks.workunit.client.1.smithi064.stdout:3/641: fsync d1/d27/d29/d6f/d72/d73/f7f 0 2024-04-26T21:08:12.535 INFO:tasks.workunit.client.1.smithi064.stdout:3/642: truncate d1/d27/d50/d35/fc4 4779126 0 2024-04-26T21:08:12.535 INFO:tasks.workunit.client.1.smithi064.stdout:3/643: fsync d1/d27/d29/d6f/d72/d73/f90 0 2024-04-26T21:08:12.539 INFO:tasks.workunit.client.1.smithi064.stdout:7/699: dread d6/d8c/f9c [0,4194304] 0 2024-04-26T21:08:12.542 INFO:tasks.workunit.client.0.smithi055.stdout:9/535: mknod d2/d46/d51/cae 0 2024-04-26T21:08:12.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/546: dread d4/d14/d17/d36/f4e [0,4194304] 0 2024-04-26T21:08:12.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/547: chown d4/dc/f71 8 1 2024-04-26T21:08:12.545 INFO:tasks.workunit.client.1.smithi064.stdout:9/683: unlink d0/d4/d7/f2e 0 2024-04-26T21:08:12.546 INFO:tasks.workunit.client.1.smithi064.stdout:8/597: dwrite d10/d41/d4e/d60/f8c [0,4194304] 0 2024-04-26T21:08:12.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/598: fsync d10/d41/f77 0 2024-04-26T21:08:12.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/599: creat d10/d2f/d90/fbf x:0 0 0 2024-04-26T21:08:12.560 INFO:tasks.workunit.client.1.smithi064.stdout:6/672: unlink d4/d7/d12/d49/d4b/dc9/cd8 0 2024-04-26T21:08:12.561 INFO:tasks.workunit.client.0.smithi055.stdout:8/439: dwrite d3/f47 [0,4194304] 0 2024-04-26T21:08:12.561 INFO:tasks.workunit.client.0.smithi055.stdout:6/489: dread d3/d17/d46/d54/d66/d6a/fab [0,4194304] 0 2024-04-26T21:08:12.561 INFO:tasks.workunit.client.0.smithi055.stdout:6/490: write d3/d17/f18 [1168257,30383] 0 2024-04-26T21:08:12.563 INFO:tasks.workunit.client.1.smithi064.stdout:4/770: chown d0/d5/d79/f8c 5949600 1 2024-04-26T21:08:12.563 INFO:tasks.workunit.client.1.smithi064.stdout:4/771: truncate d0/d1d/ff7 793552 0 2024-04-26T21:08:12.564 INFO:tasks.workunit.client.1.smithi064.stdout:0/669: dwrite dd/d21/dc8/d31/d47/dad/dce/fd2 [0,4194304] 0 2024-04-26T21:08:12.564 INFO:tasks.workunit.client.1.smithi064.stdout:0/670: chown dd/d10/d18/cbc 1 1 2024-04-26T21:08:12.567 INFO:tasks.workunit.client.0.smithi055.stdout:4/383: write d4/f30 [2519848,1874] 0 2024-04-26T21:08:12.567 INFO:tasks.workunit.client.0.smithi055.stdout:4/384: chown d4/d18/c60 6 1 2024-04-26T21:08:12.571 INFO:tasks.workunit.client.0.smithi055.stdout:2/548: write d4/db/d1f/d46/f64 [510706,23599] 0 2024-04-26T21:08:12.573 INFO:tasks.workunit.client.1.smithi064.stdout:2/768: dwrite d12/d41/d73/d83/d94/d3a/d46/f80 [0,4194304] 0 2024-04-26T21:08:12.573 INFO:tasks.workunit.client.1.smithi064.stdout:2/769: chown d12/d41/d73/d83/d94/d3a/d46/d6a/f7e 15320 1 2024-04-26T21:08:12.573 INFO:tasks.workunit.client.1.smithi064.stdout:2/770: fsync d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc 0 2024-04-26T21:08:12.575 INFO:tasks.workunit.client.1.smithi064.stdout:3/644: unlink d1/d38/f9c 0 2024-04-26T21:08:12.576 INFO:tasks.workunit.client.0.smithi055.stdout:9/536: dread d2/f1a [0,4194304] 0 2024-04-26T21:08:12.577 INFO:tasks.workunit.client.0.smithi055.stdout:9/537: write d2/d46/d77/d5f/f8a [452314,28653] 0 2024-04-26T21:08:12.577 INFO:tasks.workunit.client.0.smithi055.stdout:6/491: mkdir d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/daf 0 2024-04-26T21:08:12.581 INFO:tasks.workunit.client.1.smithi064.stdout:9/684: chown d0/d4/da/d26/f23 32 1 2024-04-26T21:08:12.586 INFO:tasks.workunit.client.0.smithi055.stdout:2/549: unlink d4/d14/f20 0 2024-04-26T21:08:12.587 INFO:tasks.workunit.client.0.smithi055.stdout:8/440: read d3/d9/d5b/f79 [3416493,93588] 0 2024-04-26T21:08:12.593 INFO:tasks.workunit.client.0.smithi055.stdout:6/492: creat d3/d17/d25/d5f/d90/fb0 x:0 0 0 2024-04-26T21:08:12.593 INFO:tasks.workunit.client.0.smithi055.stdout:5/383: dwrite d4/d15/f52 [4194304,4194304] 0 2024-04-26T21:08:12.600 INFO:tasks.workunit.client.1.smithi064.stdout:3/645: dread d1/d14/f31 [0,4194304] 0 2024-04-26T21:08:12.602 INFO:tasks.workunit.client.1.smithi064.stdout:8/600: rmdir d10/d41/d4e/d59 39 2024-04-26T21:08:12.605 INFO:tasks.workunit.client.1.smithi064.stdout:5/649: getdents dd/da9/d48/d56 0 2024-04-26T21:08:12.605 INFO:tasks.workunit.client.1.smithi064.stdout:5/650: chown dd/d12/d4f/da5/fa7 1647939 1 2024-04-26T21:08:12.605 INFO:tasks.workunit.client.1.smithi064.stdout:5/651: write dd/d12/d18/d25/d74/fbb [1291996,85201] 0 2024-04-26T21:08:12.610 INFO:tasks.workunit.client.1.smithi064.stdout:6/673: creat d4/d7/d12/d49/d4b/d5a/fdb x:0 0 0 2024-04-26T21:08:12.610 INFO:tasks.workunit.client.1.smithi064.stdout:6/674: chown d4/l4c 268321 1 2024-04-26T21:08:12.614 INFO:tasks.workunit.client.0.smithi055.stdout:9/538: dread d2/f1c [0,4194304] 0 2024-04-26T21:08:12.615 INFO:tasks.workunit.client.0.smithi055.stdout:5/384: unlink d4/d15/c50 0 2024-04-26T21:08:12.615 INFO:tasks.workunit.client.0.smithi055.stdout:5/385: fsync f2 0 2024-04-26T21:08:12.616 INFO:tasks.workunit.client.1.smithi064.stdout:4/772: creat d0/d5/d13/d6d/d97/f102 x:0 0 0 2024-04-26T21:08:12.616 INFO:tasks.workunit.client.1.smithi064.stdout:9/685: dread d0/d4/da/d26/d47/f73 [0,4194304] 0 2024-04-26T21:08:12.618 INFO:tasks.workunit.client.1.smithi064.stdout:0/671: mkdir dd/d21/dc8/ddf 0 2024-04-26T21:08:12.618 INFO:tasks.workunit.client.1.smithi064.stdout:0/672: creat dd/d10/d74/fe0 x:0 0 0 2024-04-26T21:08:12.620 INFO:tasks.workunit.client.0.smithi055.stdout:9/539: rename d2/d14/l2a to d2/d46/d77/laf 0 2024-04-26T21:08:12.621 INFO:tasks.workunit.client.0.smithi055.stdout:4/385: dwrite d4/f21 [4194304,4194304] 0 2024-04-26T21:08:12.622 INFO:tasks.workunit.client.0.smithi055.stdout:0/548: dwrite d9/dc/f8f [0,4194304] 0 2024-04-26T21:08:12.625 INFO:tasks.workunit.client.0.smithi055.stdout:5/386: unlink d4/df/d13/f25 0 2024-04-26T21:08:12.625 INFO:tasks.workunit.client.0.smithi055.stdout:9/540: rename d2/d11/c4e to d2/d11/cb0 0 2024-04-26T21:08:12.625 INFO:tasks.workunit.client.0.smithi055.stdout:5/387: creat d4/df/d13/d26/d3c/d4a/f8a x:0 0 0 2024-04-26T21:08:12.626 INFO:tasks.workunit.client.1.smithi064.stdout:2/771: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc d12/d41/d73/d83/d94/d3a/d46/d91/d92/f107 0 2024-04-26T21:08:12.626 INFO:tasks.workunit.client.1.smithi064.stdout:8/601: symlink d10/d41/d53/lc0 0 2024-04-26T21:08:12.629 INFO:tasks.workunit.client.1.smithi064.stdout:7/700: dwrite d6/db/fbc [0,4194304] 0 2024-04-26T21:08:12.629 INFO:tasks.workunit.client.1.smithi064.stdout:7/701: fdatasync d6/f24 0 2024-04-26T21:08:12.629 INFO:tasks.workunit.client.1.smithi064.stdout:7/702: write d6/db/d34/f5b [4639245,61159] 0 2024-04-26T21:08:12.629 INFO:tasks.workunit.client.1.smithi064.stdout:7/703: fdatasync d6/db/f2d 0 2024-04-26T21:08:12.629 INFO:tasks.workunit.client.1.smithi064.stdout:7/704: getdents d6/d70/da8/dd1 0 2024-04-26T21:08:12.630 INFO:tasks.workunit.client.1.smithi064.stdout:5/652: mknod dd/d12/d4f/d9c/cd4 0 2024-04-26T21:08:12.630 INFO:tasks.workunit.client.0.smithi055.stdout:4/386: creat d4/d26/d42/d28/d53/d71/d7f/f88 x:0 0 0 2024-04-26T21:08:12.630 INFO:tasks.workunit.client.0.smithi055.stdout:4/387: dread - d4/d26/d42/d28/d53/d71/f73 zero size 2024-04-26T21:08:12.630 INFO:tasks.workunit.client.0.smithi055.stdout:4/388: creat d4/d18/f89 x:0 0 0 2024-04-26T21:08:12.637 INFO:tasks.workunit.client.1.smithi064.stdout:6/675: creat d4/d7/d33/fdc x:0 0 0 2024-04-26T21:08:12.638 INFO:tasks.workunit.client.1.smithi064.stdout:6/676: creat d4/d7/d33/fdd x:0 0 0 2024-04-26T21:08:12.642 INFO:tasks.workunit.client.1.smithi064.stdout:9/686: rename d0/d4/da/c6a to d0/d4/da/d31/cd9 0 2024-04-26T21:08:12.643 INFO:tasks.workunit.client.0.smithi055.stdout:0/549: creat d9/dc/d17/d9a/fad x:0 0 0 2024-04-26T21:08:12.643 INFO:tasks.workunit.client.0.smithi055.stdout:0/550: creat d9/dc/d1c/d3e/fae x:0 0 0 2024-04-26T21:08:12.649 INFO:tasks.workunit.client.0.smithi055.stdout:9/541: unlink d2/f10 0 2024-04-26T21:08:12.649 INFO:tasks.workunit.client.0.smithi055.stdout:9/542: readlink d2/d11/l31 0 2024-04-26T21:08:12.657 INFO:tasks.workunit.client.1.smithi064.stdout:2/772: write d12/da9/fe2 [2445247,46814] 0 2024-04-26T21:08:12.669 INFO:tasks.workunit.client.0.smithi055.stdout:0/551: mkdir d9/d27/daf 0 2024-04-26T21:08:12.671 INFO:tasks.workunit.client.1.smithi064.stdout:3/646: dwrite d1/d14/f3e [0,4194304] 0 2024-04-26T21:08:12.675 INFO:tasks.workunit.client.0.smithi055.stdout:9/543: rename d2/d11/l2e to d2/lb1 0 2024-04-26T21:08:12.677 INFO:tasks.workunit.client.1.smithi064.stdout:8/602: rmdir d10/d41/d4e/d59 39 2024-04-26T21:08:12.680 INFO:tasks.workunit.client.0.smithi055.stdout:0/552: read d9/dc/d1c/d3b/f6e [147952,8034] 0 2024-04-26T21:08:12.680 INFO:tasks.workunit.client.0.smithi055.stdout:0/553: creat d9/dc/d17/d9a/fb0 x:0 0 0 2024-04-26T21:08:12.680 INFO:tasks.workunit.client.1.smithi064.stdout:7/705: unlink d6/d15/d1c/d45/f47 0 2024-04-26T21:08:12.684 INFO:tasks.workunit.client.0.smithi055.stdout:5/388: truncate d4/f8 1946505 0 2024-04-26T21:08:12.684 INFO:tasks.workunit.client.0.smithi055.stdout:2/550: dwrite d4/db/d56/d4a/d7e/f91 [0,4194304] 0 2024-04-26T21:08:12.684 INFO:tasks.workunit.client.0.smithi055.stdout:2/551: fdatasync d4/d55/d6c/fa0 0 2024-04-26T21:08:12.684 INFO:tasks.workunit.client.0.smithi055.stdout:2/552: write d4/d14/d17/fab [738974,11863] 0 2024-04-26T21:08:12.684 INFO:tasks.workunit.client.1.smithi064.stdout:5/653: mknod dd/da9/d48/d6a/cd5 0 2024-04-26T21:08:12.692 INFO:tasks.workunit.client.0.smithi055.stdout:9/544: rename d2/f5e to d2/d46/d51/fb2 0 2024-04-26T21:08:12.698 INFO:tasks.workunit.client.0.smithi055.stdout:6/493: dwrite d3/d17/d19/f1e [0,4194304] 0 2024-04-26T21:08:12.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/687: link d0/d4/d7/df/fa0 d0/d4/da/fda 0 2024-04-26T21:08:12.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/688: write d0/d4/da/d26/d45/d90/fd7 [66451,96138] 0 2024-04-26T21:08:12.703 INFO:tasks.workunit.client.1.smithi064.stdout:2/773: mknod d12/d41/d61/d6c/c108 0 2024-04-26T21:08:12.704 INFO:tasks.workunit.client.1.smithi064.stdout:4/773: dwrite d0/d5/d13/f60 [0,4194304] 0 2024-04-26T21:08:12.710 INFO:tasks.workunit.client.1.smithi064.stdout:8/603: write d10/d41/d44/f51 [2564203,84733] 0 2024-04-26T21:08:12.711 INFO:tasks.workunit.client.1.smithi064.stdout:6/677: dwrite d4/d7/d12/d49/d4b/fb8 [0,4194304] 0 2024-04-26T21:08:12.715 INFO:tasks.workunit.client.0.smithi055.stdout:2/553: mkdir d4/dc/db6 0 2024-04-26T21:08:12.716 INFO:tasks.workunit.client.1.smithi064.stdout:0/673: dwrite dd/d21/dc8/d31/d47/f66 [0,4194304] 0 2024-04-26T21:08:12.717 INFO:tasks.workunit.client.1.smithi064.stdout:5/654: symlink dd/d12/ld6 0 2024-04-26T21:08:12.717 INFO:tasks.workunit.client.1.smithi064.stdout:5/655: creat dd/da9/fd7 x:0 0 0 2024-04-26T21:08:12.719 INFO:tasks.workunit.client.0.smithi055.stdout:9/545: unlink d2/d11/f26 0 2024-04-26T21:08:12.725 INFO:tasks.workunit.client.1.smithi064.stdout:8/604: dread d10/d41/d4e/d59/f6e [0,4194304] 0 2024-04-26T21:08:12.725 INFO:tasks.workunit.client.1.smithi064.stdout:8/605: readlink d10/d41/d44/lb2 0 2024-04-26T21:08:12.726 INFO:tasks.workunit.client.1.smithi064.stdout:8/606: stat d10/d1d/d38/f98 0 2024-04-26T21:08:12.726 INFO:tasks.workunit.client.0.smithi055.stdout:4/389: dwrite d4/d18/f89 [0,4194304] 0 2024-04-26T21:08:12.729 INFO:tasks.workunit.client.0.smithi055.stdout:8/441: dwrite d3/d9/f3b [0,4194304] 0 2024-04-26T21:08:12.730 INFO:tasks.workunit.client.0.smithi055.stdout:6/494: unlink d3/d17/d25/c43 0 2024-04-26T21:08:12.730 INFO:tasks.workunit.client.0.smithi055.stdout:6/495: fdatasync d3/d17/d46/d54/d66/d6a/d51/f85 0 2024-04-26T21:08:12.732 INFO:tasks.workunit.client.1.smithi064.stdout:3/647: dwrite d1/d27/d29/d6f/d72/d7a/d99/fd0 [0,4194304] 0 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.1.smithi064.stdout:2/774: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/f109 x:0 0 0 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.1.smithi064.stdout:2/775: dread - d12/da9/f104 zero size 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.1.smithi064.stdout:2/776: truncate d12/da9/feb 1047333 0 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.1.smithi064.stdout:2/777: chown d12/d41/d73/d83/d94/d3a/d46/d91/lff 7 1 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.1.smithi064.stdout:2/778: rename d12/d41 to d12/d41/d73/d83/d94/d3a/d46/d91/d10a 22 2024-04-26T21:08:12.735 INFO:tasks.workunit.client.0.smithi055.stdout:2/554: unlink d4/db/d1f/d46/f75 0 2024-04-26T21:08:12.739 INFO:tasks.workunit.client.1.smithi064.stdout:4/774: symlink d0/d2f/d87/l103 0 2024-04-26T21:08:12.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/390: dread d4/d12/d15/f16 [0,4194304] 0 2024-04-26T21:08:12.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/391: dread - d4/d26/d42/d28/f5d zero size 2024-04-26T21:08:12.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/392: creat d4/d18/d1a/f8a x:0 0 0 2024-04-26T21:08:12.744 INFO:tasks.workunit.client.0.smithi055.stdout:9/546: read d2/d46/d77/f76 [1812648,78213] 0 2024-04-26T21:08:12.744 INFO:tasks.workunit.client.1.smithi064.stdout:7/706: dwrite d6/db/d1f/d50/f57 [0,4194304] 0 2024-04-26T21:08:12.745 INFO:tasks.workunit.client.1.smithi064.stdout:7/707: fdatasync d6/d9/f8d 0 2024-04-26T21:08:12.745 INFO:tasks.workunit.client.1.smithi064.stdout:6/678: creat d4/d7/d12/d49/fde x:0 0 0 2024-04-26T21:08:12.748 INFO:tasks.workunit.client.1.smithi064.stdout:0/674: creat dd/d10/fe1 x:0 0 0 2024-04-26T21:08:12.750 INFO:tasks.workunit.client.0.smithi055.stdout:0/554: rename d9/dc/d17/d9a/fb0 to d9/d11/d59/fb1 0 2024-04-26T21:08:12.757 INFO:tasks.workunit.client.0.smithi055.stdout:2/555: write d4/d49/f87 [978647,108699] 0 2024-04-26T21:08:12.757 INFO:tasks.workunit.client.0.smithi055.stdout:2/556: creat d4/db/d1f/d46/fb7 x:0 0 0 2024-04-26T21:08:12.758 INFO:tasks.workunit.client.1.smithi064.stdout:1/833: sync 2024-04-26T21:08:12.758 INFO:tasks.workunit.client.1.smithi064.stdout:1/834: chown d0/d6/d11/l6f 1144 1 2024-04-26T21:08:12.762 INFO:tasks.workunit.client.1.smithi064.stdout:3/648: creat d1/d27/d50/d35/d4c/d7b/d8e/fda x:0 0 0 2024-04-26T21:08:12.766 INFO:tasks.workunit.client.1.smithi064.stdout:5/656: dwrite dd/da9/d48/f4c [0,4194304] 0 2024-04-26T21:08:12.769 INFO:tasks.workunit.client.0.smithi055.stdout:0/555: dread d9/dc/d1c/f85 [0,4194304] 0 2024-04-26T21:08:12.770 INFO:tasks.workunit.client.1.smithi064.stdout:9/689: getdents d0/d4/da/d26/d47/d88 0 2024-04-26T21:08:12.770 INFO:tasks.workunit.client.1.smithi064.stdout:9/690: readlink d0/d4/da/d26/d47/d88/l95 0 2024-04-26T21:08:12.770 INFO:tasks.workunit.client.1.smithi064.stdout:2/779: rename d12/f34 to d12/d41/d73/d83/d94/d3a/d46/d6a/d86/f10b 0 2024-04-26T21:08:12.770 INFO:tasks.workunit.client.1.smithi064.stdout:2/780: write d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fcc [649487,29275] 0 2024-04-26T21:08:12.770 INFO:tasks.workunit.client.1.smithi064.stdout:6/679: dread d4/d7/f53 [0,4194304] 0 2024-04-26T21:08:12.771 INFO:tasks.workunit.client.1.smithi064.stdout:7/708: dread d6/d15/d67/f94 [0,4194304] 0 2024-04-26T21:08:12.774 INFO:tasks.workunit.client.1.smithi064.stdout:0/675: truncate dd/d21/f36 375001 0 2024-04-26T21:08:12.777 INFO:tasks.workunit.client.0.smithi055.stdout:8/442: mknod d3/d9/d1d/d48/d4b/d8b/c99 0 2024-04-26T21:08:12.777 INFO:tasks.workunit.client.0.smithi055.stdout:8/443: fsync d3/f18 0 2024-04-26T21:08:12.777 INFO:tasks.workunit.client.0.smithi055.stdout:8/444: fdatasync d3/d9/d5b/f79 0 2024-04-26T21:08:12.777 INFO:tasks.workunit.client.0.smithi055.stdout:8/445: write d3/d9/d44/f58 [739724,15632] 0 2024-04-26T21:08:12.777 INFO:tasks.workunit.client.1.smithi064.stdout:3/649: dread d1/d27/d50/fb [0,4194304] 0 2024-04-26T21:08:12.780 INFO:tasks.workunit.client.0.smithi055.stdout:6/496: creat d3/d17/d25/d5f/fb1 x:0 0 0 2024-04-26T21:08:12.780 INFO:tasks.workunit.client.1.smithi064.stdout:1/835: link d0/d6/d29/d31/f51 d0/d6/d11/ffe 0 2024-04-26T21:08:12.782 INFO:tasks.workunit.client.0.smithi055.stdout:2/557: write d4/d14/d33/f59 [4012930,59700] 0 2024-04-26T21:08:12.784 INFO:tasks.workunit.client.0.smithi055.stdout:0/556: dread d9/dc/d1c/d54/f4a [0,4194304] 0 2024-04-26T21:08:12.784 INFO:tasks.workunit.client.0.smithi055.stdout:0/557: write d9/fa1 [4878948,126556] 0 2024-04-26T21:08:12.786 INFO:tasks.workunit.client.0.smithi055.stdout:4/393: creat d4/d12/d57/f8b x:0 0 0 2024-04-26T21:08:12.789 INFO:tasks.workunit.client.0.smithi055.stdout:9/547: mknod d2/d14/cb3 0 2024-04-26T21:08:12.791 INFO:tasks.workunit.client.1.smithi064.stdout:5/657: symlink dd/dd0/ld8 0 2024-04-26T21:08:12.792 INFO:tasks.workunit.client.1.smithi064.stdout:2/781: mknod d12/d41/d73/d83/d94/c10c 0 2024-04-26T21:08:12.792 INFO:tasks.workunit.client.1.smithi064.stdout:4/775: getdents d0/d5/d13/d6d 0 2024-04-26T21:08:12.792 INFO:tasks.workunit.client.1.smithi064.stdout:4/776: write d0/d1d/d56/d89/dda/ffc [3628454,57813] 0 2024-04-26T21:08:12.792 INFO:tasks.workunit.client.1.smithi064.stdout:4/777: readlink d0/d2f/d7d/le5 0 2024-04-26T21:08:12.793 INFO:tasks.workunit.client.1.smithi064.stdout:3/650: write d1/d27/d29/d6f/d72/d7a/d99/fd0 [3584316,46828] 0 2024-04-26T21:08:12.793 INFO:tasks.workunit.client.0.smithi055.stdout:5/389: rename d4/df/d13/d26/c72 to d4/df/d13/d26/d3c/d4a/d3f/d2e/c8b 0 2024-04-26T21:08:12.793 INFO:tasks.workunit.client.0.smithi055.stdout:5/390: stat d4/df/d13/d26/d3c/d4a/d3f/d2e 0 2024-04-26T21:08:12.793 INFO:tasks.workunit.client.0.smithi055.stdout:5/391: read - d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f62 zero size 2024-04-26T21:08:12.794 INFO:tasks.workunit.client.1.smithi064.stdout:7/709: chown d6/d9/d3d/d43/c8b 1 1 2024-04-26T21:08:12.795 INFO:tasks.workunit.client.1.smithi064.stdout:7/710: write d6/db/d1f/fdf [122205,43570] 0 2024-04-26T21:08:12.800 INFO:tasks.workunit.client.1.smithi064.stdout:8/607: dwrite d10/d41/d4e/fbb [0,4194304] 0 2024-04-26T21:08:12.803 INFO:tasks.workunit.client.0.smithi055.stdout:8/446: mkdir d3/d7c/d9a 0 2024-04-26T21:08:12.804 INFO:tasks.workunit.client.0.smithi055.stdout:6/497: mknod d3/d9b/cb2 0 2024-04-26T21:08:12.806 INFO:tasks.workunit.client.1.smithi064.stdout:2/782: rmdir d12/d41/d73/d83/d94/d3a/d46/d91/def 39 2024-04-26T21:08:12.806 INFO:tasks.workunit.client.1.smithi064.stdout:2/783: fdatasync d12/d41/d61/d75/f42 0 2024-04-26T21:08:12.806 INFO:tasks.workunit.client.1.smithi064.stdout:2/784: dread - d12/d41/d73/d83/d94/f70 zero size 2024-04-26T21:08:12.813 INFO:tasks.workunit.client.1.smithi064.stdout:5/658: dread dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:12.813 INFO:tasks.workunit.client.1.smithi064.stdout:5/659: write dd/da9/d48/f7e [991802,62044] 0 2024-04-26T21:08:12.813 INFO:tasks.workunit.client.1.smithi064.stdout:9/691: dwrite d0/d4/da/faa [0,4194304] 0 2024-04-26T21:08:12.813 INFO:tasks.workunit.client.1.smithi064.stdout:9/692: stat d0/d4/da/d26/d45/d90 0 2024-04-26T21:08:12.814 INFO:tasks.workunit.client.1.smithi064.stdout:3/651: symlink d1/d27/d29/d6f/d72/d73/ldb 0 2024-04-26T21:08:12.815 INFO:tasks.workunit.client.0.smithi055.stdout:0/558: truncate d9/dc/d1c/f4f 169339 0 2024-04-26T21:08:12.816 INFO:tasks.workunit.client.1.smithi064.stdout:7/711: creat d6/db/d1f/ff6 x:0 0 0 2024-04-26T21:08:12.817 INFO:tasks.workunit.client.0.smithi055.stdout:4/394: rmdir d4/d18/d1a/d49 39 2024-04-26T21:08:12.817 INFO:tasks.workunit.client.0.smithi055.stdout:4/395: dread - d4/d18/f5c zero size 2024-04-26T21:08:12.817 INFO:tasks.workunit.client.0.smithi055.stdout:4/396: fsync d4/d18/d1a/f54 0 2024-04-26T21:08:12.818 INFO:tasks.workunit.client.0.smithi055.stdout:7/478: sync 2024-04-26T21:08:12.818 INFO:tasks.workunit.client.0.smithi055.stdout:3/595: sync 2024-04-26T21:08:12.818 INFO:tasks.workunit.client.0.smithi055.stdout:1/464: sync 2024-04-26T21:08:12.818 INFO:tasks.workunit.client.0.smithi055.stdout:3/596: fsync d0/d4/d5/f2c 0 2024-04-26T21:08:12.819 INFO:tasks.workunit.client.0.smithi055.stdout:9/548: rename d2/d14/l30 to d2/d46/lb4 0 2024-04-26T21:08:12.820 INFO:tasks.workunit.client.0.smithi055.stdout:2/558: dread d4/dc/f1d [0,4194304] 0 2024-04-26T21:08:12.821 INFO:tasks.workunit.client.0.smithi055.stdout:2/559: write d4/d49/d4c/f73 [896478,114499] 0 2024-04-26T21:08:12.821 INFO:tasks.workunit.client.0.smithi055.stdout:2/560: write d4/d14/d17/f2e [6753593,24953] 0 2024-04-26T21:08:12.825 INFO:tasks.workunit.client.0.smithi055.stdout:8/447: mkdir d3/d9/d1d/d48/d57/d61/d9b 0 2024-04-26T21:08:12.827 INFO:tasks.workunit.client.1.smithi064.stdout:8/608: creat d10/d1d/da3/fc1 x:0 0 0 2024-04-26T21:08:12.831 INFO:tasks.workunit.client.0.smithi055.stdout:6/498: mknod d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/cb3 0 2024-04-26T21:08:12.834 INFO:tasks.workunit.client.1.smithi064.stdout:2/785: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f10d x:0 0 0 2024-04-26T21:08:12.834 INFO:tasks.workunit.client.0.smithi055.stdout:0/559: mkdir d9/dc/d1c/d54/db2 0 2024-04-26T21:08:12.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/786: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f10d 620127 0 2024-04-26T21:08:12.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/787: chown d12/da9/ld1 14 1 2024-04-26T21:08:12.836 INFO:tasks.workunit.client.1.smithi064.stdout:2/788: write d12/da9/ff0 [1641581,62119] 0 2024-04-26T21:08:12.836 INFO:tasks.workunit.client.1.smithi064.stdout:2/789: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f10d 983177 0 2024-04-26T21:08:12.836 INFO:tasks.workunit.client.1.smithi064.stdout:4/778: symlink d0/d5/d79/da1/l104 0 2024-04-26T21:08:12.836 INFO:tasks.workunit.client.1.smithi064.stdout:4/779: creat d0/d1d/d17/d44/dac/d54/f105 x:0 0 0 2024-04-26T21:08:12.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/780: write d0/d5/d13/d33/f39 [4412458,73375] 0 2024-04-26T21:08:12.841 INFO:tasks.workunit.client.1.smithi064.stdout:5/660: symlink dd/d12/ld9 0 2024-04-26T21:08:12.841 INFO:tasks.workunit.client.1.smithi064.stdout:5/661: creat dd/fda x:0 0 0 2024-04-26T21:08:12.842 INFO:tasks.workunit.client.1.smithi064.stdout:5/662: readlink dd/d12/l45 0 2024-04-26T21:08:12.842 INFO:tasks.workunit.client.1.smithi064.stdout:5/663: fdatasync dd/d12/d18/d1a/d1b/f29 0 2024-04-26T21:08:12.842 INFO:tasks.workunit.client.1.smithi064.stdout:5/664: fdatasync dd/d12/d18/d1a/d1f/f5a 0 2024-04-26T21:08:12.843 INFO:tasks.workunit.client.0.smithi055.stdout:9/549: dread d2/f55 [0,4194304] 0 2024-04-26T21:08:12.843 INFO:tasks.workunit.client.0.smithi055.stdout:7/479: link d5/d6/d24/f30 d5/d53/f8a 0 2024-04-26T21:08:12.844 INFO:tasks.workunit.client.1.smithi064.stdout:9/693: mkdir d0/d4/d28/ddb 0 2024-04-26T21:08:12.844 INFO:tasks.workunit.client.1.smithi064.stdout:9/694: readlink d0/d4/d7/df/l66 0 2024-04-26T21:08:12.844 INFO:tasks.workunit.client.0.smithi055.stdout:0/560: dread d9/d11/d5b/d5e/f8e [0,4194304] 0 2024-04-26T21:08:12.846 INFO:tasks.workunit.client.0.smithi055.stdout:1/465: rename d8/d17/d1b/d7b/d8d/c4f to d8/d17/d1b/d41/c9c 0 2024-04-26T21:08:12.849 INFO:tasks.workunit.client.1.smithi064.stdout:0/676: dwrite dd/f85 [0,4194304] 0 2024-04-26T21:08:12.849 INFO:tasks.workunit.client.1.smithi064.stdout:3/652: creat d1/d27/d50/d35/d4c/d7b/fdc x:0 0 0 2024-04-26T21:08:12.850 INFO:tasks.workunit.client.0.smithi055.stdout:8/448: unlink d3/d9/fe 0 2024-04-26T21:08:12.850 INFO:tasks.workunit.client.0.smithi055.stdout:8/449: dread - d3/d9/d1f/d2e/d75/d76/f81 zero size 2024-04-26T21:08:12.853 INFO:tasks.workunit.client.1.smithi064.stdout:8/609: link d10/d41/d4e/d59/c97 d10/d41/d4e/d54/cc2 0 2024-04-26T21:08:12.858 INFO:tasks.workunit.client.0.smithi055.stdout:0/561: dread d9/dc/d1c/f85 [0,4194304] 0 2024-04-26T21:08:12.859 INFO:tasks.workunit.client.1.smithi064.stdout:4/781: rmdir d0/d1d/d17/d44 39 2024-04-26T21:08:12.859 INFO:tasks.workunit.client.1.smithi064.stdout:2/790: dread d12/d41/d61/faf [0,4194304] 0 2024-04-26T21:08:12.863 INFO:tasks.workunit.client.0.smithi055.stdout:5/392: truncate d4/df/d13/d26/d3c/d4a/d3f/d4f/f77 1739321 0 2024-04-26T21:08:12.866 INFO:tasks.workunit.client.1.smithi064.stdout:7/712: dwrite d6/db/d1f/d50/f57 [0,4194304] 0 2024-04-26T21:08:12.866 INFO:tasks.workunit.client.1.smithi064.stdout:7/713: chown d6/db/d1f/d50/l61 12991 1 2024-04-26T21:08:12.866 INFO:tasks.workunit.client.1.smithi064.stdout:7/714: truncate d6/d15/d88/dca/d5c/f7b 4460981 0 2024-04-26T21:08:12.867 INFO:tasks.workunit.client.0.smithi055.stdout:4/397: getdents d4/d12 0 2024-04-26T21:08:12.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/398: readlink d4/d26/d42/l5b 0 2024-04-26T21:08:12.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/399: fdatasync d4/d26/d42/d2d/f41 0 2024-04-26T21:08:12.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/400: readlink d4/d26/d42/d28/d53/l82 0 2024-04-26T21:08:12.870 INFO:tasks.workunit.client.1.smithi064.stdout:9/695: creat d0/da6/fdc x:0 0 0 2024-04-26T21:08:12.873 INFO:tasks.workunit.client.0.smithi055.stdout:9/550: creat d2/d46/d77/fb5 x:0 0 0 2024-04-26T21:08:12.873 INFO:tasks.workunit.client.0.smithi055.stdout:9/551: chown d2/d46/c91 113686 1 2024-04-26T21:08:12.875 INFO:tasks.workunit.client.1.smithi064.stdout:3/653: truncate d1/d27/d29/d6f/d72/d7a/d99/fd0 3392269 0 2024-04-26T21:08:12.878 INFO:tasks.workunit.client.1.smithi064.stdout:5/665: write fb [3223787,53652] 0 2024-04-26T21:08:12.878 INFO:tasks.workunit.client.1.smithi064.stdout:5/666: stat dd/d12/c17 0 2024-04-26T21:08:12.879 INFO:tasks.workunit.client.1.smithi064.stdout:5/667: read dd/d12/d18/d1a/d1f/f5a [292331,12916] 0 2024-04-26T21:08:12.882 INFO:tasks.workunit.client.0.smithi055.stdout:3/597: rename d0/d4/d5/d73/d13/d1a/c4e to d0/d4/d5/d73/d13/d1a/d46/d72/cd2 0 2024-04-26T21:08:12.882 INFO:tasks.workunit.client.1.smithi064.stdout:8/610: unlink d10/d2f/d90/fbf 0 2024-04-26T21:08:12.882 INFO:tasks.workunit.client.1.smithi064.stdout:8/611: truncate d10/d41/d4e/d54/f9f 194040 0 2024-04-26T21:08:12.885 INFO:tasks.workunit.client.0.smithi055.stdout:8/450: symlink d3/d89/l9c 0 2024-04-26T21:08:12.890 INFO:tasks.workunit.client.0.smithi055.stdout:5/393: creat d4/df/d13/d26/d3c/d5b/d83/f8c x:0 0 0 2024-04-26T21:08:12.891 INFO:tasks.workunit.client.0.smithi055.stdout:9/552: readlink d2/d46/d77/l4c 0 2024-04-26T21:08:12.895 INFO:tasks.workunit.client.0.smithi055.stdout:1/466: link d8/d17/d1b/d7b/d8d/l6f d8/df/d11/l9d 0 2024-04-26T21:08:12.897 INFO:tasks.workunit.client.0.smithi055.stdout:3/598: mkdir d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3 0 2024-04-26T21:08:12.898 INFO:tasks.workunit.client.0.smithi055.stdout:8/451: truncate d3/d9/d1f/f32 304541 0 2024-04-26T21:08:12.901 INFO:tasks.workunit.client.0.smithi055.stdout:5/394: rename d4/df/d13/d26/d3c/d4a/l59 to d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/l8d 0 2024-04-26T21:08:12.901 INFO:tasks.workunit.client.0.smithi055.stdout:5/395: creat d4/df/d13/d26/f8e x:0 0 0 2024-04-26T21:08:12.901 INFO:tasks.workunit.client.0.smithi055.stdout:5/396: dread - d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f61 zero size 2024-04-26T21:08:12.901 INFO:tasks.workunit.client.0.smithi055.stdout:5/397: creat d4/df/d13/d26/f8f x:0 0 0 2024-04-26T21:08:12.904 INFO:tasks.workunit.client.0.smithi055.stdout:1/467: mknod d8/df/d11/d27/d28/c9e 0 2024-04-26T21:08:12.905 INFO:tasks.workunit.client.0.smithi055.stdout:9/553: dread d2/d46/d51/f61 [0,4194304] 0 2024-04-26T21:08:12.906 INFO:tasks.workunit.client.0.smithi055.stdout:3/599: symlink d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/ld4 0 2024-04-26T21:08:12.907 INFO:tasks.workunit.client.0.smithi055.stdout:3/600: dread - d0/d4/d5/d73/d13/d1a/d46/d72/fd1 zero size 2024-04-26T21:08:12.907 INFO:tasks.workunit.client.0.smithi055.stdout:3/601: chown d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/la4 83911 1 2024-04-26T21:08:12.912 INFO:tasks.workunit.client.0.smithi055.stdout:7/480: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:08:12.919 INFO:tasks.workunit.client.1.smithi064.stdout:7/715: symlink d6/d9/d38/lf7 0 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:5/398: rmdir d4/df/d13/d26/d3c/d4a/d3f/d4f 39 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:1/468: dread d8/df/d11/d6c/f73 [0,4194304] 0 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:1/469: read - d8/d17/d36/f81 zero size 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:1/470: chown d8/f91 52956401 1 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:3/602: mkdir d0/d4/d5/d73/d13/d1a/d46/d72/dd5 0 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:4/401: dwrite d4/d12/d17/d3d/f68 [0,4194304] 0 2024-04-26T21:08:12.920 INFO:tasks.workunit.client.0.smithi055.stdout:4/402: creat d4/d12/d17/d3d/f8c x:0 0 0 2024-04-26T21:08:12.922 INFO:tasks.workunit.client.1.smithi064.stdout:5/668: dwrite dd/da9/d48/d6a/d9e/db9/fbc [0,4194304] 0 2024-04-26T21:08:12.922 INFO:tasks.workunit.client.1.smithi064.stdout:5/669: write dd/da9/d48/d6a/d81/fb8 [925150,48900] 0 2024-04-26T21:08:12.922 INFO:tasks.workunit.client.1.smithi064.stdout:5/670: write dd/d12/d18/d25/d74/fbb [1553776,11080] 0 2024-04-26T21:08:12.924 INFO:tasks.workunit.client.1.smithi064.stdout:9/696: symlink d0/d4/da/d26/d45/ldd 0 2024-04-26T21:08:12.924 INFO:tasks.workunit.client.1.smithi064.stdout:0/677: rename dd/d21/c33 to dd/d10/d74/ce2 0 2024-04-26T21:08:12.931 INFO:tasks.workunit.client.1.smithi064.stdout:3/654: link d1/d27/d29/d6f/d72/d7a/d84/lbc d1/d27/d50/d35/d4c/d7b/dcd/ldd 0 2024-04-26T21:08:12.932 INFO:tasks.workunit.client.1.smithi064.stdout:7/716: creat d6/d5a/d5f/ff8 x:0 0 0 2024-04-26T21:08:12.935 INFO:tasks.workunit.client.0.smithi055.stdout:5/399: dread d4/df/d13/d26/d3c/d5b/f70 [0,4194304] 0 2024-04-26T21:08:12.935 INFO:tasks.workunit.client.1.smithi064.stdout:9/697: creat d0/d4/da/d26/d47/d88/fde x:0 0 0 2024-04-26T21:08:12.937 INFO:tasks.workunit.client.1.smithi064.stdout:5/671: dread dd/d12/d18/d1a/d1f/d20/f46 [0,4194304] 0 2024-04-26T21:08:12.941 INFO:tasks.workunit.client.1.smithi064.stdout:2/791: rename d12/d41/d73/d83/d94/d3a/d46/l55 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/l10e 0 2024-04-26T21:08:12.943 INFO:tasks.workunit.client.1.smithi064.stdout:0/678: mknod dd/d10/d18/d58/dba/ce3 0 2024-04-26T21:08:12.944 INFO:tasks.workunit.client.0.smithi055.stdout:8/452: rmdir d3/d9 39 2024-04-26T21:08:12.944 INFO:tasks.workunit.client.0.smithi055.stdout:8/453: chown d3/d9/d1f/l5e 276803635 1 2024-04-26T21:08:12.946 INFO:tasks.workunit.client.0.smithi055.stdout:7/481: unlink d5/d6/d24/d48/l70 0 2024-04-26T21:08:12.947 INFO:tasks.workunit.client.1.smithi064.stdout:8/612: dwrite d10/d41/d4e/fbb [4194304,4194304] 0 2024-04-26T21:08:12.948 INFO:tasks.workunit.client.0.smithi055.stdout:9/554: getdents d2/d46/d77/d7d/da0 0 2024-04-26T21:08:12.948 INFO:tasks.workunit.client.1.smithi064.stdout:8/613: write d10/f94 [153707,127451] 0 2024-04-26T21:08:12.951 INFO:tasks.workunit.client.1.smithi064.stdout:9/698: symlink d0/da6/ldf 0 2024-04-26T21:08:12.952 INFO:tasks.workunit.client.1.smithi064.stdout:9/699: fsync d0/f8a 0 2024-04-26T21:08:12.952 INFO:tasks.workunit.client.1.smithi064.stdout:9/700: write d0/d4/da/d26/f6f [3843545,78057] 0 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/471: chown d8/cb 954 1 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/472: fdatasync d8/f35 0 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/473: creat d8/d17/d1b/f9f x:0 0 0 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/474: chown d8/cb 27 1 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/475: creat d8/d17/d1b/d7b/d65/fa0 x:0 0 0 2024-04-26T21:08:12.953 INFO:tasks.workunit.client.0.smithi055.stdout:1/476: fdatasync d8/df/d11/d27/f3a 0 2024-04-26T21:08:12.954 INFO:tasks.workunit.client.0.smithi055.stdout:1/477: readlink d8/lc 0 2024-04-26T21:08:12.957 INFO:tasks.workunit.client.1.smithi064.stdout:5/672: link dd/d12/ld6 dd/d12/d18/d1a/d1b/ldb 0 2024-04-26T21:08:12.958 INFO:tasks.workunit.client.0.smithi055.stdout:3/603: mknod d0/d4/d5/d73/d13/d1a/d46/d55/cd6 0 2024-04-26T21:08:12.961 INFO:tasks.workunit.client.1.smithi064.stdout:2/792: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/l10f 0 2024-04-26T21:08:12.961 INFO:tasks.workunit.client.1.smithi064.stdout:2/793: fsync d12/d41/d73/d83/d94/f3f 0 2024-04-26T21:08:12.964 INFO:tasks.workunit.client.1.smithi064.stdout:0/679: rename dd/d21/dc8/d31/l40 to dd/d21/dc8/d31/d5c/le4 0 2024-04-26T21:08:12.972 INFO:tasks.workunit.client.0.smithi055.stdout:4/403: creat d4/d18/d1a/d49/f8d x:0 0 0 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/614: mkdir d10/d41/d4e/d54/dc3 0 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:9/701: symlink d0/le0 0 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/615: read - d10/d2f/d61/fb6 zero size 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/616: fsync d10/d1d/f43 0 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/617: fsync d10/d41/d44/d5a/f62 0 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/618: chown d10/d1d/d38/f5b 3076193 1 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:8/619: dread - d10/d41/d44/d7d/fbd zero size 2024-04-26T21:08:12.974 INFO:tasks.workunit.client.1.smithi064.stdout:5/673: mknod dd/dd0/cdc 0 2024-04-26T21:08:12.975 INFO:tasks.workunit.client.0.smithi055.stdout:5/400: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90 0 2024-04-26T21:08:12.975 INFO:tasks.workunit.client.0.smithi055.stdout:5/401: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f91 x:0 0 0 2024-04-26T21:08:12.975 INFO:tasks.workunit.client.0.smithi055.stdout:5/402: fsync d4/df/f6b 0 2024-04-26T21:08:12.975 INFO:tasks.workunit.client.1.smithi064.stdout:2/794: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/l110 0 2024-04-26T21:08:12.976 INFO:tasks.workunit.client.1.smithi064.stdout:0/680: symlink dd/d21/dd9/le5 0 2024-04-26T21:08:12.976 INFO:tasks.workunit.client.1.smithi064.stdout:0/681: chown dd/d10/d74/d1d/f6d 13 1 2024-04-26T21:08:12.977 INFO:tasks.workunit.client.0.smithi055.stdout:9/555: mknod d2/d46/d77/d7d/da0/cb6 0 2024-04-26T21:08:12.978 INFO:tasks.workunit.client.1.smithi064.stdout:9/702: creat d0/d4/d28/fe1 x:0 0 0 2024-04-26T21:08:12.980 INFO:tasks.workunit.client.1.smithi064.stdout:8/620: rename d10/d2f/f8e to d10/d41/d4e/d60/fc4 0 2024-04-26T21:08:12.980 INFO:tasks.workunit.client.0.smithi055.stdout:1/478: mknod d8/df/d11/d27/ca1 0 2024-04-26T21:08:12.981 INFO:tasks.workunit.client.1.smithi064.stdout:0/682: mknod dd/d21/dd9/ce6 0 2024-04-26T21:08:12.981 INFO:tasks.workunit.client.1.smithi064.stdout:0/683: chown dd/d10/d18/d58/l60 8897599 1 2024-04-26T21:08:12.982 INFO:tasks.workunit.client.1.smithi064.stdout:0/684: fdatasync dd/d10/f9e 0 2024-04-26T21:08:12.983 INFO:tasks.workunit.client.0.smithi055.stdout:3/604: symlink d0/d4/d16/d18/d4b/ld7 0 2024-04-26T21:08:12.983 INFO:tasks.workunit.client.1.smithi064.stdout:2/795: dread d12/d41/d61/d6c/f9b [0,4194304] 0 2024-04-26T21:08:12.984 INFO:tasks.workunit.client.0.smithi055.stdout:1/479: write d8/d17/d33/f89 [473443,53689] 0 2024-04-26T21:08:12.984 INFO:tasks.workunit.client.1.smithi064.stdout:5/674: rename dd/d12/fa0 to dd/da9/d48/d56/daa/fdd 0 2024-04-26T21:08:12.984 INFO:tasks.workunit.client.1.smithi064.stdout:5/675: stat dd/d12/d18/f39 0 2024-04-26T21:08:12.984 INFO:tasks.workunit.client.1.smithi064.stdout:5/676: write dd/da9/d48/dac/da6/fcd [190884,93841] 0 2024-04-26T21:08:12.985 INFO:tasks.workunit.client.0.smithi055.stdout:4/404: mkdir d4/d18/d8e 0 2024-04-26T21:08:12.985 INFO:tasks.workunit.client.0.smithi055.stdout:4/405: readlink d4/l64 0 2024-04-26T21:08:12.985 INFO:tasks.workunit.client.1.smithi064.stdout:0/685: rmdir dd/d10/d74/d1d/db1 39 2024-04-26T21:08:12.987 INFO:tasks.workunit.client.0.smithi055.stdout:8/454: symlink d3/d9/l9d 0 2024-04-26T21:08:12.989 INFO:tasks.workunit.client.1.smithi064.stdout:9/703: rename d0/d4/d28/l50 to d0/d4/d28/ddb/le2 0 2024-04-26T21:08:12.989 INFO:tasks.workunit.client.0.smithi055.stdout:5/403: dread d4/df/d13/d26/f4e [0,4194304] 0 2024-04-26T21:08:12.991 INFO:tasks.workunit.client.0.smithi055.stdout:3/605: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3/fd8 x:0 0 0 2024-04-26T21:08:12.991 INFO:tasks.workunit.client.0.smithi055.stdout:4/406: creat d4/d26/d42/d28/d53/d70/f8f x:0 0 0 2024-04-26T21:08:12.993 INFO:tasks.workunit.client.0.smithi055.stdout:9/556: rename d2/d46/d77/d5f/f67 to d2/d46/d51/fb7 0 2024-04-26T21:08:12.994 INFO:tasks.workunit.client.0.smithi055.stdout:5/404: mkdir d4/df/d13/d26/d3c/d4a/d92 0 2024-04-26T21:08:12.996 INFO:tasks.workunit.client.1.smithi064.stdout:3/655: dwrite d1/d14/f31 [0,4194304] 0 2024-04-26T21:08:12.997 INFO:tasks.workunit.client.0.smithi055.stdout:3/606: mknod d0/d4/cd9 0 2024-04-26T21:08:12.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/607: stat d0/d4/d5/d73/d13/d1a/d46/d72/f60 0 2024-04-26T21:08:12.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/608: chown d0/d4/d5/d73/d13/d27/d50/cb6 61 1 2024-04-26T21:08:12.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/609: chown d0/d4/d5/d73/d13/d27/d50/fac 112646 1 2024-04-26T21:08:12.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/610: write d0/d4/d5/d73/f2e [887419,129660] 0 2024-04-26T21:08:12.999 INFO:tasks.workunit.client.0.smithi055.stdout:5/405: mkdir d4/df/d13/d26/d3c/d93 0 2024-04-26T21:08:13.001 INFO:tasks.workunit.client.1.smithi064.stdout:0/686: symlink dd/d21/dc8/le7 0 2024-04-26T21:08:13.001 INFO:tasks.workunit.client.1.smithi064.stdout:9/704: creat d0/d4/da/d26/d47/d9d/fe3 x:0 0 0 2024-04-26T21:08:13.002 INFO:tasks.workunit.client.1.smithi064.stdout:9/705: creat d0/d4/da/d31/d34/fe4 x:0 0 0 2024-04-26T21:08:13.002 INFO:tasks.workunit.client.1.smithi064.stdout:9/706: readlink d0/d4/da/d26/d47/l6c 0 2024-04-26T21:08:13.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/687: creat dd/d10/d18/d64/dda/fe8 x:0 0 0 2024-04-26T21:08:13.016 INFO:tasks.workunit.client.0.smithi055.stdout:9/557: dread d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:13.018 INFO:tasks.workunit.client.0.smithi055.stdout:9/558: mkdir d2/d14/db8 0 2024-04-26T21:08:13.018 INFO:tasks.workunit.client.0.smithi055.stdout:9/559: dread - d2/d14/f9f zero size 2024-04-26T21:08:13.033 INFO:tasks.workunit.client.1.smithi064.stdout:8/621: dread d10/d2f/f3a [0,4194304] 0 2024-04-26T21:08:13.057 INFO:tasks.workunit.client.1.smithi064.stdout:0/688: write dd/d21/dc8/d31/d47/f53 [1480118,79763] 0 2024-04-26T21:08:13.058 INFO:tasks.workunit.client.1.smithi064.stdout:0/689: symlink dd/d10/d18/d58/dba/le9 0 2024-04-26T21:08:13.066 INFO:tasks.workunit.client.1.smithi064.stdout:5/677: dwrite dd/da9/d48/d56/daa/fdd [0,4194304] 0 2024-04-26T21:08:13.070 INFO:tasks.workunit.client.1.smithi064.stdout:5/678: unlink dd/l4d 0 2024-04-26T21:08:13.070 INFO:tasks.workunit.client.1.smithi064.stdout:5/679: fsync dd/d12/d18/d1a/d1f/d20/f2d 0 2024-04-26T21:08:13.072 INFO:tasks.workunit.client.0.smithi055.stdout:4/407: dwrite d4/d23/f25 [0,4194304] 0 2024-04-26T21:08:13.085 INFO:tasks.workunit.client.1.smithi064.stdout:8/622: dwrite d10/d41/d4e/d60/f8c [0,4194304] 0 2024-04-26T21:08:13.087 INFO:tasks.workunit.client.1.smithi064.stdout:9/707: dwrite d0/d4/da/d26/d47/d9d/f84 [0,4194304] 0 2024-04-26T21:08:13.087 INFO:tasks.workunit.client.1.smithi064.stdout:2/796: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/f19 [0,4194304] 0 2024-04-26T21:08:13.088 INFO:tasks.workunit.client.1.smithi064.stdout:2/797: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85 0 2024-04-26T21:08:13.088 INFO:tasks.workunit.client.1.smithi064.stdout:2/798: write d12/d41/d73/d83/d94/d3a/d46/d6a/f9c [1486699,95927] 0 2024-04-26T21:08:13.091 INFO:tasks.workunit.client.1.smithi064.stdout:9/708: rmdir d0/d4/d7/df/da4 39 2024-04-26T21:08:13.093 INFO:tasks.workunit.client.1.smithi064.stdout:2/799: link d12/c81 d12/d41/d73/d83/d94/d3a/d46/d6a/d86/c111 0 2024-04-26T21:08:13.093 INFO:tasks.workunit.client.1.smithi064.stdout:2/800: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f112 x:0 0 0 2024-04-26T21:08:13.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/801: getdents d12/d41/d73/d83/d94/d3a/d46/dee 0 2024-04-26T21:08:13.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/802: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/f4d 0 2024-04-26T21:08:13.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/803: chown d12/d41/d61/d75/c5e 297 1 2024-04-26T21:08:13.102 INFO:tasks.workunit.client.1.smithi064.stdout:0/690: dwrite dd/f2a [0,4194304] 0 2024-04-26T21:08:13.119 INFO:tasks.workunit.client.1.smithi064.stdout:0/691: symlink dd/d21/dc8/d31/d47/lea 0 2024-04-26T21:08:13.142 INFO:tasks.workunit.client.1.smithi064.stdout:9/709: dwrite d0/d4/d7/f2f [0,4194304] 0 2024-04-26T21:08:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:12 smithi064 ceph-mon[33404]: pgmap v39: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 229 MiB/s rd, 294 MiB/s wr, 417 op/s 2024-04-26T21:08:13.164 INFO:tasks.workunit.client.1.smithi064.stdout:4/782: dwrite d0/d1d/d17/f2c [0,4194304] 0 2024-04-26T21:08:13.164 INFO:tasks.workunit.client.1.smithi064.stdout:4/783: chown d0/d5/f7c 3 1 2024-04-26T21:08:13.165 INFO:tasks.workunit.client.1.smithi064.stdout:4/784: readlink d0/d5/d13/d33/dd0/lde 0 2024-04-26T21:08:13.181 INFO:tasks.workunit.client.0.smithi055.stdout:8/455: dread d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:13.182 INFO:tasks.workunit.client.1.smithi064.stdout:7/717: dwrite d6/db/d34/f96 [0,4194304] 0 2024-04-26T21:08:13.183 INFO:tasks.workunit.client.1.smithi064.stdout:7/718: chown d6/d9/d77/c9a 918 1 2024-04-26T21:08:13.191 INFO:tasks.workunit.client.1.smithi064.stdout:2/804: dwrite d12/d41/d73/d83/d94/d3a/d46/d6a/f5a [0,4194304] 0 2024-04-26T21:08:13.193 INFO:tasks.workunit.client.0.smithi055.stdout:3/611: dread d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:13.196 INFO:tasks.workunit.client.0.smithi055.stdout:4/408: dwrite d4/d12/d15/f6f [4194304,4194304] 0 2024-04-26T21:08:13.197 INFO:tasks.workunit.client.1.smithi064.stdout:0/692: dwrite dd/d10/d18/d58/f93 [0,4194304] 0 2024-04-26T21:08:13.197 INFO:tasks.workunit.client.0.smithi055.stdout:1/480: dwrite d8/f12 [4194304,4194304] 0 2024-04-26T21:08:13.198 INFO:tasks.workunit.client.1.smithi064.stdout:3/656: dwrite d1/d27/d50/d35/fd4 [0,4194304] 0 2024-04-26T21:08:13.199 INFO:tasks.workunit.client.1.smithi064.stdout:3/657: creat d1/d27/d29/d6f/d72/da5/d7d/fde x:0 0 0 2024-04-26T21:08:13.201 INFO:tasks.workunit.client.1.smithi064.stdout:9/710: symlink d0/d4/da/d26/d5e/le5 0 2024-04-26T21:08:13.202 INFO:tasks.workunit.client.0.smithi055.stdout:8/456: dread f1 [0,4194304] 0 2024-04-26T21:08:13.202 INFO:tasks.workunit.client.0.smithi055.stdout:8/457: truncate d3/d9/f24 5599335 0 2024-04-26T21:08:13.204 INFO:tasks.workunit.client.0.smithi055.stdout:3/612: dread d0/d4/d5/d73/d13/d27/d50/d6b/f7d [0,4194304] 0 2024-04-26T21:08:13.222 INFO:tasks.workunit.client.0.smithi055.stdout:8/458: write d3/d9/d1f/d2e/f56 [2016733,31455] 0 2024-04-26T21:08:13.228 INFO:tasks.workunit.client.0.smithi055.stdout:3/613: dread d0/d4/d5/f6 [0,4194304] 0 2024-04-26T21:08:13.234 INFO:tasks.workunit.client.1.smithi064.stdout:8/623: link d10/d41/d4e/d60/fc4 d10/d41/d4e/d59/fc5 0 2024-04-26T21:08:13.251 INFO:tasks.workunit.client.1.smithi064.stdout:4/785: symlink d0/d5/d13/l106 0 2024-04-26T21:08:13.253 INFO:tasks.workunit.client.1.smithi064.stdout:4/786: write d0/d5/d13/f36 [4677018,96424] 0 2024-04-26T21:08:13.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:12 smithi055 ceph-mon[25475]: pgmap v39: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 229 MiB/s rd, 294 MiB/s wr, 417 op/s 2024-04-26T21:08:13.287 INFO:tasks.workunit.client.0.smithi055.stdout:3/614: dwrite d0/d4/d5/d73/f14 [0,4194304] 0 2024-04-26T21:08:13.287 INFO:tasks.workunit.client.0.smithi055.stdout:3/615: write d0/d4/d5/d73/d13/d27/fc2 [120220,20208] 0 2024-04-26T21:08:13.287 INFO:tasks.workunit.client.0.smithi055.stdout:3/616: dread - d0/de/fbc zero size 2024-04-26T21:08:13.325 INFO:tasks.workunit.client.0.smithi055.stdout:8/459: creat d3/d9/d1d/d48/d57/d61/d9b/f9e x:0 0 0 2024-04-26T21:08:13.325 INFO:tasks.workunit.client.0.smithi055.stdout:8/460: dread - d3/d9/d1f/d2e/d75/d76/f81 zero size 2024-04-26T21:08:13.325 INFO:tasks.workunit.client.0.smithi055.stdout:8/461: readlink d3/l74 0 2024-04-26T21:08:13.342 INFO:tasks.workunit.client.0.smithi055.stdout:8/462: creat d3/d9/d1f/f9f x:0 0 0 2024-04-26T21:08:13.346 INFO:tasks.workunit.client.1.smithi064.stdout:7/719: symlink d6/d70/d74/d99/lf9 0 2024-04-26T21:08:13.346 INFO:tasks.workunit.client.1.smithi064.stdout:7/720: dread - d6/d9/d3d/f6b zero size 2024-04-26T21:08:13.363 INFO:tasks.workunit.client.0.smithi055.stdout:8/463: dread d3/d9/d1f/f86 [0,4194304] 0 2024-04-26T21:08:13.363 INFO:tasks.workunit.client.0.smithi055.stdout:8/464: chown d3/d9/d1d/f85 65099 1 2024-04-26T21:08:13.363 INFO:tasks.workunit.client.0.smithi055.stdout:8/465: chown d3/d9/d1f/c7e 6014 1 2024-04-26T21:08:13.369 INFO:tasks.workunit.client.1.smithi064.stdout:0/693: creat dd/d21/dc8/d31/d5c/feb x:0 0 0 2024-04-26T21:08:13.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/721: mknod d6/d8c/cfa 0 2024-04-26T21:08:13.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/722: write d6/d15/d88/dca/d5c/f7b [3657600,93608] 0 2024-04-26T21:08:13.382 INFO:tasks.workunit.client.1.smithi064.stdout:7/723: truncate d6/db/d1f/ff6 684610 0 2024-04-26T21:08:13.383 INFO:tasks.workunit.client.1.smithi064.stdout:7/724: write f5 [1880020,119554] 0 2024-04-26T21:08:13.383 INFO:tasks.workunit.client.0.smithi055.stdout:8/466: write d3/d9/d1d/f6e [3657513,47558] 0 2024-04-26T21:08:13.387 INFO:tasks.workunit.client.1.smithi064.stdout:8/624: getdents d10/d1d/d38 0 2024-04-26T21:08:13.389 INFO:tasks.workunit.client.0.smithi055.stdout:8/467: creat d3/d9/d1d/d48/d57/d61/fa0 x:0 0 0 2024-04-26T21:08:13.409 INFO:tasks.workunit.client.1.smithi064.stdout:8/625: dread d10/d2f/f36 [0,4194304] 0 2024-04-26T21:08:13.411 INFO:tasks.workunit.client.1.smithi064.stdout:8/626: creat d10/d41/d4e/d59/fc6 x:0 0 0 2024-04-26T21:08:13.414 INFO:tasks.workunit.client.0.smithi055.stdout:1/481: rename d8/d17/d36/l5b to d8/d17/d1b/la2 0 2024-04-26T21:08:13.417 INFO:tasks.workunit.client.0.smithi055.stdout:1/482: truncate d8/d17/f18 1052519 0 2024-04-26T21:08:13.426 INFO:tasks.workunit.client.1.smithi064.stdout:0/694: dwrite dd/d10/fd5 [0,4194304] 0 2024-04-26T21:08:13.427 INFO:tasks.workunit.client.1.smithi064.stdout:0/695: write dd/d10/fe1 [860262,8725] 0 2024-04-26T21:08:13.427 INFO:tasks.workunit.client.1.smithi064.stdout:0/696: readlink dd/d21/dc8/lc6 0 2024-04-26T21:08:13.427 INFO:tasks.workunit.client.0.smithi055.stdout:4/409: symlink d4/d18/d1a/l90 0 2024-04-26T21:08:13.428 INFO:tasks.workunit.client.0.smithi055.stdout:4/410: chown d4/d26/d42/d28/d53/d71/l80 93480 1 2024-04-26T21:08:13.428 INFO:tasks.workunit.client.0.smithi055.stdout:4/411: write d4/d12/f3e [4760558,67111] 0 2024-04-26T21:08:13.430 INFO:tasks.workunit.client.0.smithi055.stdout:8/468: dwrite d3/d9/d1d/d48/d57/d61/f97 [0,4194304] 0 2024-04-26T21:08:13.430 INFO:tasks.workunit.client.0.smithi055.stdout:8/469: dread - d3/d9/d1f/f9f zero size 2024-04-26T21:08:13.431 INFO:tasks.workunit.client.1.smithi064.stdout:8/627: dread d10/d41/d4e/fbb [4194304,4194304] 0 2024-04-26T21:08:13.431 INFO:tasks.workunit.client.1.smithi064.stdout:8/628: chown d10/l28 976362 1 2024-04-26T21:08:13.439 INFO:tasks.workunit.client.0.smithi055.stdout:1/483: write d8/df/f6e [3494638,45426] 0 2024-04-26T21:08:13.439 INFO:tasks.workunit.client.0.smithi055.stdout:1/484: write d8/df/f8e [651185,119097] 0 2024-04-26T21:08:13.439 INFO:tasks.workunit.client.0.smithi055.stdout:4/412: dread d4/d12/d17/f6e [0,4194304] 0 2024-04-26T21:08:13.442 INFO:tasks.workunit.client.0.smithi055.stdout:4/413: link d4/d26/d42/d28/d53/l76 d4/d26/d42/d28/d53/d71/l91 0 2024-04-26T21:08:13.444 INFO:tasks.workunit.client.0.smithi055.stdout:4/414: symlink d4/d26/l92 0 2024-04-26T21:08:13.445 INFO:tasks.workunit.client.1.smithi064.stdout:0/697: dread dd/d10/d18/d64/f86 [0,4194304] 0 2024-04-26T21:08:13.445 INFO:tasks.workunit.client.1.smithi064.stdout:0/698: dread - dd/d21/dc8/d31/d47/d61/f70 zero size 2024-04-26T21:08:13.447 INFO:tasks.workunit.client.1.smithi064.stdout:0/699: getdents dd/d21/dc8/d31/d47/d61/d42 0 2024-04-26T21:08:13.448 INFO:tasks.workunit.client.0.smithi055.stdout:4/415: rmdir d4/d12/d17/d3d 39 2024-04-26T21:08:13.448 INFO:tasks.workunit.client.0.smithi055.stdout:4/416: read - d4/d12/d17/d3d/f8c zero size 2024-04-26T21:08:13.450 INFO:tasks.workunit.client.1.smithi064.stdout:1/836: sync 2024-04-26T21:08:13.451 INFO:tasks.workunit.client.1.smithi064.stdout:6/680: sync 2024-04-26T21:08:13.451 INFO:tasks.workunit.client.1.smithi064.stdout:1/837: getdents d0/d6/d11/d1e/d2a/d34/db1 0 2024-04-26T21:08:13.451 INFO:tasks.workunit.client.1.smithi064.stdout:1/838: fsync d0/d6/d91/d92/fbf 0 2024-04-26T21:08:13.451 INFO:tasks.workunit.client.1.smithi064.stdout:1/839: fsync d0/d6/d11/fb0 0 2024-04-26T21:08:13.451 INFO:tasks.workunit.client.1.smithi064.stdout:6/681: mknod d4/d7/d12/d1e/cdf 0 2024-04-26T21:08:13.472 INFO:tasks.workunit.client.1.smithi064.stdout:8/629: dwrite d10/d41/d44/d5a/f62 [0,4194304] 0 2024-04-26T21:08:13.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/840: rename d0/d6/d91/f94 to d0/d6b/fff 0 2024-04-26T21:08:13.473 INFO:tasks.workunit.client.1.smithi064.stdout:0/700: mknod dd/d10/cec 0 2024-04-26T21:08:13.476 INFO:tasks.workunit.client.0.smithi055.stdout:4/417: dread d4/d18/d1a/f7d [0,4194304] 0 2024-04-26T21:08:13.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/630: link d10/d1d/l48 d10/d41/d4e/d59/d83/lc7 0 2024-04-26T21:08:13.479 INFO:tasks.workunit.client.1.smithi064.stdout:1/841: mkdir d0/d6/dd/d100 0 2024-04-26T21:08:13.479 INFO:tasks.workunit.client.1.smithi064.stdout:1/842: write d0/d6/d11/d2c/d9c/dbc/fe3 [633673,41230] 0 2024-04-26T21:08:13.479 INFO:tasks.workunit.client.1.smithi064.stdout:1/843: readlink d0/d6/d11/d1e/d2a/d34/d57/d9b/le2 0 2024-04-26T21:08:13.479 INFO:tasks.workunit.client.1.smithi064.stdout:1/844: read d0/d22/d87/f88 [2653723,98489] 0 2024-04-26T21:08:13.480 INFO:tasks.workunit.client.1.smithi064.stdout:1/845: readlink d0/d6/d11/d1e/d2a/d34/d57/d66/lb8 0 2024-04-26T21:08:13.480 INFO:tasks.workunit.client.0.smithi055.stdout:4/418: getdents d4/d12/d61 0 2024-04-26T21:08:13.480 INFO:tasks.workunit.client.0.smithi055.stdout:4/419: write d4/d18/d1a/f37 [918891,24553] 0 2024-04-26T21:08:13.480 INFO:tasks.workunit.client.0.smithi055.stdout:4/420: fdatasync d4/d12/d15/f79 0 2024-04-26T21:08:13.482 INFO:tasks.workunit.client.1.smithi064.stdout:0/701: mknod dd/d21/dc8/d31/d43/db4/ced 0 2024-04-26T21:08:13.482 INFO:tasks.workunit.client.1.smithi064.stdout:0/702: write dd/d10/d74/d4f/fa8 [759745,27399] 0 2024-04-26T21:08:13.482 INFO:tasks.workunit.client.1.smithi064.stdout:0/703: dread - dd/d21/dc8/d31/d47/d61/f70 zero size 2024-04-26T21:08:13.483 INFO:tasks.workunit.client.0.smithi055.stdout:1/485: dwrite d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:13.483 INFO:tasks.workunit.client.0.smithi055.stdout:1/486: stat d8/df/d11/d27/d28/f40 0 2024-04-26T21:08:13.483 INFO:tasks.workunit.client.0.smithi055.stdout:1/487: read - d8/d17/d1b/d41/f8f zero size 2024-04-26T21:08:13.483 INFO:tasks.workunit.client.0.smithi055.stdout:1/488: fsync d8/d17/d6a/f4c 0 2024-04-26T21:08:13.485 INFO:tasks.workunit.client.1.smithi064.stdout:1/846: mknod d0/d6/d11/c101 0 2024-04-26T21:08:13.487 INFO:tasks.workunit.client.0.smithi055.stdout:1/489: dread d8/d17/f77 [0,4194304] 0 2024-04-26T21:08:13.487 INFO:tasks.workunit.client.0.smithi055.stdout:1/490: write d8/df/f8e [1518277,99993] 0 2024-04-26T21:08:13.489 INFO:tasks.workunit.client.0.smithi055.stdout:4/421: mkdir d4/d12/d61/d93 0 2024-04-26T21:08:13.492 INFO:tasks.workunit.client.1.smithi064.stdout:1/847: creat d0/d22/f102 x:0 0 0 2024-04-26T21:08:13.492 INFO:tasks.workunit.client.1.smithi064.stdout:1/848: readlink d0/d6/d11/l6f 0 2024-04-26T21:08:13.494 INFO:tasks.workunit.client.1.smithi064.stdout:6/682: mkdir d4/d7/de0 0 2024-04-26T21:08:13.496 INFO:tasks.workunit.client.1.smithi064.stdout:6/683: mkdir d4/d7/d12/d49/de1 0 2024-04-26T21:08:13.496 INFO:tasks.workunit.client.1.smithi064.stdout:6/684: getdents d4/d7/d12/d49/de1 0 2024-04-26T21:08:13.497 INFO:tasks.workunit.client.1.smithi064.stdout:8/631: read d10/d41/d4e/d59/fc5 [3333752,18375] 0 2024-04-26T21:08:13.498 INFO:tasks.workunit.client.1.smithi064.stdout:6/685: symlink d4/d7/le2 0 2024-04-26T21:08:13.500 INFO:tasks.workunit.client.1.smithi064.stdout:8/632: mknod d10/d41/d4e/d59/d5d/cc8 0 2024-04-26T21:08:13.500 INFO:tasks.workunit.client.1.smithi064.stdout:8/633: stat d10/d41/d4e/l65 0 2024-04-26T21:08:13.500 INFO:tasks.workunit.client.1.smithi064.stdout:8/634: truncate d10/f94 445078 0 2024-04-26T21:08:13.501 INFO:tasks.workunit.client.1.smithi064.stdout:6/686: mknod d4/d99/ce3 0 2024-04-26T21:08:13.507 INFO:tasks.workunit.client.1.smithi064.stdout:6/687: dread d4/d7/d12/d49/d9e/fb6 [0,4194304] 0 2024-04-26T21:08:13.509 INFO:tasks.workunit.client.0.smithi055.stdout:4/422: write d4/d26/d42/d28/f44 [1184087,102708] 0 2024-04-26T21:08:13.510 INFO:tasks.workunit.client.0.smithi055.stdout:4/423: fdatasync d4/d12/d17/d3d/f8c 0 2024-04-26T21:08:13.519 INFO:tasks.workunit.client.1.smithi064.stdout:9/711: mknod d0/d4/da/ce6 0 2024-04-26T21:08:13.522 INFO:tasks.workunit.client.1.smithi064.stdout:6/688: unlink d4/d7/d12/d49/d4b/d5a/d79/lba 0 2024-04-26T21:08:13.522 INFO:tasks.workunit.client.1.smithi064.stdout:6/689: chown d4/d7/d12/d49/d9e/fb6 112938 1 2024-04-26T21:08:13.524 INFO:tasks.workunit.client.1.smithi064.stdout:9/712: link d0/d4/da/d26/fad d0/d4/da/d31/fe7 0 2024-04-26T21:08:13.525 INFO:tasks.workunit.client.1.smithi064.stdout:9/713: readlink d0/d4/d7/df/l66 0 2024-04-26T21:08:13.528 INFO:tasks.workunit.client.1.smithi064.stdout:6/690: fsync d4/d7/d12/d49/d4b/d56/fc5 0 2024-04-26T21:08:13.530 INFO:tasks.workunit.client.1.smithi064.stdout:0/704: dwrite dd/d21/dc8/d31/d47/d61/f70 [0,4194304] 0 2024-04-26T21:08:13.533 INFO:tasks.workunit.client.1.smithi064.stdout:9/714: mknod d0/d4/da/d26/d47/d9d/ce8 0 2024-04-26T21:08:13.534 INFO:tasks.workunit.client.1.smithi064.stdout:8/635: rmdir d10/d41/d53 39 2024-04-26T21:08:13.534 INFO:tasks.workunit.client.1.smithi064.stdout:6/691: creat d4/d7/d12/da7/fe4 x:0 0 0 2024-04-26T21:08:13.534 INFO:tasks.workunit.client.1.smithi064.stdout:8/636: creat d10/d41/d4e/d54/fc9 x:0 0 0 2024-04-26T21:08:13.538 INFO:tasks.workunit.client.1.smithi064.stdout:6/692: mknod d4/d7/d12/d49/d9e/ce5 0 2024-04-26T21:08:13.540 INFO:tasks.workunit.client.1.smithi064.stdout:8/637: creat d10/d2f/d90/da0/fca x:0 0 0 2024-04-26T21:08:13.543 INFO:tasks.workunit.client.1.smithi064.stdout:6/693: rename d4/d7/d12/d8d to d4/d7/d12/d38/de6 0 2024-04-26T21:08:13.545 INFO:tasks.workunit.client.1.smithi064.stdout:6/694: unlink d4/d7/f9c 0 2024-04-26T21:08:13.550 INFO:tasks.workunit.client.1.smithi064.stdout:8/638: rename d10/d41/d4e/d60/f8c to d10/d41/d4e/d54/dc3/fcb 0 2024-04-26T21:08:13.550 INFO:tasks.workunit.client.1.smithi064.stdout:8/639: write d10/d41/d4e/d54/f9f [346375,124619] 0 2024-04-26T21:08:13.553 INFO:tasks.workunit.client.1.smithi064.stdout:8/640: symlink d10/d41/d4e/d59/d5d/lcc 0 2024-04-26T21:08:13.553 INFO:tasks.workunit.client.1.smithi064.stdout:8/641: fdatasync d10/f94 0 2024-04-26T21:08:13.555 INFO:tasks.workunit.client.0.smithi055.stdout:1/491: truncate d8/df/d11/d27/f3a 1035314 0 2024-04-26T21:08:13.566 INFO:tasks.workunit.client.1.smithi064.stdout:5/680: sync 2024-04-26T21:08:13.566 INFO:tasks.workunit.client.1.smithi064.stdout:2/805: sync 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:4/787: sync 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:3/658: sync 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:2/806: fdatasync d12/d41/d73/d83/d94/d3a/d46/d91/d92/f107 0 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:2/807: fdatasync d12/f78 0 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:7/725: sync 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:7/726: write d6/db/f2a [767220,9596] 0 2024-04-26T21:08:13.567 INFO:tasks.workunit.client.1.smithi064.stdout:5/681: rename dd/f1e to dd/d12/d18/d1a/d1f/dca/fde 0 2024-04-26T21:08:13.569 INFO:tasks.workunit.client.0.smithi055.stdout:1/492: dread d8/f15 [4194304,4194304] 0 2024-04-26T21:08:13.570 INFO:tasks.workunit.client.1.smithi064.stdout:3/659: mknod d1/d27/d29/d5e/da9/cdf 0 2024-04-26T21:08:13.572 INFO:tasks.workunit.client.1.smithi064.stdout:0/705: dread dd/d10/d74/fae [0,4194304] 0 2024-04-26T21:08:13.572 INFO:tasks.workunit.client.1.smithi064.stdout:7/727: symlink d6/d5a/d8f/lfb 0 2024-04-26T21:08:13.572 INFO:tasks.workunit.client.1.smithi064.stdout:0/706: write dd/d10/d18/fc0 [834393,71340] 0 2024-04-26T21:08:13.572 INFO:tasks.workunit.client.1.smithi064.stdout:2/808: write d12/da9/ff0 [4434914,1258] 0 2024-04-26T21:08:13.573 INFO:tasks.workunit.client.1.smithi064.stdout:2/809: read d12/d41/d73/d83/d94/f37 [1203071,29556] 0 2024-04-26T21:08:13.577 INFO:tasks.workunit.client.1.smithi064.stdout:8/642: dread d10/d41/d4e/d54/f9f [0,4194304] 0 2024-04-26T21:08:13.578 INFO:tasks.workunit.client.1.smithi064.stdout:5/682: getdents dd/da9/d63 0 2024-04-26T21:08:13.579 INFO:tasks.workunit.client.1.smithi064.stdout:8/643: creat d10/fcd x:0 0 0 2024-04-26T21:08:13.580 INFO:tasks.workunit.client.0.smithi055.stdout:4/424: dwrite d4/d18/d1a/f7d [0,4194304] 0 2024-04-26T21:08:13.591 INFO:tasks.workunit.client.1.smithi064.stdout:3/660: write d1/d27/f59 [1829818,50491] 0 2024-04-26T21:08:13.591 INFO:tasks.workunit.client.1.smithi064.stdout:5/683: symlink dd/da9/d48/d56/ldf 0 2024-04-26T21:08:13.591 INFO:tasks.workunit.client.1.smithi064.stdout:8/644: truncate d10/d41/d4e/d54/dc3/fcb 1895103 0 2024-04-26T21:08:13.615 INFO:tasks.workunit.client.1.smithi064.stdout:6/695: write d4/d7/d12/d49/f5c [3363951,77235] 0 2024-04-26T21:08:13.617 INFO:tasks.workunit.client.1.smithi064.stdout:7/728: dread d6/d8c/f7f [0,4194304] 0 2024-04-26T21:08:13.617 INFO:tasks.workunit.client.1.smithi064.stdout:7/729: readlink d6/db/d34/d6f/d81/ld3 0 2024-04-26T21:08:13.618 INFO:tasks.workunit.client.1.smithi064.stdout:6/696: chown d4/d7/d12/d49/d4b/l55 2916880 1 2024-04-26T21:08:13.619 INFO:tasks.workunit.client.1.smithi064.stdout:4/788: write d0/d2f/d7d/f8a [4047231,33874] 0 2024-04-26T21:08:13.620 INFO:tasks.workunit.client.1.smithi064.stdout:4/789: chown d0/d1d/d21/f8e 40870639 1 2024-04-26T21:08:13.621 INFO:tasks.workunit.client.1.smithi064.stdout:9/715: dwrite d0/d4/da/d26/d5d/f68 [0,4194304] 0 2024-04-26T21:08:13.621 INFO:tasks.workunit.client.1.smithi064.stdout:9/716: creat d0/d4/da/d26/d47/d88/fe9 x:0 0 0 2024-04-26T21:08:13.621 INFO:tasks.workunit.client.1.smithi064.stdout:9/717: fsync d0/d4/d7/df/f3a 0 2024-04-26T21:08:13.625 INFO:tasks.workunit.client.1.smithi064.stdout:6/697: getdents d4/d7/d12/dbc 0 2024-04-26T21:08:13.629 INFO:tasks.workunit.client.1.smithi064.stdout:4/790: creat d0/d1d/d17/f107 x:0 0 0 2024-04-26T21:08:13.647 INFO:tasks.workunit.client.1.smithi064.stdout:8/645: read d10/d41/d4e/d59/f96 [2756330,96571] 0 2024-04-26T21:08:13.647 INFO:tasks.workunit.client.1.smithi064.stdout:2/810: dwrite d12/d41/fe4 [0,4194304] 0 2024-04-26T21:08:13.648 INFO:tasks.workunit.client.0.smithi055.stdout:4/425: dwrite d4/f66 [0,4194304] 0 2024-04-26T21:08:13.649 INFO:tasks.workunit.client.0.smithi055.stdout:4/426: chown d4/d12/d57/c6a 0 1 2024-04-26T21:08:13.649 INFO:tasks.workunit.client.1.smithi064.stdout:0/707: dwrite dd/d21/dc8/d31/d47/f66 [0,4194304] 0 2024-04-26T21:08:13.649 INFO:tasks.workunit.client.1.smithi064.stdout:0/708: chown dd/d21/dc8/d31/d47/lb2 5603133 1 2024-04-26T21:08:13.650 INFO:tasks.workunit.client.1.smithi064.stdout:9/718: write d0/d4/da/d26/d47/f4b [3258705,20321] 0 2024-04-26T21:08:13.650 INFO:tasks.workunit.client.1.smithi064.stdout:9/719: write d0/d4/da/d26/d47/f73 [4198973,85232] 0 2024-04-26T21:08:13.650 INFO:tasks.workunit.client.1.smithi064.stdout:9/720: dread - d0/da6/fdc zero size 2024-04-26T21:08:13.651 INFO:tasks.workunit.client.0.smithi055.stdout:4/427: getdents d4/d18 0 2024-04-26T21:08:13.651 INFO:tasks.workunit.client.1.smithi064.stdout:1/849: sync 2024-04-26T21:08:13.651 INFO:tasks.workunit.client.1.smithi064.stdout:6/698: dread d4/d7/d12/d49/d4b/d56/d95/f9a [0,4194304] 0 2024-04-26T21:08:13.652 INFO:tasks.workunit.client.1.smithi064.stdout:0/709: truncate dd/d10/d18/f29 2288174 0 2024-04-26T21:08:13.652 INFO:tasks.workunit.client.0.smithi055.stdout:4/428: rmdir d4/d26/d42/d28/d53 39 2024-04-26T21:08:13.655 INFO:tasks.workunit.client.0.smithi055.stdout:4/429: link d4/d26/d42/d28/d53/d71/l80 d4/d26/d42/d28/d53/l94 0 2024-04-26T21:08:13.657 INFO:tasks.workunit.client.1.smithi064.stdout:3/661: dwrite d1/d27/d29/d6f/d72/da5/d7d/fad [4194304,4194304] 0 2024-04-26T21:08:13.659 INFO:tasks.workunit.client.1.smithi064.stdout:9/721: symlink d0/d4/da/d26/d47/lea 0 2024-04-26T21:08:13.660 INFO:tasks.workunit.client.1.smithi064.stdout:9/722: write d0/d4/da/f29 [1609841,30091] 0 2024-04-26T21:08:13.660 INFO:tasks.workunit.client.0.smithi055.stdout:4/430: creat d4/d12/d61/f95 x:0 0 0 2024-04-26T21:08:13.661 INFO:tasks.workunit.client.1.smithi064.stdout:1/850: truncate d0/d22/d87/fb4 3756666 0 2024-04-26T21:08:13.663 INFO:tasks.workunit.client.0.smithi055.stdout:4/431: creat d4/d26/d42/d56/f96 x:0 0 0 2024-04-26T21:08:13.664 INFO:tasks.workunit.client.1.smithi064.stdout:0/710: mknod dd/d10/d18/d64/dda/cee 0 2024-04-26T21:08:13.664 INFO:tasks.workunit.client.1.smithi064.stdout:0/711: truncate dd/d10/d74/d4f/d7b/fc4 881392 0 2024-04-26T21:08:13.666 INFO:tasks.workunit.client.1.smithi064.stdout:3/662: symlink d1/d27/d50/d35/d4c/d7b/d8e/le0 0 2024-04-26T21:08:13.666 INFO:tasks.workunit.client.1.smithi064.stdout:3/663: chown d1/d38/f6c 10610814 1 2024-04-26T21:08:13.667 INFO:tasks.workunit.client.0.smithi055.stdout:4/432: symlink d4/d12/d61/l97 0 2024-04-26T21:08:13.667 INFO:tasks.workunit.client.0.smithi055.stdout:4/433: chown d4/d18/d1a/d49/c85 290409 1 2024-04-26T21:08:13.667 INFO:tasks.workunit.client.0.smithi055.stdout:4/434: chown d4/d26/d42/d28/f32 538886 1 2024-04-26T21:08:13.668 INFO:tasks.workunit.client.1.smithi064.stdout:9/723: creat d0/d4/da/da3/feb x:0 0 0 2024-04-26T21:08:13.669 INFO:tasks.workunit.client.1.smithi064.stdout:1/851: mknod d0/d6/d11/d2c/d9c/dbc/c103 0 2024-04-26T21:08:13.670 INFO:tasks.workunit.client.1.smithi064.stdout:3/664: creat d1/d27/d50/d35/db9/fe1 x:0 0 0 2024-04-26T21:08:13.672 INFO:tasks.workunit.client.1.smithi064.stdout:9/724: creat d0/d4/da/d26/d47/d9d/d76/fec x:0 0 0 2024-04-26T21:08:13.672 INFO:tasks.workunit.client.1.smithi064.stdout:9/725: read - d0/d4/da/d67/fc3 zero size 2024-04-26T21:08:13.672 INFO:tasks.workunit.client.1.smithi064.stdout:4/791: write d0/d5/d13/d6d/f83 [4056024,50942] 0 2024-04-26T21:08:13.672 INFO:tasks.workunit.client.1.smithi064.stdout:4/792: creat d0/d5/d13/d10/f108 x:0 0 0 2024-04-26T21:08:13.673 INFO:tasks.workunit.client.1.smithi064.stdout:3/665: mknod d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/ce2 0 2024-04-26T21:08:13.678 INFO:tasks.workunit.client.1.smithi064.stdout:4/793: mknod d0/d2f/df1/c109 0 2024-04-26T21:08:13.679 INFO:tasks.workunit.client.1.smithi064.stdout:4/794: creat d0/d1d/d17/d44/dac/d54/f10a x:0 0 0 2024-04-26T21:08:13.679 INFO:tasks.workunit.client.1.smithi064.stdout:1/852: getdents d0/d6/d91/d92 0 2024-04-26T21:08:13.681 INFO:tasks.workunit.client.1.smithi064.stdout:3/666: mknod d1/d27/d50/d35/ce3 0 2024-04-26T21:08:13.681 INFO:tasks.workunit.client.1.smithi064.stdout:3/667: creat d1/d27/d50/d35/fe4 x:0 0 0 2024-04-26T21:08:13.682 INFO:tasks.workunit.client.1.smithi064.stdout:7/730: write d6/d9/d38/f3a [445284,107219] 0 2024-04-26T21:08:13.682 INFO:tasks.workunit.client.1.smithi064.stdout:7/731: truncate d6/d8c/f7f 5083891 0 2024-04-26T21:08:13.683 INFO:tasks.workunit.client.1.smithi064.stdout:5/684: dwrite dd/da9/d48/dac/da6/fcd [0,4194304] 0 2024-04-26T21:08:13.686 INFO:tasks.workunit.client.1.smithi064.stdout:0/712: dread dd/d10/d18/fc0 [0,4194304] 0 2024-04-26T21:08:13.686 INFO:tasks.workunit.client.1.smithi064.stdout:4/795: symlink d0/d5/d79/dd1/l10b 0 2024-04-26T21:08:13.697 INFO:tasks.workunit.client.1.smithi064.stdout:3/668: rename d1/d27/d29/d5e/da9/ccb to d1/d27/d29/d6f/d72/da5/d7d/d8a/ce5 0 2024-04-26T21:08:13.697 INFO:tasks.workunit.client.1.smithi064.stdout:3/669: write d1/d27/d50/d35/d4c/d7b/d8e/fda [437800,61308] 0 2024-04-26T21:08:13.698 INFO:tasks.workunit.client.1.smithi064.stdout:7/732: mknod d6/db/d1f/d50/db8/deb/cfc 0 2024-04-26T21:08:13.699 INFO:tasks.workunit.client.1.smithi064.stdout:5/685: symlink dd/d12/d4f/le0 0 2024-04-26T21:08:13.703 INFO:tasks.workunit.client.1.smithi064.stdout:4/796: stat d0/d1d/f70 0 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:4/797: chown d0/d2f/d69/db5 351443 1 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:4/798: read - d0/d14/feb zero size 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:7/733: creat d6/db/d1f/d50/db8/deb/ffd x:0 0 0 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:7/734: truncate d6/d9/d77/f8a 319334 0 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:3/670: mkdir d1/d14/de6 0 2024-04-26T21:08:13.704 INFO:tasks.workunit.client.1.smithi064.stdout:0/713: truncate dd/d21/dc8/d31/f7a 439503 0 2024-04-26T21:08:13.705 INFO:tasks.workunit.client.1.smithi064.stdout:1/853: dread d0/d6/d11/d1e/d2a/d34/f79 [0,4194304] 0 2024-04-26T21:08:13.705 INFO:tasks.workunit.client.1.smithi064.stdout:1/854: creat d0/d22/d9f/df1/f104 x:0 0 0 2024-04-26T21:08:13.706 INFO:tasks.workunit.client.1.smithi064.stdout:1/855: creat d0/d22/d87/f105 x:0 0 0 2024-04-26T21:08:13.706 INFO:tasks.workunit.client.1.smithi064.stdout:1/856: readlink d0/d22/d9f/lec 0 2024-04-26T21:08:13.708 INFO:tasks.workunit.client.1.smithi064.stdout:4/799: link d0/d2f/fd6 d0/d5/d13/d6d/f10c 0 2024-04-26T21:08:13.708 INFO:tasks.workunit.client.1.smithi064.stdout:3/671: unlink d1/d27/d29/d6f/d72/da5/d7d/fc2 0 2024-04-26T21:08:13.710 INFO:tasks.workunit.client.1.smithi064.stdout:0/714: truncate dd/d10/d18/d58/f93 682616 0 2024-04-26T21:08:13.715 INFO:tasks.workunit.client.1.smithi064.stdout:3/672: symlink d1/d27/d50/d35/d4c/d7b/le7 0 2024-04-26T21:08:13.718 INFO:tasks.workunit.client.1.smithi064.stdout:1/857: rmdir d0/d6/d11/d1e/d2a/d34/db1 0 2024-04-26T21:08:13.719 INFO:tasks.workunit.client.1.smithi064.stdout:1/858: symlink d0/d6/d29/l106 0 2024-04-26T21:08:13.724 INFO:tasks.workunit.client.1.smithi064.stdout:4/800: dread d0/d1d/d17/f2c [4194304,4194304] 0 2024-04-26T21:08:13.726 INFO:tasks.workunit.client.0.smithi055.stdout:6/499: sync 2024-04-26T21:08:13.727 INFO:tasks.workunit.client.0.smithi055.stdout:2/561: sync 2024-04-26T21:08:13.728 INFO:tasks.workunit.client.0.smithi055.stdout:2/562: creat d4/db/d1f/fb8 x:0 0 0 2024-04-26T21:08:13.729 INFO:tasks.workunit.client.0.smithi055.stdout:2/563: rename d4/d1e/d2a/f62 to d4/fb9 0 2024-04-26T21:08:13.730 INFO:tasks.workunit.client.0.smithi055.stdout:2/564: mkdir d4/d1e/dba 0 2024-04-26T21:08:13.734 INFO:tasks.workunit.client.1.smithi064.stdout:5/686: dread dd/d12/d18/d1a/d1f/f24 [8388608,4194304] 0 2024-04-26T21:08:13.735 INFO:tasks.workunit.client.1.smithi064.stdout:5/687: creat dd/d12/d4f/dbd/fe1 x:0 0 0 2024-04-26T21:08:13.738 INFO:tasks.workunit.client.0.smithi055.stdout:4/435: dwrite d4/d26/d42/d2d/f41 [0,4194304] 0 2024-04-26T21:08:13.739 INFO:tasks.workunit.client.1.smithi064.stdout:5/688: mkdir dd/da9/d48/de2 0 2024-04-26T21:08:13.739 INFO:tasks.workunit.client.0.smithi055.stdout:4/436: write d4/d12/d17/d3d/f68 [4423930,2194] 0 2024-04-26T21:08:13.739 INFO:tasks.workunit.client.0.smithi055.stdout:4/437: readlink d4/d26/l92 0 2024-04-26T21:08:13.739 INFO:tasks.workunit.client.0.smithi055.stdout:4/438: readlink d4/d26/d42/d28/d53/d71/l91 0 2024-04-26T21:08:13.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/439: symlink d4/d12/d61/d93/l98 0 2024-04-26T21:08:13.743 INFO:tasks.workunit.client.0.smithi055.stdout:4/440: truncate d4/d18/d1a/f8a 533246 0 2024-04-26T21:08:13.743 INFO:tasks.workunit.client.1.smithi064.stdout:4/801: write d0/d1d/d56/d89/f8f [1538839,86935] 0 2024-04-26T21:08:13.744 INFO:tasks.workunit.client.0.smithi055.stdout:4/441: creat d4/d26/f99 x:0 0 0 2024-04-26T21:08:13.755 INFO:tasks.workunit.client.0.smithi055.stdout:2/565: dread d4/dc/f71 [0,4194304] 0 2024-04-26T21:08:13.761 INFO:tasks.workunit.client.0.smithi055.stdout:2/566: chown d4/db/d1f/d32/d57 8221386 1 2024-04-26T21:08:13.761 INFO:tasks.workunit.client.0.smithi055.stdout:2/567: fsync d4/db/d56/d4a/d7e/f93 0 2024-04-26T21:08:13.761 INFO:tasks.workunit.client.0.smithi055.stdout:2/568: dread - d4/d14/f35 zero size 2024-04-26T21:08:13.761 INFO:tasks.workunit.client.0.smithi055.stdout:2/569: creat d4/db/d1f/d46/d51/fbb x:0 0 0 2024-04-26T21:08:13.764 INFO:tasks.workunit.client.0.smithi055.stdout:2/570: mkdir d4/d1e/d90/dbc 0 2024-04-26T21:08:13.764 INFO:tasks.workunit.client.0.smithi055.stdout:2/571: write d4/d55/da1/fb3 [971436,74281] 0 2024-04-26T21:08:13.764 INFO:tasks.workunit.client.0.smithi055.stdout:2/572: truncate d4/d1e/f4f 4425635 0 2024-04-26T21:08:13.765 INFO:tasks.workunit.client.1.smithi064.stdout:6/699: dread d4/f28 [0,4194304] 0 2024-04-26T21:08:13.765 INFO:tasks.workunit.client.1.smithi064.stdout:2/811: dwrite d12/d45/fc5 [0,4194304] 0 2024-04-26T21:08:13.775 INFO:tasks.workunit.client.1.smithi064.stdout:1/859: read d0/d6/d11/fb0 [3618946,4976] 0 2024-04-26T21:08:13.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/860: symlink d0/d6/d29/d31/l107 0 2024-04-26T21:08:13.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/861: fdatasync d0/d22/d87/f88 0 2024-04-26T21:08:13.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/862: fsync d0/d6/d91/ff8 0 2024-04-26T21:08:13.778 INFO:tasks.workunit.client.1.smithi064.stdout:1/863: unlink d0/d6/de0/ce5 0 2024-04-26T21:08:13.778 INFO:tasks.workunit.client.1.smithi064.stdout:1/864: stat d0/d6/dd/fa9 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:5/689: dread dd/d12/d18/d1a/d1f/d20/f8b [0,4194304] 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/865: rmdir d0/d6/d91/d92/dc7 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/866: stat d0/d6/de0/cee 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/867: readlink d0/d6/d11/d1e/d2a/lcb 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:3/673: dread d1/d27/d50/f24 [0,4194304] 0 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:3/674: chown d1/d27/d50/d35/d4c/d7b/dcd/ldd 8108701 1 2024-04-26T21:08:13.782 INFO:tasks.workunit.client.1.smithi064.stdout:3/675: fdatasync d1/d27/d50/f13 0 2024-04-26T21:08:13.783 INFO:tasks.workunit.client.1.smithi064.stdout:3/676: write d1/d27/d29/d6f/d72/d73/fca [475670,36927] 0 2024-04-26T21:08:13.783 INFO:tasks.workunit.client.1.smithi064.stdout:3/677: dread - d1/d27/d29/d6f/d72/da5/d7d/fde zero size 2024-04-26T21:08:13.783 INFO:tasks.workunit.client.1.smithi064.stdout:3/678: readlink d1/d27/d29/d6f/d72/da5/l15 0 2024-04-26T21:08:13.783 INFO:tasks.workunit.client.0.smithi055.stdout:6/500: dwrite f1 [0,4194304] 0 2024-04-26T21:08:13.785 INFO:tasks.workunit.client.1.smithi064.stdout:7/735: dwrite d6/d15/d67/d4d/fb7 [0,4194304] 0 2024-04-26T21:08:13.785 INFO:tasks.workunit.client.1.smithi064.stdout:7/736: chown d6/d9/d38/l40 5047193 1 2024-04-26T21:08:13.786 INFO:tasks.workunit.client.1.smithi064.stdout:7/737: chown d6/d8c/cfa 15 1 2024-04-26T21:08:13.786 INFO:tasks.workunit.client.1.smithi064.stdout:3/679: creat d1/d27/d29/d6f/d72/d7a/d84/fe8 x:0 0 0 2024-04-26T21:08:13.786 INFO:tasks.workunit.client.1.smithi064.stdout:3/680: readlink d1/d27/d50/d35/d4c/d7b/d82/la4 0 2024-04-26T21:08:13.787 INFO:tasks.workunit.client.1.smithi064.stdout:3/681: fdatasync d1/d27/d29/d6f/d72/d73/f85 0 2024-04-26T21:08:13.791 INFO:tasks.workunit.client.1.smithi064.stdout:7/738: mkdir d6/d15/d67/d4d/dfe 0 2024-04-26T21:08:13.793 INFO:tasks.workunit.client.1.smithi064.stdout:3/682: creat d1/d38/d68/fe9 x:0 0 0 2024-04-26T21:08:13.799 INFO:tasks.workunit.client.1.smithi064.stdout:7/739: mkdir d6/db/d34/d6f/dff 0 2024-04-26T21:08:13.801 INFO:tasks.workunit.client.1.smithi064.stdout:7/740: creat d6/db/d1f/d50/db8/f100 x:0 0 0 2024-04-26T21:08:13.801 INFO:tasks.workunit.client.1.smithi064.stdout:7/741: chown d6/db/d34/d6f/d81/ld3 160 1 2024-04-26T21:08:13.802 INFO:tasks.workunit.client.1.smithi064.stdout:7/742: chown d6/f51 1543273508 1 2024-04-26T21:08:13.803 INFO:tasks.workunit.client.0.smithi055.stdout:6/501: dread d3/d17/d25/f47 [0,4194304] 0 2024-04-26T21:08:13.805 INFO:tasks.workunit.client.0.smithi055.stdout:6/502: creat d3/d9b/fb4 x:0 0 0 2024-04-26T21:08:13.806 INFO:tasks.workunit.client.0.smithi055.stdout:6/503: rmdir d3/d17/d46/d54 39 2024-04-26T21:08:13.806 INFO:tasks.workunit.client.1.smithi064.stdout:7/743: truncate d6/d9/f36 1509045 0 2024-04-26T21:08:13.806 INFO:tasks.workunit.client.1.smithi064.stdout:7/744: chown d6/d15/de7 158 1 2024-04-26T21:08:13.806 INFO:tasks.workunit.client.1.smithi064.stdout:5/690: dread dd/da9/d48/d56/daa/fdd [0,4194304] 0 2024-04-26T21:08:13.806 INFO:tasks.workunit.client.1.smithi064.stdout:5/691: chown dd/d12/d4f/da5/cc8 1093 1 2024-04-26T21:08:13.807 INFO:tasks.workunit.client.1.smithi064.stdout:5/692: fdatasync dd/d12/d18/d25/d32/fa4 0 2024-04-26T21:08:13.807 INFO:tasks.workunit.client.1.smithi064.stdout:7/745: write d6/d15/d88/dca/fc6 [5053052,90299] 0 2024-04-26T21:08:13.807 INFO:tasks.workunit.client.1.smithi064.stdout:7/746: chown d6/d15/de7/cd2 74 1 2024-04-26T21:08:13.807 INFO:tasks.workunit.client.1.smithi064.stdout:7/747: fsync d6/db/d1f/d50/f57 0 2024-04-26T21:08:13.808 INFO:tasks.workunit.client.0.smithi055.stdout:6/504: creat d3/d17/d46/d54/d66/fb5 x:0 0 0 2024-04-26T21:08:13.809 INFO:tasks.workunit.client.0.smithi055.stdout:2/573: read d4/dc/d21/f24 [2409198,104338] 0 2024-04-26T21:08:13.810 INFO:tasks.workunit.client.0.smithi055.stdout:6/505: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d73/db6 0 2024-04-26T21:08:13.812 INFO:tasks.workunit.client.0.smithi055.stdout:2/574: mkdir d4/d7f/dbd 0 2024-04-26T21:08:13.812 INFO:tasks.workunit.client.0.smithi055.stdout:2/575: fdatasync d4/db/d56/f7c 0 2024-04-26T21:08:13.814 INFO:tasks.workunit.client.0.smithi055.stdout:6/506: symlink d3/d17/d19/d7b/lb7 0 2024-04-26T21:08:13.816 INFO:tasks.workunit.client.1.smithi064.stdout:5/693: rmdir dd/da9/d48/d6a/d81 39 2024-04-26T21:08:13.816 INFO:tasks.workunit.client.1.smithi064.stdout:5/694: chown dd/d12/d18/f36 6 1 2024-04-26T21:08:13.819 INFO:tasks.workunit.client.0.smithi055.stdout:2/576: unlink d4/dc/l40 0 2024-04-26T21:08:13.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/748: unlink d6/db/c3c 0 2024-04-26T21:08:13.821 INFO:tasks.workunit.client.1.smithi064.stdout:7/749: chown d6/d9/d38 53728 1 2024-04-26T21:08:13.821 INFO:tasks.workunit.client.1.smithi064.stdout:7/750: creat d6/d8c/d9e/f101 x:0 0 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.0.smithi055.stdout:6/507: unlink d3/l4b 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.0.smithi055.stdout:6/508: write d3/d9b/fa2 [585331,107967] 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.0.smithi055.stdout:6/509: creat d3/d17/d46/d54/d66/d6a/fb8 x:0 0 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.0.smithi055.stdout:6/510: write d3/d17/d46/d54/d66/d6a/d6b/f76 [646092,41483] 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.1.smithi064.stdout:7/751: mknod d6/d70/da8/dd1/c102 0 2024-04-26T21:08:13.824 INFO:tasks.workunit.client.1.smithi064.stdout:7/752: fsync d6/db/ff4 0 2024-04-26T21:08:13.830 INFO:tasks.workunit.client.1.smithi064.stdout:2/812: dwrite d12/d41/d73/d83/d94/d3a/f58 [0,4194304] 0 2024-04-26T21:08:13.833 INFO:tasks.workunit.client.1.smithi064.stdout:4/802: dwrite d0/d1d/d56/d89/dda/ffc [0,4194304] 0 2024-04-26T21:08:13.836 INFO:tasks.workunit.client.1.smithi064.stdout:7/753: rmdir d6/db/d1f/d50/db8 39 2024-04-26T21:08:13.836 INFO:tasks.workunit.client.1.smithi064.stdout:7/754: chown d6/db/dc1 29 1 2024-04-26T21:08:13.840 INFO:tasks.workunit.client.1.smithi064.stdout:2/813: unlink d12/d41/d73/d83/d94/d3a/cac 0 2024-04-26T21:08:13.841 INFO:tasks.workunit.client.1.smithi064.stdout:4/803: truncate d0/d2f/d7d/f94 1031871 0 2024-04-26T21:08:13.841 INFO:tasks.workunit.client.1.smithi064.stdout:4/804: fsync d0/d14/fed 0 2024-04-26T21:08:13.842 INFO:tasks.workunit.client.1.smithi064.stdout:2/814: mkdir d12/d41/d73/d83/d94/d3a/d46/d113 0 2024-04-26T21:08:13.845 INFO:tasks.workunit.client.1.smithi064.stdout:4/805: creat d0/d5/d13/d6d/f10d x:0 0 0 2024-04-26T21:08:13.845 INFO:tasks.workunit.client.1.smithi064.stdout:4/806: readlink d0/d5/d79/dd1/da0/dcd/ld5 0 2024-04-26T21:08:13.846 INFO:tasks.workunit.client.1.smithi064.stdout:4/807: mknod d0/d5/d13/d10/db7/c10e 0 2024-04-26T21:08:13.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/808: symlink d0/d5/d79/dd1/da0/dcd/l10f 0 2024-04-26T21:08:13.848 INFO:tasks.workunit.client.1.smithi064.stdout:4/809: chown d0/d1d/ff7 84 1 2024-04-26T21:08:13.857 INFO:tasks.workunit.client.1.smithi064.stdout:1/868: dwrite d0/d6b/d9e/da2/fc6 [0,4194304] 0 2024-04-26T21:08:13.857 INFO:tasks.workunit.client.1.smithi064.stdout:1/869: chown d0/d6b/d9e/da2/dc9 489 1 2024-04-26T21:08:13.858 INFO:tasks.workunit.client.1.smithi064.stdout:7/755: dread d6/d9/f11 [0,4194304] 0 2024-04-26T21:08:13.858 INFO:tasks.workunit.client.1.smithi064.stdout:7/756: stat d6/d5a/d8f/lfb 0 2024-04-26T21:08:13.859 INFO:tasks.workunit.client.1.smithi064.stdout:7/757: stat d6/d70/da8/dd1 0 2024-04-26T21:08:13.859 INFO:tasks.workunit.client.1.smithi064.stdout:7/758: creat d6/db/d34/d6f/d81/f103 x:0 0 0 2024-04-26T21:08:13.859 INFO:tasks.workunit.client.1.smithi064.stdout:7/759: creat d6/d15/d88/dca/f104 x:0 0 0 2024-04-26T21:08:13.859 INFO:tasks.workunit.client.1.smithi064.stdout:6/700: dwrite d4/d7/fe [0,4194304] 0 2024-04-26T21:08:13.859 INFO:tasks.workunit.client.1.smithi064.stdout:2/815: dread d12/d41/d73/d83/d94/f37 [0,4194304] 0 2024-04-26T21:08:13.865 INFO:tasks.workunit.client.1.smithi064.stdout:3/683: dwrite d1/f11 [12582912,4194304] 0 2024-04-26T21:08:13.866 INFO:tasks.workunit.client.1.smithi064.stdout:5/695: dwrite dd/d12/d18/d1a/d1b/f52 [0,4194304] 0 2024-04-26T21:08:13.866 INFO:tasks.workunit.client.1.smithi064.stdout:5/696: write dd/d12/d18/d25/d32/f80 [4521716,106972] 0 2024-04-26T21:08:13.867 INFO:tasks.workunit.client.1.smithi064.stdout:1/870: dread d0/d6/d29/d31/f83 [0,4194304] 0 2024-04-26T21:08:13.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/442: dwrite d4/d26/f99 [0,4194304] 0 2024-04-26T21:08:13.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/701: creat d4/d7/d12/d38/de6/fe7 x:0 0 0 2024-04-26T21:08:13.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/702: readlink d4/d7/d33/l8a 0 2024-04-26T21:08:13.891 INFO:tasks.workunit.client.1.smithi064.stdout:6/703: fdatasync d4/d7/d12/d49/d4b/d56/d95/fcc 0 2024-04-26T21:08:13.892 INFO:tasks.workunit.client.1.smithi064.stdout:2/816: symlink d12/d41/d73/d83/l114 0 2024-04-26T21:08:13.893 INFO:tasks.workunit.client.1.smithi064.stdout:0/715: sync 2024-04-26T21:08:13.893 INFO:tasks.workunit.client.1.smithi064.stdout:8/646: sync 2024-04-26T21:08:13.896 INFO:tasks.workunit.client.1.smithi064.stdout:3/684: unlink d1/d14/l23 0 2024-04-26T21:08:13.899 INFO:tasks.workunit.client.1.smithi064.stdout:5/697: write dd/da9/d48/dac/d8a/fb0 [1755490,113970] 0 2024-04-26T21:08:13.899 INFO:tasks.workunit.client.1.smithi064.stdout:5/698: read - dd/da9/d48/d6a/d81/fab zero size 2024-04-26T21:08:13.899 INFO:tasks.workunit.client.1.smithi064.stdout:9/726: sync 2024-04-26T21:08:13.899 INFO:tasks.workunit.client.1.smithi064.stdout:9/727: fsync d0/d4/d28/f2d 0 2024-04-26T21:08:13.899 INFO:tasks.workunit.client.1.smithi064.stdout:9/728: write d0/d4/da/d26/d5d/fa8 [17591,13088] 0 2024-04-26T21:08:13.900 INFO:tasks.workunit.client.1.smithi064.stdout:9/729: truncate d0/d4/d7/df/fae 936623 0 2024-04-26T21:08:13.900 INFO:tasks.workunit.client.1.smithi064.stdout:1/871: symlink d0/d6/d91/d92/l108 0 2024-04-26T21:08:13.907 INFO:tasks.workunit.client.1.smithi064.stdout:7/760: rmdir d6/db/d34/d6f/d81 39 2024-04-26T21:08:13.908 INFO:tasks.workunit.client.0.smithi055.stdout:9/560: sync 2024-04-26T21:08:13.908 INFO:tasks.workunit.client.0.smithi055.stdout:3/617: sync 2024-04-26T21:08:13.909 INFO:tasks.workunit.client.0.smithi055.stdout:3/618: chown d0/d4/d5/d73/d47/l29 174292 1 2024-04-26T21:08:13.909 INFO:tasks.workunit.client.0.smithi055.stdout:3/619: fdatasync d0/d4/f44 0 2024-04-26T21:08:13.909 INFO:tasks.workunit.client.0.smithi055.stdout:1/493: sync 2024-04-26T21:08:13.909 INFO:tasks.workunit.client.1.smithi064.stdout:0/716: symlink dd/d21/dc8/d31/d5c/lef 0 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:1/494: dread - d8/df/f5c zero size 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:5/406: sync 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/482: sync 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:0/562: sync 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:8/470: sync 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/483: write d5/d6/d24/d48/d58/f5f [156318,52153] 0 2024-04-26T21:08:13.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/484: fsync d5/d6/d24/d3b/f3c 0 2024-04-26T21:08:13.914 INFO:tasks.workunit.client.0.smithi055.stdout:0/563: write d9/d11/d5b/d5e/d6c/d7a/f9b [473209,65567] 0 2024-04-26T21:08:13.914 INFO:tasks.workunit.client.0.smithi055.stdout:0/564: write d9/d11/d5b/d5e/d6c/f84 [1251352,75413] 0 2024-04-26T21:08:13.914 INFO:tasks.workunit.client.1.smithi064.stdout:8/647: rename d10/d41/d4e/d54/f55 to d10/d41/d4e/d54/fce 0 2024-04-26T21:08:13.916 INFO:tasks.workunit.client.0.smithi055.stdout:9/561: symlink d2/d46/d77/d7d/d94/lb9 0 2024-04-26T21:08:13.917 INFO:tasks.workunit.client.0.smithi055.stdout:2/577: dwrite d4/db/d1f/d46/f79 [0,4194304] 0 2024-04-26T21:08:13.917 INFO:tasks.workunit.client.0.smithi055.stdout:3/620: dread d0/d4/d16/d18/d4b/f89 [0,4194304] 0 2024-04-26T21:08:13.919 INFO:tasks.workunit.client.1.smithi064.stdout:3/685: rename d1/d27/d29/d6f/d72/d95/caf to d1/d27/d29/d6f/d72/d95/dd9/cea 0 2024-04-26T21:08:13.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/495: link d8/d17/c2c d8/d17/d1b/d7b/d8d/ca3 0 2024-04-26T21:08:13.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/496: read - d8/d17/d1b/d7b/d8d/f7a zero size 2024-04-26T21:08:13.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/497: truncate d8/d17/d1b/d7b/d8d/f92 496386 0 2024-04-26T21:08:13.927 INFO:tasks.workunit.client.1.smithi064.stdout:5/699: mkdir dd/da9/d48/de3 0 2024-04-26T21:08:13.927 INFO:tasks.workunit.client.1.smithi064.stdout:5/700: chown dd/da9/d48/d56/fb4 248555435 1 2024-04-26T21:08:13.928 INFO:tasks.workunit.client.1.smithi064.stdout:9/730: mknod d0/d4/da/d26/d47/d9d/d76/ced 0 2024-04-26T21:08:13.930 INFO:tasks.workunit.client.0.smithi055.stdout:8/471: link d3/l74 d3/d7c/d90/la1 0 2024-04-26T21:08:13.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/872: creat d0/d6/d11/d6c/dda/f109 x:0 0 0 2024-04-26T21:08:13.932 INFO:tasks.workunit.client.0.smithi055.stdout:7/485: link d5/d53/d6e/d6c/f84 d5/db/f8b 0 2024-04-26T21:08:13.935 INFO:tasks.workunit.client.0.smithi055.stdout:0/565: mkdir d9/d11/db3 0 2024-04-26T21:08:13.935 INFO:tasks.workunit.client.0.smithi055.stdout:9/562: link d2/d46/d51/c56 d2/d46/d9a/cba 0 2024-04-26T21:08:13.937 INFO:tasks.workunit.client.1.smithi064.stdout:3/686: creat d1/d14/feb x:0 0 0 2024-04-26T21:08:13.939 INFO:tasks.workunit.client.1.smithi064.stdout:0/717: rename dd/d21/dc8/d31/f3c to dd/d21/dc8/d31/d47/d61/ff0 0 2024-04-26T21:08:13.939 INFO:tasks.workunit.client.0.smithi055.stdout:2/578: write d4/db/d1f/d32/f5f [332060,52392] 0 2024-04-26T21:08:13.940 INFO:tasks.workunit.client.1.smithi064.stdout:9/731: mkdir d0/d4/da/d26/d5e/dee 0 2024-04-26T21:08:13.941 INFO:tasks.workunit.client.0.smithi055.stdout:6/511: dwrite d3/d17/d25/d5f/d90/f69 [0,4194304] 0 2024-04-26T21:08:13.942 INFO:tasks.workunit.client.1.smithi064.stdout:1/873: mkdir d0/d6/d29/d31/dd1/d10a 0 2024-04-26T21:08:13.943 INFO:tasks.workunit.client.1.smithi064.stdout:1/874: chown d0/d6/d11/f23 0 1 2024-04-26T21:08:13.943 INFO:tasks.workunit.client.0.smithi055.stdout:1/498: mkdir d8/df/d11/d27/d28/da4 0 2024-04-26T21:08:13.943 INFO:tasks.workunit.client.1.smithi064.stdout:7/761: symlink d6/db/d1f/d50/db8/l105 0 2024-04-26T21:08:13.946 INFO:tasks.workunit.client.1.smithi064.stdout:5/701: write dd/d12/d18/d1a/d1f/d20/f8b [728902,78632] 0 2024-04-26T21:08:13.949 INFO:tasks.workunit.client.1.smithi064.stdout:2/817: dwrite d12/da9/ff0 [4194304,4194304] 0 2024-04-26T21:08:13.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/566: mknod d9/d11/d5b/d5e/d67/cb4 0 2024-04-26T21:08:13.953 INFO:tasks.workunit.client.0.smithi055.stdout:5/407: mknod d4/c94 0 2024-04-26T21:08:13.953 INFO:tasks.workunit.client.0.smithi055.stdout:5/408: fdatasync d4/df/d13/d26/f4e 0 2024-04-26T21:08:13.953 INFO:tasks.workunit.client.0.smithi055.stdout:9/563: creat d2/d46/d77/fbb x:0 0 0 2024-04-26T21:08:13.953 INFO:tasks.workunit.client.1.smithi064.stdout:3/687: truncate d1/d27/d29/d6f/d72/da5/f7c 180888 0 2024-04-26T21:08:13.953 INFO:tasks.workunit.client.1.smithi064.stdout:3/688: fsync d1/d38/f49 0 2024-04-26T21:08:13.954 INFO:tasks.workunit.client.1.smithi064.stdout:9/732: mknod d0/d4/da/d26/d47/d9d/d76/cef 0 2024-04-26T21:08:13.954 INFO:tasks.workunit.client.1.smithi064.stdout:9/733: stat d0/d4/da/d26/d47/d6b/f70 0 2024-04-26T21:08:13.954 INFO:tasks.workunit.client.0.smithi055.stdout:2/579: mknod d4/d1e/d90/dbc/cbe 0 2024-04-26T21:08:13.954 INFO:tasks.workunit.client.0.smithi055.stdout:2/580: fdatasync d4/db/d56/d4a/f53 0 2024-04-26T21:08:13.962 INFO:tasks.workunit.client.0.smithi055.stdout:3/621: rmdir d0/d4/d5/d73/d47/d37/dbd 39 2024-04-26T21:08:13.962 INFO:tasks.workunit.client.0.smithi055.stdout:3/622: stat d0/d4/d5/d73/d47/d37/c39 0 2024-04-26T21:08:13.962 INFO:tasks.workunit.client.0.smithi055.stdout:3/623: chown d0/d4/d5/d73/d47/fb7 12 1 2024-04-26T21:08:13.965 INFO:tasks.workunit.client.0.smithi055.stdout:4/443: dwrite d4/d26/d42/d2d/f41 [0,4194304] 0 2024-04-26T21:08:13.965 INFO:tasks.workunit.client.0.smithi055.stdout:4/444: fdatasync d4/d18/d1a/d49/f8d 0 2024-04-26T21:08:13.965 INFO:tasks.workunit.client.0.smithi055.stdout:4/445: creat d4/d18/d1a/d49/f9a x:0 0 0 2024-04-26T21:08:13.966 INFO:tasks.workunit.client.1.smithi064.stdout:1/875: link d0/d6/d11/d1e/d2a/d34/d57/d9b/cf5 d0/d6/d11/d1e/d2a/d34/d57/d66/c10b 0 2024-04-26T21:08:13.966 INFO:tasks.workunit.client.1.smithi064.stdout:1/876: read - d0/d6/d11/d6c/fab zero size 2024-04-26T21:08:13.966 INFO:tasks.workunit.client.1.smithi064.stdout:7/762: chown d6/d8c/f7f 12541389 1 2024-04-26T21:08:13.972 INFO:tasks.workunit.client.0.smithi055.stdout:1/499: symlink d8/d17/d6a/la5 0 2024-04-26T21:08:13.972 INFO:tasks.workunit.client.0.smithi055.stdout:1/500: dread - d8/df/f5c zero size 2024-04-26T21:08:13.978 INFO:tasks.workunit.client.1.smithi064.stdout:0/718: link dd/d21/l28 dd/d21/dc8/lf1 0 2024-04-26T21:08:13.983 INFO:tasks.workunit.client.0.smithi055.stdout:5/409: rename d4/df/d13/f37 to d4/df/d13/f95 0 2024-04-26T21:08:13.984 INFO:tasks.workunit.client.0.smithi055.stdout:0/567: symlink d9/d8b/lb5 0 2024-04-26T21:08:13.985 INFO:tasks.workunit.client.0.smithi055.stdout:2/581: write d4/db/d26/d9a/fad [627704,46416] 0 2024-04-26T21:08:13.986 INFO:tasks.workunit.client.1.smithi064.stdout:1/877: write d0/d6/d11/d1e/d2a/d34/f69 [932861,86419] 0 2024-04-26T21:08:13.986 INFO:tasks.workunit.client.1.smithi064.stdout:1/878: write d0/d6b/d9e/da2/dc9/fe6 [2387799,111865] 0 2024-04-26T21:08:13.986 INFO:tasks.workunit.client.1.smithi064.stdout:1/879: write d0/d6b/d9e/da2/dc9/fe6 [1360313,95704] 0 2024-04-26T21:08:13.986 INFO:tasks.workunit.client.0.smithi055.stdout:9/564: rename d2/d14/l18 to d2/lbc 0 2024-04-26T21:08:13.988 INFO:tasks.workunit.client.1.smithi064.stdout:9/734: rename d0/d4/d28/f30 to d0/d4/da/d26/d5e/dee/ff0 0 2024-04-26T21:08:13.989 INFO:tasks.workunit.client.0.smithi055.stdout:4/446: link d4/d26/d42/d2d/f41 d4/d23/f9b 0 2024-04-26T21:08:13.991 INFO:tasks.workunit.client.1.smithi064.stdout:6/704: dwrite d4/f2f [4194304,4194304] 0 2024-04-26T21:08:13.991 INFO:tasks.workunit.client.1.smithi064.stdout:6/705: chown d4/d7/dce 1004930 1 2024-04-26T21:08:13.995 INFO:tasks.workunit.client.0.smithi055.stdout:6/512: rmdir d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/da9 0 2024-04-26T21:08:13.995 INFO:tasks.workunit.client.1.smithi064.stdout:0/719: mkdir dd/d10/d18/d58/df2 0 2024-04-26T21:08:13.996 INFO:tasks.workunit.client.1.smithi064.stdout:0/720: creat dd/ff3 x:0 0 0 2024-04-26T21:08:13.997 INFO:tasks.workunit.client.0.smithi055.stdout:0/568: dread d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:13.999 INFO:tasks.workunit.client.1.smithi064.stdout:5/702: dread dd/da9/d48/d6a/d81/f77 [0,4194304] 0 2024-04-26T21:08:14.002 INFO:tasks.workunit.client.1.smithi064.stdout:9/735: mkdir d0/d4/da/d26/d5e/dd8/df1 0 2024-04-26T21:08:14.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/721: symlink dd/d21/dc8/d31/d43/db4/lf4 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/648: dwrite d10/d41/d4e/d59/fc5 [0,4194304] 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/649: write d10/d1d/d38/fb0 [250891,50718] 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/650: write d10/d41/d4e/d54/faf [904136,96113] 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/736: mkdir d0/d4/da/d67/dd0/df2 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/651: write d10/d41/d4e/d60/fad [189032,26878] 0 2024-04-26T21:08:14.013 INFO:tasks.workunit.client.1.smithi064.stdout:9/737: truncate d0/d4/da/d26/d45/d90/fbc 1022432 0 2024-04-26T21:08:14.014 INFO:tasks.workunit.client.0.smithi055.stdout:2/582: rmdir d4/d1e 39 2024-04-26T21:08:14.014 INFO:tasks.workunit.client.0.smithi055.stdout:5/410: creat d4/df/d13/d26/d3c/d4a/d3f/f96 x:0 0 0 2024-04-26T21:08:14.014 INFO:tasks.workunit.client.0.smithi055.stdout:2/583: dread - d4/d55/d6c/f9e zero size 2024-04-26T21:08:14.014 INFO:tasks.workunit.client.0.smithi055.stdout:4/447: rename d4/d26/d42/d2d/c83 to d4/d18/d1a/d49/c9c 0 2024-04-26T21:08:14.018 INFO:tasks.workunit.client.0.smithi055.stdout:8/472: dwrite d3/d77/f78 [4194304,4194304] 0 2024-04-26T21:08:14.018 INFO:tasks.workunit.client.0.smithi055.stdout:8/473: truncate d3/d9/d1f/d2e/d75/f6c 449281 0 2024-04-26T21:08:14.018 INFO:tasks.workunit.client.0.smithi055.stdout:8/474: chown d3/d9/d1d/d48/d57/f6f 1838 1 2024-04-26T21:08:14.019 INFO:tasks.workunit.client.0.smithi055.stdout:2/584: rmdir d4/db 39 2024-04-26T21:08:14.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/585: mkdir d4/d55/da1/dbf 0 2024-04-26T21:08:14.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/586: fsync d4/db/d26/f4d 0 2024-04-26T21:08:14.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/587: stat d4/d1e/d90 0 2024-04-26T21:08:14.023 INFO:tasks.workunit.client.0.smithi055.stdout:2/588: chown d4/db/d56/d4a 113806 1 2024-04-26T21:08:14.024 INFO:tasks.workunit.client.1.smithi064.stdout:3/689: read d1/d27/d29/f92 [469751,78473] 0 2024-04-26T21:08:14.024 INFO:tasks.workunit.client.0.smithi055.stdout:7/486: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:08:14.025 INFO:tasks.workunit.client.0.smithi055.stdout:2/589: unlink d4/d49/f50 0 2024-04-26T21:08:14.025 INFO:tasks.workunit.client.0.smithi055.stdout:2/590: chown d4/db/d1f/d46/f79 306460 1 2024-04-26T21:08:14.026 INFO:tasks.workunit.client.0.smithi055.stdout:2/591: write d4/d1e/d2a/f30 [4465993,24505] 0 2024-04-26T21:08:14.027 INFO:tasks.workunit.client.0.smithi055.stdout:7/487: mkdir d5/d11/d8c 0 2024-04-26T21:08:14.027 INFO:tasks.workunit.client.0.smithi055.stdout:7/488: stat d5/d6/d39/l5a 0 2024-04-26T21:08:14.028 INFO:tasks.workunit.client.1.smithi064.stdout:7/763: write d6/d15/d88/dca/f9d [2389852,55033] 0 2024-04-26T21:08:14.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/501: dwrite d8/df/f8e [0,4194304] 0 2024-04-26T21:08:14.031 INFO:tasks.workunit.client.0.smithi055.stdout:7/489: mknod d5/d6/d24/c8d 0 2024-04-26T21:08:14.032 INFO:tasks.workunit.client.1.smithi064.stdout:3/690: mkdir d1/d27/d50/d35/d4c/d7b/dec 0 2024-04-26T21:08:14.033 INFO:tasks.workunit.client.0.smithi055.stdout:7/490: creat d5/d6/d24/d48/d7f/f8e x:0 0 0 2024-04-26T21:08:14.033 INFO:tasks.workunit.client.1.smithi064.stdout:2/818: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/fbc [0,4194304] 0 2024-04-26T21:08:14.044 INFO:tasks.workunit.client.0.smithi055.stdout:3/624: dwrite d0/d4/d5/d73/d13/d1a/d46/d72/d69/fbb [0,4194304] 0 2024-04-26T21:08:14.044 INFO:tasks.workunit.client.0.smithi055.stdout:3/625: creat d0/d4/d5/d73/d13/d1a/d46/fda x:0 0 0 2024-04-26T21:08:14.045 INFO:tasks.workunit.client.1.smithi064.stdout:2/819: truncate d12/d41/d73/d83/d94/d3a/d46/d91/fca 368949 0 2024-04-26T21:08:14.045 INFO:tasks.workunit.client.1.smithi064.stdout:7/764: dread d6/d15/d1c/f25 [0,4194304] 0 2024-04-26T21:08:14.046 INFO:tasks.workunit.client.1.smithi064.stdout:7/765: chown d6/db/d34 3 1 2024-04-26T21:08:14.050 INFO:tasks.workunit.client.1.smithi064.stdout:6/706: dwrite d4/d7/d12/d49/d4b/d5a/d79/f90 [0,4194304] 0 2024-04-26T21:08:14.051 INFO:tasks.workunit.client.1.smithi064.stdout:2/820: rmdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f 39 2024-04-26T21:08:14.053 INFO:tasks.workunit.client.0.smithi055.stdout:0/569: rename d9/d11/d5b/d5e to d9/dc/d1c/d3e/d7d/da3/d97/db6 0 2024-04-26T21:08:14.062 INFO:tasks.workunit.client.0.smithi055.stdout:2/592: read d4/dc/f11 [154208,34318] 0 2024-04-26T21:08:14.067 INFO:tasks.workunit.client.0.smithi055.stdout:2/593: fsync d4/dc/f1d 0 2024-04-26T21:08:14.069 INFO:tasks.workunit.client.0.smithi055.stdout:3/626: dread d0/d4/d5/d73/d13/d1a/d46/d72/f53 [0,4194304] 0 2024-04-26T21:08:14.084 INFO:tasks.workunit.client.1.smithi064.stdout:6/707: getdents d4/d7/d12/d49/d4b/d5a 0 2024-04-26T21:08:14.084 INFO:tasks.workunit.client.1.smithi064.stdout:6/708: write d4/d7/d12/fbe [112557,122640] 0 2024-04-26T21:08:14.094 INFO:tasks.workunit.client.0.smithi055.stdout:5/411: dwrite d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f91 [0,4194304] 0 2024-04-26T21:08:14.096 INFO:tasks.workunit.client.0.smithi055.stdout:2/594: write d4/db/d26/f7b [834850,68942] 0 2024-04-26T21:08:14.096 INFO:tasks.workunit.client.0.smithi055.stdout:2/595: read - d4/d14/d17/f5d zero size 2024-04-26T21:08:14.100 INFO:tasks.workunit.client.0.smithi055.stdout:1/502: rename d8/d17/c76 to d8/df/d11/d27/d28/ca6 0 2024-04-26T21:08:14.101 INFO:tasks.workunit.client.0.smithi055.stdout:8/475: dwrite d3/d9/d1f/d2e/d75/d76/f81 [0,4194304] 0 2024-04-26T21:08:14.101 INFO:tasks.workunit.client.0.smithi055.stdout:8/476: chown d3 919134 1 2024-04-26T21:08:14.104 INFO:tasks.workunit.client.0.smithi055.stdout:6/513: dwrite d3/d17/d46/d54/d66/d6a/f56 [0,4194304] 0 2024-04-26T21:08:14.108 INFO:tasks.workunit.client.1.smithi064.stdout:7/766: dwrite d6/d8c/f89 [0,4194304] 0 2024-04-26T21:08:14.111 INFO:tasks.workunit.client.0.smithi055.stdout:6/514: write d3/d17/d46/d54/d66/d6a/d51/d58/d62/fa4 [480192,115140] 0 2024-04-26T21:08:14.111 INFO:tasks.workunit.client.1.smithi064.stdout:2/821: unlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f112 0 2024-04-26T21:08:14.111 INFO:tasks.workunit.client.1.smithi064.stdout:2/822: write d12/d41/d61/fbd [860257,88513] 0 2024-04-26T21:08:14.112 INFO:tasks.workunit.client.1.smithi064.stdout:2/823: write d12/d41/d73/d83/f8d [4358098,65775] 0 2024-04-26T21:08:14.113 INFO:tasks.workunit.client.1.smithi064.stdout:9/738: dwrite d0/d4/da/d67/dd0/dd2/f9f [0,4194304] 0 2024-04-26T21:08:14.117 INFO:tasks.workunit.client.0.smithi055.stdout:8/477: dread d3/d9/d44/f58 [0,4194304] 0 2024-04-26T21:08:14.118 INFO:tasks.workunit.client.1.smithi064.stdout:8/652: dwrite d10/d1d/da3/fc1 [0,4194304] 0 2024-04-26T21:08:14.118 INFO:tasks.workunit.client.1.smithi064.stdout:8/653: creat d10/d41/d4e/d54/fcf x:0 0 0 2024-04-26T21:08:14.118 INFO:tasks.workunit.client.0.smithi055.stdout:4/448: dwrite d4/d12/d17/f19 [0,4194304] 0 2024-04-26T21:08:14.119 INFO:tasks.workunit.client.0.smithi055.stdout:4/449: write d4/d12/f43 [3195526,128482] 0 2024-04-26T21:08:14.119 INFO:tasks.workunit.client.0.smithi055.stdout:4/450: getdents d4/d18/d8e 0 2024-04-26T21:08:14.120 INFO:tasks.workunit.client.0.smithi055.stdout:3/627: mkdir d0/d4/d5/d73/d13/d27/ddb 0 2024-04-26T21:08:14.120 INFO:tasks.workunit.client.0.smithi055.stdout:9/565: dwrite d2/d46/d77/f62 [0,4194304] 0 2024-04-26T21:08:14.122 INFO:tasks.workunit.client.0.smithi055.stdout:0/570: dwrite d9/dc/d1c/d3e/fa2 [0,4194304] 0 2024-04-26T21:08:14.124 INFO:tasks.workunit.client.1.smithi064.stdout:6/709: unlink d4/d7/d12/d49/d4b/d5a/d8f/fc6 0 2024-04-26T21:08:14.124 INFO:tasks.workunit.client.1.smithi064.stdout:8/654: dread d10/d1d/d38/fb0 [0,4194304] 0 2024-04-26T21:08:14.133 INFO:tasks.workunit.client.0.smithi055.stdout:5/412: rmdir d4/df/d13/d26/d63 39 2024-04-26T21:08:14.137 INFO:tasks.workunit.client.0.smithi055.stdout:6/515: dread d3/d17/d19/d71/f4d [0,4194304] 0 2024-04-26T21:08:14.137 INFO:tasks.workunit.client.0.smithi055.stdout:6/516: dread - d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d zero size 2024-04-26T21:08:14.138 INFO:tasks.workunit.client.0.smithi055.stdout:2/596: creat d4/db/d1f/d32/d57/fc0 x:0 0 0 2024-04-26T21:08:14.139 INFO:tasks.workunit.client.1.smithi064.stdout:0/722: write dd/d10/d18/f29 [335378,7228] 0 2024-04-26T21:08:14.139 INFO:tasks.workunit.client.1.smithi064.stdout:0/723: chown dd/d10/d18/d58/dba 232924 1 2024-04-26T21:08:14.140 INFO:tasks.workunit.client.0.smithi055.stdout:6/517: read d3/d17/d46/d54/d66/d6a/d51/d58/d62/fa4 [1359277,118691] 0 2024-04-26T21:08:14.141 INFO:tasks.workunit.client.0.smithi055.stdout:6/518: fdatasync d3/d17/d46/f7f 0 2024-04-26T21:08:14.141 INFO:tasks.workunit.client.1.smithi064.stdout:9/739: mkdir d0/d4/d28/df3 0 2024-04-26T21:08:14.143 INFO:tasks.workunit.client.0.smithi055.stdout:2/597: write d4/db/d1f/fb8 [472322,3610] 0 2024-04-26T21:08:14.143 INFO:tasks.workunit.client.0.smithi055.stdout:8/478: write d3/d9/d44/f67 [380921,37860] 0 2024-04-26T21:08:14.151 INFO:tasks.workunit.client.0.smithi055.stdout:1/503: mkdir d8/df/d11/d27/d28/d2a/da7 0 2024-04-26T21:08:14.152 INFO:tasks.workunit.client.0.smithi055.stdout:1/504: write d8/df/d11/d27/f3a [1487197,112578] 0 2024-04-26T21:08:14.152 INFO:tasks.workunit.client.0.smithi055.stdout:1/505: readlink d8/d17/d6a/l43 0 2024-04-26T21:08:14.162 INFO:tasks.workunit.client.0.smithi055.stdout:4/451: getdents d4/d12/d17/d3d 0 2024-04-26T21:08:14.166 INFO:tasks.workunit.client.1.smithi064.stdout:7/767: dwrite d6/d15/d88/dca/f49 [0,4194304] 0 2024-04-26T21:08:14.166 INFO:tasks.workunit.client.1.smithi064.stdout:7/768: fdatasync d6/d8c/d9e/f101 0 2024-04-26T21:08:14.168 INFO:tasks.workunit.client.0.smithi055.stdout:9/566: symlink d2/lbd 0 2024-04-26T21:08:14.170 INFO:tasks.workunit.client.1.smithi064.stdout:0/724: truncate dd/d21/dc8/d31/f37 5078123 0 2024-04-26T21:08:14.172 INFO:tasks.workunit.client.1.smithi064.stdout:4/810: sync 2024-04-26T21:08:14.172 INFO:tasks.workunit.client.1.smithi064.stdout:4/811: creat d0/d1d/d56/d89/f110 x:0 0 0 2024-04-26T21:08:14.178 INFO:tasks.workunit.client.1.smithi064.stdout:9/740: rename d0/l8 to d0/d4/da/d67/dd0/dd2/lf4 0 2024-04-26T21:08:14.194 INFO:tasks.workunit.client.0.smithi055.stdout:6/519: creat d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/fb9 x:0 0 0 2024-04-26T21:08:14.194 INFO:tasks.workunit.client.0.smithi055.stdout:6/520: read - d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d zero size 2024-04-26T21:08:14.194 INFO:tasks.workunit.client.0.smithi055.stdout:6/521: truncate d3/d17/d25/f9c 51925 0 2024-04-26T21:08:14.194 INFO:tasks.workunit.client.0.smithi055.stdout:6/522: fsync d3/d17/d25/d5f/fb1 0 2024-04-26T21:08:14.195 INFO:tasks.workunit.client.1.smithi064.stdout:0/725: unlink dd/d21/dc8/d31/d43/lb6 0 2024-04-26T21:08:14.197 INFO:tasks.workunit.client.1.smithi064.stdout:2/824: truncate d12/d41/d73/d83/f8d 3127334 0 2024-04-26T21:08:14.198 INFO:tasks.workunit.client.1.smithi064.stdout:2/825: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f106 [239342,89647] 0 2024-04-26T21:08:14.198 INFO:tasks.workunit.client.0.smithi055.stdout:1/506: dwrite d8/d17/d1b/f62 [0,4194304] 0 2024-04-26T21:08:14.207 INFO:tasks.workunit.client.1.smithi064.stdout:4/812: unlink d0/d1d/d21/d9c/fa2 0 2024-04-26T21:08:14.207 INFO:tasks.workunit.client.1.smithi064.stdout:4/813: stat d0/d1d/d17/d44/cc2 0 2024-04-26T21:08:14.207 INFO:tasks.workunit.client.1.smithi064.stdout:4/814: creat d0/d1d/d17/d9b/f111 x:0 0 0 2024-04-26T21:08:14.211 INFO:tasks.workunit.client.1.smithi064.stdout:9/741: rename d0/d4/d7/df/fa0 to d0/d4/d7/df/da4/ff5 0 2024-04-26T21:08:14.214 INFO:tasks.workunit.client.1.smithi064.stdout:7/769: rmdir d6/d8c 39 2024-04-26T21:08:14.215 INFO:tasks.workunit.client.1.smithi064.stdout:2/826: creat d12/d45/dd7/df9/f115 x:0 0 0 2024-04-26T21:08:14.220 INFO:tasks.workunit.client.1.smithi064.stdout:4/815: mknod d0/d5/d13/d6d/c112 0 2024-04-26T21:08:14.220 INFO:tasks.workunit.client.1.smithi064.stdout:4/816: chown d0/d5/d13/d33/le8 126 1 2024-04-26T21:08:14.220 INFO:tasks.workunit.client.1.smithi064.stdout:4/817: fdatasync d0/d1d/d17/d44/dac/f67 0 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:4/452: rmdir d4/d12/d17/d3d 39 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:3/628: rmdir d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3 39 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:9/567: mknod d2/d14/cbe 0 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:4/453: write d4/d12/d17/f6e [1072119,117537] 0 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:2/598: dwrite d4/db/d1f/d46/d51/fbb [0,4194304] 0 2024-04-26T21:08:14.221 INFO:tasks.workunit.client.0.smithi055.stdout:6/523: chown d3/da5 1994 1 2024-04-26T21:08:14.222 INFO:tasks.workunit.client.0.smithi055.stdout:6/524: readlink d3/d17/d19/d7b/lb7 0 2024-04-26T21:08:14.228 INFO:tasks.workunit.client.1.smithi064.stdout:0/726: dread dd/d10/d74/f68 [0,4194304] 0 2024-04-26T21:08:14.228 INFO:tasks.workunit.client.1.smithi064.stdout:0/727: chown dd/d21/dc8/d31/d43/fa6 3 1 2024-04-26T21:08:14.232 INFO:tasks.workunit.client.0.smithi055.stdout:3/629: truncate d0/d4/d5/d73/d13/d1a/f54 1964713 0 2024-04-26T21:08:14.232 INFO:tasks.workunit.client.1.smithi064.stdout:3/691: sync 2024-04-26T21:08:14.232 INFO:tasks.workunit.client.1.smithi064.stdout:5/703: sync 2024-04-26T21:08:14.232 INFO:tasks.workunit.client.1.smithi064.stdout:1/880: sync 2024-04-26T21:08:14.234 INFO:tasks.workunit.client.1.smithi064.stdout:2/827: mkdir d12/d45/d116 0 2024-04-26T21:08:14.235 INFO:tasks.workunit.client.0.smithi055.stdout:9/568: mkdir d2/d46/d77/d7d/dbf 0 2024-04-26T21:08:14.238 INFO:tasks.workunit.client.0.smithi055.stdout:4/454: unlink d4/d12/d17/d3d/l6c 0 2024-04-26T21:08:14.239 INFO:tasks.workunit.client.0.smithi055.stdout:5/413: write d4/f9 [533626,68202] 0 2024-04-26T21:08:14.239 INFO:tasks.workunit.client.1.smithi064.stdout:9/742: getdents d0/d4/da/d67 0 2024-04-26T21:08:14.240 INFO:tasks.workunit.client.0.smithi055.stdout:7/491: dwrite d5/f21 [0,4194304] 0 2024-04-26T21:08:14.243 INFO:tasks.workunit.client.0.smithi055.stdout:6/525: mknod d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/cba 0 2024-04-26T21:08:14.243 INFO:tasks.workunit.client.0.smithi055.stdout:6/526: write d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d [465831,58090] 0 2024-04-26T21:08:14.243 INFO:tasks.workunit.client.0.smithi055.stdout:6/527: creat d3/d17/d25/fbb x:0 0 0 2024-04-26T21:08:14.245 INFO:tasks.workunit.client.1.smithi064.stdout:1/881: rename d0/c7 to d0/d22/d9f/df1/dfa/c10c 0 2024-04-26T21:08:14.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/630: unlink d0/d4/d5/d73/d13/d27/d3b/l3e 0 2024-04-26T21:08:14.251 INFO:tasks.workunit.client.1.smithi064.stdout:3/692: dread d1/d14/f5a [0,4194304] 0 2024-04-26T21:08:14.252 INFO:tasks.workunit.client.1.smithi064.stdout:9/743: mkdir d0/d4/d7/df6 0 2024-04-26T21:08:14.252 INFO:tasks.workunit.client.1.smithi064.stdout:9/744: chown d0/d4/da/faa 7390833 1 2024-04-26T21:08:14.255 INFO:tasks.workunit.client.1.smithi064.stdout:1/882: unlink d0/d6/d11/d6c/dda/f109 0 2024-04-26T21:08:14.257 INFO:tasks.workunit.client.0.smithi055.stdout:9/569: creat d2/fc0 x:0 0 0 2024-04-26T21:08:14.257 INFO:tasks.workunit.client.0.smithi055.stdout:9/570: creat d2/d14/fc1 x:0 0 0 2024-04-26T21:08:14.257 INFO:tasks.workunit.client.0.smithi055.stdout:4/455: link d4/d12/d15/f67 d4/d26/d42/d28/d53/d71/d7f/f9d 0 2024-04-26T21:08:14.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/828: getdents d12/d41/d61/d75 0 2024-04-26T21:08:14.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/829: fdatasync d12/d88/f102 0 2024-04-26T21:08:14.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/830: write d12/d41/d73/d83/fb2 [487104,8146] 0 2024-04-26T21:08:14.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/831: chown d12/c2e 6 1 2024-04-26T21:08:14.260 INFO:tasks.workunit.client.1.smithi064.stdout:2/832: read d12/d41/d73/d83/d94/d3a/f79 [834635,28484] 0 2024-04-26T21:08:14.264 INFO:tasks.workunit.client.0.smithi055.stdout:5/414: rename d4/df/d13/d26/d3c/d4a/d3f/d4f/f60 to d4/df/d13/f97 0 2024-04-26T21:08:14.266 INFO:tasks.workunit.client.1.smithi064.stdout:8/655: sync 2024-04-26T21:08:14.266 INFO:tasks.workunit.client.1.smithi064.stdout:8/656: chown d10/c14 1 1 2024-04-26T21:08:14.266 INFO:tasks.workunit.client.1.smithi064.stdout:8/657: write d10/d1d/f29 [2667995,43451] 0 2024-04-26T21:08:14.266 INFO:tasks.workunit.client.1.smithi064.stdout:8/658: fsync d10/d41/d4e/fbb 0 2024-04-26T21:08:14.268 INFO:tasks.workunit.client.1.smithi064.stdout:9/745: mkdir d0/d4/da/d31/d34/df7 0 2024-04-26T21:08:14.268 INFO:tasks.workunit.client.1.smithi064.stdout:9/746: write d0/d4/da/f29 [4921497,76775] 0 2024-04-26T21:08:14.268 INFO:tasks.workunit.client.1.smithi064.stdout:6/710: sync 2024-04-26T21:08:14.268 INFO:tasks.workunit.client.1.smithi064.stdout:6/711: chown d4/d7/d12/fbf 2067 1 2024-04-26T21:08:14.268 INFO:tasks.workunit.client.1.smithi064.stdout:6/712: write d4/d7/fd [974724,13536] 0 2024-04-26T21:08:14.273 INFO:tasks.workunit.client.1.smithi064.stdout:1/883: mknod d0/d6b/d9e/da2/c10d 0 2024-04-26T21:08:14.274 INFO:tasks.workunit.client.1.smithi064.stdout:1/884: chown d0/d6b/fa8 0 1 2024-04-26T21:08:14.281 INFO:tasks.workunit.client.1.smithi064.stdout:3/693: dread d1/d27/d50/f39 [0,4194304] 0 2024-04-26T21:08:14.281 INFO:tasks.workunit.client.1.smithi064.stdout:3/694: chown d1/d27/d29/d6f/d72/d26/l28 230869438 1 2024-04-26T21:08:14.286 INFO:tasks.workunit.client.1.smithi064.stdout:8/659: symlink d10/d41/d4e/d54/db3/ld0 0 2024-04-26T21:08:14.286 INFO:tasks.workunit.client.1.smithi064.stdout:8/660: chown d10/d1d/c23 1292658 1 2024-04-26T21:08:14.286 INFO:tasks.workunit.client.1.smithi064.stdout:8/661: chown d10/c17 3114 1 2024-04-26T21:08:14.286 INFO:tasks.workunit.client.1.smithi064.stdout:8/662: fdatasync d10/d41/d4e/d54/f57 0 2024-04-26T21:08:14.287 INFO:tasks.workunit.client.0.smithi055.stdout:3/631: mknod d0/d4/d5/d73/d47/d37/da6/cdc 0 2024-04-26T21:08:14.287 INFO:tasks.workunit.client.0.smithi055.stdout:3/632: chown d0/d4/d16/d18/d4b/d57/d8e/db1 7948 1 2024-04-26T21:08:14.290 INFO:tasks.workunit.client.1.smithi064.stdout:7/770: dread d6/d9/d3d/f6e [0,4194304] 0 2024-04-26T21:08:14.290 INFO:tasks.workunit.client.1.smithi064.stdout:9/747: creat d0/d4/da/d31/ff8 x:0 0 0 2024-04-26T21:08:14.291 INFO:tasks.workunit.client.1.smithi064.stdout:0/728: dwrite dd/d21/dc8/d31/d43/fb9 [0,4194304] 0 2024-04-26T21:08:14.291 INFO:tasks.workunit.client.1.smithi064.stdout:0/729: chown dd/d21/db8 112981303 1 2024-04-26T21:08:14.300 INFO:tasks.workunit.client.1.smithi064.stdout:6/713: unlink d4/f28 0 2024-04-26T21:08:14.301 INFO:tasks.workunit.client.0.smithi055.stdout:5/415: chown d4/df/l5f 236930 1 2024-04-26T21:08:14.303 INFO:tasks.workunit.client.1.smithi064.stdout:1/885: symlink d0/d6/d76/l10e 0 2024-04-26T21:08:14.305 INFO:tasks.workunit.client.0.smithi055.stdout:7/492: dwrite d5/d11/f5d [0,4194304] 0 2024-04-26T21:08:14.305 INFO:tasks.workunit.client.0.smithi055.stdout:6/528: unlink d3/l31 0 2024-04-26T21:08:14.305 INFO:tasks.workunit.client.0.smithi055.stdout:6/529: truncate d3/d17/d19/d71/f53 1736932 0 2024-04-26T21:08:14.307 INFO:tasks.workunit.client.1.smithi064.stdout:2/833: dread d12/d41/d61/d75/f2c [0,4194304] 0 2024-04-26T21:08:14.307 INFO:tasks.workunit.client.1.smithi064.stdout:2/834: stat d12/d41/d73/d83/d94/d3a/dba/ce9 0 2024-04-26T21:08:14.307 INFO:tasks.workunit.client.1.smithi064.stdout:2/835: chown d12/d41/d73/d83/d94/d3a/d5d/fc3 7 1 2024-04-26T21:08:14.307 INFO:tasks.workunit.client.1.smithi064.stdout:8/663: rename d10/d1d/l2c to d10/d1d/d38/ld1 0 2024-04-26T21:08:14.312 INFO:tasks.workunit.client.0.smithi055.stdout:9/571: dwrite d2/f92 [0,4194304] 0 2024-04-26T21:08:14.312 INFO:tasks.workunit.client.0.smithi055.stdout:9/572: readlink d2/d14/d97/d9b/la3 0 2024-04-26T21:08:14.312 INFO:tasks.workunit.client.1.smithi064.stdout:0/730: symlink dd/d21/dc8/d31/d43/db4/dc2/lf5 0 2024-04-26T21:08:14.315 INFO:tasks.workunit.client.0.smithi055.stdout:2/599: dwrite d4/dc/d21/f96 [0,4194304] 0 2024-04-26T21:08:14.318 INFO:tasks.workunit.client.1.smithi064.stdout:1/886: symlink d0/d6/l10f 0 2024-04-26T21:08:14.319 INFO:tasks.workunit.client.0.smithi055.stdout:5/416: creat d4/df/d13/d26/d3c/d4a/f98 x:0 0 0 2024-04-26T21:08:14.319 INFO:tasks.workunit.client.0.smithi055.stdout:5/417: write d4/df/f6b [739300,124522] 0 2024-04-26T21:08:14.320 INFO:tasks.workunit.client.1.smithi064.stdout:6/714: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:08:14.320 INFO:tasks.workunit.client.1.smithi064.stdout:6/715: chown d4/d7/d12/d49/d4b/d56/dcf 221000649 1 2024-04-26T21:08:14.320 INFO:tasks.workunit.client.1.smithi064.stdout:2/836: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d117 0 2024-04-26T21:08:14.321 INFO:tasks.workunit.client.1.smithi064.stdout:7/771: rename d6/d9/f11 to d6/db/d34/f106 0 2024-04-26T21:08:14.322 INFO:tasks.workunit.client.0.smithi055.stdout:7/493: symlink d5/d6/d24/d3b/l8f 0 2024-04-26T21:08:14.323 INFO:tasks.workunit.client.0.smithi055.stdout:7/494: write d5/d6/d24/f50 [4687717,93902] 0 2024-04-26T21:08:14.323 INFO:tasks.workunit.client.1.smithi064.stdout:8/664: symlink d10/ld2 0 2024-04-26T21:08:14.323 INFO:tasks.workunit.client.1.smithi064.stdout:8/665: creat d10/d2f/d56/fd3 x:0 0 0 2024-04-26T21:08:14.327 INFO:tasks.workunit.client.1.smithi064.stdout:0/731: mkdir dd/df6 0 2024-04-26T21:08:14.329 INFO:tasks.workunit.client.1.smithi064.stdout:1/887: symlink d0/d22/d9f/df1/dfa/l110 0 2024-04-26T21:08:14.329 INFO:tasks.workunit.client.1.smithi064.stdout:1/888: chown d0/d6/ff 1045466217 1 2024-04-26T21:08:14.331 INFO:tasks.workunit.client.0.smithi055.stdout:2/600: write d4/dc/f71 [4026700,15518] 0 2024-04-26T21:08:14.333 INFO:tasks.workunit.client.0.smithi055.stdout:3/633: dwrite d0/d4/d5/d73/d13/d27/d3b/faf [0,4194304] 0 2024-04-26T21:08:14.335 INFO:tasks.workunit.client.1.smithi064.stdout:6/716: dread d4/d7/d12/d38/f61 [0,4194304] 0 2024-04-26T21:08:14.335 INFO:tasks.workunit.client.1.smithi064.stdout:3/695: dwrite d1/d27/d50/d35/fe4 [0,4194304] 0 2024-04-26T21:08:14.336 INFO:tasks.workunit.client.0.smithi055.stdout:7/495: truncate d5/d6/f41 2558569 0 2024-04-26T21:08:14.340 INFO:tasks.workunit.client.1.smithi064.stdout:2/837: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/f9e 651428 0 2024-04-26T21:08:14.340 INFO:tasks.workunit.client.1.smithi064.stdout:2/838: fsync d12/d45/dd7/df9/f115 0 2024-04-26T21:08:14.341 INFO:tasks.workunit.client.1.smithi064.stdout:0/732: getdents dd/d10/d74/d1d/db1 0 2024-04-26T21:08:14.341 INFO:tasks.workunit.client.1.smithi064.stdout:0/733: chown dd/d21/dc8/d31/d47 1249177 1 2024-04-26T21:08:14.341 INFO:tasks.workunit.client.0.smithi055.stdout:9/573: rmdir d2/d46/d51 39 2024-04-26T21:08:14.341 INFO:tasks.workunit.client.0.smithi055.stdout:9/574: creat d2/d11/fc2 x:0 0 0 2024-04-26T21:08:14.341 INFO:tasks.workunit.client.1.smithi064.stdout:1/889: creat d0/d6/d76/de7/f111 x:0 0 0 2024-04-26T21:08:14.343 INFO:tasks.workunit.client.0.smithi055.stdout:2/601: link d4/db/d1f/d32/d57/l9d d4/db/d8f/da6/lc1 0 2024-04-26T21:08:14.343 INFO:tasks.workunit.client.1.smithi064.stdout:7/772: write d6/db/d34/d6f/d81/fae [2376689,22227] 0 2024-04-26T21:08:14.352 INFO:tasks.workunit.client.0.smithi055.stdout:5/418: getdents d4/df/d13/d26/d3c/d4a/d3f 0 2024-04-26T21:08:14.352 INFO:tasks.workunit.client.0.smithi055.stdout:5/419: write d4/df/d13/d26/d3c/d4a/d3f/f6a [400207,3625] 0 2024-04-26T21:08:14.354 INFO:tasks.workunit.client.1.smithi064.stdout:5/704: dwrite dd/d12/f40 [0,4194304] 0 2024-04-26T21:08:14.355 INFO:tasks.workunit.client.0.smithi055.stdout:3/634: symlink d0/d4/d5/d73/ldd 0 2024-04-26T21:08:14.356 INFO:tasks.workunit.client.1.smithi064.stdout:2/839: creat d12/d45/f118 x:0 0 0 2024-04-26T21:08:14.356 INFO:tasks.workunit.client.1.smithi064.stdout:0/734: creat dd/df6/ff7 x:0 0 0 2024-04-26T21:08:14.358 INFO:tasks.workunit.client.0.smithi055.stdout:6/530: rmdir d3/d9b 39 2024-04-26T21:08:14.358 INFO:tasks.workunit.client.0.smithi055.stdout:6/531: readlink d3/d17/d46/d54/d66/d6a/d51/d58/d73/l75 0 2024-04-26T21:08:14.361 INFO:tasks.workunit.client.1.smithi064.stdout:1/890: mkdir d0/d6/d11/d2c/d112 0 2024-04-26T21:08:14.361 INFO:tasks.workunit.client.1.smithi064.stdout:1/891: chown d0/d6/d11/d1e/d2a/lcb 11058 1 2024-04-26T21:08:14.363 INFO:tasks.workunit.client.0.smithi055.stdout:5/420: link d4/l85 d4/df/d13/l99 0 2024-04-26T21:08:14.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/773: creat d6/d15/d1c/d45/f107 x:0 0 0 2024-04-26T21:08:14.369 INFO:tasks.workunit.client.0.smithi055.stdout:3/635: mknod d0/d4/d16/d18/d4b/cde 0 2024-04-26T21:08:14.371 INFO:tasks.workunit.client.1.smithi064.stdout:6/717: rmdir d4/d7/d12/d49/d4b/d7d 39 2024-04-26T21:08:14.374 INFO:tasks.workunit.client.0.smithi055.stdout:6/532: symlink d3/d17/d46/d54/lbc 0 2024-04-26T21:08:14.374 INFO:tasks.workunit.client.1.smithi064.stdout:8/666: dwrite d10/d2f/d90/f93 [0,4194304] 0 2024-04-26T21:08:14.378 INFO:tasks.workunit.client.0.smithi055.stdout:5/421: creat d4/df/d13/d26/d3c/d4a/d92/f9a x:0 0 0 2024-04-26T21:08:14.379 INFO:tasks.workunit.client.0.smithi055.stdout:3/636: creat d0/d4/d5/d73/d47/d37/dbd/fdf x:0 0 0 2024-04-26T21:08:14.380 INFO:tasks.workunit.client.1.smithi064.stdout:1/892: write d0/d22/f5f [1218933,73058] 0 2024-04-26T21:08:14.384 INFO:tasks.workunit.client.0.smithi055.stdout:6/533: rename d3/d17/d19/c2f to d3/d17/d46/d54/d66/d6a/d67/d83/d96/cbd 0 2024-04-26T21:08:14.391 INFO:tasks.workunit.client.1.smithi064.stdout:5/705: symlink dd/da9/d48/dac/le4 0 2024-04-26T21:08:14.391 INFO:tasks.workunit.client.1.smithi064.stdout:5/706: truncate dd/d12/d18/d1a/d1f/dca/fde 4660653 0 2024-04-26T21:08:14.395 INFO:tasks.workunit.client.0.smithi055.stdout:2/602: dwrite d4/d55/da1/fb3 [0,4194304] 0 2024-04-26T21:08:14.395 INFO:tasks.workunit.client.0.smithi055.stdout:2/603: write d4/db/d26/f8d [735862,35758] 0 2024-04-26T21:08:14.396 INFO:tasks.workunit.client.1.smithi064.stdout:0/735: creat dd/d10/d74/d1d/db1/ff8 x:0 0 0 2024-04-26T21:08:14.397 INFO:tasks.workunit.client.1.smithi064.stdout:7/774: chown d6/caa 7 1 2024-04-26T21:08:14.405 INFO:tasks.workunit.client.0.smithi055.stdout:2/604: creat d4/db/fc2 x:0 0 0 2024-04-26T21:08:14.405 INFO:tasks.workunit.client.0.smithi055.stdout:2/605: write d4/db/d56/f70 [781310,44242] 0 2024-04-26T21:08:14.411 INFO:tasks.workunit.client.0.smithi055.stdout:6/534: rename d3/d17/d46/d54/d66/d6a/d6b/f76 to d3/fbe 0 2024-04-26T21:08:14.413 INFO:tasks.workunit.client.1.smithi064.stdout:1/893: rename d0/d6/d11/d1e/d27/f81 to d0/d6/d29/d31/f113 0 2024-04-26T21:08:14.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/840: dwrite d12/d41/d73/d83/d94/d3a/dba/ff4 [0,4194304] 0 2024-04-26T21:08:14.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/841: chown d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fd6 621 1 2024-04-26T21:08:14.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/842: creat d12/d45/f119 x:0 0 0 2024-04-26T21:08:14.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/843: write d12/d45/f8b [452753,69025] 0 2024-04-26T21:08:14.415 INFO:tasks.workunit.client.1.smithi064.stdout:0/736: unlink dd/d21/dd9/le5 0 2024-04-26T21:08:14.416 INFO:tasks.workunit.client.0.smithi055.stdout:6/535: getdents d3/d17 0 2024-04-26T21:08:14.418 INFO:tasks.workunit.client.1.smithi064.stdout:8/667: getdents d10/d41/d44 0 2024-04-26T21:08:14.419 INFO:tasks.workunit.client.1.smithi064.stdout:8/668: write d10/d2f/d61/f88 [1343452,103065] 0 2024-04-26T21:08:14.419 INFO:tasks.workunit.client.1.smithi064.stdout:8/669: write d10/d41/d44/fb5 [830206,73222] 0 2024-04-26T21:08:14.421 INFO:tasks.workunit.client.1.smithi064.stdout:1/894: mkdir d0/d22/d9f/d114 0 2024-04-26T21:08:14.424 INFO:tasks.workunit.client.0.smithi055.stdout:6/536: link d3/d17/d25/d5f/d90/l55 d3/d9b/lbf 0 2024-04-26T21:08:14.425 INFO:tasks.workunit.client.0.smithi055.stdout:6/537: creat d3/d17/d46/d54/d66/d6a/d51/d58/d6d/fc0 x:0 0 0 2024-04-26T21:08:14.425 INFO:tasks.workunit.client.0.smithi055.stdout:6/538: fsync d3/d17/d46/d54/d66/d6a/d51/d58/d6d/f98 0 2024-04-26T21:08:14.427 INFO:tasks.workunit.client.1.smithi064.stdout:5/707: rename dd/d12/d18/d1a/f57 to dd/da9/d48/d56/daa/fe5 0 2024-04-26T21:08:14.429 INFO:tasks.workunit.client.0.smithi055.stdout:7/496: dwrite d5/d6/d24/d48/d7f/f8e [0,4194304] 0 2024-04-26T21:08:14.429 INFO:tasks.workunit.client.0.smithi055.stdout:2/606: dread d4/d55/d6c/fa0 [0,4194304] 0 2024-04-26T21:08:14.429 INFO:tasks.workunit.client.0.smithi055.stdout:2/607: readlink d4/d14/l54 0 2024-04-26T21:08:14.429 INFO:tasks.workunit.client.0.smithi055.stdout:2/608: write d4/d49/d4c/d5e/f95 [918350,82980] 0 2024-04-26T21:08:14.431 INFO:tasks.workunit.client.1.smithi064.stdout:4/818: sync 2024-04-26T21:08:14.432 INFO:tasks.workunit.client.0.smithi055.stdout:9/575: dwrite d2/d46/d51/f61 [0,4194304] 0 2024-04-26T21:08:14.432 INFO:tasks.workunit.client.0.smithi055.stdout:9/576: creat d2/d46/d9a/fc3 x:0 0 0 2024-04-26T21:08:14.434 INFO:tasks.workunit.client.0.smithi055.stdout:6/539: symlink d3/d17/d19/d7b/d8f/lc1 0 2024-04-26T21:08:14.435 INFO:tasks.workunit.client.1.smithi064.stdout:2/844: truncate d12/d41/d73/d83/d94/f3f 1022673 0 2024-04-26T21:08:14.435 INFO:tasks.workunit.client.0.smithi055.stdout:3/637: dwrite d0/d4/d5/f62 [0,4194304] 0 2024-04-26T21:08:14.436 INFO:tasks.workunit.client.1.smithi064.stdout:2/845: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f106 [518876,40622] 0 2024-04-26T21:08:14.436 INFO:tasks.workunit.client.1.smithi064.stdout:6/718: dwrite d4/d7/f62 [0,4194304] 0 2024-04-26T21:08:14.436 INFO:tasks.workunit.client.1.smithi064.stdout:6/719: readlink d4/l7c 0 2024-04-26T21:08:14.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/708: rename dd/da9/d48/de2 to dd/da9/d48/d6a/d9e/db9/de6 0 2024-04-26T21:08:14.451 INFO:tasks.workunit.client.0.smithi055.stdout:9/577: rename d2/d46/d77/d5f/f8a to d2/d14/d97/fc4 0 2024-04-26T21:08:14.456 INFO:tasks.workunit.client.1.smithi064.stdout:2/846: rmdir d12/d41/d73/d83/d94/d3a/d3e 39 2024-04-26T21:08:14.457 INFO:tasks.workunit.client.1.smithi064.stdout:6/720: creat d4/d7/d12/dbc/fe8 x:0 0 0 2024-04-26T21:08:14.461 INFO:tasks.workunit.client.0.smithi055.stdout:3/638: mkdir d0/d4/d16/d18/d4b/d57/d8e/de0 0 2024-04-26T21:08:14.461 INFO:tasks.workunit.client.0.smithi055.stdout:9/578: truncate d2/f1c 3776289 0 2024-04-26T21:08:14.469 INFO:tasks.workunit.client.0.smithi055.stdout:3/639: unlink d0/d4/d5/d73/d13/d27/d50/d6b/fd0 0 2024-04-26T21:08:14.470 INFO:tasks.workunit.client.1.smithi064.stdout:7/775: dwrite d6/d9/d38/f3a [0,4194304] 0 2024-04-26T21:08:14.470 INFO:tasks.workunit.client.0.smithi055.stdout:3/640: chown d0/d4/d5/d73/d13/d1a/d46/d72/fd1 170 1 2024-04-26T21:08:14.473 INFO:tasks.workunit.client.0.smithi055.stdout:9/579: mkdir d2/d14/db8/dc5 0 2024-04-26T21:08:14.476 INFO:tasks.workunit.client.0.smithi055.stdout:9/580: truncate d2/d46/d77/d7d/f83 795710 0 2024-04-26T21:08:14.476 INFO:tasks.workunit.client.0.smithi055.stdout:9/581: readlink d2/d11/l38 0 2024-04-26T21:08:14.476 INFO:tasks.workunit.client.0.smithi055.stdout:9/582: chown d2/d14/d97/d9b 6 1 2024-04-26T21:08:14.479 INFO:tasks.workunit.client.1.smithi064.stdout:2/847: rmdir d12/d41/d73/d83/d94/d3a/d46/d6a/d86 39 2024-04-26T21:08:14.485 INFO:tasks.workunit.client.0.smithi055.stdout:9/583: symlink d2/d11/lc6 0 2024-04-26T21:08:14.485 INFO:tasks.workunit.client.0.smithi055.stdout:9/584: write d2/d11/f2f [1731341,40372] 0 2024-04-26T21:08:14.489 INFO:tasks.workunit.client.1.smithi064.stdout:7/776: rename d6/d15/d88/dca/cd9 to d6/d15/d1c/d45/c108 0 2024-04-26T21:08:14.495 INFO:tasks.workunit.client.1.smithi064.stdout:6/721: mknod d4/d7/d12/d49/d4b/ce9 0 2024-04-26T21:08:14.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/777: symlink d6/db/d34/d6f/d81/l109 0 2024-04-26T21:08:14.496 INFO:tasks.workunit.client.1.smithi064.stdout:7/778: write d6/db/d1f/f6c [908585,81113] 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:4/819: dwrite d0/d5/d13/d6d/f10d [0,4194304] 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:0/737: dwrite dd/d21/dc8/d31/d47/fd1 [0,4194304] 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:0/738: truncate dd/d10/d74/d4f/fa5 231596 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:2/848: dread d12/d41/d73/d83/d94/f33 [4194304,4194304] 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:2/849: fdatasync d12/d41/d73/d83/d94/d3a/d46/d91/fe6 0 2024-04-26T21:08:14.504 INFO:tasks.workunit.client.1.smithi064.stdout:7/779: creat d6/d15/d88/dca/d5c/ded/f10a x:0 0 0 2024-04-26T21:08:14.508 INFO:tasks.workunit.client.0.smithi055.stdout:2/609: dwrite d4/fb9 [0,4194304] 0 2024-04-26T21:08:14.508 INFO:tasks.workunit.client.0.smithi055.stdout:6/540: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d6d/f98 [0,4194304] 0 2024-04-26T21:08:14.508 INFO:tasks.workunit.client.0.smithi055.stdout:2/610: write d4/d14/d17/d36/f4e [1432789,88160] 0 2024-04-26T21:08:14.508 INFO:tasks.workunit.client.0.smithi055.stdout:2/611: chown d4/d1e/d2a/c9c 127295 1 2024-04-26T21:08:14.508 INFO:tasks.workunit.client.0.smithi055.stdout:6/541: write d3/d17/d19/f36 [1247308,128949] 0 2024-04-26T21:08:14.509 INFO:tasks.workunit.client.1.smithi064.stdout:9/748: sync 2024-04-26T21:08:14.509 INFO:tasks.workunit.client.1.smithi064.stdout:3/696: sync 2024-04-26T21:08:14.509 INFO:tasks.workunit.client.1.smithi064.stdout:9/749: dread - d0/d4/da/d26/d47/d6b/fcb zero size 2024-04-26T21:08:14.512 INFO:tasks.workunit.client.1.smithi064.stdout:0/739: dread dd/d21/dc8/f9c [0,4194304] 0 2024-04-26T21:08:14.512 INFO:tasks.workunit.client.1.smithi064.stdout:0/740: chown dd/d21/dc8/d31/d47/d61/ff0 1 1 2024-04-26T21:08:14.516 INFO:tasks.workunit.client.1.smithi064.stdout:4/820: truncate d0/d1d/d21/f3a 60015 0 2024-04-26T21:08:14.519 INFO:tasks.workunit.client.1.smithi064.stdout:7/780: mknod d6/d8c/c10b 0 2024-04-26T21:08:14.519 INFO:tasks.workunit.client.0.smithi055.stdout:7/497: dwrite d5/d6/f89 [0,4194304] 0 2024-04-26T21:08:14.521 INFO:tasks.workunit.client.0.smithi055.stdout:7/498: write d5/d6/d24/f4b [681857,18409] 0 2024-04-26T21:08:14.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/850: mknod d12/d45/dd7/c11a 0 2024-04-26T21:08:14.523 INFO:tasks.workunit.client.1.smithi064.stdout:2/851: stat d12/d41/d61/d75/l50 0 2024-04-26T21:08:14.526 INFO:tasks.workunit.client.1.smithi064.stdout:3/697: truncate d1/d27/d29/d6f/d72/da5/f93 1063277 0 2024-04-26T21:08:14.526 INFO:tasks.workunit.client.1.smithi064.stdout:3/698: readlink d1/d27/d29/d6f/d72/da5/l16 0 2024-04-26T21:08:14.529 INFO:tasks.workunit.client.1.smithi064.stdout:9/750: creat d0/d4/d7/df/da4/ff9 x:0 0 0 2024-04-26T21:08:14.530 INFO:tasks.workunit.client.1.smithi064.stdout:9/751: readlink d0/d4/l36 0 2024-04-26T21:08:14.530 INFO:tasks.workunit.client.0.smithi055.stdout:6/542: truncate d3/d17/d46/d54/d66/d6a/fab 4185529 0 2024-04-26T21:08:14.534 INFO:tasks.workunit.client.0.smithi055.stdout:3/641: dwrite d0/d4/d5/d73/d13/d27/d50/fac [4194304,4194304] 0 2024-04-26T21:08:14.534 INFO:tasks.workunit.client.1.smithi064.stdout:6/722: link d4/d7/d12/d49/d4b/dc9/ca5 d4/d7/d12/d38/de6/dc1/cea 0 2024-04-26T21:08:14.534 INFO:tasks.workunit.client.1.smithi064.stdout:6/723: dread - d4/d7/d12/d49/d4b/d56/fc5 zero size 2024-04-26T21:08:14.537 INFO:tasks.workunit.client.1.smithi064.stdout:7/781: write d6/d8c/f7f [684034,26720] 0 2024-04-26T21:08:14.538 INFO:tasks.workunit.client.1.smithi064.stdout:0/741: truncate dd/d10/d74/d1d/f38 5591391 0 2024-04-26T21:08:14.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/499: rename d5/d6/d39/d80 to d5/d6/d90 0 2024-04-26T21:08:14.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/500: chown d5 17515 1 2024-04-26T21:08:14.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/501: readlink d5/d53/l78 0 2024-04-26T21:08:14.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/502: readlink d5/d6/d24/d3b/l7d 0 2024-04-26T21:08:14.543 INFO:tasks.workunit.client.1.smithi064.stdout:4/821: rename d0/d2f/d7d/c92 to d0/d5/d13/d33/dd0/dd8/c113 0 2024-04-26T21:08:14.543 INFO:tasks.workunit.client.1.smithi064.stdout:4/822: fdatasync d0/d2f/d7d/fb8 0 2024-04-26T21:08:14.543 INFO:tasks.workunit.client.1.smithi064.stdout:4/823: fsync d0/d2f/d7d/fc1 0 2024-04-26T21:08:14.546 INFO:tasks.workunit.client.0.smithi055.stdout:3/642: creat d0/d4/d5/d73/d13/d1a/d46/d72/dd5/fe1 x:0 0 0 2024-04-26T21:08:14.546 INFO:tasks.workunit.client.0.smithi055.stdout:3/643: readlink d0/d4/d5/d73/d47/dcf/l65 0 2024-04-26T21:08:14.549 INFO:tasks.workunit.client.1.smithi064.stdout:6/724: dread d4/d7/f1f [0,4194304] 0 2024-04-26T21:08:14.554 INFO:tasks.workunit.client.0.smithi055.stdout:6/543: dread d3/d17/d46/d54/d66/d6a/f56 [0,4194304] 0 2024-04-26T21:08:14.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/644: creat d0/d4/d5/d73/d47/dcf/fe2 x:0 0 0 2024-04-26T21:08:14.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/645: chown d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/ld4 155908 1 2024-04-26T21:08:14.554 INFO:tasks.workunit.client.0.smithi055.stdout:7/503: dread d5/d6/f4c [0,4194304] 0 2024-04-26T21:08:14.555 INFO:tasks.workunit.client.0.smithi055.stdout:7/504: truncate d5/d11/f2f 7699816 0 2024-04-26T21:08:14.555 INFO:tasks.workunit.client.0.smithi055.stdout:7/505: write d5/d53/d6e/d65/f7c [712226,12111] 0 2024-04-26T21:08:14.555 INFO:tasks.workunit.client.0.smithi055.stdout:7/506: fsync d5/d6/f41 0 2024-04-26T21:08:14.555 INFO:tasks.workunit.client.0.smithi055.stdout:7/507: chown d5/d53/d6e 482 1 2024-04-26T21:08:14.555 INFO:tasks.workunit.client.1.smithi064.stdout:3/699: symlink d1/d27/d50/led 0 2024-04-26T21:08:14.561 INFO:tasks.workunit.client.0.smithi055.stdout:9/585: dread d2/f1e [0,4194304] 0 2024-04-26T21:08:14.563 INFO:tasks.workunit.client.0.smithi055.stdout:7/508: creat d5/d6/d24/f91 x:0 0 0 2024-04-26T21:08:14.563 INFO:tasks.workunit.client.0.smithi055.stdout:7/509: fdatasync d5/d53/f8a 0 2024-04-26T21:08:14.566 INFO:tasks.workunit.client.1.smithi064.stdout:4/824: truncate d0/d14/f95 2441921 0 2024-04-26T21:08:14.566 INFO:tasks.workunit.client.1.smithi064.stdout:6/725: unlink d4/d7/d12/d49/d4b/dc9/ca5 0 2024-04-26T21:08:14.566 INFO:tasks.workunit.client.1.smithi064.stdout:6/726: truncate d4/d7/d12/d49/d4b/d56/f82 4927248 0 2024-04-26T21:08:14.566 INFO:tasks.workunit.client.1.smithi064.stdout:6/727: truncate d4/d99/fa4 1566961 0 2024-04-26T21:08:14.566 INFO:tasks.workunit.client.1.smithi064.stdout:2/852: rmdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43 39 2024-04-26T21:08:14.569 INFO:tasks.workunit.client.1.smithi064.stdout:3/700: mkdir d1/d27/dee 0 2024-04-26T21:08:14.569 INFO:tasks.workunit.client.1.smithi064.stdout:3/701: chown d1/d27/d29/d6f/d72/da5/d7d/d8d/lcc 1000 0 2024-04-26T21:08:14.571 INFO:tasks.workunit.client.1.smithi064.stdout:6/728: creat d4/d7/d12/feb x:0 0 0 2024-04-26T21:08:14.571 INFO:tasks.workunit.client.1.smithi064.stdout:6/729: creat d4/d7/d12/d49/d4b/d5a/d8f/fec x:0 0 0 2024-04-26T21:08:14.572 INFO:tasks.workunit.client.1.smithi064.stdout:2/853: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b 0 2024-04-26T21:08:14.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/612: dwrite d4/dc/f71 [0,4194304] 0 2024-04-26T21:08:14.577 INFO:tasks.workunit.client.1.smithi064.stdout:6/730: mkdir d4/d7/d12/d49/d4b/d5a/d8f/ded 0 2024-04-26T21:08:14.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/854: rmdir d12/d45/d116 0 2024-04-26T21:08:14.577 INFO:tasks.workunit.client.1.smithi064.stdout:2/855: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/c31 389 1 2024-04-26T21:08:14.578 INFO:tasks.workunit.client.0.smithi055.stdout:2/613: unlink d4/dc/f16 0 2024-04-26T21:08:14.602 INFO:tasks.workunit.client.0.smithi055.stdout:7/510: dread d5/d6/d24/d4d/f60 [0,4194304] 0 2024-04-26T21:08:14.603 INFO:tasks.workunit.client.1.smithi064.stdout:2/856: write d12/fb8 [3888670,31858] 0 2024-04-26T21:08:14.604 INFO:tasks.workunit.client.0.smithi055.stdout:7/511: mknod d5/d53/d6e/d6c/d7a/c92 0 2024-04-26T21:08:14.604 INFO:tasks.workunit.client.0.smithi055.stdout:7/512: chown d5/d6/d24/f38 22008806 1 2024-04-26T21:08:14.605 INFO:tasks.workunit.client.1.smithi064.stdout:2/857: truncate d12/d41/d73/d83/f8d 2924660 0 2024-04-26T21:08:14.611 INFO:tasks.workunit.client.1.smithi064.stdout:7/782: dwrite d6/d9/d3d/d43/f98 [0,4194304] 0 2024-04-26T21:08:14.611 INFO:tasks.workunit.client.1.smithi064.stdout:2/858: rename d12/d45/f119 to d12/d41/d73/d83/d94/d3a/d46/d48/d85/f11c 0 2024-04-26T21:08:14.614 INFO:tasks.workunit.client.1.smithi064.stdout:1/895: sync 2024-04-26T21:08:14.614 INFO:tasks.workunit.client.1.smithi064.stdout:5/709: sync 2024-04-26T21:08:14.614 INFO:tasks.workunit.client.1.smithi064.stdout:1/896: truncate d0/d6/d91/d92/fbf 5103364 0 2024-04-26T21:08:14.614 INFO:tasks.workunit.client.1.smithi064.stdout:1/897: chown d0/l24 26256155 1 2024-04-26T21:08:14.615 INFO:tasks.workunit.client.1.smithi064.stdout:8/670: sync 2024-04-26T21:08:14.620 INFO:tasks.workunit.client.1.smithi064.stdout:7/783: mknod d6/d8c/c10c 0 2024-04-26T21:08:14.623 INFO:tasks.workunit.client.1.smithi064.stdout:2/859: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/lcb to d12/d41/d73/d83/d94/d3a/d5d/l11d 0 2024-04-26T21:08:14.625 INFO:tasks.workunit.client.0.smithi055.stdout:9/586: dread d2/d14/f4f [4194304,4194304] 0 2024-04-26T21:08:14.625 INFO:tasks.workunit.client.0.smithi055.stdout:9/587: dread - d2/d46/d9a/fc3 zero size 2024-04-26T21:08:14.625 INFO:tasks.workunit.client.0.smithi055.stdout:9/588: readlink d2/d46/d77/d5f/l7f 0 2024-04-26T21:08:14.626 INFO:tasks.workunit.client.1.smithi064.stdout:8/671: link d10/d41/c58 d10/d1d/da3/cd4 0 2024-04-26T21:08:14.626 INFO:tasks.workunit.client.1.smithi064.stdout:8/672: chown d10/d2f/c3f 7370 1 2024-04-26T21:08:14.626 INFO:tasks.workunit.client.1.smithi064.stdout:8/673: chown d10/d1d/l26 672 1 2024-04-26T21:08:14.627 INFO:tasks.workunit.client.1.smithi064.stdout:5/710: unlink dd/d12/d18/d25/d32/fa4 0 2024-04-26T21:08:14.629 INFO:tasks.workunit.client.0.smithi055.stdout:3/646: dwrite d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:14.631 INFO:tasks.workunit.client.1.smithi064.stdout:7/784: mknod d6/db/d1f/d50/db8/dce/c10d 0 2024-04-26T21:08:14.633 INFO:tasks.workunit.client.1.smithi064.stdout:2/860: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/l11e 0 2024-04-26T21:08:14.635 INFO:tasks.workunit.client.0.smithi055.stdout:3/647: creat d0/d4/d16/d18/d4b/d57/d8e/de0/fe3 x:0 0 0 2024-04-26T21:08:14.636 INFO:tasks.workunit.client.0.smithi055.stdout:3/648: write d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/fab [350967,76432] 0 2024-04-26T21:08:14.636 INFO:tasks.workunit.client.0.smithi055.stdout:3/649: write d0/d4/d5/d73/d13/d1a/d46/fae [877476,93931] 0 2024-04-26T21:08:14.637 INFO:tasks.workunit.client.1.smithi064.stdout:7/785: truncate d6/db/d34/f96 1658009 0 2024-04-26T21:08:14.640 INFO:tasks.workunit.client.0.smithi055.stdout:6/544: dwrite d3/d17/f29 [4194304,4194304] 0 2024-04-26T21:08:14.640 INFO:tasks.workunit.client.1.smithi064.stdout:6/731: read d4/d7/f4d [2750740,87656] 0 2024-04-26T21:08:14.640 INFO:tasks.workunit.client.1.smithi064.stdout:6/732: write d4/d7/d33/fdd [326297,33701] 0 2024-04-26T21:08:14.641 INFO:tasks.workunit.client.1.smithi064.stdout:2/861: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/f11f x:0 0 0 2024-04-26T21:08:14.644 INFO:tasks.workunit.client.1.smithi064.stdout:3/702: dwrite d1/f1b [0,4194304] 0 2024-04-26T21:08:14.644 INFO:tasks.workunit.client.1.smithi064.stdout:3/703: creat d1/d27/d29/d6f/d72/d73/fef x:0 0 0 2024-04-26T21:08:14.654 INFO:tasks.workunit.client.0.smithi055.stdout:6/545: dread d3/d9b/fa2 [0,4194304] 0 2024-04-26T21:08:14.655 INFO:tasks.workunit.client.1.smithi064.stdout:6/733: rename d4/d7/d12/d49/d4b/d56/f70 to d4/d7/fee 0 2024-04-26T21:08:14.656 INFO:tasks.workunit.client.1.smithi064.stdout:1/898: read d0/d6/f74 [3612778,86347] 0 2024-04-26T21:08:14.665 INFO:tasks.workunit.client.0.smithi055.stdout:6/546: mkdir d3/d17/d46/dc2 0 2024-04-26T21:08:14.667 INFO:tasks.workunit.client.1.smithi064.stdout:1/899: link d0/d6b/d9e/da2/dc9/fe6 d0/d6/d11/d1e/d2a/f115 0 2024-04-26T21:08:14.668 INFO:tasks.workunit.client.1.smithi064.stdout:1/900: link d0/d6/d11/d1e/d2a/d34/f79 d0/d22/d9f/df1/f116 0 2024-04-26T21:08:14.670 INFO:tasks.workunit.client.1.smithi064.stdout:1/901: creat d0/d6/dd/d100/f117 x:0 0 0 2024-04-26T21:08:14.683 INFO:tasks.workunit.client.0.smithi055.stdout:6/547: write d3/f30 [138819,95443] 0 2024-04-26T21:08:14.683 INFO:tasks.workunit.client.0.smithi055.stdout:6/548: chown f0 202 1 2024-04-26T21:08:14.687 INFO:tasks.workunit.client.0.smithi055.stdout:6/549: rename d3/d17/d19/d71/f4d to d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/fc3 0 2024-04-26T21:08:14.687 INFO:tasks.workunit.client.0.smithi055.stdout:6/550: creat d3/d17/d46/d54/d66/d6a/d51/d58/d73/fc4 x:0 0 0 2024-04-26T21:08:14.691 INFO:tasks.workunit.client.0.smithi055.stdout:6/551: rmdir d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e 39 2024-04-26T21:08:14.694 INFO:tasks.workunit.client.0.smithi055.stdout:6/552: write d3/d9b/fa2 [1263533,102240] 0 2024-04-26T21:08:14.695 INFO:tasks.workunit.client.0.smithi055.stdout:6/553: rename d3/d17/d46/d54/f5e to d3/d17/d46/dc2/fc5 0 2024-04-26T21:08:14.695 INFO:tasks.workunit.client.0.smithi055.stdout:6/554: truncate d3/d17/f81 1041128 0 2024-04-26T21:08:14.695 INFO:tasks.workunit.client.0.smithi055.stdout:6/555: write d3/d9b/fb4 [538095,40175] 0 2024-04-26T21:08:14.695 INFO:tasks.workunit.client.0.smithi055.stdout:6/556: creat d3/d17/d25/fc6 x:0 0 0 2024-04-26T21:08:14.702 INFO:tasks.workunit.client.0.smithi055.stdout:9/589: dwrite d2/d46/d77/fb5 [0,4194304] 0 2024-04-26T21:08:14.702 INFO:tasks.workunit.client.0.smithi055.stdout:6/557: fdatasync d3/f16 0 2024-04-26T21:08:14.703 INFO:tasks.workunit.client.0.smithi055.stdout:7/513: dwrite d5/d11/f2f [8388608,4194304] 0 2024-04-26T21:08:14.706 INFO:tasks.workunit.client.0.smithi055.stdout:7/514: mkdir d5/d53/d93 0 2024-04-26T21:08:14.710 INFO:tasks.workunit.client.1.smithi064.stdout:8/674: dwrite d10/d41/d4e/fbb [4194304,4194304] 0 2024-04-26T21:08:14.710 INFO:tasks.workunit.client.1.smithi064.stdout:5/711: dwrite dd/d12/d18/d1a/d1f/f7b [0,4194304] 0 2024-04-26T21:08:14.714 INFO:tasks.workunit.client.1.smithi064.stdout:9/752: sync 2024-04-26T21:08:14.724 INFO:tasks.workunit.client.0.smithi055.stdout:3/650: dwrite d0/d4/d5/d73/d13/d27/d50/d6b/fc1 [0,4194304] 0 2024-04-26T21:08:14.727 INFO:tasks.workunit.client.1.smithi064.stdout:5/712: unlink dd/da9/d48/d56/fb4 0 2024-04-26T21:08:14.727 INFO:tasks.workunit.client.1.smithi064.stdout:5/713: readlink dd/d12/d18/d1a/d1f/l65 0 2024-04-26T21:08:14.728 INFO:tasks.workunit.client.1.smithi064.stdout:8/675: dread d10/d41/d44/fb5 [0,4194304] 0 2024-04-26T21:08:14.738 INFO:tasks.workunit.client.1.smithi064.stdout:2/862: dwrite d12/d41/fe4 [0,4194304] 0 2024-04-26T21:08:14.739 INFO:tasks.workunit.client.1.smithi064.stdout:8/676: rename d10/d41/d53/fa1 to d10/d1d/da3/fd5 0 2024-04-26T21:08:14.746 INFO:tasks.workunit.client.0.smithi055.stdout:3/651: creat d0/d4/d5/d73/d13/fe4 x:0 0 0 2024-04-26T21:08:14.754 INFO:tasks.workunit.client.1.smithi064.stdout:5/714: write dd/d12/d18/d25/d67/f94 [1439658,33880] 0 2024-04-26T21:08:14.760 INFO:tasks.workunit.client.1.smithi064.stdout:2/863: rename d12/d45/dd7 to d12/d41/d73/d83/d94/d3a/d46/d48/d120 0 2024-04-26T21:08:14.760 INFO:tasks.workunit.client.1.smithi064.stdout:2/864: write d12/d41/f4b [527838,98982] 0 2024-04-26T21:08:14.765 INFO:tasks.workunit.client.1.smithi064.stdout:2/865: unlink d12/d41/d73/d83/d94/d3a/d46/l8e 0 2024-04-26T21:08:14.768 INFO:tasks.workunit.client.1.smithi064.stdout:4/825: dwrite d0/d1d/d21/f4e [0,4194304] 0 2024-04-26T21:08:14.768 INFO:tasks.workunit.client.1.smithi064.stdout:7/786: dwrite d6/d15/d88/dca/f9d [4194304,4194304] 0 2024-04-26T21:08:14.768 INFO:tasks.workunit.client.1.smithi064.stdout:4/826: fdatasync d0/d5/f7c 0 2024-04-26T21:08:14.771 INFO:tasks.workunit.client.1.smithi064.stdout:2/866: mkdir d12/d45/d121 0 2024-04-26T21:08:14.771 INFO:tasks.workunit.client.1.smithi064.stdout:3/704: dwrite d1/f51 [0,4194304] 0 2024-04-26T21:08:14.776 INFO:tasks.workunit.client.0.smithi055.stdout:3/652: creat d0/d4/d16/d18/d4b/d57/d8e/db1/fe5 x:0 0 0 2024-04-26T21:08:14.777 INFO:tasks.workunit.client.1.smithi064.stdout:2/867: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/f122 x:0 0 0 2024-04-26T21:08:14.777 INFO:tasks.workunit.client.1.smithi064.stdout:2/868: chown d12/d41/f4b 3758 1 2024-04-26T21:08:14.777 INFO:tasks.workunit.client.1.smithi064.stdout:2/869: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/f123 x:0 0 0 2024-04-26T21:08:14.782 INFO:tasks.workunit.client.1.smithi064.stdout:3/705: creat d1/d14/de6/ff0 x:0 0 0 2024-04-26T21:08:14.782 INFO:tasks.workunit.client.1.smithi064.stdout:0/742: sync 2024-04-26T21:08:14.782 INFO:tasks.workunit.client.1.smithi064.stdout:5/715: write dd/d12/d18/d1a/d1f/d20/f59 [3977939,72989] 0 2024-04-26T21:08:14.782 INFO:tasks.workunit.client.1.smithi064.stdout:2/870: rename d12/d41/d73/d83/d94/d3a/d46/d91/fe6 to d12/d41/d73/d83/d94/f124 0 2024-04-26T21:08:14.785 INFO:tasks.workunit.client.1.smithi064.stdout:2/871: creat d12/d41/d73/d83/d94/d3a/d46/d48/d120/df9/f125 x:0 0 0 2024-04-26T21:08:14.785 INFO:tasks.workunit.client.1.smithi064.stdout:2/872: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/l11e 0 2024-04-26T21:08:14.785 INFO:tasks.workunit.client.1.smithi064.stdout:2/873: write d12/d41/d73/d83/d94/f70 [622582,57476] 0 2024-04-26T21:08:14.787 INFO:tasks.workunit.client.1.smithi064.stdout:9/753: dwrite d0/d4/d7/fb5 [0,4194304] 0 2024-04-26T21:08:14.787 INFO:tasks.workunit.client.1.smithi064.stdout:0/743: mkdir dd/d21/df9 0 2024-04-26T21:08:14.795 INFO:tasks.workunit.client.0.smithi055.stdout:7/515: dwrite d5/d11/f1a [0,4194304] 0 2024-04-26T21:08:14.795 INFO:tasks.workunit.client.0.smithi055.stdout:7/516: dread - d5/d6/d24/d48/d58/f88 zero size 2024-04-26T21:08:14.796 INFO:tasks.workunit.client.0.smithi055.stdout:7/517: chown d5/d6/d90 520 1 2024-04-26T21:08:14.796 INFO:tasks.workunit.client.0.smithi055.stdout:7/518: dread - d5/db/f8b zero size 2024-04-26T21:08:14.798 INFO:tasks.workunit.client.1.smithi064.stdout:2/874: link d12/d41/d73/d83/d94/d3a/d46/d48/d85/c31 d12/d41/d73/d83/d94/d3a/d46/d91/d92/c126 0 2024-04-26T21:08:14.801 INFO:tasks.workunit.client.1.smithi064.stdout:9/754: creat d0/d4/d28/df3/ffa x:0 0 0 2024-04-26T21:08:14.801 INFO:tasks.workunit.client.1.smithi064.stdout:9/755: chown d0/d4/f53 8653 1 2024-04-26T21:08:14.801 INFO:tasks.workunit.client.1.smithi064.stdout:6/734: dwrite d4/d7/d12/da7/fe4 [0,4194304] 0 2024-04-26T21:08:14.802 INFO:tasks.workunit.client.0.smithi055.stdout:9/590: dwrite d2/d46/d77/d79/f87 [0,4194304] 0 2024-04-26T21:08:14.803 INFO:tasks.workunit.client.0.smithi055.stdout:7/519: link d5/d6/d24/d3b/f4e d5/d53/d6e/d65/f94 0 2024-04-26T21:08:14.803 INFO:tasks.workunit.client.0.smithi055.stdout:7/520: chown d5/d53/c54 4 1 2024-04-26T21:08:14.811 INFO:tasks.workunit.client.1.smithi064.stdout:2/875: mknod d12/d41/d73/d83/d94/d3a/d3e/c127 0 2024-04-26T21:08:14.811 INFO:tasks.workunit.client.1.smithi064.stdout:8/677: dwrite d10/d41/d4e/fbb [4194304,4194304] 0 2024-04-26T21:08:14.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/706: write d1/d27/d50/d35/fe4 [1720782,93575] 0 2024-04-26T21:08:14.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/707: creat d1/d27/d29/d6f/d72/d7a/d84/ff1 x:0 0 0 2024-04-26T21:08:14.818 INFO:tasks.workunit.client.1.smithi064.stdout:3/708: dread - d1/d27/d50/d35/d4c/d7b/d82/fd7 zero size 2024-04-26T21:08:14.819 INFO:tasks.workunit.client.0.smithi055.stdout:9/591: mkdir d2/dc7 0 2024-04-26T21:08:14.820 INFO:tasks.workunit.client.0.smithi055.stdout:3/653: dwrite d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 [0,4194304] 0 2024-04-26T21:08:14.823 INFO:tasks.workunit.client.1.smithi064.stdout:6/735: truncate d4/d7/d12/f68 202476 0 2024-04-26T21:08:14.827 INFO:tasks.workunit.client.0.smithi055.stdout:7/521: dread d5/d6/d24/d48/d58/f5f [0,4194304] 0 2024-04-26T21:08:14.835 INFO:tasks.workunit.client.1.smithi064.stdout:2/876: creat d12/d41/d73/d83/d94/d3a/d46/dee/f128 x:0 0 0 2024-04-26T21:08:14.840 INFO:tasks.workunit.client.0.smithi055.stdout:9/592: rename d2/d14/f86 to d2/fc8 0 2024-04-26T21:08:14.840 INFO:tasks.workunit.client.0.smithi055.stdout:9/593: truncate d2/d14/f47 706274 0 2024-04-26T21:08:14.840 INFO:tasks.workunit.client.0.smithi055.stdout:9/594: creat d2/d46/d9a/fc9 x:0 0 0 2024-04-26T21:08:14.840 INFO:tasks.workunit.client.0.smithi055.stdout:9/595: fsync d2/d46/d9a/da7/fa9 0 2024-04-26T21:08:14.840 INFO:tasks.workunit.client.1.smithi064.stdout:3/709: read d1/d27/d50/d35/d4c/dd1/f7e [114392,78348] 0 2024-04-26T21:08:14.841 INFO:tasks.workunit.client.1.smithi064.stdout:3/710: fsync d1/d27/d29/f92 0 2024-04-26T21:08:14.843 INFO:tasks.workunit.client.1.smithi064.stdout:5/716: dwrite dd/da9/d48/d6a/f9b [0,4194304] 0 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:5/422: sync 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:1/507: sync 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:8/479: sync 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:5/423: truncate d4/df/d13/d26/f7e 393603 0 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:0/571: sync 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:4/456: sync 2024-04-26T21:08:14.848 INFO:tasks.workunit.client.0.smithi055.stdout:2/614: sync 2024-04-26T21:08:14.849 INFO:tasks.workunit.client.0.smithi055.stdout:2/615: write d4/db/d1f/d32/d57/fc0 [635014,128330] 0 2024-04-26T21:08:14.851 INFO:tasks.workunit.client.0.smithi055.stdout:3/654: read d0/d4/d16/f26 [2992683,26243] 0 2024-04-26T21:08:14.851 INFO:tasks.workunit.client.0.smithi055.stdout:3/655: creat d0/d4/d5/d73/d13/fe6 x:0 0 0 2024-04-26T21:08:14.851 INFO:tasks.workunit.client.0.smithi055.stdout:3/656: chown d0/d4/d5/d73/d13/fe6 3 1 2024-04-26T21:08:14.852 INFO:tasks.workunit.client.1.smithi064.stdout:4/827: dwrite d0/d2f/d7d/fc1 [0,4194304] 0 2024-04-26T21:08:14.852 INFO:tasks.workunit.client.1.smithi064.stdout:4/828: fsync d0/d1d/d17/f2c 0 2024-04-26T21:08:14.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/596: rename d2/d46/d77/d5f/l8c to d2/d14/db8/lca 0 2024-04-26T21:08:14.854 INFO:tasks.workunit.client.0.smithi055.stdout:9/597: creat d2/d14/fcb x:0 0 0 2024-04-26T21:08:14.859 INFO:tasks.workunit.client.0.smithi055.stdout:9/598: write d2/d46/f48 [278451,5228] 0 2024-04-26T21:08:14.860 INFO:tasks.workunit.client.1.smithi064.stdout:6/736: creat d4/d7/d12/d49/d4b/d5a/d79/fef x:0 0 0 2024-04-26T21:08:14.862 INFO:tasks.workunit.client.1.smithi064.stdout:9/756: dwrite d0/d4/da/d26/d5d/fb0 [0,4194304] 0 2024-04-26T21:08:14.862 INFO:tasks.workunit.client.1.smithi064.stdout:9/757: readlink d0/d39/l83 0 2024-04-26T21:08:14.862 INFO:tasks.workunit.client.1.smithi064.stdout:9/758: write d0/d4/da/d31/d34/fcc [672200,94928] 0 2024-04-26T21:08:14.863 INFO:tasks.workunit.client.1.smithi064.stdout:0/744: dwrite dd/d10/fd5 [0,4194304] 0 2024-04-26T21:08:14.863 INFO:tasks.workunit.client.1.smithi064.stdout:8/678: dwrite d10/d2f/d56/fae [0,4194304] 0 2024-04-26T21:08:14.863 INFO:tasks.workunit.client.1.smithi064.stdout:8/679: chown d10/d41/d4e/d54/db3/ld0 185201 1 2024-04-26T21:08:14.866 INFO:tasks.workunit.client.0.smithi055.stdout:8/480: stat d3/d9/d1d/d48/d4b/c64 0 2024-04-26T21:08:14.866 INFO:tasks.workunit.client.1.smithi064.stdout:3/711: symlink d1/d38/d68/lf2 0 2024-04-26T21:08:14.868 INFO:tasks.workunit.client.0.smithi055.stdout:1/508: truncate d8/df/f6e 40840 0 2024-04-26T21:08:14.868 INFO:tasks.workunit.client.0.smithi055.stdout:0/572: creat d9/dc/d1c/d3e/d7d/da3/d97/db6/d67/fb7 x:0 0 0 2024-04-26T21:08:14.868 INFO:tasks.workunit.client.0.smithi055.stdout:0/573: truncate d9/f64 4715296 0 2024-04-26T21:08:14.868 INFO:tasks.workunit.client.0.smithi055.stdout:1/509: dread - d8/f91 zero size 2024-04-26T21:08:14.868 INFO:tasks.workunit.client.0.smithi055.stdout:1/510: readlink d8/df/l50 0 2024-04-26T21:08:14.869 INFO:tasks.workunit.client.0.smithi055.stdout:1/511: creat d8/d17/d1b/d7b/d65/fa8 x:0 0 0 2024-04-26T21:08:14.869 INFO:tasks.workunit.client.0.smithi055.stdout:4/457: read d4/f36 [5898991,74994] 0 2024-04-26T21:08:14.869 INFO:tasks.workunit.client.1.smithi064.stdout:5/717: write dd/d12/f3f [2396356,64127] 0 2024-04-26T21:08:14.869 INFO:tasks.workunit.client.1.smithi064.stdout:5/718: truncate dd/d12/d9a/fd2 112898 0 2024-04-26T21:08:14.876 INFO:tasks.workunit.client.0.smithi055.stdout:9/599: mknod d2/d14/d97/d9b/ccc 0 2024-04-26T21:08:14.879 INFO:tasks.workunit.client.1.smithi064.stdout:8/680: read d10/d41/d4e/fbb [1859107,101272] 0 2024-04-26T21:08:14.882 INFO:tasks.workunit.client.0.smithi055.stdout:0/574: mknod d9/d11/db3/cb8 0 2024-04-26T21:08:14.882 INFO:tasks.workunit.client.0.smithi055.stdout:8/481: creat d3/d9/d1d/d48/fa2 x:0 0 0 2024-04-26T21:08:14.886 INFO:tasks.workunit.client.0.smithi055.stdout:4/458: mkdir d4/d18/d8e/d9e 0 2024-04-26T21:08:14.888 INFO:tasks.workunit.client.1.smithi064.stdout:4/829: mkdir d0/d5/d79/dd1/da0/d114 0 2024-04-26T21:08:14.889 INFO:tasks.workunit.client.0.smithi055.stdout:9/600: truncate d2/d46/d77/d7d/f90 4161127 0 2024-04-26T21:08:14.892 INFO:tasks.workunit.client.0.smithi055.stdout:7/522: dwrite d5/d6/d24/d3b/f44 [4194304,4194304] 0 2024-04-26T21:08:14.893 INFO:tasks.workunit.client.0.smithi055.stdout:0/575: truncate d9/d27/f42 1320730 0 2024-04-26T21:08:14.898 INFO:tasks.workunit.client.1.smithi064.stdout:2/877: dwrite d12/d45/f7d [0,4194304] 0 2024-04-26T21:08:14.898 INFO:tasks.workunit.client.1.smithi064.stdout:2/878: readlink d12/d41/d73/l7a 0 2024-04-26T21:08:14.898 INFO:tasks.workunit.client.1.smithi064.stdout:2/879: creat d12/d88/f129 x:0 0 0 2024-04-26T21:08:14.898 INFO:tasks.workunit.client.1.smithi064.stdout:2/880: write d12/d41/d73/d83/d94/fa5 [449291,79363] 0 2024-04-26T21:08:14.898 INFO:tasks.workunit.client.0.smithi055.stdout:8/482: truncate d3/d77/f78 7214199 0 2024-04-26T21:08:14.900 INFO:tasks.workunit.client.0.smithi055.stdout:4/459: rmdir d4/d23 39 2024-04-26T21:08:14.901 INFO:tasks.workunit.client.0.smithi055.stdout:4/460: chown d4/d18/d1a/f37 30 1 2024-04-26T21:08:14.903 INFO:tasks.workunit.client.0.smithi055.stdout:3/657: write d0/f68 [629663,55339] 0 2024-04-26T21:08:14.903 INFO:tasks.workunit.client.0.smithi055.stdout:9/601: mknod d2/d14/db8/dc5/ccd 0 2024-04-26T21:08:14.906 INFO:tasks.workunit.client.1.smithi064.stdout:9/759: symlink d0/d4/d28/d4f/lfb 0 2024-04-26T21:08:14.906 INFO:tasks.workunit.client.1.smithi064.stdout:9/760: creat d0/d4/da/d26/d47/d9d/d76/ffc x:0 0 0 2024-04-26T21:08:14.906 INFO:tasks.workunit.client.1.smithi064.stdout:9/761: chown d0/l6 27872882 1 2024-04-26T21:08:14.906 INFO:tasks.workunit.client.1.smithi064.stdout:9/762: truncate d0/d4/da/d31/d34/fe4 478130 0 2024-04-26T21:08:14.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/523: rename d5/d11/f33 to d5/d6/d24/d48/d7f/d6f/f95 0 2024-04-26T21:08:14.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/524: truncate d5/d53/d6e/f6b 56447 0 2024-04-26T21:08:14.913 INFO:tasks.workunit.client.0.smithi055.stdout:7/525: fsync d5/d53/d6e/d6c/f84 0 2024-04-26T21:08:14.919 INFO:tasks.workunit.client.1.smithi064.stdout:0/745: mknod dd/d10/d74/d4f/cfa 0 2024-04-26T21:08:14.919 INFO:tasks.workunit.client.1.smithi064.stdout:0/746: read dd/d10/d18/f49 [317453,110985] 0 2024-04-26T21:08:14.920 INFO:tasks.workunit.client.0.smithi055.stdout:2/616: dwrite d4/db/d1f/d46/f5a [0,4194304] 0 2024-04-26T21:08:14.921 INFO:tasks.workunit.client.1.smithi064.stdout:3/712: truncate d1/fc 11543492 0 2024-04-26T21:08:14.922 INFO:tasks.workunit.client.0.smithi055.stdout:0/576: truncate d9/dc/d1c/d3e/d7d/da3/d97/db6/d6c/f84 433668 0 2024-04-26T21:08:14.928 INFO:tasks.workunit.client.0.smithi055.stdout:4/461: mkdir d4/d26/d42/d28/d53/d70/d9f 0 2024-04-26T21:08:14.930 INFO:tasks.workunit.client.1.smithi064.stdout:5/719: rename dd/da9/d48/d56/fae to dd/d12/d9a/fe7 0 2024-04-26T21:08:14.931 INFO:tasks.workunit.client.1.smithi064.stdout:8/681: getdents d10/d1d/da3 0 2024-04-26T21:08:14.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/902: sync 2024-04-26T21:08:14.931 INFO:tasks.workunit.client.1.smithi064.stdout:1/903: stat d0/d6/d91/ld7 0 2024-04-26T21:08:14.932 INFO:tasks.workunit.client.0.smithi055.stdout:7/526: write d5/d6/d24/f50 [787715,83381] 0 2024-04-26T21:08:14.933 INFO:tasks.workunit.client.0.smithi055.stdout:7/527: truncate d5/db/f8b 98002 0 2024-04-26T21:08:14.935 INFO:tasks.workunit.client.1.smithi064.stdout:4/830: mkdir d0/d5/d115 0 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 -- 172.21.15.55:0/3285531334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 msgr2=0x7f0bc41063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 --2- 172.21.15.55:0/3285531334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 0x7f0bc41063b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009940 tx=0x7f0bac009c50 comp rx=0 tx=0).stop 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 -- 172.21.15.55:0/3285531334 shutdown_connections 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 --2- 172.21.15.55:0/3285531334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 0x7f0bc41063b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 --2- 172.21.15.55:0/3285531334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc40fe870 0x7f0bc40fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.937+0000 7f0bc9600700 1 -- 172.21.15.55:0/3285531334 >> 172.21.15.55:0/3285531334 conn(0x7f0bc40fa420 msgr2=0x7f0bc40fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.940+0000 7f0bc9600700 1 -- 172.21.15.55:0/3285531334 shutdown_connections 2024-04-26T21:08:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.940+0000 7f0bc9600700 1 -- 172.21.15.55:0/3285531334 wait complete. 2024-04-26T21:08:14.941 INFO:tasks.workunit.client.0.smithi055.stdout:9/602: link d2/d46/d51/c56 d2/d46/d51/cce 0 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.941+0000 7f0bc9600700 1 Processor -- start 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.941+0000 7f0bc9600700 1 -- start start 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.942+0000 7f0bc9600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 0x7f0bc419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.942+0000 7f0bc9600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.942+0000 7f0bc9600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc419d8d0 con 0x7f0bc40ff240 2024-04-26T21:08:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.942+0000 7f0bc9600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc419da40 con 0x7f0bc419d3c0 2024-04-26T21:08:14.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.943+0000 7f0bc2a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:14.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.943+0000 7f0bc2a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:48328/0 (socket says 172.21.15.55:48328) 2024-04-26T21:08:14.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.943+0000 7f0bc2a00700 1 -- 172.21.15.55:0/1498378131 learned_addr learned my addr 172.21.15.55:0/1498378131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:14.944 INFO:tasks.workunit.client.0.smithi055.stdout:5/424: dwrite d4/df/d13/d26/d3c/d4a/d3f/f2c [0,4194304] 0 2024-04-26T21:08:14.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.944+0000 7f0bc2a00700 1 -- 172.21.15.55:0/1498378131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 msgr2=0x7f0bc419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:14.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.944+0000 7f0bc2a00700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 0x7f0bc419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:14.945 INFO:tasks.workunit.client.0.smithi055.stdout:1/512: dread d8/d17/d1b/f62 [0,4194304] 0 2024-04-26T21:08:14.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.944+0000 7f0bc2a00700 1 -- 172.21.15.55:0/1498378131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0095f0 con 0x7f0bc419d3c0 2024-04-26T21:08:14.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.944+0000 7f0bc2a00700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b800 tx=0x7f0bac005690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:14.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.945+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac01d070 con 0x7f0bc419d3c0 2024-04-26T21:08:14.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.945+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bac00f460 con 0x7f0bc419d3c0 2024-04-26T21:08:14.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.945+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac021640 con 0x7f0bc419d3c0 2024-04-26T21:08:14.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.946+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc41a2920 con 0x7f0bc419d3c0 2024-04-26T21:08:14.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.946+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc41a2e90 con 0x7f0bc419d3c0 2024-04-26T21:08:14.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.949+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc404ebb0 con 0x7f0bc419d3c0 2024-04-26T21:08:14.951 INFO:tasks.workunit.client.0.smithi055.stdout:8/483: rename d3/d9/d1f/c43 to d3/d9/d1f/d2e/d75/d76/ca3 0 2024-04-26T21:08:14.951 INFO:tasks.workunit.client.0.smithi055.stdout:8/484: stat d3/d9/l9d 0 2024-04-26T21:08:14.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.951+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f0bac004ab0 con 0x7f0bc419d3c0 2024-04-26T21:08:14.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.954+0000 7f0bbbe00700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 0x7f0ba8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:14.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.956+0000 7f0bbaa00700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 0x7f0ba8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:14.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.957+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f0bac08fc50 con 0x7f0bc419d3c0 2024-04-26T21:08:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.960+0000 7f0bbaa00700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 0x7f0ba8070f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4067ab0 tx=0x7f0bb4006d20 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:14.961 INFO:tasks.workunit.client.0.smithi055.stdout:2/617: unlink d4/d14/d17/c2c 0 2024-04-26T21:08:14.962 INFO:tasks.workunit.client.0.smithi055.stdout:2/618: fdatasync d4/db/d56/f70 0 2024-04-26T21:08:14.962 INFO:tasks.workunit.client.0.smithi055.stdout:2/619: stat d4/l2b 0 2024-04-26T21:08:14.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/577: link d9/dc/d17/l38 d9/d11/d59/lb9 0 2024-04-26T21:08:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:14.968+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f0bac05c830 con 0x7f0bc419d3c0 2024-04-26T21:08:14.979 INFO:tasks.workunit.client.0.smithi055.stdout:4/462: dwrite d4/d12/d17/d3d/f8c [0,4194304] 0 2024-04-26T21:08:14.983 INFO:tasks.workunit.client.0.smithi055.stdout:2/620: dread d4/d1e/d2a/f30 [0,4194304] 0 2024-04-26T21:08:14.987 INFO:tasks.workunit.client.0.smithi055.stdout:3/658: rmdir d0/d4/d5/d73/d13/d27/d50/d6b 39 2024-04-26T21:08:14.989 INFO:tasks.workunit.client.0.smithi055.stdout:7/528: truncate d5/d6/f31 7287470 0 2024-04-26T21:08:14.989 INFO:tasks.workunit.client.0.smithi055.stdout:7/529: creat d5/d6/d24/d48/d7f/f96 x:0 0 0 2024-04-26T21:08:14.990 INFO:tasks.workunit.client.1.smithi064.stdout:6/737: rmdir d4/d7/d12 39 2024-04-26T21:08:14.990 INFO:tasks.workunit.client.1.smithi064.stdout:6/738: chown d4/d7/d12/f18 13707 1 2024-04-26T21:08:14.993 INFO:tasks.workunit.client.0.smithi055.stdout:9/603: mkdir d2/d14/db8/dc5/dcf 0 2024-04-26T21:08:15.007 INFO:tasks.workunit.client.1.smithi064.stdout:6/739: dread d4/d7/fe [0,4194304] 0 2024-04-26T21:08:15.007 INFO:tasks.workunit.client.1.smithi064.stdout:6/740: chown d4/d7/d33/l84 120230 1 2024-04-26T21:08:15.009 INFO:tasks.workunit.client.1.smithi064.stdout:2/881: creat d12/d41/d73/d83/d94/d3a/d46/d91/d92/f12a x:0 0 0 2024-04-26T21:08:15.009 INFO:tasks.workunit.client.1.smithi064.stdout:2/882: creat d12/d41/d73/d83/d94/d3a/d46/d91/d92/f12b x:0 0 0 2024-04-26T21:08:15.014 INFO:tasks.workunit.client.1.smithi064.stdout:9/763: mkdir d0/d4/da/d26/d45/dfd 0 2024-04-26T21:08:15.015 INFO:tasks.workunit.client.1.smithi064.stdout:7/787: sync 2024-04-26T21:08:15.015 INFO:tasks.workunit.client.1.smithi064.stdout:7/788: chown d6/d15/de7/lbf 55 1 2024-04-26T21:08:15.015 INFO:tasks.workunit.client.1.smithi064.stdout:7/789: fdatasync d6/db/f2d 0 2024-04-26T21:08:15.016 INFO:tasks.workunit.client.1.smithi064.stdout:3/713: unlink d1/d27/d50/d35/fc4 0 2024-04-26T21:08:15.018 INFO:tasks.workunit.client.0.smithi055.stdout:5/425: mknod d4/df/d13/d26/d3c/d4a/d3f/d4f/c9b 0 2024-04-26T21:08:15.018 INFO:tasks.workunit.client.0.smithi055.stdout:5/426: chown d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/l8d 7238621 1 2024-04-26T21:08:15.019 INFO:tasks.workunit.client.1.smithi064.stdout:5/720: mknod dd/da9/ce8 0 2024-04-26T21:08:15.021 INFO:tasks.workunit.client.0.smithi055.stdout:1/513: link d8/df/d11/f37 d8/df/d11/d27/d63/fa9 0 2024-04-26T21:08:15.025 INFO:tasks.workunit.client.1.smithi064.stdout:1/904: unlink d0/d6/d11/d1e/d2a/d34/fdc 0 2024-04-26T21:08:15.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/485: mkdir d3/d9/d5b/da4 0 2024-04-26T21:08:15.028 INFO:tasks.workunit.client.0.smithi055.stdout:0/578: unlink d9/fa1 0 2024-04-26T21:08:15.028 INFO:tasks.workunit.client.0.smithi055.stdout:0/579: fdatasync d9/dc/f57 0 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:8/682: creat d10/d41/d4e/d59/d5d/d79/fd6 x:0 0 0 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:4/831: mknod d0/d5/d13/d33/c116 0 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:4/832: chown d0/d1d/d56/d89/dda/ffc 16 1 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:4/833: chown d0/d1d/d56/d89/l91 244937829 1 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:4/834: truncate d0/d1d/d17/f107 272571 0 2024-04-26T21:08:15.033 INFO:tasks.workunit.client.1.smithi064.stdout:6/741: symlink d4/d7/d12/d49/d4b/d5a/d8f/lf0 0 2024-04-26T21:08:15.034 INFO:tasks.workunit.client.1.smithi064.stdout:6/742: truncate d4/d7/d12/d49/d4b/d56/d95/fcc 1127487 0 2024-04-26T21:08:15.034 INFO:tasks.workunit.client.1.smithi064.stdout:9/764: dread d0/d4/d28/f2d [0,4194304] 0 2024-04-26T21:08:15.034 INFO:tasks.workunit.client.1.smithi064.stdout:6/743: write d4/d7/f4e [92563,110549] 0 2024-04-26T21:08:15.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/714: dread d1/d27/d29/d6f/f86 [0,4194304] 0 2024-04-26T21:08:15.034 INFO:tasks.workunit.client.1.smithi064.stdout:3/715: truncate d1/d27/d50/f91 584363 0 2024-04-26T21:08:15.035 INFO:tasks.workunit.client.0.smithi055.stdout:0/580: dread d9/dc/d1c/d3e/d7d/da3/d97/db6/f8e [0,4194304] 0 2024-04-26T21:08:15.036 INFO:tasks.workunit.client.0.smithi055.stdout:4/463: creat d4/d18/d8e/d9e/fa0 x:0 0 0 2024-04-26T21:08:15.036 INFO:tasks.workunit.client.0.smithi055.stdout:6/558: sync 2024-04-26T21:08:15.038 INFO:tasks.workunit.client.1.smithi064.stdout:2/883: symlink d12/l12c 0 2024-04-26T21:08:15.038 INFO:tasks.workunit.client.1.smithi064.stdout:2/884: write d12/fb8 [5451479,67575] 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.1.smithi064.stdout:2/885: write d12/d41/d73/d83/d94/f3f [128138,55831] 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.1.smithi064.stdout:2/886: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f10d [1145459,35176] 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.1.smithi064.stdout:2/887: creat d12/d41/d73/d83/d94/d3a/d46/dee/f12d x:0 0 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.1.smithi064.stdout:2/888: stat d12/d41/d61 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.1.smithi064.stdout:2/889: write d12/d41/d73/d83/d94/d3a/d46/d48/fa1 [305090,8687] 0 2024-04-26T21:08:15.039 INFO:tasks.workunit.client.0.smithi055.stdout:2/621: mkdir d4/db/d26/d9a/dc3 0 2024-04-26T21:08:15.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/683: dread d10/d1d/d38/fb0 [0,4194304] 0 2024-04-26T21:08:15.040 INFO:tasks.workunit.client.1.smithi064.stdout:8/684: write d10/d1d/d38/f5b [1547843,22717] 0 2024-04-26T21:08:15.041 INFO:tasks.workunit.client.1.smithi064.stdout:5/721: truncate dd/d12/d18/d25/d32/f37 1080064 0 2024-04-26T21:08:15.043 INFO:tasks.workunit.client.0.smithi055.stdout:3/659: mkdir d0/d4/d5/d73/d47/d37/de7 0 2024-04-26T21:08:15.045 INFO:tasks.workunit.client.0.smithi055.stdout:6/559: dread d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d [0,4194304] 0 2024-04-26T21:08:15.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/530: creat d5/d53/d6e/d6c/d7a/f97 x:0 0 0 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/531: write d5/f83 [716267,30693] 0 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/532: chown d5/d6/d24/c8d 120 1 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/533: fsync d5/d6/d24/f4b 0 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/534: fdatasync d5/db/f14 0 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/535: write d5/db/f1e [1780447,76146] 0 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/536: chown d5/d6/d24/d48/d7f/d6f/f95 118001 1 2024-04-26T21:08:15.050 INFO:tasks.workunit.client.0.smithi055.stdout:7/537: chown d5/d6/d24/d48/d58/c5c 576078 1 2024-04-26T21:08:15.051 INFO:tasks.workunit.client.1.smithi064.stdout:9/765: read d0/d4/da/d26/d47/f65 [1202095,29211] 0 2024-04-26T21:08:15.051 INFO:tasks.workunit.client.1.smithi064.stdout:9/766: fdatasync d0/d4/da/d26/d47/d9d/fe3 0 2024-04-26T21:08:15.051 INFO:tasks.workunit.client.1.smithi064.stdout:0/747: rename dd/d21/dc8/d31/d43/l71 to dd/d21/lfb 0 2024-04-26T21:08:15.052 INFO:tasks.workunit.client.1.smithi064.stdout:0/748: readlink dd/d21/dc8/d31/d47/l54 0 2024-04-26T21:08:15.052 INFO:tasks.workunit.client.1.smithi064.stdout:4/835: chown d0/d5/d79/cb2 16 1 2024-04-26T21:08:15.052 INFO:tasks.workunit.client.1.smithi064.stdout:0/749: fdatasync dd/ff3 0 2024-04-26T21:08:15.052 INFO:tasks.workunit.client.1.smithi064.stdout:6/744: mkdir d4/d7/d12/d49/d4b/d56/df1 0 2024-04-26T21:08:15.052 INFO:tasks.workunit.client.0.smithi055.stdout:9/604: getdents d2/d46/d77/d7d/d94 0 2024-04-26T21:08:15.054 INFO:tasks.workunit.client.1.smithi064.stdout:3/716: symlink d1/d14/de6/lf3 0 2024-04-26T21:08:15.056 INFO:tasks.workunit.client.0.smithi055.stdout:5/427: mknod d4/df/d13/d26/d3c/d4a/d92/c9c 0 2024-04-26T21:08:15.056 INFO:tasks.workunit.client.0.smithi055.stdout:5/428: write d4/df/d13/d26/d3c/d4a/d92/f9a [72318,86242] 0 2024-04-26T21:08:15.056 INFO:tasks.workunit.client.0.smithi055.stdout:5/429: write d4/df/d13/d26/d3c/f71 [8965242,125729] 0 2024-04-26T21:08:15.057 INFO:tasks.workunit.client.0.smithi055.stdout:5/430: fsync d4/df/f1b 0 2024-04-26T21:08:15.057 INFO:tasks.workunit.client.0.smithi055.stdout:5/431: fdatasync d4/df/d13/d26/d3c/f79 0 2024-04-26T21:08:15.061 INFO:tasks.workunit.client.0.smithi055.stdout:1/514: mkdir d8/df/d11/d27/d28/da4/daa 0 2024-04-26T21:08:15.065 INFO:tasks.workunit.client.0.smithi055.stdout:8/486: unlink d3/d9/d1d/f65 0 2024-04-26T21:08:15.066 INFO:tasks.workunit.client.1.smithi064.stdout:2/890: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/l12e 0 2024-04-26T21:08:15.068 INFO:tasks.workunit.client.0.smithi055.stdout:0/581: mknod d9/dc/d1c/d54/d4b/cba 0 2024-04-26T21:08:15.068 INFO:tasks.workunit.client.0.smithi055.stdout:0/582: fdatasync d9/dc/d1c/f9f 0 2024-04-26T21:08:15.069 INFO:tasks.workunit.client.1.smithi064.stdout:9/767: mkdir d0/d4/d7/df6/dfe 0 2024-04-26T21:08:15.070 INFO:tasks.workunit.client.0.smithi055.stdout:9/605: dread d2/d46/d77/d7d/da8/fab [4194304,4194304] 0 2024-04-26T21:08:15.070 INFO:tasks.workunit.client.0.smithi055.stdout:9/606: write d2/d46/d77/d7d/f90 [5192863,64203] 0 2024-04-26T21:08:15.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/790: rename d6/caa to d6/db/dc1/c10e 0 2024-04-26T21:08:15.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/791: creat d6/db/dc1/f10f x:0 0 0 2024-04-26T21:08:15.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/792: chown d6/db/d8e 189165 1 2024-04-26T21:08:15.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/793: chown d6/d9/f36 91421 1 2024-04-26T21:08:15.072 INFO:tasks.workunit.client.1.smithi064.stdout:7/794: write d6/db/d34/f5b [5525823,80951] 0 2024-04-26T21:08:15.072 INFO:tasks.workunit.client.1.smithi064.stdout:7/795: readlink d6/db/d1f/d50/db8/l105 0 2024-04-26T21:08:15.075 INFO:tasks.workunit.client.0.smithi055.stdout:2/622: rename d4/db/d1f/d46/f64 to d4/fc4 0 2024-04-26T21:08:15.075 INFO:tasks.workunit.client.0.smithi055.stdout:3/660: mkdir d0/d4/d5/d73/d47/d37/de8 0 2024-04-26T21:08:15.076 INFO:tasks.workunit.client.0.smithi055.stdout:3/661: chown d0/d4/d5/d73/d47/d37/dbd/fdf 34761771 1 2024-04-26T21:08:15.076 INFO:tasks.workunit.client.0.smithi055.stdout:3/662: dread - d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad zero size 2024-04-26T21:08:15.080 INFO:tasks.workunit.client.1.smithi064.stdout:0/750: getdents dd/d10 0 2024-04-26T21:08:15.081 INFO:tasks.workunit.client.0.smithi055.stdout:6/560: mkdir d3/d17/d25/dc7 0 2024-04-26T21:08:15.081 INFO:tasks.workunit.client.1.smithi064.stdout:3/717: creat d1/d27/d29/d5e/ff4 x:0 0 0 2024-04-26T21:08:15.087 INFO:tasks.workunit.client.0.smithi055.stdout:7/538: truncate d5/d53/d6e/f64 1781956 0 2024-04-26T21:08:15.089 INFO:tasks.workunit.client.1.smithi064.stdout:9/768: mkdir d0/d4/d28/dff 0 2024-04-26T21:08:15.089 INFO:tasks.workunit.client.1.smithi064.stdout:9/769: write d0/d4/da/d31/fe7 [4193186,33501] 0 2024-04-26T21:08:15.089 INFO:tasks.workunit.client.1.smithi064.stdout:9/770: readlink d0/d4/da/l21 0 2024-04-26T21:08:15.096 INFO:tasks.workunit.client.0.smithi055.stdout:5/432: mknod d4/df/d13/d26/d3c/d4a/d3f/c9d 0 2024-04-26T21:08:15.097 INFO:tasks.workunit.client.0.smithi055.stdout:3/663: dread d0/d4/d16/d18/f30 [0,4194304] 0 2024-04-26T21:08:15.097 INFO:tasks.workunit.client.0.smithi055.stdout:3/664: chown d0/d4 562 1 2024-04-26T21:08:15.098 INFO:tasks.workunit.client.0.smithi055.stdout:2/623: read d4/d49/d4c/f99 [2748226,24815] 0 2024-04-26T21:08:15.098 INFO:tasks.workunit.client.0.smithi055.stdout:2/624: read d4/dc/d21/f24 [1033992,65811] 0 2024-04-26T21:08:15.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/891: dread d12/d41/d73/d83/d94/d3a/dba/ff4 [0,4194304] 0 2024-04-26T21:08:15.098 INFO:tasks.workunit.client.1.smithi064.stdout:2/892: write d12/d41/d73/d83/d94/d3a/d46/dee/f12d [11927,75128] 0 2024-04-26T21:08:15.105 INFO:tasks.workunit.client.0.smithi055.stdout:1/515: rmdir d8/d17 39 2024-04-26T21:08:15.105 INFO:tasks.workunit.client.1.smithi064.stdout:7/796: creat d6/d15/f110 x:0 0 0 2024-04-26T21:08:15.106 INFO:tasks.workunit.client.1.smithi064.stdout:8/685: dwrite d10/d41/d4e/d54/f9f [0,4194304] 0 2024-04-26T21:08:15.106 INFO:tasks.workunit.client.1.smithi064.stdout:8/686: write d10/d1d/da3/fc1 [4970824,60093] 0 2024-04-26T21:08:15.107 INFO:tasks.workunit.client.0.smithi055.stdout:8/487: mknod d3/d89/ca5 0 2024-04-26T21:08:15.110 INFO:tasks.workunit.client.0.smithi055.stdout:0/583: truncate d9/dc/d1c/d3e/f47 3781332 0 2024-04-26T21:08:15.114 INFO:tasks.workunit.client.0.smithi055.stdout:4/464: rmdir d4/d18/d1a/d49 39 2024-04-26T21:08:15.122 INFO:tasks.workunit.client.0.smithi055.stdout:2/625: dread d4/d14/d33/f59 [0,4194304] 0 2024-04-26T21:08:15.126 INFO:tasks.workunit.client.0.smithi055.stdout:9/607: symlink d2/d11/ld0 0 2024-04-26T21:08:15.127 INFO:tasks.workunit.client.0.smithi055.stdout:9/608: chown d2/d46/d77/d7d/lac 1536 1 2024-04-26T21:08:15.132 INFO:tasks.workunit.client.0.smithi055.stdout:7/539: truncate d5/d6/d24/d3b/f45 2483398 0 2024-04-26T21:08:15.132 INFO:tasks.workunit.client.0.smithi055.stdout:7/540: creat d5/d6/d24/d48/d7f/f98 x:0 0 0 2024-04-26T21:08:15.137 INFO:tasks.workunit.client.0.smithi055.stdout:5/433: rmdir d4/df/d13/d26/d3c 39 2024-04-26T21:08:15.141 INFO:tasks.workunit.client.0.smithi055.stdout:3/665: mkdir d0/d4/d5/d73/d47/d37/da6/de9 0 2024-04-26T21:08:15.141 INFO:tasks.workunit.client.0.smithi055.stdout:3/666: read d0/d4/d5/d73/d13/f7e [3234310,53144] 0 2024-04-26T21:08:15.147 INFO:tasks.workunit.client.1.smithi064.stdout:4/836: rmdir d0/d5 39 2024-04-26T21:08:15.150 INFO:tasks.workunit.client.0.smithi055.stdout:8/488: mkdir d3/d9/d1f/d2e/da6 0 2024-04-26T21:08:15.150 INFO:tasks.workunit.client.0.smithi055.stdout:8/489: readlink d3/d9/d1d/d48/d4b/l66 0 2024-04-26T21:08:15.150 INFO:tasks.workunit.client.1.smithi064.stdout:9/771: truncate d0/d4/da/fc 7277251 0 2024-04-26T21:08:15.152 INFO:tasks.workunit.client.0.smithi055.stdout:4/465: rmdir d4/d26/d42/d28/d53/d70/d9f 0 2024-04-26T21:08:15.153 INFO:tasks.workunit.client.0.smithi055.stdout:4/466: write d4/d26/d42/d28/d53/d71/d7f/f9d [1020897,108860] 0 2024-04-26T21:08:15.153 INFO:tasks.workunit.client.0.smithi055.stdout:2/626: rmdir d4/d49/d4c 39 2024-04-26T21:08:15.155 INFO:tasks.workunit.client.1.smithi064.stdout:2/893: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d120/d12f 0 2024-04-26T21:08:15.155 INFO:tasks.workunit.client.1.smithi064.stdout:2/894: stat d12/d41/d61/d6c/fc8 0 2024-04-26T21:08:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:14 smithi064 ceph-mon[33404]: pgmap v40: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 146 MiB/s rd, 191 MiB/s wr, 273 op/s 2024-04-26T21:08:15.156 INFO:tasks.workunit.client.0.smithi055.stdout:9/609: creat d2/d46/fd1 x:0 0 0 2024-04-26T21:08:15.156 INFO:tasks.workunit.client.0.smithi055.stdout:9/610: creat d2/d11/fd2 x:0 0 0 2024-04-26T21:08:15.161 INFO:tasks.workunit.client.1.smithi064.stdout:6/745: dwrite d4/d7/d12/dbc/fca [0,4194304] 0 2024-04-26T21:08:15.162 INFO:tasks.workunit.client.1.smithi064.stdout:7/797: dwrite d6/d9/d3d/fe1 [0,4194304] 0 2024-04-26T21:08:15.164 INFO:tasks.workunit.client.1.smithi064.stdout:8/687: mknod d10/d41/d44/cd7 0 2024-04-26T21:08:15.167 INFO:tasks.workunit.client.0.smithi055.stdout:5/434: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/d9e 0 2024-04-26T21:08:15.167 INFO:tasks.workunit.client.0.smithi055.stdout:5/435: stat f2 0 2024-04-26T21:08:15.169 INFO:tasks.workunit.client.1.smithi064.stdout:5/722: dwrite dd/d12/d4f/f55 [4194304,4194304] 0 2024-04-26T21:08:15.170 INFO:tasks.workunit.client.1.smithi064.stdout:1/905: rename d0/d6/d11/d1e/d2a/d72 to d0/d6/d11/d1e/d2a/d34/d57/d118 0 2024-04-26T21:08:15.172 INFO:tasks.workunit.client.0.smithi055.stdout:6/561: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e [0,4194304] 0 2024-04-26T21:08:15.172 INFO:tasks.workunit.client.0.smithi055.stdout:6/562: chown d3/fbe 240743411 1 2024-04-26T21:08:15.172 INFO:tasks.workunit.client.0.smithi055.stdout:6/563: fsync d3/d17/d25/d5f/d90/f87 0 2024-04-26T21:08:15.172 INFO:tasks.workunit.client.0.smithi055.stdout:6/564: dread - d3/d17/d46/d54/d66/d6a/fb8 zero size 2024-04-26T21:08:15.173 INFO:tasks.workunit.client.0.smithi055.stdout:3/667: symlink d0/d4/d5/d73/d47/d37/lea 0 2024-04-26T21:08:15.182 INFO:tasks.workunit.client.0.smithi055.stdout:8/490: dread d3/f41 [0,4194304] 0 2024-04-26T21:08:15.186 INFO:tasks.workunit.client.1.smithi064.stdout:0/751: dwrite dd/d21/dc8/d31/d47/f53 [0,4194304] 0 2024-04-26T21:08:15.187 INFO:tasks.workunit.client.0.smithi055.stdout:9/611: symlink d2/d14/db8/dc5/ld3 0 2024-04-26T21:08:15.187 INFO:tasks.workunit.client.0.smithi055.stdout:9/612: write d2/d14/d97/fc4 [643197,115294] 0 2024-04-26T21:08:15.193 INFO:tasks.workunit.client.1.smithi064.stdout:4/837: dread d0/d1d/f49 [0,4194304] 0 2024-04-26T21:08:15.194 INFO:tasks.workunit.client.0.smithi055.stdout:5/436: rename d4/df/d13/d26/d3c/d4a/f55 to d4/df/d13/d26/d3c/d4a/d3f/d4f/f9f 0 2024-04-26T21:08:15.194 INFO:tasks.workunit.client.0.smithi055.stdout:5/437: fdatasync f2 0 2024-04-26T21:08:15.194 INFO:tasks.workunit.client.0.smithi055.stdout:5/438: getdents d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90 0 2024-04-26T21:08:15.194 INFO:tasks.workunit.client.0.smithi055.stdout:5/439: chown d4/df/d13/d26/d3c/d4a/d3f/f96 11353 1 2024-04-26T21:08:15.202 INFO:tasks.workunit.client.1.smithi064.stdout:8/688: symlink d10/d2f/d61/ld8 0 2024-04-26T21:08:15.202 INFO:tasks.workunit.client.1.smithi064.stdout:8/689: chown d10/f47 1021616723 1 2024-04-26T21:08:15.202 INFO:tasks.workunit.client.1.smithi064.stdout:8/690: read - d10/d2f/d90/da0/fca zero size 2024-04-26T21:08:15.202 INFO:tasks.workunit.client.1.smithi064.stdout:8/691: dread - d10/d41/d4e/d59/fba zero size 2024-04-26T21:08:15.206 INFO:tasks.workunit.client.1.smithi064.stdout:9/772: mkdir d0/d4/da/d26/d100 0 2024-04-26T21:08:15.206 INFO:tasks.workunit.client.1.smithi064.stdout:9/773: stat d0/d4/da/d26/d5e/f69 0 2024-04-26T21:08:15.208 INFO:tasks.workunit.client.0.smithi055.stdout:6/565: creat d3/d17/fc8 x:0 0 0 2024-04-26T21:08:15.213 INFO:tasks.workunit.client.0.smithi055.stdout:3/668: link d0/d4/d5/d73/d13/d1a/d46/d55/f96 d0/d4/d16/d18/d4b/feb 0 2024-04-26T21:08:15.216 INFO:tasks.workunit.client.1.smithi064.stdout:6/746: dwrite d4/d7/d12/d1e/f45 [0,4194304] 0 2024-04-26T21:08:15.218 INFO:tasks.workunit.client.1.smithi064.stdout:1/906: mknod d0/d6/d11/d2c/d112/c119 0 2024-04-26T21:08:15.220 INFO:tasks.workunit.client.0.smithi055.stdout:7/541: write d5/d6/d24/f27 [4050916,43206] 0 2024-04-26T21:08:15.220 INFO:tasks.workunit.client.0.smithi055.stdout:7/542: chown d5/d53 706771 1 2024-04-26T21:08:15.222 INFO:tasks.workunit.client.0.smithi055.stdout:2/627: getdents d4/d14/d17/d36 0 2024-04-26T21:08:15.224 INFO:tasks.workunit.client.1.smithi064.stdout:3/718: rename d1/d27/d50/d35/d4c/d7b/d82/cb6 to d1/d27/d29/d6f/d72/da5/d7d/d8a/cf5 0 2024-04-26T21:08:15.224 INFO:tasks.workunit.client.1.smithi064.stdout:3/719: stat d1/d27/d50/d35/d4c/d7b/d82 0 2024-04-26T21:08:15.224 INFO:tasks.workunit.client.1.smithi064.stdout:3/720: truncate d1/d27/d29/d6f/d72/d26/fcf 526099 0 2024-04-26T21:08:15.225 INFO:tasks.workunit.client.0.smithi055.stdout:8/491: symlink d3/d9/d5b/da4/la7 0 2024-04-26T21:08:15.228 INFO:tasks.workunit.client.0.smithi055.stdout:9/613: rmdir d2/d46/d77/d7d/d94 39 2024-04-26T21:08:15.230 INFO:tasks.workunit.client.1.smithi064.stdout:2/895: getdents d12/da9 0 2024-04-26T21:08:15.230 INFO:tasks.workunit.client.1.smithi064.stdout:2/896: dread - d12/d41/d73/d83/d94/d3a/d3e/f84 zero size 2024-04-26T21:08:15.230 INFO:tasks.workunit.client.1.smithi064.stdout:0/752: mkdir dd/d21/dd9/dfc 0 2024-04-26T21:08:15.231 INFO:tasks.workunit.client.1.smithi064.stdout:0/753: write dd/d21/dc8/d31/d47/dad/faf [813605,125704] 0 2024-04-26T21:08:15.234 INFO:tasks.workunit.client.1.smithi064.stdout:4/838: mknod d0/d5/d13/d6d/d97/df6/c117 0 2024-04-26T21:08:15.235 INFO:tasks.workunit.client.1.smithi064.stdout:4/839: write d0/d5/d13/d6d/dd3/ffd [519733,63560] 0 2024-04-26T21:08:15.235 INFO:tasks.workunit.client.0.smithi055.stdout:5/440: mknod d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/d9e/ca0 0 2024-04-26T21:08:15.237 INFO:tasks.workunit.client.0.smithi055.stdout:4/467: dwrite d4/d26/d42/d28/d53/d71/f73 [0,4194304] 0 2024-04-26T21:08:15.239 INFO:tasks.workunit.client.1.smithi064.stdout:7/798: mknod d6/d70/da8/dd1/c111 0 2024-04-26T21:08:15.239 INFO:tasks.workunit.client.1.smithi064.stdout:7/799: write d6/d15/d67/f94 [4687551,127885] 0 2024-04-26T21:08:15.243 INFO:tasks.workunit.client.1.smithi064.stdout:8/692: truncate d10/d2f/f33 1707152 0 2024-04-26T21:08:15.244 INFO:tasks.workunit.client.0.smithi055.stdout:6/566: creat d3/d17/d19/fc9 x:0 0 0 2024-04-26T21:08:15.247 INFO:tasks.workunit.client.1.smithi064.stdout:9/774: creat d0/d4/da/d26/d45/f101 x:0 0 0 2024-04-26T21:08:15.249 INFO:tasks.workunit.client.0.smithi055.stdout:1/516: dwrite d8/d17/d1b/d7b/f90 [0,4194304] 0 2024-04-26T21:08:15.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:14 smithi055 ceph-mon[25475]: pgmap v40: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 146 MiB/s rd, 191 MiB/s wr, 273 op/s 2024-04-26T21:08:15.255 INFO:tasks.workunit.client.0.smithi055.stdout:2/628: mkdir d4/d14/dc5 0 2024-04-26T21:08:15.256 INFO:tasks.workunit.client.1.smithi064.stdout:5/723: rmdir dd/d12/d4f/d9c/da1 39 2024-04-26T21:08:15.257 INFO:tasks.workunit.client.0.smithi055.stdout:8/492: link d3/d9/d1d/d48/d57/d61/l88 d3/d9/d1f/d2e/d75/d76/d92/la8 0 2024-04-26T21:08:15.258 INFO:tasks.workunit.client.0.smithi055.stdout:9/614: symlink d2/d46/d77/d79/ld4 0 2024-04-26T21:08:15.258 INFO:tasks.workunit.client.0.smithi055.stdout:9/615: chown d2/d11/f6e 98478516 1 2024-04-26T21:08:15.258 INFO:tasks.workunit.client.0.smithi055.stdout:9/616: write d2/d46/f48 [171821,79614] 0 2024-04-26T21:08:15.263 INFO:tasks.workunit.client.1.smithi064.stdout:1/907: mkdir d0/d6b/d9e/da2/dc9/d11a 0 2024-04-26T21:08:15.263 INFO:tasks.workunit.client.1.smithi064.stdout:4/840: rmdir d0/d5/d13/d6d/d97/df6 39 2024-04-26T21:08:15.263 INFO:tasks.workunit.client.1.smithi064.stdout:1/908: write d0/d22/f5f [3152986,48188] 0 2024-04-26T21:08:15.268 INFO:tasks.workunit.client.0.smithi055.stdout:4/468: mkdir d4/d26/d42/d28/d53/d71/d7f/da1 0 2024-04-26T21:08:15.272 INFO:tasks.workunit.client.1.smithi064.stdout:9/775: dread d0/d4/da/fc [4194304,4194304] 0 2024-04-26T21:08:15.273 INFO:tasks.workunit.client.1.smithi064.stdout:8/693: mkdir d10/d41/d4e/d59/d5d/dd9 0 2024-04-26T21:08:15.273 INFO:tasks.workunit.client.1.smithi064.stdout:5/724: rename dd/d12/d18/d25/d32/f8c to dd/d12/d18/d25/d74/fe9 0 2024-04-26T21:08:15.273 INFO:tasks.workunit.client.1.smithi064.stdout:2/897: dread d12/d41/d73/d83/d94/d3a/d46/d6a/f7e [0,4194304] 0 2024-04-26T21:08:15.274 INFO:tasks.workunit.client.1.smithi064.stdout:4/841: creat d0/d5/d13/d10/db7/f118 x:0 0 0 2024-04-26T21:08:15.274 INFO:tasks.workunit.client.1.smithi064.stdout:2/898: creat d12/d88/f130 x:0 0 0 2024-04-26T21:08:15.274 INFO:tasks.workunit.client.1.smithi064.stdout:2/899: chown d12/d41/d73/d83/d94/d3a/d46/d91/d92/c126 1056953 1 2024-04-26T21:08:15.275 INFO:tasks.workunit.client.1.smithi064.stdout:3/721: dwrite d1/d27/d50/f5b [0,4194304] 0 2024-04-26T21:08:15.276 INFO:tasks.workunit.client.0.smithi055.stdout:1/517: link d8/df/d11/d27/d28/d2a/l5d d8/d17/d36/lab 0 2024-04-26T21:08:15.283 INFO:tasks.workunit.client.0.smithi055.stdout:5/441: write d4/df/d13/f4c [1800709,78499] 0 2024-04-26T21:08:15.283 INFO:tasks.workunit.client.0.smithi055.stdout:5/442: chown d4/df/d13/d26/d3c/d4a/f98 132606463 1 2024-04-26T21:08:15.284 INFO:tasks.workunit.client.0.smithi055.stdout:3/669: dwrite d0/d4/d16/f26 [4194304,4194304] 0 2024-04-26T21:08:15.284 INFO:tasks.workunit.client.0.smithi055.stdout:3/670: chown d0/d4/d16/d18/d4b/d57/d8e 28197 1 2024-04-26T21:08:15.284 INFO:tasks.workunit.client.0.smithi055.stdout:3/671: truncate d0/d4/d5/d73/d13/d1a/d46/d72/fd1 909417 0 2024-04-26T21:08:15.284 INFO:tasks.workunit.client.0.smithi055.stdout:7/543: rename d5/d6/d24/d48 to d5/d53/d6e/d99 0 2024-04-26T21:08:15.285 INFO:tasks.workunit.client.1.smithi064.stdout:5/725: dread dd/da9/d48/f7e [0,4194304] 0 2024-04-26T21:08:15.285 INFO:tasks.workunit.client.1.smithi064.stdout:5/726: fsync dd/d12/d4f/dbd/fe1 0 2024-04-26T21:08:15.285 INFO:tasks.workunit.client.1.smithi064.stdout:9/776: mkdir d0/d4/d7/d102 0 2024-04-26T21:08:15.287 INFO:tasks.workunit.client.1.smithi064.stdout:8/694: symlink d10/d2f/d90/lda 0 2024-04-26T21:08:15.287 INFO:tasks.workunit.client.1.smithi064.stdout:8/695: getdents d10/d41/d44/d5a/da2 0 2024-04-26T21:08:15.287 INFO:tasks.workunit.client.1.smithi064.stdout:8/696: getdents d10/d41/d4e/d59/d5d/dd9 0 2024-04-26T21:08:15.288 INFO:tasks.workunit.client.1.smithi064.stdout:7/800: dwrite d6/d9/d3d/fba [0,4194304] 0 2024-04-26T21:08:15.289 INFO:tasks.workunit.client.0.smithi055.stdout:2/629: link d4/db/d8f/da6/lc1 d4/d1e/d2a/lc6 0 2024-04-26T21:08:15.292 INFO:tasks.workunit.client.0.smithi055.stdout:8/493: mkdir d3/d77/da9 0 2024-04-26T21:08:15.292 INFO:tasks.workunit.client.0.smithi055.stdout:8/494: write d3/d9/d1d/d48/d57/f6f [1331395,124730] 0 2024-04-26T21:08:15.296 INFO:tasks.workunit.client.0.smithi055.stdout:9/617: stat d2/d11/l31 0 2024-04-26T21:08:15.296 INFO:tasks.workunit.client.0.smithi055.stdout:9/618: write d2/f1e [2974051,52907] 0 2024-04-26T21:08:15.299 INFO:tasks.workunit.client.1.smithi064.stdout:4/842: symlink d0/d2f/d69/l119 0 2024-04-26T21:08:15.302 INFO:tasks.workunit.client.0.smithi055.stdout:4/469: mknod d4/d26/d42/d28/d53/d71/d7f/da1/ca2 0 2024-04-26T21:08:15.303 INFO:tasks.workunit.client.1.smithi064.stdout:2/900: getdents d12/d41/d73/d83/d94/d3a/d46/d91/def 0 2024-04-26T21:08:15.309 INFO:tasks.workunit.client.0.smithi055.stdout:6/567: unlink d3/f9 0 2024-04-26T21:08:15.309 INFO:tasks.workunit.client.0.smithi055.stdout:7/544: read d5/d53/d6e/d99/d7f/d6f/f95 [476395,42944] 0 2024-04-26T21:08:15.312 INFO:tasks.workunit.client.1.smithi064.stdout:0/754: dwrite dd/d10/d74/d1d/f79 [0,4194304] 0 2024-04-26T21:08:15.312 INFO:tasks.workunit.client.1.smithi064.stdout:0/755: fdatasync dd/d21/dc8/d31/d47/f66 0 2024-04-26T21:08:15.312 INFO:tasks.workunit.client.0.smithi055.stdout:1/518: mknod d8/d17/d33/cac 0 2024-04-26T21:08:15.313 INFO:tasks.workunit.client.1.smithi064.stdout:0/756: write dd/d21/dc8/d31/d47/d61/f9d [471845,23564] 0 2024-04-26T21:08:15.314 INFO:tasks.workunit.client.0.smithi055.stdout:5/443: mkdir d4/df/d13/d26/d3c/d4a/d3f/da1 0 2024-04-26T21:08:15.317 INFO:tasks.workunit.client.0.smithi055.stdout:3/672: unlink d0/d4/d5/d73/d13/d1a/d46/d72/f53 0 2024-04-26T21:08:15.320 INFO:tasks.workunit.client.0.smithi055.stdout:8/495: dread d3/d9/d5b/f79 [0,4194304] 0 2024-04-26T21:08:15.320 INFO:tasks.workunit.client.0.smithi055.stdout:2/630: truncate d4/d49/f87 7275887 0 2024-04-26T21:08:15.320 INFO:tasks.workunit.client.0.smithi055.stdout:4/470: write d4/d26/d42/d2d/f3a [606168,12519] 0 2024-04-26T21:08:15.324 INFO:tasks.workunit.client.1.smithi064.stdout:3/722: symlink d1/d27/d50/d35/d4c/dd1/lf6 0 2024-04-26T21:08:15.326 INFO:tasks.workunit.client.0.smithi055.stdout:9/619: mknod d2/d14/db8/dc5/dcf/cd5 0 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:5/727: truncate dd/d12/d18/d25/d74/f82 466685 0 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:3/723: write d1/d27/f98 [920667,112857] 0 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/909: write d0/d6/d11/d1e/f56 [1208399,40234] 0 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/910: dread - d0/d22/d9f/df1/ffb zero size 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/911: chown d0/d6/d11/d1e/d27 487 1 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/912: truncate d0/d6/f7d 910002 0 2024-04-26T21:08:15.327 INFO:tasks.workunit.client.1.smithi064.stdout:1/913: creat d0/d6/dd/d100/f11b x:0 0 0 2024-04-26T21:08:15.328 INFO:tasks.workunit.client.1.smithi064.stdout:1/914: creat d0/f11c x:0 0 0 2024-04-26T21:08:15.328 INFO:tasks.workunit.client.1.smithi064.stdout:1/915: fsync d0/d6/d11/ffe 0 2024-04-26T21:08:15.328 INFO:tasks.workunit.client.1.smithi064.stdout:7/801: creat d6/db/f112 x:0 0 0 2024-04-26T21:08:15.329 INFO:tasks.workunit.client.0.smithi055.stdout:6/568: mkdir d3/d17/d19/d71/dca 0 2024-04-26T21:08:15.331 INFO:tasks.workunit.client.0.smithi055.stdout:7/545: getdents d5/d6/d24/d3b 0 2024-04-26T21:08:15.334 INFO:tasks.workunit.client.1.smithi064.stdout:4/843: creat d0/d5/d13/d33/dd0/f11a x:0 0 0 2024-04-26T21:08:15.334 INFO:tasks.workunit.client.1.smithi064.stdout:4/844: dread - d0/d5/d13/d33/dcf/fe2 zero size 2024-04-26T21:08:15.334 INFO:tasks.workunit.client.1.smithi064.stdout:2/901: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/lce 0 2024-04-26T21:08:15.335 INFO:tasks.workunit.client.0.smithi055.stdout:1/519: mknod d8/df/d11/d27/cad 0 2024-04-26T21:08:15.335 INFO:tasks.workunit.client.0.smithi055.stdout:1/520: chown d8/df/d11/d27/d28/d2a/l5d 3251 1 2024-04-26T21:08:15.338 INFO:tasks.workunit.client.1.smithi064.stdout:0/757: getdents dd/d21/dc8/d31/d43/db4/dc2 0 2024-04-26T21:08:15.342 INFO:tasks.workunit.client.0.smithi055.stdout:3/673: symlink d0/d4/d5/d73/d47/d37/de8/lec 0 2024-04-26T21:08:15.343 INFO:tasks.workunit.client.0.smithi055.stdout:9/620: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:15.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/724: getdents d1/d27/d50/d35/d4c/d7b/dcd 0 2024-04-26T21:08:15.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/725: creat d1/d27/d50/d35/d4c/d7b/d8e/ff7 x:0 0 0 2024-04-26T21:08:15.344 INFO:tasks.workunit.client.0.smithi055.stdout:8/496: mkdir d3/d89/daa 0 2024-04-26T21:08:15.344 INFO:tasks.workunit.client.0.smithi055.stdout:8/497: write d3/d9/d44/f98 [663590,102575] 0 2024-04-26T21:08:15.347 INFO:tasks.workunit.client.0.smithi055.stdout:2/631: truncate d4/dc/f12 2007515 0 2024-04-26T21:08:15.347 INFO:tasks.workunit.client.0.smithi055.stdout:2/632: fdatasync d4/db/d1f/d32/d57/fc0 0 2024-04-26T21:08:15.349 INFO:tasks.workunit.client.1.smithi064.stdout:7/802: read d6/d9/d3d/fba [3331225,4525] 0 2024-04-26T21:08:15.349 INFO:tasks.workunit.client.1.smithi064.stdout:7/803: fsync d6/d8c/f9c 0 2024-04-26T21:08:15.349 INFO:tasks.workunit.client.0.smithi055.stdout:6/569: truncate d3/d17/f18 4769642 0 2024-04-26T21:08:15.353 INFO:tasks.workunit.client.1.smithi064.stdout:9/777: dwrite d0/d4/da/f77 [0,4194304] 0 2024-04-26T21:08:15.353 INFO:tasks.workunit.client.1.smithi064.stdout:9/778: read d0/d4/da/f57 [1024054,105822] 0 2024-04-26T21:08:15.356 INFO:tasks.workunit.client.0.smithi055.stdout:7/546: symlink d5/d53/d6e/l9a 0 2024-04-26T21:08:15.356 INFO:tasks.workunit.client.0.smithi055.stdout:7/547: dread - d5/d53/d6e/d6c/d7a/f97 zero size 2024-04-26T21:08:15.357 INFO:tasks.workunit.client.0.smithi055.stdout:7/548: getdents d5/d53/d6e/d99/d75 0 2024-04-26T21:08:15.359 INFO:tasks.workunit.client.0.smithi055.stdout:1/521: creat d8/d17/fae x:0 0 0 2024-04-26T21:08:15.364 INFO:tasks.workunit.client.1.smithi064.stdout:4/845: rename d0/d5/d13/d10/f4c to d0/d2f/d69/db5/ddd/f11b 0 2024-04-26T21:08:15.364 INFO:tasks.workunit.client.1.smithi064.stdout:1/916: unlink d0/l8 0 2024-04-26T21:08:15.364 INFO:tasks.workunit.client.1.smithi064.stdout:1/917: fsync d0/d6/d11/f5e 0 2024-04-26T21:08:15.370 INFO:tasks.workunit.client.0.smithi055.stdout:9/621: link d2/d46/d51/l6a d2/d14/d97/d9b/ld6 0 2024-04-26T21:08:15.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/674: dread d0/d4/d5/f62 [0,4194304] 0 2024-04-26T21:08:15.370 INFO:tasks.workunit.client.0.smithi055.stdout:3/675: write d0/d4/d5/f2c [458582,61206] 0 2024-04-26T21:08:15.371 INFO:tasks.workunit.client.0.smithi055.stdout:3/676: chown d0/f22 680 1 2024-04-26T21:08:15.371 INFO:tasks.workunit.client.1.smithi064.stdout:2/902: creat d12/d41/d73/d83/d94/f131 x:0 0 0 2024-04-26T21:08:15.373 INFO:tasks.workunit.client.0.smithi055.stdout:8/498: creat d3/d9/fab x:0 0 0 2024-04-26T21:08:15.378 INFO:tasks.workunit.client.1.smithi064.stdout:6/747: dwrite d4/d7/d12/f68 [0,4194304] 0 2024-04-26T21:08:15.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/697: dwrite d10/d41/d44/f6d [0,4194304] 0 2024-04-26T21:08:15.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/698: chown l7 750 1 2024-04-26T21:08:15.380 INFO:tasks.workunit.client.1.smithi064.stdout:3/726: mkdir d1/d27/d29/d9d/df8 0 2024-04-26T21:08:15.380 INFO:tasks.workunit.client.1.smithi064.stdout:3/727: write d1/d27/d29/d6f/d72/da5/f7c [86245,127296] 0 2024-04-26T21:08:15.394 INFO:tasks.workunit.client.1.smithi064.stdout:7/804: mkdir d6/d15/d88/d113 0 2024-04-26T21:08:15.395 INFO:tasks.workunit.client.0.smithi055.stdout:2/633: mknod d4/d1e/dba/cc7 0 2024-04-26T21:08:15.398 INFO:tasks.workunit.client.1.smithi064.stdout:4/846: write d0/d14/f95 [1439736,102017] 0 2024-04-26T21:08:15.398 INFO:tasks.workunit.client.0.smithi055.stdout:6/570: getdents d3/da1 0 2024-04-26T21:08:15.400 INFO:tasks.workunit.client.0.smithi055.stdout:1/522: rmdir d8/df/d11/d27/d63 39 2024-04-26T21:08:15.404 INFO:tasks.workunit.client.1.smithi064.stdout:9/779: unlink d0/d4/da/d67/fc3 0 2024-04-26T21:08:15.407 INFO:tasks.workunit.client.0.smithi055.stdout:8/499: symlink d3/d9/d44/lac 0 2024-04-26T21:08:15.408 INFO:tasks.workunit.client.1.smithi064.stdout:8/699: dread d10/d41/d44/f66 [0,4194304] 0 2024-04-26T21:08:15.409 INFO:tasks.workunit.client.1.smithi064.stdout:1/918: rename d0/d6/f8f to d0/d6/d29/f11d 0 2024-04-26T21:08:15.409 INFO:tasks.workunit.client.1.smithi064.stdout:1/919: chown d0/d6/d91/ld7 44 1 2024-04-26T21:08:15.411 INFO:tasks.workunit.client.0.smithi055.stdout:4/471: dwrite d4/f36 [4194304,4194304] 0 2024-04-26T21:08:15.411 INFO:tasks.workunit.client.0.smithi055.stdout:9/622: dread d2/f1c [0,4194304] 0 2024-04-26T21:08:15.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.411+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc40fbf20 con 0x7f0ba806eab0 2024-04-26T21:08:15.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/571: mkdir d3/d17/d19/d71/dca/dcb 0 2024-04-26T21:08:15.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/572: fdatasync d3/d17/d25/d5f/d90/f69 0 2024-04-26T21:08:15.415 INFO:tasks.workunit.client.1.smithi064.stdout:2/903: write d12/d41/d73/d83/d94/f33 [7629540,111245] 0 2024-04-26T21:08:15.417 INFO:tasks.workunit.client.0.smithi055.stdout:1/523: unlink d8/d17/d36/l9a 0 2024-04-26T21:08:15.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/500: rename d3/d9/l95 to d3/d9/d1d/d48/d57/d61/d9b/lad 0 2024-04-26T21:08:15.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/501: creat d3/d9/d1f/fae x:0 0 0 2024-04-26T21:08:15.417 INFO:tasks.workunit.client.0.smithi055.stdout:8/502: getdents d3/d77/da9 0 2024-04-26T21:08:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.419+0000 7f0bbbe00700 1 -- 172.21.15.55:0/1498378131 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f0bc40fbf20 con 0x7f0ba806eab0 2024-04-26T21:08:15.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 msgr2=0x7f0ba8070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:15.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 0x7f0ba8070f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4067ab0 tx=0x7f0bb4006d20 comp rx=0 tx=0).stop 2024-04-26T21:08:15.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 msgr2=0x7f0bc41a23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:15.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b800 tx=0x7f0bac005690 comp rx=0 tx=0).stop 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 shutdown_connections 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f0ba806eab0 0x7f0ba8070f70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40ff240 0x7f0bc419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 --2- 172.21.15.55:0/1498378131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc419d3c0 0x7f0bc41a23e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 >> 172.21.15.55:0/1498378131 conn(0x7f0bc40fa420 msgr2=0x7f0bc40fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 shutdown_connections 2024-04-26T21:08:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.422+0000 7f0bc9600700 1 -- 172.21.15.55:0/1498378131 wait complete. 2024-04-26T21:08:15.425 INFO:tasks.workunit.client.1.smithi064.stdout:3/728: unlink d1/d27/d50/d35/d4c/l75 0 2024-04-26T21:08:15.428 INFO:tasks.workunit.client.0.smithi055.stdout:2/634: dread d4/db/d1f/d32/f3e [0,4194304] 0 2024-04-26T21:08:15.428 INFO:tasks.workunit.client.0.smithi055.stdout:9/623: unlink d2/lbd 0 2024-04-26T21:08:15.432 INFO:tasks.workunit.client.0.smithi055.stdout:6/573: creat d3/d17/d46/d54/d66/d6a/d51/d58/fcc x:0 0 0 2024-04-26T21:08:15.433 INFO:tasks.workunit.client.1.smithi064.stdout:5/728: dwrite dd/da9/d48/f72 [4194304,4194304] 0 2024-04-26T21:08:15.434 INFO:tasks.workunit.client.1.smithi064.stdout:5/729: read - dd/d12/d18/d25/d74/fd1 zero size 2024-04-26T21:08:15.434 INFO:tasks.workunit.client.1.smithi064.stdout:5/730: chown dd/d12/d18/d1a/d1b/f2c 5 1 2024-04-26T21:08:15.435 INFO:tasks.workunit.client.0.smithi055.stdout:1/524: creat d8/df/d11/d27/d63/faf x:0 0 0 2024-04-26T21:08:15.435 INFO:tasks.workunit.client.0.smithi055.stdout:1/525: truncate d8/d17/d6a/f99 575773 0 2024-04-26T21:08:15.437 INFO:tasks.workunit.client.1.smithi064.stdout:9/780: dread d0/d4/da/f5b [0,4194304] 0 2024-04-26T21:08:15.441 INFO:tasks.workunit.client.1.smithi064.stdout:4/847: creat d0/d5/d115/f11c x:0 0 0 2024-04-26T21:08:15.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/729: write d1/d14/f3b [61420,127835] 0 2024-04-26T21:08:15.443 INFO:tasks.workunit.client.1.smithi064.stdout:3/730: truncate d1/d27/d50/d35/d4c/d7b/fdc 171252 0 2024-04-26T21:08:15.443 INFO:tasks.workunit.client.1.smithi064.stdout:0/758: dwrite dd/d10/d18/d58/f93 [0,4194304] 0 2024-04-26T21:08:15.444 INFO:tasks.workunit.client.0.smithi055.stdout:8/503: link d3/d9/d1f/d2e/f62 d3/d7c/faf 0 2024-04-26T21:08:15.449 INFO:tasks.workunit.client.0.smithi055.stdout:5/444: dwrite d4/df/d13/f95 [0,4194304] 0 2024-04-26T21:08:15.449 INFO:tasks.workunit.client.0.smithi055.stdout:7/549: dwrite d5/d6/f4c [0,4194304] 0 2024-04-26T21:08:15.449 INFO:tasks.workunit.client.0.smithi055.stdout:7/550: readlink d5/d6/d24/d3b/l7d 0 2024-04-26T21:08:15.450 INFO:tasks.workunit.client.1.smithi064.stdout:8/700: truncate d10/f4d 905401 0 2024-04-26T21:08:15.452 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:08:15.454 INFO:tasks.workunit.client.1.smithi064.stdout:5/731: dread dd/d12/d18/d1a/d1f/d20/f2d [0,4194304] 0 2024-04-26T21:08:15.460 INFO:tasks.workunit.client.0.smithi055.stdout:9/624: mkdir d2/d14/d97/dd7 0 2024-04-26T21:08:15.464 INFO:tasks.workunit.client.1.smithi064.stdout:1/920: symlink d0/d6/d29/d31/dd1/l11e 0 2024-04-26T21:08:15.464 INFO:tasks.workunit.client.1.smithi064.stdout:6/748: rename d4/d7/d12/d49/d4b/d5a/fdb to d4/d7/d12/d49/d4b/d5a/daf/db2/ff2 0 2024-04-26T21:08:15.468 INFO:tasks.workunit.client.0.smithi055.stdout:1/526: getdents d8/df/d11/d27/d28/da4 0 2024-04-26T21:08:15.468 INFO:tasks.workunit.client.0.smithi055.stdout:8/504: symlink d3/d9/d1f/d84/lb0 0 2024-04-26T21:08:15.478 INFO:tasks.workunit.client.1.smithi064.stdout:2/904: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d120/df9/f115 [0,4194304] 0 2024-04-26T21:08:15.480 INFO:tasks.workunit.client.1.smithi064.stdout:4/848: creat d0/d5/d79/dd1/f11d x:0 0 0 2024-04-26T21:08:15.480 INFO:tasks.workunit.client.1.smithi064.stdout:4/849: readlink d0/d5/d13/d6d/lbf 0 2024-04-26T21:08:15.481 INFO:tasks.workunit.client.1.smithi064.stdout:7/805: link d6/d5a/l72 d6/db/d1f/d50/db8/dce/l114 0 2024-04-26T21:08:15.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/472: dwrite d4/d18/d1a/d49/f9a [0,4194304] 0 2024-04-26T21:08:15.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/473: chown d4/d26/d42/d2d/l4a 118949 1 2024-04-26T21:08:15.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/474: fsync d4/d18/d1a/f8a 0 2024-04-26T21:08:15.495 INFO:tasks.workunit.client.0.smithi055.stdout:4/475: fdatasync d4/d18/d1a/f7d 0 2024-04-26T21:08:15.496 INFO:tasks.workunit.client.1.smithi064.stdout:5/732: symlink dd/d12/d4f/dbd/lea 0 2024-04-26T21:08:15.500 INFO:tasks.workunit.client.1.smithi064.stdout:8/701: rename d10/d41/d4e/l3e to d10/d41/d44/ldb 0 2024-04-26T21:08:15.500 INFO:tasks.workunit.client.1.smithi064.stdout:8/702: creat d10/d41/d4e/d59/fdc x:0 0 0 2024-04-26T21:08:15.501 INFO:tasks.workunit.client.1.smithi064.stdout:1/921: creat d0/d22/d9f/d114/f11f x:0 0 0 2024-04-26T21:08:15.505 INFO:tasks.workunit.client.1.smithi064.stdout:6/749: symlink d4/d7/d12/d49/de1/lf3 0 2024-04-26T21:08:15.505 INFO:tasks.workunit.client.0.smithi055.stdout:8/505: symlink d3/d9/d1f/lb1 0 2024-04-26T21:08:15.505 INFO:tasks.workunit.client.0.smithi055.stdout:8/506: fdatasync d3/d9/d1f/d2e/d75/d76/f81 0 2024-04-26T21:08:15.506 INFO:tasks.workunit.client.1.smithi064.stdout:2/905: symlink d12/l132 0 2024-04-26T21:08:15.506 INFO:tasks.workunit.client.1.smithi064.stdout:2/906: read - d12/d41/d73/d83/d94/d3a/d46/d91/d92/f12b zero size 2024-04-26T21:08:15.506 INFO:tasks.workunit.client.1.smithi064.stdout:9/781: dwrite d0/d4/da/d26/d47/d88/fe9 [0,4194304] 0 2024-04-26T21:08:15.506 INFO:tasks.workunit.client.0.smithi055.stdout:5/445: dread d4/df/d13/f97 [0,4194304] 0 2024-04-26T21:08:15.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/907: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/fb1 [4506006,99746] 0 2024-04-26T21:08:15.507 INFO:tasks.workunit.client.1.smithi064.stdout:2/908: write d12/d41/d61/d75/f2c [1313191,6348] 0 2024-04-26T21:08:15.507 INFO:tasks.workunit.client.1.smithi064.stdout:7/806: mknod d6/d15/d88/dca/d5c/c115 0 2024-04-26T21:08:15.508 INFO:tasks.workunit.client.0.smithi055.stdout:1/527: dread d8/f35 [0,4194304] 0 2024-04-26T21:08:15.509 INFO:tasks.workunit.client.0.smithi055.stdout:1/528: creat d8/df/d11/d27/d63/fb0 x:0 0 0 2024-04-26T21:08:15.509 INFO:tasks.workunit.client.1.smithi064.stdout:4/850: symlink d0/d5/d79/dd1/da0/d114/l11e 0 2024-04-26T21:08:15.512 INFO:tasks.workunit.client.0.smithi055.stdout:8/507: creat d3/d9/d1d/d48/d57/fb2 x:0 0 0 2024-04-26T21:08:15.518 INFO:tasks.workunit.client.1.smithi064.stdout:5/733: rmdir dd/d12 39 2024-04-26T21:08:15.518 INFO:tasks.workunit.client.1.smithi064.stdout:5/734: chown dd/da9/d48/dac/da6 9 1 2024-04-26T21:08:15.520 INFO:tasks.workunit.client.1.smithi064.stdout:8/703: rename d10/d2f/l70 to d10/d41/ldd 0 2024-04-26T21:08:15.525 INFO:tasks.workunit.client.1.smithi064.stdout:1/922: symlink d0/d6b/d9e/da2/l120 0 2024-04-26T21:08:15.526 INFO:tasks.workunit.client.0.smithi055.stdout:8/508: mkdir d3/d9/d1f/d2e/db3 0 2024-04-26T21:08:15.528 INFO:tasks.workunit.client.0.smithi055.stdout:7/551: dwrite d5/d53/d6e/d99/d7f/f96 [0,4194304] 0 2024-04-26T21:08:15.529 INFO:tasks.workunit.client.1.smithi064.stdout:6/750: link d4/d7/fd d4/d7/d12/d49/de1/ff4 0 2024-04-26T21:08:15.530 INFO:tasks.workunit.client.0.smithi055.stdout:5/446: rmdir d4/df/d13/d26/d3c/d4a/d3f/d2e/d82 39 2024-04-26T21:08:15.530 INFO:tasks.workunit.client.0.smithi055.stdout:5/447: chown d4/df/d13/d26/d3c/d93 345756 1 2024-04-26T21:08:15.532 INFO:tasks.workunit.client.0.smithi055.stdout:6/574: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d6d/fc0 [0,4194304] 0 2024-04-26T21:08:15.535 INFO:tasks.workunit.client.0.smithi055.stdout:2/635: dwrite d4/d55/d6c/f94 [4194304,4194304] 0 2024-04-26T21:08:15.536 INFO:tasks.workunit.client.0.smithi055.stdout:2/636: write d4/d1e/f4f [1700880,80125] 0 2024-04-26T21:08:15.536 INFO:tasks.workunit.client.0.smithi055.stdout:2/637: chown d4/fc4 417192 1 2024-04-26T21:08:15.545 INFO:tasks.workunit.client.0.smithi055.stdout:5/448: write d4/df/f30 [2515352,96795] 0 2024-04-26T21:08:15.545 INFO:tasks.workunit.client.0.smithi055.stdout:5/449: chown d4/df/l43 51311648 1 2024-04-26T21:08:15.597 INFO:tasks.workunit.client.1.smithi064.stdout:7/807: fsync d6/db/d34/f5b 0 2024-04-26T21:08:15.603 INFO:tasks.workunit.client.0.smithi055.stdout:8/509: link d3/d9/d1d/d48/d4b/d8b/f93 d3/d9/d1d/d48/d4b/fb4 0 2024-04-26T21:08:15.603 INFO:tasks.workunit.client.0.smithi055.stdout:8/510: write d3/d7c/faf [1278208,77414] 0 2024-04-26T21:08:15.603 INFO:tasks.workunit.client.0.smithi055.stdout:8/511: write d3/d9/f2b [1090566,23233] 0 2024-04-26T21:08:15.606 INFO:tasks.workunit.client.1.smithi064.stdout:0/759: dwrite dd/d10/d18/d64/f65 [0,4194304] 0 2024-04-26T21:08:15.607 INFO:tasks.workunit.client.1.smithi064.stdout:8/704: dwrite d10/d41/d53/f64 [0,4194304] 0 2024-04-26T21:08:15.611 INFO:tasks.workunit.client.0.smithi055.stdout:7/552: creat d5/f9b x:0 0 0 2024-04-26T21:08:15.613 INFO:tasks.workunit.client.0.smithi055.stdout:1/529: dread d8/d17/d6a/f52 [0,4194304] 0 2024-04-26T21:08:15.616 INFO:tasks.workunit.client.1.smithi064.stdout:4/851: link d0/d1d/f70 d0/d1d/d21/d9c/f11f 0 2024-04-26T21:08:15.619 INFO:tasks.workunit.client.0.smithi055.stdout:8/512: dread d3/d9/d1f/d2e/d75/d76/f81 [0,4194304] 0 2024-04-26T21:08:15.620 INFO:tasks.workunit.client.0.smithi055.stdout:4/476: dwrite d4/d26/d42/d2d/f41 [4194304,4194304] 0 2024-04-26T21:08:15.620 INFO:tasks.workunit.client.0.smithi055.stdout:4/477: creat d4/d26/fa3 x:0 0 0 2024-04-26T21:08:15.621 INFO:tasks.workunit.client.1.smithi064.stdout:1/923: rename d0/d6/d76/de7/f111 to d0/d22/d9f/f121 0 2024-04-26T21:08:15.623 INFO:tasks.workunit.client.0.smithi055.stdout:6/575: rename d3/d17/d25/d5f/fb1 to d3/d17/d46/d54/d66/d6a/d51/d58/d73/fcd 0 2024-04-26T21:08:15.624 INFO:tasks.workunit.client.1.smithi064.stdout:3/731: write d1/d27/d29/d6f/d72/da5/f93 [1420633,121611] 0 2024-04-26T21:08:15.625 INFO:tasks.workunit.client.0.smithi055.stdout:2/638: creat d4/db/d1f/d32/fc8 x:0 0 0 2024-04-26T21:08:15.625 INFO:tasks.workunit.client.0.smithi055.stdout:2/639: fsync d4/d14/d17/d36/fac 0 2024-04-26T21:08:15.626 INFO:tasks.workunit.client.1.smithi064.stdout:6/751: creat d4/d7/d12/d49/d4b/ff5 x:0 0 0 2024-04-26T21:08:15.627 INFO:tasks.workunit.client.0.smithi055.stdout:5/450: unlink d4/df/d13/d26/d3c/d4a/d3f/d2e/c45 0 2024-04-26T21:08:15.627 INFO:tasks.workunit.client.0.smithi055.stdout:5/451: truncate d4/df/d13/d26/f7e 577163 0 2024-04-26T21:08:15.627 INFO:tasks.workunit.client.0.smithi055.stdout:5/452: chown d4/f10 50 1 2024-04-26T21:08:15.627 INFO:tasks.workunit.client.0.smithi055.stdout:0/584: sync 2024-04-26T21:08:15.629 INFO:tasks.workunit.client.0.smithi055.stdout:7/553: unlink d5/d6/d24/c4a 0 2024-04-26T21:08:15.629 INFO:tasks.workunit.client.0.smithi055.stdout:7/554: write d5/d53/d6e/d99/d7f/d6f/f95 [557649,118263] 0 2024-04-26T21:08:15.634 INFO:tasks.workunit.client.0.smithi055.stdout:8/513: truncate d3/d9/d1d/f35 2421699 0 2024-04-26T21:08:15.641 INFO:tasks.workunit.client.0.smithi055.stdout:4/478: mknod d4/d26/d42/ca4 0 2024-04-26T21:08:15.641 INFO:tasks.workunit.client.0.smithi055.stdout:4/479: creat d4/d12/d61/fa5 x:0 0 0 2024-04-26T21:08:15.643 INFO:tasks.workunit.client.0.smithi055.stdout:6/576: symlink d3/d17/d46/d54/d66/d6a/d51/d58/d73/lce 0 2024-04-26T21:08:15.643 INFO:tasks.workunit.client.0.smithi055.stdout:6/577: truncate d3/d17/d19/fc9 763545 0 2024-04-26T21:08:15.643 INFO:tasks.workunit.client.0.smithi055.stdout:6/578: readlink d3/d17/d25/d5f/d90/lad 0 2024-04-26T21:08:15.649 INFO:tasks.workunit.client.0.smithi055.stdout:2/640: rename d4/fc4 to d4/d14/d17/d36/fc9 0 2024-04-26T21:08:15.654 INFO:tasks.workunit.client.0.smithi055.stdout:0/585: dread d9/dc/d1c/d3e/d7d/da3/f6d [4194304,4194304] 0 2024-04-26T21:08:15.654 INFO:tasks.workunit.client.0.smithi055.stdout:0/586: read d9/dc/d1c/f26 [3986588,100423] 0 2024-04-26T21:08:15.655 INFO:tasks.workunit.client.0.smithi055.stdout:5/453: rmdir d4/df/d13/d26/d3c/d4a/d3f 39 2024-04-26T21:08:15.656 INFO:tasks.workunit.client.0.smithi055.stdout:7/555: mknod d5/d6/c9c 0 2024-04-26T21:08:15.657 INFO:tasks.workunit.client.0.smithi055.stdout:8/514: write d3/d9/f24 [3205358,87149] 0 2024-04-26T21:08:15.658 INFO:tasks.workunit.client.1.smithi064.stdout:7/808: unlink d6/d8c/d9e/f101 0 2024-04-26T21:08:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.663+0000 7f5cd3600700 1 -- 172.21.15.55:0/2904804253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc101e10 msgr2=0x7f5ccc102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.663+0000 7f5cd3600700 1 --2- 172.21.15.55:0/2904804253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc101e10 0x7f5ccc102270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009870 tx=0x7f5cb8009b80 comp rx=0 tx=0).stop 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 -- 172.21.15.55:0/2904804253 shutdown_connections 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 --2- 172.21.15.55:0/2904804253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc101e10 0x7f5ccc102270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 --2- 172.21.15.55:0/2904804253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc100c10 0x7f5ccc101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 -- 172.21.15.55:0/2904804253 >> 172.21.15.55:0/2904804253 conn(0x7f5ccc0fc1f0 msgr2=0x7f5ccc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 -- 172.21.15.55:0/2904804253 shutdown_connections 2024-04-26T21:08:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.664+0000 7f5cd3600700 1 -- 172.21.15.55:0/2904804253 wait complete. 2024-04-26T21:08:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.665+0000 7f5cd3600700 1 Processor -- start 2024-04-26T21:08:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.666+0000 7f5cd3600700 1 -- start start 2024-04-26T21:08:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.666+0000 7f5cd3600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc100c10 0x7f5ccc196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.666+0000 7f5cd3600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.666+0000 7f5cd3600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc197190 con 0x7f5ccc101e10 2024-04-26T21:08:15.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.666+0000 7f5cd3600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc1972d0 con 0x7f5ccc100c10 2024-04-26T21:08:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.667+0000 7f5ccbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.667+0000 7f5ccbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45628/0 (socket says 172.21.15.55:45628) 2024-04-26T21:08:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.667+0000 7f5ccbe00700 1 -- 172.21.15.55:0/407827052 learned_addr learned my addr 172.21.15.55:0/407827052 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.667+0000 7f5cd0c00700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc100c10 0x7f5ccc196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.668+0000 7f5ccbe00700 1 -- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc100c10 msgr2=0x7f5ccc196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.668+0000 7f5ccbe00700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc100c10 0x7f5ccc196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.668+0000 7f5ccbe00700 1 -- 172.21.15.55:0/407827052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009520 con 0x7f5ccc101e10 2024-04-26T21:08:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.669+0000 7f5ccbe00700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009230 tx=0x7f5cb800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.669+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb801c070 con 0x7f5ccc101e10 2024-04-26T21:08:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.669+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cb800b4e0 con 0x7f5ccc101e10 2024-04-26T21:08:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.669+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb8022e50 con 0x7f5ccc101e10 2024-04-26T21:08:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.671+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc19bc80 con 0x7f5ccc101e10 2024-04-26T21:08:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.671+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc19c170 con 0x7f5ccc101e10 2024-04-26T21:08:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.673+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc190790 con 0x7f5ccc101e10 2024-04-26T21:08:15.673 INFO:tasks.workunit.client.0.smithi055.stdout:5/454: mkdir d4/df/d13/d26/da2 0 2024-04-26T21:08:15.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.675+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f5cb8020070 con 0x7f5ccc101e10 2024-04-26T21:08:15.678 INFO:tasks.workunit.client.0.smithi055.stdout:7/556: dread d5/d53/d6e/d99/d7f/f8e [0,4194304] 0 2024-04-26T21:08:15.678 INFO:tasks.workunit.client.0.smithi055.stdout:7/557: chown d5/d11/d8c 3 1 2024-04-26T21:08:15.679 INFO:tasks.workunit.client.1.smithi064.stdout:8/705: symlink d10/d41/d4e/d59/d83/lde 0 2024-04-26T21:08:15.680 INFO:tasks.workunit.client.0.smithi055.stdout:1/530: write d8/d17/d6a/f99 [555339,57305] 0 2024-04-26T21:08:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.678+0000 7f5cc9600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 0x7f5cb4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.678+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f5cb808fae0 con 0x7f5ccc101e10 2024-04-26T21:08:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.679+0000 7f5cd0c00700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 0x7f5cb4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.680+0000 7f5cd0c00700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 0x7f5cb4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc101c70 tx=0x7f5cc0009310 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:15.683 INFO:tasks.workunit.client.0.smithi055.stdout:1/531: fsync d8/f31 0 2024-04-26T21:08:15.686 INFO:tasks.workunit.client.0.smithi055.stdout:7/558: mknod d5/d6/d90/c9d 0 2024-04-26T21:08:15.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:15.689+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5cb805c9e0 con 0x7f5ccc101e10 2024-04-26T21:08:15.693 INFO:tasks.workunit.client.0.smithi055.stdout:5/455: dread d4/df/d13/d26/d3c/d4a/d3f/f2c [0,4194304] 0 2024-04-26T21:08:15.696 INFO:tasks.workunit.client.0.smithi055.stdout:5/456: symlink d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/la3 0 2024-04-26T21:08:15.697 INFO:tasks.workunit.client.0.smithi055.stdout:4/480: rename d4/d12/d61/d74 to d4/d18/d86/da6 0 2024-04-26T21:08:15.697 INFO:tasks.workunit.client.0.smithi055.stdout:4/481: truncate d4/d12/d15/f67 1729055 0 2024-04-26T21:08:15.697 INFO:tasks.workunit.client.0.smithi055.stdout:4/482: fdatasync d4/d26/d42/d2d/f4f 0 2024-04-26T21:08:15.697 INFO:tasks.workunit.client.0.smithi055.stdout:4/483: fsync d4/f13 0 2024-04-26T21:08:15.699 INFO:tasks.workunit.client.0.smithi055.stdout:0/587: rename d9/d27/f40 to d9/dc/d1c/d54/db2/fbb 0 2024-04-26T21:08:15.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/588: creat d9/dc/d17/d5d/fbc x:0 0 0 2024-04-26T21:08:15.717 INFO:tasks.workunit.client.0.smithi055.stdout:0/589: truncate d9/dc/d1c/d3e/d7d/da3/d97/db6/d6c/d7a/f95 3558014 0 2024-04-26T21:08:15.718 INFO:tasks.workunit.client.0.smithi055.stdout:0/590: write d9/dc/d1c/f9f [7193343,59327] 0 2024-04-26T21:08:15.718 INFO:tasks.workunit.client.0.smithi055.stdout:0/591: stat d9/dc/d1c/f85 0 2024-04-26T21:08:15.718 INFO:tasks.workunit.client.0.smithi055.stdout:5/457: rename d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f61 to d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/fa4 0 2024-04-26T21:08:15.718 INFO:tasks.workunit.client.0.smithi055.stdout:5/458: chown d4/df/d13/d26/d3c/d4a/f5e 771162 1 2024-04-26T21:08:15.718 INFO:tasks.workunit.client.0.smithi055.stdout:5/459: creat d4/d15/fa5 x:0 0 0 2024-04-26T21:08:15.724 INFO:tasks.workunit.client.0.smithi055.stdout:1/532: dread d8/d17/d1b/d7b/d8d/f54 [0,4194304] 0 2024-04-26T21:08:15.727 INFO:tasks.workunit.client.0.smithi055.stdout:0/592: truncate d9/dc/d1c/f85 282059 0 2024-04-26T21:08:15.731 INFO:tasks.workunit.client.0.smithi055.stdout:5/460: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/da6 0 2024-04-26T21:08:15.734 INFO:tasks.workunit.client.0.smithi055.stdout:1/533: rename d8/d17/d1b/d41/l5e to d8/d94/d9b/lb1 0 2024-04-26T21:08:15.738 INFO:tasks.workunit.client.0.smithi055.stdout:0/593: unlink d9/dc/d17/f79 0 2024-04-26T21:08:15.738 INFO:tasks.workunit.client.0.smithi055.stdout:0/594: write d9/dc/d17/d5d/fbc [467448,19431] 0 2024-04-26T21:08:15.755 INFO:tasks.workunit.client.0.smithi055.stdout:8/515: dwrite d3/d9/f8e [0,4194304] 0 2024-04-26T21:08:15.755 INFO:tasks.workunit.client.0.smithi055.stdout:8/516: dread - d3/d9/d1d/d48/d57/d61/f8c zero size 2024-04-26T21:08:15.758 INFO:tasks.workunit.client.0.smithi055.stdout:5/461: rename d4/df/d13/f22 to d4/df/d13/d26/d3c/d5b/d83/fa7 0 2024-04-26T21:08:15.758 INFO:tasks.workunit.client.0.smithi055.stdout:4/484: dwrite d4/d12/d17/d3d/f8c [0,4194304] 0 2024-04-26T21:08:15.760 INFO:tasks.workunit.client.1.smithi064.stdout:9/782: rmdir d0 39 2024-04-26T21:08:15.762 INFO:tasks.workunit.client.0.smithi055.stdout:1/534: mknod d8/d94/d9b/cb2 0 2024-04-26T21:08:15.762 INFO:tasks.workunit.client.0.smithi055.stdout:1/535: chown d8/df/d11/d27/d63/fb0 14 1 2024-04-26T21:08:15.763 INFO:tasks.workunit.client.0.smithi055.stdout:7/559: dwrite d5/d6/d24/d52/f5e [0,4194304] 0 2024-04-26T21:08:15.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/852: unlink d0/d5/d13/l20 0 2024-04-26T21:08:15.766 INFO:tasks.workunit.client.1.smithi064.stdout:5/735: truncate dd/d12/d4f/d9c/da1/fb7 420008 0 2024-04-26T21:08:15.781 INFO:tasks.workunit.client.1.smithi064.stdout:3/732: truncate d1/ff 7378547 0 2024-04-26T21:08:15.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/924: creat d0/d6/d11/d1e/d2a/d34/d57/d66/f122 x:0 0 0 2024-04-26T21:08:15.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/925: readlink d0/d6/l10f 0 2024-04-26T21:08:15.782 INFO:tasks.workunit.client.1.smithi064.stdout:1/926: chown d0/d6/d11/d1e/d2a/d34/d57/d118 3356370 1 2024-04-26T21:08:15.782 INFO:tasks.workunit.client.1.smithi064.stdout:3/733: write d1/d27/d50/d35/d4c/d7b/d82/fd7 [221634,92732] 0 2024-04-26T21:08:15.783 INFO:tasks.workunit.client.1.smithi064.stdout:7/809: mkdir d6/d70/d74/d116 0 2024-04-26T21:08:15.785 INFO:tasks.workunit.client.1.smithi064.stdout:8/706: mkdir d10/d41/d4e/d59/d5d/d79/ddf 0 2024-04-26T21:08:15.786 INFO:tasks.workunit.client.1.smithi064.stdout:8/707: chown d10/d41/d44/fb5 56205 1 2024-04-26T21:08:15.787 INFO:tasks.workunit.client.0.smithi055.stdout:7/560: dread d5/d6/d24/f50 [0,4194304] 0 2024-04-26T21:08:15.792 INFO:tasks.workunit.client.0.smithi055.stdout:5/462: dread d4/df/f3b [0,4194304] 0 2024-04-26T21:08:15.792 INFO:tasks.workunit.client.0.smithi055.stdout:5/463: read d4/df/f30 [667318,37785] 0 2024-04-26T21:08:15.792 INFO:tasks.workunit.client.0.smithi055.stdout:5/464: write d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/fa4 [246158,71133] 0 2024-04-26T21:08:15.798 INFO:tasks.workunit.client.0.smithi055.stdout:4/485: rename d4/d12/d17/c24 to d4/d18/d86/ca7 0 2024-04-26T21:08:15.800 INFO:tasks.workunit.client.0.smithi055.stdout:1/536: creat d8/df/d11/d27/d28/da4/daa/fb3 x:0 0 0 2024-04-26T21:08:15.800 INFO:tasks.workunit.client.0.smithi055.stdout:1/537: fsync d8/d17/d1b/d41/f8f 0 2024-04-26T21:08:15.800 INFO:tasks.workunit.client.0.smithi055.stdout:1/538: chown d8/c1e 12831446 1 2024-04-26T21:08:15.801 INFO:tasks.workunit.client.1.smithi064.stdout:5/736: dread dd/da9/d48/d56/f62 [0,4194304] 0 2024-04-26T21:08:15.807 INFO:tasks.workunit.client.0.smithi055.stdout:7/561: truncate d5/d53/d6e/d99/d7f/f8e 3066867 0 2024-04-26T21:08:15.811 INFO:tasks.workunit.client.1.smithi064.stdout:0/760: rename dd/d10 to dd/d21/dc8/d31/d47/dad/dfd 0 2024-04-26T21:08:15.813 INFO:tasks.workunit.client.0.smithi055.stdout:5/465: link d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f7a d4/d15/fa8 0 2024-04-26T21:08:15.814 INFO:tasks.workunit.client.1.smithi064.stdout:6/752: dread d4/d7/d12/d38/f97 [0,4194304] 0 2024-04-26T21:08:15.815 INFO:tasks.workunit.client.1.smithi064.stdout:5/737: dread dd/d12/d18/d25/d74/fe9 [0,4194304] 0 2024-04-26T21:08:15.815 INFO:tasks.workunit.client.0.smithi055.stdout:4/486: creat d4/d12/d17/fa8 x:0 0 0 2024-04-26T21:08:15.816 INFO:tasks.workunit.client.0.smithi055.stdout:0/595: dwrite d9/dc/f8f [0,4194304] 0 2024-04-26T21:08:15.816 INFO:tasks.workunit.client.1.smithi064.stdout:1/927: symlink d0/d6/d29/d31/dd1/d10a/l123 0 2024-04-26T21:08:15.817 INFO:tasks.workunit.client.1.smithi064.stdout:1/928: write d0/d6/d11/d1e/f46 [1247931,10996] 0 2024-04-26T21:08:15.817 INFO:tasks.workunit.client.1.smithi064.stdout:3/734: rmdir d1/d27/d29/d6f/d72/da5 39 2024-04-26T21:08:15.818 INFO:tasks.workunit.client.0.smithi055.stdout:1/539: symlink d8/d17/d1b/d7b/d65/lb4 0 2024-04-26T21:08:15.818 INFO:tasks.workunit.client.0.smithi055.stdout:1/540: write d8/df/d11/d27/f3a [2646555,90065] 0 2024-04-26T21:08:15.821 INFO:tasks.workunit.client.1.smithi064.stdout:7/810: symlink d6/d9/d38/l117 0 2024-04-26T21:08:15.822 INFO:tasks.workunit.client.0.smithi055.stdout:7/562: symlink d5/d53/d6e/d99/d7f/l9e 0 2024-04-26T21:08:15.825 INFO:tasks.workunit.client.0.smithi055.stdout:4/487: creat d4/d18/d1a/d49/fa9 x:0 0 0 2024-04-26T21:08:15.825 INFO:tasks.workunit.client.0.smithi055.stdout:4/488: fsync d4/d12/d17/f19 0 2024-04-26T21:08:15.825 INFO:tasks.workunit.client.0.smithi055.stdout:4/489: read d4/d12/d15/f79 [1318116,4269] 0 2024-04-26T21:08:15.825 INFO:tasks.workunit.client.0.smithi055.stdout:4/490: chown d4/d12/d61/d93/l98 16287540 1 2024-04-26T21:08:15.829 INFO:tasks.workunit.client.0.smithi055.stdout:7/563: truncate d5/f83 87062 0 2024-04-26T21:08:15.829 INFO:tasks.workunit.client.1.smithi064.stdout:8/708: truncate ff 2045593 0 2024-04-26T21:08:15.829 INFO:tasks.workunit.client.1.smithi064.stdout:4/853: getdents d0/d1d/d17/d9b 0 2024-04-26T21:08:15.829 INFO:tasks.workunit.client.1.smithi064.stdout:4/854: chown d0/d1d/d17/d44 1506454 1 2024-04-26T21:08:15.829 INFO:tasks.workunit.client.1.smithi064.stdout:6/753: creat d4/d7/d12/d1e/dd4/ff6 x:0 0 0 2024-04-26T21:08:15.830 INFO:tasks.workunit.client.1.smithi064.stdout:6/754: chown l3 92 1 2024-04-26T21:08:15.830 INFO:tasks.workunit.client.1.smithi064.stdout:6/755: write d4/d7/d12/d49/d4b/d5a/d8f/fec [436415,127627] 0 2024-04-26T21:08:15.830 INFO:tasks.workunit.client.1.smithi064.stdout:3/735: mkdir d1/d27/d29/d6f/d72/da5/d7d/df9 0 2024-04-26T21:08:15.830 INFO:tasks.workunit.client.1.smithi064.stdout:3/736: write d1/d27/d50/f52 [4223456,4523] 0 2024-04-26T21:08:15.833 INFO:tasks.workunit.client.0.smithi055.stdout:4/491: rename d4/d26/d42/d28/f5d to d4/d12/d17/d3d/faa 0 2024-04-26T21:08:15.833 INFO:tasks.workunit.client.0.smithi055.stdout:5/466: dread d4/df/f1b [0,4194304] 0 2024-04-26T21:08:15.836 INFO:tasks.workunit.client.0.smithi055.stdout:1/541: mkdir d8/df/d11/db5 0 2024-04-26T21:08:15.838 INFO:tasks.workunit.client.0.smithi055.stdout:7/564: rename d5/d6/d39/c3a to d5/d6/c9f 0 2024-04-26T21:08:15.841 INFO:tasks.workunit.client.0.smithi055.stdout:4/492: symlink d4/d18/d1a/lab 0 2024-04-26T21:08:15.841 INFO:tasks.workunit.client.0.smithi055.stdout:4/493: dread - d4/d18/d1a/f54 zero size 2024-04-26T21:08:15.841 INFO:tasks.workunit.client.0.smithi055.stdout:4/494: read - d4/d12/d17/fa8 zero size 2024-04-26T21:08:15.844 INFO:tasks.workunit.client.0.smithi055.stdout:5/467: truncate d4/fd 185039 0 2024-04-26T21:08:15.849 INFO:tasks.workunit.client.0.smithi055.stdout:1/542: symlink d8/d17/lb6 0 2024-04-26T21:08:15.849 INFO:tasks.workunit.client.0.smithi055.stdout:1/543: stat d8/df/d11/d27/d28/d2a/da7 0 2024-04-26T21:08:15.851 INFO:tasks.workunit.client.0.smithi055.stdout:7/565: creat d5/d53/d6e/fa0 x:0 0 0 2024-04-26T21:08:15.851 INFO:tasks.workunit.client.0.smithi055.stdout:7/566: write d5/d53/d6e/d65/f94 [602599,937] 0 2024-04-26T21:08:15.851 INFO:tasks.workunit.client.0.smithi055.stdout:7/567: chown d5/d6/d24/f38 425129751 1 2024-04-26T21:08:15.851 INFO:tasks.workunit.client.0.smithi055.stdout:7/568: chown d5/d6/d24/l6d 1531827367 1 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/756: mknod d4/d7/d12/cf7 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/757: chown d4/d7/d12/dbc/fca 164785 1 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/758: chown l3 3415044 1 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/759: truncate d4/d7/d12/dbc/fe8 956419 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:7/811: dread d6/d9/d38/fb3 [0,4194304] 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/760: write d4/d7/d12/d49/f5c [3653877,102610] 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:6/761: truncate d4/d99/fa4 2205005 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:3/737: creat d1/ffa x:0 0 0 2024-04-26T21:08:15.852 INFO:tasks.workunit.client.1.smithi064.stdout:3/738: stat d1/d27/d29/d6f/d72/d73 0 2024-04-26T21:08:15.853 INFO:tasks.workunit.client.0.smithi055.stdout:4/495: mkdir d4/d26/d42/d28/d53/d71/d7f/dac 0 2024-04-26T21:08:15.855 INFO:tasks.workunit.client.1.smithi064.stdout:9/783: dwrite d0/d4/f53 [0,4194304] 0 2024-04-26T21:08:15.856 INFO:tasks.workunit.client.0.smithi055.stdout:5/468: write d4/f4d [359465,24432] 0 2024-04-26T21:08:15.859 INFO:tasks.workunit.client.1.smithi064.stdout:2/909: sync 2024-04-26T21:08:15.859 INFO:tasks.workunit.client.1.smithi064.stdout:2/910: stat d12/d41/d73/d83/d94/d3a/d46/d91/fe7 0 2024-04-26T21:08:15.859 INFO:tasks.workunit.client.1.smithi064.stdout:2/911: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l5c 56717 1 2024-04-26T21:08:15.859 INFO:tasks.workunit.client.1.smithi064.stdout:7/812: symlink d6/d15/d1c/d45/l118 0 2024-04-26T21:08:15.864 INFO:tasks.workunit.client.1.smithi064.stdout:5/738: dwrite dd/d12/d9a/fd2 [0,4194304] 0 2024-04-26T21:08:15.864 INFO:tasks.workunit.client.1.smithi064.stdout:6/762: creat d4/d7/d12/d38/ff8 x:0 0 0 2024-04-26T21:08:15.873 INFO:tasks.workunit.client.1.smithi064.stdout:3/739: symlink d1/d27/d50/d35/d4c/d7b/dc1/lfb 0 2024-04-26T21:08:15.873 INFO:tasks.workunit.client.1.smithi064.stdout:3/740: write d1/d27/d29/d9d/fd8 [663485,34998] 0 2024-04-26T21:08:15.873 INFO:tasks.workunit.client.1.smithi064.stdout:3/741: truncate d1/d27/d29/d6f/d72/fb5 1566484 0 2024-04-26T21:08:15.876 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:15 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:15.880 INFO:tasks.workunit.client.1.smithi064.stdout:8/709: dread d10/d41/d4e/d60/fc4 [0,4194304] 0 2024-04-26T21:08:15.880 INFO:tasks.workunit.client.1.smithi064.stdout:0/761: dwrite dd/d21/dc8/d31/d47/dad/dfd/fd5 [4194304,4194304] 0 2024-04-26T21:08:15.880 INFO:tasks.workunit.client.1.smithi064.stdout:0/762: read - dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/db1/ff8 zero size 2024-04-26T21:08:15.880 INFO:tasks.workunit.client.0.smithi055.stdout:0/596: dwrite d9/d11/d59/fb1 [0,4194304] 0 2024-04-26T21:08:15.883 INFO:tasks.workunit.client.1.smithi064.stdout:8/710: write d10/d2f/fa6 [133308,13762] 0 2024-04-26T21:08:15.884 INFO:tasks.workunit.client.1.smithi064.stdout:8/711: write d10/d41/d4e/d54/fc9 [593775,43282] 0 2024-04-26T21:08:15.884 INFO:tasks.workunit.client.1.smithi064.stdout:8/712: readlink d10/l20 0 2024-04-26T21:08:15.884 INFO:tasks.workunit.client.1.smithi064.stdout:8/713: write d10/d41/d4e/d59/d5d/d79/fd6 [629061,17837] 0 2024-04-26T21:08:15.896 INFO:tasks.workunit.client.0.smithi055.stdout:5/469: mknod d4/df/d13/ca9 0 2024-04-26T21:08:15.896 INFO:tasks.workunit.client.0.smithi055.stdout:5/470: fdatasync d4/df/f30 0 2024-04-26T21:08:15.901 INFO:tasks.workunit.client.1.smithi064.stdout:6/763: write d4/d7/d12/d49/d4b/d56/f96 [882074,120446] 0 2024-04-26T21:08:15.901 INFO:tasks.workunit.client.1.smithi064.stdout:7/813: dwrite d6/db/dc1/fdd [0,4194304] 0 2024-04-26T21:08:15.907 INFO:tasks.workunit.client.0.smithi055.stdout:7/569: getdents d5/d11 0 2024-04-26T21:08:15.913 INFO:tasks.workunit.client.0.smithi055.stdout:4/496: rmdir d4/d26/d42/d56 39 2024-04-26T21:08:15.913 INFO:tasks.workunit.client.1.smithi064.stdout:2/912: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d133 0 2024-04-26T21:08:15.921 INFO:tasks.workunit.client.1.smithi064.stdout:5/739: symlink dd/d12/d18/d25/leb 0 2024-04-26T21:08:15.930 INFO:tasks.workunit.client.1.smithi064.stdout:3/742: mkdir d1/d27/d29/d6f/dfc 0 2024-04-26T21:08:15.931 INFO:tasks.workunit.client.0.smithi055.stdout:7/570: symlink d5/d53/d6e/d99/d7f/d6f/la1 0 2024-04-26T21:08:15.935 INFO:tasks.workunit.client.0.smithi055.stdout:1/544: dwrite d8/d17/d1b/d7b/d8d/f54 [0,4194304] 0 2024-04-26T21:08:15.935 INFO:tasks.workunit.client.0.smithi055.stdout:1/545: write d8/df/d11/d27/d28/f29 [922773,128660] 0 2024-04-26T21:08:15.941 INFO:tasks.workunit.client.0.smithi055.stdout:4/497: symlink d4/d26/d42/d28/d53/d71/d7f/da1/lad 0 2024-04-26T21:08:15.948 INFO:tasks.workunit.client.1.smithi064.stdout:0/763: mkdir dd/d21/dc8/d31/d43/db4/dfe 0 2024-04-26T21:08:15.948 INFO:tasks.workunit.client.0.smithi055.stdout:1/546: creat d8/df/d11/d27/fb7 x:0 0 0 2024-04-26T21:08:15.949 INFO:tasks.workunit.client.0.smithi055.stdout:4/498: stat d4/d12/d17/d3d/l4e 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:1/547: link d8/d17/d1b/d7b/d65/l83 d8/d17/d1b/d41/lb8 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:1/548: chown d8/d17/d1b/f9f 4709 1 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:5/471: dwrite d4/df/d13/d26/d3c/d4a/d3f/f46 [0,4194304] 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:5/472: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/faa x:0 0 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:5/473: fsync d4/df/d13/d26/d3c/d4a/d3f/d4f/f75 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:4/499: mkdir d4/d18/d1a/d49/dae 0 2024-04-26T21:08:15.954 INFO:tasks.workunit.client.0.smithi055.stdout:4/500: write d4/d26/d42/d28/f44 [415016,17106] 0 2024-04-26T21:08:15.958 INFO:tasks.workunit.client.0.smithi055.stdout:0/597: dwrite d9/dc/d1c/d3b/f36 [0,4194304] 0 2024-04-26T21:08:15.961 INFO:tasks.workunit.client.1.smithi064.stdout:8/714: truncate d10/d41/d44/f6d 847718 0 2024-04-26T21:08:15.966 INFO:tasks.workunit.client.1.smithi064.stdout:6/764: creat d4/d7/d12/d49/de1/ff9 x:0 0 0 2024-04-26T21:08:15.968 INFO:tasks.workunit.client.0.smithi055.stdout:1/549: write d8/df/f24 [1315422,112640] 0 2024-04-26T21:08:15.968 INFO:tasks.workunit.client.1.smithi064.stdout:7/814: rmdir d6 39 2024-04-26T21:08:15.969 INFO:tasks.workunit.client.0.smithi055.stdout:3/677: sync 2024-04-26T21:08:15.969 INFO:tasks.workunit.client.0.smithi055.stdout:3/678: dread - d0/d4/d16/d18/d4b/d57/d8e/db1/fe5 zero size 2024-04-26T21:08:15.970 INFO:tasks.workunit.client.0.smithi055.stdout:3/679: dread - d0/d4/d5/d73/d13/d1a/d46/d72/dd5/fe1 zero size 2024-04-26T21:08:15.974 INFO:tasks.workunit.client.1.smithi064.stdout:2/913: mknod d12/d41/d73/d83/d94/d3a/d46/d91/d92/dd4/c134 0 2024-04-26T21:08:15.979 INFO:tasks.workunit.client.1.smithi064.stdout:5/740: mkdir dd/d12/d4f/d64/d73/dec 0 2024-04-26T21:08:15.980 INFO:tasks.workunit.client.1.smithi064.stdout:3/743: mkdir d1/d14/de6/dfd 0 2024-04-26T21:08:15.980 INFO:tasks.workunit.client.1.smithi064.stdout:3/744: chown d1/d27/d29/d6f/d72/da5/d7d/d8a/l8c 85 1 2024-04-26T21:08:15.985 INFO:tasks.workunit.client.1.smithi064.stdout:8/715: getdents d10/d1d/d38 0 2024-04-26T21:08:15.985 INFO:tasks.workunit.client.0.smithi055.stdout:5/474: mknod d4/cab 0 2024-04-26T21:08:15.986 INFO:tasks.workunit.client.0.smithi055.stdout:0/598: rmdir d9/dc/d1c/d3e/d7d/da3/d97/db6/d6c/d7a 39 2024-04-26T21:08:15.989 INFO:tasks.workunit.client.0.smithi055.stdout:0/599: write d9/dc/d1c/d3e/d7d/da3/d97/db6/d6c/d7a/f9b [438533,56962] 0 2024-04-26T21:08:15.990 INFO:tasks.workunit.client.1.smithi064.stdout:7/815: creat d6/d15/d88/d113/f119 x:0 0 0 2024-04-26T21:08:15.992 INFO:tasks.workunit.client.1.smithi064.stdout:2/914: mkdir d12/d88/d135 0 2024-04-26T21:08:15.993 INFO:tasks.workunit.client.1.smithi064.stdout:9/784: dwrite d0/d4/da/d67/dd0/dd2/f99 [0,4194304] 0 2024-04-26T21:08:15.993 INFO:tasks.workunit.client.1.smithi064.stdout:9/785: fdatasync d0/d4/d7/f2f 0 2024-04-26T21:08:16.004 INFO:tasks.workunit.client.1.smithi064.stdout:6/765: rename d4/d7/d12/d38/lc3 to d4/d7/d12/d49/d4b/d5a/d79/lfa 0 2024-04-26T21:08:16.005 INFO:tasks.workunit.client.0.smithi055.stdout:4/501: rmdir d4/d26 39 2024-04-26T21:08:16.005 INFO:tasks.workunit.client.0.smithi055.stdout:9/625: sync 2024-04-26T21:08:16.005 INFO:tasks.workunit.client.0.smithi055.stdout:6/579: sync 2024-04-26T21:08:16.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:15 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:16.009 INFO:tasks.workunit.client.1.smithi064.stdout:8/716: creat d10/d41/fe0 x:0 0 0 2024-04-26T21:08:16.009 INFO:tasks.workunit.client.1.smithi064.stdout:5/741: dread dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:16.018 INFO:tasks.workunit.client.0.smithi055.stdout:0/600: rename d9/d11/db3 to d9/dc/d1c/d3e/d7d/da3/d97/dbd 0 2024-04-26T21:08:16.020 INFO:tasks.workunit.client.1.smithi064.stdout:7/816: unlink d6/d70/da8/dd1/c102 0 2024-04-26T21:08:16.028 INFO:tasks.workunit.client.0.smithi055.stdout:1/550: dwrite d8/d17/d1b/d7b/d65/f7d [0,4194304] 0 2024-04-26T21:08:16.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/551: dread - d8/df/d11/d27/fb7 zero size 2024-04-26T21:08:16.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/552: readlink d8/d17/d1b/l8b 0 2024-04-26T21:08:16.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/553: readlink d8/df/d11/l1c 0 2024-04-26T21:08:16.031 INFO:tasks.workunit.client.1.smithi064.stdout:9/786: mkdir d0/d4/d28/dff/d103 0 2024-04-26T21:08:16.033 INFO:tasks.workunit.client.0.smithi055.stdout:9/626: rename d2/d46/d77/l49 to d2/d46/d9a/da7/ld8 0 2024-04-26T21:08:16.033 INFO:tasks.workunit.client.0.smithi055.stdout:9/627: fdatasync d2/d11/fa4 0 2024-04-26T21:08:16.038 INFO:tasks.workunit.client.1.smithi064.stdout:2/915: rename d12/d41/d73/d83/d94/d3a/d46/d48/d120/df9/f115 to d12/d45/d121/f136 0 2024-04-26T21:08:16.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/628: symlink d2/d14/db8/ld9 0 2024-04-26T21:08:16.042 INFO:tasks.workunit.client.0.smithi055.stdout:6/580: dread d3/fbe [0,4194304] 0 2024-04-26T21:08:16.042 INFO:tasks.workunit.client.0.smithi055.stdout:6/581: write d3/d9b/fa2 [1989928,23430] 0 2024-04-26T21:08:16.048 INFO:tasks.workunit.client.0.smithi055.stdout:1/554: rmdir d8/df/d11/d27 39 2024-04-26T21:08:16.048 INFO:tasks.workunit.client.0.smithi055.stdout:1/555: chown d8/df/c13 15043 1 2024-04-26T21:08:16.049 INFO:tasks.workunit.client.0.smithi055.stdout:6/582: creat d3/da1/fcf x:0 0 0 2024-04-26T21:08:16.052 INFO:tasks.workunit.client.0.smithi055.stdout:9/629: symlink d2/d46/d77/lda 0 2024-04-26T21:08:16.052 INFO:tasks.workunit.client.0.smithi055.stdout:9/630: getdents d2/d46/d77/d7d/d94 0 2024-04-26T21:08:16.052 INFO:tasks.workunit.client.0.smithi055.stdout:9/631: creat d2/d46/d9a/da7/fdb x:0 0 0 2024-04-26T21:08:16.052 INFO:tasks.workunit.client.1.smithi064.stdout:2/916: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d117/f137 x:0 0 0 2024-04-26T21:08:16.053 INFO:tasks.workunit.client.1.smithi064.stdout:2/917: write d12/d88/f129 [13981,41919] 0 2024-04-26T21:08:16.053 INFO:tasks.workunit.client.0.smithi055.stdout:1/556: mknod d8/d17/d33/cb9 0 2024-04-26T21:08:16.053 INFO:tasks.workunit.client.0.smithi055.stdout:1/557: write d8/d17/d36/f81 [950470,98279] 0 2024-04-26T21:08:16.054 INFO:tasks.workunit.client.0.smithi055.stdout:1/558: chown d8/d17/c2c 166 1 2024-04-26T21:08:16.055 INFO:tasks.workunit.client.0.smithi055.stdout:6/583: fsync d3/f5b 0 2024-04-26T21:08:16.055 INFO:tasks.workunit.client.1.smithi064.stdout:8/717: getdents d10 0 2024-04-26T21:08:16.057 INFO:tasks.workunit.client.0.smithi055.stdout:9/632: symlink d2/d14/d97/dd7/ldc 0 2024-04-26T21:08:16.057 INFO:tasks.workunit.client.0.smithi055.stdout:1/559: mknod d8/d17/d1b/d7b/cba 0 2024-04-26T21:08:16.059 INFO:tasks.workunit.client.0.smithi055.stdout:0/601: dread d9/d11/d59/f7f [0,4194304] 0 2024-04-26T21:08:16.059 INFO:tasks.workunit.client.0.smithi055.stdout:0/602: dread - d9/dc/d1c/d3e/d7d/da3/d97/fa0 zero size 2024-04-26T21:08:16.059 INFO:tasks.workunit.client.0.smithi055.stdout:7/571: dwrite d5/db/f14 [0,4194304] 0 2024-04-26T21:08:16.060 INFO:tasks.workunit.client.1.smithi064.stdout:5/742: dread dd/f16 [0,4194304] 0 2024-04-26T21:08:16.060 INFO:tasks.workunit.client.0.smithi055.stdout:9/633: mknod d2/d46/d77/d7d/dbf/cdd 0 2024-04-26T21:08:16.065 INFO:tasks.workunit.client.1.smithi064.stdout:5/743: mkdir dd/da9/d48/d6a/d9e/db9/ded 0 2024-04-26T21:08:16.066 INFO:tasks.workunit.client.0.smithi055.stdout:1/560: symlink d8/df/d11/d27/d28/d2a/lbb 0 2024-04-26T21:08:16.067 INFO:tasks.workunit.client.0.smithi055.stdout:1/561: write d8/d17/d6a/f6b [1029376,126932] 0 2024-04-26T21:08:16.069 INFO:tasks.workunit.client.0.smithi055.stdout:0/603: creat d9/dc/d1c/d3e/d7d/da3/d97/db6/fbe x:0 0 0 2024-04-26T21:08:16.070 INFO:tasks.workunit.client.0.smithi055.stdout:7/572: mkdir d5/d53/d6e/d6c/da2 0 2024-04-26T21:08:16.071 INFO:tasks.workunit.client.0.smithi055.stdout:9/634: symlink d2/d46/d77/d79/lde 0 2024-04-26T21:08:16.072 INFO:tasks.workunit.client.0.smithi055.stdout:1/562: mkdir d8/df/dbc 0 2024-04-26T21:08:16.073 INFO:tasks.workunit.client.0.smithi055.stdout:9/635: mknod d2/d46/d51/cdf 0 2024-04-26T21:08:16.075 INFO:tasks.workunit.client.0.smithi055.stdout:1/563: rmdir d8/df/d11/d27/d75 0 2024-04-26T21:08:16.079 INFO:tasks.workunit.client.0.smithi055.stdout:9/636: stat d2/d46/d51/c56 0 2024-04-26T21:08:16.083 INFO:tasks.workunit.client.0.smithi055.stdout:1/564: creat d8/d17/d6a/fbd x:0 0 0 2024-04-26T21:08:16.084 INFO:tasks.workunit.client.0.smithi055.stdout:1/565: mkdir d8/df/d11/d27/d28/da4/dbe 0 2024-04-26T21:08:16.086 INFO:tasks.workunit.client.0.smithi055.stdout:1/566: mknod d8/df/d11/d27/d28/d2a/cbf 0 2024-04-26T21:08:16.086 INFO:tasks.workunit.client.0.smithi055.stdout:1/567: creat d8/d17/d1b/d41/fc0 x:0 0 0 2024-04-26T21:08:16.088 INFO:tasks.workunit.client.0.smithi055.stdout:1/568: rmdir d8/df/d11/d27/d28/d2a 39 2024-04-26T21:08:16.089 INFO:tasks.workunit.client.0.smithi055.stdout:1/569: symlink d8/d94/lc1 0 2024-04-26T21:08:16.089 INFO:tasks.workunit.client.0.smithi055.stdout:2/641: sync 2024-04-26T21:08:16.089 INFO:tasks.workunit.client.0.smithi055.stdout:8/517: sync 2024-04-26T21:08:16.089 INFO:tasks.workunit.client.0.smithi055.stdout:8/518: creat d3/d9/d1f/fb5 x:0 0 0 2024-04-26T21:08:16.113 INFO:tasks.workunit.client.1.smithi064.stdout:0/764: dwrite dd/d21/dc8/d31/d43/db4/fd3 [0,4194304] 0 2024-04-26T21:08:16.113 INFO:tasks.workunit.client.1.smithi064.stdout:0/765: fsync dd/fc9 0 2024-04-26T21:08:16.113 INFO:tasks.workunit.client.1.smithi064.stdout:0/766: chown dd/d21/lfb 507691527 1 2024-04-26T21:08:16.114 INFO:tasks.workunit.client.0.smithi055.stdout:5/475: dwrite d4/df/d13/d26/d3c/f3e [0,4194304] 0 2024-04-26T21:08:16.114 INFO:tasks.workunit.client.0.smithi055.stdout:5/476: readlink d4/df/d13/d26/l48 0 2024-04-26T21:08:16.122 INFO:tasks.workunit.client.0.smithi055.stdout:3/680: dwrite d0/d4/d5/d73/d13/d1a/d46/d72/f60 [0,4194304] 0 2024-04-26T21:08:16.122 INFO:tasks.workunit.client.0.smithi055.stdout:3/681: creat d0/d4/d5/d73/d47/d37/d3d/fed x:0 0 0 2024-04-26T21:08:16.131 INFO:tasks.workunit.client.1.smithi064.stdout:5/744: dwrite dd/da9/fc5 [0,4194304] 0 2024-04-26T21:08:16.136 INFO:tasks.workunit.client.1.smithi064.stdout:7/817: write d6/d5a/f3b [1626548,9648] 0 2024-04-26T21:08:16.136 INFO:tasks.workunit.client.1.smithi064.stdout:7/818: creat d6/d9/d3d/d58/f11a x:0 0 0 2024-04-26T21:08:16.139 INFO:tasks.workunit.client.0.smithi055.stdout:2/642: dread d4/dc/d21/f43 [0,4194304] 0 2024-04-26T21:08:16.139 INFO:tasks.workunit.client.0.smithi055.stdout:2/643: readlink d4/l1a 0 2024-04-26T21:08:16.144 INFO:tasks.workunit.client.0.smithi055.stdout:8/519: rename d3/d9/f2b to d3/d77/da9/fb6 0 2024-04-26T21:08:16.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/477: dread d4/df/d13/d26/d3c/d4a/d3f/d4f/f9f [0,4194304] 0 2024-04-26T21:08:16.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/478: write d4/df/d13/d26/f8f [119333,95852] 0 2024-04-26T21:08:16.145 INFO:tasks.workunit.client.0.smithi055.stdout:5/479: write d4/df/d13/d26/d3c/f51 [379781,13325] 0 2024-04-26T21:08:16.147 INFO:tasks.workunit.client.0.smithi055.stdout:5/480: dread - d4/df/d13/d26/d3c/d4a/d3f/d2e/f54 zero size 2024-04-26T21:08:16.148 INFO:tasks.workunit.client.0.smithi055.stdout:2/644: mknod d4/d55/cca 0 2024-04-26T21:08:16.151 INFO:tasks.workunit.client.0.smithi055.stdout:4/502: dwrite d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:16.151 INFO:tasks.workunit.client.0.smithi055.stdout:5/481: link d4/df/d13/d26/l2b d4/df/d13/d26/d3c/d4a/d3f/d5c/lac 0 2024-04-26T21:08:16.152 INFO:tasks.workunit.client.0.smithi055.stdout:5/482: write d4/f4d [626269,13787] 0 2024-04-26T21:08:16.152 INFO:tasks.workunit.client.0.smithi055.stdout:5/483: write f2 [625417,102988] 0 2024-04-26T21:08:16.152 INFO:tasks.workunit.client.0.smithi055.stdout:5/484: chown d4/df/d13/d26/d3c/d4a/d3f/d4f/c6f 21507533 1 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:2/645: getdents d4/db/d1f/d46/d51 0 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:5/485: truncate d4/df/d13/d26/d3c/f79 4019949 0 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:5/486: chown d4/df/d13/d26/d63/c68 3416 1 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:5/487: stat d4/df/d13/d26/d3c/d4a/d3f/l2d 0 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:5/488: chown d4/df/d13/d26/d3c/d4a/d3f/d4f/d53 27 1 2024-04-26T21:08:16.155 INFO:tasks.workunit.client.0.smithi055.stdout:5/489: chown d4/df/f5d 25 1 2024-04-26T21:08:16.157 INFO:tasks.workunit.client.0.smithi055.stdout:2/646: mknod d4/db/d1f/d32/d57/ccb 0 2024-04-26T21:08:16.157 INFO:tasks.workunit.client.0.smithi055.stdout:2/647: fdatasync d4/db/d56/f70 0 2024-04-26T21:08:16.159 INFO:tasks.workunit.client.0.smithi055.stdout:5/490: creat d4/df/d13/d26/d3c/d4a/d3f/da1/fad x:0 0 0 2024-04-26T21:08:16.159 INFO:tasks.workunit.client.0.smithi055.stdout:5/491: write d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f62 [843401,120229] 0 2024-04-26T21:08:16.161 INFO:tasks.workunit.client.0.smithi055.stdout:2/648: link d4/db/d56/c8a d4/db/d26/ccc 0 2024-04-26T21:08:16.162 INFO:tasks.workunit.client.1.smithi064.stdout:5/745: dread dd/d12/d18/d1a/d1f/d20/f59 [0,4194304] 0 2024-04-26T21:08:16.163 INFO:tasks.workunit.client.0.smithi055.stdout:2/649: mkdir d4/db/d1f/d32/dcd 0 2024-04-26T21:08:16.164 INFO:tasks.workunit.client.0.smithi055.stdout:2/650: symlink d4/dc/lce 0 2024-04-26T21:08:16.164 INFO:tasks.workunit.client.0.smithi055.stdout:2/651: readlink d4/d55/d6c/la5 0 2024-04-26T21:08:16.165 INFO:tasks.workunit.client.0.smithi055.stdout:2/652: symlink d4/db/d56/d4a/lcf 0 2024-04-26T21:08:16.165 INFO:tasks.workunit.client.0.smithi055.stdout:2/653: creat d4/d55/d6c/fd0 x:0 0 0 2024-04-26T21:08:16.166 INFO:tasks.workunit.client.0.smithi055.stdout:2/654: creat d4/db/d1f/d32/d57/fd1 x:0 0 0 2024-04-26T21:08:16.168 INFO:tasks.workunit.client.0.smithi055.stdout:6/584: dwrite d3/d17/d19/f3d [4194304,4194304] 0 2024-04-26T21:08:16.168 INFO:tasks.workunit.client.0.smithi055.stdout:6/585: write d3/d17/d46/d54/d66/d6a/d51/d58/d73/f8d [1530152,108621] 0 2024-04-26T21:08:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.169+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ccc02ce50 con 0x7f5cb406ea70 2024-04-26T21:08:16.170 INFO:tasks.workunit.client.0.smithi055.stdout:2/655: creat d4/d49/fd2 x:0 0 0 2024-04-26T21:08:16.170 INFO:tasks.workunit.client.0.smithi055.stdout:2/656: dread - d4/d1e/f92 zero size 2024-04-26T21:08:16.172 INFO:tasks.workunit.client.0.smithi055.stdout:6/586: mkdir d3/d17/d19/d71/dca/dcb/dd0 0 2024-04-26T21:08:16.173 INFO:tasks.workunit.client.0.smithi055.stdout:6/587: mknod d3/da5/cd1 0 2024-04-26T21:08:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.174+0000 7f5cc9600700 1 -- 172.21.15.55:0/407827052 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f5ccc02ce50 con 0x7f5cb406ea70 2024-04-26T21:08:16.176 INFO:tasks.workunit.client.0.smithi055.stdout:6/588: symlink d3/d17/d46/d54/d66/d6a/d51/d58/ld2 0 2024-04-26T21:08:16.178 INFO:tasks.workunit.client.0.smithi055.stdout:6/589: symlink d3/d17/d19/d71/dca/dcb/ld3 0 2024-04-26T21:08:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.177+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 msgr2=0x7f5cb4070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.177+0000 7f5cd3600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 0x7f5cb4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc101c70 tx=0x7f5cc0009310 comp rx=0 tx=0).stop 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.177+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 msgr2=0x7f5ccc196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.177+0000 7f5cd3600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009230 tx=0x7f5cb800f740 comp rx=0 tx=0).stop 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 shutdown_connections 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cb406ea70 0x7f5cb4070f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ccc100c10 0x7f5ccc196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 --2- 172.21.15.55:0/407827052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ccc101e10 0x7f5ccc196b70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 >> 172.21.15.55:0/407827052 conn(0x7f5ccc0fc1f0 msgr2=0x7f5ccc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 shutdown_connections 2024-04-26T21:08:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.178+0000 7f5cd3600700 1 -- 172.21.15.55:0/407827052 wait complete. 2024-04-26T21:08:16.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/590: mkdir d3/d17/d46/dc2/dd4 0 2024-04-26T21:08:16.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/591: creat d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/fd5 x:0 0 0 2024-04-26T21:08:16.180 INFO:tasks.workunit.client.0.smithi055.stdout:6/592: rename d3 to d3/d17/d19/d71/dca/dd6 22 2024-04-26T21:08:16.187 INFO:tasks.workunit.client.0.smithi055.stdout:6/593: getdents d3/d17/d19 0 2024-04-26T21:08:16.187 INFO:tasks.workunit.client.0.smithi055.stdout:6/594: chown d3/d17/d19/fc9 7596 1 2024-04-26T21:08:16.188 INFO:tasks.workunit.client.0.smithi055.stdout:8/520: write d3/f47 [2204229,123003] 0 2024-04-26T21:08:16.188 INFO:tasks.workunit.client.0.smithi055.stdout:8/521: fsync d3/d9/d1f/d2e/d75/f6a 0 2024-04-26T21:08:16.191 INFO:tasks.workunit.client.0.smithi055.stdout:2/657: dread d4/db/d1f/d46/f5a [0,4194304] 0 2024-04-26T21:08:16.192 INFO:tasks.workunit.client.1.smithi064.stdout:2/918: dwrite d12/d41/d73/d83/d94/d3a/dba/ff4 [4194304,4194304] 0 2024-04-26T21:08:16.192 INFO:tasks.workunit.client.1.smithi064.stdout:2/919: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/f123 [580277,36380] 0 2024-04-26T21:08:16.192 INFO:tasks.workunit.client.0.smithi055.stdout:2/658: mkdir d4/d49/d4c/d5e/d7d/dd3 0 2024-04-26T21:08:16.196 INFO:tasks.workunit.client.0.smithi055.stdout:0/604: dwrite d9/f5a [0,4194304] 0 2024-04-26T21:08:16.198 INFO:tasks.workunit.client.1.smithi064.stdout:6/766: dwrite d4/d7/fee [0,4194304] 0 2024-04-26T21:08:16.199 INFO:tasks.workunit.client.0.smithi055.stdout:5/492: dread d4/df/f6b [0,4194304] 0 2024-04-26T21:08:16.199 INFO:tasks.workunit.client.0.smithi055.stdout:5/493: write d4/df/d13/d26/d3c/d4a/d3f/d4f/f75 [78494,126200] 0 2024-04-26T21:08:16.200 INFO:tasks.workunit.client.0.smithi055.stdout:0/605: rename d9/d27/c69 to d9/dc/d17/cbf 0 2024-04-26T21:08:16.202 INFO:tasks.workunit.client.0.smithi055.stdout:0/606: rename d9/d11/d5b/d74/l81 to d9/d27/daf/lc0 0 2024-04-26T21:08:16.202 INFO:tasks.workunit.client.0.smithi055.stdout:0/607: fsync d9/dc/d1c/d54/f92 0 2024-04-26T21:08:16.203 INFO:tasks.workunit.client.0.smithi055.stdout:5/494: write d4/df/d13/d26/d3c/d4a/d3f/d4f/f75 [1342181,7425] 0 2024-04-26T21:08:16.205 INFO:tasks.workunit.client.1.smithi064.stdout:1/929: sync 2024-04-26T21:08:16.209 INFO:tasks.workunit.client.0.smithi055.stdout:0/608: mkdir d9/dc/d1c/d3e/d7d/dc1 0 2024-04-26T21:08:16.214 INFO:tasks.workunit.client.1.smithi064.stdout:8/718: dwrite d10/d41/d4e/d54/dc3/fcb [0,4194304] 0 2024-04-26T21:08:16.214 INFO:tasks.workunit.client.1.smithi064.stdout:8/719: creat d10/d41/d4e/d54/fe1 x:0 0 0 2024-04-26T21:08:16.214 INFO:tasks.workunit.client.1.smithi064.stdout:8/720: chown d10/d41/d4e/d59/fba 2613788 1 2024-04-26T21:08:16.214 INFO:tasks.workunit.client.1.smithi064.stdout:8/721: fsync d10/d1d/d38/f5b 0 2024-04-26T21:08:16.219 INFO:tasks.workunit.client.1.smithi064.stdout:6/767: symlink d4/d7/d33/lfb 0 2024-04-26T21:08:16.219 INFO:tasks.workunit.client.1.smithi064.stdout:6/768: read - d4/d7/d12/fc2 zero size 2024-04-26T21:08:16.222 INFO:tasks.workunit.client.1.smithi064.stdout:6/769: unlink d4/d7/d12/d49/d4b/d5a/d79/f90 0 2024-04-26T21:08:16.225 INFO:tasks.workunit.client.1.smithi064.stdout:6/770: link d4/d7/d12/d49/d4b/d5a/d8f/fec d4/d7/d12/d49/d4b/d56/dcf/ffc 0 2024-04-26T21:08:16.225 INFO:tasks.workunit.client.1.smithi064.stdout:6/771: chown d4/d7/d12/d49/d4b/d5a/l5f 87150 1 2024-04-26T21:08:16.229 INFO:tasks.workunit.client.1.smithi064.stdout:5/746: dwrite dd/d12/f40 [8388608,4194304] 0 2024-04-26T21:08:16.229 INFO:tasks.workunit.client.1.smithi064.stdout:5/747: chown dd/d12/d18/d1a/d1f/d20/l68 1 1 2024-04-26T21:08:16.229 INFO:tasks.workunit.client.1.smithi064.stdout:5/748: rename dd/d12/d18/d25/d67/db3 to dd/d12/d18/d25/d67/db3/dee 22 2024-04-26T21:08:16.238 INFO:tasks.workunit.client.1.smithi064.stdout:6/772: link d4/d7/d12/fbe d4/d7/d12/d49/de1/ffd 0 2024-04-26T21:08:16.238 INFO:tasks.workunit.client.1.smithi064.stdout:6/773: dread - d4/d7/d12/d38/de6/fe7 zero size 2024-04-26T21:08:16.238 INFO:tasks.workunit.client.1.smithi064.stdout:8/722: dread d10/d41/d44/d5a/f62 [0,4194304] 0 2024-04-26T21:08:16.239 INFO:tasks.workunit.client.1.smithi064.stdout:7/819: dwrite d6/d9/d38/f3a [0,4194304] 0 2024-04-26T21:08:16.244 INFO:tasks.workunit.client.1.smithi064.stdout:6/774: write d4/d7/d12/f77 [153584,122092] 0 2024-04-26T21:08:16.244 INFO:tasks.workunit.client.0.smithi055.stdout:4/503: dwrite d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:16.244 INFO:tasks.workunit.client.0.smithi055.stdout:4/504: stat d4/d26/d42/d56/f96 0 2024-04-26T21:08:16.244 INFO:tasks.workunit.client.0.smithi055.stdout:4/505: truncate d4/d26/d42/d2d/f41 8504875 0 2024-04-26T21:08:16.245 INFO:tasks.workunit.client.1.smithi064.stdout:8/723: mknod d10/d41/d4e/d59/d83/ce2 0 2024-04-26T21:08:16.245 INFO:tasks.workunit.client.1.smithi064.stdout:5/749: rename dd/d12/d4f/d9c/c9d to dd/d12/d18/d25/d74/cef 0 2024-04-26T21:08:16.245 INFO:tasks.workunit.client.1.smithi064.stdout:8/724: write d10/d41/d4e/d59/f96 [2619438,1373] 0 2024-04-26T21:08:16.251 INFO:tasks.workunit.client.0.smithi055.stdout:4/506: truncate d4/f1d 889447 0 2024-04-26T21:08:16.251 INFO:tasks.workunit.client.0.smithi055.stdout:4/507: chown d4/d12/d15/l33 23506 1 2024-04-26T21:08:16.255 INFO:tasks.workunit.client.0.smithi055.stdout:4/508: symlink d4/d12/d61/d6b/laf 0 2024-04-26T21:08:16.259 INFO:tasks.workunit.client.1.smithi064.stdout:7/820: mknod d6/d70/c11b 0 2024-04-26T21:08:16.262 INFO:tasks.workunit.client.0.smithi055.stdout:4/509: rename d4/d12/d17/d3d/l84 to d4/d12/d15/lb0 0 2024-04-26T21:08:16.263 INFO:tasks.workunit.client.1.smithi064.stdout:6/775: rmdir d4/d7/d12/d49 39 2024-04-26T21:08:16.264 INFO:tasks.workunit.client.1.smithi064.stdout:2/920: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/ff7 [4194304,4194304] 0 2024-04-26T21:08:16.264 INFO:tasks.workunit.client.1.smithi064.stdout:2/921: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f138 x:0 0 0 2024-04-26T21:08:16.265 INFO:tasks.workunit.client.1.smithi064.stdout:6/776: creat d4/d7/d12/d49/d4b/d7d/ffe x:0 0 0 2024-04-26T21:08:16.266 INFO:tasks.workunit.client.1.smithi064.stdout:4/855: sync 2024-04-26T21:08:16.266 INFO:tasks.workunit.client.1.smithi064.stdout:2/922: write d12/d41/d61/d75/f2c [1118884,63734] 0 2024-04-26T21:08:16.267 INFO:tasks.workunit.client.1.smithi064.stdout:6/777: creat d4/d7/d12/d49/fff x:0 0 0 2024-04-26T21:08:16.268 INFO:tasks.workunit.client.1.smithi064.stdout:4/856: creat d0/d5/d13/d33/dd0/dd8/f120 x:0 0 0 2024-04-26T21:08:16.269 INFO:tasks.workunit.client.1.smithi064.stdout:6/778: truncate d4/d7/f3a 393098 0 2024-04-26T21:08:16.269 INFO:tasks.workunit.client.1.smithi064.stdout:6/779: dread - d4/d7/d12/d38/ff8 zero size 2024-04-26T21:08:16.270 INFO:tasks.workunit.client.1.smithi064.stdout:4/857: rename d0/d1d/d56/d89/ce0 to d0/d5/d13/d6d/d97/c121 0 2024-04-26T21:08:16.270 INFO:tasks.workunit.client.1.smithi064.stdout:4/858: stat d0/d5/d13/d33/dd0 0 2024-04-26T21:08:16.282 INFO:tasks.workunit.client.1.smithi064.stdout:4/859: getdents d0/d5/d13/d6d/dd3 0 2024-04-26T21:08:16.282 INFO:tasks.workunit.client.1.smithi064.stdout:6/780: creat d4/d7/d12/f100 x:0 0 0 2024-04-26T21:08:16.283 INFO:tasks.workunit.client.0.smithi055.stdout:2/659: dwrite d4/d49/d4c/d5e/f95 [0,4194304] 0 2024-04-26T21:08:16.283 INFO:tasks.workunit.client.0.smithi055.stdout:5/495: dwrite d4/df/d13/d26/d3c/d4a/f56 [0,4194304] 0 2024-04-26T21:08:16.290 INFO:tasks.workunit.client.1.smithi064.stdout:6/781: unlink d4/d7/d12/d49/d4b/c66 0 2024-04-26T21:08:16.290 INFO:tasks.workunit.client.1.smithi064.stdout:6/782: chown d4/d7/d12/d49/d4b/d56/f96 1 1 2024-04-26T21:08:16.298 INFO:tasks.workunit.client.1.smithi064.stdout:6/783: mkdir d4/d7/d12/d49/d4b/d101 0 2024-04-26T21:08:16.299 INFO:tasks.workunit.client.1.smithi064.stdout:6/784: write d4/d7/d33/fdd [539753,58406] 0 2024-04-26T21:08:16.303 INFO:tasks.workunit.client.1.smithi064.stdout:8/725: dwrite d10/d41/d4e/d54/dc3/fcb [0,4194304] 0 2024-04-26T21:08:16.303 INFO:tasks.workunit.client.1.smithi064.stdout:8/726: chown d10/d41/d44/f51 125772 1 2024-04-26T21:08:16.303 INFO:tasks.workunit.client.1.smithi064.stdout:1/930: dwrite d0/d6/d11/d1e/d2a/d34/d57/f96 [4194304,4194304] 0 2024-04-26T21:08:16.306 INFO:tasks.workunit.client.1.smithi064.stdout:0/767: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fa5 [0,4194304] 0 2024-04-26T21:08:16.312 INFO:tasks.workunit.client.0.smithi055.stdout:2/660: symlink d4/d49/d4c/d5e/d7d/ld4 0 2024-04-26T21:08:16.314 INFO:tasks.workunit.client.0.smithi055.stdout:5/496: mkdir d4/df/dae 0 2024-04-26T21:08:16.315 INFO:tasks.workunit.client.1.smithi064.stdout:6/785: rename d4/d7/f69 to d4/d7/d12/d49/d4b/d5a/daf/db2/f102 0 2024-04-26T21:08:16.320 INFO:tasks.workunit.client.1.smithi064.stdout:3/745: sync 2024-04-26T21:08:16.325 INFO:tasks.workunit.client.0.smithi055.stdout:5/497: dread d4/df/d13/d26/d3c/d4a/d3f/f6a [0,4194304] 0 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:6/786: mkdir d4/d7/d12/d49/de1/d103 0 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:6/787: creat d4/d7/d12/d49/f104 x:0 0 0 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:8/727: dread d10/d41/d53/f8b [0,4194304] 0 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:3/746: rename d1/d14/feb to d1/d27/d29/ffe 0 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:3/747: chown d1/d27/d29/d6f/d72/d73/fca 57 1 2024-04-26T21:08:16.330 INFO:tasks.workunit.client.1.smithi064.stdout:3/748: dread - d1/d27/d29/d6f/d72/da5/d7d/fde zero size 2024-04-26T21:08:16.331 INFO:tasks.workunit.client.1.smithi064.stdout:8/728: read d10/d41/d44/f7c [221192,28167] 0 2024-04-26T21:08:16.334 INFO:tasks.workunit.client.0.smithi055.stdout:5/498: link d4/df/d13/d26/d3c/d4a/l4b d4/df/d13/d26/d3c/d93/laf 0 2024-04-26T21:08:16.334 INFO:tasks.workunit.client.0.smithi055.stdout:5/499: chown d4/df/d13/f4c 6362 1 2024-04-26T21:08:16.340 INFO:tasks.workunit.client.1.smithi064.stdout:6/788: unlink d4/d7/d33/lb4 0 2024-04-26T21:08:16.340 INFO:tasks.workunit.client.1.smithi064.stdout:3/749: symlink d1/d27/d50/d35/d4c/d7b/lff 0 2024-04-26T21:08:16.343 INFO:tasks.workunit.client.0.smithi055.stdout:4/510: dwrite d4/d12/d57/f8b [0,4194304] 0 2024-04-26T21:08:16.345 INFO:tasks.workunit.client.1.smithi064.stdout:7/821: dwrite d6/d9/d3d/f6e [4194304,4194304] 0 2024-04-26T21:08:16.345 INFO:tasks.workunit.client.1.smithi064.stdout:7/822: chown d6/d9/d77/c9a 111 1 2024-04-26T21:08:16.348 INFO:tasks.workunit.client.1.smithi064.stdout:5/750: dwrite dd/da9/d63/f84 [0,4194304] 0 2024-04-26T21:08:16.348 INFO:tasks.workunit.client.1.smithi064.stdout:8/729: mkdir d10/d41/d4e/de3 0 2024-04-26T21:08:16.350 INFO:tasks.workunit.client.1.smithi064.stdout:0/768: dwrite dd/d21/dc8/d31/d47/dad/dfd/d18/d64/fa1 [0,4194304] 0 2024-04-26T21:08:16.352 INFO:tasks.workunit.client.1.smithi064.stdout:2/923: dwrite d12/d41/d73/d83/d94/f3f [0,4194304] 0 2024-04-26T21:08:16.354 INFO:tasks.workunit.client.0.smithi055.stdout:5/500: mknod d4/df/d13/d26/d3c/d4a/d3f/cb0 0 2024-04-26T21:08:16.354 INFO:tasks.workunit.client.0.smithi055.stdout:5/501: dread - d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/faa zero size 2024-04-26T21:08:16.354 INFO:tasks.workunit.client.1.smithi064.stdout:6/789: creat d4/d7/d12/d49/d4b/d5a/d8f/f105 x:0 0 0 2024-04-26T21:08:16.355 INFO:tasks.workunit.client.0.smithi055.stdout:2/661: dread d4/db/f15 [0,4194304] 0 2024-04-26T21:08:16.358 INFO:tasks.workunit.client.1.smithi064.stdout:3/750: rmdir d1/d27/d50/d35/d4c/d7b/dec 0 2024-04-26T21:08:16.359 INFO:tasks.workunit.client.1.smithi064.stdout:3/751: stat d1/d14/la1 0 2024-04-26T21:08:16.359 INFO:tasks.workunit.client.1.smithi064.stdout:3/752: creat d1/d27/d29/d9d/f100 x:0 0 0 2024-04-26T21:08:16.361 INFO:tasks.workunit.client.1.smithi064.stdout:4/860: dwrite d0/d5/d13/d6d/f4b [0,4194304] 0 2024-04-26T21:08:16.363 INFO:tasks.workunit.client.0.smithi055.stdout:2/662: mknod d4/db/d56/d4a/d7e/cd5 0 2024-04-26T21:08:16.363 INFO:tasks.workunit.client.0.smithi055.stdout:2/663: creat d4/d1e/d2a/fd6 x:0 0 0 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/823: symlink d6/db/d1f/d50/db8/deb/l11c 0 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/824: creat d6/d9/d38/f11d x:0 0 0 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/825: dread - d6/db/ff4 zero size 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:4/861: read d0/d2f/f6f [337851,37753] 0 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/826: read - d6/d15/d88/dca/d5c/ded/f10a zero size 2024-04-26T21:08:16.365 INFO:tasks.workunit.client.1.smithi064.stdout:7/827: dread - d6/d9/d3d/f6b zero size 2024-04-26T21:08:16.366 INFO:tasks.workunit.client.0.smithi055.stdout:5/502: dread d4/df/f1b [0,4194304] 0 2024-04-26T21:08:16.372 INFO:tasks.workunit.client.1.smithi064.stdout:5/751: unlink dd/d12/d18/d25/d32/f80 0 2024-04-26T21:08:16.373 INFO:tasks.workunit.client.1.smithi064.stdout:1/931: dwrite d0/d6b/d9e/da2/fc6 [4194304,4194304] 0 2024-04-26T21:08:16.373 INFO:tasks.workunit.client.1.smithi064.stdout:1/932: creat d0/d22/f124 x:0 0 0 2024-04-26T21:08:16.373 INFO:tasks.workunit.client.1.smithi064.stdout:1/933: write d0/f11c [302543,29419] 0 2024-04-26T21:08:16.376 INFO:tasks.workunit.client.0.smithi055.stdout:5/503: rmdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90 39 2024-04-26T21:08:16.381 INFO:tasks.workunit.client.1.smithi064.stdout:8/730: unlink d10/d41/d4e/d59/l92 0 2024-04-26T21:08:16.382 INFO:tasks.workunit.client.0.smithi055.stdout:5/504: mknod d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/da6/cb1 0 2024-04-26T21:08:16.382 INFO:tasks.workunit.client.0.smithi055.stdout:5/505: fsync d4/df/d13/d26/d3c/d5b/f70 0 2024-04-26T21:08:16.382 INFO:tasks.workunit.client.0.smithi055.stdout:5/506: readlink d4/d15/l66 0 2024-04-26T21:08:16.384 INFO:tasks.workunit.client.1.smithi064.stdout:0/769: creat dd/d21/dc8/d31/d47/d61/fff x:0 0 0 2024-04-26T21:08:16.384 INFO:tasks.workunit.client.1.smithi064.stdout:0/770: creat dd/df6/f100 x:0 0 0 2024-04-26T21:08:16.384 INFO:tasks.workunit.client.1.smithi064.stdout:0/771: dread - dd/fdc zero size 2024-04-26T21:08:16.384 INFO:tasks.workunit.client.1.smithi064.stdout:0/772: dread - dd/ff3 zero size 2024-04-26T21:08:16.387 INFO:tasks.workunit.client.1.smithi064.stdout:7/828: dread d6/d9/f76 [0,4194304] 0 2024-04-26T21:08:16.388 INFO:tasks.workunit.client.1.smithi064.stdout:2/924: unlink d12/d41/d73/l7a 0 2024-04-26T21:08:16.388 INFO:tasks.workunit.client.1.smithi064.stdout:7/829: fdatasync d6/d9/f36 0 2024-04-26T21:08:16.389 INFO:tasks.workunit.client.0.smithi055.stdout:5/507: link d4/df/d13/d26/d3c/c40 d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d87/d9e/cb2 0 2024-04-26T21:08:16.389 INFO:tasks.workunit.client.0.smithi055.stdout:5/508: readlink d4/df/l5f 0 2024-04-26T21:08:16.392 INFO:tasks.workunit.client.1.smithi064.stdout:6/790: symlink d4/d7/d12/d49/l106 0 2024-04-26T21:08:16.395 INFO:tasks.workunit.client.1.smithi064.stdout:3/753: mknod d1/d27/d29/d5e/c101 0 2024-04-26T21:08:16.406 INFO:tasks.workunit.client.1.smithi064.stdout:4/862: getdents d0/d2f/d7d 0 2024-04-26T21:08:16.407 INFO:tasks.workunit.client.1.smithi064.stdout:5/752: creat dd/dd0/ff0 x:0 0 0 2024-04-26T21:08:16.408 INFO:tasks.workunit.client.1.smithi064.stdout:5/753: write dd/d12/d18/f1d [4169026,109032] 0 2024-04-26T21:08:16.408 INFO:tasks.workunit.client.1.smithi064.stdout:0/773: dread dd/d21/dc8/d31/d47/dad/dfd/d18/d58/fcb [0,4194304] 0 2024-04-26T21:08:16.411 INFO:tasks.workunit.client.1.smithi064.stdout:1/934: creat d0/d6/d11/d1e/f125 x:0 0 0 2024-04-26T21:08:16.412 INFO:tasks.workunit.client.1.smithi064.stdout:3/754: dread d1/d27/d29/d6f/d72/da5/fae [0,4194304] 0 2024-04-26T21:08:16.412 INFO:tasks.workunit.client.1.smithi064.stdout:8/731: creat d10/d41/d4e/d59/d83/fe4 x:0 0 0 2024-04-26T21:08:16.414 INFO:tasks.workunit.client.1.smithi064.stdout:2/925: mknod d12/d41/d73/d83/d94/d3a/d46/d48/d120/d12f/c139 0 2024-04-26T21:08:16.415 INFO:tasks.workunit.client.1.smithi064.stdout:7/830: getdents d6/d15/d67 0 2024-04-26T21:08:16.415 INFO:tasks.workunit.client.1.smithi064.stdout:7/831: readlink d6/d9/d77/l97 0 2024-04-26T21:08:16.415 INFO:tasks.workunit.client.1.smithi064.stdout:7/832: write d6/d15/d88/dca/d5c/f7b [1504220,110652] 0 2024-04-26T21:08:16.416 INFO:tasks.workunit.client.0.smithi055.stdout:4/511: dwrite d4/d12/d17/fa8 [0,4194304] 0 2024-04-26T21:08:16.417 INFO:tasks.workunit.client.1.smithi064.stdout:7/833: creat d6/d9/d38/f11e x:0 0 0 2024-04-26T21:08:16.417 INFO:tasks.workunit.client.1.smithi064.stdout:7/834: dread - d6/db/d34/d6f/d81/fc5 zero size 2024-04-26T21:08:16.417 INFO:tasks.workunit.client.1.smithi064.stdout:7/835: fsync d6/d15/d1c/d45/f107 0 2024-04-26T21:08:16.417 INFO:tasks.workunit.client.1.smithi064.stdout:7/836: truncate d6/d9/d38/f11d 472769 0 2024-04-26T21:08:16.417 INFO:tasks.workunit.client.1.smithi064.stdout:6/791: rename d4/d7/de0 to d4/d7/d12/d49/d4b/d7d/d83/d107 0 2024-04-26T21:08:16.418 INFO:tasks.workunit.client.1.smithi064.stdout:4/863: symlink d0/d2f/d69/db5/l122 0 2024-04-26T21:08:16.420 INFO:tasks.workunit.client.1.smithi064.stdout:5/754: write dd/d12/d18/f1d [6342621,42081] 0 2024-04-26T21:08:16.420 INFO:tasks.workunit.client.1.smithi064.stdout:5/755: fdatasync dd/d12/d18/d1a/d1f/f5a 0 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 -- 172.21.15.55:0/541741946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 msgr2=0x7f3100100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 --2- 172.21.15.55:0/541741946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f3100100330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009910 tx=0x7f30ec009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 -- 172.21.15.55:0/541741946 shutdown_connections 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 --2- 172.21.15.55:0/541741946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f3100100330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 --2- 172.21.15.55:0/541741946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f31000ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.419+0000 7f3107800700 1 -- 172.21.15.55:0/541741946 >> 172.21.15.55:0/541741946 conn(0x7f31000fb110 msgr2=0x7f31000fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.420+0000 7f3107800700 1 -- 172.21.15.55:0/541741946 shutdown_connections 2024-04-26T21:08:16.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.420+0000 7f3107800700 1 -- 172.21.15.55:0/541741946 wait complete. 2024-04-26T21:08:16.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.421+0000 7f3107800700 1 Processor -- start 2024-04-26T21:08:16.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3107800700 1 -- start start 2024-04-26T21:08:16.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3107800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3107800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f31000724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3107800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100072ac0 con 0x7f31000ffeb0 2024-04-26T21:08:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3107800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31001a6550 con 0x7f31000ff550 2024-04-26T21:08:16.423 INFO:tasks.workunit.client.1.smithi064.stdout:1/935: getdents d0/d6 0 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3104e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3104e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:48374/0 (socket says 172.21.15.55:48374) 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.422+0000 7f3104e00700 1 -- 172.21.15.55:0/1784612835 learned_addr learned my addr 172.21.15.55:0/1784612835 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.423+0000 7f30ffe00700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f31000724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.423+0000 7f3104e00700 1 -- 172.21.15.55:0/1784612835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 msgr2=0x7f31000724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.423+0000 7f3104e00700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f31000724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.423+0000 7f3104e00700 1 -- 172.21.15.55:0/1784612835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0095f0 con 0x7f31000ff550 2024-04-26T21:08:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.424+0000 7f3104e00700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e920 tx=0x7f30f400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.424+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f400c9d0 con 0x7f31000ff550 2024-04-26T21:08:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.424+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30f4010430 con 0x7f31000ff550 2024-04-26T21:08:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.424+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31001a6750 con 0x7f31000ff550 2024-04-26T21:08:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.424+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f4018630 con 0x7f31000ff550 2024-04-26T21:08:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.425+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31001a6c50 con 0x7f31000ff550 2024-04-26T21:08:16.425 INFO:tasks.workunit.client.1.smithi064.stdout:8/732: mknod d10/d1d/d38/ce5 0 2024-04-26T21:08:16.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.426+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310006c0a0 con 0x7f31000ff550 2024-04-26T21:08:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.427+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 26) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f30f40188a0 con 0x7f31000ff550 2024-04-26T21:08:16.428 INFO:tasks.workunit.client.0.smithi055.stdout:4/512: rename d4/d18/f5c to d4/d18/d8e/d9e/fb1 0 2024-04-26T21:08:16.428 INFO:tasks.workunit.client.0.smithi055.stdout:4/513: dread - d4/d18/f55 zero size 2024-04-26T21:08:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.428+0000 7f30fd600700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 0x7f30e8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:16.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.428+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f30f4014070 con 0x7f31000ff550 2024-04-26T21:08:16.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.429+0000 7f30ffe00700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 0x7f30e8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.430+0000 7f30ffe00700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 0x7f30e8070f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006010 tx=0x7f30ec009f70 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:16.430 INFO:tasks.workunit.client.1.smithi064.stdout:2/926: creat d12/d41/d61/f13a x:0 0 0 2024-04-26T21:08:16.432 INFO:tasks.workunit.client.1.smithi064.stdout:9/787: sync 2024-04-26T21:08:16.432 INFO:tasks.workunit.client.1.smithi064.stdout:9/788: fsync d0/d4/da/d26/d47/d9d/d76/ffc 0 2024-04-26T21:08:16.436 INFO:tasks.workunit.client.1.smithi064.stdout:0/774: rename dd/d21/dc8/d31/d5c/l62 to dd/d21/dc8/d31/d47/dad/dfd/d18/d64/dda/l101 0 2024-04-26T21:08:16.436 INFO:tasks.workunit.client.1.smithi064.stdout:0/775: truncate dd/ff3 503525 0 2024-04-26T21:08:16.436 INFO:tasks.workunit.client.1.smithi064.stdout:0/776: getdents dd/d21/db8 0 2024-04-26T21:08:16.437 INFO:tasks.workunit.client.1.smithi064.stdout:6/792: getdents d4/d7/d12/d1e 0 2024-04-26T21:08:16.437 INFO:tasks.workunit.client.1.smithi064.stdout:6/793: write d4/d7/d12/d49/de1/ff4 [204131,68802] 0 2024-04-26T21:08:16.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.437+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f30f4053f60 con 0x7f31000ff550 2024-04-26T21:08:16.439 INFO:tasks.workunit.client.1.smithi064.stdout:5/756: mknod dd/da9/d48/d56/daa/cf1 0 2024-04-26T21:08:16.442 INFO:tasks.workunit.client.1.smithi064.stdout:9/789: getdents d0/d4/da/d26/d47/d9d/d76 0 2024-04-26T21:08:16.445 INFO:tasks.workunit.client.1.smithi064.stdout:3/755: rename d1/d27/d50/d35/d4c/d7b/d82/d9b/cbf to d1/d38/d68/c102 0 2024-04-26T21:08:16.449 INFO:tasks.workunit.client.1.smithi064.stdout:5/757: mkdir dd/d12/d4f/dbd/df2 0 2024-04-26T21:08:16.449 INFO:tasks.workunit.client.1.smithi064.stdout:5/758: stat dd/d12/d18/d25/d67/db3/fbf 0 2024-04-26T21:08:16.449 INFO:tasks.workunit.client.1.smithi064.stdout:6/794: mkdir d4/d7/d12/d49/d4b/d5a/d8f/d108 0 2024-04-26T21:08:16.449 INFO:tasks.workunit.client.1.smithi064.stdout:5/759: write dd/d12/d18/d25/d67/f93 [1103496,118815] 0 2024-04-26T21:08:16.452 INFO:tasks.workunit.client.1.smithi064.stdout:1/936: rmdir d0/d6/de0 39 2024-04-26T21:08:16.452 INFO:tasks.workunit.client.1.smithi064.stdout:1/937: fdatasync d0/d22/d9f/df1/ffb 0 2024-04-26T21:08:16.453 INFO:tasks.workunit.client.1.smithi064.stdout:9/790: getdents d0/d4/da/d26 0 2024-04-26T21:08:16.454 INFO:tasks.workunit.client.0.smithi055.stdout:2/664: dwrite d4/d1e/f92 [0,4194304] 0 2024-04-26T21:08:16.454 INFO:tasks.workunit.client.0.smithi055.stdout:2/665: stat d4/db/d1f/d32/d57/ccb 0 2024-04-26T21:08:16.463 INFO:tasks.workunit.client.0.smithi055.stdout:2/666: symlink d4/db/d1f/d46/ld7 0 2024-04-26T21:08:16.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/938: dread d0/d6/d11/d1e/f46 [0,4194304] 0 2024-04-26T21:08:16.473 INFO:tasks.workunit.client.1.smithi064.stdout:1/939: chown d0/d6/d11/d1e 22 1 2024-04-26T21:08:16.474 INFO:tasks.workunit.client.1.smithi064.stdout:1/940: getdents d0/d22/d9f/df1 0 2024-04-26T21:08:16.474 INFO:tasks.workunit.client.1.smithi064.stdout:1/941: write d0/d6/d11/d1e/d2a/f115 [4114241,70967] 0 2024-04-26T21:08:16.481 INFO:tasks.workunit.client.1.smithi064.stdout:1/942: creat d0/d6/d76/f126 x:0 0 0 2024-04-26T21:08:16.482 INFO:tasks.workunit.client.1.smithi064.stdout:9/791: write d0/d4/da/d26/d47/d88/fe9 [571278,34222] 0 2024-04-26T21:08:16.488 INFO:tasks.workunit.client.1.smithi064.stdout:2/927: dwrite d12/d41/d73/d83/d94/d3a/d46/d91/d92/f12b [0,4194304] 0 2024-04-26T21:08:16.488 INFO:tasks.workunit.client.0.smithi055.stdout:5/509: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:08:16.491 INFO:tasks.workunit.client.1.smithi064.stdout:2/928: mknod d12/d41/d73/d83/d94/c13b 0 2024-04-26T21:08:16.499 INFO:tasks.workunit.client.1.smithi064.stdout:2/929: rmdir d12/d41/d73/d83/d94/d3a/d46/d6a/d86 39 2024-04-26T21:08:16.499 INFO:tasks.workunit.client.1.smithi064.stdout:2/930: readlink d12/da9/ld1 0 2024-04-26T21:08:16.499 INFO:tasks.workunit.client.1.smithi064.stdout:2/931: stat d12/d41 0 2024-04-26T21:08:16.501 INFO:tasks.workunit.client.1.smithi064.stdout:2/932: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/d13c 0 2024-04-26T21:08:16.501 INFO:tasks.workunit.client.1.smithi064.stdout:2/933: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f138 172520 0 2024-04-26T21:08:16.504 INFO:tasks.workunit.client.1.smithi064.stdout:2/934: symlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/d13c/l13d 0 2024-04-26T21:08:16.504 INFO:tasks.workunit.client.1.smithi064.stdout:2/935: stat d12/d41/d73/d83/d94/d3a/d46/d6a 0 2024-04-26T21:08:16.505 INFO:tasks.workunit.client.1.smithi064.stdout:2/936: mkdir d12/d41/d73/d83/d94/d13e 0 2024-04-26T21:08:16.505 INFO:tasks.workunit.client.1.smithi064.stdout:2/937: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/lb0 0 2024-04-26T21:08:16.510 INFO:tasks.workunit.client.1.smithi064.stdout:5/760: write dd/f16 [2044256,79770] 0 2024-04-26T21:08:16.512 INFO:tasks.workunit.client.1.smithi064.stdout:4/864: dwrite d0/d5/d79/dd1/f88 [0,4194304] 0 2024-04-26T21:08:16.512 INFO:tasks.workunit.client.1.smithi064.stdout:4/865: readlink d0/d1d/d21/lb0 0 2024-04-26T21:08:16.513 INFO:tasks.workunit.client.1.smithi064.stdout:7/837: dwrite d6/d9/d38/fb4 [0,4194304] 0 2024-04-26T21:08:16.513 INFO:tasks.workunit.client.1.smithi064.stdout:0/777: dread dd/f14 [0,4194304] 0 2024-04-26T21:08:16.517 INFO:tasks.workunit.client.1.smithi064.stdout:5/761: rename dd/d12/c17 to dd/d12/d4f/dbd/cf3 0 2024-04-26T21:08:16.517 INFO:tasks.workunit.client.1.smithi064.stdout:2/938: unlink d12/d41/d61/f13a 0 2024-04-26T21:08:16.525 INFO:tasks.workunit.client.1.smithi064.stdout:7/838: truncate d6/d15/d1c/d45/f4f 246452 0 2024-04-26T21:08:16.525 INFO:tasks.workunit.client.1.smithi064.stdout:2/939: mkdir d12/d41/d61/dd5/d13f 0 2024-04-26T21:08:16.525 INFO:tasks.workunit.client.1.smithi064.stdout:0/778: rename dd/d21/dc8/d31/d47/dad/dfd/f7d to dd/d21/dd9/f102 0 2024-04-26T21:08:16.525 INFO:tasks.workunit.client.1.smithi064.stdout:4/866: rmdir d0/d1d/d56/d89 39 2024-04-26T21:08:16.526 INFO:tasks.workunit.client.1.smithi064.stdout:7/839: write d6/d15/d67/d4d/fcb [877371,79137] 0 2024-04-26T21:08:16.529 INFO:tasks.workunit.client.1.smithi064.stdout:2/940: creat d12/d41/d73/d83/d94/d3a/d46/d48/d120/d12f/f140 x:0 0 0 2024-04-26T21:08:16.531 INFO:tasks.workunit.client.1.smithi064.stdout:0/779: creat dd/d21/dd9/f103 x:0 0 0 2024-04-26T21:08:16.531 INFO:tasks.workunit.client.1.smithi064.stdout:4/867: truncate d0/d5/d13/f12 101848 0 2024-04-26T21:08:16.531 INFO:tasks.workunit.client.1.smithi064.stdout:4/868: stat d0/d5/d13/d33/dcf/fe2 0 2024-04-26T21:08:16.535 INFO:tasks.workunit.client.1.smithi064.stdout:4/869: rmdir d0/d2f 39 2024-04-26T21:08:16.536 INFO:tasks.workunit.client.1.smithi064.stdout:4/870: readlink d0/d5/d79/l99 0 2024-04-26T21:08:16.540 INFO:tasks.workunit.client.0.smithi055.stdout:4/514: dwrite d4/d18/f55 [0,4194304] 0 2024-04-26T21:08:16.543 INFO:tasks.workunit.client.1.smithi064.stdout:4/871: symlink d0/d5/d79/dd1/da0/dcd/l123 0 2024-04-26T21:08:16.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/733: dwrite d10/d41/fe0 [0,4194304] 0 2024-04-26T21:08:16.552 INFO:tasks.workunit.client.0.smithi055.stdout:9/637: sync 2024-04-26T21:08:16.552 INFO:tasks.workunit.client.0.smithi055.stdout:1/570: sync 2024-04-26T21:08:16.552 INFO:tasks.workunit.client.0.smithi055.stdout:1/571: truncate d8/df/d11/d27/f3a 3439244 0 2024-04-26T21:08:16.553 INFO:tasks.workunit.client.0.smithi055.stdout:9/638: write d2/fc0 [1032541,57666] 0 2024-04-26T21:08:16.555 INFO:tasks.workunit.client.1.smithi064.stdout:3/756: dwrite d1/d27/d29/d6f/d72/da5/f7c [0,4194304] 0 2024-04-26T21:08:16.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/572: creat d8/df/d11/d27/fc2 x:0 0 0 2024-04-26T21:08:16.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/573: read - d8/d17/d1b/d41/fc0 zero size 2024-04-26T21:08:16.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/574: truncate d8/d17/d1b/d7b/f90 4686597 0 2024-04-26T21:08:16.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/575: stat d8/df/f24 0 2024-04-26T21:08:16.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/576: write d8/d17/d1b/d7b/d8d/f7a [708293,27119] 0 2024-04-26T21:08:16.562 INFO:tasks.workunit.client.1.smithi064.stdout:3/757: unlink d1/d27/d50/f91 0 2024-04-26T21:08:16.564 INFO:tasks.workunit.client.0.smithi055.stdout:9/639: rename d2/dc7 to d2/d46/d77/d79/de0 0 2024-04-26T21:08:16.564 INFO:tasks.workunit.client.0.smithi055.stdout:9/640: chown d2/d14/c5b 708 1 2024-04-26T21:08:16.572 INFO:tasks.workunit.client.1.smithi064.stdout:3/758: unlink d1/l3 0 2024-04-26T21:08:16.575 INFO:tasks.workunit.client.0.smithi055.stdout:9/641: write d2/d46/d77/d7d/f83 [320314,37484] 0 2024-04-26T21:08:16.576 INFO:tasks.workunit.client.1.smithi064.stdout:1/943: dread d0/d6/d11/d2c/f85 [0,4194304] 0 2024-04-26T21:08:16.579 INFO:tasks.workunit.client.0.smithi055.stdout:2/667: dwrite d4/f5 [0,4194304] 0 2024-04-26T21:08:16.580 INFO:tasks.workunit.client.0.smithi055.stdout:4/515: write d4/d18/f89 [4081084,122208] 0 2024-04-26T21:08:16.580 INFO:tasks.workunit.client.0.smithi055.stdout:4/516: fdatasync d4/d18/d8e/d9e/fb1 0 2024-04-26T21:08:16.580 INFO:tasks.workunit.client.0.smithi055.stdout:4/517: write d4/d18/f89 [5011489,11613] 0 2024-04-26T21:08:16.582 INFO:tasks.workunit.client.0.smithi055.stdout:5/510: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:08:16.585 INFO:tasks.workunit.client.1.smithi064.stdout:2/941: dread d12/d45/d121/f136 [0,4194304] 0 2024-04-26T21:08:16.585 INFO:tasks.workunit.client.1.smithi064.stdout:2/942: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/f11f 1 1 2024-04-26T21:08:16.585 INFO:tasks.workunit.client.1.smithi064.stdout:2/943: read d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/f6d [3161321,104086] 0 2024-04-26T21:08:16.593 INFO:tasks.workunit.client.1.smithi064.stdout:3/759: symlink d1/d27/d29/d6f/d72/d95/l103 0 2024-04-26T21:08:16.593 INFO:tasks.workunit.client.1.smithi064.stdout:3/760: dread - d1/d14/de6/ff0 zero size 2024-04-26T21:08:16.597 INFO:tasks.workunit.client.1.smithi064.stdout:1/944: truncate d0/d6/d11/d1e/d2a/d34/d57/d118/f84 2005877 0 2024-04-26T21:08:16.597 INFO:tasks.workunit.client.1.smithi064.stdout:2/944: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/f141 x:0 0 0 2024-04-26T21:08:16.597 INFO:tasks.workunit.client.1.smithi064.stdout:2/945: fdatasync d12/d41/d73/d83/d94/f4c 0 2024-04-26T21:08:16.600 INFO:tasks.workunit.client.0.smithi055.stdout:2/668: creat d4/db/d56/fd8 x:0 0 0 2024-04-26T21:08:16.600 INFO:tasks.workunit.client.0.smithi055.stdout:2/669: write d4/d55/d6c/fa2 [3569576,17426] 0 2024-04-26T21:08:16.600 INFO:tasks.workunit.client.0.smithi055.stdout:4/518: truncate d4/d12/d17/d3d/f68 1526136 0 2024-04-26T21:08:16.601 INFO:tasks.workunit.client.1.smithi064.stdout:4/872: dread d0/d5/d13/f60 [0,4194304] 0 2024-04-26T21:08:16.601 INFO:tasks.workunit.client.1.smithi064.stdout:1/945: creat d0/d22/d9f/df1/dfa/f127 x:0 0 0 2024-04-26T21:08:16.602 INFO:tasks.workunit.client.0.smithi055.stdout:2/670: mknod d4/d14/dc5/cd9 0 2024-04-26T21:08:16.602 INFO:tasks.workunit.client.0.smithi055.stdout:2/671: fdatasync d4/d14/d33/f42 0 2024-04-26T21:08:16.603 INFO:tasks.workunit.client.0.smithi055.stdout:4/519: read d4/d12/d17/f7e [107667,92457] 0 2024-04-26T21:08:16.607 INFO:tasks.workunit.client.1.smithi064.stdout:0/780: dwrite dd/d21/dc8/d31/d43/fa6 [0,4194304] 0 2024-04-26T21:08:16.607 INFO:tasks.workunit.client.1.smithi064.stdout:1/946: dread d0/d6/d11/fa5 [0,4194304] 0 2024-04-26T21:08:16.610 INFO:tasks.workunit.client.1.smithi064.stdout:5/762: dwrite dd/d12/d18/d1a/d1f/d20/f59 [0,4194304] 0 2024-04-26T21:08:16.610 INFO:tasks.workunit.client.1.smithi064.stdout:5/763: creat dd/da9/d48/dac/da6/ff4 x:0 0 0 2024-04-26T21:08:16.610 INFO:tasks.workunit.client.1.smithi064.stdout:5/764: read - dd/d12/d4f/da5/fa7 zero size 2024-04-26T21:08:16.611 INFO:tasks.workunit.client.1.smithi064.stdout:2/946: truncate d12/d41/d73/d83/d94/d3a/f64 756009 0 2024-04-26T21:08:16.611 INFO:tasks.workunit.client.1.smithi064.stdout:2/947: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/ffd 0 2024-04-26T21:08:16.613 INFO:tasks.workunit.client.1.smithi064.stdout:6/795: dwrite d4/d7/d12/f100 [0,4194304] 0 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:4/520: symlink d4/d12/lb2 0 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/642: getdents d2/d46/d77/d79 0 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/643: chown d2/d11/f2f 411677217 1 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/644: creat d2/fe1 x:0 0 0 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/645: chown d2/f9e 974052 1 2024-04-26T21:08:16.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/646: write d2/d11/fc2 [931312,6902] 0 2024-04-26T21:08:16.620 INFO:tasks.workunit.client.0.smithi055.stdout:9/647: link d2/d46/d77/d5f/l60 d2/d11/le2 0 2024-04-26T21:08:16.622 INFO:tasks.workunit.client.1.smithi064.stdout:4/873: write d0/d1d/f49 [2265910,17812] 0 2024-04-26T21:08:16.622 INFO:tasks.workunit.client.1.smithi064.stdout:0/781: mkdir dd/d21/df9/d104 0 2024-04-26T21:08:16.623 INFO:tasks.workunit.client.0.smithi055.stdout:1/577: dwrite d8/d17/d1b/f9f [0,4194304] 0 2024-04-26T21:08:16.623 INFO:tasks.workunit.client.0.smithi055.stdout:1/578: truncate d8/d17/d36/f4d 721689 0 2024-04-26T21:08:16.623 INFO:tasks.workunit.client.1.smithi064.stdout:6/796: read d4/f31 [83953,95698] 0 2024-04-26T21:08:16.623 INFO:tasks.workunit.client.1.smithi064.stdout:8/734: dwrite d10/d2f/d61/f88 [0,4194304] 0 2024-04-26T21:08:16.625 INFO:tasks.workunit.client.1.smithi064.stdout:0/782: write dd/f2a [4507054,81063] 0 2024-04-26T21:08:16.626 INFO:tasks.workunit.client.0.smithi055.stdout:7/573: sync 2024-04-26T21:08:16.627 INFO:tasks.workunit.client.0.smithi055.stdout:2/672: dread d4/d1e/d2a/f30 [0,4194304] 0 2024-04-26T21:08:16.627 INFO:tasks.workunit.client.0.smithi055.stdout:2/673: chown d4/d14/c1c 2 1 2024-04-26T21:08:16.627 INFO:tasks.workunit.client.0.smithi055.stdout:2/674: read - d4/d1e/d2a/fd6 zero size 2024-04-26T21:08:16.627 INFO:tasks.workunit.client.0.smithi055.stdout:9/648: link d2/d14/c64 d2/d46/d77/d7d/ce3 0 2024-04-26T21:08:16.627 INFO:tasks.workunit.client.0.smithi055.stdout:9/649: chown d2/f55 0 1 2024-04-26T21:08:16.629 INFO:tasks.workunit.client.1.smithi064.stdout:5/765: dread dd/d12/d18/d1a/d1f/d20/f2d [0,4194304] 0 2024-04-26T21:08:16.631 INFO:tasks.workunit.client.0.smithi055.stdout:4/521: write d4/d12/f3e [1849523,93221] 0 2024-04-26T21:08:16.632 INFO:tasks.workunit.client.0.smithi055.stdout:6/595: sync 2024-04-26T21:08:16.632 INFO:tasks.workunit.client.0.smithi055.stdout:0/609: sync 2024-04-26T21:08:16.632 INFO:tasks.workunit.client.0.smithi055.stdout:8/522: sync 2024-04-26T21:08:16.633 INFO:tasks.workunit.client.0.smithi055.stdout:3/682: sync 2024-04-26T21:08:16.636 INFO:tasks.workunit.client.1.smithi064.stdout:7/840: dwrite d6/d9/d3d/fe1 [0,4194304] 0 2024-04-26T21:08:16.642 INFO:tasks.workunit.client.0.smithi055.stdout:7/574: dread d5/db/f1e [0,4194304] 0 2024-04-26T21:08:16.645 INFO:tasks.workunit.client.1.smithi064.stdout:3/761: dwrite d1/f51 [0,4194304] 0 2024-04-26T21:08:16.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/579: unlink d8/df/c23 0 2024-04-26T21:08:16.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/580: creat d8/df/d11/d27/fc3 x:0 0 0 2024-04-26T21:08:16.646 INFO:tasks.workunit.client.0.smithi055.stdout:1/581: write d8/df/d11/d27/d28/d2a/f93 [813769,28887] 0 2024-04-26T21:08:16.646 INFO:tasks.workunit.client.0.smithi055.stdout:1/582: chown d8/d17/d33 115999751 1 2024-04-26T21:08:16.650 INFO:tasks.workunit.client.0.smithi055.stdout:5/511: dwrite d4/df/d13/d26/f8e [0,4194304] 0 2024-04-26T21:08:16.652 INFO:tasks.workunit.client.0.smithi055.stdout:2/675: unlink d4/db/d56/d4a/f53 0 2024-04-26T21:08:16.652 INFO:tasks.workunit.client.0.smithi055.stdout:9/650: mkdir d2/d14/db8/dc5/de4 0 2024-04-26T21:08:16.658 INFO:tasks.workunit.client.0.smithi055.stdout:3/683: write d0/d4/d5/d73/f3f [2794980,33016] 0 2024-04-26T21:08:16.661 INFO:tasks.workunit.client.0.smithi055.stdout:4/522: truncate d4/f9 366793 0 2024-04-26T21:08:16.661 INFO:tasks.workunit.client.0.smithi055.stdout:4/523: write d4/d26/d42/d28/f32 [784526,25416] 0 2024-04-26T21:08:16.662 INFO:tasks.workunit.client.1.smithi064.stdout:7/841: write d6/d9/d38/f42 [2597962,101837] 0 2024-04-26T21:08:16.662 INFO:tasks.workunit.client.1.smithi064.stdout:2/948: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/d13c/f142 x:0 0 0 2024-04-26T21:08:16.662 INFO:tasks.workunit.client.1.smithi064.stdout:7/842: read - d6/d5a/d5f/ff8 zero size 2024-04-26T21:08:16.662 INFO:tasks.workunit.client.1.smithi064.stdout:7/843: getdents d6/db/d34/d6f/dff 0 2024-04-26T21:08:16.663 INFO:tasks.workunit.client.0.smithi055.stdout:6/596: truncate d3/d17/d25/d5f/d90/f69 8140 0 2024-04-26T21:08:16.663 INFO:tasks.workunit.client.0.smithi055.stdout:6/597: creat d3/d17/d46/d54/d66/d6a/d51/d58/d73/fd7 x:0 0 0 2024-04-26T21:08:16.664 INFO:tasks.workunit.client.0.smithi055.stdout:0/610: mkdir d9/dc/d1c/d54/dc2 0 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.0.smithi055.stdout:0/611: write d9/dc/d1c/d54/db2/fbb [1983328,98265] 0 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.1.smithi064.stdout:4/874: rmdir d0/d5/d13/d6d/d97/df6 39 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.1.smithi064.stdout:4/875: readlink d0/d5/d13/d33/le8 0 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.1.smithi064.stdout:4/876: read - d0/d1d/d17/d44/f78 zero size 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.1.smithi064.stdout:4/877: chown d0/d1d/d17/d44/cc2 26924 1 2024-04-26T21:08:16.665 INFO:tasks.workunit.client.1.smithi064.stdout:4/878: write d0/d2f/d69/db5/fdc [218208,54] 0 2024-04-26T21:08:16.669 INFO:tasks.workunit.client.1.smithi064.stdout:6/797: link d4/d7/d12/d49/d4b/ff5 d4/f109 0 2024-04-26T21:08:16.672 INFO:tasks.workunit.client.0.smithi055.stdout:1/583: rename d8/d17/d1b/d41/lb8 to d8/df/d11/d27/d63/lc4 0 2024-04-26T21:08:16.679 INFO:tasks.workunit.client.1.smithi064.stdout:8/735: link d10/d1d/l37 d10/d2f/d61/le6 0 2024-04-26T21:08:16.682 INFO:tasks.workunit.client.0.smithi055.stdout:2/676: mkdir d4/dda 0 2024-04-26T21:08:16.682 INFO:tasks.workunit.client.0.smithi055.stdout:2/677: fsync d4/f89 0 2024-04-26T21:08:16.694 INFO:tasks.workunit.client.0.smithi055.stdout:3/684: unlink d0/d4/cd9 0 2024-04-26T21:08:16.695 INFO:tasks.workunit.client.1.smithi064.stdout:0/783: mknod dd/d21/dc8/d31/d47/dad/dfd/d18/d58/df2/c105 0 2024-04-26T21:08:16.700 INFO:tasks.workunit.client.1.smithi064.stdout:1/947: rmdir d0/d6/d29/d31/dd1 39 2024-04-26T21:08:16.707 INFO:tasks.workunit.client.0.smithi055.stdout:4/524: creat d4/d18/d8e/fb3 x:0 0 0 2024-04-26T21:08:16.707 INFO:tasks.workunit.client.0.smithi055.stdout:4/525: stat d4/d23/f3b 0 2024-04-26T21:08:16.717 INFO:tasks.workunit.client.0.smithi055.stdout:6/598: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/dd8 0 2024-04-26T21:08:16.720 INFO:tasks.workunit.client.1.smithi064.stdout:4/879: rename d0/d5/d13/d33/dd0/dd8/f120 to d0/d5/d13/d6d/f124 0 2024-04-26T21:08:16.724 INFO:tasks.workunit.client.1.smithi064.stdout:9/792: sync 2024-04-26T21:08:16.727 INFO:tasks.workunit.client.0.smithi055.stdout:2/678: symlink d4/d49/d4c/ldb 0 2024-04-26T21:08:16.729 INFO:tasks.workunit.client.0.smithi055.stdout:9/651: rmdir d2/d46/d9a/da7 39 2024-04-26T21:08:16.730 INFO:tasks.workunit.client.0.smithi055.stdout:9/652: read d2/d46/d77/d7d/da8/fab [5732889,56364] 0 2024-04-26T21:08:16.732 INFO:tasks.workunit.client.1.smithi064.stdout:0/784: dread dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/fc4 [0,4194304] 0 2024-04-26T21:08:16.737 INFO:tasks.workunit.client.1.smithi064.stdout:3/762: creat d1/d27/d29/f104 x:0 0 0 2024-04-26T21:08:16.739 INFO:tasks.workunit.client.0.smithi055.stdout:7/575: dread d5/d53/d6e/d99/d7f/d6f/f95 [0,4194304] 0 2024-04-26T21:08:16.740 INFO:tasks.workunit.client.1.smithi064.stdout:2/949: dwrite d12/d41/d73/d83/d94/f131 [0,4194304] 0 2024-04-26T21:08:16.740 INFO:tasks.workunit.client.1.smithi064.stdout:8/736: rename d10/d41/d4e/d60/c84 to d10/d41/d44/d5a/da2/ce7 0 2024-04-26T21:08:16.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/685: creat d0/d4/d5/db8/fee x:0 0 0 2024-04-26T21:08:16.742 INFO:tasks.workunit.client.0.smithi055.stdout:5/512: dread d4/d15/f52 [0,4194304] 0 2024-04-26T21:08:16.742 INFO:tasks.workunit.client.0.smithi055.stdout:5/513: write d4/df/d13/d26/d3c/d4a/d3f/d2e/d82/f84 [530985,64304] 0 2024-04-26T21:08:16.743 INFO:tasks.workunit.client.0.smithi055.stdout:8/523: dwrite d3/d9/fab [0,4194304] 0 2024-04-26T21:08:16.743 INFO:tasks.workunit.client.0.smithi055.stdout:6/599: getdents d3/d17/d46/d54/d66/d6a/d6b 0 2024-04-26T21:08:16.744 INFO:tasks.workunit.client.0.smithi055.stdout:0/612: write d9/dc/d1c/f26 [3878093,107681] 0 2024-04-26T21:08:16.745 INFO:tasks.workunit.client.0.smithi055.stdout:5/514: creat d4/df/d13/d26/d3c/d4a/fb3 x:0 0 0 2024-04-26T21:08:16.745 INFO:tasks.workunit.client.0.smithi055.stdout:5/515: truncate d4/df/d13/d26/f58 1194053 0 2024-04-26T21:08:16.747 INFO:tasks.workunit.client.1.smithi064.stdout:9/793: getdents d0/d4/d28/df3 0 2024-04-26T21:08:16.748 INFO:tasks.workunit.client.1.smithi064.stdout:1/948: symlink d0/d6/d91/d92/l128 0 2024-04-26T21:08:16.748 INFO:tasks.workunit.client.1.smithi064.stdout:1/949: chown d0/d6 12507251 1 2024-04-26T21:08:16.748 INFO:tasks.workunit.client.1.smithi064.stdout:6/798: dwrite d4/d7/d12/d49/d4b/d5a/daf/db2/f102 [0,4194304] 0 2024-04-26T21:08:16.749 INFO:tasks.workunit.client.1.smithi064.stdout:1/950: write d0/d6b/d9e/da2/dc9/fe6 [1727270,43463] 0 2024-04-26T21:08:16.749 INFO:tasks.workunit.client.1.smithi064.stdout:6/799: dread - d4/d7/d12/d49/d4b/d5a/d79/fef zero size 2024-04-26T21:08:16.749 INFO:tasks.workunit.client.1.smithi064.stdout:1/951: dread - d0/d6/d11/d1e/d2a/ff2 zero size 2024-04-26T21:08:16.749 INFO:tasks.workunit.client.1.smithi064.stdout:0/785: creat dd/d21/dc8/d31/d43/db4/dc2/f106 x:0 0 0 2024-04-26T21:08:16.750 INFO:tasks.workunit.client.1.smithi064.stdout:7/844: dwrite d6/db/f2a [4194304,4194304] 0 2024-04-26T21:08:16.750 INFO:tasks.workunit.client.1.smithi064.stdout:7/845: creat d6/d15/d88/d113/f11f x:0 0 0 2024-04-26T21:08:16.751 INFO:tasks.workunit.client.0.smithi055.stdout:2/679: truncate d4/db/d56/f70 427523 0 2024-04-26T21:08:16.755 INFO:tasks.workunit.client.0.smithi055.stdout:9/653: unlink d2/d46/d51/c8e 0 2024-04-26T21:08:16.755 INFO:tasks.workunit.client.0.smithi055.stdout:9/654: write d2/d14/fcb [187200,29717] 0 2024-04-26T21:08:16.755 INFO:tasks.workunit.client.0.smithi055.stdout:9/655: fdatasync d2/d46/f50 0 2024-04-26T21:08:16.759 INFO:tasks.workunit.client.0.smithi055.stdout:3/686: mkdir d0/d4/d5/d73/d13/d1a/def 0 2024-04-26T21:08:16.759 INFO:tasks.workunit.client.0.smithi055.stdout:3/687: write d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad [955289,28110] 0 2024-04-26T21:08:16.760 INFO:tasks.workunit.client.0.smithi055.stdout:3/688: chown d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 152 1 2024-04-26T21:08:16.769 INFO:tasks.workunit.client.0.smithi055.stdout:8/524: dread d3/d9/d1d/d48/d4b/f6b [0,4194304] 0 2024-04-26T21:08:16.769 INFO:tasks.workunit.client.1.smithi064.stdout:8/737: creat d10/d41/d44/d5a/da2/fe8 x:0 0 0 2024-04-26T21:08:16.769 INFO:tasks.workunit.client.1.smithi064.stdout:8/738: stat d10/d41/d4e/d54/db3 0 2024-04-26T21:08:16.771 INFO:tasks.workunit.client.1.smithi064.stdout:4/880: getdents d0/d1d/d21/d9c 0 2024-04-26T21:08:16.771 INFO:tasks.workunit.client.1.smithi064.stdout:6/800: dread d4/d7/d12/dbc/fca [0,4194304] 0 2024-04-26T21:08:16.773 INFO:tasks.workunit.client.1.smithi064.stdout:5/766: dwrite dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:16.773 INFO:tasks.workunit.client.0.smithi055.stdout:6/600: rmdir d3/d9b 39 2024-04-26T21:08:16.777 INFO:tasks.workunit.client.0.smithi055.stdout:7/576: dread d5/d6/d24/f4b [0,4194304] 0 2024-04-26T21:08:16.777 INFO:tasks.workunit.client.0.smithi055.stdout:7/577: truncate d5/d6/ff 1629578 0 2024-04-26T21:08:16.777 INFO:tasks.workunit.client.0.smithi055.stdout:7/578: stat d5/db/f7e 0 2024-04-26T21:08:16.777 INFO:tasks.workunit.client.1.smithi064.stdout:9/794: symlink d0/d4/da/d26/d5e/dd8/l104 0 2024-04-26T21:08:16.785 INFO:tasks.workunit.client.0.smithi055.stdout:0/613: dread d9/d11/d5b/d74/f2e [0,4194304] 0 2024-04-26T21:08:16.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/881: dread d0/d5/d13/d6d/f4b [0,4194304] 0 2024-04-26T21:08:16.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/882: chown d0/d5/d13/d6d/f4b 0 1 2024-04-26T21:08:16.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/883: creat d0/d5/d13/d10/db7/f125 x:0 0 0 2024-04-26T21:08:16.788 INFO:tasks.workunit.client.1.smithi064.stdout:4/884: stat d0/d5/d79/da1/l104 0 2024-04-26T21:08:16.792 INFO:tasks.workunit.client.1.smithi064.stdout:0/786: dwrite dd/d21/dc8/d31/d47/dad/dfd/d18/d58/dba/fd4 [0,4194304] 0 2024-04-26T21:08:16.792 INFO:tasks.workunit.client.1.smithi064.stdout:0/787: truncate dd/d21/dc8/d31/d47/dad/dfd/d18/d58/fde 68429 0 2024-04-26T21:08:16.793 INFO:tasks.workunit.client.1.smithi064.stdout:0/788: chown dd/d21/l28 11654641 1 2024-04-26T21:08:16.793 INFO:tasks.workunit.client.1.smithi064.stdout:0/789: chown dd/d21/dc8/d31/d47/d61/d42 0 1 2024-04-26T21:08:16.793 INFO:tasks.workunit.client.1.smithi064.stdout:0/790: truncate dd/fdc 473404 0 2024-04-26T21:08:16.805 INFO:tasks.workunit.client.0.smithi055.stdout:5/516: mkdir d4/d15/db4 0 2024-04-26T21:08:16.806 INFO:tasks.workunit.client.1.smithi064.stdout:1/952: truncate d0/d6/d11/d1e/d2a/d34/fd8 3750545 0 2024-04-26T21:08:16.809 INFO:tasks.workunit.client.0.smithi055.stdout:1/584: rename d8/d17/d36 to d8/d17/d33/dc5 0 2024-04-26T21:08:16.813 INFO:tasks.workunit.client.0.smithi055.stdout:9/656: creat d2/d14/d97/fe5 x:0 0 0 2024-04-26T21:08:16.818 INFO:tasks.workunit.client.1.smithi064.stdout:5/767: dwrite dd/d12/d18/d25/d67/f85 [0,4194304] 0 2024-04-26T21:08:16.819 INFO:tasks.workunit.client.0.smithi055.stdout:3/689: link d0/d4/d5/d73/d47/d37/da6/fc0 d0/d4/d5/d73/d13/d27/d3b/ff0 0 2024-04-26T21:08:16.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/846: symlink d6/d70/d74/d99/l120 0 2024-04-26T21:08:16.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/847: write d6/db/d1f/ff6 [1687525,21126] 0 2024-04-26T21:08:16.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/848: chown d6/db/d34/d6f 9468492 1 2024-04-26T21:08:16.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/849: read d6/db/d1f/fdf [349051,1111] 0 2024-04-26T21:08:16.820 INFO:tasks.workunit.client.1.smithi064.stdout:7/850: fdatasync d6/db/d8e/d90/fc3 0 2024-04-26T21:08:16.821 INFO:tasks.workunit.client.1.smithi064.stdout:7/851: write d6/d70/da8/fb2 [3782665,88872] 0 2024-04-26T21:08:16.827 INFO:tasks.workunit.client.1.smithi064.stdout:3/763: rmdir d1/d27/d29/d6f/d72/d7a 39 2024-04-26T21:08:16.829 INFO:tasks.workunit.client.1.smithi064.stdout:2/950: getdents d12/d41/d73/d83/d94/d3a/d46/d48/d120/d12f 0 2024-04-26T21:08:16.829 INFO:tasks.workunit.client.1.smithi064.stdout:2/951: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/f123 [882147,8918] 0 2024-04-26T21:08:16.831 INFO:tasks.workunit.client.1.smithi064.stdout:8/739: stat d10/d1d/l37 0 2024-04-26T21:08:16.834 INFO:tasks.workunit.client.1.smithi064.stdout:6/801: unlink d4/d7/d12/d1e/f39 0 2024-04-26T21:08:16.835 INFO:tasks.workunit.client.0.smithi055.stdout:6/601: symlink d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86/ld9 0 2024-04-26T21:08:16.836 INFO:tasks.workunit.client.0.smithi055.stdout:6/602: dread - d3/d17/d25/d5f/d90/fb0 zero size 2024-04-26T21:08:16.836 INFO:tasks.workunit.client.1.smithi064.stdout:2/952: dread d12/d41/d73/d83/d94/d3a/d46/d91/fca [0,4194304] 0 2024-04-26T21:08:16.840 INFO:tasks.workunit.client.1.smithi064.stdout:9/795: rename d0/d4/da/d26/d5d/fa5 to d0/d4/da/d67/dd0/dd2/f105 0 2024-04-26T21:08:16.842 INFO:tasks.workunit.client.0.smithi055.stdout:7/579: rename d5/db/l72 to d5/db/la3 0 2024-04-26T21:08:16.844 INFO:tasks.workunit.client.1.smithi064.stdout:7/852: write d6/db/d34/f5b [5377112,56024] 0 2024-04-26T21:08:16.844 INFO:tasks.workunit.client.1.smithi064.stdout:7/853: write d6/d15/f110 [618270,5764] 0 2024-04-26T21:08:16.849 INFO:tasks.workunit.client.0.smithi055.stdout:4/526: rename d4/d12/f3e to d4/d26/d42/d28/d53/d71/fb4 0 2024-04-26T21:08:16.850 INFO:tasks.workunit.client.0.smithi055.stdout:0/614: rename d9/dc/d1c/d3e/d7d/da3/d97 to d9/dc/d1c/d3e/d7d/da3/d97/db6/dc3 22 2024-04-26T21:08:16.852 INFO:tasks.workunit.client.0.smithi055.stdout:9/657: rmdir d2/d14/d97/d9b 39 2024-04-26T21:08:16.857 INFO:tasks.workunit.client.0.smithi055.stdout:3/690: truncate d0/d4/d5/d73/f3f 2926809 0 2024-04-26T21:08:16.857 INFO:tasks.workunit.client.1.smithi064.stdout:3/764: dread d1/d27/d29/d6f/d72/f40 [0,4194304] 0 2024-04-26T21:08:16.860 INFO:tasks.workunit.client.1.smithi064.stdout:2/953: read d12/d41/d73/d83/d94/d3a/d46/f80 [2030835,19624] 0 2024-04-26T21:08:16.860 INFO:tasks.workunit.client.1.smithi064.stdout:2/954: write d12/d41/d73/d83/d94/d3a/d46/dee/f128 [232868,72946] 0 2024-04-26T21:08:16.860 INFO:tasks.workunit.client.1.smithi064.stdout:2/955: truncate d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/f141 302899 0 2024-04-26T21:08:16.860 INFO:tasks.workunit.client.0.smithi055.stdout:8/525: symlink d3/lb7 0 2024-04-26T21:08:16.865 INFO:tasks.workunit.client.1.smithi064.stdout:1/953: mknod d0/d6/d11/c129 0 2024-04-26T21:08:16.867 INFO:tasks.workunit.client.0.smithi055.stdout:7/580: symlink d5/d6/d24/d3b/la4 0 2024-04-26T21:08:16.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/527: symlink d4/d26/d42/d28/d53/lb5 0 2024-04-26T21:08:16.868 INFO:tasks.workunit.client.0.smithi055.stdout:0/615: mknod d9/dc/cc4 0 2024-04-26T21:08:16.868 INFO:tasks.workunit.client.0.smithi055.stdout:0/616: write d9/dc/d1c/d3e/f47 [2675162,96559] 0 2024-04-26T21:08:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.873+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f310002ce50 con 0x7f30e806eac0 2024-04-26T21:08:16.877 INFO:tasks.workunit.client.0.smithi055.stdout:9/658: truncate d2/d14/f4f 7803280 0 2024-04-26T21:08:16.878 INFO:tasks.workunit.client.0.smithi055.stdout:3/691: read d0/d4/d5/d73/d13/d1a/d46/d72/d69/fbb [4124018,15556] 0 2024-04-26T21:08:16.884 INFO:tasks.workunit.client.0.smithi055.stdout:4/528: creat d4/d26/d42/d28/d53/d71/d7f/da1/fb6 x:0 0 0 2024-04-26T21:08:16.884 INFO:tasks.workunit.client.0.smithi055.stdout:8/526: write d3/d9/f3b [4182631,64634] 0 2024-04-26T21:08:16.885 INFO:tasks.workunit.client.0.smithi055.stdout:0/617: write d9/d11/d59/f7f [530398,14575] 0 2024-04-26T21:08:16.893 INFO:tasks.workunit.client.1.smithi064.stdout:8/740: mknod d10/d41/d53/ce9 0 2024-04-26T21:08:16.894 INFO:tasks.workunit.client.0.smithi055.stdout:5/517: dwrite d4/df/d13/d26/d3c/d4a/d3f/da1/fad [0,4194304] 0 2024-04-26T21:08:16.895 INFO:tasks.workunit.client.0.smithi055.stdout:3/692: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/ff1 x:0 0 0 2024-04-26T21:08:16.896 INFO:tasks.workunit.client.1.smithi064.stdout:6/802: creat d4/d7/d12/d49/d4b/d56/f10a x:0 0 0 2024-04-26T21:08:16.896 INFO:tasks.workunit.client.1.smithi064.stdout:6/803: truncate d4/d7/fd7 956869 0 2024-04-26T21:08:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.897+0000 7f30fd600700 1 -- 172.21.15.55:0/1784612835 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f310002ce50 con 0x7f30e806eac0 2024-04-26T21:08:16.900 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:08:16.900 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (9m) 10s ago 11m 13.6M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:08:16.900 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (12m) 10s ago 12m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:08:16.900 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (10m) 65s ago 10m 7688k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (12m) 10s ago 12m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (10m) 65s ago 10m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (9m) 10s ago 11m 76.1M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (4m) 10s ago 4m 181M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (4m) 10s ago 4m 13.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (4m) 65s ago 4m 66.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (4m) 65s ago 3m 13.4M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (36s) 10s ago 13m 62.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (90s) 65s ago 10m 491M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a10bf33fff03 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (13m) 10s ago 13m 51.5M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (10m) 65s ago 10m 39.0M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (11m) 10s ago 11m 8158k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (10m) 65s ago 10m 8078k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:08:16.901 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (9m) 10s ago 9m 124M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (8m) 10s ago 8m 138M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (7m) 10s ago 7m 116M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (7m) 65s ago 7m 105M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (6m) 65s ago 6m 98.9M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (6m) 65s ago 6m 94.1M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:08:16.902 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (46s) 10s ago 11m 36.3M - 2.43.0 a07b618ecd1d a6982e8442fa 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 msgr2=0x7f30e8070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 0x7f30e8070f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006010 tx=0x7f30ec009f70 comp rx=0 tx=0).stop 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 msgr2=0x7f3100071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e920 tx=0x7f30f400ec30 comp rx=0 tx=0).stop 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 shutdown_connections 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f30e806eac0 0x7f30e8070f80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31000ff550 0x7f3100071f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 --2- 172.21.15.55:0/1784612835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31000ffeb0 0x7f31000724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.900+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 >> 172.21.15.55:0/1784612835 conn(0x7f31000fb110 msgr2=0x7f3100107fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.901+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 shutdown_connections 2024-04-26T21:08:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:16.901+0000 7f3107800700 1 -- 172.21.15.55:0/1784612835 wait complete. 2024-04-26T21:08:16.905 INFO:tasks.workunit.client.1.smithi064.stdout:5/768: rename dd/da9/c60 to dd/da9/d48/de3/cf5 0 2024-04-26T21:08:16.909 INFO:tasks.workunit.client.0.smithi055.stdout:4/529: creat d4/d26/d42/d28/d53/d71/fb7 x:0 0 0 2024-04-26T21:08:16.909 INFO:tasks.workunit.client.0.smithi055.stdout:4/530: readlink d4/l64 0 2024-04-26T21:08:16.909 INFO:tasks.workunit.client.0.smithi055.stdout:0/618: mkdir d9/dc/d1c/d3e/dc5 0 2024-04-26T21:08:16.911 INFO:tasks.workunit.client.1.smithi064.stdout:9/796: creat d0/d4/d28/dff/d103/f106 x:0 0 0 2024-04-26T21:08:16.912 INFO:tasks.workunit.client.0.smithi055.stdout:0/619: dread d9/dc/d1c/f4f [0,4194304] 0 2024-04-26T21:08:16.915 INFO:tasks.workunit.client.0.smithi055.stdout:0/620: write d9/dc/d1c/f9f [9514005,46725] 0 2024-04-26T21:08:16.916 INFO:tasks.workunit.client.0.smithi055.stdout:0/621: write d9/dc/d17/d9a/fad [754006,106807] 0 2024-04-26T21:08:16.917 INFO:tasks.workunit.client.1.smithi064.stdout:4/885: getdents d0/d5/d13/d33/dd0/dd8 0 2024-04-26T21:08:16.918 INFO:tasks.workunit.client.1.smithi064.stdout:8/741: write d10/d41/fe0 [3059861,73945] 0 2024-04-26T21:08:16.918 INFO:tasks.workunit.client.1.smithi064.stdout:8/742: readlink d10/d41/d4e/d54/lb4 0 2024-04-26T21:08:16.918 INFO:tasks.workunit.client.1.smithi064.stdout:8/743: write f4 [6068023,31310] 0 2024-04-26T21:08:16.921 INFO:tasks.workunit.client.1.smithi064.stdout:3/765: mkdir d1/d27/d29/d6f/d72/d95/d105 0 2024-04-26T21:08:16.921 INFO:tasks.workunit.client.0.smithi055.stdout:7/581: dwrite d5/d53/d6e/d99/d7f/f98 [0,4194304] 0 2024-04-26T21:08:16.925 INFO:tasks.workunit.client.0.smithi055.stdout:5/518: symlink d4/df/d13/d26/d63/lb5 0 2024-04-26T21:08:16.926 INFO:tasks.workunit.client.1.smithi064.stdout:2/956: creat d12/d45/d121/f143 x:0 0 0 2024-04-26T21:08:16.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/693: symlink d0/d4/d16/lf2 0 2024-04-26T21:08:16.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/694: creat d0/d4/d5/d73/d47/dcf/ff3 x:0 0 0 2024-04-26T21:08:16.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/695: chown d0/d4/d5/lcb 65283 1 2024-04-26T21:08:16.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/696: read d0/d4/d5/d73/f2e [308225,104472] 0 2024-04-26T21:08:16.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/697: chown d0/d4/d16/d18/d4b/d57/c8c 0 1 2024-04-26T21:08:16.930 INFO:tasks.workunit.client.1.smithi064.stdout:1/954: mknod d0/d6/d11/d1e/d2a/c12a 0 2024-04-26T21:08:16.933 INFO:tasks.workunit.client.0.smithi055.stdout:0/622: creat d9/dc/d1c/d54/d4b/fc6 x:0 0 0 2024-04-26T21:08:16.933 INFO:tasks.workunit.client.0.smithi055.stdout:0/623: truncate d9/dc/d1c/d3e/d7d/da3/d97/db6/d67/fa9 1047844 0 2024-04-26T21:08:16.933 INFO:tasks.workunit.client.0.smithi055.stdout:0/624: write d9/dc/d1c/d54/d4b/fc6 [472362,110892] 0 2024-04-26T21:08:16.933 INFO:tasks.workunit.client.0.smithi055.stdout:0/625: read d9/dc/d1c/d3e/d7d/da3/d97/db6/d6c/d7a/f9b [491728,75763] 0 2024-04-26T21:08:16.938 INFO:tasks.workunit.client.0.smithi055.stdout:9/659: dwrite d2/d11/fa5 [0,4194304] 0 2024-04-26T21:08:16.941 INFO:tasks.workunit.client.0.smithi055.stdout:7/582: mkdir d5/d53/d6e/d99/d7f/d6f/da5 0 2024-04-26T21:08:16.946 INFO:tasks.workunit.client.0.smithi055.stdout:6/603: dwrite d3/d17/faa [0,4194304] 0 2024-04-26T21:08:16.948 INFO:tasks.workunit.client.1.smithi064.stdout:3/766: dread d1/d27/d50/f52 [0,4194304] 0 2024-04-26T21:08:16.948 INFO:tasks.workunit.client.0.smithi055.stdout:4/531: write d4/d18/f55 [1046306,23919] 0 2024-04-26T21:08:16.948 INFO:tasks.workunit.client.0.smithi055.stdout:4/532: readlink d4/d12/d15/lb0 0 2024-04-26T21:08:16.948 INFO:tasks.workunit.client.0.smithi055.stdout:4/533: write d4/d18/d1a/f37 [1917058,126434] 0 2024-04-26T21:08:16.949 INFO:tasks.workunit.client.1.smithi064.stdout:3/767: chown d1/d27/d50/d35/la8 1877 1 2024-04-26T21:08:16.949 INFO:tasks.workunit.client.0.smithi055.stdout:3/698: creat d0/d4/d16/d18/d4b/d57/ff4 x:0 0 0 2024-04-26T21:08:16.952 INFO:tasks.workunit.client.0.smithi055.stdout:0/626: creat d9/dc/d1c/d54/db2/fc7 x:0 0 0 2024-04-26T21:08:16.953 INFO:tasks.workunit.client.0.smithi055.stdout:0/627: creat d9/fc8 x:0 0 0 2024-04-26T21:08:16.956 INFO:tasks.workunit.client.1.smithi064.stdout:6/804: symlink d4/d7/d12/d49/d4b/d5a/d8f/l10b 0 2024-04-26T21:08:16.959 INFO:tasks.workunit.client.0.smithi055.stdout:9/660: mknod d2/d14/ce6 0 2024-04-26T21:08:16.963 INFO:tasks.workunit.client.0.smithi055.stdout:7/583: creat d5/d6/d39/fa6 x:0 0 0 2024-04-26T21:08:16.965 INFO:tasks.workunit.client.0.smithi055.stdout:8/527: dwrite d3/d9/d1d/f53 [0,4194304] 0 2024-04-26T21:08:16.965 INFO:tasks.workunit.client.0.smithi055.stdout:8/528: write d3/d9/f24 [3357180,96971] 0 2024-04-26T21:08:16.966 INFO:tasks.workunit.client.1.smithi064.stdout:5/769: truncate dd/d12/d18/d1a/d1f/f7b 368690 0 2024-04-26T21:08:16.967 INFO:tasks.workunit.client.1.smithi064.stdout:5/770: readlink dd/d12/lba 0 2024-04-26T21:08:16.967 INFO:tasks.workunit.client.1.smithi064.stdout:9/797: mknod d0/d4/c107 0 2024-04-26T21:08:16.972 INFO:tasks.workunit.client.1.smithi064.stdout:7/854: rmdir d6/d70/da8 39 2024-04-26T21:08:16.973 INFO:tasks.workunit.client.1.smithi064.stdout:7/855: dread - d6/d15/d88/dca/d5c/fe3 zero size 2024-04-26T21:08:16.973 INFO:tasks.workunit.client.0.smithi055.stdout:4/534: mknod d4/d26/cb8 0 2024-04-26T21:08:16.973 INFO:tasks.workunit.client.0.smithi055.stdout:4/535: chown d4/d12/d17/c2e 115612351 1 2024-04-26T21:08:16.975 INFO:tasks.workunit.client.1.smithi064.stdout:0/791: sync 2024-04-26T21:08:16.977 INFO:tasks.workunit.client.1.smithi064.stdout:4/886: rename d0/d5/d13/d10/db7/lcc to d0/d1d/d17/d44/dac/d54/l126 0 2024-04-26T21:08:16.979 INFO:tasks.workunit.client.0.smithi055.stdout:3/699: creat d0/d4/d16/d18/d4b/d57/d8e/ff5 x:0 0 0 2024-04-26T21:08:16.979 INFO:tasks.workunit.client.0.smithi055.stdout:3/700: fdatasync d0/d4/d5/d73/d13/d1a/d46/d72/fd1 0 2024-04-26T21:08:16.979 INFO:tasks.workunit.client.0.smithi055.stdout:3/701: dread - d0/d4/d5/d73/d13/d1a/d46/d72/dd5/fe1 zero size 2024-04-26T21:08:16.980 INFO:tasks.workunit.client.0.smithi055.stdout:0/628: write d9/dc/f10 [1740325,7286] 0 2024-04-26T21:08:16.985 INFO:tasks.workunit.client.1.smithi064.stdout:2/957: creat d12/d41/d61/dd5/f144 x:0 0 0 2024-04-26T21:08:16.985 INFO:tasks.workunit.client.1.smithi064.stdout:2/958: dread - d12/d41/d73/d83/d94/d3a/d46/d48/d120/d12f/f140 zero size 2024-04-26T21:08:16.995 INFO:tasks.workunit.client.1.smithi064.stdout:3/768: dwrite d1/d27/d29/d5e/f6d [0,4194304] 0 2024-04-26T21:08:16.995 INFO:tasks.workunit.client.1.smithi064.stdout:3/769: creat d1/d27/d29/d5e/f106 x:0 0 0 2024-04-26T21:08:17.001 INFO:tasks.workunit.client.1.smithi064.stdout:9/798: mknod d0/d4/da/da3/c108 0 2024-04-26T21:08:17.003 INFO:tasks.workunit.client.1.smithi064.stdout:1/955: dread d0/d22/d87/fb4 [0,4194304] 0 2024-04-26T21:08:17.007 INFO:tasks.workunit.client.0.smithi055.stdout:7/584: mkdir d5/d6/d24/d4d/da7 0 2024-04-26T21:08:17.014 INFO:tasks.workunit.client.1.smithi064.stdout:0/792: unlink dd/d21/dc8/d31/d47/dad/dfd/d74/fe0 0 2024-04-26T21:08:17.014 INFO:tasks.workunit.client.1.smithi064.stdout:0/793: dread - dd/fac zero size 2024-04-26T21:08:17.015 INFO:tasks.workunit.client.1.smithi064.stdout:6/805: dwrite d4/d7/d12/d49/d4b/d56/d95/fcc [0,4194304] 0 2024-04-26T21:08:17.015 INFO:tasks.workunit.client.0.smithi055.stdout:9/661: write d2/f5a [2442598,9265] 0 2024-04-26T21:08:17.021 INFO:tasks.workunit.client.0.smithi055.stdout:6/604: dwrite f0 [0,4194304] 0 2024-04-26T21:08:17.031 INFO:tasks.workunit.client.1.smithi064.stdout:4/887: symlink d0/d5/d79/dd1/da0/l127 0 2024-04-26T21:08:17.031 INFO:tasks.workunit.client.1.smithi064.stdout:5/771: rename dd/da9/c34 to dd/da9/d48/d6a/cf6 0 2024-04-26T21:08:17.033 INFO:tasks.workunit.client.1.smithi064.stdout:8/744: getdents d10/d2f/d56 0 2024-04-26T21:08:17.033 INFO:tasks.workunit.client.1.smithi064.stdout:9/799: write d0/d4/d28/f2d [31287,3236] 0 2024-04-26T21:08:17.033 INFO:tasks.workunit.client.1.smithi064.stdout:8/745: chown d10/d41/d4e/d59/d83/lde 734799463 1 2024-04-26T21:08:17.033 INFO:tasks.workunit.client.1.smithi064.stdout:9/800: dread - d0/d4/da/d26/d45/d90/fb2 zero size 2024-04-26T21:08:17.033 INFO:tasks.workunit.client.1.smithi064.stdout:9/801: truncate d0/d4/da/d26/d5e/fa7 711030 0 2024-04-26T21:08:17.034 INFO:tasks.workunit.client.1.smithi064.stdout:2/959: link d12/d45/f56 d12/d41/d73/d83/d94/d3a/d46/d6a/d86/f145 0 2024-04-26T21:08:17.034 INFO:tasks.workunit.client.1.smithi064.stdout:2/960: chown d12/d41/d61/d75/lc7 4 1 2024-04-26T21:08:17.042 INFO:tasks.workunit.client.1.smithi064.stdout:7/856: rmdir d6/d9/d38 39 2024-04-26T21:08:17.042 INFO:tasks.workunit.client.1.smithi064.stdout:7/857: read d6/d9/f76 [1935187,56111] 0 2024-04-26T21:08:17.048 INFO:tasks.workunit.client.0.smithi055.stdout:4/536: mkdir d4/d26/d42/d28/db9 0 2024-04-26T21:08:17.056 INFO:tasks.workunit.client.0.smithi055.stdout:3/702: mkdir d0/d4/df6 0 2024-04-26T21:08:17.059 INFO:tasks.workunit.client.1.smithi064.stdout:3/770: dread d1/d14/f6a [0,4194304] 0 2024-04-26T21:08:17.061 INFO:tasks.workunit.client.1.smithi064.stdout:4/888: getdents d0/d5/d79/dd1/da0/d114 0 2024-04-26T21:08:17.068 INFO:tasks.workunit.client.0.smithi055.stdout:7/585: mkdir d5/d53/d6e/d99/d7f/d6f/da8 0 2024-04-26T21:08:17.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/802: symlink d0/d4/da/l109 0 2024-04-26T21:08:17.074 INFO:tasks.workunit.client.0.smithi055.stdout:9/662: creat d2/d46/d51/fe7 x:0 0 0 2024-04-26T21:08:17.074 INFO:tasks.workunit.client.0.smithi055.stdout:9/663: write d2/d11/f6e [768282,94464] 0 2024-04-26T21:08:17.075 INFO:tasks.workunit.client.0.smithi055.stdout:9/664: chown d2/l3d 41 1 2024-04-26T21:08:17.078 INFO:tasks.workunit.client.1.smithi064.stdout:6/806: dwrite d4/d7/d33/f50 [0,4194304] 0 2024-04-26T21:08:17.079 INFO:tasks.workunit.client.1.smithi064.stdout:2/961: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/d146 0 2024-04-26T21:08:17.079 INFO:tasks.workunit.client.1.smithi064.stdout:3/771: dread d1/d27/d29/d6f/d72/d26/f58 [0,4194304] 0 2024-04-26T21:08:17.080 INFO:tasks.workunit.client.1.smithi064.stdout:3/772: creat d1/d27/d50/d35/d4c/d7b/d8e/f107 x:0 0 0 2024-04-26T21:08:17.080 INFO:tasks.workunit.client.1.smithi064.stdout:3/773: chown d1/d27/d50/d35/d4c/d7b/d8e/ff7 348337155 1 2024-04-26T21:08:17.080 INFO:tasks.workunit.client.0.smithi055.stdout:6/605: mknod d3/d17/d19/cda 0 2024-04-26T21:08:17.083 INFO:tasks.workunit.client.0.smithi055.stdout:0/629: dread d9/f64 [0,4194304] 0 2024-04-26T21:08:17.083 INFO:tasks.workunit.client.0.smithi055.stdout:0/630: stat d9/dc/d1c/d3e 0 2024-04-26T21:08:17.086 INFO:tasks.workunit.client.0.smithi055.stdout:7/586: dread d5/d53/d6e/f64 [0,4194304] 0 2024-04-26T21:08:17.089 INFO:tasks.workunit.client.1.smithi064.stdout:7/858: mkdir d6/d15/d67/d4d/d121 0 2024-04-26T21:08:17.089 INFO:tasks.workunit.client.1.smithi064.stdout:7/859: write d6/d9/d3d/f6e [3961256,51030] 0 2024-04-26T21:08:17.089 INFO:tasks.workunit.client.1.smithi064.stdout:7/860: stat d6/d70/d74/d99/l120 0 2024-04-26T21:08:17.106 INFO:tasks.workunit.client.0.smithi055.stdout:8/529: rmdir d3/d9 39 2024-04-26T21:08:17.108 INFO:tasks.workunit.client.1.smithi064.stdout:0/794: getdents dd/d21/dc8/d31/d43/db4/dc2 0 2024-04-26T21:08:17.108 INFO:tasks.workunit.client.1.smithi064.stdout:0/795: stat dd/d21/dc8/d31/f41 0 2024-04-26T21:08:17.112 INFO:tasks.workunit.client.1.smithi064.stdout:3/774: read d1/d27/d29/d6f/d72/da5/d7d/fad [6323062,92791] 0 2024-04-26T21:08:17.113 INFO:tasks.workunit.client.1.smithi064.stdout:8/746: dwrite d10/d41/d44/d5a/f62 [0,4194304] 0 2024-04-26T21:08:17.118 INFO:tasks.workunit.client.0.smithi055.stdout:4/537: symlink d4/d12/lba 0 2024-04-26T21:08:17.121 INFO:tasks.workunit.client.1.smithi064.stdout:4/889: symlink d0/d5/d13/d6d/dd3/l128 0 2024-04-26T21:08:17.124 INFO:tasks.workunit.client.0.smithi055.stdout:3/703: mkdir d0/d4/d5/d73/d47/d37/d3d/df7 0 2024-04-26T21:08:17.124 INFO:tasks.workunit.client.0.smithi055.stdout:3/704: chown d0/f22 22 1 2024-04-26T21:08:17.126 INFO:tasks.workunit.client.1.smithi064.stdout:3/775: write d1/d27/d50/d35/fd4 [1812352,124367] 0 2024-04-26T21:08:17.126 INFO:tasks.workunit.client.1.smithi064.stdout:9/803: mkdir d0/d4/da/d26/d45/d90/d10a 0 2024-04-26T21:08:17.128 INFO:tasks.workunit.client.1.smithi064.stdout:3/776: read d1/d27/d29/d6f/d72/d73/fca [331614,36102] 0 2024-04-26T21:08:17.134 INFO:tasks.workunit.client.1.smithi064.stdout:6/807: creat d4/d7/d12/d49/d4b/d5a/daf/f10c x:0 0 0 2024-04-26T21:08:17.135 INFO:tasks.workunit.client.0.smithi055.stdout:9/665: symlink d2/d46/d77/d7d/da8/le8 0 2024-04-26T21:08:17.136 INFO:tasks.workunit.client.0.smithi055.stdout:9/666: creat d2/d46/d51/fe9 x:0 0 0 2024-04-26T21:08:17.138 INFO:tasks.workunit.client.1.smithi064.stdout:2/962: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d11b/d147 0 2024-04-26T21:08:17.139 INFO:tasks.workunit.client.1.smithi064.stdout:1/956: dwrite d0/d6b/fa8 [0,4194304] 0 2024-04-26T21:08:17.144 INFO:tasks.workunit.client.1.smithi064.stdout:7/861: mknod d6/db/d1f/c122 0 2024-04-26T21:08:17.144 INFO:tasks.workunit.client.1.smithi064.stdout:7/862: stat d6/db/d1f/ff6 0 2024-04-26T21:08:17.146 INFO:tasks.workunit.client.0.smithi055.stdout:7/587: symlink d5/d53/d6e/la9 0 2024-04-26T21:08:17.147 INFO:tasks.workunit.client.0.smithi055.stdout:6/606: dread d3/f64 [0,4194304] 0 2024-04-26T21:08:17.150 INFO:tasks.workunit.client.1.smithi064.stdout:8/747: rmdir d10/d41/d4e/d54/dc3 39 2024-04-26T21:08:17.151 INFO:tasks.workunit.client.1.smithi064.stdout:0/796: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fa8 [0,4194304] 0 2024-04-26T21:08:17.151 INFO:tasks.workunit.client.0.smithi055.stdout:0/631: dwrite d9/fc8 [0,4194304] 0 2024-04-26T21:08:17.152 INFO:tasks.workunit.client.0.smithi055.stdout:4/538: dread d4/d12/d17/fa8 [0,4194304] 0 2024-04-26T21:08:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:16 smithi064 ceph-mon[33404]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:16 smithi064 ceph-mon[33404]: pgmap v41: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 146 MiB/s rd, 191 MiB/s wr, 273 op/s 2024-04-26T21:08:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:16 smithi064 ceph-mon[33404]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:17.159 INFO:tasks.workunit.client.1.smithi064.stdout:4/890: creat d0/d2f/d7d/f129 x:0 0 0 2024-04-26T21:08:17.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:16 smithi055 ceph-mon[25475]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:17.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:16 smithi055 ceph-mon[25475]: pgmap v41: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 146 MiB/s rd, 191 MiB/s wr, 273 op/s 2024-04-26T21:08:17.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:16 smithi055 ceph-mon[25475]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.155+0000 7f5cf8400700 1 -- 172.21.15.55:0/747899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 msgr2=0x7f5cf010c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.155+0000 7f5cf8400700 1 --2- 172.21.15.55:0/747899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf010c8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009910 tx=0x7f5cdc009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.156+0000 7f5cf8400700 1 -- 172.21.15.55:0/747899 shutdown_connections 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.156+0000 7f5cf8400700 1 --2- 172.21.15.55:0/747899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf010c8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.157+0000 7f5cf8400700 1 --2- 172.21.15.55:0/747899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf0109ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.157+0000 7f5cf8400700 1 -- 172.21.15.55:0/747899 >> 172.21.15.55:0/747899 conn(0x7f5cf006db80 msgr2=0x7f5cf006ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:17.161 INFO:tasks.workunit.client.0.smithi055.stdout:8/530: rmdir d3/d77 39 2024-04-26T21:08:17.163 INFO:tasks.workunit.client.1.smithi064.stdout:9/804: symlink d0/d4/d28/ddb/l10b 0 2024-04-26T21:08:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.160+0000 7f5cf8400700 1 -- 172.21.15.55:0/747899 shutdown_connections 2024-04-26T21:08:17.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.161+0000 7f5cf8400700 1 -- 172.21.15.55:0/747899 wait complete. 2024-04-26T21:08:17.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/705: creat d0/d4/d5/d73/d47/d37/de7/ff8 x:0 0 0 2024-04-26T21:08:17.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.164+0000 7f5cf8400700 1 Processor -- start 2024-04-26T21:08:17.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.164+0000 7f5cf8400700 1 -- start start 2024-04-26T21:08:17.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.165+0000 7f5cf8400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:17.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.166+0000 7f5cf8400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf01a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:17.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.166+0000 7f5cf8400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a5f70 con 0x7f5cf0072c00 2024-04-26T21:08:17.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.166+0000 7f5cf8400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a60b0 con 0x7f5cf010a430 2024-04-26T21:08:17.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.167+0000 7f5cf5a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:17.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.167+0000 7f5cf5a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45664/0 (socket says 172.21.15.55:45664) 2024-04-26T21:08:17.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.168+0000 7f5cf5a00700 1 -- 172.21.15.55:0/4099140672 learned_addr learned my addr 172.21.15.55:0/4099140672 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:17.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.168+0000 7f5cf5000700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf01a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:17.170 INFO:tasks.workunit.client.1.smithi064.stdout:3/777: dwrite d1/d27/d50/f39 [0,4194304] 0 2024-04-26T21:08:17.171 INFO:tasks.workunit.client.0.smithi055.stdout:9/667: mknod d2/d46/d77/d7d/d94/cea 0 2024-04-26T21:08:17.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.169+0000 7f5cf5a00700 1 -- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 msgr2=0x7f5cf01a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:17.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.169+0000 7f5cf5a00700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf01a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.169+0000 7f5cf5a00700 1 -- 172.21.15.55:0/4099140672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009c40 con 0x7f5cf0072c00 2024-04-26T21:08:17.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.170+0000 7f5cf5a00700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c370 tx=0x7f5ce400c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:17.173 INFO:tasks.workunit.client.1.smithi064.stdout:2/963: link d12/d41/d73/d83/d94/d3a/d46/d48/d120/df9/f125 d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/f148 0 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.171+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cf0072c00 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.171+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc0095f0 con 0x7f5cf0072c00 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.172+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01aaef0 con 0x7f5cf0072c00 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.172+0000 7f5cf5000700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf01a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.172+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ce400f040 con 0x7f5cf0072c00 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.172+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce400e050 con 0x7f5cf0072c00 2024-04-26T21:08:17.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.173+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd0005320 con 0x7f5cf0072c00 2024-04-26T21:08:17.175 INFO:tasks.workunit.client.1.smithi064.stdout:1/957: creat d0/d6b/d9e/da2/dc9/d11a/f12b x:0 0 0 2024-04-26T21:08:17.176 INFO:tasks.workunit.client.1.smithi064.stdout:7/863: symlink d6/d15/d67/l123 0 2024-04-26T21:08:17.181 INFO:tasks.workunit.client.1.smithi064.stdout:8/748: mkdir d10/d41/d4e/d59/d5d/dea 0 2024-04-26T21:08:17.181 INFO:tasks.workunit.client.1.smithi064.stdout:8/749: readlink d10/d1d/d38/l80 0 2024-04-26T21:08:17.183 INFO:tasks.workunit.client.0.smithi055.stdout:4/539: rename d4/d23 to d4/d26/d42/dbb 0 2024-04-26T21:08:17.186 INFO:tasks.workunit.client.0.smithi055.stdout:8/531: creat d3/d9/d44/fb8 x:0 0 0 2024-04-26T21:08:17.186 INFO:tasks.workunit.client.0.smithi055.stdout:8/532: write d3/d9/d1f/f9f [712104,113090] 0 2024-04-26T21:08:17.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.182+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f5ce40090d0 con 0x7f5cf0072c00 2024-04-26T21:08:17.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.184+0000 7f5cee000700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 0x7f5cd8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:17.191 INFO:tasks.workunit.client.0.smithi055.stdout:9/668: truncate d2/f55 2621716 0 2024-04-26T21:08:17.192 INFO:tasks.workunit.client.0.smithi055.stdout:9/669: fsync d2/d46/d77/d7d/f83 0 2024-04-26T21:08:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.189+0000 7f5cf5000700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 0x7f5cd8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:17.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.194+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f5ce408ec10 con 0x7f5cf0072c00 2024-04-26T21:08:17.195 INFO:tasks.workunit.client.1.smithi064.stdout:0/797: rmdir dd/d21/dc8/d31/d43/db4/dfe 0 2024-04-26T21:08:17.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.195+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5ce405b9c0 con 0x7f5cf0072c00 2024-04-26T21:08:17.200 INFO:tasks.workunit.client.0.smithi055.stdout:9/670: link d2/d14/f47 d2/d46/d77/d7d/feb 0 2024-04-26T21:08:17.207 INFO:tasks.workunit.client.1.smithi064.stdout:9/805: dread d0/d4/d7/f2f [0,4194304] 0 2024-04-26T21:08:17.207 INFO:tasks.workunit.client.1.smithi064.stdout:9/806: dread - d0/fc7 zero size 2024-04-26T21:08:17.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.204+0000 7f5cf5000700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 0x7f5cd8070f80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009fd0 tx=0x7f5cdc005fd0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:17.209 INFO:tasks.workunit.client.0.smithi055.stdout:0/632: write d9/dc/d1c/d3e/d7d/da3/d97/db6/d67/f88 [1851152,94441] 0 2024-04-26T21:08:17.209 INFO:tasks.workunit.client.0.smithi055.stdout:0/633: truncate d9/d11/d59/fb1 4893253 0 2024-04-26T21:08:17.209 INFO:tasks.workunit.client.1.smithi064.stdout:4/891: unlink d0/d14/feb 0 2024-04-26T21:08:17.212 INFO:tasks.workunit.client.0.smithi055.stdout:7/588: dwrite d5/d6/f89 [4194304,4194304] 0 2024-04-26T21:08:17.212 INFO:tasks.workunit.client.0.smithi055.stdout:9/671: getdents d2/d46/d77/d7d/da0 0 2024-04-26T21:08:17.213 INFO:tasks.workunit.client.0.smithi055.stdout:6/607: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d62/f78 [0,4194304] 0 2024-04-26T21:08:17.222 INFO:tasks.workunit.client.0.smithi055.stdout:5/519: sync 2024-04-26T21:08:17.234 INFO:tasks.workunit.client.0.smithi055.stdout:0/634: getdents d9/dc/d1c/d3e/d7d/da3/d97 0 2024-04-26T21:08:17.234 INFO:tasks.workunit.client.0.smithi055.stdout:0/635: write d9/d11/f46 [1062093,118257] 0 2024-04-26T21:08:17.234 INFO:tasks.workunit.client.0.smithi055.stdout:0/636: write d9/dc/d17/f1e [4111625,86944] 0 2024-04-26T21:08:17.235 INFO:tasks.workunit.client.0.smithi055.stdout:1/585: sync 2024-04-26T21:08:17.235 INFO:tasks.workunit.client.0.smithi055.stdout:1/586: chown d8/df/d11/d27/f3a 144322080 1 2024-04-26T21:08:17.235 INFO:tasks.workunit.client.0.smithi055.stdout:1/587: chown d8/df/d11/d27/d28/d2a/c53 761880 1 2024-04-26T21:08:17.240 INFO:tasks.workunit.client.0.smithi055.stdout:2/680: sync 2024-04-26T21:08:17.241 INFO:tasks.workunit.client.1.smithi064.stdout:3/778: write d1/d38/f49 [476734,52992] 0 2024-04-26T21:08:17.245 INFO:tasks.workunit.client.1.smithi064.stdout:1/958: rmdir d0/d6b/d9e/deb 0 2024-04-26T21:08:17.246 INFO:tasks.workunit.client.0.smithi055.stdout:9/672: rename d2/d46/c5c to d2/d46/cec 0 2024-04-26T21:08:17.250 INFO:tasks.workunit.client.1.smithi064.stdout:7/864: symlink d6/d70/d74/d116/l124 0 2024-04-26T21:08:17.250 INFO:tasks.workunit.client.1.smithi064.stdout:8/750: creat d10/d41/d4e/d59/d5d/d79/feb x:0 0 0 2024-04-26T21:08:17.253 INFO:tasks.workunit.client.0.smithi055.stdout:6/608: link d3/d17/d46/d54/d66/d6a/d51/d58/c7d d3/d9b/cdb 0 2024-04-26T21:08:17.254 INFO:tasks.workunit.client.0.smithi055.stdout:6/609: write d3/d17/d46/d54/d66/d6a/fb8 [964049,127103] 0 2024-04-26T21:08:17.258 INFO:tasks.workunit.client.1.smithi064.stdout:4/892: creat d0/d5/f12a x:0 0 0 2024-04-26T21:08:17.260 INFO:tasks.workunit.client.0.smithi055.stdout:5/520: dread d4/df/d13/d26/d3c/f79 [0,4194304] 0 2024-04-26T21:08:17.262 INFO:tasks.workunit.client.0.smithi055.stdout:1/588: creat d8/df/d11/d27/d28/da4/daa/fc6 x:0 0 0 2024-04-26T21:08:17.263 INFO:tasks.workunit.client.0.smithi055.stdout:1/589: write d8/df/d11/f37 [512883,124693] 0 2024-04-26T21:08:17.269 INFO:tasks.workunit.client.0.smithi055.stdout:0/637: dread d9/dc/d1c/d3e/fa2 [0,4194304] 0 2024-04-26T21:08:17.269 INFO:tasks.workunit.client.0.smithi055.stdout:0/638: chown d9/d27 0 1 2024-04-26T21:08:17.271 INFO:tasks.workunit.client.1.smithi064.stdout:3/779: creat d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/f108 x:0 0 0 2024-04-26T21:08:17.274 INFO:tasks.workunit.client.1.smithi064.stdout:6/808: dwrite d4/d7/d12/d49/d4b/d7d/f91 [0,4194304] 0 2024-04-26T21:08:17.276 INFO:tasks.workunit.client.0.smithi055.stdout:9/673: mkdir d2/d14/db8/dc5/ded 0 2024-04-26T21:08:17.276 INFO:tasks.workunit.client.0.smithi055.stdout:9/674: fsync d2/d46/d51/fb2 0 2024-04-26T21:08:17.277 INFO:tasks.workunit.client.1.smithi064.stdout:1/959: symlink d0/d6/d91/l12c 0 2024-04-26T21:08:17.282 INFO:tasks.workunit.client.0.smithi055.stdout:6/610: mknod d3/d17/d46/d54/d66/d6a/d51/d58/cdc 0 2024-04-26T21:08:17.284 INFO:tasks.workunit.client.1.smithi064.stdout:7/865: symlink d6/db/d1f/l125 0 2024-04-26T21:08:17.284 INFO:tasks.workunit.client.1.smithi064.stdout:7/866: chown d6/d15/d67/d4d/fcb 39204441 1 2024-04-26T21:08:17.288 INFO:tasks.workunit.client.0.smithi055.stdout:3/706: dwrite d0/d4/d5/d73/d13/d27/d3b/ff0 [0,4194304] 0 2024-04-26T21:08:17.288 INFO:tasks.workunit.client.0.smithi055.stdout:3/707: chown d0/d4/d16/c1e 363 1 2024-04-26T21:08:17.288 INFO:tasks.workunit.client.0.smithi055.stdout:3/708: readlink d0/de/l2d 0 2024-04-26T21:08:17.288 INFO:tasks.workunit.client.0.smithi055.stdout:3/709: stat d0 0 2024-04-26T21:08:17.288 INFO:tasks.workunit.client.0.smithi055.stdout:3/710: write d0/d4/d5/d73/d47/d37/d3d/d4c/f63 [3652571,1123] 0 2024-04-26T21:08:17.290 INFO:tasks.workunit.client.1.smithi064.stdout:8/751: rename d10/d1d/d38/l8a to d10/d41/d4e/d59/d5d/dd9/lec 0 2024-04-26T21:08:17.298 INFO:tasks.workunit.client.0.smithi055.stdout:1/590: truncate d8/df/f8e 1812604 0 2024-04-26T21:08:17.318 INFO:tasks.workunit.client.0.smithi055.stdout:8/533: dwrite d3/d9/d1f/f9f [0,4194304] 0 2024-04-26T21:08:17.318 INFO:tasks.workunit.client.0.smithi055.stdout:3/711: read d0/d4/d5/d73/d13/d1a/d46/d55/f96 [224522,78411] 0 2024-04-26T21:08:17.319 INFO:tasks.workunit.client.1.smithi064.stdout:9/807: dwrite d0/f8a [0,4194304] 0 2024-04-26T21:08:17.323 INFO:tasks.workunit.client.0.smithi055.stdout:0/639: truncate d9/dc/d1c/d3e/d7d/da3/d97/db6/d67/fa9 1986802 0 2024-04-26T21:08:17.326 INFO:tasks.workunit.client.1.smithi064.stdout:1/960: creat d0/d22/d9f/df1/f12d x:0 0 0 2024-04-26T21:08:17.328 INFO:tasks.workunit.client.0.smithi055.stdout:2/681: getdents d4/dc/d21 0 2024-04-26T21:08:17.331 INFO:tasks.workunit.client.0.smithi055.stdout:7/589: dwrite d5/db/f1e [0,4194304] 0 2024-04-26T21:08:17.335 INFO:tasks.workunit.client.1.smithi064.stdout:0/798: dwrite dd/d21/dc8/d31/d43/fa6 [0,4194304] 0 2024-04-26T21:08:17.335 INFO:tasks.workunit.client.1.smithi064.stdout:0/799: dread - dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f94 zero size 2024-04-26T21:08:17.335 INFO:tasks.workunit.client.1.smithi064.stdout:0/800: readlink dd/d21/dc8/le7 0 2024-04-26T21:08:17.336 INFO:tasks.workunit.client.0.smithi055.stdout:9/675: creat d2/d46/d77/d79/fee x:0 0 0 2024-04-26T21:08:17.340 INFO:tasks.workunit.client.1.smithi064.stdout:2/964: dwrite d12/d41/d73/d83/d94/d3a/f58 [0,4194304] 0 2024-04-26T21:08:17.340 INFO:tasks.workunit.client.1.smithi064.stdout:2/965: readlink d12/l12c 0 2024-04-26T21:08:17.342 INFO:tasks.workunit.client.1.smithi064.stdout:5/772: sync 2024-04-26T21:08:17.355 INFO:tasks.workunit.client.0.smithi055.stdout:8/534: mkdir d3/d9/d1d/db9 0 2024-04-26T21:08:17.355 INFO:tasks.workunit.client.0.smithi055.stdout:8/535: getdents d3/d89/daa 0 2024-04-26T21:08:17.355 INFO:tasks.workunit.client.0.smithi055.stdout:8/536: fdatasync d3/d9/d5b/f79 0 2024-04-26T21:08:17.355 INFO:tasks.workunit.client.0.smithi055.stdout:8/537: getdents d3/d9/d1f/d84/d8f 0 2024-04-26T21:08:17.355 INFO:tasks.workunit.client.0.smithi055.stdout:8/538: write d3/d9/d1f/f5d [1354339,81531] 0 2024-04-26T21:08:17.358 INFO:tasks.workunit.client.0.smithi055.stdout:0/640: link d9/d11/c1a d9/d27/daf/cc9 0 2024-04-26T21:08:17.361 INFO:tasks.workunit.client.1.smithi064.stdout:1/961: creat d0/d6/d11/d1e/d2a/d34/f12e x:0 0 0 2024-04-26T21:08:17.363 INFO:tasks.workunit.client.0.smithi055.stdout:4/540: dwrite d4/d12/d17/d3d/f8c [0,4194304] 0 2024-04-26T21:08:17.364 INFO:tasks.workunit.client.1.smithi064.stdout:0/801: creat dd/d21/f107 x:0 0 0 2024-04-26T21:08:17.364 INFO:tasks.workunit.client.1.smithi064.stdout:0/802: chown dd/d21/dc8/d31/d47/fd1 226 1 2024-04-26T21:08:17.369 INFO:tasks.workunit.client.1.smithi064.stdout:7/867: getdents d6/d9/d3d/d58 0 2024-04-26T21:08:17.370 INFO:tasks.workunit.client.1.smithi064.stdout:7/868: read - d6/db/d1f/d50/db8/f100 zero size 2024-04-26T21:08:17.370 INFO:tasks.workunit.client.1.smithi064.stdout:7/869: creat d6/d15/d88/dca/f126 x:0 0 0 2024-04-26T21:08:17.370 INFO:tasks.workunit.client.1.smithi064.stdout:7/870: dread - d6/d15/d88/dca/f104 zero size 2024-04-26T21:08:17.371 INFO:tasks.workunit.client.0.smithi055.stdout:2/682: symlink d4/db/d8f/da6/d97/ldc 0 2024-04-26T21:08:17.371 INFO:tasks.workunit.client.0.smithi055.stdout:2/683: chown d4/d14/d17/d36/c3c 0 1 2024-04-26T21:08:17.374 INFO:tasks.workunit.client.0.smithi055.stdout:5/521: dwrite d4/df/f5d [0,4194304] 0 2024-04-26T21:08:17.374 INFO:tasks.workunit.client.0.smithi055.stdout:5/522: read - d4/df/d13/f81 zero size 2024-04-26T21:08:17.375 INFO:tasks.workunit.client.1.smithi064.stdout:5/773: mknod dd/d12/d18/d1a/d1f/dca/cf7 0 2024-04-26T21:08:17.379 INFO:tasks.workunit.client.1.smithi064.stdout:4/893: rename d0/d1d/f49 to d0/d14/f12b 0 2024-04-26T21:08:17.381 INFO:tasks.workunit.client.0.smithi055.stdout:7/590: link d5/d6/c9f d5/d6/d24/caa 0 2024-04-26T21:08:17.386 INFO:tasks.workunit.client.1.smithi064.stdout:8/752: getdents d10/d41/d4e/d60 0 2024-04-26T21:08:17.391 INFO:tasks.workunit.client.0.smithi055.stdout:9/676: fdatasync d2/d46/d77/f76 0 2024-04-26T21:08:17.392 INFO:tasks.workunit.client.1.smithi064.stdout:6/809: write d4/d7/d12/d49/d4b/fb8 [4776518,19340] 0 2024-04-26T21:08:17.393 INFO:tasks.workunit.client.1.smithi064.stdout:6/810: write d4/d7/d12/fc2 [821921,125855] 0 2024-04-26T21:08:17.396 INFO:tasks.workunit.client.0.smithi055.stdout:6/611: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/fb9 [0,4194304] 0 2024-04-26T21:08:17.398 INFO:tasks.workunit.client.0.smithi055.stdout:6/612: write d3/d9b/fb4 [495799,126149] 0 2024-04-26T21:08:17.401 INFO:tasks.workunit.client.1.smithi064.stdout:0/803: dread dd/d21/dc8/d31/d47/dad/dfd/d74/f92 [0,4194304] 0 2024-04-26T21:08:17.403 INFO:tasks.workunit.client.1.smithi064.stdout:3/780: dwrite d1/d14/f1c [4194304,4194304] 0 2024-04-26T21:08:17.403 INFO:tasks.workunit.client.1.smithi064.stdout:3/781: readlink d1/d27/d50/d35/d4c/d7b/d82/la4 0 2024-04-26T21:08:17.403 INFO:tasks.workunit.client.1.smithi064.stdout:3/782: fsync d1/d27/d29/d6f/d72/d7a/d84/fe8 0 2024-04-26T21:08:17.403 INFO:tasks.workunit.client.1.smithi064.stdout:3/783: fsync d1/d14/f6a 0 2024-04-26T21:08:17.409 INFO:tasks.workunit.client.1.smithi064.stdout:9/808: dwrite d0/d4/da/f57 [0,4194304] 0 2024-04-26T21:08:17.409 INFO:tasks.workunit.client.1.smithi064.stdout:7/871: symlink d6/d15/d67/d4d/d121/l127 0 2024-04-26T21:08:17.409 INFO:tasks.workunit.client.1.smithi064.stdout:7/872: fdatasync d6/db/d1f/d50/db8/deb/ffd 0 2024-04-26T21:08:17.410 INFO:tasks.workunit.client.1.smithi064.stdout:1/962: dread d0/d6b/fd5 [0,4194304] 0 2024-04-26T21:08:17.410 INFO:tasks.workunit.client.1.smithi064.stdout:1/963: chown d0/d6/d11/d1e/d2a/d34/f73 3416593 1 2024-04-26T21:08:17.414 INFO:tasks.workunit.client.1.smithi064.stdout:5/774: rename dd/d12/d4f/d64/d73/dec to dd/d12/d4f/d64/df8 0 2024-04-26T21:08:17.414 INFO:tasks.workunit.client.1.smithi064.stdout:5/775: creat dd/da9/d48/d6a/d9e/db9/ff9 x:0 0 0 2024-04-26T21:08:17.417 INFO:tasks.workunit.client.1.smithi064.stdout:2/966: dwrite d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f49 [0,4194304] 0 2024-04-26T21:08:17.417 INFO:tasks.workunit.client.1.smithi064.stdout:2/967: chown d12/d41/d73/d83/d94 12 1 2024-04-26T21:08:17.418 INFO:tasks.workunit.client.1.smithi064.stdout:2/968: readlink d12/d41/d61/l87 0 2024-04-26T21:08:17.418 INFO:tasks.workunit.client.1.smithi064.stdout:2/969: creat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/d13c/f149 x:0 0 0 2024-04-26T21:08:17.418 INFO:tasks.workunit.client.1.smithi064.stdout:2/970: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/d13c/f149 [715400,103415] 0 2024-04-26T21:08:17.425 INFO:tasks.workunit.client.1.smithi064.stdout:4/894: creat d0/d5/d13/d33/f12c x:0 0 0 2024-04-26T21:08:17.425 INFO:tasks.workunit.client.0.smithi055.stdout:6/613: dread d3/d17/f18 [0,4194304] 0 2024-04-26T21:08:17.426 INFO:tasks.workunit.client.0.smithi055.stdout:6/614: read - d3/d17/d25/fbb zero size 2024-04-26T21:08:17.427 INFO:tasks.workunit.client.0.smithi055.stdout:0/641: mkdir d9/dc/d1c/d3e/d7d/da3/dca 0 2024-04-26T21:08:17.429 INFO:tasks.workunit.client.1.smithi064.stdout:6/811: mknod d4/d7/d12/d49/d4b/d56/d95/c10d 0 2024-04-26T21:08:17.430 INFO:tasks.workunit.client.1.smithi064.stdout:6/812: fdatasync d4/d7/d12/d1e/dd4/ff6 0 2024-04-26T21:08:17.431 INFO:tasks.workunit.client.0.smithi055.stdout:4/541: rmdir d4/d26/d42/d28/d53/d71/d7f/dac 0 2024-04-26T21:08:17.432 INFO:tasks.workunit.client.1.smithi064.stdout:0/804: symlink dd/d21/dc8/d31/d47/dad/dfd/d18/d58/df2/l108 0 2024-04-26T21:08:17.438 INFO:tasks.workunit.client.0.smithi055.stdout:2/684: dwrite d4/db/d1f/d46/f79 [4194304,4194304] 0 2024-04-26T21:08:17.442 INFO:tasks.workunit.client.0.smithi055.stdout:7/591: rename d5/d53/d93 to d5/d6/d24/d4d/da7/dab 0 2024-04-26T21:08:17.442 INFO:tasks.workunit.client.0.smithi055.stdout:7/592: write d5/f57 [4917190,73121] 0 2024-04-26T21:08:17.442 INFO:tasks.workunit.client.0.smithi055.stdout:7/593: chown d5/d6/d24/caa 45177 1 2024-04-26T21:08:17.442 INFO:tasks.workunit.client.0.smithi055.stdout:7/594: write d5/d6/f41 [293471,40794] 0 2024-04-26T21:08:17.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/595: creat d5/d53/d6e/d6c/d7a/fac x:0 0 0 2024-04-26T21:08:17.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/596: dread - d5/d53/d6e/d99/d58/f88 zero size 2024-04-26T21:08:17.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/597: chown d5/db/la3 4891 1 2024-04-26T21:08:17.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/598: chown d5/db/le 183053 1 2024-04-26T21:08:17.447 INFO:tasks.workunit.client.1.smithi064.stdout:1/964: read d0/d6/d29/d31/f51 [4359069,101807] 0 2024-04-26T21:08:17.447 INFO:tasks.workunit.client.1.smithi064.stdout:1/965: fsync d0/d6/d11/d1e/d2a/d34/fd8 0 2024-04-26T21:08:17.447 INFO:tasks.workunit.client.1.smithi064.stdout:3/784: mknod d1/d27/d50/d35/d4c/d7b/d82/d9b/c109 0 2024-04-26T21:08:17.447 INFO:tasks.workunit.client.1.smithi064.stdout:3/785: creat d1/d27/d29/d6f/d72/d73/f10a x:0 0 0 2024-04-26T21:08:17.448 INFO:tasks.workunit.client.1.smithi064.stdout:3/786: write d1/d27/d50/d35/d4c/d7b/d8e/f107 [274956,125261] 0 2024-04-26T21:08:17.450 INFO:tasks.workunit.client.1.smithi064.stdout:4/895: write d0/d1d/d17/d44/dac/f67 [373214,55728] 0 2024-04-26T21:08:17.450 INFO:tasks.workunit.client.1.smithi064.stdout:4/896: fsync d0/d1d/d17/f25 0 2024-04-26T21:08:17.450 INFO:tasks.workunit.client.1.smithi064.stdout:9/809: unlink d0/d4/d7/f33 0 2024-04-26T21:08:17.454 INFO:tasks.workunit.client.0.smithi055.stdout:5/523: dwrite d4/df/d13/d26/d3c/f71 [0,4194304] 0 2024-04-26T21:08:17.455 INFO:tasks.workunit.client.0.smithi055.stdout:5/524: write d4/df/d13/d26/d3c/d4a/d3f/da1/fad [4594705,69892] 0 2024-04-26T21:08:17.457 INFO:tasks.workunit.client.1.smithi064.stdout:7/873: link d6/d9/f8d d6/d8c/f128 0 2024-04-26T21:08:17.458 INFO:tasks.workunit.client.1.smithi064.stdout:7/874: write d6/db/d34/d6f/d81/fae [5231439,80458] 0 2024-04-26T21:08:17.458 INFO:tasks.workunit.client.1.smithi064.stdout:7/875: fsync d6/d15/d67/d4d/fcb 0 2024-04-26T21:08:17.458 INFO:tasks.workunit.client.0.smithi055.stdout:2/685: dread d4/d14/d17/d6d/f72 [0,4194304] 0 2024-04-26T21:08:17.467 INFO:tasks.workunit.client.1.smithi064.stdout:5/776: symlink dd/d12/d18/d1a/d1f/d20/lfa 0 2024-04-26T21:08:17.473 INFO:tasks.workunit.client.1.smithi064.stdout:9/810: dread d0/d4/d7/fb5 [0,4194304] 0 2024-04-26T21:08:17.473 INFO:tasks.workunit.client.1.smithi064.stdout:9/811: readlink d0/d4/da/l1c 0 2024-04-26T21:08:17.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/753: dwrite d10/f94 [0,4194304] 0 2024-04-26T21:08:17.479 INFO:tasks.workunit.client.0.smithi055.stdout:5/525: dread d4/d15/f52 [0,4194304] 0 2024-04-26T21:08:17.479 INFO:tasks.workunit.client.0.smithi055.stdout:5/526: fdatasync d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/fa4 0 2024-04-26T21:08:17.479 INFO:tasks.workunit.client.0.smithi055.stdout:8/539: rmdir d3/d89 39 2024-04-26T21:08:17.480 INFO:tasks.workunit.client.1.smithi064.stdout:8/754: write d10/f9e [634496,107064] 0 2024-04-26T21:08:17.480 INFO:tasks.workunit.client.1.smithi064.stdout:6/813: mkdir d4/d10e 0 2024-04-26T21:08:17.480 INFO:tasks.workunit.client.1.smithi064.stdout:6/814: fsync d4/d7/f3b 0 2024-04-26T21:08:17.482 INFO:tasks.workunit.client.1.smithi064.stdout:6/815: write d4/f41 [651859,120700] 0 2024-04-26T21:08:17.487 INFO:tasks.workunit.client.1.smithi064.stdout:1/966: link d0/d22/d9f/df1/dfa/c10c d0/d6/d29/c12f 0 2024-04-26T21:08:17.487 INFO:tasks.workunit.client.1.smithi064.stdout:1/967: creat d0/d22/d87/f130 x:0 0 0 2024-04-26T21:08:17.488 INFO:tasks.workunit.client.1.smithi064.stdout:1/968: read - d0/d6/d11/d2c/d9c/ffd zero size 2024-04-26T21:08:17.489 INFO:tasks.workunit.client.0.smithi055.stdout:0/642: mkdir d9/d27/dcb 0 2024-04-26T21:08:17.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/542: dwrite d4/d18/d1a/d49/fa9 [0,4194304] 0 2024-04-26T21:08:17.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/543: read - d4/d18/d1a/f54 zero size 2024-04-26T21:08:17.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/544: fdatasync d4/d12/d61/f95 0 2024-04-26T21:08:17.493 INFO:tasks.workunit.client.0.smithi055.stdout:4/545: write d4/d18/f55 [3404482,13165] 0 2024-04-26T21:08:17.499 INFO:tasks.workunit.client.1.smithi064.stdout:4/897: mknod d0/d5/d13/d10/dd7/c12d 0 2024-04-26T21:08:17.499 INFO:tasks.workunit.client.1.smithi064.stdout:4/898: creat d0/d5/d79/dd1/f12e x:0 0 0 2024-04-26T21:08:17.504 INFO:tasks.workunit.client.0.smithi055.stdout:9/677: rename d2/d46/d77/d7d/feb to d2/d14/db8/dc5/ded/fef 0 2024-04-26T21:08:17.504 INFO:tasks.workunit.client.0.smithi055.stdout:9/678: chown d2/d46/d77/d7d/da8 365090560 1 2024-04-26T21:08:17.504 INFO:tasks.workunit.client.0.smithi055.stdout:9/679: chown d2/d11/f1f 445472 1 2024-04-26T21:08:17.509 INFO:tasks.workunit.client.1.smithi064.stdout:7/876: link d6/d9/d38/fb3 d6/d15/d67/f129 0 2024-04-26T21:08:17.516 INFO:tasks.workunit.client.1.smithi064.stdout:5/777: creat dd/d12/d18/d1a/d1b/ffb x:0 0 0 2024-04-26T21:08:17.516 INFO:tasks.workunit.client.1.smithi064.stdout:5/778: chown dd/d12/d18/d25/d67 0 1 2024-04-26T21:08:17.516 INFO:tasks.workunit.client.1.smithi064.stdout:5/779: chown dd/d12/d4f/dbd/cf3 152019 1 2024-04-26T21:08:17.516 INFO:tasks.workunit.client.1.smithi064.stdout:5/780: chown dd/da9/d63/f7f 538291 1 2024-04-26T21:08:17.519 INFO:tasks.workunit.client.1.smithi064.stdout:9/812: mkdir d0/d4/da/d31/d10c 0 2024-04-26T21:08:17.519 INFO:tasks.workunit.client.1.smithi064.stdout:9/813: readlink d0/d4/da/d26/d5d/lb7 0 2024-04-26T21:08:17.519 INFO:tasks.workunit.client.0.smithi055.stdout:0/643: dread d9/dc/d1c/d54/f44 [0,4194304] 0 2024-04-26T21:08:17.520 INFO:tasks.workunit.client.0.smithi055.stdout:7/599: creat d5/d53/d6e/d99/d75/fad x:0 0 0 2024-04-26T21:08:17.523 INFO:tasks.workunit.client.0.smithi055.stdout:2/686: symlink d4/d14/d17/d6d/d81/da9/ldd 0 2024-04-26T21:08:17.526 INFO:tasks.workunit.client.0.smithi055.stdout:5/527: creat d4/df/d13/d26/d63/fb6 x:0 0 0 2024-04-26T21:08:17.526 INFO:tasks.workunit.client.0.smithi055.stdout:5/528: write f2 [1192320,10203] 0 2024-04-26T21:08:17.531 INFO:tasks.workunit.client.0.smithi055.stdout:8/540: creat d3/d9/d1d/d48/fba x:0 0 0 2024-04-26T21:08:17.534 INFO:tasks.workunit.client.0.smithi055.stdout:0/644: dread d9/dc/d1c/d3b/f6e [0,4194304] 0 2024-04-26T21:08:17.535 INFO:tasks.workunit.client.1.smithi064.stdout:8/755: mkdir d10/d1d/da3/ded 0 2024-04-26T21:08:17.540 INFO:tasks.workunit.client.0.smithi055.stdout:9/680: rename d2/d46/d77/d7d/da8/fab to d2/d46/d77/d7d/ff0 0 2024-04-26T21:08:17.544 INFO:tasks.workunit.client.1.smithi064.stdout:3/787: rmdir d1/d27/d50/d35/d4c 39 2024-04-26T21:08:17.544 INFO:tasks.workunit.client.1.smithi064.stdout:3/788: chown d1/d27/d29/d5e/fbd 1212 1 2024-04-26T21:08:17.544 INFO:tasks.workunit.client.1.smithi064.stdout:3/789: truncate d1/d27/d29/d6f/d72/d73/f85 4550819 0 2024-04-26T21:08:17.544 INFO:tasks.workunit.client.1.smithi064.stdout:3/790: read - d1/d27/d29/d5e/ff4 zero size 2024-04-26T21:08:17.544 INFO:tasks.workunit.client.1.smithi064.stdout:3/791: dread - d1/d38/fd2 zero size 2024-04-26T21:08:17.546 INFO:tasks.workunit.client.0.smithi055.stdout:2/687: mkdir d4/d55/dde 0 2024-04-26T21:08:17.550 INFO:tasks.workunit.client.0.smithi055.stdout:7/600: write d5/d6/d24/d52/f5e [674139,66940] 0 2024-04-26T21:08:17.550 INFO:tasks.workunit.client.0.smithi055.stdout:7/601: readlink d5/d6/d24/d3b/la4 0 2024-04-26T21:08:17.550 INFO:tasks.workunit.client.0.smithi055.stdout:7/602: write d5/d53/d6e/d99/d58/f88 [447381,89526] 0 2024-04-26T21:08:17.554 INFO:tasks.workunit.client.0.smithi055.stdout:5/529: mknod d4/df/d13/cb7 0 2024-04-26T21:08:17.556 INFO:tasks.workunit.client.1.smithi064.stdout:4/899: mkdir d0/d1d/d17/d44/dac/da9/d12f 0 2024-04-26T21:08:17.558 INFO:tasks.workunit.client.0.smithi055.stdout:8/541: symlink d3/d9/d1f/d2e/da6/lbb 0 2024-04-26T21:08:17.558 INFO:tasks.workunit.client.0.smithi055.stdout:8/542: write d3/d9/d5b/f79 [708221,82465] 0 2024-04-26T21:08:17.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/681: mkdir d2/d46/d77/d5f/df1 0 2024-04-26T21:08:17.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/682: creat d2/d11/ff2 x:0 0 0 2024-04-26T21:08:17.562 INFO:tasks.workunit.client.1.smithi064.stdout:7/877: mknod d6/d15/d88/d113/c12a 0 2024-04-26T21:08:17.562 INFO:tasks.workunit.client.1.smithi064.stdout:7/878: dread - d6/d15/d88/d113/f11f zero size 2024-04-26T21:08:17.562 INFO:tasks.workunit.client.1.smithi064.stdout:7/879: readlink d6/d5a/d5f/la3 0 2024-04-26T21:08:17.567 INFO:tasks.workunit.client.1.smithi064.stdout:4/900: dread d0/d2f/d7d/faf [0,4194304] 0 2024-04-26T21:08:17.567 INFO:tasks.workunit.client.1.smithi064.stdout:4/901: write d0/d5/d13/d6d/dd3/ffd [889697,46597] 0 2024-04-26T21:08:17.569 INFO:tasks.workunit.client.0.smithi055.stdout:6/615: dwrite d3/f8b [0,4194304] 0 2024-04-26T21:08:17.572 INFO:tasks.workunit.client.1.smithi064.stdout:5/781: mknod dd/d12/d4f/d9c/da1/cfc 0 2024-04-26T21:08:17.578 INFO:tasks.workunit.client.1.smithi064.stdout:2/971: rename d12/d45 to d12/d41/d73/d83/d94/d3a/d46/dee/d14a 0 2024-04-26T21:08:17.581 INFO:tasks.workunit.client.1.smithi064.stdout:3/792: unlink d1/d27/d29/d6f/d72/f2e 0 2024-04-26T21:08:17.585 INFO:tasks.workunit.client.0.smithi055.stdout:0/645: rename d9/dc/d1c/d54 to d9/dc/d1c/d3e/dc5/dcc 0 2024-04-26T21:08:17.585 INFO:tasks.workunit.client.0.smithi055.stdout:0/646: fdatasync d9/dc/d1c/d3e/fae 0 2024-04-26T21:08:17.586 INFO:tasks.workunit.client.1.smithi064.stdout:9/814: dwrite d0/d4/da/d26/f23 [0,4194304] 0 2024-04-26T21:08:17.588 INFO:tasks.workunit.client.0.smithi055.stdout:6/616: symlink d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/ldd 0 2024-04-26T21:08:17.589 INFO:tasks.workunit.client.0.smithi055.stdout:6/617: stat d3/d17/d46/d54/d66/d6a/d51/d58/ld2 0 2024-04-26T21:08:17.589 INFO:tasks.workunit.client.0.smithi055.stdout:6/618: fsync d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e/fb9 0 2024-04-26T21:08:17.590 INFO:tasks.workunit.client.0.smithi055.stdout:2/688: write d4/db/d1f/d46/d51/fbb [1184847,127461] 0 2024-04-26T21:08:17.594 INFO:tasks.workunit.client.0.smithi055.stdout:5/530: rename d4/df/d13/d26/d3c/d4a/d92/f9a to d4/d15/fb8 0 2024-04-26T21:08:17.594 INFO:tasks.workunit.client.0.smithi055.stdout:5/531: dread - d4/df/d13/d26/d3c/d4a/f8a zero size 2024-04-26T21:08:17.597 INFO:tasks.workunit.client.0.smithi055.stdout:6/619: mkdir d3/d17/d46/dc2/dde 0 2024-04-26T21:08:17.597 INFO:tasks.workunit.client.0.smithi055.stdout:6/620: stat d3/d17/d46/d54/d66/d6a/d67/f89 0 2024-04-26T21:08:17.598 INFO:tasks.workunit.client.1.smithi064.stdout:5/782: unlink dd/d12/d18/f39 0 2024-04-26T21:08:17.603 INFO:tasks.workunit.client.1.smithi064.stdout:0/805: rename dd/d21/dc8/d31/d47/dad/dfd/d74/c2d to dd/d21/dc8/ddf/c109 0 2024-04-26T21:08:17.603 INFO:tasks.workunit.client.1.smithi064.stdout:2/972: truncate d12/d41/d73/d83/d94/d3a/d46/d91/d92/f107 2245873 0 2024-04-26T21:08:17.603 INFO:tasks.workunit.client.1.smithi064.stdout:2/973: readlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/lcf 0 2024-04-26T21:08:17.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/806: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/f1f 449320 0 2024-04-26T21:08:17.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/807: chown dd/d21/dc8/d31/d47/d61/c5d 10645 1 2024-04-26T21:08:17.615 INFO:tasks.workunit.client.1.smithi064.stdout:2/974: mknod d12/d41/d61/d6c/c14b 0 2024-04-26T21:08:17.615 INFO:tasks.workunit.client.1.smithi064.stdout:2/975: fdatasync d12/d41/d73/d83/d94/f33 0 2024-04-26T21:08:17.615 INFO:tasks.workunit.client.1.smithi064.stdout:2/976: write d12/d41/d73/d83/d94/d3a/d46/d48/d85/d57/fdf [978284,72597] 0 2024-04-26T21:08:17.618 INFO:tasks.workunit.client.0.smithi055.stdout:5/532: getdents d4/df 0 2024-04-26T21:08:17.618 INFO:tasks.workunit.client.0.smithi055.stdout:5/533: read - d4/df/d13/d26/d3c/d4a/fb3 zero size 2024-04-26T21:08:17.618 INFO:tasks.workunit.client.0.smithi055.stdout:6/621: unlink d3/d17/d19/f41 0 2024-04-26T21:08:17.621 INFO:tasks.workunit.client.1.smithi064.stdout:6/816: rename d4/d7/d12/d38/la1 to d4/d7/d12/d49/d4b/d56/df1/l10f 0 2024-04-26T21:08:17.622 INFO:tasks.workunit.client.1.smithi064.stdout:0/808: mknod dd/d21/dc8/d31/d47/dad/dce/c10a 0 2024-04-26T21:08:17.625 INFO:tasks.workunit.client.1.smithi064.stdout:2/977: symlink d12/d41/d73/d83/d94/d3a/d3e/l14c 0 2024-04-26T21:08:17.625 INFO:tasks.workunit.client.1.smithi064.stdout:2/978: stat d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/f7f 0 2024-04-26T21:08:17.625 INFO:tasks.workunit.client.1.smithi064.stdout:2/979: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d99/f106 9 1 2024-04-26T21:08:17.631 INFO:tasks.workunit.client.1.smithi064.stdout:7/880: rename d6/d70/d74/l86 to d6/d15/d88/dca/d5c/ded/l12b 0 2024-04-26T21:08:17.633 INFO:tasks.workunit.client.1.smithi064.stdout:4/902: dwrite d0/d1d/d17/d44/dac/d54/fbb [0,4194304] 0 2024-04-26T21:08:17.634 INFO:tasks.workunit.client.0.smithi055.stdout:7/603: dread d5/f57 [0,4194304] 0 2024-04-26T21:08:17.634 INFO:tasks.workunit.client.0.smithi055.stdout:6/622: truncate d3/d17/d46/d54/d66/d6a/fab 1955625 0 2024-04-26T21:08:17.634 INFO:tasks.workunit.client.0.smithi055.stdout:6/623: write d3/d17/d25/fbb [188718,57212] 0 2024-04-26T21:08:17.638 INFO:tasks.workunit.client.1.smithi064.stdout:6/817: rename d4/d7/fa0 to d4/d7/d12/d38/de6/f110 0 2024-04-26T21:08:17.641 INFO:tasks.workunit.client.1.smithi064.stdout:7/881: mkdir d6/db/d34/d6f/d12c 0 2024-04-26T21:08:17.644 INFO:tasks.workunit.client.1.smithi064.stdout:4/903: symlink d0/d5/d79/dd1/da0/dcd/l130 0 2024-04-26T21:08:17.647 INFO:tasks.workunit.client.0.smithi055.stdout:6/624: rmdir d3/d17/d46/d54/d66/d6a/d51/d58/dd8 0 2024-04-26T21:08:17.647 INFO:tasks.workunit.client.0.smithi055.stdout:6/625: readlink d3/d17/d19/l65 0 2024-04-26T21:08:17.653 INFO:tasks.workunit.client.0.smithi055.stdout:0/647: dread d9/dc/d1c/d3b/f6e [0,4194304] 0 2024-04-26T21:08:17.653 INFO:tasks.workunit.client.0.smithi055.stdout:0/648: write d9/dc/d17/f3f [4446823,78419] 0 2024-04-26T21:08:17.659 INFO:tasks.workunit.client.0.smithi055.stdout:0/649: mkdir d9/dc/d1c/d3e/dcd 0 2024-04-26T21:08:17.663 INFO:tasks.workunit.client.1.smithi064.stdout:6/818: creat d4/d7/d12/d38/f111 x:0 0 0 2024-04-26T21:08:17.663 INFO:tasks.workunit.client.1.smithi064.stdout:7/882: stat d6/d15/d1c/d45/c108 0 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:8/543: dwrite d3/d9/d1f/f9f [0,4194304] 0 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:8/544: dread - d3/d9/d1d/d48/d57/d61/d9b/f9e zero size 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:8/545: chown d3/f41 80 1 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:8/546: write d3/d9/f3b [251777,68961] 0 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:0/650: rmdir d9/dc/d1c/d3e/dc5/dcc/db2 39 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:0/651: write d9/dc/d1c/d3b/f36 [5018377,66012] 0 2024-04-26T21:08:17.665 INFO:tasks.workunit.client.0.smithi055.stdout:0/652: chown d9/d11/l99 416608969 1 2024-04-26T21:08:17.671 INFO:tasks.workunit.client.1.smithi064.stdout:7/883: mkdir d6/d15/d67/d12d 0 2024-04-26T21:08:17.672 INFO:tasks.workunit.client.1.smithi064.stdout:7/884: write d6/d15/d88/dca/d5c/fe3 [700091,105168] 0 2024-04-26T21:08:17.673 INFO:tasks.workunit.client.1.smithi064.stdout:5/783: dwrite dd/da9/d48/f72 [0,4194304] 0 2024-04-26T21:08:17.674 INFO:tasks.workunit.client.1.smithi064.stdout:7/885: mkdir d6/d70/da8/dd1/d12e 0 2024-04-26T21:08:17.674 INFO:tasks.workunit.client.1.smithi064.stdout:7/886: read - d6/d9/d3d/d43/ff3 zero size 2024-04-26T21:08:17.674 INFO:tasks.workunit.client.1.smithi064.stdout:7/887: fdatasync d6/db/d34/d6f/d81/fae 0 2024-04-26T21:08:17.676 INFO:tasks.workunit.client.0.smithi055.stdout:9/683: dwrite d2/d11/fa4 [0,4194304] 0 2024-04-26T21:08:17.680 INFO:tasks.workunit.client.1.smithi064.stdout:5/784: truncate dd/d12/d18/d1a/d1b/f6c 780497 0 2024-04-26T21:08:17.689 INFO:tasks.workunit.client.0.smithi055.stdout:0/653: dread d9/dc/d1c/d3e/dc5/dcc/f44 [0,4194304] 0 2024-04-26T21:08:17.690 INFO:tasks.workunit.client.0.smithi055.stdout:0/654: stat d9/d11/c13 0 2024-04-26T21:08:17.690 INFO:tasks.workunit.client.1.smithi064.stdout:6/819: dread d4/d7/d33/f81 [0,4194304] 0 2024-04-26T21:08:17.697 INFO:tasks.workunit.client.1.smithi064.stdout:6/820: truncate d4/d7/d33/f89 1501281 0 2024-04-26T21:08:17.697 INFO:tasks.workunit.client.1.smithi064.stdout:6/821: write d4/d7/d12/d49/d4b/d7d/ffe [85880,50717] 0 2024-04-26T21:08:17.703 INFO:tasks.workunit.client.0.smithi055.stdout:2/689: dwrite d4/d14/d33/f59 [0,4194304] 0 2024-04-26T21:08:17.703 INFO:tasks.workunit.client.0.smithi055.stdout:9/684: creat d2/d46/d77/ff3 x:0 0 0 2024-04-26T21:08:17.703 INFO:tasks.workunit.client.0.smithi055.stdout:0/655: mkdir d9/dc/d1c/d3e/d7d/da3/dce 0 2024-04-26T21:08:17.709 INFO:tasks.workunit.client.0.smithi055.stdout:2/690: rename d4/d49/d4c/f99 to d4/d1e/fdf 0 2024-04-26T21:08:17.711 INFO:tasks.workunit.client.0.smithi055.stdout:9/685: symlink d2/d14/db8/lf4 0 2024-04-26T21:08:17.711 INFO:tasks.workunit.client.0.smithi055.stdout:9/686: write d2/d11/f4b [4549225,96785] 0 2024-04-26T21:08:17.711 INFO:tasks.workunit.client.0.smithi055.stdout:9/687: readlink d2/d14/d97/d9b/l9c 0 2024-04-26T21:08:17.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/656: mknod d9/d11/d59/d78/ccf 0 2024-04-26T21:08:17.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/657: getdents d9/dc/d1c/d3e/dc5/dcc/d9c 0 2024-04-26T21:08:17.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/658: write d9/dc/d1c/d3e/fa2 [4428702,6646] 0 2024-04-26T21:08:17.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/659: write d9/dc/d1c/d3b/f94 [780572,79943] 0 2024-04-26T21:08:17.713 INFO:tasks.workunit.client.1.smithi064.stdout:5/785: write dd/d12/d4f/f55 [1560508,365] 0 2024-04-26T21:08:17.716 INFO:tasks.workunit.client.1.smithi064.stdout:2/980: dwrite d12/d41/d61/faf [0,4194304] 0 2024-04-26T21:08:17.716 INFO:tasks.workunit.client.1.smithi064.stdout:2/981: readlink d12/l12c 0 2024-04-26T21:08:17.716 INFO:tasks.workunit.client.1.smithi064.stdout:2/982: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l5c 706291 1 2024-04-26T21:08:17.716 INFO:tasks.workunit.client.1.smithi064.stdout:4/904: dwrite d0/d2f/fd6 [0,4194304] 0 2024-04-26T21:08:17.716 INFO:tasks.workunit.client.1.smithi064.stdout:4/905: chown d0/d5/d13/d33/dd0/dd8/c113 480 1 2024-04-26T21:08:17.717 INFO:tasks.workunit.client.0.smithi055.stdout:2/691: unlink d4/d14/d17/f2e 0 2024-04-26T21:08:17.719 INFO:tasks.workunit.client.0.smithi055.stdout:9/688: mkdir d2/d11/df5 0 2024-04-26T21:08:17.723 INFO:tasks.workunit.client.1.smithi064.stdout:5/786: unlink dd/da9/f98 0 2024-04-26T21:08:17.723 INFO:tasks.workunit.client.1.smithi064.stdout:5/787: fsync dd/da9/d48/d6a/d81/f77 0 2024-04-26T21:08:17.725 INFO:tasks.workunit.client.1.smithi064.stdout:6/822: dread d4/d7/d12/d38/f97 [0,4194304] 0 2024-04-26T21:08:17.725 INFO:tasks.workunit.client.1.smithi064.stdout:6/823: dread - d4/d7/d12/d49/d4b/d56/f10a zero size 2024-04-26T21:08:17.728 INFO:tasks.workunit.client.0.smithi055.stdout:0/660: creat d9/dc/d1c/d3e/d7d/da3/d97/dbd/fd0 x:0 0 0 2024-04-26T21:08:17.728 INFO:tasks.workunit.client.0.smithi055.stdout:0/661: write d9/dc/d17/d9a/fad [1435894,105482] 0 2024-04-26T21:08:17.732 INFO:tasks.workunit.client.0.smithi055.stdout:2/692: getdents d4/d1e/d90 0 2024-04-26T21:08:17.739 INFO:tasks.workunit.client.1.smithi064.stdout:7/888: dwrite d6/d9/f1a [0,4194304] 0 2024-04-26T21:08:17.749 INFO:tasks.workunit.client.1.smithi064.stdout:4/906: rename d0/d5/d79/dd1/da0/dcd to d0/d5/d13/d6d/d97/df6/d131 0 2024-04-26T21:08:17.750 INFO:tasks.workunit.client.1.smithi064.stdout:2/983: dread d12/d41/d73/d83/d94/d3a/f64 [0,4194304] 0 2024-04-26T21:08:17.751 INFO:tasks.workunit.client.0.smithi055.stdout:2/693: mknod d4/d14/ce0 0 2024-04-26T21:08:17.753 INFO:tasks.workunit.client.1.smithi064.stdout:6/824: symlink d4/d7/d12/d49/d4b/d56/dcf/l112 0 2024-04-26T21:08:17.754 INFO:tasks.workunit.client.1.smithi064.stdout:6/825: creat d4/d7/d12/d49/d4b/d5a/daf/f113 x:0 0 0 2024-04-26T21:08:17.754 INFO:tasks.workunit.client.1.smithi064.stdout:6/826: creat d4/d7/d12/d49/de1/f114 x:0 0 0 2024-04-26T21:08:17.756 INFO:tasks.workunit.client.0.smithi055.stdout:9/689: rename d2/c3c to d2/d46/d77/cf6 0 2024-04-26T21:08:17.760 INFO:tasks.workunit.client.0.smithi055.stdout:0/662: getdents d9/dc/d1c/d3e 0 2024-04-26T21:08:17.765 INFO:tasks.workunit.client.0.smithi055.stdout:9/690: creat d2/d46/d77/d7d/ff7 x:0 0 0 2024-04-26T21:08:17.766 INFO:tasks.workunit.client.1.smithi064.stdout:4/907: dread d0/d5/d13/d33/dd0/ff4 [0,4194304] 0 2024-04-26T21:08:17.766 INFO:tasks.workunit.client.1.smithi064.stdout:4/908: fdatasync d0/d1d/f70 0 2024-04-26T21:08:17.766 INFO:tasks.workunit.client.1.smithi064.stdout:4/909: stat d0/d2f/d7d/fc1 0 2024-04-26T21:08:17.766 INFO:tasks.workunit.client.1.smithi064.stdout:4/910: chown d0/d1d/d17/d44/dac/l9e 16743020 1 2024-04-26T21:08:17.767 INFO:tasks.workunit.client.1.smithi064.stdout:4/911: fsync d0/d1d/d21/f3a 0 2024-04-26T21:08:17.767 INFO:tasks.workunit.client.1.smithi064.stdout:4/912: read d0/d14/f50 [3346281,126783] 0 2024-04-26T21:08:17.776 INFO:tasks.workunit.client.0.smithi055.stdout:2/694: dread d4/d55/d6c/f94 [0,4194304] 0 2024-04-26T21:08:17.776 INFO:tasks.workunit.client.0.smithi055.stdout:0/663: getdents d9/dc/d1c/d3e/d7d/da3 0 2024-04-26T21:08:17.776 INFO:tasks.workunit.client.0.smithi055.stdout:0/664: write d9/dc/d17/f3f [535403,22790] 0 2024-04-26T21:08:17.780 INFO:tasks.workunit.client.0.smithi055.stdout:5/534: dwrite d4/df/d13/f95 [0,4194304] 0 2024-04-26T21:08:17.784 INFO:tasks.workunit.client.0.smithi055.stdout:9/691: dread d2/f1a [0,4194304] 0 2024-04-26T21:08:17.785 INFO:tasks.workunit.client.0.smithi055.stdout:6/626: dread d3/d17/faa [0,4194304] 0 2024-04-26T21:08:17.786 INFO:tasks.workunit.client.0.smithi055.stdout:7/604: dwrite d5/f57 [0,4194304] 0 2024-04-26T21:08:17.786 INFO:tasks.workunit.client.0.smithi055.stdout:2/695: mknod d4/d14/dc5/ce1 0 2024-04-26T21:08:17.790 INFO:tasks.workunit.client.0.smithi055.stdout:0/665: mknod d9/d27/dcb/cd1 0 2024-04-26T21:08:17.790 INFO:tasks.workunit.client.0.smithi055.stdout:0/666: creat d9/dc/d1c/d3e/d7d/fd2 x:0 0 0 2024-04-26T21:08:17.794 INFO:tasks.workunit.client.1.smithi064.stdout:7/889: creat d6/db/d34/d6f/dff/f12f x:0 0 0 2024-04-26T21:08:17.797 INFO:tasks.workunit.client.0.smithi055.stdout:8/547: dwrite d3/d9/d1d/d48/d4b/fb4 [0,4194304] 0 2024-04-26T21:08:17.798 INFO:tasks.workunit.client.1.smithi064.stdout:5/788: dwrite dd/d12/d18/d1a/d1f/d20/f59 [0,4194304] 0 2024-04-26T21:08:17.808 INFO:tasks.workunit.client.1.smithi064.stdout:2/984: mknod d12/d88/d135/c14d 0 2024-04-26T21:08:17.810 INFO:tasks.workunit.client.0.smithi055.stdout:8/548: write d3/d77/f78 [4953387,119883] 0 2024-04-26T21:08:17.827 INFO:tasks.workunit.client.1.smithi064.stdout:6/827: mkdir d4/d7/d12/d49/d4b/d5a/d8f/d108/d115 0 2024-04-26T21:08:17.833 INFO:tasks.workunit.client.1.smithi064.stdout:0/809: sync 2024-04-26T21:08:17.834 INFO:tasks.workunit.client.1.smithi064.stdout:0/810: readlink dd/d21/dc8/lf1 0 2024-04-26T21:08:17.835 INFO:tasks.workunit.client.1.smithi064.stdout:7/890: dwrite d6/d9/d38/fb3 [4194304,4194304] 0 2024-04-26T21:08:17.836 INFO:tasks.workunit.client.0.smithi055.stdout:5/535: mkdir d4/df/d13/d26/d3c/d4a/d3f/d5c/db9 0 2024-04-26T21:08:17.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/913: truncate d0/d5/d13/f60 2005317 0 2024-04-26T21:08:17.837 INFO:tasks.workunit.client.1.smithi064.stdout:4/914: chown d0/d5/d13/d33/dcf 7606053 1 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:3/793: sync 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:8/756: sync 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:9/815: sync 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:1/969: sync 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:9/816: chown d0/d4/da/d31/fc0 1642461 1 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:3/794: dread - d1/d27/d50/d35/d4c/d7b/d8e/ff7 zero size 2024-04-26T21:08:17.838 INFO:tasks.workunit.client.1.smithi064.stdout:1/970: write d0/d22/f5f [4015478,57909] 0 2024-04-26T21:08:17.840 INFO:tasks.workunit.client.1.smithi064.stdout:9/817: creat d0/d4/d28/dff/d103/f10d x:0 0 0 2024-04-26T21:08:17.840 INFO:tasks.workunit.client.1.smithi064.stdout:1/971: write d0/d22/d9f/df1/ffb [312554,42092] 0 2024-04-26T21:08:17.843 INFO:tasks.workunit.client.0.smithi055.stdout:9/692: creat d2/d46/d77/d7d/da8/ff8 x:0 0 0 2024-04-26T21:08:17.844 INFO:tasks.workunit.client.1.smithi064.stdout:5/789: mknod dd/d12/d4f/dbd/cfd 0 2024-04-26T21:08:17.846 INFO:tasks.workunit.client.1.smithi064.stdout:5/790: creat dd/da9/d48/d6a/d9e/db9/ffe x:0 0 0 2024-04-26T21:08:17.846 INFO:tasks.workunit.client.0.smithi055.stdout:8/549: dread d3/d77/f78 [0,4194304] 0 2024-04-26T21:08:17.847 INFO:tasks.workunit.client.0.smithi055.stdout:6/627: dwrite d3/d17/d25/d5f/d90/f87 [0,4194304] 0 2024-04-26T21:08:17.847 INFO:tasks.workunit.client.0.smithi055.stdout:6/628: stat d3/d17/d19/d7b/d9a 0 2024-04-26T21:08:17.849 INFO:tasks.workunit.client.1.smithi064.stdout:0/811: dread dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f95 [0,4194304] 0 2024-04-26T21:08:17.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/828: symlink d4/d7/l116 0 2024-04-26T21:08:17.851 INFO:tasks.workunit.client.1.smithi064.stdout:6/829: stat d4/d7/d12/d49/d4b/d5a/d8f/l10b 0 2024-04-26T21:08:17.852 INFO:tasks.workunit.client.1.smithi064.stdout:1/972: dread d0/d6b/d9e/fa4 [0,4194304] 0 2024-04-26T21:08:17.854 INFO:tasks.workunit.client.0.smithi055.stdout:2/696: mknod d4/d1e/dba/ce2 0 2024-04-26T21:08:17.854 INFO:tasks.workunit.client.0.smithi055.stdout:7/605: unlink d5/d6/d39/fa6 0 2024-04-26T21:08:17.856 INFO:tasks.workunit.client.1.smithi064.stdout:7/891: creat d6/db/d1f/d50/db8/dce/f130 x:0 0 0 2024-04-26T21:08:17.856 INFO:tasks.workunit.client.1.smithi064.stdout:7/892: stat d6/db/d8e/lf2 0 2024-04-26T21:08:17.859 INFO:tasks.workunit.client.0.smithi055.stdout:0/667: creat d9/dc/d1c/d3e/fd3 x:0 0 0 2024-04-26T21:08:17.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.855+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5cd00058a0 con 0x7f5cf0072c00 2024-04-26T21:08:17.860 INFO:tasks.workunit.client.1.smithi064.stdout:4/915: rename d0/d5/d13/d10/dd7/c12d to d0/d5/d13/d10/dd7/c132 0 2024-04-26T21:08:17.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/795: symlink d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/l10b 0 2024-04-26T21:08:17.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.864+0000 7f5cee000700 1 -- 172.21.15.55:0/4099140672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f5ce405b9c0 con 0x7f5cf0072c00 2024-04-26T21:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:08:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.868+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 msgr2=0x7f5cd8070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:17.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.868+0000 7f5cf8400700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 0x7f5cd8070f80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009fd0 tx=0x7f5cdc005fd0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 msgr2=0x7f5cf01a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c370 tx=0x7f5ce400c680 comp rx=0 tx=0).stop 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 shutdown_connections 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7f5cd806eac0 0x7f5cd8070f80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cf0072c00 0x7f5cf01a5410 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 --2- 172.21.15.55:0/4099140672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5cf010a430 0x7f5cf01a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 >> 172.21.15.55:0/4099140672 conn(0x7f5cf006db80 msgr2=0x7f5cf010b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 shutdown_connections 2024-04-26T21:08:17.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:17.870+0000 7f5cf8400700 1 -- 172.21.15.55:0/4099140672 wait complete. 2024-04-26T21:08:17.878 INFO:tasks.workunit.client.0.smithi055.stdout:5/536: rename d4/df/d13/d26/d3c/d4a/d3f/d2e/d82/f84 to d4/df/d13/d26/d3c/d5b/d83/fba 0 2024-04-26T21:08:17.879 INFO:tasks.workunit.client.0.smithi055.stdout:5/537: stat d4/df/dae 0 2024-04-26T21:08:17.879 INFO:tasks.workunit.client.0.smithi055.stdout:5/538: creat d4/df/d13/d26/d3c/d4a/d3f/d2e/fbb x:0 0 0 2024-04-26T21:08:17.881 INFO:tasks.workunit.client.1.smithi064.stdout:7/893: write d6/d15/d88/dca/f49 [3616556,60898] 0 2024-04-26T21:08:17.881 INFO:tasks.workunit.client.1.smithi064.stdout:2/985: dwrite d12/fb8 [0,4194304] 0 2024-04-26T21:08:17.885 INFO:tasks.workunit.client.1.smithi064.stdout:3/796: dread d1/d27/d29/d6f/d72/d73/f90 [0,4194304] 0 2024-04-26T21:08:17.885 INFO:tasks.workunit.client.1.smithi064.stdout:3/797: write d1/d27/d50/fb [2434862,104736] 0 2024-04-26T21:08:17.886 INFO:tasks.workunit.client.1.smithi064.stdout:5/791: creat dd/d12/d18/d1a/d1f/fff x:0 0 0 2024-04-26T21:08:17.890 INFO:tasks.workunit.client.1.smithi064.stdout:0/812: link dd/d21/l28 dd/d21/dc8/d31/d5c/l10b 0 2024-04-26T21:08:17.892 INFO:tasks.workunit.client.1.smithi064.stdout:6/830: creat d4/d7/d12/d49/d4b/dc9/f117 x:0 0 0 2024-04-26T21:08:17.892 INFO:tasks.workunit.client.1.smithi064.stdout:6/831: chown d4/d7/d12/d49/d9e/ce5 1848416 1 2024-04-26T21:08:17.894 INFO:tasks.workunit.client.1.smithi064.stdout:9/818: dwrite d0/d4/da/d26/d45/f101 [0,4194304] 0 2024-04-26T21:08:17.896 INFO:tasks.workunit.client.1.smithi064.stdout:9/819: write d0/d4/d28/d4f/f61 [1587765,119301] 0 2024-04-26T21:08:17.897 INFO:tasks.workunit.client.1.smithi064.stdout:1/973: rename d0/d6/d11/d1e/d2a/l6d to d0/d22/d9f/l131 0 2024-04-26T21:08:17.899 INFO:tasks.workunit.client.1.smithi064.stdout:4/916: unlink d0/d1d/d56/f8b 0 2024-04-26T21:08:17.899 INFO:tasks.workunit.client.1.smithi064.stdout:4/917: fsync d0/d1d/f70 0 2024-04-26T21:08:17.899 INFO:tasks.workunit.client.0.smithi055.stdout:2/697: truncate d4/db/d1f/fb8 68021 0 2024-04-26T21:08:17.901 INFO:tasks.workunit.client.0.smithi055.stdout:7/606: mkdir d5/d6/d24/d4d/da7/dab/dae 0 2024-04-26T21:08:17.901 INFO:tasks.workunit.client.0.smithi055.stdout:1/591: sync 2024-04-26T21:08:17.904 INFO:tasks.workunit.client.0.smithi055.stdout:3/712: sync 2024-04-26T21:08:17.907 INFO:tasks.workunit.client.0.smithi055.stdout:0/668: unlink d9/dc/d1c/d3e/dc5/dcc/db2/fc7 0 2024-04-26T21:08:17.911 INFO:tasks.workunit.client.1.smithi064.stdout:3/798: write d1/d27/d50/d35/d4c/f83 [3933769,121287] 0 2024-04-26T21:08:17.911 INFO:tasks.workunit.client.1.smithi064.stdout:3/799: truncate d1/d27/d50/d35/db9/fe1 112708 0 2024-04-26T21:08:17.913 INFO:tasks.workunit.client.0.smithi055.stdout:3/713: write d0/d4/d5/f36 [3584747,61214] 0 2024-04-26T21:08:17.913 INFO:tasks.workunit.client.0.smithi055.stdout:5/539: dwrite d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/f7a [0,4194304] 0 2024-04-26T21:08:17.915 INFO:tasks.workunit.client.0.smithi055.stdout:9/693: rename d2/d14/db8/dc5/dcf to d2/d11/df5/df9 0 2024-04-26T21:08:17.920 INFO:tasks.workunit.client.0.smithi055.stdout:2/698: mknod d4/d14/ce3 0 2024-04-26T21:08:17.923 INFO:tasks.workunit.client.0.smithi055.stdout:7/607: link d5/d6/d24/l6d d5/d6/d24/d4d/da7/dab/laf 0 2024-04-26T21:08:17.925 INFO:tasks.workunit.client.1.smithi064.stdout:7/894: rmdir d6/d70/d74/d99 39 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/669: getdents d9/d11/d59/d78 0 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/670: getdents d9/dab 0 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/671: write d9/dc/d1c/f85 [664325,58830] 0 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/672: truncate d9/dc/d1c/d3e/d7d/da3/d97/db6/d67/f93 990729 0 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/673: creat d9/dc/d19/fd4 x:0 0 0 2024-04-26T21:08:17.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/674: write d9/dc/d1c/f4f [493243,95637] 0 2024-04-26T21:08:17.931 INFO:tasks.workunit.client.1.smithi064.stdout:2/986: symlink d12/d41/d61/dd5/d13f/l14e 0 2024-04-26T21:08:17.945 INFO:tasks.workunit.client.1.smithi064.stdout:0/813: symlink dd/d21/db8/l10c 0 2024-04-26T21:08:17.946 INFO:tasks.workunit.client.1.smithi064.stdout:2/987: dread d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/fe5 [0,4194304] 0 2024-04-26T21:08:17.946 INFO:tasks.workunit.client.1.smithi064.stdout:6/832: write d4/d7/d12/d38/f9f [1331684,63188] 0 2024-04-26T21:08:17.947 INFO:tasks.workunit.client.1.smithi064.stdout:2/988: fsync d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d4e/ddc/f9e 0 2024-04-26T21:08:17.949 INFO:tasks.workunit.client.0.smithi055.stdout:4/546: sync 2024-04-26T21:08:17.949 INFO:tasks.workunit.client.0.smithi055.stdout:9/694: mkdir d2/dfa 0 2024-04-26T21:08:17.953 INFO:tasks.workunit.client.0.smithi055.stdout:2/699: mknod d4/db/d1f/d32/d57/ce4 0 2024-04-26T21:08:17.954 INFO:tasks.workunit.client.0.smithi055.stdout:7/608: mknod d5/d53/d6e/d99/d7f/d6f/cb0 0 2024-04-26T21:08:17.956 INFO:tasks.workunit.client.0.smithi055.stdout:1/592: dwrite d8/d17/d1b/d41/f8f [0,4194304] 0 2024-04-26T21:08:17.969 INFO:tasks.workunit.client.0.smithi055.stdout:4/547: read d4/ff [807287,32170] 0 2024-04-26T21:08:17.970 INFO:tasks.workunit.client.1.smithi064.stdout:9/820: creat d0/d4/da/d26/d45/dc4/f10e x:0 0 0 2024-04-26T21:08:17.971 INFO:tasks.workunit.client.0.smithi055.stdout:8/550: rename d3/d9/d1f/d84 to d3/dbc 0 2024-04-26T21:08:17.971 INFO:tasks.workunit.client.0.smithi055.stdout:3/714: dwrite d0/d4/d5/d73/d13/d1a/f35 [0,4194304] 0 2024-04-26T21:08:17.972 INFO:tasks.workunit.client.1.smithi064.stdout:1/974: mknod d0/d6/d11/d1e/d27/c132 0 2024-04-26T21:08:17.974 INFO:tasks.workunit.client.0.smithi055.stdout:7/609: mkdir d5/d6/d90/db1 0 2024-04-26T21:08:17.975 INFO:tasks.workunit.client.1.smithi064.stdout:4/918: rmdir d0/d1d/d21/d9c 39 2024-04-26T21:08:17.975 INFO:tasks.workunit.client.1.smithi064.stdout:4/919: dread - d0/d5/d115/f11c zero size 2024-04-26T21:08:17.975 INFO:tasks.workunit.client.1.smithi064.stdout:4/920: write d0/d5/d13/d6d/f101 [710250,49555] 0 2024-04-26T21:08:17.978 INFO:tasks.workunit.client.1.smithi064.stdout:3/800: creat d1/d27/d29/d6f/d72/f10c x:0 0 0 2024-04-26T21:08:17.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/801: read - d1/d27/d29/d5e/f76 zero size 2024-04-26T21:08:17.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/802: chown d1/d27/d29/d5e/f6d 668213772 1 2024-04-26T21:08:17.979 INFO:tasks.workunit.client.1.smithi064.stdout:3/803: chown d1/d27/d29/d6f 846459097 1 2024-04-26T21:08:17.982 INFO:tasks.workunit.client.1.smithi064.stdout:7/895: symlink d6/db/l131 0 2024-04-26T21:08:17.985 INFO:tasks.workunit.client.1.smithi064.stdout:0/814: mkdir dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d 0 2024-04-26T21:08:17.987 INFO:tasks.workunit.client.0.smithi055.stdout:1/593: link d8/d17/d6a/la5 d8/df/d11/d27/d28/lc7 0 2024-04-26T21:08:17.989 INFO:tasks.workunit.client.1.smithi064.stdout:6/833: mknod d4/d7/d12/d1e/dd4/c118 0 2024-04-26T21:08:17.989 INFO:tasks.workunit.client.1.smithi064.stdout:6/834: write d4/f109 [377920,55209] 0 2024-04-26T21:08:17.990 INFO:tasks.workunit.client.0.smithi055.stdout:4/548: link d4/d26/cb8 d4/d12/d17/d3d/cbc 0 2024-04-26T21:08:17.993 INFO:tasks.workunit.client.1.smithi064.stdout:2/989: mkdir d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/d43/d14f 0 2024-04-26T21:08:17.993 INFO:tasks.workunit.client.1.smithi064.stdout:2/990: chown d12/d41/d61/d6c/l103 2704 1 2024-04-26T21:08:17.994 INFO:tasks.workunit.client.0.smithi055.stdout:5/540: dwrite d4/df/d13/d26/d3c/d4a/d3f/da1/fad [0,4194304] 0 2024-04-26T21:08:17.994 INFO:tasks.workunit.client.0.smithi055.stdout:5/541: chown d4/df/f5d 5 1 2024-04-26T21:08:17.994 INFO:tasks.workunit.client.0.smithi055.stdout:5/542: creat d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/fbc x:0 0 0 2024-04-26T21:08:17.994 INFO:tasks.workunit.client.0.smithi055.stdout:2/700: rename d4/db/d56/fd8 to d4/dc/db6/fe5 0 2024-04-26T21:08:17.996 INFO:tasks.workunit.client.0.smithi055.stdout:7/610: symlink d5/d53/d6e/lb2 0 2024-04-26T21:08:17.997 INFO:tasks.workunit.client.0.smithi055.stdout:7/611: fdatasync d5/d53/d6e/d99/d7f/f96 0 2024-04-26T21:08:17.997 INFO:tasks.workunit.client.0.smithi055.stdout:7/612: creat d5/d53/d6e/d99/d75/fb3 x:0 0 0 2024-04-26T21:08:17.998 INFO:tasks.workunit.client.0.smithi055.stdout:8/551: dread d3/d9/d1f/f9f [0,4194304] 0 2024-04-26T21:08:17.999 INFO:tasks.workunit.client.0.smithi055.stdout:8/552: readlink d3/d9/d1d/d48/d4b/l4e 0 2024-04-26T21:08:17.999 INFO:tasks.workunit.client.0.smithi055.stdout:4/549: truncate d4/d12/d17/d3d/f8c 3587637 0 2024-04-26T21:08:18.001 INFO:tasks.workunit.client.0.smithi055.stdout:0/675: dwrite d9/dc/d1c/f26 [0,4194304] 0 2024-04-26T21:08:18.006 INFO:tasks.workunit.client.0.smithi055.stdout:1/594: write d8/d17/d1b/d7b/d65/f7d [3387333,92716] 0 2024-04-26T21:08:18.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:17 smithi055 ceph-mon[25475]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:18.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:17 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4099140672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:08:18.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/815: read dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f8a [417208,100315] 0 2024-04-26T21:08:18.008 INFO:tasks.workunit.client.1.smithi064.stdout:0/816: write dd/d21/dc8/d31/d47/dad/dfd/d18/f29 [355714,95523] 0 2024-04-26T21:08:18.008 INFO:tasks.workunit.client.1.smithi064.stdout:6/835: read d4/d7/d12/d49/d4b/d5a/daf/db2/f102 [2971071,90385] 0 2024-04-26T21:08:18.009 INFO:tasks.workunit.client.0.smithi055.stdout:5/543: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/dbd 0 2024-04-26T21:08:18.011 INFO:tasks.workunit.client.1.smithi064.stdout:9/821: creat d0/d4/d28/d4f/f10f x:0 0 0 2024-04-26T21:08:18.016 INFO:tasks.workunit.client.0.smithi055.stdout:3/715: rename d0/d4/d5/d73/d13/d27/d50/d6b/d83/fc3 to d0/d4/ff9 0 2024-04-26T21:08:18.016 INFO:tasks.workunit.client.0.smithi055.stdout:3/716: fsync d0/d4/d16/d18/d4b/d57/f67 0 2024-04-26T21:08:18.018 INFO:tasks.workunit.client.1.smithi064.stdout:1/975: mknod d0/d22/c133 0 2024-04-26T21:08:18.021 INFO:tasks.workunit.client.0.smithi055.stdout:2/701: creat d4/d14/d33/fe6 x:0 0 0 2024-04-26T21:08:18.021 INFO:tasks.workunit.client.0.smithi055.stdout:2/702: dread - d4/d14/d17/d36/fac zero size 2024-04-26T21:08:18.033 INFO:tasks.workunit.client.1.smithi064.stdout:3/804: mkdir d1/d27/d29/d5e/d10d 0 2024-04-26T21:08:18.033 INFO:tasks.workunit.client.1.smithi064.stdout:7/896: mkdir d6/d9/d3d/d132 0 2024-04-26T21:08:18.033 INFO:tasks.workunit.client.1.smithi064.stdout:7/897: creat d6/d9/d77/f133 x:0 0 0 2024-04-26T21:08:18.034 INFO:tasks.workunit.client.1.smithi064.stdout:2/991: rename d12/d41/d73/d83/d94/d3a/d46/d48/d85/f11c to d12/d41/d73/d83/d94/d3a/d46/d6a/f150 0 2024-04-26T21:08:18.042 INFO:tasks.workunit.client.0.smithi055.stdout:7/613: mknod d5/d53/d6e/d99/d7f/d6f/da8/cb4 0 2024-04-26T21:08:18.048 INFO:tasks.workunit.client.1.smithi064.stdout:4/921: link d0/d2f/d69/db5/dba/cc3 d0/d14/c133 0 2024-04-26T21:08:18.048 INFO:tasks.workunit.client.1.smithi064.stdout:0/817: read dd/d21/dc8/d31/d47/dad/dfd/d74/f92 [383626,90445] 0 2024-04-26T21:08:18.049 INFO:tasks.workunit.client.1.smithi064.stdout:8/757: sync 2024-04-26T21:08:18.049 INFO:tasks.workunit.client.1.smithi064.stdout:3/805: truncate d1/d27/d29/d6f/d72/f40 646068 0 2024-04-26T21:08:18.056 INFO:tasks.workunit.client.1.smithi064.stdout:5/792: dwrite dd/d12/d18/d1a/d1f/d20/f38 [0,4194304] 0 2024-04-26T21:08:18.056 INFO:tasks.workunit.client.1.smithi064.stdout:6/836: rename d4/d7/d12/d49/de1/ff9 to d4/d7/d33/f119 0 2024-04-26T21:08:18.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/992: unlink d12/d41/d73/d83/d94/d3a/d46/d48/d85/d2f/d53/l5c 0 2024-04-26T21:08:18.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/993: write d12/d41/d61/fdb [118465,84818] 0 2024-04-26T21:08:18.056 INFO:tasks.workunit.client.1.smithi064.stdout:2/994: chown d12/d41/d73/d83/d94/d3a/d46/d48/d85/d29/f138 1587 1 2024-04-26T21:08:18.057 INFO:tasks.workunit.client.0.smithi055.stdout:0/676: rename d9/d11/c4c to d9/dc/d1c/d3e/dcd/cd5 0 2024-04-26T21:08:18.058 INFO:tasks.workunit.client.0.smithi055.stdout:4/550: dread d4/f1d [0,4194304] 0 2024-04-26T21:08:18.059 INFO:tasks.workunit.client.0.smithi055.stdout:3/717: symlink d0/d4/d5/d73/d47/d37/d3d/df7/lfa 0 2024-04-26T21:08:18.061 INFO:tasks.workunit.client.0.smithi055.stdout:2/703: symlink d4/d49/le7 0 2024-04-26T21:08:18.062 INFO:tasks.workunit.client.0.smithi055.stdout:2/704: dread - d4/d1e/d2a/fd6 zero size 2024-04-26T21:08:18.064 INFO:tasks.workunit.client.0.smithi055.stdout:7/614: mknod d5/d53/d6e/d99/d58/cb5 0 2024-04-26T21:08:18.064 INFO:tasks.workunit.client.0.smithi055.stdout:7/615: fdatasync d5/f29 0 2024-04-26T21:08:18.068 INFO:tasks.workunit.client.0.smithi055.stdout:2/705: dread d4/d49/d4c/faa [0,4194304] 0 2024-04-26T21:08:18.071 INFO:tasks.workunit.client.0.smithi055.stdout:0/677: link d9/dc/d1c/f4f d9/dc/d1c/d3e/d7d/da3/d97/fd6 0 2024-04-26T21:08:18.071 INFO:tasks.workunit.client.0.smithi055.stdout:0/678: readlink d9/dc/d1c/l2b 0 2024-04-26T21:08:18.074 INFO:tasks.workunit.client.0.smithi055.stdout:4/551: getdents d4/d12 0 2024-04-26T21:08:18.075 INFO:tasks.workunit.client.1.smithi064.stdout:9/822: dwrite d0/d4/da/d26/d5e/dee/ff0 [0,4194304] 0 2024-04-26T21:08:18.078 INFO:tasks.workunit.client.0.smithi055.stdout:5/544: rename d4/df/d13/d26/f2f to d4/df/d13/d26/d3c/d4a/d3f/fbe 0 2024-04-26T21:08:18.082 INFO:tasks.workunit.client.0.smithi055.stdout:7/616: mkdir d5/db/db6 0 2024-04-26T21:08:18.091 INFO:tasks.workunit.client.0.smithi055.stdout:2/706: link d4/d14/d17/l61 d4/db/d56/d4a/le8 0 2024-04-26T21:08:18.094 INFO:tasks.workunit.client.0.smithi055.stdout:0/679: symlink d9/dc/d1c/d3e/d7d/da3/d82/ld7 0 2024-04-26T21:08:18.097 INFO:tasks.workunit.client.0.smithi055.stdout:5/545: symlink d4/df/d13/d26/d63/lbf 0 2024-04-26T21:08:18.097 INFO:tasks.workunit.client.0.smithi055.stdout:5/546: fdatasync d4/f9 0 2024-04-26T21:08:18.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/617: creat d5/d6/d90/fb7 x:0 0 0 2024-04-26T21:08:18.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/618: fsync d5/d6/f41 0 2024-04-26T21:08:18.103 INFO:tasks.workunit.client.0.smithi055.stdout:2/707: creat d4/d49/d4c/d5e/d7d/fe9 x:0 0 0 2024-04-26T21:08:18.103 INFO:tasks.workunit.client.0.smithi055.stdout:2/708: creat d4/db/fea x:0 0 0 2024-04-26T21:08:18.108 INFO:tasks.workunit.client.0.smithi055.stdout:0/680: truncate d9/dc/d1c/d3e/fa2 754759 0 2024-04-26T21:08:18.108 INFO:tasks.workunit.client.0.smithi055.stdout:5/547: mkdir d4/df/d13/d26/d3c/dc0 0 2024-04-26T21:08:18.109 INFO:tasks.workunit.client.1.smithi064.stdout:2/995: write d12/d41/d61/d6c/fc8 [949899,77354] 0 2024-04-26T21:08:18.109 INFO:tasks.workunit.client.1.smithi064.stdout:2/996: dread - d12/d41/d73/d83/d94/d3a/d46/d6a/d86/fd6 zero size 2024-04-26T21:08:18.109 INFO:tasks.workunit.client.1.smithi064.stdout:2/997: write d12/d41/d61/dd5/f144 [475112,3952] 0 2024-04-26T21:08:18.110 INFO:tasks.workunit.client.0.smithi055.stdout:1/595: dwrite d8/d17/d1b/d41/f7f [0,4194304] 0 2024-04-26T21:08:18.110 INFO:tasks.workunit.client.0.smithi055.stdout:1/596: dread - d8/d17/d6a/fbd zero size 2024-04-26T21:08:18.110 INFO:tasks.workunit.client.0.smithi055.stdout:1/597: stat d8/d17 0 2024-04-26T21:08:18.110 INFO:tasks.workunit.client.0.smithi055.stdout:1/598: read - d8/df/d11/d27/fc2 zero size 2024-04-26T21:08:18.111 INFO:tasks.workunit.client.1.smithi064.stdout:1/976: rmdir d0 39 2024-04-26T21:08:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.109+0000 7eff99600700 1 -- 172.21.15.55:0/1282378936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94101720 msgr2=0x7eff94103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.109+0000 7eff99600700 1 --2- 172.21.15.55:0/1282378936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94101720 0x7eff94103b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff84009910 tx=0x7eff84009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:18.112 INFO:tasks.workunit.client.1.smithi064.stdout:6/837: getdents d4/d7/d12/d49/d4b/d5a 0 2024-04-26T21:08:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.110+0000 7eff99600700 1 -- 172.21.15.55:0/1282378936 shutdown_connections 2024-04-26T21:08:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.110+0000 7eff99600700 1 --2- 172.21.15.55:0/1282378936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff94104050 0x7eff94106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.110+0000 7eff99600700 1 --2- 172.21.15.55:0/1282378936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94101720 0x7eff94103b10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.110+0000 7eff99600700 1 -- 172.21.15.55:0/1282378936 >> 172.21.15.55:0/1282378936 conn(0x7eff940fb110 msgr2=0x7eff940fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:18.114 INFO:tasks.workunit.client.1.smithi064.stdout:7/898: rename d6/d15/d88/dca/f104 to d6/d9/d77/f134 0 2024-04-26T21:08:18.114 INFO:tasks.workunit.client.1.smithi064.stdout:7/899: dread - d6/db/f112 zero size 2024-04-26T21:08:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.112+0000 7eff99600700 1 -- 172.21.15.55:0/1282378936 shutdown_connections 2024-04-26T21:08:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.112+0000 7eff99600700 1 -- 172.21.15.55:0/1282378936 wait complete. 2024-04-26T21:08:18.115 INFO:tasks.workunit.client.0.smithi055.stdout:2/709: mknod d4/d1e/d2a/ceb 0 2024-04-26T21:08:18.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.113+0000 7eff99600700 1 Processor -- start 2024-04-26T21:08:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.114+0000 7eff99600700 1 -- start start 2024-04-26T21:08:18.117 INFO:tasks.workunit.client.1.smithi064.stdout:9/823: write d0/d4/d7/fb5 [1122229,12756] 0 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.115+0000 7eff99600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff94198bf0 0x7eff94199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.115+0000 7eff99600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.115+0000 7eff99600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9419e660 con 0x7eff94199550 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.115+0000 7eff99600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9419e7a0 con 0x7eff94198bf0 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.115+0000 7eff8a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.116+0000 7eff8a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45680/0 (socket says 172.21.15.55:45680) 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.116+0000 7eff8a000700 1 -- 172.21.15.55:0/3867071203 learned_addr learned my addr 172.21.15.55:0/3867071203 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.117+0000 7eff8a000700 1 -- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff94198bf0 msgr2=0x7eff94199010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.117+0000 7eff8a000700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff94198bf0 0x7eff94199010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.117+0000 7eff8a000700 1 -- 172.21.15.55:0/3867071203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840095f0 con 0x7eff94199550 2024-04-26T21:08:18.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.119+0000 7eff8a000700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b480 tx=0x7eff7c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:18.121 INFO:tasks.workunit.client.0.smithi055.stdout:5/548: creat d4/df/d13/d26/d3c/d4a/d3f/d5c/db9/fc1 x:0 0 0 2024-04-26T21:08:18.121 INFO:tasks.workunit.client.0.smithi055.stdout:5/549: fsync d4/df/d13/d26/d3c/f71 0 2024-04-26T21:08:18.122 INFO:tasks.workunit.client.0.smithi055.stdout:0/681: mknod d9/dc/d1c/d3e/d7d/da3/d97/db6/cd8 0 2024-04-26T21:08:18.122 INFO:tasks.workunit.client.1.smithi064.stdout:2/998: mknod d12/d88/c151 0 2024-04-26T21:08:18.122 INFO:tasks.workunit.client.1.smithi064.stdout:1/977: symlink d0/d6/d29/d31/dd1/d10a/l134 0 2024-04-26T21:08:18.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.122+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff7c011800 con 0x7eff94199550 2024-04-26T21:08:18.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.122+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff7c011e20 con 0x7eff94199550 2024-04-26T21:08:18.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.122+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff7c00f2e0 con 0x7eff94199550 2024-04-26T21:08:18.125 INFO:tasks.workunit.client.0.smithi055.stdout:5/550: symlink d4/df/d13/d26/d3c/d4a/lc2 0 2024-04-26T21:08:18.126 INFO:tasks.workunit.client.1.smithi064.stdout:2/999: write d12/d41/d73/d83/fb2 [478319,87014] 0 2024-04-26T21:08:18.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.124+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9419ea80 con 0x7eff94199550 2024-04-26T21:08:18.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.124+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9419f050 con 0x7eff94199550 2024-04-26T21:08:18.127 INFO:tasks.workunit.client.0.smithi055.stdout:0/682: creat d9/dc/d1c/d3e/d7d/da3/d82/fd9 x:0 0 0 2024-04-26T21:08:18.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.126+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940fcd00 con 0x7eff94199550 2024-04-26T21:08:18.128 INFO:tasks.workunit.client.1.smithi064.stdout:6/838: mknod d4/d7/d12/d38/c11a 0 2024-04-26T21:08:18.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.134+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 92708+0+0 (secure 0 0 0) 0x7eff7c010380 con 0x7eff94199550 2024-04-26T21:08:18.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.135+0000 7eff8be00700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 0x7eff78070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:18.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.135+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5726+0+0 (secure 0 0 0) 0x7eff7c08e840 con 0x7eff94199550 2024-04-26T21:08:18.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.136+0000 7eff92a00700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 0x7eff78070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:18.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.138+0000 7eff92a00700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 0x7eff78070f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff84005090 tx=0x7eff84005fb0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:18.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.147+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7eff7c05b730 con 0x7eff94199550 2024-04-26T21:08:18.150 INFO:tasks.workunit.client.1.smithi064.stdout:3/806: dwrite d1/d38/f6c [0,4194304] 0 2024-04-26T21:08:18.150 INFO:tasks.workunit.client.1.smithi064.stdout:3/807: dread - d1/d27/d29/d6f/d72/d7a/d84/fe8 zero size 2024-04-26T21:08:18.150 INFO:tasks.workunit.client.1.smithi064.stdout:3/808: dread - d1/d27/d29/d5e/f76 zero size 2024-04-26T21:08:18.151 INFO:tasks.workunit.client.1.smithi064.stdout:3/809: write d1/d27/d29/d6f/d72/da5/d7d/fde [443657,22933] 0 2024-04-26T21:08:18.154 INFO:tasks.workunit.client.1.smithi064.stdout:0/818: dwrite dd/d21/dc8/d31/d47/dad/dce/fd2 [0,4194304] 0 2024-04-26T21:08:18.163 INFO:tasks.workunit.client.0.smithi055.stdout:2/710: dread d4/dc/d21/f96 [0,4194304] 0 2024-04-26T21:08:18.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/718: dwrite d0/d4/d16/d18/d4b/feb [0,4194304] 0 2024-04-26T21:08:18.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/719: truncate d0/d4/d16/f70 1271229 0 2024-04-26T21:08:18.168 INFO:tasks.workunit.client.1.smithi064.stdout:4/922: dwrite d0/d1d/d56/fd4 [0,4194304] 0 2024-04-26T21:08:18.170 INFO:tasks.workunit.client.0.smithi055.stdout:1/599: dwrite d8/df/d11/d27/fc3 [0,4194304] 0 2024-04-26T21:08:18.170 INFO:tasks.workunit.client.1.smithi064.stdout:5/793: dwrite dd/da9/d48/d6a/f8d [0,4194304] 0 2024-04-26T21:08:18.178 INFO:tasks.workunit.client.1.smithi064.stdout:8/758: dwrite d10/d41/d44/d5a/da2/fe8 [0,4194304] 0 2024-04-26T21:08:18.178 INFO:tasks.workunit.client.1.smithi064.stdout:3/810: dread d1/d27/d29/d6f/d72/da5/d7d/fad [4194304,4194304] 0 2024-04-26T21:08:18.180 INFO:tasks.workunit.client.0.smithi055.stdout:7/619: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:18.190 INFO:tasks.workunit.client.0.smithi055.stdout:2/711: write d4/db/f15 [3246668,103597] 0 2024-04-26T21:08:18.195 INFO:tasks.workunit.client.1.smithi064.stdout:9/824: dwrite d0/d4/da/d31/d34/fe4 [0,4194304] 0 2024-04-26T21:08:18.206 INFO:tasks.workunit.client.0.smithi055.stdout:7/620: write d5/d6/d24/f38 [815323,11140] 0 2024-04-26T21:08:18.208 INFO:tasks.workunit.client.1.smithi064.stdout:1/978: dwrite d0/d22/f102 [0,4194304] 0 2024-04-26T21:08:18.208 INFO:tasks.workunit.client.1.smithi064.stdout:1/979: fsync d0/d6/d11/f7a 0 2024-04-26T21:08:18.210 INFO:tasks.workunit.client.1.smithi064.stdout:1/980: write d0/d6/d76/faf [167814,58098] 0 2024-04-26T21:08:18.230 INFO:tasks.workunit.client.0.smithi055.stdout:5/551: rename d4/df/d13/d26/d3c/f79 to d4/df/d13/d26/d63/fc3 0 2024-04-26T21:08:18.237 INFO:tasks.workunit.client.1.smithi064.stdout:6/839: mkdir d4/d7/d12/d49/d4b/d5a/daf/db2/d11b 0 2024-04-26T21:08:18.255 INFO:tasks.workunit.client.1.smithi064.stdout:0/819: dwrite dd/d21/dc8/d31/d43/fb9 [0,4194304] 0 2024-04-26T21:08:18.255 INFO:tasks.workunit.client.1.smithi064.stdout:7/900: dwrite d6/db/d34/f106 [0,4194304] 0 2024-04-26T21:08:18.256 INFO:tasks.workunit.client.1.smithi064.stdout:7/901: fdatasync d6/d70/da8/fb2 0 2024-04-26T21:08:18.273 INFO:tasks.workunit.client.1.smithi064.stdout:3/811: dread d1/d27/d50/fb [0,4194304] 0 2024-04-26T21:08:18.274 INFO:tasks.workunit.client.0.smithi055.stdout:0/683: truncate d9/d11/d59/f7f 1108943 0 2024-04-26T21:08:18.274 INFO:tasks.workunit.client.0.smithi055.stdout:0/684: chown d9/dc/d1c/d3e/fae 8052519 1 2024-04-26T21:08:18.274 INFO:tasks.workunit.client.0.smithi055.stdout:0/685: truncate d9/dc/d1c/d3e/fd3 590532 0 2024-04-26T21:08:18.291 INFO:tasks.workunit.client.0.smithi055.stdout:5/552: dwrite d4/df/d13/d26/d3c/d4a/d3f/d4f/f75 [0,4194304] 0 2024-04-26T21:08:18.292 INFO:tasks.workunit.client.1.smithi064.stdout:8/759: dwrite d10/d1d/f29 [0,4194304] 0 2024-04-26T21:08:18.292 INFO:tasks.workunit.client.1.smithi064.stdout:8/760: dread - d10/d41/d4e/d59/d5d/d79/feb zero size 2024-04-26T21:08:18.293 INFO:tasks.workunit.client.1.smithi064.stdout:9/825: dwrite d0/fc7 [0,4194304] 0 2024-04-26T21:08:18.300 INFO:tasks.workunit.client.1.smithi064.stdout:4/923: link d0/d5/d79/dd1/da0/l127 d0/d1d/d17/d44/dac/da9/d12f/l134 0 2024-04-26T21:08:18.301 INFO:tasks.workunit.client.1.smithi064.stdout:8/761: dread d10/d41/d44/fb5 [0,4194304] 0 2024-04-26T21:08:18.301 INFO:tasks.workunit.client.1.smithi064.stdout:8/762: write d10/d41/d4e/d60/fad [526627,61810] 0 2024-04-26T21:08:18.307 INFO:tasks.workunit.client.0.smithi055.stdout:3/720: creat d0/d4/d5/d73/d13/d27/d50/d6b/ffb x:0 0 0 2024-04-26T21:08:18.326 INFO:tasks.workunit.client.1.smithi064.stdout:4/924: dread d0/d5/d13/d6d/f83 [0,4194304] 0 2024-04-26T21:08:18.330 INFO:tasks.workunit.client.0.smithi055.stdout:1/600: getdents d8/d17/d33/dc5 0 2024-04-26T21:08:18.332 INFO:tasks.workunit.client.1.smithi064.stdout:8/763: write d10/d1d/f29 [3643807,70756] 0 2024-04-26T21:08:18.332 INFO:tasks.workunit.client.1.smithi064.stdout:8/764: write d10/d41/d4e/d59/fba [359709,12878] 0 2024-04-26T21:08:18.332 INFO:tasks.workunit.client.1.smithi064.stdout:8/765: truncate d10/d41/d4e/d54/f57 847841 0 2024-04-26T21:08:18.357 INFO:tasks.workunit.client.1.smithi064.stdout:8/766: dread d10/d1d/d38/f39 [0,4194304] 0 2024-04-26T21:08:18.357 INFO:tasks.workunit.client.1.smithi064.stdout:8/767: fsync d10/fcd 0 2024-04-26T21:08:18.358 INFO:tasks.workunit.client.1.smithi064.stdout:8/768: readlink d10/d41/d44/ldb 0 2024-04-26T21:08:18.358 INFO:tasks.workunit.client.1.smithi064.stdout:8/769: fsync d10/d41/d4e/d54/f57 0 2024-04-26T21:08:18.387 INFO:tasks.workunit.client.1.smithi064.stdout:9/826: dwrite d0/d4/da/d26/f6f [0,4194304] 0 2024-04-26T21:08:18.399 INFO:tasks.workunit.client.0.smithi055.stdout:0/686: dwrite d9/dc/d1c/d3e/dc5/dcc/d4b/fc6 [0,4194304] 0 2024-04-26T21:08:18.401 INFO:tasks.workunit.client.0.smithi055.stdout:2/712: truncate d4/fb9 1244348 0 2024-04-26T21:08:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:17 smithi064 ceph-mon[33404]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:17 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4099140672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:08:18.406 INFO:tasks.workunit.client.1.smithi064.stdout:8/770: dwrite d10/d1d/da3/fc1 [4194304,4194304] 0 2024-04-26T21:08:18.415 INFO:tasks.workunit.client.1.smithi064.stdout:1/981: creat d0/d6b/d9e/da2/dc9/f135 x:0 0 0 2024-04-26T21:08:18.430 INFO:tasks.workunit.client.0.smithi055.stdout:7/621: symlink d5/d53/d6e/d6c/lb8 0 2024-04-26T21:08:18.462 INFO:tasks.workunit.client.1.smithi064.stdout:6/840: mkdir d4/d7/d12/d49/d4b/d101/d11c 0 2024-04-26T21:08:18.465 INFO:tasks.workunit.client.1.smithi064.stdout:0/820: creat dd/d21/dc8/d31/d43/db4/f10e x:0 0 0 2024-04-26T21:08:18.469 INFO:tasks.workunit.client.1.smithi064.stdout:7/902: creat d6/d70/d74/d116/f135 x:0 0 0 2024-04-26T21:08:18.473 INFO:tasks.workunit.client.1.smithi064.stdout:3/812: mknod d1/d27/d50/d35/d4c/d7b/d8e/c10e 0 2024-04-26T21:08:18.474 INFO:tasks.workunit.client.0.smithi055.stdout:0/687: dwrite d9/d11/d5b/f90 [0,4194304] 0 2024-04-26T21:08:18.484 INFO:tasks.workunit.client.1.smithi064.stdout:5/794: rename dd/d12/d18/d25/d74/cef to dd/da9/d48/d6a/d9e/c100 0 2024-04-26T21:08:18.511 INFO:tasks.workunit.client.0.smithi055.stdout:5/553: mkdir d4/df/d13/d26/d3c/d93/dc4 0 2024-04-26T21:08:18.511 INFO:tasks.workunit.client.1.smithi064.stdout:9/827: symlink d0/d4/d28/l110 0 2024-04-26T21:08:18.527 INFO:tasks.workunit.client.0.smithi055.stdout:2/713: symlink d4/db/d56/d4a/lec 0 2024-04-26T21:08:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.534+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 --> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff9402cf30 con 0x7eff7806ea70 2024-04-26T21:08:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.538+0000 7eff8be00700 1 -- 172.21.15.55:0/3867071203 <== mgr.24377 v2:172.21.15.64:6828/1518549536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7eff9402cf30 con 0x7eff7806ea70 2024-04-26T21:08:18.539 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mgr daemons", 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:08:18.540 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:08:18.540 INFO:tasks.workunit.client.0.smithi055.stdout:5/554: creat d4/df/d13/d26/d3c/d4a/d3f/fc5 x:0 0 0 2024-04-26T21:08:18.541 INFO:tasks.workunit.client.0.smithi055.stdout:5/555: stat d4/df/d13/d26/d3c/d4a/d3f/d2e 0 2024-04-26T21:08:18.543 INFO:tasks.workunit.client.1.smithi064.stdout:8/771: truncate d10/d2f/d61/f88 2671533 0 2024-04-26T21:08:18.543 INFO:tasks.workunit.client.1.smithi064.stdout:8/772: truncate d10/d41/d4e/d59/d5d/d79/fb1 75911 0 2024-04-26T21:08:18.543 INFO:tasks.workunit.client.1.smithi064.stdout:8/773: getdents d10 0 2024-04-26T21:08:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.541+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 msgr2=0x7eff78070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.541+0000 7eff99600700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 0x7eff78070f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff84005090 tx=0x7eff84005fb0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.541+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 msgr2=0x7eff9419e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.541+0000 7eff99600700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b480 tx=0x7eff7c00b840 comp rx=0 tx=0).stop 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 shutdown_connections 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:6828/1518549536,v1:172.21.15.64:6829/1518549536] conn(0x7eff7806ea70 0x7eff78070f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff94198bf0 0x7eff94199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 --2- 172.21.15.55:0/3867071203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff94199550 0x7eff9419e120 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 >> 172.21.15.55:0/3867071203 conn(0x7eff940fb110 msgr2=0x7eff94102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 shutdown_connections 2024-04-26T21:08:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:18.543+0000 7eff99600700 1 -- 172.21.15.55:0/3867071203 wait complete. 2024-04-26T21:08:18.547 INFO:tasks.workunit.client.1.smithi064.stdout:1/982: truncate d0/d6/d11/d1e/d2a/d34/d57/d66/f7e 1447602 0 2024-04-26T21:08:18.555 INFO:tasks.workunit.client.1.smithi064.stdout:0/821: symlink dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/l10f 0 2024-04-26T21:08:18.558 INFO:tasks.workunit.client.1.smithi064.stdout:7/903: creat d6/db/d1f/f136 x:0 0 0 2024-04-26T21:08:18.559 INFO:tasks.workunit.client.1.smithi064.stdout:5/795: mkdir dd/da9/d48/d6a/d101 0 2024-04-26T21:08:18.563 INFO:tasks.workunit.client.1.smithi064.stdout:9/828: unlink d0/d4/da/d67/dd0/dd2/lf4 0 2024-04-26T21:08:18.565 INFO:tasks.workunit.client.1.smithi064.stdout:1/983: rename d0/d6/d11/l5a to d0/d6/d11/d1e/d2a/d34/d57/d118/l136 0 2024-04-26T21:08:18.569 INFO:tasks.workunit.client.1.smithi064.stdout:3/813: dwrite d1/d27/d29/f104 [0,4194304] 0 2024-04-26T21:08:18.570 INFO:tasks.workunit.client.1.smithi064.stdout:0/822: mkdir dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/d110 0 2024-04-26T21:08:18.570 INFO:tasks.workunit.client.1.smithi064.stdout:0/823: stat dd/f14 0 2024-04-26T21:08:18.571 INFO:tasks.workunit.client.1.smithi064.stdout:7/904: symlink d6/d15/d88/dca/d5c/ded/l137 0 2024-04-26T21:08:18.571 INFO:tasks.workunit.client.1.smithi064.stdout:6/841: dread d4/d7/d33/f89 [0,4194304] 0 2024-04-26T21:08:18.571 INFO:tasks.workunit.client.1.smithi064.stdout:6/842: readlink d4/l7c 0 2024-04-26T21:08:18.572 INFO:tasks.workunit.client.1.smithi064.stdout:9/829: creat d0/d4/da/d31/d10c/f111 x:0 0 0 2024-04-26T21:08:18.580 INFO:tasks.workunit.client.1.smithi064.stdout:3/814: rename d1/d27/d50/c42 to d1/d27/d29/d6f/d72/d26/c10f 0 2024-04-26T21:08:18.580 INFO:tasks.workunit.client.1.smithi064.stdout:3/815: fdatasync d1/d27/d29/d6f/d72/d73/f85 0 2024-04-26T21:08:18.586 INFO:tasks.workunit.client.1.smithi064.stdout:9/830: rename d0/d4/da/d26/d47/d9d/ce8 to d0/d4/da/d26/d45/dfd/c112 0 2024-04-26T21:08:18.586 INFO:tasks.workunit.client.1.smithi064.stdout:9/831: read d0/d4/da/d67/dd0/dd2/f8b [1674387,55899] 0 2024-04-26T21:08:18.588 INFO:tasks.workunit.client.1.smithi064.stdout:6/843: mkdir d4/d7/d12/d38/de6/dc1/d11d 0 2024-04-26T21:08:18.589 INFO:tasks.workunit.client.1.smithi064.stdout:7/905: truncate d6/f24 511324 0 2024-04-26T21:08:18.589 INFO:tasks.workunit.client.1.smithi064.stdout:7/906: write d6/db/d1f/d50/db8/deb/ffd [588456,117168] 0 2024-04-26T21:08:18.590 INFO:tasks.workunit.client.1.smithi064.stdout:5/796: dread dd/d12/d18/d1a/d1b/f52 [0,4194304] 0 2024-04-26T21:08:18.590 INFO:tasks.workunit.client.0.smithi055.stdout:5/556: dwrite d4/d15/f52 [0,4194304] 0 2024-04-26T21:08:18.590 INFO:tasks.workunit.client.1.smithi064.stdout:5/797: write dd/d12/d4f/d9c/da1/fc0 [167042,84768] 0 2024-04-26T21:08:18.591 INFO:tasks.workunit.client.1.smithi064.stdout:3/816: rename d1/d27/d29/d6f/d72/ld5 to d1/d27/d29/d6f/d72/d73/l110 0 2024-04-26T21:08:18.594 INFO:tasks.workunit.client.1.smithi064.stdout:7/907: mknod d6/db/d34/d6f/d81/c138 0 2024-04-26T21:08:18.594 INFO:tasks.workunit.client.1.smithi064.stdout:7/908: chown d6/db/d1f/d50/f57 450 1 2024-04-26T21:08:18.595 INFO:tasks.workunit.client.1.smithi064.stdout:5/798: unlink dd/d12/d18/d25/d67/db3/fbf 0 2024-04-26T21:08:18.597 INFO:tasks.workunit.client.1.smithi064.stdout:3/817: truncate d1/d14/f31 1125440 0 2024-04-26T21:08:18.601 INFO:tasks.workunit.client.1.smithi064.stdout:7/909: creat d6/db/d34/da7/f139 x:0 0 0 2024-04-26T21:08:18.601 INFO:tasks.workunit.client.1.smithi064.stdout:5/799: link dd/d12/f40 dd/d12/f102 0 2024-04-26T21:08:18.601 INFO:tasks.workunit.client.1.smithi064.stdout:7/910: chown d6/d70/da8/dd1/d12e 0 1 2024-04-26T21:08:18.602 INFO:tasks.workunit.client.1.smithi064.stdout:5/800: read - dd/d12/d4f/dbd/fe1 zero size 2024-04-26T21:08:18.604 INFO:tasks.workunit.client.1.smithi064.stdout:7/911: symlink d6/d5a/l13a 0 2024-04-26T21:08:18.606 INFO:tasks.workunit.client.1.smithi064.stdout:7/912: mknod d6/d9/d3d/c13b 0 2024-04-26T21:08:18.608 INFO:tasks.workunit.client.1.smithi064.stdout:7/913: creat d6/d9/f13c x:0 0 0 2024-04-26T21:08:18.615 INFO:tasks.workunit.client.1.smithi064.stdout:1/984: symlink d0/d6/l137 0 2024-04-26T21:08:18.615 INFO:tasks.workunit.client.1.smithi064.stdout:1/985: chown d0/d6b 1779 1 2024-04-26T21:08:18.623 INFO:tasks.workunit.client.1.smithi064.stdout:1/986: unlink d0/d6/l10f 0 2024-04-26T21:08:18.636 INFO:tasks.workunit.client.1.smithi064.stdout:0/824: creat dd/d21/dc8/d31/d47/d61/f111 x:0 0 0 2024-04-26T21:08:18.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/987: dread d0/d6/d29/d31/f4c [0,4194304] 0 2024-04-26T21:08:18.640 INFO:tasks.workunit.client.1.smithi064.stdout:1/988: fsync d0/d22/d9f/fd4 0 2024-04-26T21:08:18.657 INFO:tasks.workunit.client.1.smithi064.stdout:6/844: creat d4/d7/d12/d49/f11e x:0 0 0 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/818: dwrite d1/d27/d29/d6f/d72/f40 [0,4194304] 0 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/819: readlink d1/d27/d50/d35/d4c/d7b/d82/la4 0 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/820: stat d1/d38/fd2 0 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/821: chown d1/d27/d50/d35/d4c/d7b/d8e/fda 2425290 1 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/822: dread - d1/d27/d29/d6f/d72/d73/f10a zero size 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.1.smithi064.stdout:3/823: creat d1/d27/d50/d35/db9/f111 x:0 0 0 2024-04-26T21:08:18.659 INFO:tasks.workunit.client.0.smithi055.stdout:7/622: write d5/d6/ff [203464,85163] 0 2024-04-26T21:08:18.660 INFO:tasks.workunit.client.0.smithi055.stdout:7/623: truncate d5/d53/d6e/d99/d75/fad 1001637 0 2024-04-26T21:08:18.660 INFO:tasks.workunit.client.0.smithi055.stdout:5/557: unlink d4/df/d13/d26/f76 0 2024-04-26T21:08:18.667 INFO:tasks.workunit.client.1.smithi064.stdout:1/989: write d0/d6/d91/d92/fbf [4063311,9175] 0 2024-04-26T21:08:18.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/832: rename d0/f18 to d0/d4/da/d26/d45/dc4/f113 0 2024-04-26T21:08:18.672 INFO:tasks.workunit.client.1.smithi064.stdout:1/990: creat d0/d6/d11/d2c/d9c/dbc/f138 x:0 0 0 2024-04-26T21:08:18.672 INFO:tasks.workunit.client.1.smithi064.stdout:1/991: write d0/d6b/f9d [4341548,79284] 0 2024-04-26T21:08:18.673 INFO:tasks.workunit.client.1.smithi064.stdout:9/833: truncate d0/f59 3945651 0 2024-04-26T21:08:18.673 INFO:tasks.workunit.client.1.smithi064.stdout:9/834: fsync d0/d4/da/d26/d5d/fb0 0 2024-04-26T21:08:18.675 INFO:tasks.workunit.client.1.smithi064.stdout:1/992: mkdir d0/d6/d11/d2c/d9c/d139 0 2024-04-26T21:08:18.679 INFO:tasks.workunit.client.1.smithi064.stdout:0/825: dread dd/f30 [0,4194304] 0 2024-04-26T21:08:18.679 INFO:tasks.workunit.client.1.smithi064.stdout:4/925: sync 2024-04-26T21:08:18.679 INFO:tasks.workunit.client.1.smithi064.stdout:4/926: read d0/d2f/f6f [385143,119679] 0 2024-04-26T21:08:18.681 INFO:tasks.workunit.client.1.smithi064.stdout:0/826: mkdir dd/d21/dc8/d31/d47/d61/d112 0 2024-04-26T21:08:18.681 INFO:tasks.workunit.client.1.smithi064.stdout:4/927: symlink d0/d5/d13/d6d/d97/l135 0 2024-04-26T21:08:18.682 INFO:tasks.workunit.client.1.smithi064.stdout:4/928: fsync d0/d5/d13/d6d/f59 0 2024-04-26T21:08:18.685 INFO:tasks.workunit.client.1.smithi064.stdout:7/914: dwrite d6/d9/f36 [0,4194304] 0 2024-04-26T21:08:18.685 INFO:tasks.workunit.client.1.smithi064.stdout:7/915: fsync d6/d9/d3d/fe1 0 2024-04-26T21:08:18.685 INFO:tasks.workunit.client.1.smithi064.stdout:4/929: truncate d0/d2f/d7d/f8a 565145 0 2024-04-26T21:08:18.689 INFO:tasks.workunit.client.1.smithi064.stdout:7/916: rename d6/d5a/l72 to d6/d70/da8/dd7/l13d 0 2024-04-26T21:08:18.694 INFO:tasks.workunit.client.1.smithi064.stdout:4/930: creat d0/d2f/df1/f136 x:0 0 0 2024-04-26T21:08:18.694 INFO:tasks.workunit.client.1.smithi064.stdout:4/931: chown d0/d5 377133 1 2024-04-26T21:08:18.694 INFO:tasks.workunit.client.1.smithi064.stdout:4/932: fdatasync d0/d5/d79/f8c 0 2024-04-26T21:08:18.696 INFO:tasks.workunit.client.1.smithi064.stdout:7/917: mkdir d6/db/d34/d6f/dff/d13e 0 2024-04-26T21:08:18.696 INFO:tasks.workunit.client.1.smithi064.stdout:7/918: fdatasync d6/d9/d38/f95 0 2024-04-26T21:08:18.696 INFO:tasks.workunit.client.1.smithi064.stdout:7/919: write d6/d15/d88/dca/fc6 [5299096,86219] 0 2024-04-26T21:08:18.701 INFO:tasks.workunit.client.1.smithi064.stdout:7/920: link d6/d15/d88/dca/lcc d6/d8c/d9e/l13f 0 2024-04-26T21:08:18.704 INFO:tasks.workunit.client.1.smithi064.stdout:7/921: mkdir d6/d70/da8/dd1/d140 0 2024-04-26T21:08:18.705 INFO:tasks.workunit.client.1.smithi064.stdout:5/801: write dd/da9/d48/d6a/f79 [390899,76561] 0 2024-04-26T21:08:18.705 INFO:tasks.workunit.client.1.smithi064.stdout:5/802: fdatasync dd/d12/d4f/d9c/da1/fb7 0 2024-04-26T21:08:18.705 INFO:tasks.workunit.client.1.smithi064.stdout:5/803: write dd/da9/d48/d6a/d9e/db9/ffe [997690,114566] 0 2024-04-26T21:08:18.706 INFO:tasks.workunit.client.1.smithi064.stdout:5/804: dread - dd/d12/fcf zero size 2024-04-26T21:08:18.706 INFO:tasks.workunit.client.1.smithi064.stdout:7/922: mkdir d6/d15/d67/d141 0 2024-04-26T21:08:18.708 INFO:tasks.workunit.client.1.smithi064.stdout:5/805: creat dd/d12/d4f/d64/df8/f103 x:0 0 0 2024-04-26T21:08:18.710 INFO:tasks.workunit.client.1.smithi064.stdout:7/923: symlink d6/d70/da8/dd1/d12e/l142 0 2024-04-26T21:08:18.711 INFO:tasks.workunit.client.1.smithi064.stdout:5/806: mknod dd/d12/d4f/d9c/c104 0 2024-04-26T21:08:18.712 INFO:tasks.workunit.client.1.smithi064.stdout:7/924: mknod d6/db/d34/da7/c143 0 2024-04-26T21:08:18.712 INFO:tasks.workunit.client.1.smithi064.stdout:7/925: chown d6/d15/d1c/d45/c108 682906 1 2024-04-26T21:08:18.713 INFO:tasks.workunit.client.1.smithi064.stdout:7/926: creat d6/d15/d88/dca/d5c/db5/f144 x:0 0 0 2024-04-26T21:08:18.713 INFO:tasks.workunit.client.1.smithi064.stdout:4/933: dread d0/d5/d13/f12 [0,4194304] 0 2024-04-26T21:08:18.713 INFO:tasks.workunit.client.1.smithi064.stdout:4/934: stat d0/d5/d13/d6d/f4b 0 2024-04-26T21:08:18.714 INFO:tasks.workunit.client.0.smithi055.stdout:5/558: truncate d4/f6 4123363 0 2024-04-26T21:08:18.715 INFO:tasks.workunit.client.1.smithi064.stdout:4/935: symlink d0/d5/d13/d6d/d97/df6/d131/l137 0 2024-04-26T21:08:18.716 INFO:tasks.workunit.client.0.smithi055.stdout:5/559: symlink d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/d90/lc6 0 2024-04-26T21:08:18.716 INFO:tasks.workunit.client.1.smithi064.stdout:4/936: rmdir d0/d5/d79/dd1/da0/d114 39 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/937: unlink d0/d2f/d87/lfb 0 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/938: write d0/d1d/d17/d44/f78 [754817,62673] 0 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/939: chown d0/d5/d79/dd1/f5c 442 1 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/940: fdatasync d0/d5/d79/dd1/fdf 0 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/941: truncate d0/d1d/ff7 1714732 0 2024-04-26T21:08:18.719 INFO:tasks.workunit.client.1.smithi064.stdout:4/942: dread - d0/d5/d79/dd1/f75 zero size 2024-04-26T21:08:18.720 INFO:tasks.workunit.client.1.smithi064.stdout:0/827: symlink dd/d21/dc8/d31/d47/dad/l113 0 2024-04-26T21:08:18.720 INFO:tasks.workunit.client.1.smithi064.stdout:0/828: creat dd/d21/dc8/d31/d5c/f114 x:0 0 0 2024-04-26T21:08:18.720 INFO:tasks.workunit.client.1.smithi064.stdout:0/829: write dd/d21/dc8/d31/d47/dad/dfd/d74/f68 [4530028,10672] 0 2024-04-26T21:08:18.720 INFO:tasks.workunit.client.1.smithi064.stdout:0/830: readlink dd/d21/dc8/l76 0 2024-04-26T21:08:18.720 INFO:tasks.workunit.client.1.smithi064.stdout:4/943: creat d0/d1d/d56/f138 x:0 0 0 2024-04-26T21:08:18.722 INFO:tasks.workunit.client.1.smithi064.stdout:0/831: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/f115 x:0 0 0 2024-04-26T21:08:18.722 INFO:tasks.workunit.client.1.smithi064.stdout:0/832: fdatasync dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/fc4 0 2024-04-26T21:08:18.726 INFO:tasks.workunit.client.1.smithi064.stdout:9/835: read d0/d4/da/d31/d34/fe4 [3629092,75651] 0 2024-04-26T21:08:18.726 INFO:tasks.workunit.client.0.smithi055.stdout:3/721: rename d0/d4/d5/d73/d47/d37/d3d/fa2 to d0/ffc 0 2024-04-26T21:08:18.726 INFO:tasks.workunit.client.0.smithi055.stdout:3/722: write d0/d4/d5/f2c [2243113,63757] 0 2024-04-26T21:08:18.726 INFO:tasks.workunit.client.0.smithi055.stdout:3/723: chown d0/d4/fb2 13966428 1 2024-04-26T21:08:18.728 INFO:tasks.workunit.client.1.smithi064.stdout:4/944: mkdir d0/d1d/d17/d139 0 2024-04-26T21:08:18.730 INFO:tasks.workunit.client.1.smithi064.stdout:7/927: read d6/db/d34/f96 [1654396,72805] 0 2024-04-26T21:08:18.731 INFO:tasks.workunit.client.0.smithi055.stdout:3/724: mkdir d0/d4/d5/db8/dfd 0 2024-04-26T21:08:18.731 INFO:tasks.workunit.client.0.smithi055.stdout:2/714: rename d4/d49/fd2 to d4/db/d1f/d32/d57/fed 0 2024-04-26T21:08:18.731 INFO:tasks.workunit.client.0.smithi055.stdout:2/715: creat d4/db/d1f/d46/fee x:0 0 0 2024-04-26T21:08:18.731 INFO:tasks.workunit.client.0.smithi055.stdout:2/716: truncate d4/d55/d6c/fa2 5129455 0 2024-04-26T21:08:18.732 INFO:tasks.workunit.client.1.smithi064.stdout:3/824: dwrite d1/d27/d29/d6f/d72/d26/f58 [0,4194304] 0 2024-04-26T21:08:18.732 INFO:tasks.workunit.client.1.smithi064.stdout:3/825: read d1/d27/d29/d6f/d72/d73/f7f [118048,71778] 0 2024-04-26T21:08:18.733 INFO:tasks.workunit.client.1.smithi064.stdout:4/945: mknod d0/d5/d79/dd1/da0/d114/c13a 0 2024-04-26T21:08:18.733 INFO:tasks.workunit.client.1.smithi064.stdout:4/946: chown d0/d2f/d69/c6b 15898 1 2024-04-26T21:08:18.734 INFO:tasks.workunit.client.0.smithi055.stdout:5/560: dread d4/df/d13/d26/d3c/d4a/d3f/f46 [0,4194304] 0 2024-04-26T21:08:18.736 INFO:tasks.workunit.client.1.smithi064.stdout:7/928: symlink d6/d15/d1c/d45/l145 0 2024-04-26T21:08:18.740 INFO:tasks.workunit.client.0.smithi055.stdout:2/717: mkdir d4/db/d8f/da6/def 0 2024-04-26T21:08:18.740 INFO:tasks.workunit.client.0.smithi055.stdout:2/718: fdatasync d4/db/d8f/da6/fb4 0 2024-04-26T21:08:18.741 INFO:tasks.workunit.client.0.smithi055.stdout:2/719: readlink d4/d55/d6c/la5 0 2024-04-26T21:08:18.748 INFO:tasks.workunit.client.1.smithi064.stdout:4/947: symlink d0/d5/d13/d6d/d97/df6/l13b 0 2024-04-26T21:08:18.749 INFO:tasks.workunit.client.1.smithi064.stdout:0/833: dread dd/d21/dc8/d31/d47/dad/dfd/d74/f80 [0,4194304] 0 2024-04-26T21:08:18.749 INFO:tasks.workunit.client.1.smithi064.stdout:0/834: creat dd/d21/dc8/d31/d43/db4/f116 x:0 0 0 2024-04-26T21:08:18.754 INFO:tasks.workunit.client.0.smithi055.stdout:7/624: rename d5/d6/d24/f38 to d5/d6/d24/d4d/da7/dab/dae/fb9 0 2024-04-26T21:08:18.754 INFO:tasks.workunit.client.0.smithi055.stdout:2/720: rmdir d4/d49/d4c/d5e/d7d/dd3 0 2024-04-26T21:08:18.755 INFO:tasks.workunit.client.1.smithi064.stdout:6/845: dwrite d4/d7/d12/d1e/f63 [0,4194304] 0 2024-04-26T21:08:18.758 INFO:tasks.workunit.client.1.smithi064.stdout:4/948: mkdir d0/d5/d13/d6d/d97/d13c 0 2024-04-26T21:08:18.759 INFO:tasks.workunit.client.0.smithi055.stdout:3/725: dread d0/d4/d5/d73/d47/d37/da6/fc0 [0,4194304] 0 2024-04-26T21:08:18.762 INFO:tasks.workunit.client.0.smithi055.stdout:7/625: truncate d5/db/f14 4021500 0 2024-04-26T21:08:18.765 INFO:tasks.workunit.client.1.smithi064.stdout:0/835: mkdir dd/d21/dc8/d31/d43/db4/dc2/d117 0 2024-04-26T21:08:18.767 INFO:tasks.workunit.client.0.smithi055.stdout:2/721: creat d4/db/d8f/ff0 x:0 0 0 2024-04-26T21:08:18.769 INFO:tasks.workunit.client.1.smithi064.stdout:6/846: rename d4/d7/fd to d4/d7/d12/d49/d4b/d5a/daf/f11f 0 2024-04-26T21:08:18.769 INFO:tasks.workunit.client.1.smithi064.stdout:1/993: dwrite d0/d6/f74 [4194304,4194304] 0 2024-04-26T21:08:18.769 INFO:tasks.workunit.client.1.smithi064.stdout:6/847: write d4/d7/d12/d49/d4b/d5a/daf/f11f [366445,22213] 0 2024-04-26T21:08:18.769 INFO:tasks.workunit.client.1.smithi064.stdout:6/848: dread - d4/d7/d12/fd9 zero size 2024-04-26T21:08:18.771 INFO:tasks.workunit.client.1.smithi064.stdout:3/826: stat d1/d14/f31 0 2024-04-26T21:08:18.771 INFO:tasks.workunit.client.1.smithi064.stdout:3/827: fsync d1/d14/f5a 0 2024-04-26T21:08:18.771 INFO:tasks.workunit.client.1.smithi064.stdout:3/828: fsync d1/d27/d50/d35/d4c/dd1/f7e 0 2024-04-26T21:08:18.772 INFO:tasks.workunit.client.1.smithi064.stdout:0/836: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f38 406353 0 2024-04-26T21:08:18.772 INFO:tasks.workunit.client.1.smithi064.stdout:0/837: readlink dd/d21/dc8/d31/d47/dad/dfd/l17 0 2024-04-26T21:08:18.773 INFO:tasks.workunit.client.0.smithi055.stdout:3/726: creat d0/d4/d5/d73/d13/d27/ffe x:0 0 0 2024-04-26T21:08:18.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/994: unlink d0/d6/d11/d1e/d27/f50 0 2024-04-26T21:08:18.777 INFO:tasks.workunit.client.1.smithi064.stdout:1/995: fdatasync d0/d6/d11/d1e/d2a/f5b 0 2024-04-26T21:08:18.779 INFO:tasks.workunit.client.0.smithi055.stdout:7/626: unlink d5/d53/d6e/f64 0 2024-04-26T21:08:18.779 INFO:tasks.workunit.client.0.smithi055.stdout:7/627: truncate d5/f83 1112654 0 2024-04-26T21:08:18.781 INFO:tasks.workunit.client.1.smithi064.stdout:6/849: creat d4/d7/d12/d38/de6/f120 x:0 0 0 2024-04-26T21:08:18.781 INFO:tasks.workunit.client.1.smithi064.stdout:6/850: fsync d4/d7/d12/dbc/fca 0 2024-04-26T21:08:18.782 INFO:tasks.workunit.client.0.smithi055.stdout:2/722: mknod d4/db/d8f/da6/cf1 0 2024-04-26T21:08:18.783 INFO:tasks.workunit.client.1.smithi064.stdout:1/996: write d0/d6/d11/d1e/d2a/d34/f8e [333208,114319] 0 2024-04-26T21:08:18.783 INFO:tasks.workunit.client.1.smithi064.stdout:1/997: write d0/d6/d11/d1e/d2a/fcc [435110,67962] 0 2024-04-26T21:08:18.790 INFO:tasks.workunit.client.0.smithi055.stdout:2/723: rmdir d4/d7f/dbd 0 2024-04-26T21:08:18.792 INFO:tasks.workunit.client.0.smithi055.stdout:3/727: write d0/d4/d5/d73/d13/d27/d50/d6b/f9e [2231851,120452] 0 2024-04-26T21:08:18.792 INFO:tasks.workunit.client.0.smithi055.stdout:3/728: readlink d0/d4/l84 0 2024-04-26T21:08:18.793 INFO:tasks.workunit.client.1.smithi064.stdout:0/838: getdents dd/d21/dc8/d31/d47/dad/dce 0 2024-04-26T21:08:18.796 INFO:tasks.workunit.client.0.smithi055.stdout:2/724: symlink d4/d7f/lf2 0 2024-04-26T21:08:18.796 INFO:tasks.workunit.client.0.smithi055.stdout:2/725: chown d4/d55/d6c/f94 826939 1 2024-04-26T21:08:18.796 INFO:tasks.workunit.client.0.smithi055.stdout:3/729: mkdir d0/d4/d5/d73/d47/d37/de7/dff 0 2024-04-26T21:08:18.797 INFO:tasks.workunit.client.1.smithi064.stdout:3/829: dread d1/d27/d29/d6f/d72/d73/f85 [0,4194304] 0 2024-04-26T21:08:18.798 INFO:tasks.workunit.client.1.smithi064.stdout:0/839: mknod dd/d21/dd9/c118 0 2024-04-26T21:08:18.799 INFO:tasks.workunit.client.0.smithi055.stdout:3/730: read d0/f22 [4680779,119774] 0 2024-04-26T21:08:18.803 INFO:tasks.workunit.client.0.smithi055.stdout:2/726: write d4/d14/d17/fab [613047,69440] 0 2024-04-26T21:08:18.804 INFO:tasks.workunit.client.0.smithi055.stdout:3/731: symlink d0/d4/d5/d73/d13/d27/d3b/l100 0 2024-04-26T21:08:18.807 INFO:tasks.workunit.client.0.smithi055.stdout:2/727: getdents d4/d55 0 2024-04-26T21:08:18.807 INFO:tasks.workunit.client.0.smithi055.stdout:2/728: write d4/db/d1f/d32/f5f [616934,20466] 0 2024-04-26T21:08:18.807 INFO:tasks.workunit.client.0.smithi055.stdout:2/729: chown d4/d1e/d2a 6 1 2024-04-26T21:08:18.807 INFO:tasks.workunit.client.0.smithi055.stdout:2/730: stat d4/d55/d6c/fa2 0 2024-04-26T21:08:18.808 INFO:tasks.workunit.client.0.smithi055.stdout:6/629: sync 2024-04-26T21:08:18.808 INFO:tasks.workunit.client.0.smithi055.stdout:9/695: sync 2024-04-26T21:08:18.809 INFO:tasks.workunit.client.0.smithi055.stdout:8/553: sync 2024-04-26T21:08:18.809 INFO:tasks.workunit.client.0.smithi055.stdout:1/601: sync 2024-04-26T21:08:18.809 INFO:tasks.workunit.client.0.smithi055.stdout:0/688: sync 2024-04-26T21:08:18.809 INFO:tasks.workunit.client.0.smithi055.stdout:4/552: sync 2024-04-26T21:08:18.809 INFO:tasks.workunit.client.0.smithi055.stdout:1/602: fsync d8/df/d11/d27/fc3 0 2024-04-26T21:08:18.810 INFO:tasks.workunit.client.0.smithi055.stdout:6/630: readlink d3/d17/d46/d54/d66/d6a/d51/d58/l9f 0 2024-04-26T21:08:18.810 INFO:tasks.workunit.client.0.smithi055.stdout:8/554: stat d3/d9/c10 0 2024-04-26T21:08:18.814 INFO:tasks.workunit.client.0.smithi055.stdout:3/732: mknod d0/d4/d5/d73/d47/d37/d3d/df7/c101 0 2024-04-26T21:08:18.815 INFO:tasks.workunit.client.1.smithi064.stdout:8/774: sync 2024-04-26T21:08:18.815 INFO:tasks.workunit.client.1.smithi064.stdout:8/775: chown d10/d41/d4e/d59/d5d/d79 170529 1 2024-04-26T21:08:18.815 INFO:tasks.workunit.client.1.smithi064.stdout:1/998: write d0/d6/d91/fcd [106102,75170] 0 2024-04-26T21:08:18.816 INFO:tasks.workunit.client.0.smithi055.stdout:2/731: getdents d4/d1e/d90/dbc 0 2024-04-26T21:08:18.816 INFO:tasks.workunit.client.0.smithi055.stdout:2/732: creat d4/d14/d17/d6d/ff3 x:0 0 0 2024-04-26T21:08:18.820 INFO:tasks.workunit.client.0.smithi055.stdout:9/696: truncate d2/f22 488539 0 2024-04-26T21:08:18.820 INFO:tasks.workunit.client.0.smithi055.stdout:4/553: symlink d4/d12/d61/d93/lbd 0 2024-04-26T21:08:18.822 INFO:tasks.workunit.client.1.smithi064.stdout:5/807: dwrite dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:18.822 INFO:tasks.workunit.client.0.smithi055.stdout:6/631: rename d3/d17/d19/d7b/d9a to d3/d9b/ddf 0 2024-04-26T21:08:18.824 INFO:tasks.workunit.client.0.smithi055.stdout:8/555: creat d3/d9/fbd x:0 0 0 2024-04-26T21:08:18.834 INFO:tasks.workunit.client.0.smithi055.stdout:0/689: creat d9/dc/d1c/d3e/dc5/dcc/d4b/fda x:0 0 0 2024-04-26T21:08:18.834 INFO:tasks.workunit.client.1.smithi064.stdout:7/929: dwrite d6/d9/d38/fb4 [0,4194304] 0 2024-04-26T21:08:18.843 INFO:tasks.workunit.client.1.smithi064.stdout:9/836: dwrite d0/d4/d28/dff/d103/f106 [0,4194304] 0 2024-04-26T21:08:18.843 INFO:tasks.workunit.client.0.smithi055.stdout:2/733: dread d4/fb9 [0,4194304] 0 2024-04-26T21:08:18.845 INFO:tasks.workunit.client.0.smithi055.stdout:4/554: getdents d4/d26/d42/dbb 0 2024-04-26T21:08:18.845 INFO:tasks.workunit.client.0.smithi055.stdout:4/555: stat d4/d26/d42/d2d/f59 0 2024-04-26T21:08:18.845 INFO:tasks.workunit.client.0.smithi055.stdout:4/556: creat d4/d18/d1a/d49/fbe x:0 0 0 2024-04-26T21:08:18.845 INFO:tasks.workunit.client.0.smithi055.stdout:4/557: write d4/d26/d42/d28/d53/d71/fb4 [1047947,46177] 0 2024-04-26T21:08:18.845 INFO:tasks.workunit.client.0.smithi055.stdout:3/733: rename d0/d4/d5/d73/d47/d37/d3d/fb9 to d0/d4/d5/db8/f102 0 2024-04-26T21:08:18.846 INFO:tasks.workunit.client.0.smithi055.stdout:3/734: creat d0/d4/d5/d73/d13/d1a/d46/d72/dd5/f103 x:0 0 0 2024-04-26T21:08:18.847 INFO:tasks.workunit.client.0.smithi055.stdout:3/735: write d0/d4/d5/d73/d13/d27/d50/d6b/f7d [839674,69162] 0 2024-04-26T21:08:18.847 INFO:tasks.workunit.client.0.smithi055.stdout:3/736: chown d0/d4/d5/f6 1741178446 1 2024-04-26T21:08:18.847 INFO:tasks.workunit.client.0.smithi055.stdout:3/737: chown d0/c9a 93443650 1 2024-04-26T21:08:18.851 INFO:tasks.workunit.client.1.smithi064.stdout:8/776: dread d10/d41/d4e/d54/dc3/fcb [0,4194304] 0 2024-04-26T21:08:18.851 INFO:tasks.workunit.client.1.smithi064.stdout:8/777: write d10/d1d/da3/fab [812539,48661] 0 2024-04-26T21:08:18.851 INFO:tasks.workunit.client.1.smithi064.stdout:8/778: readlink d10/d41/ldd 0 2024-04-26T21:08:18.852 INFO:tasks.workunit.client.0.smithi055.stdout:2/734: creat d4/d1e/dba/ff4 x:0 0 0 2024-04-26T21:08:18.858 INFO:tasks.workunit.client.1.smithi064.stdout:9/837: rmdir d0/d4/d28/ddb 39 2024-04-26T21:08:18.865 INFO:tasks.workunit.client.1.smithi064.stdout:8/779: mkdir d10/d1d/d38/dee 0 2024-04-26T21:08:18.865 INFO:tasks.workunit.client.1.smithi064.stdout:8/780: truncate d10/f4d 1380546 0 2024-04-26T21:08:18.866 INFO:tasks.workunit.client.0.smithi055.stdout:4/558: symlink d4/d18/d8e/lbf 0 2024-04-26T21:08:18.872 INFO:tasks.workunit.client.0.smithi055.stdout:3/738: link d0/d4/d5/d73/l81 d0/d4/d5/d73/d13/d27/d50/l104 0 2024-04-26T21:08:18.872 INFO:tasks.workunit.client.0.smithi055.stdout:3/739: chown d0/d4/d5/db8 108 1 2024-04-26T21:08:18.872 INFO:tasks.workunit.client.0.smithi055.stdout:2/735: mkdir d4/d14/d17/d36/df5 0 2024-04-26T21:08:18.879 INFO:tasks.workunit.client.1.smithi064.stdout:6/851: dwrite d4/d7/d12/d49/d4b/d5a/d8f/f105 [0,4194304] 0 2024-04-26T21:08:18.886 INFO:tasks.workunit.client.0.smithi055.stdout:7/628: dwrite d5/d6/d24/f69 [0,4194304] 0 2024-04-26T21:08:18.886 INFO:tasks.workunit.client.0.smithi055.stdout:6/632: dread d3/d17/d46/d54/d66/d6a/d51/d58/d62/fa4 [0,4194304] 0 2024-04-26T21:08:18.892 INFO:tasks.workunit.client.1.smithi064.stdout:9/838: write d0/d4/f53 [2497547,89871] 0 2024-04-26T21:08:18.895 INFO:tasks.workunit.client.1.smithi064.stdout:4/949: dwrite d0/d2f/f6f [0,4194304] 0 2024-04-26T21:08:18.895 INFO:tasks.workunit.client.1.smithi064.stdout:4/950: creat d0/d2f/df1/f13d x:0 0 0 2024-04-26T21:08:18.895 INFO:tasks.workunit.client.1.smithi064.stdout:0/840: dwrite dd/d21/dc8/d31/d47/dad/dfd/f7e [0,4194304] 0 2024-04-26T21:08:18.895 INFO:tasks.workunit.client.1.smithi064.stdout:0/841: dread - dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fcf zero size 2024-04-26T21:08:18.895 INFO:tasks.workunit.client.0.smithi055.stdout:0/690: rename d9/dc/d1c/d3e/d7d/da3/d97 to d9/dc/d19/ddb 0 2024-04-26T21:08:18.905 INFO:tasks.workunit.client.1.smithi064.stdout:9/839: dread d0/d4/da/d26/d5d/f6d [0,4194304] 0 2024-04-26T21:08:18.910 INFO:tasks.workunit.client.1.smithi064.stdout:4/951: dread d0/d5/d79/dd1/fc0 [0,4194304] 0 2024-04-26T21:08:18.915 INFO:tasks.workunit.client.1.smithi064.stdout:3/830: write d1/d27/d50/f10 [1289879,77680] 0 2024-04-26T21:08:18.915 INFO:tasks.workunit.client.1.smithi064.stdout:0/842: dread dd/d21/dc8/d31/d47/fd1 [0,4194304] 0 2024-04-26T21:08:18.915 INFO:tasks.workunit.client.1.smithi064.stdout:0/843: readlink dd/d21/dc8/d31/d47/l54 0 2024-04-26T21:08:18.916 INFO:tasks.workunit.client.0.smithi055.stdout:6/633: mknod d3/d17/d46/d54/ce0 0 2024-04-26T21:08:18.921 INFO:tasks.workunit.client.0.smithi055.stdout:0/691: symlink d9/d11/d5b/d74/ldc 0 2024-04-26T21:08:18.921 INFO:tasks.workunit.client.0.smithi055.stdout:0/692: fsync d9/d11/d59/fb1 0 2024-04-26T21:08:18.922 INFO:tasks.workunit.client.0.smithi055.stdout:0/693: truncate d9/dc/d19/ddb/db6/fbe 632182 0 2024-04-26T21:08:18.922 INFO:tasks.workunit.client.0.smithi055.stdout:0/694: dread - d9/dc/d1c/d3e/d7d/da3/d82/fd9 zero size 2024-04-26T21:08:18.922 INFO:tasks.workunit.client.0.smithi055.stdout:0/695: write d9/dc/d17/f45 [3703317,14863] 0 2024-04-26T21:08:18.925 INFO:tasks.workunit.client.0.smithi055.stdout:9/697: dwrite d2/d14/f59 [0,4194304] 0 2024-04-26T21:08:18.927 INFO:tasks.workunit.client.0.smithi055.stdout:7/629: symlink d5/d6/d24/d3b/lba 0 2024-04-26T21:08:18.927 INFO:tasks.workunit.client.0.smithi055.stdout:7/630: stat d5/d53/d6e/d99/d75 0 2024-04-26T21:08:18.930 INFO:tasks.workunit.client.1.smithi064.stdout:6/852: rename d4/d7/d12/d49/d4b/d5a/daf/db2/d11b to d4/d7/d12/d49/d4b/d121 0 2024-04-26T21:08:18.932 INFO:tasks.workunit.client.1.smithi064.stdout:3/831: mknod d1/d27/d29/d6f/d72/da5/d7d/d8d/c112 0 2024-04-26T21:08:18.933 INFO:tasks.workunit.client.1.smithi064.stdout:1/999: dwrite d0/d6/d29/f11d [0,4194304] 0 2024-04-26T21:08:18.934 INFO:tasks.workunit.client.1.smithi064.stdout:9/840: write d0/d4/da/fc [2458302,99978] 0 2024-04-26T21:08:18.936 INFO:tasks.workunit.client.1.smithi064.stdout:6/853: unlink d4/d7/l9d 0 2024-04-26T21:08:18.940 INFO:tasks.workunit.client.1.smithi064.stdout:3/832: mkdir d1/d27/d29/d5e/d113 0 2024-04-26T21:08:18.941 INFO:tasks.workunit.client.0.smithi055.stdout:7/631: creat d5/d53/d6e/d99/d58/fbb x:0 0 0 2024-04-26T21:08:18.947 INFO:tasks.workunit.client.1.smithi064.stdout:0/844: dread dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f65 [0,4194304] 0 2024-04-26T21:08:18.948 INFO:tasks.workunit.client.0.smithi055.stdout:7/632: mkdir d5/d6/d39/dbc 0 2024-04-26T21:08:18.949 INFO:tasks.workunit.client.1.smithi064.stdout:3/833: symlink d1/d27/dee/l114 0 2024-04-26T21:08:18.950 INFO:tasks.workunit.client.1.smithi064.stdout:3/834: write d1/d27/f98 [1610647,113236] 0 2024-04-26T21:08:18.950 INFO:tasks.workunit.client.0.smithi055.stdout:6/634: rename d3/d17/d46/d54/d66/d6a/d51/d58/d62/d7e to d3/d17/d46/d54/d66/de1 0 2024-04-26T21:08:18.957 INFO:tasks.workunit.client.0.smithi055.stdout:7/633: rename d5/d11/l46 to d5/d11/lbd 0 2024-04-26T21:08:18.959 INFO:tasks.workunit.client.1.smithi064.stdout:9/841: write d0/d4/d7/f46 [168755,23318] 0 2024-04-26T21:08:18.959 INFO:tasks.workunit.client.1.smithi064.stdout:9/842: fsync d0/d4/da/d26/f6f 0 2024-04-26T21:08:18.960 INFO:tasks.workunit.client.0.smithi055.stdout:9/698: read d2/f92 [1263920,33941] 0 2024-04-26T21:08:18.960 INFO:tasks.workunit.client.0.smithi055.stdout:8/556: dwrite d3/d9/d1f/fb5 [0,4194304] 0 2024-04-26T21:08:18.960 INFO:tasks.workunit.client.0.smithi055.stdout:1/603: dwrite d8/df/f8e [0,4194304] 0 2024-04-26T21:08:18.962 INFO:tasks.workunit.client.1.smithi064.stdout:0/845: creat dd/d21/dc8/d31/f119 x:0 0 0 2024-04-26T21:08:18.964 INFO:tasks.workunit.client.1.smithi064.stdout:5/808: dwrite dd/d12/d18/d1a/d1f/dca/fde [0,4194304] 0 2024-04-26T21:08:18.964 INFO:tasks.workunit.client.1.smithi064.stdout:8/781: dwrite d10/d41/d44/fb5 [0,4194304] 0 2024-04-26T21:08:18.968 INFO:tasks.workunit.client.1.smithi064.stdout:3/835: rmdir d1/d27/d29/d5e/da9 39 2024-04-26T21:08:18.972 INFO:tasks.workunit.client.1.smithi064.stdout:7/930: dwrite d6/d15/d67/f129 [4194304,4194304] 0 2024-04-26T21:08:18.972 INFO:tasks.workunit.client.1.smithi064.stdout:0/846: dread dd/d21/dc8/d31/d47/dad/dfd/fe1 [0,4194304] 0 2024-04-26T21:08:18.981 INFO:tasks.workunit.client.0.smithi055.stdout:9/699: symlink d2/d14/lfb 0 2024-04-26T21:08:18.981 INFO:tasks.workunit.client.0.smithi055.stdout:9/700: stat d2/dfa 0 2024-04-26T21:08:18.982 INFO:tasks.workunit.client.1.smithi064.stdout:3/836: mknod d1/d27/d29/d9d/df8/c115 0 2024-04-26T21:08:18.982 INFO:tasks.workunit.client.1.smithi064.stdout:3/837: dread - d1/d27/d29/d6f/d72/f10c zero size 2024-04-26T21:08:18.985 INFO:tasks.workunit.client.1.smithi064.stdout:7/931: mknod d6/d9/d38/c146 0 2024-04-26T21:08:18.986 INFO:tasks.workunit.client.0.smithi055.stdout:4/559: dwrite d4/d12/d15/f6f [0,4194304] 0 2024-04-26T21:08:18.986 INFO:tasks.workunit.client.0.smithi055.stdout:4/560: fsync d4/d12/d17/d3d/faa 0 2024-04-26T21:08:18.986 INFO:tasks.workunit.client.0.smithi055.stdout:8/557: mknod d3/d89/daa/cbe 0 2024-04-26T21:08:18.989 INFO:tasks.workunit.client.0.smithi055.stdout:1/604: symlink d8/df/d11/d27/d28/d2a/da7/lc8 0 2024-04-26T21:08:18.989 INFO:tasks.workunit.client.0.smithi055.stdout:8/558: write d3/d9/d1d/d48/d4b/f6b [57088,42911] 0 2024-04-26T21:08:18.994 INFO:tasks.workunit.client.1.smithi064.stdout:8/782: dread d10/d41/d4e/d54/dc3/fcb [0,4194304] 0 2024-04-26T21:08:18.994 INFO:tasks.workunit.client.1.smithi064.stdout:8/783: creat d10/d41/d44/d5a/da2/fef x:0 0 0 2024-04-26T21:08:18.994 INFO:tasks.workunit.client.1.smithi064.stdout:3/838: rename d1/d27/d29/d6f/d72/d7a/cb3 to d1/d27/d50/d35/d4c/d7b/d8e/c116 0 2024-04-26T21:08:18.998 INFO:tasks.workunit.client.0.smithi055.stdout:7/634: symlink d5/d6/d24/d4d/lbe 0 2024-04-26T21:08:18.998 INFO:tasks.workunit.client.0.smithi055.stdout:7/635: read d5/d6/f31 [2662227,109632] 0 2024-04-26T21:08:19.000 INFO:tasks.workunit.client.0.smithi055.stdout:9/701: truncate d2/d46/d77/d7d/ff0 1600440 0 2024-04-26T21:08:19.000 INFO:tasks.workunit.client.0.smithi055.stdout:3/740: dwrite d0/d4/f40 [4194304,4194304] 0 2024-04-26T21:08:19.000 INFO:tasks.workunit.client.0.smithi055.stdout:3/741: chown d0/d4/d5/d73/d13/d1a/c45 8 1 2024-04-26T21:08:19.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/784: link d10/d41/d4e/d54/f57 d10/d41/d4e/d54/db3/ff0 0 2024-04-26T21:08:19.013 INFO:tasks.workunit.client.0.smithi055.stdout:4/561: mkdir d4/d18/d1a/d49/dae/dc0 0 2024-04-26T21:08:19.019 INFO:tasks.workunit.client.0.smithi055.stdout:1/605: read d8/d17/d1b/d41/f8f [763377,118302] 0 2024-04-26T21:08:19.019 INFO:tasks.workunit.client.1.smithi064.stdout:4/952: dwrite d0/d5/f12a [0,4194304] 0 2024-04-26T21:08:19.019 INFO:tasks.workunit.client.1.smithi064.stdout:3/839: rename d1/d14/de6/dfd to d1/d27/d50/d35/d4c/d7b/d8e/d117 0 2024-04-26T21:08:19.023 INFO:tasks.workunit.client.1.smithi064.stdout:9/843: dread d0/d4/da/d26/d47/f4b [0,4194304] 0 2024-04-26T21:08:19.026 INFO:tasks.workunit.client.0.smithi055.stdout:4/562: read d4/d12/f43 [1250239,33943] 0 2024-04-26T21:08:19.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/559: rename d3/d9/d1f/d2e/d75/f6a to d3/d9/d1f/d2e/d75/d76/d92/fbf 0 2024-04-26T21:08:19.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/560: chown d3/lb 83663 1 2024-04-26T21:08:19.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/561: fsync d3/d7c/faf 0 2024-04-26T21:08:19.026 INFO:tasks.workunit.client.0.smithi055.stdout:8/562: readlink d3/d9/d1f/d2e/l50 0 2024-04-26T21:08:19.027 INFO:tasks.workunit.client.0.smithi055.stdout:8/563: write d3/d9/d1d/d48/d57/d61/fa0 [213345,14403] 0 2024-04-26T21:08:19.030 INFO:tasks.workunit.client.0.smithi055.stdout:6/635: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d73/fd7 [0,4194304] 0 2024-04-26T21:08:19.031 INFO:tasks.workunit.client.1.smithi064.stdout:6/854: dwrite d4/d7/d12/d49/d9e/fb6 [0,4194304] 0 2024-04-26T21:08:19.034 INFO:tasks.workunit.client.0.smithi055.stdout:7/636: truncate d5/d53/d6e/d99/d7f/d6f/f95 3592457 0 2024-04-26T21:08:19.037 INFO:tasks.workunit.client.1.smithi064.stdout:7/932: dread d6/d9/d3d/f6e [4194304,4194304] 0 2024-04-26T21:08:19.037 INFO:tasks.workunit.client.1.smithi064.stdout:7/933: readlink d6/d5a/l13 0 2024-04-26T21:08:19.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/702: mknod d2/d46/d77/d79/de0/cfc 0 2024-04-26T21:08:19.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/703: fdatasync d2/d11/fa4 0 2024-04-26T21:08:19.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/704: dread - d2/d46/d77/d7d/ff7 zero size 2024-04-26T21:08:19.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/705: chown d2/d46/d9a/da7/ld8 20539408 1 2024-04-26T21:08:19.041 INFO:tasks.workunit.client.0.smithi055.stdout:9/706: readlink d2/d46/d77/d79/lde 0 2024-04-26T21:08:19.047 INFO:tasks.workunit.client.0.smithi055.stdout:8/564: dread d3/d9/d44/f98 [0,4194304] 0 2024-04-26T21:08:19.047 INFO:tasks.workunit.client.0.smithi055.stdout:8/565: dread - d3/d9/d1d/f85 zero size 2024-04-26T21:08:19.047 INFO:tasks.workunit.client.0.smithi055.stdout:8/566: chown d3/dbc/d8f 3446 1 2024-04-26T21:08:19.048 INFO:tasks.workunit.client.0.smithi055.stdout:2/736: dwrite d4/db/d1f/d32/f5f [0,4194304] 0 2024-04-26T21:08:19.048 INFO:tasks.workunit.client.0.smithi055.stdout:2/737: fdatasync d4/db/d8f/ff0 0 2024-04-26T21:08:19.052 INFO:tasks.workunit.client.0.smithi055.stdout:1/606: unlink d8/d94/d9b/cb2 0 2024-04-26T21:08:19.052 INFO:tasks.workunit.client.1.smithi064.stdout:3/840: dread d1/d27/d50/f39 [0,4194304] 0 2024-04-26T21:08:19.054 INFO:tasks.workunit.client.1.smithi064.stdout:9/844: dread d0/d4/d7/df/fac [0,4194304] 0 2024-04-26T21:08:19.054 INFO:tasks.workunit.client.1.smithi064.stdout:9/845: readlink d0/d4/d28/ddb/l10b 0 2024-04-26T21:08:19.054 INFO:tasks.workunit.client.1.smithi064.stdout:9/846: read - d0/d4/da/d26/d45/fbb zero size 2024-04-26T21:08:19.055 INFO:tasks.workunit.client.0.smithi055.stdout:4/563: mkdir d4/d12/d17/dc1 0 2024-04-26T21:08:19.056 INFO:tasks.workunit.client.0.smithi055.stdout:4/564: readlink d4/d26/d42/d28/d53/l94 0 2024-04-26T21:08:19.068 INFO:tasks.workunit.client.1.smithi064.stdout:7/934: dread d6/d9/d3d/d43/f98 [0,4194304] 0 2024-04-26T21:08:19.071 INFO:tasks.workunit.client.0.smithi055.stdout:0/696: dwrite d9/dc/d1c/d3e/dc5/dcc/f44 [0,4194304] 0 2024-04-26T21:08:19.076 INFO:tasks.workunit.client.1.smithi064.stdout:5/809: dwrite dd/d12/d18/d1a/d1f/d20/f3b [0,4194304] 0 2024-04-26T21:08:19.076 INFO:tasks.workunit.client.1.smithi064.stdout:5/810: readlink dd/dd0/ld8 0 2024-04-26T21:08:19.077 INFO:tasks.workunit.client.0.smithi055.stdout:3/742: dwrite d0/d4/d5/d73/d13/d1a/f54 [0,4194304] 0 2024-04-26T21:08:19.077 INFO:tasks.workunit.client.0.smithi055.stdout:3/743: creat d0/d4/d5/d73/d47/d37/de7/f105 x:0 0 0 2024-04-26T21:08:19.083 INFO:tasks.workunit.client.1.smithi064.stdout:6/855: mkdir d4/d7/d12/d49/d4b/d56/df1/d122 0 2024-04-26T21:08:19.097 INFO:tasks.workunit.client.0.smithi055.stdout:7/637: rename d5/d6/f89 to d5/db/fbf 0 2024-04-26T21:08:19.098 INFO:tasks.workunit.client.0.smithi055.stdout:6/636: dwrite d3/d17/d46/d54/d66/fac [0,4194304] 0 2024-04-26T21:08:19.103 INFO:tasks.workunit.client.0.smithi055.stdout:9/707: truncate d2/f55 253943 0 2024-04-26T21:08:19.105 INFO:tasks.workunit.client.0.smithi055.stdout:8/567: truncate d3/d9/d1f/f5d 2531186 0 2024-04-26T21:08:19.107 INFO:tasks.workunit.client.0.smithi055.stdout:2/738: mkdir d4/db/d1f/df6 0 2024-04-26T21:08:19.107 INFO:tasks.workunit.client.0.smithi055.stdout:2/739: dread - d4/d14/d17/d6d/ff3 zero size 2024-04-26T21:08:19.107 INFO:tasks.workunit.client.0.smithi055.stdout:2/740: stat d4/db/d1f/d46/d51 0 2024-04-26T21:08:19.110 INFO:tasks.workunit.client.0.smithi055.stdout:1/607: creat d8/df/d11/d27/d28/d2a/fc9 x:0 0 0 2024-04-26T21:08:19.111 INFO:tasks.workunit.client.1.smithi064.stdout:9/847: dwrite d0/d4/da/d31/fc0 [0,4194304] 0 2024-04-26T21:08:19.113 INFO:tasks.workunit.client.0.smithi055.stdout:0/697: creat d9/dc/d1c/d3e/dc5/fdd x:0 0 0 2024-04-26T21:08:19.114 INFO:tasks.workunit.client.0.smithi055.stdout:0/698: write d9/dc/d19/ddb/db6/fbe [411070,24137] 0 2024-04-26T21:08:19.114 INFO:tasks.workunit.client.0.smithi055.stdout:0/699: truncate d9/dc/d19/fa5 809243 0 2024-04-26T21:08:19.117 INFO:tasks.workunit.client.1.smithi064.stdout:3/841: readlink d1/le 0 2024-04-26T21:08:19.123 INFO:tasks.workunit.client.1.smithi064.stdout:8/785: truncate ff 2523432 0 2024-04-26T21:08:19.123 INFO:tasks.workunit.client.1.smithi064.stdout:8/786: write d10/d41/d4e/fbb [3894595,35014] 0 2024-04-26T21:08:19.124 INFO:tasks.workunit.client.0.smithi055.stdout:7/638: creat d5/d53/d6e/d99/d7f/d6f/da8/fc0 x:0 0 0 2024-04-26T21:08:19.127 INFO:tasks.workunit.client.1.smithi064.stdout:7/935: link d6/d15/l63 d6/d70/da8/dd7/l147 0 2024-04-26T21:08:19.127 INFO:tasks.workunit.client.1.smithi064.stdout:7/936: creat d6/db/d1f/f148 x:0 0 0 2024-04-26T21:08:19.127 INFO:tasks.workunit.client.1.smithi064.stdout:7/937: fdatasync d6/db/d1f/d50/db8/f100 0 2024-04-26T21:08:19.128 INFO:tasks.workunit.client.0.smithi055.stdout:6/637: link d3/d17/d25/d5f/d90/f69 d3/d17/d46/d54/fe2 0 2024-04-26T21:08:19.130 INFO:tasks.workunit.client.0.smithi055.stdout:2/741: dread d4/d1e/f4f [0,4194304] 0 2024-04-26T21:08:19.130 INFO:tasks.workunit.client.0.smithi055.stdout:2/742: stat d4/db/d1f/d32/d57/fc0 0 2024-04-26T21:08:19.132 INFO:tasks.workunit.client.1.smithi064.stdout:4/953: symlink d0/d5/d79/l13e 0 2024-04-26T21:08:19.132 INFO:tasks.workunit.client.1.smithi064.stdout:4/954: chown d0/d2f/d69/db5/ddd 1 1 2024-04-26T21:08:19.134 INFO:tasks.workunit.client.1.smithi064.stdout:4/955: getdents d0/d1d/d21/d9c 0 2024-04-26T21:08:19.142 INFO:tasks.workunit.client.0.smithi055.stdout:1/608: write d8/d17/d1b/d7b/d8d/f88 [4026179,14580] 0 2024-04-26T21:08:19.142 INFO:tasks.workunit.client.0.smithi055.stdout:8/568: truncate d3/d9/d1f/f9f 2481541 0 2024-04-26T21:08:19.147 INFO:tasks.workunit.client.1.smithi064.stdout:3/842: creat d1/d27/d50/d35/d4c/d7b/dcd/f118 x:0 0 0 2024-04-26T21:08:19.159 INFO:tasks.workunit.client.1.smithi064.stdout:7/938: mknod d6/d15/d1c/d45/c149 0 2024-04-26T21:08:19.159 INFO:tasks.workunit.client.1.smithi064.stdout:7/939: creat d6/d15/d67/d4d/f14a x:0 0 0 2024-04-26T21:08:19.159 INFO:tasks.workunit.client.1.smithi064.stdout:6/856: dwrite d4/d7/d12/dbc/fca [0,4194304] 0 2024-04-26T21:08:19.159 INFO:tasks.workunit.client.1.smithi064.stdout:7/940: write f5 [699767,54569] 0 2024-04-26T21:08:19.159 INFO:tasks.workunit.client.1.smithi064.stdout:6/857: write d4/d7/d12/d49/d4b/dc9/f117 [168168,70997] 0 2024-04-26T21:08:19.162 INFO:tasks.workunit.client.1.smithi064.stdout:4/956: unlink d0/d5/d13/d33/f86 0 2024-04-26T21:08:19.169 INFO:tasks.workunit.client.0.smithi055.stdout:8/569: truncate d3/d77/f78 5793526 0 2024-04-26T21:08:19.169 INFO:tasks.workunit.client.0.smithi055.stdout:8/570: write d3/d9/d1f/d2e/f56 [3326125,82261] 0 2024-04-26T21:08:19.169 INFO:tasks.workunit.client.0.smithi055.stdout:8/571: truncate d3/d9/fbd 132196 0 2024-04-26T21:08:19.171 INFO:tasks.workunit.client.1.smithi064.stdout:3/843: creat d1/d27/d50/d35/d4c/d7b/d82/f119 x:0 0 0 2024-04-26T21:08:19.173 INFO:tasks.workunit.client.1.smithi064.stdout:9/848: dwrite d0/fcd [0,4194304] 0 2024-04-26T21:08:19.174 INFO:tasks.workunit.client.0.smithi055.stdout:0/700: getdents d9/dc/d19 0 2024-04-26T21:08:19.178 INFO:tasks.workunit.client.1.smithi064.stdout:6/858: dread d4/d7/d12/d49/de1/ff4 [0,4194304] 0 2024-04-26T21:08:19.181 INFO:tasks.workunit.client.0.smithi055.stdout:7/639: dwrite d5/d11/f2f [4194304,4194304] 0 2024-04-26T21:08:19.181 INFO:tasks.workunit.client.0.smithi055.stdout:2/743: getdents d4/dc 0 2024-04-26T21:08:19.182 INFO:tasks.workunit.client.1.smithi064.stdout:8/787: dwrite d10/d1d/d38/f98 [0,4194304] 0 2024-04-26T21:08:19.186 INFO:tasks.workunit.client.0.smithi055.stdout:9/708: rename d2/d46/d77/c98 to d2/d46/d77/cfd 0 2024-04-26T21:08:19.187 INFO:tasks.workunit.client.0.smithi055.stdout:9/709: read - d2/d46/d9a/fc3 zero size 2024-04-26T21:08:19.189 INFO:tasks.workunit.client.1.smithi064.stdout:4/957: link d0/d1d/d17/d44/dac/d54/l126 d0/d5/d79/dd1/da0/l13f 0 2024-04-26T21:08:19.192 INFO:tasks.workunit.client.1.smithi064.stdout:5/811: rename dd/da9/d48/dac/da6 to dd/d12/d4f/dbd/d105 0 2024-04-26T21:08:19.201 INFO:tasks.workunit.client.0.smithi055.stdout:1/609: dwrite d8/d17/d6a/f6b [0,4194304] 0 2024-04-26T21:08:19.204 INFO:tasks.workunit.client.0.smithi055.stdout:0/701: symlink d9/dc/d1c/d3e/dc5/lde 0 2024-04-26T21:08:19.204 INFO:tasks.workunit.client.0.smithi055.stdout:0/702: readlink d9/d11/d59/d78/la7 0 2024-04-26T21:08:19.205 INFO:tasks.workunit.client.1.smithi064.stdout:3/844: mknod d1/d27/d29/c11a 0 2024-04-26T21:08:19.209 INFO:tasks.workunit.client.0.smithi055.stdout:6/638: rename d3/d17/d46/d54/d66/d6a/d51/d58/d73 to d3/da1/de3 0 2024-04-26T21:08:19.211 INFO:tasks.workunit.client.0.smithi055.stdout:7/640: symlink d5/d53/d6e/d65/lc1 0 2024-04-26T21:08:19.211 INFO:tasks.workunit.client.1.smithi064.stdout:6/859: mknod d4/d7/d12/d49/d4b/d101/d11c/c123 0 2024-04-26T21:08:19.212 INFO:tasks.workunit.client.0.smithi055.stdout:9/710: mkdir d2/d11/df5/dfe 0 2024-04-26T21:08:19.224 INFO:tasks.workunit.client.0.smithi055.stdout:1/610: unlink d8/d17/d1b/d7b/d8d/l87 0 2024-04-26T21:08:19.224 INFO:tasks.workunit.client.0.smithi055.stdout:1/611: stat d8/d17/d1b/d7b/d65 0 2024-04-26T21:08:19.227 INFO:tasks.workunit.client.1.smithi064.stdout:8/788: symlink d10/d41/d44/d7d/lf1 0 2024-04-26T21:08:19.228 INFO:tasks.workunit.client.1.smithi064.stdout:7/941: dwrite d6/d9/d3d/f6e [4194304,4194304] 0 2024-04-26T21:08:19.229 INFO:tasks.workunit.client.1.smithi064.stdout:6/860: dread d4/d7/d12/f14 [0,4194304] 0 2024-04-26T21:08:19.233 INFO:tasks.workunit.client.0.smithi055.stdout:0/703: link d9/d11/d59/lb9 d9/dc/d1c/d3e/d7d/dc1/ldf 0 2024-04-26T21:08:19.236 INFO:tasks.workunit.client.0.smithi055.stdout:7/641: mknod d5/d6/d90/db1/cc2 0 2024-04-26T21:08:19.236 INFO:tasks.workunit.client.0.smithi055.stdout:7/642: write d5/d53/d6e/d99/d58/fbb [291238,41903] 0 2024-04-26T21:08:19.236 INFO:tasks.workunit.client.0.smithi055.stdout:7/643: dread - d5/d53/d6e/d6c/d7a/f97 zero size 2024-04-26T21:08:19.240 INFO:tasks.workunit.client.0.smithi055.stdout:9/711: write d2/d46/d51/f61 [3088470,91819] 0 2024-04-26T21:08:19.240 INFO:tasks.workunit.client.0.smithi055.stdout:9/712: chown d2/d46/d77/d7d/f90 7730 1 2024-04-26T21:08:19.243 INFO:tasks.workunit.client.1.smithi064.stdout:5/812: dwrite dd/d12/d18/d25/d32/f78 [0,4194304] 0 2024-04-26T21:08:19.244 INFO:tasks.workunit.client.0.smithi055.stdout:1/612: rmdir d8/df/d11/d27/d28/da4 39 2024-04-26T21:08:19.248 INFO:tasks.workunit.client.0.smithi055.stdout:0/704: creat d9/d8b/fe0 x:0 0 0 2024-04-26T21:08:19.248 INFO:tasks.workunit.client.0.smithi055.stdout:0/705: chown d9/dc/d17/f3f 107 1 2024-04-26T21:08:19.249 INFO:tasks.workunit.client.1.smithi064.stdout:3/845: mknod d1/d27/d29/c11b 0 2024-04-26T21:08:19.250 INFO:tasks.workunit.client.0.smithi055.stdout:7/644: rmdir d5/d6 39 2024-04-26T21:08:19.252 INFO:tasks.workunit.client.1.smithi064.stdout:0/847: sync 2024-04-26T21:08:19.253 INFO:tasks.workunit.client.1.smithi064.stdout:8/789: unlink d10/d1d/c87 0 2024-04-26T21:08:19.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:18 smithi055 ceph-mon[25475]: pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 226 MiB/s rd, 284 MiB/s wr, 423 op/s 2024-04-26T21:08:19.256 INFO:tasks.workunit.client.0.smithi055.stdout:8/572: rename d3/d9/d1f to d3/dc0 0 2024-04-26T21:08:19.260 INFO:tasks.workunit.client.0.smithi055.stdout:9/713: mkdir d2/d46/d77/d79/de0/dff 0 2024-04-26T21:08:19.261 INFO:tasks.workunit.client.0.smithi055.stdout:6/639: dwrite d3/d17/faa [0,4194304] 0 2024-04-26T21:08:19.261 INFO:tasks.workunit.client.0.smithi055.stdout:6/640: truncate d3/d17/d19/f36 4658637 0 2024-04-26T21:08:19.262 INFO:tasks.workunit.client.0.smithi055.stdout:6/641: creat d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86/fe4 x:0 0 0 2024-04-26T21:08:19.262 INFO:tasks.workunit.client.0.smithi055.stdout:6/642: write d3/d17/d25/d5f/d90/fb0 [108433,107742] 0 2024-04-26T21:08:19.262 INFO:tasks.workunit.client.0.smithi055.stdout:6/643: chown d3/d17/d46/d54/d66/d6a/d51/d58/l61 11 1 2024-04-26T21:08:19.264 INFO:tasks.workunit.client.1.smithi064.stdout:5/813: write dd/d12/f40 [4558288,9002] 0 2024-04-26T21:08:19.264 INFO:tasks.workunit.client.1.smithi064.stdout:7/942: creat d6/d9/d3d/f14b x:0 0 0 2024-04-26T21:08:19.264 INFO:tasks.workunit.client.1.smithi064.stdout:6/861: mkdir d4/d7/d12/d49/d4b/d7d/d83/d124 0 2024-04-26T21:08:19.264 INFO:tasks.workunit.client.1.smithi064.stdout:7/943: readlink d6/d70/da8/le0 0 2024-04-26T21:08:19.264 INFO:tasks.workunit.client.0.smithi055.stdout:0/706: truncate d9/dc/d19/ddb/db6/d67/f88 4151027 0 2024-04-26T21:08:19.265 INFO:tasks.workunit.client.0.smithi055.stdout:0/707: creat d9/d8b/fe1 x:0 0 0 2024-04-26T21:08:19.266 INFO:tasks.workunit.client.1.smithi064.stdout:4/958: mknod d0/d5/d79/c140 0 2024-04-26T21:08:19.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/645: rename d5/d6/c2b to d5/d6/d39/cc3 0 2024-04-26T21:08:19.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/646: dread - d5/d6/d24/d4d/f73 zero size 2024-04-26T21:08:19.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/647: read - d5/d53/d6e/d6c/d7a/fac zero size 2024-04-26T21:08:19.281 INFO:tasks.workunit.client.0.smithi055.stdout:2/744: dwrite d4/d14/d17/f5d [0,4194304] 0 2024-04-26T21:08:19.286 INFO:tasks.workunit.client.1.smithi064.stdout:5/814: dread dd/d12/d18/d25/d32/f78 [0,4194304] 0 2024-04-26T21:08:19.286 INFO:tasks.workunit.client.1.smithi064.stdout:5/815: truncate dd/d12/d18/d25/d67/f94 4714922 0 2024-04-26T21:08:19.287 INFO:tasks.workunit.client.0.smithi055.stdout:9/714: mknod d2/d11/df5/dfe/c100 0 2024-04-26T21:08:19.289 INFO:tasks.workunit.client.1.smithi064.stdout:3/846: symlink d1/d27/d29/l11c 0 2024-04-26T21:08:19.292 INFO:tasks.workunit.client.1.smithi064.stdout:0/848: link dd/d21/dc8/d31/d47/dad/dfd/fd5 dd/d21/dc8/d31/d47/d61/f11a 0 2024-04-26T21:08:19.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/790: mkdir d10/d41/d4e/d59/d5d/d79/ddf/df2 0 2024-04-26T21:08:19.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/791: readlink d10/l2a 0 2024-04-26T21:08:19.297 INFO:tasks.workunit.client.1.smithi064.stdout:8/792: write d10/d41/f77 [166254,124384] 0 2024-04-26T21:08:19.297 INFO:tasks.workunit.client.0.smithi055.stdout:6/644: dread f1 [0,4194304] 0 2024-04-26T21:08:19.300 INFO:tasks.workunit.client.1.smithi064.stdout:6/862: rename d4/d7/d33/f81 to d4/d7/d12/d49/d4b/d5a/daf/f125 0 2024-04-26T21:08:19.303 INFO:tasks.workunit.client.1.smithi064.stdout:4/959: creat d0/d2f/f141 x:0 0 0 2024-04-26T21:08:19.304 INFO:tasks.workunit.client.0.smithi055.stdout:1/613: dwrite d8/d17/d1b/f9f [0,4194304] 0 2024-04-26T21:08:19.304 INFO:tasks.workunit.client.0.smithi055.stdout:7/648: rmdir d5/d6/d24/d4d/da7/dab/dae 39 2024-04-26T21:08:19.304 INFO:tasks.workunit.client.0.smithi055.stdout:7/649: fsync d5/db/f14 0 2024-04-26T21:08:19.306 INFO:tasks.workunit.client.1.smithi064.stdout:5/816: truncate dd/da9/d63/f84 3162155 0 2024-04-26T21:08:19.311 INFO:tasks.workunit.client.1.smithi064.stdout:0/849: mkdir dd/d21/dc8/d31/d47/d61/d11b 0 2024-04-26T21:08:19.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/745: mknod d4/db/d56/d4a/d7e/cf7 0 2024-04-26T21:08:19.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/746: readlink d4/d49/d4c/ldb 0 2024-04-26T21:08:19.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/747: getdents d4/d1e/d90 0 2024-04-26T21:08:19.324 INFO:tasks.workunit.client.0.smithi055.stdout:6/645: creat d3/d17/d46/d54/d66/de1/fe5 x:0 0 0 2024-04-26T21:08:19.327 INFO:tasks.workunit.client.1.smithi064.stdout:0/850: dread dd/d21/dc8/d31/d47/dad/dfd/d18/f29 [0,4194304] 0 2024-04-26T21:08:19.329 INFO:tasks.workunit.client.0.smithi055.stdout:7/650: link d5/d53/d6e/d6c/lb8 d5/d53/d6e/d65/lc4 0 2024-04-26T21:08:19.339 INFO:tasks.workunit.client.0.smithi055.stdout:7/651: mkdir d5/d53/d6e/d65/dc5 0 2024-04-26T21:08:19.339 INFO:tasks.workunit.client.0.smithi055.stdout:7/652: truncate d5/d53/d6e/d6c/f84 1088525 0 2024-04-26T21:08:19.343 INFO:tasks.workunit.client.0.smithi055.stdout:2/748: rename d4/d49/d4c to d4/db/d8f/df8 0 2024-04-26T21:08:19.343 INFO:tasks.workunit.client.0.smithi055.stdout:2/749: chown d4/d14/d17/l68 243 1 2024-04-26T21:08:19.348 INFO:tasks.workunit.client.1.smithi064.stdout:7/944: rename d6/db/d34/f106 to d6/d15/d88/dca/d5c/db5/f14c 0 2024-04-26T21:08:19.349 INFO:tasks.workunit.client.0.smithi055.stdout:7/653: mkdir d5/d53/d6e/d99/d7f/d6f/dc6 0 2024-04-26T21:08:19.354 INFO:tasks.workunit.client.0.smithi055.stdout:9/715: dwrite d2/d46/d77/ff3 [0,4194304] 0 2024-04-26T21:08:19.355 INFO:tasks.workunit.client.0.smithi055.stdout:2/750: mknod d4/db/d1f/cf9 0 2024-04-26T21:08:19.358 INFO:tasks.workunit.client.0.smithi055.stdout:6/646: rename d3/d17/d25/d5f/d90/f87 to d3/d17/d25/dc7/fe6 0 2024-04-26T21:08:19.360 INFO:tasks.workunit.client.0.smithi055.stdout:7/654: readlink d5/d6/d24/l6d 0 2024-04-26T21:08:19.368 INFO:tasks.workunit.client.0.smithi055.stdout:6/647: write d3/f16 [69124,34908] 0 2024-04-26T21:08:19.369 INFO:tasks.workunit.client.0.smithi055.stdout:2/751: mknod d4/d14/d33/cfa 0 2024-04-26T21:08:19.369 INFO:tasks.workunit.client.0.smithi055.stdout:2/752: fdatasync d4/dc/f1d 0 2024-04-26T21:08:19.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:18 smithi064 ceph-mon[33404]: pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 226 MiB/s rd, 284 MiB/s wr, 423 op/s 2024-04-26T21:08:19.370 INFO:tasks.workunit.client.1.smithi064.stdout:8/793: rename d10/d41/d4e/d60/fc4 to d10/d41/d4e/d59/ff3 0 2024-04-26T21:08:19.370 INFO:tasks.workunit.client.1.smithi064.stdout:6/863: getdents d4/d7/d33 0 2024-04-26T21:08:19.370 INFO:tasks.workunit.client.1.smithi064.stdout:5/817: rmdir dd/d12/d18/d25/d74 39 2024-04-26T21:08:19.374 INFO:tasks.workunit.client.0.smithi055.stdout:1/614: dwrite d8/df/d11/d27/d63/fb0 [0,4194304] 0 2024-04-26T21:08:19.377 INFO:tasks.workunit.client.0.smithi055.stdout:6/648: symlink d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/le7 0 2024-04-26T21:08:19.377 INFO:tasks.workunit.client.0.smithi055.stdout:6/649: chown d3/d17/d46/d54/d66/l92 242 1 2024-04-26T21:08:19.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/794: mkdir d10/d41/d4e/d59/d5d/dea/df4 0 2024-04-26T21:08:19.378 INFO:tasks.workunit.client.1.smithi064.stdout:8/795: readlink le 0 2024-04-26T21:08:19.379 INFO:tasks.workunit.client.0.smithi055.stdout:0/708: dwrite d9/dc/d17/f3a [0,4194304] 0 2024-04-26T21:08:19.380 INFO:tasks.workunit.client.1.smithi064.stdout:6/864: creat d4/d7/d12/dbc/f126 x:0 0 0 2024-04-26T21:08:19.383 INFO:tasks.workunit.client.0.smithi055.stdout:2/753: mkdir d4/db/d8f/df8/d5e/d7d/dfb 0 2024-04-26T21:08:19.384 INFO:tasks.workunit.client.0.smithi055.stdout:7/655: getdents d5/d53/d6e/d6c 0 2024-04-26T21:08:19.385 INFO:tasks.workunit.client.1.smithi064.stdout:9/849: sync 2024-04-26T21:08:19.386 INFO:tasks.workunit.client.1.smithi064.stdout:3/847: dwrite d1/d27/d29/d5e/f6d [0,4194304] 0 2024-04-26T21:08:19.386 INFO:tasks.workunit.client.1.smithi064.stdout:3/848: fdatasync d1/d27/d29/d5e/f106 0 2024-04-26T21:08:19.386 INFO:tasks.workunit.client.1.smithi064.stdout:3/849: chown d1/d14/f31 265 1 2024-04-26T21:08:19.386 INFO:tasks.workunit.client.1.smithi064.stdout:4/960: dwrite d0/d5/d13/d6d/d97/f102 [0,4194304] 0 2024-04-26T21:08:19.389 INFO:tasks.workunit.client.1.smithi064.stdout:8/796: creat d10/d41/d4e/d54/db3/ff5 x:0 0 0 2024-04-26T21:08:19.393 INFO:tasks.workunit.client.0.smithi055.stdout:1/615: link d8/d94/d9b/lb1 d8/df/d11/d27/d28/da4/daa/lca 0 2024-04-26T21:08:19.398 INFO:tasks.workunit.client.0.smithi055.stdout:6/650: dread d3/d17/d19/d71/f44 [0,4194304] 0 2024-04-26T21:08:19.405 INFO:tasks.workunit.client.0.smithi055.stdout:0/709: rename d9/dc/d17/f61 to d9/dc/d1c/d3e/dc5/dcc/d9c/fe2 0 2024-04-26T21:08:19.406 INFO:tasks.workunit.client.1.smithi064.stdout:7/945: dwrite d6/d15/d88/d113/f11f [0,4194304] 0 2024-04-26T21:08:19.412 INFO:tasks.workunit.client.1.smithi064.stdout:5/818: dread dd/d12/d18/d25/d74/f82 [0,4194304] 0 2024-04-26T21:08:19.413 INFO:tasks.workunit.client.1.smithi064.stdout:9/850: truncate d0/d4/da/d67/dd0/dd2/f105 3498376 0 2024-04-26T21:08:19.413 INFO:tasks.workunit.client.1.smithi064.stdout:9/851: truncate d0/d4/da/d26/d45/d90/fd7 1070330 0 2024-04-26T21:08:19.413 INFO:tasks.workunit.client.1.smithi064.stdout:9/852: write d0/d4/d7/fd [2607096,29026] 0 2024-04-26T21:08:19.413 INFO:tasks.workunit.client.1.smithi064.stdout:3/850: link d1/d27/cc6 d1/d27/d29/d6f/c11d 0 2024-04-26T21:08:19.413 INFO:tasks.workunit.client.1.smithi064.stdout:8/797: dread d10/d41/d4e/d54/fc9 [0,4194304] 0 2024-04-26T21:08:19.414 INFO:tasks.workunit.client.0.smithi055.stdout:2/754: unlink d4/d14/d17/d36/fc9 0 2024-04-26T21:08:19.414 INFO:tasks.workunit.client.0.smithi055.stdout:2/755: write d4/db/fea [1889,39720] 0 2024-04-26T21:08:19.416 INFO:tasks.workunit.client.0.smithi055.stdout:7/656: mkdir d5/d53/d6e/d65/dc5/dc7 0 2024-04-26T21:08:19.418 INFO:tasks.workunit.client.1.smithi064.stdout:4/961: creat d0/d5/d13/d33/dd0/dd8/f142 x:0 0 0 2024-04-26T21:08:19.418 INFO:tasks.workunit.client.1.smithi064.stdout:4/962: fsync d0/d14/f6c 0 2024-04-26T21:08:19.420 INFO:tasks.workunit.client.0.smithi055.stdout:6/651: mknod d3/d17/d46/d54/ce8 0 2024-04-26T21:08:19.421 INFO:tasks.workunit.client.0.smithi055.stdout:6/652: write d3/d17/d25/d5f/d90/fb0 [904035,98266] 0 2024-04-26T21:08:19.421 INFO:tasks.workunit.client.0.smithi055.stdout:6/653: write d3/d17/f94 [1822926,42524] 0 2024-04-26T21:08:19.421 INFO:tasks.workunit.client.0.smithi055.stdout:6/654: chown d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/cb3 25 1 2024-04-26T21:08:19.427 INFO:tasks.workunit.client.1.smithi064.stdout:7/946: link d6/d15/d88/dca/d5c/db5/f144 d6/d15/f14d 0 2024-04-26T21:08:19.431 INFO:tasks.workunit.client.1.smithi064.stdout:5/819: creat dd/d12/d18/d1a/f106 x:0 0 0 2024-04-26T21:08:19.432 INFO:tasks.workunit.client.1.smithi064.stdout:6/865: dread d4/d7/d12/d38/f73 [0,4194304] 0 2024-04-26T21:08:19.436 INFO:tasks.workunit.client.1.smithi064.stdout:9/853: rename d0/d4/d28/f2d to d0/d39/f114 0 2024-04-26T21:08:19.436 INFO:tasks.workunit.client.1.smithi064.stdout:0/851: dwrite dd/d21/dc8/d31/d47/dad/faf [0,4194304] 0 2024-04-26T21:08:19.442 INFO:tasks.workunit.client.0.smithi055.stdout:0/710: dread d9/dc/d1c/d3e/f47 [0,4194304] 0 2024-04-26T21:08:19.442 INFO:tasks.workunit.client.0.smithi055.stdout:9/716: dwrite d2/d46/d51/fb7 [0,4194304] 0 2024-04-26T21:08:19.442 INFO:tasks.workunit.client.0.smithi055.stdout:9/717: readlink d2/d14/db8/ld9 0 2024-04-26T21:08:19.449 INFO:tasks.workunit.client.1.smithi064.stdout:3/851: symlink d1/d27/d50/l11e 0 2024-04-26T21:08:19.450 INFO:tasks.workunit.client.1.smithi064.stdout:0/852: dread dd/d21/dc8/d31/d5c/f5e [0,4194304] 0 2024-04-26T21:08:19.451 INFO:tasks.workunit.client.1.smithi064.stdout:0/853: chown dd/d21/dc8/d31/d47/dad/dfd/d18/f99 14406928 1 2024-04-26T21:08:19.451 INFO:tasks.workunit.client.1.smithi064.stdout:0/854: fdatasync dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fa8 0 2024-04-26T21:08:19.451 INFO:tasks.workunit.client.1.smithi064.stdout:0/855: truncate dd/d21/dc8/d31/d43/db4/f10e 515991 0 2024-04-26T21:08:19.455 INFO:tasks.workunit.client.1.smithi064.stdout:4/963: link d0/d1d/c66 d0/d5/d13/c143 0 2024-04-26T21:08:19.460 INFO:tasks.workunit.client.1.smithi064.stdout:7/947: unlink d6/d15/d88/d113/f119 0 2024-04-26T21:08:19.461 INFO:tasks.workunit.client.0.smithi055.stdout:0/711: dread d9/dc/d17/d5d/f7c [0,4194304] 0 2024-04-26T21:08:19.461 INFO:tasks.workunit.client.0.smithi055.stdout:0/712: readlink d9/dc/d1c/d3e/dc5/dcc/la4 0 2024-04-26T21:08:19.465 INFO:tasks.workunit.client.1.smithi064.stdout:5/820: mknod dd/d12/d18/d1a/d1b/c107 0 2024-04-26T21:08:19.467 INFO:tasks.workunit.client.1.smithi064.stdout:6/866: rename d4/d7/d12/d49/d9e/fc0 to d4/d7/d12/d49/d4b/d56/df1/f127 0 2024-04-26T21:08:19.471 INFO:tasks.workunit.client.0.smithi055.stdout:1/616: dwrite d8/df/d11/d27/d28/d2a/fc9 [0,4194304] 0 2024-04-26T21:08:19.472 INFO:tasks.workunit.client.1.smithi064.stdout:9/854: link d0/d4/d28/d4f/fbe d0/d4/d28/dff/d103/f115 0 2024-04-26T21:08:19.478 INFO:tasks.workunit.client.0.smithi055.stdout:6/655: rmdir d3/d17/d19/d71/dca/dcb 39 2024-04-26T21:08:19.484 INFO:tasks.workunit.client.0.smithi055.stdout:7/657: dwrite d5/d6/d24/d3b/f42 [0,4194304] 0 2024-04-26T21:08:19.484 INFO:tasks.workunit.client.1.smithi064.stdout:7/948: creat d6/d9/d3d/d43/f14e x:0 0 0 2024-04-26T21:08:19.489 INFO:tasks.workunit.client.1.smithi064.stdout:5/821: dread dd/d12/d18/d25/d67/f93 [0,4194304] 0 2024-04-26T21:08:19.489 INFO:tasks.workunit.client.1.smithi064.stdout:5/822: truncate dd/d12/d18/d25/d32/fcb 484323 0 2024-04-26T21:08:19.489 INFO:tasks.workunit.client.1.smithi064.stdout:3/852: rename d1/d27/d50/d35/la8 to d1/d27/d29/d6f/d72/l11f 0 2024-04-26T21:08:19.490 INFO:tasks.workunit.client.0.smithi055.stdout:9/718: link d2/d14/c16 d2/d14/db8/dc5/ded/c101 0 2024-04-26T21:08:19.492 INFO:tasks.workunit.client.1.smithi064.stdout:6/867: mknod d4/d7/d12/d49/d4b/d5a/daf/db2/c128 0 2024-04-26T21:08:19.495 INFO:tasks.workunit.client.0.smithi055.stdout:0/713: mknod d9/dc/d19/ddb/db6/d6c/ce3 0 2024-04-26T21:08:19.495 INFO:tasks.workunit.client.0.smithi055.stdout:2/756: getdents d4/db/d1f/d32 0 2024-04-26T21:08:19.503 INFO:tasks.workunit.client.1.smithi064.stdout:0/856: rmdir dd/d21/dc8/d31/d47/dad/dfd/d74 39 2024-04-26T21:08:19.504 INFO:tasks.workunit.client.1.smithi064.stdout:8/798: write d10/f4d [519766,76313] 0 2024-04-26T21:08:19.506 INFO:tasks.workunit.client.0.smithi055.stdout:7/658: write d5/f57 [2983449,1178] 0 2024-04-26T21:08:19.507 INFO:tasks.workunit.client.1.smithi064.stdout:7/949: mkdir d6/d15/d88/d113/d14f 0 2024-04-26T21:08:19.511 INFO:tasks.workunit.client.1.smithi064.stdout:3/853: mknod d1/d27/d29/d6f/d72/c120 0 2024-04-26T21:08:19.515 INFO:tasks.workunit.client.1.smithi064.stdout:6/868: link d4/d7/d33/f44 d4/d7/d12/d49/d4b/dc9/f129 0 2024-04-26T21:08:19.519 INFO:tasks.workunit.client.1.smithi064.stdout:9/855: symlink d0/d4/d7/df/l116 0 2024-04-26T21:08:19.519 INFO:tasks.workunit.client.0.smithi055.stdout:9/719: dread d2/d11/f4b [0,4194304] 0 2024-04-26T21:08:19.521 INFO:tasks.workunit.client.0.smithi055.stdout:2/757: mkdir d4/db/d8f/da6/dfc 0 2024-04-26T21:08:19.521 INFO:tasks.workunit.client.0.smithi055.stdout:2/758: write d4/db/d8f/df8/d5e/d7d/fe9 [282448,19709] 0 2024-04-26T21:08:19.524 INFO:tasks.workunit.client.0.smithi055.stdout:5/561: sync 2024-04-26T21:08:19.524 INFO:tasks.workunit.client.1.smithi064.stdout:0/857: getdents dd 0 2024-04-26T21:08:19.525 INFO:tasks.workunit.client.1.smithi064.stdout:9/856: write d0/d4/da/d31/f82 [574321,95980] 0 2024-04-26T21:08:19.526 INFO:tasks.workunit.client.1.smithi064.stdout:4/964: dwrite d0/d1d/d21/f4e [0,4194304] 0 2024-04-26T21:08:19.527 INFO:tasks.workunit.client.0.smithi055.stdout:1/617: rename d8/d94/d9b/lb1 to d8/lcb 0 2024-04-26T21:08:19.527 INFO:tasks.workunit.client.0.smithi055.stdout:1/618: creat d8/d17/d1b/d7b/d65/fcc x:0 0 0 2024-04-26T21:08:19.529 INFO:tasks.workunit.client.0.smithi055.stdout:1/619: read d8/df/d11/d27/d63/f66 [296019,23086] 0 2024-04-26T21:08:19.529 INFO:tasks.workunit.client.1.smithi064.stdout:5/823: getdents dd/d12/d18/d1a/d1f 0 2024-04-26T21:08:19.529 INFO:tasks.workunit.client.0.smithi055.stdout:6/656: truncate d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/fc3 3935235 0 2024-04-26T21:08:19.533 INFO:tasks.workunit.client.1.smithi064.stdout:3/854: rename d1/d27/d29/d6f/d72/d7a/d84 to d1/d27/d29/d6f/d72/d7a/d121 0 2024-04-26T21:08:19.540 INFO:tasks.workunit.client.0.smithi055.stdout:2/759: truncate d4/d14/d17/f5d 2685497 0 2024-04-26T21:08:19.544 INFO:tasks.workunit.client.1.smithi064.stdout:6/869: chown d4/d7/d12/d49/d4b/c64 7447389 1 2024-04-26T21:08:19.546 INFO:tasks.workunit.client.0.smithi055.stdout:9/720: write d2/d11/f1f [2413631,42521] 0 2024-04-26T21:08:19.546 INFO:tasks.workunit.client.0.smithi055.stdout:5/562: creat d4/d15/db4/fc7 x:0 0 0 2024-04-26T21:08:19.547 INFO:tasks.workunit.client.1.smithi064.stdout:9/857: mknod d0/d4/d7/df6/dfe/c117 0 2024-04-26T21:08:19.555 INFO:tasks.workunit.client.1.smithi064.stdout:4/965: creat d0/d2f/d69/f144 x:0 0 0 2024-04-26T21:08:19.557 INFO:tasks.workunit.client.1.smithi064.stdout:8/799: dwrite d10/d41/d44/f6d [0,4194304] 0 2024-04-26T21:08:19.558 INFO:tasks.workunit.client.1.smithi064.stdout:8/800: readlink d10/d41/d44/d7d/lf1 0 2024-04-26T21:08:19.558 INFO:tasks.workunit.client.0.smithi055.stdout:7/659: rename d5/d6/d90 to d5/d53/d6e/d99/d7f/d6f/dc6/dc8 0 2024-04-26T21:08:19.561 INFO:tasks.workunit.client.0.smithi055.stdout:1/620: rmdir d8/df/dbc 0 2024-04-26T21:08:19.561 INFO:tasks.workunit.client.0.smithi055.stdout:1/621: write d8/df/d11/d27/d28/f40 [2128727,71069] 0 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.1.smithi064.stdout:3/855: creat d1/d27/d50/d35/d4c/d7b/f122 x:0 0 0 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.1.smithi064.stdout:3/856: dread - d1/d27/d50/d35/d4c/d7b/f122 zero size 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.1.smithi064.stdout:3/857: fsync d1/d27/d50/d35/fd4 0 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.1.smithi064.stdout:3/858: write d1/d27/d29/d5e/fbd [964384,80312] 0 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.0.smithi055.stdout:8/573: sync 2024-04-26T21:08:19.563 INFO:tasks.workunit.client.0.smithi055.stdout:4/565: sync 2024-04-26T21:08:19.564 INFO:tasks.workunit.client.0.smithi055.stdout:3/744: sync 2024-04-26T21:08:19.564 INFO:tasks.workunit.client.0.smithi055.stdout:3/745: chown d0/de/l6c 58 1 2024-04-26T21:08:19.569 INFO:tasks.workunit.client.1.smithi064.stdout:6/870: link d4/d99/la3 d4/d10e/l12a 0 2024-04-26T21:08:19.571 INFO:tasks.workunit.client.0.smithi055.stdout:6/657: link d3/da5/cd1 d3/d17/d46/d54/d66/ce9 0 2024-04-26T21:08:19.571 INFO:tasks.workunit.client.0.smithi055.stdout:9/721: creat d2/d46/d9a/da7/f102 x:0 0 0 2024-04-26T21:08:19.573 INFO:tasks.workunit.client.1.smithi064.stdout:7/950: dwrite d6/d9/f76 [0,4194304] 0 2024-04-26T21:08:19.573 INFO:tasks.workunit.client.1.smithi064.stdout:7/951: write d6/db/dc1/f10f [203543,120591] 0 2024-04-26T21:08:19.575 INFO:tasks.workunit.client.1.smithi064.stdout:4/966: unlink d0/d1d/d17/fff 0 2024-04-26T21:08:19.578 INFO:tasks.workunit.client.1.smithi064.stdout:0/858: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/f9f [0,4194304] 0 2024-04-26T21:08:19.580 INFO:tasks.workunit.client.0.smithi055.stdout:5/563: rmdir d4/df/d13/d26/da2 0 2024-04-26T21:08:19.580 INFO:tasks.workunit.client.0.smithi055.stdout:5/564: fsync d4/df/d13/d26/d3c/f3e 0 2024-04-26T21:08:19.580 INFO:tasks.workunit.client.0.smithi055.stdout:5/565: chown d4/l85 26405446 1 2024-04-26T21:08:19.580 INFO:tasks.workunit.client.0.smithi055.stdout:6/658: dread d3/d17/d19/f49 [0,4194304] 0 2024-04-26T21:08:19.580 INFO:tasks.workunit.client.0.smithi055.stdout:5/566: creat d4/d15/fc8 x:0 0 0 2024-04-26T21:08:19.590 INFO:tasks.workunit.client.1.smithi064.stdout:8/801: creat d10/d41/d4e/d59/d5d/d79/ddf/ff6 x:0 0 0 2024-04-26T21:08:19.596 INFO:tasks.workunit.client.1.smithi064.stdout:5/824: mknod dd/da9/d48/dac/d8a/c108 0 2024-04-26T21:08:19.596 INFO:tasks.workunit.client.1.smithi064.stdout:5/825: dread - dd/da9/d48/d56/fb1 zero size 2024-04-26T21:08:19.598 INFO:tasks.workunit.client.1.smithi064.stdout:3/859: symlink d1/d27/d29/d6f/d72/d73/l123 0 2024-04-26T21:08:19.600 INFO:tasks.workunit.client.1.smithi064.stdout:7/952: rename d6/d70/da8/dd1/d140 to d6/d15/d67/d4d/dfe/d150 0 2024-04-26T21:08:19.600 INFO:tasks.workunit.client.0.smithi055.stdout:1/622: rmdir d8/df/d11/d27/d28 39 2024-04-26T21:08:19.600 INFO:tasks.workunit.client.0.smithi055.stdout:8/574: symlink d3/d77/lc1 0 2024-04-26T21:08:19.604 INFO:tasks.workunit.client.0.smithi055.stdout:7/660: dread d5/d53/d6e/d99/d7f/f98 [0,4194304] 0 2024-04-26T21:08:19.604 INFO:tasks.workunit.client.0.smithi055.stdout:4/566: symlink d4/d26/d42/d28/d53/d71/d7f/da1/lc2 0 2024-04-26T21:08:19.604 INFO:tasks.workunit.client.1.smithi064.stdout:4/967: mknod d0/d2f/d87/c145 0 2024-04-26T21:08:19.605 INFO:tasks.workunit.client.1.smithi064.stdout:9/858: dwrite d0/d4/d7/fd [4194304,4194304] 0 2024-04-26T21:08:19.606 INFO:tasks.workunit.client.1.smithi064.stdout:0/859: creat dd/d21/df9/d104/f11c x:0 0 0 2024-04-26T21:08:19.607 INFO:tasks.workunit.client.0.smithi055.stdout:2/760: dwrite d4/db/d1f/d46/d51/faf [0,4194304] 0 2024-04-26T21:08:19.607 INFO:tasks.workunit.client.0.smithi055.stdout:9/722: link d2/d46/d51/cae d2/d46/d9a/da7/c103 0 2024-04-26T21:08:19.608 INFO:tasks.workunit.client.1.smithi064.stdout:8/802: symlink d10/lf7 0 2024-04-26T21:08:19.608 INFO:tasks.workunit.client.1.smithi064.stdout:8/803: fsync d10/d1d/da3/fd5 0 2024-04-26T21:08:19.610 INFO:tasks.workunit.client.0.smithi055.stdout:1/623: creat d8/d17/d1b/fcd x:0 0 0 2024-04-26T21:08:19.611 INFO:tasks.workunit.client.1.smithi064.stdout:5/826: symlink dd/d12/d9a/l109 0 2024-04-26T21:08:19.615 INFO:tasks.workunit.client.0.smithi055.stdout:8/575: rename d3/lb to d3/dc0/lc2 0 2024-04-26T21:08:19.615 INFO:tasks.workunit.client.0.smithi055.stdout:8/576: read - d3/d9/d1d/d48/fa2 zero size 2024-04-26T21:08:19.617 INFO:tasks.workunit.client.0.smithi055.stdout:6/659: dread d3/d17/f81 [0,4194304] 0 2024-04-26T21:08:19.624 INFO:tasks.workunit.client.1.smithi064.stdout:4/968: write d0/d5/d79/fe1 [42491,14240] 0 2024-04-26T21:08:19.624 INFO:tasks.workunit.client.1.smithi064.stdout:8/804: write d10/d41/d4e/d54/dc3/fcb [3336228,12099] 0 2024-04-26T21:08:19.625 INFO:tasks.workunit.client.1.smithi064.stdout:8/805: write d10/f47 [2646318,9815] 0 2024-04-26T21:08:19.625 INFO:tasks.workunit.client.1.smithi064.stdout:8/806: chown d10/d41/d4e/de3 5706 1 2024-04-26T21:08:19.625 INFO:tasks.workunit.client.1.smithi064.stdout:3/860: dread d1/d27/d50/f2d [4194304,4194304] 0 2024-04-26T21:08:19.625 INFO:tasks.workunit.client.1.smithi064.stdout:3/861: truncate d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/f108 90824 0 2024-04-26T21:08:19.627 INFO:tasks.workunit.client.0.smithi055.stdout:2/761: dread d4/db/d26/f9f [0,4194304] 0 2024-04-26T21:08:19.627 INFO:tasks.workunit.client.1.smithi064.stdout:9/859: rmdir d0/d4/da/d26/d47/d9d 39 2024-04-26T21:08:19.627 INFO:tasks.workunit.client.1.smithi064.stdout:9/860: chown d0/d4/da/l109 16 1 2024-04-26T21:08:19.627 INFO:tasks.workunit.client.1.smithi064.stdout:9/861: dread - d0/da6/fdc zero size 2024-04-26T21:08:19.637 INFO:tasks.workunit.client.0.smithi055.stdout:4/567: rename d4/d26/d42/d28/d53/d71/f73 to d4/fc3 0 2024-04-26T21:08:19.640 INFO:tasks.workunit.client.1.smithi064.stdout:6/871: dwrite d4/d7/d12/d49/d4b/d56/d95/fcc [0,4194304] 0 2024-04-26T21:08:19.641 INFO:tasks.workunit.client.1.smithi064.stdout:5/827: mknod dd/d12/d4f/d64/df8/c10a 0 2024-04-26T21:08:19.641 INFO:tasks.workunit.client.1.smithi064.stdout:5/828: write dd/d12/d4f/da5/fa7 [9876,18346] 0 2024-04-26T21:08:19.642 INFO:tasks.workunit.client.1.smithi064.stdout:5/829: chown dd/d12/d4f/da5/cc8 282 1 2024-04-26T21:08:19.644 INFO:tasks.workunit.client.0.smithi055.stdout:6/660: creat d3/da1/de3/db6/fea x:0 0 0 2024-04-26T21:08:19.653 INFO:tasks.workunit.client.1.smithi064.stdout:8/807: link d10/d2f/d56/fae d10/d41/d4e/ff8 0 2024-04-26T21:08:19.657 INFO:tasks.workunit.client.0.smithi055.stdout:9/723: rename d2/d14/l44 to d2/d46/d77/d7d/dbf/l104 0 2024-04-26T21:08:19.664 INFO:tasks.workunit.client.1.smithi064.stdout:3/862: mknod d1/d38/c124 0 2024-04-26T21:08:19.664 INFO:tasks.workunit.client.1.smithi064.stdout:3/863: getdents d1/d27/d29/d5e/d10d 0 2024-04-26T21:08:19.666 INFO:tasks.workunit.client.0.smithi055.stdout:9/724: rmdir d2/d14/d97 39 2024-04-26T21:08:19.668 INFO:tasks.workunit.client.1.smithi064.stdout:5/830: write dd/da9/d48/d6a/f8d [2176919,68208] 0 2024-04-26T21:08:19.671 INFO:tasks.workunit.client.1.smithi064.stdout:7/953: dwrite d6/d8c/f9c [4194304,4194304] 0 2024-04-26T21:08:19.671 INFO:tasks.workunit.client.1.smithi064.stdout:9/862: symlink d0/d4/l118 0 2024-04-26T21:08:19.671 INFO:tasks.workunit.client.1.smithi064.stdout:9/863: dread - d0/d4/da/d26/d47/d9d/d76/ffc zero size 2024-04-26T21:08:19.672 INFO:tasks.workunit.client.0.smithi055.stdout:5/567: dwrite d4/df/d13/d26/d3c/d5b/d83/fba [0,4194304] 0 2024-04-26T21:08:19.673 INFO:tasks.workunit.client.0.smithi055.stdout:2/762: dread d4/db/d26/d9a/fad [0,4194304] 0 2024-04-26T21:08:19.673 INFO:tasks.workunit.client.0.smithi055.stdout:5/568: chown d4/df 12446481 1 2024-04-26T21:08:19.675 INFO:tasks.workunit.client.1.smithi064.stdout:6/872: creat d4/d7/d12/d49/d4b/d5a/d8f/d108/f12b x:0 0 0 2024-04-26T21:08:19.675 INFO:tasks.workunit.client.1.smithi064.stdout:6/873: readlink d4/d7/l19 0 2024-04-26T21:08:19.677 INFO:tasks.workunit.client.0.smithi055.stdout:1/624: getdents d8/d17/d1b 0 2024-04-26T21:08:19.679 INFO:tasks.workunit.client.1.smithi064.stdout:9/864: dread d0/d4/da/d26/d5e/f69 [0,4194304] 0 2024-04-26T21:08:19.680 INFO:tasks.workunit.client.1.smithi064.stdout:4/969: rmdir d0/d1d/d56 39 2024-04-26T21:08:19.681 INFO:tasks.workunit.client.0.smithi055.stdout:7/661: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:19.685 INFO:tasks.workunit.client.1.smithi064.stdout:8/808: symlink d10/d41/d4e/d59/d5d/d79/ddf/lf9 0 2024-04-26T21:08:19.686 INFO:tasks.workunit.client.0.smithi055.stdout:2/763: rmdir d4/db/d8f/df8 39 2024-04-26T21:08:19.688 INFO:tasks.workunit.client.1.smithi064.stdout:3/864: creat d1/d27/d29/f125 x:0 0 0 2024-04-26T21:08:19.689 INFO:tasks.workunit.client.0.smithi055.stdout:5/569: mkdir d4/df/d13/d26/d3c/d4a/d3f/d4f/d53/dc9 0 2024-04-26T21:08:19.690 INFO:tasks.workunit.client.1.smithi064.stdout:5/831: truncate dd/d12/d18/d1a/d1f/d20/f44 7445859 0 2024-04-26T21:08:19.692 INFO:tasks.workunit.client.0.smithi055.stdout:1/625: symlink d8/df/d11/d27/d28/d2a/da7/lce 0 2024-04-26T21:08:19.692 INFO:tasks.workunit.client.0.smithi055.stdout:1/626: truncate d8/d17/d33/dc5/f81 1187759 0 2024-04-26T21:08:19.695 INFO:tasks.workunit.client.0.smithi055.stdout:9/725: rename d2/d14 to d2/d46/d9a/d105 0 2024-04-26T21:08:19.698 INFO:tasks.workunit.client.0.smithi055.stdout:7/662: creat d5/d53/d6e/d65/dc5/dc7/fc9 x:0 0 0 2024-04-26T21:08:19.698 INFO:tasks.workunit.client.0.smithi055.stdout:7/663: chown d5/db/l1d 3507892 1 2024-04-26T21:08:19.700 INFO:tasks.workunit.client.1.smithi064.stdout:7/954: mknod d6/d70/d74/d116/c151 0 2024-04-26T21:08:19.701 INFO:tasks.workunit.client.0.smithi055.stdout:2/764: mknod d4/d14/cfd 0 2024-04-26T21:08:19.701 INFO:tasks.workunit.client.0.smithi055.stdout:2/765: stat d4/dc/f1d 0 2024-04-26T21:08:19.703 INFO:tasks.workunit.client.1.smithi064.stdout:0/860: rename dd/d21/dc8/d31/d47/d61 to dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d 0 2024-04-26T21:08:19.704 INFO:tasks.workunit.client.0.smithi055.stdout:5/570: rmdir d4/df/d13/d26/d3c/d93 39 2024-04-26T21:08:19.705 INFO:tasks.workunit.client.1.smithi064.stdout:6/874: dread - d4/d7/d12/d49/d4b/fd5 zero size 2024-04-26T21:08:19.708 INFO:tasks.workunit.client.0.smithi055.stdout:1/627: mkdir d8/d17/d33/dcf 0 2024-04-26T21:08:19.709 INFO:tasks.workunit.client.0.smithi055.stdout:7/664: link d5/d53/d6e/d65/dc5/dc7/fc9 d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/fca 0 2024-04-26T21:08:19.709 INFO:tasks.workunit.client.0.smithi055.stdout:7/665: fdatasync d5/d6/d24/d3b/f42 0 2024-04-26T21:08:19.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/865: link d0/d4/da/d31/cd9 d0/d4/d28/d4f/c119 0 2024-04-26T21:08:19.711 INFO:tasks.workunit.client.1.smithi064.stdout:9/866: fdatasync d0/d39/f114 0 2024-04-26T21:08:19.711 INFO:tasks.workunit.client.0.smithi055.stdout:2/766: mknod d4/db/d8f/df8/d5e/cfe 0 2024-04-26T21:08:19.713 INFO:tasks.workunit.client.0.smithi055.stdout:6/661: dwrite d3/d17/d19/f3d [4194304,4194304] 0 2024-04-26T21:08:19.713 INFO:tasks.workunit.client.0.smithi055.stdout:6/662: read - d3/d17/d25/fc6 zero size 2024-04-26T21:08:19.713 INFO:tasks.workunit.client.0.smithi055.stdout:1/628: unlink d8/df/l48 0 2024-04-26T21:08:19.713 INFO:tasks.workunit.client.0.smithi055.stdout:1/629: fdatasync d8/f35 0 2024-04-26T21:08:19.716 INFO:tasks.workunit.client.1.smithi064.stdout:5/832: write dd/da9/d48/d6a/d81/f77 [824561,97845] 0 2024-04-26T21:08:19.716 INFO:tasks.workunit.client.1.smithi064.stdout:5/833: chown dd/d12/d18/d1a/d1f/dca/fde 261367 1 2024-04-26T21:08:19.723 INFO:tasks.workunit.client.1.smithi064.stdout:5/834: link dd/d12/d18/d1a/d1f/c42 dd/c10b 0 2024-04-26T21:08:19.723 INFO:tasks.workunit.client.0.smithi055.stdout:4/568: dwrite d4/f21 [4194304,4194304] 0 2024-04-26T21:08:19.723 INFO:tasks.workunit.client.0.smithi055.stdout:2/767: creat d4/d14/d17/d6d/d81/da9/fff x:0 0 0 2024-04-26T21:08:19.723 INFO:tasks.workunit.client.0.smithi055.stdout:6/663: creat d3/d17/d19/d7b/feb x:0 0 0 2024-04-26T21:08:19.729 INFO:tasks.workunit.client.0.smithi055.stdout:1/630: rename d8/d17/d33/dc5/lab to d8/df/d11/db5/ld0 0 2024-04-26T21:08:19.729 INFO:tasks.workunit.client.0.smithi055.stdout:1/631: fdatasync d8/df/f8e 0 2024-04-26T21:08:19.732 INFO:tasks.workunit.client.1.smithi064.stdout:4/970: rmdir d0/d5/d13/d6d/de4 0 2024-04-26T21:08:19.739 INFO:tasks.workunit.client.0.smithi055.stdout:2/768: mknod d4/d14/d17/d6d/c100 0 2024-04-26T21:08:19.740 INFO:tasks.workunit.client.0.smithi055.stdout:7/666: dread d5/d6/d24/f50 [0,4194304] 0 2024-04-26T21:08:19.743 INFO:tasks.workunit.client.1.smithi064.stdout:4/971: truncate d0/d5/d79/f80 193820 0 2024-04-26T21:08:19.743 INFO:tasks.workunit.client.1.smithi064.stdout:4/972: write d0/d1d/d21/f8e [2066528,92853] 0 2024-04-26T21:08:19.744 INFO:tasks.workunit.client.1.smithi064.stdout:4/973: chown d0/d5/d13/d6d/dd3 242405238 1 2024-04-26T21:08:19.746 INFO:tasks.workunit.client.0.smithi055.stdout:1/632: symlink d8/df/d11/d27/d28/da4/dbe/ld1 0 2024-04-26T21:08:19.747 INFO:tasks.workunit.client.0.smithi055.stdout:2/769: mknod d4/db/d8f/da6/def/c101 0 2024-04-26T21:08:19.747 INFO:tasks.workunit.client.0.smithi055.stdout:2/770: fdatasync d4/d55/d6c/fd0 0 2024-04-26T21:08:19.751 INFO:tasks.workunit.client.0.smithi055.stdout:7/667: dread d5/d53/d6e/d65/f94 [0,4194304] 0 2024-04-26T21:08:19.753 INFO:tasks.workunit.client.1.smithi064.stdout:4/974: rename d0/d1d/d56/d89/f110 to d0/d5/d13/d33/f146 0 2024-04-26T21:08:19.758 INFO:tasks.workunit.client.0.smithi055.stdout:9/726: dwrite d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:19.758 INFO:tasks.workunit.client.1.smithi064.stdout:5/835: read dd/da9/d48/d56/daa/fdd [2679377,87332] 0 2024-04-26T21:08:19.762 INFO:tasks.workunit.client.0.smithi055.stdout:2/771: mknod d4/db/d1f/d32/dcd/c102 0 2024-04-26T21:08:19.762 INFO:tasks.workunit.client.0.smithi055.stdout:1/633: mknod d8/df/d11/d27/d28/d2a/da7/cd2 0 2024-04-26T21:08:19.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/975: truncate d0/d5/d13/f36 2767133 0 2024-04-26T21:08:19.764 INFO:tasks.workunit.client.1.smithi064.stdout:9/867: dread d0/d39/f114 [0,4194304] 0 2024-04-26T21:08:19.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/976: write d0/d5/d79/fe1 [164567,129539] 0 2024-04-26T21:08:19.764 INFO:tasks.workunit.client.1.smithi064.stdout:4/977: readlink d0/d1d/l26 0 2024-04-26T21:08:19.766 INFO:tasks.workunit.client.0.smithi055.stdout:7/668: creat d5/d6/d39/dbc/fcb x:0 0 0 2024-04-26T21:08:19.767 INFO:tasks.workunit.client.0.smithi055.stdout:7/669: stat d5/d53/d6e/d99/d7f/c77 0 2024-04-26T21:08:19.767 INFO:tasks.workunit.client.1.smithi064.stdout:5/836: rename dd/d12/d4f/dbd/d105/cc6 to dd/da9/d48/de3/c10c 0 2024-04-26T21:08:19.772 INFO:tasks.workunit.client.1.smithi064.stdout:9/868: symlink d0/d4/da/d31/d34/df7/l11a 0 2024-04-26T21:08:19.774 INFO:tasks.workunit.client.0.smithi055.stdout:2/772: mknod d4/db/d8f/df8/d5e/d7d/dfb/c103 0 2024-04-26T21:08:19.777 INFO:tasks.workunit.client.1.smithi064.stdout:3/865: dread d1/f11 [0,4194304] 0 2024-04-26T21:08:19.778 INFO:tasks.workunit.client.0.smithi055.stdout:7/670: creat d5/d6/d24/d4d/da7/fcc x:0 0 0 2024-04-26T21:08:19.779 INFO:tasks.workunit.client.1.smithi064.stdout:9/869: link d0/d4/da/l1c d0/d4/da/d26/d47/l11b 0 2024-04-26T21:08:19.781 INFO:tasks.workunit.client.1.smithi064.stdout:3/866: mkdir d1/d27/d50/d35/d4c/d7b/dcd/d126 0 2024-04-26T21:08:19.788 INFO:tasks.workunit.client.1.smithi064.stdout:3/867: mknod d1/d27/d29/d6f/d72/da5/d7d/df9/c127 0 2024-04-26T21:08:19.788 INFO:tasks.workunit.client.1.smithi064.stdout:9/870: rename d0/d4/da/f29 to d0/d4/d28/dff/d103/f11c 0 2024-04-26T21:08:19.788 INFO:tasks.workunit.client.1.smithi064.stdout:3/868: truncate d1/d27/d29/d6f/d72/d73/f10a 654530 0 2024-04-26T21:08:19.789 INFO:tasks.workunit.client.0.smithi055.stdout:2/773: rename d4/d1e/dba/cc7 to d4/d1e/d90/c104 0 2024-04-26T21:08:19.789 INFO:tasks.workunit.client.0.smithi055.stdout:2/774: creat d4/db/d8f/da6/f105 x:0 0 0 2024-04-26T21:08:19.790 INFO:tasks.workunit.client.0.smithi055.stdout:7/671: creat d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/fcd x:0 0 0 2024-04-26T21:08:19.791 INFO:tasks.workunit.client.1.smithi064.stdout:3/869: rename d1/d27/d29/d6f/d72/da5/f93 to d1/d27/d29/d6f/d72/d73/f128 0 2024-04-26T21:08:19.791 INFO:tasks.workunit.client.1.smithi064.stdout:3/870: write d1/d27/d29/d6f/d72/f10c [96568,76017] 0 2024-04-26T21:08:19.792 INFO:tasks.workunit.client.1.smithi064.stdout:3/871: write d1/ff [7857562,1301] 0 2024-04-26T21:08:19.793 INFO:tasks.workunit.client.1.smithi064.stdout:3/872: readlink d1/d38/d68/lf2 0 2024-04-26T21:08:19.793 INFO:tasks.workunit.client.0.smithi055.stdout:2/775: stat d4/db/d1f/d32/d57/ccb 0 2024-04-26T21:08:19.793 INFO:tasks.workunit.client.0.smithi055.stdout:2/776: write d4/dc/d21/f24 [4583973,72734] 0 2024-04-26T21:08:19.797 INFO:tasks.workunit.client.0.smithi055.stdout:2/777: creat d4/d14/d17/f106 x:0 0 0 2024-04-26T21:08:19.801 INFO:tasks.workunit.client.0.smithi055.stdout:2/778: dread - d4/d14/d17/d36/fac zero size 2024-04-26T21:08:19.803 INFO:tasks.workunit.client.1.smithi064.stdout:3/873: dread d1/d27/d29/f92 [0,4194304] 0 2024-04-26T21:08:19.805 INFO:tasks.workunit.client.1.smithi064.stdout:4/978: dread d0/d5/d13/d6d/d97/f102 [0,4194304] 0 2024-04-26T21:08:19.805 INFO:tasks.workunit.client.1.smithi064.stdout:4/979: dread - d0/d5/d79/dd1/f11d zero size 2024-04-26T21:08:19.806 INFO:tasks.workunit.client.1.smithi064.stdout:4/980: chown d0/d5/d79 206252760 1 2024-04-26T21:08:19.809 INFO:tasks.workunit.client.1.smithi064.stdout:9/871: read d0/d4/d7/f2f [3915888,9631] 0 2024-04-26T21:08:19.810 INFO:tasks.workunit.client.1.smithi064.stdout:9/872: fsync d0/d4/da/d67/dd0/dd2/f9f 0 2024-04-26T21:08:19.810 INFO:tasks.workunit.client.1.smithi064.stdout:3/874: symlink d1/d27/d29/d6f/dfc/l129 0 2024-04-26T21:08:19.810 INFO:tasks.workunit.client.1.smithi064.stdout:3/875: write d1/d27/d50/d35/db9/f111 [734038,125491] 0 2024-04-26T21:08:19.811 INFO:tasks.workunit.client.1.smithi064.stdout:9/873: creat d0/d4/d7/df6/dfe/f11d x:0 0 0 2024-04-26T21:08:19.813 INFO:tasks.workunit.client.1.smithi064.stdout:3/876: rename d1/d27/d29/d6f/d72/d73/f90 to d1/d27/d29/d6f/dfc/f12a 0 2024-04-26T21:08:19.813 INFO:tasks.workunit.client.1.smithi064.stdout:9/874: mkdir d0/d4/d28/ddb/d11e 0 2024-04-26T21:08:19.815 INFO:tasks.workunit.client.1.smithi064.stdout:9/875: creat d0/d4/d7/d102/f11f x:0 0 0 2024-04-26T21:08:19.816 INFO:tasks.workunit.client.1.smithi064.stdout:9/876: unlink d0/d4/da/d26/d5d/fb0 0 2024-04-26T21:08:19.817 INFO:tasks.workunit.client.1.smithi064.stdout:9/877: symlink d0/d4/d28/d4f/l120 0 2024-04-26T21:08:19.819 INFO:tasks.workunit.client.1.smithi064.stdout:9/878: symlink d0/d4/da/d31/dc2/l121 0 2024-04-26T21:08:19.821 INFO:tasks.workunit.client.1.smithi064.stdout:9/879: link d0/d4/da/d26/d5d/f7b d0/d4/da/da3/f122 0 2024-04-26T21:08:19.821 INFO:tasks.workunit.client.1.smithi064.stdout:9/880: fsync d0/fc7 0 2024-04-26T21:08:19.821 INFO:tasks.workunit.client.1.smithi064.stdout:9/881: stat d0/d4/da/d67/dd0/dd2/f99 0 2024-04-26T21:08:19.825 INFO:tasks.workunit.client.1.smithi064.stdout:9/882: mkdir d0/d4/da/d26/d47/d6b/d123 0 2024-04-26T21:08:19.825 INFO:tasks.workunit.client.1.smithi064.stdout:9/883: truncate d0/d4/d7/df/da4/ff9 151811 0 2024-04-26T21:08:19.825 INFO:tasks.workunit.client.1.smithi064.stdout:8/809: dwrite d10/d41/d4e/d54/f57 [0,4194304] 0 2024-04-26T21:08:19.827 INFO:tasks.workunit.client.0.smithi055.stdout:5/571: dwrite d4/df/d13/d26/d3c/d5b/d83/f8c [0,4194304] 0 2024-04-26T21:08:19.827 INFO:tasks.workunit.client.0.smithi055.stdout:6/664: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/fcc [0,4194304] 0 2024-04-26T21:08:19.827 INFO:tasks.workunit.client.0.smithi055.stdout:6/665: dread - d3/d17/d19/d7b/feb zero size 2024-04-26T21:08:19.827 INFO:tasks.workunit.client.1.smithi064.stdout:7/955: dwrite d6/d9/d3d/d43/ff3 [0,4194304] 0 2024-04-26T21:08:19.828 INFO:tasks.workunit.client.0.smithi055.stdout:9/727: dwrite d2/d46/d77/fbb [0,4194304] 0 2024-04-26T21:08:19.833 INFO:tasks.workunit.client.0.smithi055.stdout:4/569: dwrite d4/d26/d42/d2d/f41 [0,4194304] 0 2024-04-26T21:08:19.839 INFO:tasks.workunit.client.1.smithi064.stdout:9/884: unlink d0/d4/da/d26/d47/lea 0 2024-04-26T21:08:19.848 INFO:tasks.workunit.client.1.smithi064.stdout:0/861: dwrite dd/d21/dc8/d31/d47/dad/dfd/fe1 [0,4194304] 0 2024-04-26T21:08:19.851 INFO:tasks.workunit.client.0.smithi055.stdout:7/672: dwrite d5/db/f14 [4194304,4194304] 0 2024-04-26T21:08:19.852 INFO:tasks.workunit.client.1.smithi064.stdout:7/956: truncate d6/d15/d67/d4d/f9b 3750695 0 2024-04-26T21:08:19.853 INFO:tasks.workunit.client.0.smithi055.stdout:6/666: creat d3/d17/d46/d54/d66/d6a/d67/d83/fec x:0 0 0 2024-04-26T21:08:19.854 INFO:tasks.workunit.client.1.smithi064.stdout:9/885: symlink d0/d4/da/d26/d47/d9d/l124 0 2024-04-26T21:08:19.858 INFO:tasks.workunit.client.0.smithi055.stdout:9/728: dread d2/f1e [4194304,4194304] 0 2024-04-26T21:08:19.862 INFO:tasks.workunit.client.1.smithi064.stdout:6/875: dwrite d4/d7/d12/d49/d9e/fb6 [0,4194304] 0 2024-04-26T21:08:19.864 INFO:tasks.workunit.client.0.smithi055.stdout:1/634: rmdir d8/d17 39 2024-04-26T21:08:19.868 INFO:tasks.workunit.client.0.smithi055.stdout:4/570: unlink d4/d26/d42/c2c 0 2024-04-26T21:08:19.871 INFO:tasks.workunit.client.1.smithi064.stdout:0/862: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/f11e x:0 0 0 2024-04-26T21:08:19.871 INFO:tasks.workunit.client.1.smithi064.stdout:6/876: read d4/f41 [965539,218] 0 2024-04-26T21:08:19.875 INFO:tasks.workunit.client.0.smithi055.stdout:7/673: mkdir d5/d6/d24/d4d/da7/dab/dce 0 2024-04-26T21:08:19.875 INFO:tasks.workunit.client.0.smithi055.stdout:7/674: write d5/d53/f8a [271798,103087] 0 2024-04-26T21:08:19.875 INFO:tasks.workunit.client.0.smithi055.stdout:9/729: dread d2/d11/f2f [0,4194304] 0 2024-04-26T21:08:19.875 INFO:tasks.workunit.client.0.smithi055.stdout:9/730: write d2/d11/f1f [4352702,14595] 0 2024-04-26T21:08:19.876 INFO:tasks.workunit.client.0.smithi055.stdout:9/731: read - d2/d46/d51/fe9 zero size 2024-04-26T21:08:19.876 INFO:tasks.workunit.client.0.smithi055.stdout:7/675: write d5/d6/d24/d4d/da7/dab/dae/fb9 [9005419,87860] 0 2024-04-26T21:08:19.876 INFO:tasks.workunit.client.0.smithi055.stdout:7/676: readlink d5/d6/d24/l6d 0 2024-04-26T21:08:19.876 INFO:tasks.workunit.client.0.smithi055.stdout:9/732: write d2/d46/d9a/d105/f9f [497540,67820] 0 2024-04-26T21:08:19.876 INFO:tasks.workunit.client.0.smithi055.stdout:9/733: getdents d2/d46/d9a/d105/db8/dc5/de4 0 2024-04-26T21:08:19.883 INFO:tasks.workunit.client.1.smithi064.stdout:7/957: rename d6/d70/d74/d99/l120 to d6/d15/d1c/l152 0 2024-04-26T21:08:19.887 INFO:tasks.workunit.client.1.smithi064.stdout:6/877: dread d4/d7/d12/fc2 [0,4194304] 0 2024-04-26T21:08:19.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/886: creat d0/d4/da/d26/d5e/dd8/f125 x:0 0 0 2024-04-26T21:08:19.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/887: readlink d0/d4/da/d26/d45/ldd 0 2024-04-26T21:08:19.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/888: readlink d0/l6 0 2024-04-26T21:08:19.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/889: fsync d0/d4/d7/f20 0 2024-04-26T21:08:19.888 INFO:tasks.workunit.client.1.smithi064.stdout:9/890: chown d0/d4/da/d26/d5e/f69 58032 1 2024-04-26T21:08:19.889 INFO:tasks.workunit.client.0.smithi055.stdout:1/635: getdents d8/df/d11/d27/d63 0 2024-04-26T21:08:19.889 INFO:tasks.workunit.client.1.smithi064.stdout:4/981: dwrite d0/d1d/d21/f76 [0,4194304] 0 2024-04-26T21:08:19.892 INFO:tasks.workunit.client.1.smithi064.stdout:3/877: dwrite d1/d14/f5a [4194304,4194304] 0 2024-04-26T21:08:19.892 INFO:tasks.workunit.client.1.smithi064.stdout:3/878: write d1/d27/d29/d9d/f100 [216146,97138] 0 2024-04-26T21:08:19.895 INFO:tasks.workunit.client.1.smithi064.stdout:0/863: rename dd/d21/dc8/d31/f119 to dd/d21/dc8/d31/d43/f11f 0 2024-04-26T21:08:19.896 INFO:tasks.workunit.client.0.smithi055.stdout:4/571: getdents d4/d18/d1a/d49/dae 0 2024-04-26T21:08:19.898 INFO:tasks.workunit.client.1.smithi064.stdout:7/958: creat d6/db/d34/dc7/f153 x:0 0 0 2024-04-26T21:08:19.899 INFO:tasks.workunit.client.0.smithi055.stdout:6/667: unlink d3/cd 0 2024-04-26T21:08:19.902 INFO:tasks.workunit.client.1.smithi064.stdout:8/810: dwrite d10/d41/d44/f51 [0,4194304] 0 2024-04-26T21:08:19.902 INFO:tasks.workunit.client.1.smithi064.stdout:6/878: mknod d4/d7/d12/d49/d4b/d5a/d8f/d108/d115/c12c 0 2024-04-26T21:08:19.905 INFO:tasks.workunit.client.0.smithi055.stdout:4/572: creat d4/fc4 x:0 0 0 2024-04-26T21:08:19.905 INFO:tasks.workunit.client.0.smithi055.stdout:4/573: chown d4/d12/d17/d3d/c69 2444 1 2024-04-26T21:08:19.908 INFO:tasks.workunit.client.1.smithi064.stdout:5/837: dread dd/d12/d18/d1a/d1f/d20/f44 [4194304,4194304] 0 2024-04-26T21:08:19.908 INFO:tasks.workunit.client.1.smithi064.stdout:5/838: stat dd/d12/d4f/d9c/da1/fb7 0 2024-04-26T21:08:19.908 INFO:tasks.workunit.client.1.smithi064.stdout:5/839: truncate dd/fda 204360 0 2024-04-26T21:08:19.911 INFO:tasks.workunit.client.0.smithi055.stdout:2/779: dwrite d4/d14/d33/f59 [0,4194304] 0 2024-04-26T21:08:19.915 INFO:tasks.workunit.client.1.smithi064.stdout:4/982: mknod d0/d5/d13/d6d/c147 0 2024-04-26T21:08:19.923 INFO:tasks.workunit.client.1.smithi064.stdout:3/879: creat d1/d27/d50/d35/d4c/dd1/f12b x:0 0 0 2024-04-26T21:08:19.926 INFO:tasks.workunit.client.1.smithi064.stdout:9/891: rename d0/l6 to d0/d4/da/d31/l126 0 2024-04-26T21:08:19.926 INFO:tasks.workunit.client.1.smithi064.stdout:9/892: write d0/d4/da/d26/d47/d6b/fcb [567296,10401] 0 2024-04-26T21:08:19.935 INFO:tasks.workunit.client.0.smithi055.stdout:7/677: write d5/d53/d6e/d99/d7f/f8e [1975627,40555] 0 2024-04-26T21:08:19.940 INFO:tasks.workunit.client.1.smithi064.stdout:0/864: rmdir dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/d110 0 2024-04-26T21:08:19.940 INFO:tasks.workunit.client.1.smithi064.stdout:0/865: dread - dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fcf zero size 2024-04-26T21:08:19.940 INFO:tasks.workunit.client.1.smithi064.stdout:0/866: chown dd/d21/dc8/d31/d5c 2764421 1 2024-04-26T21:08:19.940 INFO:tasks.workunit.client.1.smithi064.stdout:0/867: fdatasync dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/f11e 0 2024-04-26T21:08:19.944 INFO:tasks.workunit.client.1.smithi064.stdout:8/811: symlink d10/d2f/d61/lfa 0 2024-04-26T21:08:19.947 INFO:tasks.workunit.client.0.smithi055.stdout:6/668: truncate d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/fc3 1081935 0 2024-04-26T21:08:19.951 INFO:tasks.workunit.client.1.smithi064.stdout:6/879: getdents d4/d7/d12/d49/d4b 0 2024-04-26T21:08:19.952 INFO:tasks.workunit.client.0.smithi055.stdout:4/574: dread d4/d12/d17/f7e [0,4194304] 0 2024-04-26T21:08:19.952 INFO:tasks.workunit.client.0.smithi055.stdout:4/575: write d4/d18/d8e/d9e/fb1 [493006,98140] 0 2024-04-26T21:08:19.953 INFO:tasks.workunit.client.0.smithi055.stdout:2/780: mkdir d4/d14/dc5/d107 0 2024-04-26T21:08:19.957 INFO:tasks.workunit.client.1.smithi064.stdout:4/983: unlink d0/d1d/d21/f4e 0 2024-04-26T21:08:19.957 INFO:tasks.workunit.client.1.smithi064.stdout:4/984: chown d0/d5/d13/d6d/f4b 138311 1 2024-04-26T21:08:19.959 INFO:tasks.workunit.client.1.smithi064.stdout:3/880: rmdir d1/d27/dac 0 2024-04-26T21:08:19.960 INFO:tasks.workunit.client.1.smithi064.stdout:5/840: dwrite dd/d12/d18/d25/fc1 [0,4194304] 0 2024-04-26T21:08:19.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/959: rename d6/d9/d3d/d58 to d6/d15/d67/d154 0 2024-04-26T21:08:19.963 INFO:tasks.workunit.client.1.smithi064.stdout:7/960: creat d6/d15/f155 x:0 0 0 2024-04-26T21:08:19.965 INFO:tasks.workunit.client.0.smithi055.stdout:1/636: dwrite d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:19.965 INFO:tasks.workunit.client.0.smithi055.stdout:9/734: dwrite d2/d46/d51/fe7 [0,4194304] 0 2024-04-26T21:08:19.965 INFO:tasks.workunit.client.0.smithi055.stdout:2/781: truncate d4/d14/d17/f5d 947977 0 2024-04-26T21:08:19.967 INFO:tasks.workunit.client.1.smithi064.stdout:8/812: read f4 [2110267,4717] 0 2024-04-26T21:08:19.967 INFO:tasks.workunit.client.1.smithi064.stdout:8/813: creat d10/d41/d4e/d59/d83/ffb x:0 0 0 2024-04-26T21:08:19.970 INFO:tasks.workunit.client.1.smithi064.stdout:9/893: mkdir d0/d4/da/d67/dd0/df2/d127 0 2024-04-26T21:08:19.970 INFO:tasks.workunit.client.1.smithi064.stdout:9/894: fsync d0/d4/da/d26/d47/d9d/f8c 0 2024-04-26T21:08:19.971 INFO:tasks.workunit.client.1.smithi064.stdout:9/895: creat d0/d4/d7/d102/f128 x:0 0 0 2024-04-26T21:08:19.973 INFO:tasks.workunit.client.1.smithi064.stdout:0/868: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d42/f120 x:0 0 0 2024-04-26T21:08:19.974 INFO:tasks.workunit.client.0.smithi055.stdout:4/576: read d4/d18/d1a/f8a [350399,41275] 0 2024-04-26T21:08:19.976 INFO:tasks.workunit.client.1.smithi064.stdout:6/880: mknod d4/d7/d12/d49/d4b/d7d/d83/d124/c12d 0 2024-04-26T21:08:19.976 INFO:tasks.workunit.client.1.smithi064.stdout:6/881: dread - d4/d7/fa8 zero size 2024-04-26T21:08:19.979 INFO:tasks.workunit.client.0.smithi055.stdout:6/669: write d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e [406692,18039] 0 2024-04-26T21:08:19.983 INFO:tasks.workunit.client.1.smithi064.stdout:4/985: creat d0/d1d/d56/f148 x:0 0 0 2024-04-26T21:08:19.986 INFO:tasks.workunit.client.0.smithi055.stdout:4/577: symlink d4/d26/d42/d28/d53/d71/lc5 0 2024-04-26T21:08:19.993 INFO:tasks.workunit.client.0.smithi055.stdout:7/678: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:19.993 INFO:tasks.workunit.client.1.smithi064.stdout:5/841: write dd/d12/d18/d1a/d1f/dca/fde [2032833,114687] 0 2024-04-26T21:08:19.994 INFO:tasks.workunit.client.1.smithi064.stdout:5/842: stat dd/d12/d4f/d9c/da1 0 2024-04-26T21:08:19.994 INFO:tasks.workunit.client.1.smithi064.stdout:5/843: chown dd/d12/d18/d1a/d1f/d20/f46 29088 1 2024-04-26T21:08:19.994 INFO:tasks.workunit.client.1.smithi064.stdout:5/844: fsync dd/d12/d18/d25/d32/f78 0 2024-04-26T21:08:19.995 INFO:tasks.workunit.client.1.smithi064.stdout:3/881: link d1/ff d1/d27/d50/d35/d4c/d7b/d82/f12c 0 2024-04-26T21:08:19.997 INFO:tasks.workunit.client.0.smithi055.stdout:4/578: mkdir d4/d12/d57/dc6 0 2024-04-26T21:08:19.998 INFO:tasks.workunit.client.0.smithi055.stdout:0/714: sync 2024-04-26T21:08:20.000 INFO:tasks.workunit.client.1.smithi064.stdout:9/896: write d0/d4/da/d26/d47/d9d/f84 [2422035,96978] 0 2024-04-26T21:08:20.004 INFO:tasks.workunit.client.1.smithi064.stdout:7/961: write d6/f91 [1698633,98005] 0 2024-04-26T21:08:20.011 INFO:tasks.workunit.client.1.smithi064.stdout:0/869: mkdir dd/d21/dc8/ddf/d121 0 2024-04-26T21:08:20.017 INFO:tasks.workunit.client.1.smithi064.stdout:4/986: symlink d0/d5/d79/dd1/da0/l149 0 2024-04-26T21:08:20.017 INFO:tasks.workunit.client.1.smithi064.stdout:4/987: creat d0/d5/d79/dd1/f14a x:0 0 0 2024-04-26T21:08:20.024 INFO:tasks.workunit.client.0.smithi055.stdout:9/735: truncate d2/d46/d51/fe7 2834727 0 2024-04-26T21:08:20.024 INFO:tasks.workunit.client.0.smithi055.stdout:9/736: truncate d2/f1c 4108844 0 2024-04-26T21:08:20.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/845: mknod dd/d12/d9a/c10d 0 2024-04-26T21:08:20.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/846: fdatasync dd/da9/d48/d56/fb1 0 2024-04-26T21:08:20.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/847: chown dd/d12/d18/d1a/d1b/f5b 2136864514 1 2024-04-26T21:08:20.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/848: chown dd/d12/d18/d25/d67/f93 65748 1 2024-04-26T21:08:20.027 INFO:tasks.workunit.client.1.smithi064.stdout:5/849: getdents dd/da9/d48/d6a/d101 0 2024-04-26T21:08:20.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/637: dwrite d8/df/d11/d27/d28/d2a/fc9 [4194304,4194304] 0 2024-04-26T21:08:20.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/638: fdatasync d8/f86 0 2024-04-26T21:08:20.029 INFO:tasks.workunit.client.0.smithi055.stdout:1/639: readlink d8/df/d11/d27/d28/d2a/l5d 0 2024-04-26T21:08:20.038 INFO:tasks.workunit.client.1.smithi064.stdout:7/962: mkdir d6/db/d34/d6f/d12c/d156 0 2024-04-26T21:08:20.039 INFO:tasks.workunit.client.1.smithi064.stdout:7/963: stat d6/d70/d74/f85 0 2024-04-26T21:08:20.040 INFO:tasks.workunit.client.1.smithi064.stdout:6/882: write d4/d7/d12/d49/d4b/d5a/daf/f125 [634330,41775] 0 2024-04-26T21:08:20.041 INFO:tasks.workunit.client.1.smithi064.stdout:8/814: dwrite d10/d41/d4e/d54/f57 [0,4194304] 0 2024-04-26T21:08:20.041 INFO:tasks.workunit.client.1.smithi064.stdout:8/815: dread - d10/d41/d4e/d59/fdc zero size 2024-04-26T21:08:20.045 INFO:tasks.workunit.client.1.smithi064.stdout:0/870: creat dd/d21/dc8/d31/d43/f122 x:0 0 0 2024-04-26T21:08:20.051 INFO:tasks.workunit.client.1.smithi064.stdout:7/964: mkdir d6/d9/d157 0 2024-04-26T21:08:20.051 INFO:tasks.workunit.client.1.smithi064.stdout:7/965: truncate d6/d9/f8d 754416 0 2024-04-26T21:08:20.054 INFO:tasks.workunit.client.1.smithi064.stdout:8/816: creat d10/d41/d4e/d59/d5d/d79/ffc x:0 0 0 2024-04-26T21:08:20.057 INFO:tasks.workunit.client.1.smithi064.stdout:0/871: rename dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d42/lca to dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/db1/l123 0 2024-04-26T21:08:20.057 INFO:tasks.workunit.client.0.smithi055.stdout:2/782: dwrite d4/dc/db6/fe5 [0,4194304] 0 2024-04-26T21:08:20.059 INFO:tasks.workunit.client.1.smithi064.stdout:8/817: unlink d10/d41/d4e/d54/cc2 0 2024-04-26T21:08:20.059 INFO:tasks.workunit.client.1.smithi064.stdout:8/818: creat d10/d41/ffd x:0 0 0 2024-04-26T21:08:20.060 INFO:tasks.workunit.client.0.smithi055.stdout:6/670: rmdir d3 39 2024-04-26T21:08:20.060 INFO:tasks.workunit.client.0.smithi055.stdout:8/577: sync 2024-04-26T21:08:20.060 INFO:tasks.workunit.client.0.smithi055.stdout:6/671: truncate d3/d9b/fb4 1334938 0 2024-04-26T21:08:20.060 INFO:tasks.workunit.client.0.smithi055.stdout:3/746: sync 2024-04-26T21:08:20.061 INFO:tasks.workunit.client.1.smithi064.stdout:5/850: dread dd/d12/d18/d25/fc1 [0,4194304] 0 2024-04-26T21:08:20.063 INFO:tasks.workunit.client.1.smithi064.stdout:0/872: rename dd/d21/f107 to dd/d21/dd9/dfc/f124 0 2024-04-26T21:08:20.066 INFO:tasks.workunit.client.0.smithi055.stdout:0/715: rename d9/fc8 to d9/dc/d1c/d3e/d7d/da3/dca/fe4 0 2024-04-26T21:08:20.068 INFO:tasks.workunit.client.0.smithi055.stdout:1/640: getdents d8/df/d11/d27/d28/da4/dbe 0 2024-04-26T21:08:20.069 INFO:tasks.workunit.client.1.smithi064.stdout:5/851: symlink dd/da9/d48/d6a/d9e/db9/de6/l10e 0 2024-04-26T21:08:20.073 INFO:tasks.workunit.client.0.smithi055.stdout:2/783: symlink d4/db/d1f/d46/l108 0 2024-04-26T21:08:20.074 INFO:tasks.workunit.client.0.smithi055.stdout:8/578: creat d3/fc3 x:0 0 0 2024-04-26T21:08:20.074 INFO:tasks.workunit.client.1.smithi064.stdout:3/882: dwrite d1/d27/d50/d35/d4c/d7b/d82/fd7 [0,4194304] 0 2024-04-26T21:08:20.074 INFO:tasks.workunit.client.1.smithi064.stdout:3/883: truncate d1/d27/d50/f74 1346843 0 2024-04-26T21:08:20.077 INFO:tasks.workunit.client.0.smithi055.stdout:7/679: dwrite d5/d6/d24/d3b/f42 [0,4194304] 0 2024-04-26T21:08:20.077 INFO:tasks.workunit.client.0.smithi055.stdout:6/672: unlink d3/d17/d46/d54/d66/d6a/d51/d58/d6d/fc0 0 2024-04-26T21:08:20.077 INFO:tasks.workunit.client.0.smithi055.stdout:3/747: rmdir d0/d4/d5/d73/d13/d1a 39 2024-04-26T21:08:20.077 INFO:tasks.workunit.client.0.smithi055.stdout:3/748: write d0/d4/d5/d73/d47/d37/de7/f105 [331929,19413] 0 2024-04-26T21:08:20.078 INFO:tasks.workunit.client.0.smithi055.stdout:4/579: rmdir d4/d18/d1a/d49 39 2024-04-26T21:08:20.081 INFO:tasks.workunit.client.1.smithi064.stdout:7/966: write d6/d15/d88/dca/d5c/db5/f14c [934120,10542] 0 2024-04-26T21:08:20.082 INFO:tasks.workunit.client.1.smithi064.stdout:4/988: dwrite d0/d1d/d56/d89/f96 [0,4194304] 0 2024-04-26T21:08:20.083 INFO:tasks.workunit.client.1.smithi064.stdout:3/884: mknod d1/d27/d29/c12d 0 2024-04-26T21:08:20.084 INFO:tasks.workunit.client.1.smithi064.stdout:5/852: dread dd/d12/d18/d1a/d1f/f5a [0,4194304] 0 2024-04-26T21:08:20.086 INFO:tasks.workunit.client.0.smithi055.stdout:0/716: creat d9/d11/fe5 x:0 0 0 2024-04-26T21:08:20.089 INFO:tasks.workunit.client.1.smithi064.stdout:0/873: dread dd/d21/dc8/d31/d47/dad/dfd/f9a [0,4194304] 0 2024-04-26T21:08:20.089 INFO:tasks.workunit.client.1.smithi064.stdout:0/874: rename dd/d21/dc8/d31 to dd/d21/dc8/d31/d5c/d125 22 2024-04-26T21:08:20.089 INFO:tasks.workunit.client.1.smithi064.stdout:0/875: readlink dd/d21/dc8/d31/d5c/le4 0 2024-04-26T21:08:20.096 INFO:tasks.workunit.client.1.smithi064.stdout:9/897: dwrite d0/d4/d28/dff/d103/f11c [0,4194304] 0 2024-04-26T21:08:20.096 INFO:tasks.workunit.client.1.smithi064.stdout:9/898: chown d0/d4/da/d26/d45/fbb 214172284 1 2024-04-26T21:08:20.101 INFO:tasks.workunit.client.0.smithi055.stdout:9/737: dwrite d2/d46/d9a/d105/d97/fc4 [0,4194304] 0 2024-04-26T21:08:20.101 INFO:tasks.workunit.client.0.smithi055.stdout:1/641: creat d8/df/d11/d27/d28/d2a/da7/fd3 x:0 0 0 2024-04-26T21:08:20.109 INFO:tasks.workunit.client.0.smithi055.stdout:2/784: mknod d4/d14/dc5/c109 0 2024-04-26T21:08:20.111 INFO:tasks.workunit.client.1.smithi064.stdout:5/853: dread dd/d12/d4f/f66 [0,4194304] 0 2024-04-26T21:08:20.112 INFO:tasks.workunit.client.0.smithi055.stdout:5/572: sync 2024-04-26T21:08:20.116 INFO:tasks.workunit.client.1.smithi064.stdout:7/967: creat d6/d9/d3d/d43/f158 x:0 0 0 2024-04-26T21:08:20.119 INFO:tasks.workunit.client.0.smithi055.stdout:8/579: symlink d3/d9/d1d/d48/d57/d61/lc4 0 2024-04-26T21:08:20.122 INFO:tasks.workunit.client.1.smithi064.stdout:4/989: mkdir d0/d5/d14b 0 2024-04-26T21:08:20.122 INFO:tasks.workunit.client.1.smithi064.stdout:4/990: creat d0/d5/d13/d33/dd0/f14c x:0 0 0 2024-04-26T21:08:20.130 INFO:tasks.workunit.client.0.smithi055.stdout:6/673: creat d3/d17/d46/fed x:0 0 0 2024-04-26T21:08:20.130 INFO:tasks.workunit.client.0.smithi055.stdout:3/749: creat d0/d4/d16/d18/f106 x:0 0 0 2024-04-26T21:08:20.130 INFO:tasks.workunit.client.0.smithi055.stdout:6/674: fdatasync d3/d17/faa 0 2024-04-26T21:08:20.136 INFO:tasks.workunit.client.1.smithi064.stdout:0/876: symlink dd/d21/dc8/l126 0 2024-04-26T21:08:20.143 INFO:tasks.workunit.client.0.smithi055.stdout:4/580: dwrite d4/d18/f89 [0,4194304] 0 2024-04-26T21:08:20.143 INFO:tasks.workunit.client.0.smithi055.stdout:8/580: rmdir d3/dc0 39 2024-04-26T21:08:20.144 INFO:tasks.workunit.client.1.smithi064.stdout:6/883: dwrite d4/d7/fa8 [0,4194304] 0 2024-04-26T21:08:20.150 INFO:tasks.workunit.client.1.smithi064.stdout:5/854: mknod dd/da9/d48/d6a/d9e/db9/de6/c10f 0 2024-04-26T21:08:20.150 INFO:tasks.workunit.client.0.smithi055.stdout:3/750: mkdir d0/de/d107 0 2024-04-26T21:08:20.156 INFO:tasks.workunit.client.1.smithi064.stdout:3/885: dwrite d1/d27/d29/f92 [0,4194304] 0 2024-04-26T21:08:20.156 INFO:tasks.workunit.client.1.smithi064.stdout:3/886: read - d1/d27/d50/d35/d4c/d7b/d82/f119 zero size 2024-04-26T21:08:20.158 INFO:tasks.workunit.client.0.smithi055.stdout:1/642: dread d8/df/d11/d27/d28/d2a/fc9 [4194304,4194304] 0 2024-04-26T21:08:20.158 INFO:tasks.workunit.client.0.smithi055.stdout:1/643: chown d8/d17/d1b/la2 3635546 1 2024-04-26T21:08:20.158 INFO:tasks.workunit.client.0.smithi055.stdout:1/644: write d8/df/d11/d27/d28/f72 [9423468,38372] 0 2024-04-26T21:08:20.159 INFO:tasks.workunit.client.1.smithi064.stdout:4/991: link d0/d5/d79/dd1/f88 d0/d5/d13/d10/dd7/f14d 0 2024-04-26T21:08:20.164 INFO:tasks.workunit.client.0.smithi055.stdout:6/675: creat d3/d17/d46/d54/d66/d6a/d67/fee x:0 0 0 2024-04-26T21:08:20.164 INFO:tasks.workunit.client.0.smithi055.stdout:6/676: write d3/d17/d46/d54/d66/d6a/d67/fee [277583,51246] 0 2024-04-26T21:08:20.168 INFO:tasks.workunit.client.1.smithi064.stdout:0/877: mknod dd/d21/dc8/d31/d47/dad/dfd/c127 0 2024-04-26T21:08:20.171 INFO:tasks.workunit.client.1.smithi064.stdout:9/899: dwrite d0/d4/da/d67/dd0/dd2/f9f [0,4194304] 0 2024-04-26T21:08:20.171 INFO:tasks.workunit.client.1.smithi064.stdout:9/900: creat d0/d4/da/d26/d45/dc4/f129 x:0 0 0 2024-04-26T21:08:20.171 INFO:tasks.workunit.client.0.smithi055.stdout:6/677: unlink d3/d17/d25/f39 0 2024-04-26T21:08:20.178 INFO:tasks.workunit.client.1.smithi064.stdout:4/992: dread d0/d1d/d17/d44/dac/f67 [0,4194304] 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:5/573: dwrite d4/df/d13/d26/f7e [0,4194304] 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:5/574: getdents d4/df/d13/d26/d3c/dc0 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:0/717: write d9/dc/d19/ddb/db6/d67/f93 [1419512,98000] 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:0/718: readlink d9/dc/d17/l38 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:7/680: rename d5/d53/d6e/d6c/d7a to d5/d6/d24/dcf 0 2024-04-26T21:08:20.181 INFO:tasks.workunit.client.0.smithi055.stdout:7/681: truncate d5/d6/d39/dbc/fcb 109951 0 2024-04-26T21:08:20.182 INFO:tasks.workunit.client.0.smithi055.stdout:6/678: link d3/d17/d25/d5f/d90/l5a d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/daf/lef 0 2024-04-26T21:08:20.190 INFO:tasks.workunit.client.0.smithi055.stdout:5/575: truncate d4/df/d13/d26/d3c/d4a/d3f/f2c 1502724 0 2024-04-26T21:08:20.195 INFO:tasks.workunit.client.0.smithi055.stdout:8/581: dwrite d3/d9/d1d/d48/d4b/d8b/f93 [4194304,4194304] 0 2024-04-26T21:08:20.196 INFO:tasks.workunit.client.0.smithi055.stdout:0/719: truncate d9/f64 1182831 0 2024-04-26T21:08:20.196 INFO:tasks.workunit.client.0.smithi055.stdout:0/720: dread - d9/dc/d1c/d3e/dc5/fdd zero size 2024-04-26T21:08:20.196 INFO:tasks.workunit.client.1.smithi064.stdout:4/993: dread d0/d5/d13/d33/fe3 [0,4194304] 0 2024-04-26T21:08:20.198 INFO:tasks.workunit.client.1.smithi064.stdout:6/884: unlink d4/d7/d12/f18 0 2024-04-26T21:08:20.201 INFO:tasks.workunit.client.0.smithi055.stdout:7/682: rename d5/d53/d6e/d99/d7f/d6f/dc6/dc8/c9d to d5/d6/d24/d4d/da7/dab/dae/cd0 0 2024-04-26T21:08:20.203 INFO:tasks.workunit.client.1.smithi064.stdout:9/901: dwrite d0/d4/da/d26/d45/dc4/f129 [0,4194304] 0 2024-04-26T21:08:20.203 INFO:tasks.workunit.client.1.smithi064.stdout:9/902: write d0/d4/da/faa [4927288,100942] 0 2024-04-26T21:08:20.203 INFO:tasks.workunit.client.1.smithi064.stdout:9/903: chown d0/d4/da/d67/dd0/df2 1021482059 1 2024-04-26T21:08:20.203 INFO:tasks.workunit.client.1.smithi064.stdout:9/904: chown d0/d4/f53 788749 1 2024-04-26T21:08:20.204 INFO:tasks.workunit.client.0.smithi055.stdout:6/679: creat d3/da5/ff0 x:0 0 0 2024-04-26T21:08:20.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/721: dread d9/dc/d19/ddb/db6/f8e [0,4194304] 0 2024-04-26T21:08:20.205 INFO:tasks.workunit.client.0.smithi055.stdout:0/722: write d9/dc/f10 [4450620,4968] 0 2024-04-26T21:08:20.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/576: getdents d4/df/d13/d26/d3c/d93 0 2024-04-26T21:08:20.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/577: dread - d4/df/d13/d26/d3c/d4a/f8a zero size 2024-04-26T21:08:20.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/578: fdatasync d4/df/d13/d26/f31 0 2024-04-26T21:08:20.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/579: creat d4/df/d13/d26/d3c/d4a/fca x:0 0 0 2024-04-26T21:08:20.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/580: read d4/df/f3b [543285,18021] 0 2024-04-26T21:08:20.216 INFO:tasks.workunit.client.1.smithi064.stdout:3/887: symlink d1/d27/d29/d6f/d72/da5/d7d/d8a/l12e 0 2024-04-26T21:08:20.216 INFO:tasks.workunit.client.1.smithi064.stdout:3/888: write d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/f108 [303296,59215] 0 2024-04-26T21:08:20.216 INFO:tasks.workunit.client.1.smithi064.stdout:3/889: creat d1/d27/d50/d35/d4c/d7b/dcd/f12f x:0 0 0 2024-04-26T21:08:20.234 INFO:tasks.workunit.client.0.smithi055.stdout:5/581: write d4/df/d13/f95 [3933570,10598] 0 2024-04-26T21:08:20.234 INFO:tasks.workunit.client.0.smithi055.stdout:8/582: mkdir d3/d9/d5b/da4/dc5 0 2024-04-26T21:08:20.234 INFO:tasks.workunit.client.0.smithi055.stdout:8/583: stat d3/d9/d1d/d48/d57/d61 0 2024-04-26T21:08:20.245 INFO:tasks.workunit.client.0.smithi055.stdout:2/785: rename d4/f89 to d4/d55/f10a 0 2024-04-26T21:08:20.248 INFO:tasks.workunit.client.1.smithi064.stdout:0/878: mknod dd/d21/dc8/d31/d47/dad/dfd/d18/d58/df2/c128 0 2024-04-26T21:08:20.252 INFO:tasks.workunit.client.0.smithi055.stdout:6/680: mknod d3/da1/de3/db6/cf1 0 2024-04-26T21:08:20.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:19 smithi055 ceph-mon[25475]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:20.258 INFO:tasks.workunit.client.0.smithi055.stdout:0/723: creat d9/dc/d1c/d3e/d7d/da3/fe6 x:0 0 0 2024-04-26T21:08:20.264 INFO:tasks.workunit.client.0.smithi055.stdout:8/584: creat d3/d77/fc6 x:0 0 0 2024-04-26T21:08:20.267 INFO:tasks.workunit.client.0.smithi055.stdout:7/683: dwrite d5/d53/f8a [0,4194304] 0 2024-04-26T21:08:20.267 INFO:tasks.workunit.client.1.smithi064.stdout:6/885: dwrite d4/d7/d12/d49/f5c [0,4194304] 0 2024-04-26T21:08:20.273 INFO:tasks.workunit.client.0.smithi055.stdout:2/786: unlink d4/db/d8f/df8/d5e/cfe 0 2024-04-26T21:08:20.273 INFO:tasks.workunit.client.0.smithi055.stdout:2/787: chown d4 2 1 2024-04-26T21:08:20.278 INFO:tasks.workunit.client.0.smithi055.stdout:1/645: rename d8/d17/d1b/l4e to d8/df/d11/d27/d28/da4/ld4 0 2024-04-26T21:08:20.280 INFO:tasks.workunit.client.1.smithi064.stdout:9/905: dwrite d0/d4/d7/fd [0,4194304] 0 2024-04-26T21:08:20.280 INFO:tasks.workunit.client.1.smithi064.stdout:9/906: chown d0/d4/da/d31/dc2 469 1 2024-04-26T21:08:20.280 INFO:tasks.workunit.client.1.smithi064.stdout:9/907: fdatasync d0/d4/da/d26/d47/d9d/fd5 0 2024-04-26T21:08:20.285 INFO:tasks.workunit.client.0.smithi055.stdout:0/724: rmdir d9/dc/d19/ddb/db6/d6c/d7a 39 2024-04-26T21:08:20.287 INFO:tasks.workunit.client.0.smithi055.stdout:8/585: stat d3/dc0/d2e/d75/d76/ca3 0 2024-04-26T21:08:20.291 INFO:tasks.workunit.client.0.smithi055.stdout:7/684: fsync d5/d6/d24/f30 0 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/994: mknod d0/d1d/d17/d44/dac/da9/d12f/c14e 0 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/995: truncate d0/d2f/d69/f144 516720 0 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/996: dread - d0/d5/d115/f11c zero size 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/997: creat d0/d5/d79/dd1/f14f x:0 0 0 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/998: fsync d0/d5/d79/dd1/f75 0 2024-04-26T21:08:20.293 INFO:tasks.workunit.client.1.smithi064.stdout:4/999: fsync d0/d5/d13/d6d/f10c 0 2024-04-26T21:08:20.294 INFO:tasks.workunit.client.0.smithi055.stdout:2/788: mknod d4/db/d8f/df8/d5e/d7d/c10b 0 2024-04-26T21:08:20.298 INFO:tasks.workunit.client.1.smithi064.stdout:3/890: mknod d1/d27/d50/c130 0 2024-04-26T21:08:20.300 INFO:tasks.workunit.client.0.smithi055.stdout:0/725: creat d9/dc/d1c/d3e/dc5/dcc/db2/fe7 x:0 0 0 2024-04-26T21:08:20.306 INFO:tasks.workunit.client.0.smithi055.stdout:8/586: truncate d3/d9/f3b 1138709 0 2024-04-26T21:08:20.308 INFO:tasks.workunit.client.1.smithi064.stdout:6/886: rename d4/d7/d12/d38/c11a to d4/d10e/c12e 0 2024-04-26T21:08:20.308 INFO:tasks.workunit.client.1.smithi064.stdout:0/879: dwrite dd/d21/dc8/d31/d5c/feb [0,4194304] 0 2024-04-26T21:08:20.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/880: chown dd/d21/dc8/d31/d47/dad/dfd/d74/d1d 6931520 1 2024-04-26T21:08:20.309 INFO:tasks.workunit.client.0.smithi055.stdout:2/789: mkdir d4/d55/dde/d10c 0 2024-04-26T21:08:20.310 INFO:tasks.workunit.client.0.smithi055.stdout:2/790: dread - d4/db/d1f/d32/fc8 zero size 2024-04-26T21:08:20.312 INFO:tasks.workunit.client.0.smithi055.stdout:1/646: mknod d8/cd5 0 2024-04-26T21:08:20.312 INFO:tasks.workunit.client.0.smithi055.stdout:7/685: write d5/d11/f1a [2974066,78483] 0 2024-04-26T21:08:20.313 INFO:tasks.workunit.client.0.smithi055.stdout:6/681: dwrite d3/da1/de3/fd7 [4194304,4194304] 0 2024-04-26T21:08:20.313 INFO:tasks.workunit.client.0.smithi055.stdout:6/682: dread - d3/da1/de3/fc4 zero size 2024-04-26T21:08:20.315 INFO:tasks.workunit.client.0.smithi055.stdout:8/587: truncate d3/dc0/d2e/d75/d76/d92/fbf 2476967 0 2024-04-26T21:08:20.315 INFO:tasks.workunit.client.0.smithi055.stdout:8/588: write d3/d9/d1d/f85 [624454,71909] 0 2024-04-26T21:08:20.315 INFO:tasks.workunit.client.1.smithi064.stdout:3/891: rmdir d1/d27/d29/d6f/d72/da5 39 2024-04-26T21:08:20.319 INFO:tasks.workunit.client.0.smithi055.stdout:2/791: creat d4/d1e/d90/dbc/f10d x:0 0 0 2024-04-26T21:08:20.320 INFO:tasks.workunit.client.0.smithi055.stdout:0/726: write d9/dc/d17/f3a [2008104,24879] 0 2024-04-26T21:08:20.322 INFO:tasks.workunit.client.0.smithi055.stdout:1/647: creat d8/d94/fd6 x:0 0 0 2024-04-26T21:08:20.322 INFO:tasks.workunit.client.0.smithi055.stdout:1/648: dread - d8/d17/d1b/d7b/d65/f71 zero size 2024-04-26T21:08:20.329 INFO:tasks.workunit.client.0.smithi055.stdout:6/683: creat d3/d17/d46/d54/d66/d6a/d67/d83/ff2 x:0 0 0 2024-04-26T21:08:20.333 INFO:tasks.workunit.client.0.smithi055.stdout:0/727: mknod d9/dc/d1c/d3e/dc5/dcc/dc2/ce8 0 2024-04-26T21:08:20.340 INFO:tasks.workunit.client.0.smithi055.stdout:6/684: mkdir d3/d17/d46/dc2/dd4/df3 0 2024-04-26T21:08:20.340 INFO:tasks.workunit.client.0.smithi055.stdout:6/685: readlink d3/d17/d19/l59 0 2024-04-26T21:08:20.340 INFO:tasks.workunit.client.0.smithi055.stdout:6/686: write d3/da1/fcf [567757,90211] 0 2024-04-26T21:08:20.340 INFO:tasks.workunit.client.0.smithi055.stdout:6/687: read - d3/da1/de3/fc4 zero size 2024-04-26T21:08:20.344 INFO:tasks.workunit.client.0.smithi055.stdout:7/686: rename d5/db to d5/d53/dd1 0 2024-04-26T21:08:20.348 INFO:tasks.workunit.client.0.smithi055.stdout:6/688: creat d3/d17/d46/dc2/dd4/df3/ff4 x:0 0 0 2024-04-26T21:08:20.352 INFO:tasks.workunit.client.0.smithi055.stdout:1/649: rename d8/df/d11/d27/d63 to d8/df/d11/d27/d28/dd7 0 2024-04-26T21:08:20.352 INFO:tasks.workunit.client.0.smithi055.stdout:1/650: readlink d8/df/d11/l9d 0 2024-04-26T21:08:20.359 INFO:tasks.workunit.client.0.smithi055.stdout:7/687: symlink d5/d53/d6e/d99/d58/ld2 0 2024-04-26T21:08:20.362 INFO:tasks.workunit.client.1.smithi064.stdout:5/855: sync 2024-04-26T21:08:20.362 INFO:tasks.workunit.client.1.smithi064.stdout:8/819: sync 2024-04-26T21:08:20.363 INFO:tasks.workunit.client.1.smithi064.stdout:7/968: sync 2024-04-26T21:08:20.363 INFO:tasks.workunit.client.1.smithi064.stdout:5/856: chown dd/da9/d63/f84 429247 1 2024-04-26T21:08:20.363 INFO:tasks.workunit.client.1.smithi064.stdout:8/820: write d10/f7e [225092,21859] 0 2024-04-26T21:08:20.363 INFO:tasks.workunit.client.1.smithi064.stdout:8/821: fdatasync d10/d41/d44/fb5 0 2024-04-26T21:08:20.363 INFO:tasks.workunit.client.0.smithi055.stdout:6/689: mkdir d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/daf/df5 0 2024-04-26T21:08:20.365 INFO:tasks.workunit.client.1.smithi064.stdout:9/908: rename d0/d4/da/d26/d47/f73 to d0/d4/d7/df6/dfe/f12a 0 2024-04-26T21:08:20.367 INFO:tasks.workunit.client.1.smithi064.stdout:0/881: link dd/d21/dc8/d31/d47/dad/faf dd/d21/dc8/d31/d47/dad/dfd/f129 0 2024-04-26T21:08:20.372 INFO:tasks.workunit.client.0.smithi055.stdout:0/728: rename d9/dc/d17/c66 to d9/d11/d5b/d74/ce9 0 2024-04-26T21:08:20.377 INFO:tasks.workunit.client.1.smithi064.stdout:6/887: mkdir d4/d7/d12/d1e/d12f 0 2024-04-26T21:08:20.377 INFO:tasks.workunit.client.1.smithi064.stdout:6/888: chown d4/d99/la3 68452 1 2024-04-26T21:08:20.380 INFO:tasks.workunit.client.1.smithi064.stdout:8/822: truncate d10/f9e 566734 0 2024-04-26T21:08:20.380 INFO:tasks.workunit.client.1.smithi064.stdout:8/823: creat d10/d41/d4e/d54/ffe x:0 0 0 2024-04-26T21:08:20.380 INFO:tasks.workunit.client.1.smithi064.stdout:8/824: stat d10/l20 0 2024-04-26T21:08:20.383 INFO:tasks.workunit.client.1.smithi064.stdout:8/825: creat d10/d41/d4e/d59/d83/fff x:0 0 0 2024-04-26T21:08:20.383 INFO:tasks.workunit.client.0.smithi055.stdout:1/651: dread d8/df/d11/d27/d28/dd7/fb0 [0,4194304] 0 2024-04-26T21:08:20.387 INFO:tasks.workunit.client.0.smithi055.stdout:0/729: rename d9/dc/d1c/d3b/f6e to d9/d11/d59/d78/fea 0 2024-04-26T21:08:20.387 INFO:tasks.workunit.client.0.smithi055.stdout:0/730: read d9/dc/d1c/d3e/fa2 [456922,53982] 0 2024-04-26T21:08:20.387 INFO:tasks.workunit.client.1.smithi064.stdout:3/892: rename d1/ff to d1/d27/d50/d35/d4c/d7b/d82/d9b/f131 0 2024-04-26T21:08:20.388 INFO:tasks.workunit.client.1.smithi064.stdout:0/882: mknod dd/d21/dc8/d31/d47/dad/dce/c12a 0 2024-04-26T21:08:20.388 INFO:tasks.workunit.client.1.smithi064.stdout:0/883: chown dd/d21/dc8/d31/d47/dad/dfd/d18/d64/dda 7242773 1 2024-04-26T21:08:20.391 INFO:tasks.workunit.client.0.smithi055.stdout:6/690: getdents d3/d17/d25 0 2024-04-26T21:08:20.391 INFO:tasks.workunit.client.0.smithi055.stdout:6/691: fdatasync d3/d17/d46/dc2/fc5 0 2024-04-26T21:08:20.391 INFO:tasks.workunit.client.0.smithi055.stdout:6/692: fsync d3/da1/de3/fcd 0 2024-04-26T21:08:20.391 INFO:tasks.workunit.client.0.smithi055.stdout:6/693: dread - d3/d17/fc8 zero size 2024-04-26T21:08:20.391 INFO:tasks.workunit.client.0.smithi055.stdout:6/694: fdatasync d3/f16 0 2024-04-26T21:08:20.398 INFO:tasks.workunit.client.0.smithi055.stdout:2/792: dwrite d4/db/d1f/d46/fee [0,4194304] 0 2024-04-26T21:08:20.398 INFO:tasks.workunit.client.0.smithi055.stdout:2/793: fsync d4/db/d1f/d46/fb7 0 2024-04-26T21:08:20.398 INFO:tasks.workunit.client.0.smithi055.stdout:1/652: symlink d8/d17/d33/dc5/ld8 0 2024-04-26T21:08:20.400 INFO:tasks.workunit.client.1.smithi064.stdout:8/826: creat d10/d41/d44/f100 x:0 0 0 2024-04-26T21:08:20.400 INFO:tasks.workunit.client.1.smithi064.stdout:8/827: read - d10/d41/d4e/d54/fcf zero size 2024-04-26T21:08:20.401 INFO:tasks.workunit.client.0.smithi055.stdout:8/589: dwrite d3/d9/d1d/f6e [0,4194304] 0 2024-04-26T21:08:20.401 INFO:tasks.workunit.client.1.smithi064.stdout:8/828: creat d10/d2f/d90/f101 x:0 0 0 2024-04-26T21:08:20.402 INFO:tasks.workunit.client.1.smithi064.stdout:3/893: creat d1/d27/dee/f132 x:0 0 0 2024-04-26T21:08:20.404 INFO:tasks.workunit.client.1.smithi064.stdout:0/884: symlink dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/l12b 0 2024-04-26T21:08:20.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:19 smithi064 ceph-mon[33404]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:20.408 INFO:tasks.workunit.client.1.smithi064.stdout:5/857: dwrite dd/da9/d48/d6a/f9b [0,4194304] 0 2024-04-26T21:08:20.409 INFO:tasks.workunit.client.1.smithi064.stdout:5/858: chown dd/da9/d48/f4c 235343698 1 2024-04-26T21:08:20.419 INFO:tasks.workunit.client.0.smithi055.stdout:2/794: dread d4/d1e/d2a/f6b [0,4194304] 0 2024-04-26T21:08:20.421 INFO:tasks.workunit.client.0.smithi055.stdout:8/590: dread d3/d9/d1d/f53 [0,4194304] 0 2024-04-26T21:08:20.423 INFO:tasks.workunit.client.1.smithi064.stdout:7/969: dread d6/d8c/f9c [4194304,4194304] 0 2024-04-26T21:08:20.423 INFO:tasks.workunit.client.1.smithi064.stdout:0/885: write dd/d21/dc8/d31/d47/dad/dfd/fe1 [2242785,129703] 0 2024-04-26T21:08:20.424 INFO:tasks.workunit.client.1.smithi064.stdout:0/886: dread - dd/d21/df9/d104/f11c zero size 2024-04-26T21:08:20.424 INFO:tasks.workunit.client.1.smithi064.stdout:6/889: dwrite d4/d7/d33/fdc [0,4194304] 0 2024-04-26T21:08:20.425 INFO:tasks.workunit.client.0.smithi055.stdout:7/688: write d5/d6/d24/d3b/f45 [2782013,55611] 0 2024-04-26T21:08:20.426 INFO:tasks.workunit.client.1.smithi064.stdout:8/829: creat d10/d1d/da3/ded/f102 x:0 0 0 2024-04-26T21:08:20.429 INFO:tasks.workunit.client.1.smithi064.stdout:3/894: symlink d1/d27/d29/d6f/d72/d95/dd9/l133 0 2024-04-26T21:08:20.429 INFO:tasks.workunit.client.1.smithi064.stdout:3/895: chown d1/d27/d29/c12d 14682 1 2024-04-26T21:08:20.432 INFO:tasks.workunit.client.1.smithi064.stdout:5/859: mkdir dd/da9/d48/d6a/d9e/db9/ded/d110 0 2024-04-26T21:08:20.434 INFO:tasks.workunit.client.0.smithi055.stdout:2/795: read d4/d1e/f92 [1405594,12218] 0 2024-04-26T21:08:20.436 INFO:tasks.workunit.client.0.smithi055.stdout:1/653: mkdir d8/d94/dd9 0 2024-04-26T21:08:20.436 INFO:tasks.workunit.client.0.smithi055.stdout:1/654: stat d8/df/d11/d27/d28/d2a/da7 0 2024-04-26T21:08:20.437 INFO:tasks.workunit.client.0.smithi055.stdout:1/655: creat d8/df/d11/d27/d28/da4/daa/fda x:0 0 0 2024-04-26T21:08:20.438 INFO:tasks.workunit.client.1.smithi064.stdout:7/970: unlink d6/d9/d3d/cf5 0 2024-04-26T21:08:20.438 INFO:tasks.workunit.client.1.smithi064.stdout:7/971: truncate d6/d9/d3d/d43/f14e 666819 0 2024-04-26T21:08:20.446 INFO:tasks.workunit.client.1.smithi064.stdout:3/896: symlink d1/d27/d29/d6f/d72/da5/d7d/d8a/l134 0 2024-04-26T21:08:20.450 INFO:tasks.workunit.client.1.smithi064.stdout:5/860: symlink dd/d12/d18/d25/d67/l111 0 2024-04-26T21:08:20.450 INFO:tasks.workunit.client.1.smithi064.stdout:5/861: dread - dd/d12/d18/d25/d32/fa3 zero size 2024-04-26T21:08:20.450 INFO:tasks.workunit.client.1.smithi064.stdout:5/862: stat dd/d12/d4f/dbd/d105/fcd 0 2024-04-26T21:08:20.451 INFO:tasks.workunit.client.1.smithi064.stdout:5/863: write dd/d12/d18/d1a/d1f/d20/f8b [4783079,95535] 0 2024-04-26T21:08:20.454 INFO:tasks.workunit.client.1.smithi064.stdout:3/897: creat d1/d27/d29/d5e/d113/f135 x:0 0 0 2024-04-26T21:08:20.457 INFO:tasks.workunit.client.0.smithi055.stdout:8/591: mkdir d3/dc0/d2e/d75/d76/d92/dc7 0 2024-04-26T21:08:20.460 INFO:tasks.workunit.client.1.smithi064.stdout:5/864: creat dd/d12/d4f/d64/d73/f112 x:0 0 0 2024-04-26T21:08:20.461 INFO:tasks.workunit.client.0.smithi055.stdout:6/695: truncate d3/da1/de3/fd7 4456522 0 2024-04-26T21:08:20.462 INFO:tasks.workunit.client.1.smithi064.stdout:7/972: dread d6/db/fbc [0,4194304] 0 2024-04-26T21:08:20.463 INFO:tasks.workunit.client.1.smithi064.stdout:8/830: dwrite d10/d2f/d61/fb6 [0,4194304] 0 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.1.smithi064.stdout:8/831: write d10/d41/d4e/d54/dc3/fcb [2873674,30639] 0 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.1.smithi064.stdout:8/832: write d10/d41/d4e/d59/d83/fe4 [388746,87741] 0 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.1.smithi064.stdout:8/833: chown d10/d41/ldd 71035271 1 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.1.smithi064.stdout:8/834: chown d10/d41/d4e/d59/d5d/d79/ddf/ff6 16021 1 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.1.smithi064.stdout:8/835: write d10/d41/d4e/d54/fcf [304769,92487] 0 2024-04-26T21:08:20.464 INFO:tasks.workunit.client.0.smithi055.stdout:1/656: dread d8/f15 [0,4194304] 0 2024-04-26T21:08:20.466 INFO:tasks.workunit.client.1.smithi064.stdout:3/898: mkdir d1/d27/d50/d35/d4c/d7b/dcd/d126/d136 0 2024-04-26T21:08:20.467 INFO:tasks.workunit.client.0.smithi055.stdout:8/592: creat d3/d7c/d9a/fc8 x:0 0 0 2024-04-26T21:08:20.467 INFO:tasks.workunit.client.0.smithi055.stdout:8/593: dread - d3/d9/d5b/f6d zero size 2024-04-26T21:08:20.467 INFO:tasks.workunit.client.0.smithi055.stdout:8/594: chown d3 33045807 1 2024-04-26T21:08:20.468 INFO:tasks.workunit.client.0.smithi055.stdout:8/595: chown d3/d9/f24 91432303 1 2024-04-26T21:08:20.468 INFO:tasks.workunit.client.1.smithi064.stdout:7/973: symlink d6/d15/d88/d113/l159 0 2024-04-26T21:08:20.468 INFO:tasks.workunit.client.1.smithi064.stdout:5/865: truncate dd/d12/d18/d1a/d1f/d20/f2d 1197282 0 2024-04-26T21:08:20.469 INFO:tasks.workunit.client.0.smithi055.stdout:7/689: mknod d5/d6/d24/d52/cd3 0 2024-04-26T21:08:20.469 INFO:tasks.workunit.client.1.smithi064.stdout:5/866: fsync dd/d12/d18/d1a/d1b/f6c 0 2024-04-26T21:08:20.473 INFO:tasks.workunit.client.0.smithi055.stdout:6/696: link d3/d17/d19/f36 d3/d17/d25/d5f/ff6 0 2024-04-26T21:08:20.474 INFO:tasks.workunit.client.0.smithi055.stdout:6/697: chown d3/f8b 2118132 1 2024-04-26T21:08:20.474 INFO:tasks.workunit.client.0.smithi055.stdout:6/698: write d3/d17/f94 [492632,36227] 0 2024-04-26T21:08:20.475 INFO:tasks.workunit.client.0.smithi055.stdout:2/796: getdents d4/d14/d17/d6d 0 2024-04-26T21:08:20.475 INFO:tasks.workunit.client.0.smithi055.stdout:2/797: chown d4/db/d8f/df8/d5e/f95 198021 1 2024-04-26T21:08:20.478 INFO:tasks.workunit.client.0.smithi055.stdout:1/657: creat d8/df/d11/d6c/fdb x:0 0 0 2024-04-26T21:08:20.481 INFO:tasks.workunit.client.0.smithi055.stdout:4/581: sync 2024-04-26T21:08:20.481 INFO:tasks.workunit.client.0.smithi055.stdout:9/738: sync 2024-04-26T21:08:20.481 INFO:tasks.workunit.client.0.smithi055.stdout:3/751: sync 2024-04-26T21:08:20.481 INFO:tasks.workunit.client.0.smithi055.stdout:9/739: fsync d2/d46/d77/d7d/ff0 0 2024-04-26T21:08:20.481 INFO:tasks.workunit.client.0.smithi055.stdout:9/740: dread - d2/fe1 zero size 2024-04-26T21:08:20.482 INFO:tasks.workunit.client.1.smithi064.stdout:8/836: write d10/d2f/f3a [5299843,14384] 0 2024-04-26T21:08:20.482 INFO:tasks.workunit.client.1.smithi064.stdout:8/837: write d10/f47 [3476977,20225] 0 2024-04-26T21:08:20.485 INFO:tasks.workunit.client.1.smithi064.stdout:0/887: dwrite dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f94 [0,4194304] 0 2024-04-26T21:08:20.485 INFO:tasks.workunit.client.1.smithi064.stdout:0/888: dread - dd/df6/f100 zero size 2024-04-26T21:08:20.485 INFO:tasks.workunit.client.1.smithi064.stdout:0/889: stat dd/d21/dc8/d31/d47/dad/dfd/d18/d58/dba 0 2024-04-26T21:08:20.491 INFO:tasks.workunit.client.1.smithi064.stdout:3/899: mkdir d1/d27/d29/d6f/dfc/d137 0 2024-04-26T21:08:20.493 INFO:tasks.workunit.client.0.smithi055.stdout:8/596: symlink d3/d7c/d9a/lc9 0 2024-04-26T21:08:20.493 INFO:tasks.workunit.client.0.smithi055.stdout:6/699: dread d3/d17/d25/d5f/d90/f69 [0,4194304] 0 2024-04-26T21:08:20.502 INFO:tasks.workunit.client.1.smithi064.stdout:5/867: dread dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:20.504 INFO:tasks.workunit.client.0.smithi055.stdout:2/798: symlink d4/d14/d17/l10e 0 2024-04-26T21:08:20.510 INFO:tasks.workunit.client.0.smithi055.stdout:8/597: getdents d3/d9/d1d/d48/d57/d61/d9b 0 2024-04-26T21:08:20.510 INFO:tasks.workunit.client.0.smithi055.stdout:8/598: dread - d3/d9/d1d/d48/d57/d61/f8c zero size 2024-04-26T21:08:20.510 INFO:tasks.workunit.client.0.smithi055.stdout:6/700: creat d3/d17/d25/ff7 x:0 0 0 2024-04-26T21:08:20.515 INFO:tasks.workunit.client.0.smithi055.stdout:1/658: link d8/d17/d33/dc5/f81 d8/df/d11/fdc 0 2024-04-26T21:08:20.515 INFO:tasks.workunit.client.0.smithi055.stdout:8/599: creat d3/d9/d1d/fca x:0 0 0 2024-04-26T21:08:20.515 INFO:tasks.workunit.client.0.smithi055.stdout:8/600: dread - d3/d9/d44/fb8 zero size 2024-04-26T21:08:20.515 INFO:tasks.workunit.client.0.smithi055.stdout:6/701: getdents d3/d17/d19/d71/dca/dcb 0 2024-04-26T21:08:20.516 INFO:tasks.workunit.client.1.smithi064.stdout:3/900: read d1/d27/d29/d9d/fd8 [240206,82615] 0 2024-04-26T21:08:20.518 INFO:tasks.workunit.client.0.smithi055.stdout:8/601: mkdir d3/dc0/d2e/d75/dcb 0 2024-04-26T21:08:20.519 INFO:tasks.workunit.client.1.smithi064.stdout:3/901: chown d1/f51 1409098 1 2024-04-26T21:08:20.519 INFO:tasks.workunit.client.0.smithi055.stdout:1/659: stat d8/df/d11/d27/d28/dd7/l70 0 2024-04-26T21:08:20.522 INFO:tasks.workunit.client.1.smithi064.stdout:3/902: link d1/d27/d29/d6f/lb1 d1/d27/d50/d35/d4c/d7b/d82/d9b/l138 0 2024-04-26T21:08:20.526 INFO:tasks.workunit.client.0.smithi055.stdout:1/660: rmdir d8/d17/d1b/d7b/d8d 39 2024-04-26T21:08:20.528 INFO:tasks.workunit.client.1.smithi064.stdout:3/903: symlink d1/d27/d29/d6f/d72/da5/d7d/d8d/l139 0 2024-04-26T21:08:20.531 INFO:tasks.workunit.client.1.smithi064.stdout:5/868: dread dd/d12/d18/d1a/d1f/f5a [0,4194304] 0 2024-04-26T21:08:20.534 INFO:tasks.workunit.client.0.smithi055.stdout:1/661: unlink d8/df/d11/d27/d28/lc7 0 2024-04-26T21:08:20.544 INFO:tasks.workunit.client.1.smithi064.stdout:8/838: dread d10/d41/d4e/d59/ff3 [0,4194304] 0 2024-04-26T21:08:20.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/839: truncate d10/d41/d4e/d54/fbe 6982970 0 2024-04-26T21:08:20.547 INFO:tasks.workunit.client.1.smithi064.stdout:8/840: fdatasync d10/d1d/d38/f39 0 2024-04-26T21:08:20.548 INFO:tasks.workunit.client.1.smithi064.stdout:8/841: write d10/d41/d44/d7d/f7f [936522,115960] 0 2024-04-26T21:08:20.548 INFO:tasks.workunit.client.1.smithi064.stdout:8/842: write d10/d41/d4e/d54/f9f [4655297,87818] 0 2024-04-26T21:08:20.548 INFO:tasks.workunit.client.1.smithi064.stdout:8/843: creat d10/d2f/d90/f103 x:0 0 0 2024-04-26T21:08:20.555 INFO:tasks.workunit.client.1.smithi064.stdout:8/844: getdents d10/d41/d4e/d59 0 2024-04-26T21:08:20.558 INFO:tasks.workunit.client.1.smithi064.stdout:3/904: dread d1/f51 [0,4194304] 0 2024-04-26T21:08:20.558 INFO:tasks.workunit.client.1.smithi064.stdout:7/974: dwrite d6/d15/d67/f129 [0,4194304] 0 2024-04-26T21:08:20.560 INFO:tasks.workunit.client.1.smithi064.stdout:3/905: mkdir d1/d38/d68/d13a 0 2024-04-26T21:08:20.560 INFO:tasks.workunit.client.1.smithi064.stdout:3/906: chown d1/d27/d29/d6f/d72/d26/l28 3014 1 2024-04-26T21:08:20.560 INFO:tasks.workunit.client.1.smithi064.stdout:3/907: stat d1/d27/d29/d6f/d72/da5/f44 0 2024-04-26T21:08:20.561 INFO:tasks.workunit.client.0.smithi055.stdout:3/752: dread d0/d4/d5/f62 [0,4194304] 0 2024-04-26T21:08:20.562 INFO:tasks.workunit.client.0.smithi055.stdout:9/741: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:20.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/890: dwrite d4/d7/d12/d49/d4b/d56/df1/f127 [0,4194304] 0 2024-04-26T21:08:20.564 INFO:tasks.workunit.client.1.smithi064.stdout:6/891: write d4/d7/d12/f77 [454191,67049] 0 2024-04-26T21:08:20.567 INFO:tasks.workunit.client.1.smithi064.stdout:3/908: mkdir d1/d27/d29/d5e/d13b 0 2024-04-26T21:08:20.569 INFO:tasks.workunit.client.0.smithi055.stdout:3/753: creat d0/d4/d5/d73/d47/d37/da6/f108 x:0 0 0 2024-04-26T21:08:20.573 INFO:tasks.workunit.client.0.smithi055.stdout:4/582: dwrite d4/d12/d17/f7e [0,4194304] 0 2024-04-26T21:08:20.573 INFO:tasks.workunit.client.0.smithi055.stdout:4/583: dread - d4/d12/d17/d3d/faa zero size 2024-04-26T21:08:20.573 INFO:tasks.workunit.client.0.smithi055.stdout:4/584: dread - d4/d26/d42/d56/f96 zero size 2024-04-26T21:08:20.573 INFO:tasks.workunit.client.0.smithi055.stdout:9/742: link d2/d11/f3b d2/d46/d77/d7d/d94/f106 0 2024-04-26T21:08:20.573 INFO:tasks.workunit.client.0.smithi055.stdout:9/743: getdents d2/dfa 0 2024-04-26T21:08:20.574 INFO:tasks.workunit.client.1.smithi064.stdout:0/890: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d42/f51 [0,4194304] 0 2024-04-26T21:08:20.575 INFO:tasks.workunit.client.1.smithi064.stdout:5/869: dread fb [0,4194304] 0 2024-04-26T21:08:20.575 INFO:tasks.workunit.client.0.smithi055.stdout:7/690: dwrite d5/d6/d24/d4d/da7/dab/dae/fb9 [0,4194304] 0 2024-04-26T21:08:20.580 INFO:tasks.workunit.client.0.smithi055.stdout:2/799: dwrite d4/db/f15 [4194304,4194304] 0 2024-04-26T21:08:20.581 INFO:tasks.workunit.client.0.smithi055.stdout:3/754: symlink d0/d4/d5/d73/d47/d37/de7/dff/l109 0 2024-04-26T21:08:20.591 INFO:tasks.workunit.client.0.smithi055.stdout:4/585: symlink d4/d18/d1a/d49/lc7 0 2024-04-26T21:08:20.591 INFO:tasks.workunit.client.0.smithi055.stdout:9/744: rmdir d2/d11/df5/df9 39 2024-04-26T21:08:20.591 INFO:tasks.workunit.client.1.smithi064.stdout:7/975: dread d6/d15/d88/dca/f49 [0,4194304] 0 2024-04-26T21:08:20.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/745: write d2/d46/d9a/d105/fcb [178409,21978] 0 2024-04-26T21:08:20.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/746: truncate d2/fc8 1014763 0 2024-04-26T21:08:20.592 INFO:tasks.workunit.client.0.smithi055.stdout:8/602: dwrite d3/d9/d44/fb8 [0,4194304] 0 2024-04-26T21:08:20.598 INFO:tasks.workunit.client.0.smithi055.stdout:2/800: truncate d4/db/d56/f70 98464 0 2024-04-26T21:08:20.607 INFO:tasks.workunit.client.0.smithi055.stdout:3/755: mknod d0/d4/d5/d73/d47/d37/d3d/df7/c10a 0 2024-04-26T21:08:20.619 INFO:tasks.workunit.client.0.smithi055.stdout:9/747: creat d2/d46/d9a/d105/d97/d9b/f107 x:0 0 0 2024-04-26T21:08:20.621 INFO:tasks.workunit.client.0.smithi055.stdout:6/702: dwrite d3/da1/de3/fcd [0,4194304] 0 2024-04-26T21:08:20.623 INFO:tasks.workunit.client.1.smithi064.stdout:6/892: truncate d4/d7/f3b 1067985 0 2024-04-26T21:08:20.628 INFO:tasks.workunit.client.0.smithi055.stdout:2/801: link d4/d55/d6c/fa0 d4/db/d26/d9a/f10f 0 2024-04-26T21:08:20.629 INFO:tasks.workunit.client.0.smithi055.stdout:1/662: dwrite d8/d17/d6a/f6b [0,4194304] 0 2024-04-26T21:08:20.629 INFO:tasks.workunit.client.0.smithi055.stdout:1/663: chown d8/d17/f77 766805 1 2024-04-26T21:08:20.633 INFO:tasks.workunit.client.0.smithi055.stdout:1/664: read d8/df/d11/d6c/f73 [125684,78613] 0 2024-04-26T21:08:20.635 INFO:tasks.workunit.client.1.smithi064.stdout:3/909: creat d1/d38/d68/d13a/f13c x:0 0 0 2024-04-26T21:08:20.635 INFO:tasks.workunit.client.1.smithi064.stdout:3/910: read - d1/d27/d29/d6f/d72/d73/fef zero size 2024-04-26T21:08:20.635 INFO:tasks.workunit.client.1.smithi064.stdout:3/911: dread - d1/d27/d29/f125 zero size 2024-04-26T21:08:20.637 INFO:tasks.workunit.client.0.smithi055.stdout:3/756: dread d0/f19 [0,4194304] 0 2024-04-26T21:08:20.641 INFO:tasks.workunit.client.0.smithi055.stdout:7/691: dwrite d5/d53/d6e/d99/d58/fbb [0,4194304] 0 2024-04-26T21:08:20.641 INFO:tasks.workunit.client.0.smithi055.stdout:9/748: link d2/d46/d51/cdf d2/d46/d51/c108 0 2024-04-26T21:08:20.642 INFO:tasks.workunit.client.0.smithi055.stdout:9/749: creat d2/d46/d51/f109 x:0 0 0 2024-04-26T21:08:20.648 INFO:tasks.workunit.client.1.smithi064.stdout:0/891: creat dd/d21/dc8/d31/d43/db4/dc2/f12c x:0 0 0 2024-04-26T21:08:20.651 INFO:tasks.workunit.client.0.smithi055.stdout:6/703: rename d3/d17/d46/d54/d66/d6a/d51/d58/d62/c82 to d3/d17/d25/d5f/d90/cf8 0 2024-04-26T21:08:20.654 INFO:tasks.workunit.client.1.smithi064.stdout:5/870: unlink dd/d12/d18/d1a/d1f/d20/l3e 0 2024-04-26T21:08:20.654 INFO:tasks.workunit.client.1.smithi064.stdout:5/871: write dd/d12/d18/d1a/d1b/ffb [445805,54298] 0 2024-04-26T21:08:20.654 INFO:tasks.workunit.client.1.smithi064.stdout:5/872: write dd/da9/d48/dac/d8a/fb0 [5731492,80082] 0 2024-04-26T21:08:20.656 INFO:tasks.workunit.client.1.smithi064.stdout:9/909: sync 2024-04-26T21:08:20.657 INFO:tasks.workunit.client.1.smithi064.stdout:9/910: creat d0/d4/d7/d102/f12b x:0 0 0 2024-04-26T21:08:20.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/586: dwrite d4/f4b [0,4194304] 0 2024-04-26T21:08:20.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/587: dread - d4/d18/d86/da6/f7b zero size 2024-04-26T21:08:20.661 INFO:tasks.workunit.client.0.smithi055.stdout:8/603: dwrite d3/d9/d1d/d48/d4b/fb4 [4194304,4194304] 0 2024-04-26T21:08:20.666 INFO:tasks.workunit.client.0.smithi055.stdout:9/750: dread d2/d46/d77/d5f/f69 [0,4194304] 0 2024-04-26T21:08:20.668 INFO:tasks.workunit.client.1.smithi064.stdout:7/976: creat d6/d15/d67/d154/f15a x:0 0 0 2024-04-26T21:08:20.668 INFO:tasks.workunit.client.0.smithi055.stdout:6/704: dread d3/fbe [0,4194304] 0 2024-04-26T21:08:20.678 INFO:tasks.workunit.client.1.smithi064.stdout:6/893: symlink d4/d7/d12/d49/d4b/d5a/d8f/d108/d115/l130 0 2024-04-26T21:08:20.678 INFO:tasks.workunit.client.1.smithi064.stdout:6/894: getdents d4/d7/dce 0 2024-04-26T21:08:20.687 INFO:tasks.workunit.client.1.smithi064.stdout:7/977: dread f5 [0,4194304] 0 2024-04-26T21:08:20.687 INFO:tasks.workunit.client.1.smithi064.stdout:7/978: chown d6/d15/d88/dca/f126 27 1 2024-04-26T21:08:20.688 INFO:tasks.workunit.client.1.smithi064.stdout:6/895: creat d4/d7/d12/d38/de6/dc1/d11d/f131 x:0 0 0 2024-04-26T21:08:20.692 INFO:tasks.workunit.client.1.smithi064.stdout:7/979: symlink d6/db/d34/da7/l15b 0 2024-04-26T21:08:20.692 INFO:tasks.workunit.client.0.smithi055.stdout:1/665: mknod d8/d94/cdd 0 2024-04-26T21:08:20.694 INFO:tasks.workunit.client.1.smithi064.stdout:6/896: mkdir d4/d7/d12/d49/d4b/d5a/d8f/d132 0 2024-04-26T21:08:20.696 INFO:tasks.workunit.client.0.smithi055.stdout:3/757: rmdir d0/de/d107 0 2024-04-26T21:08:20.697 INFO:tasks.workunit.client.1.smithi064.stdout:3/912: dwrite d1/d38/fd2 [0,4194304] 0 2024-04-26T21:08:20.699 INFO:tasks.workunit.client.1.smithi064.stdout:6/897: mkdir d4/d7/d12/d49/d4b/d5a/d133 0 2024-04-26T21:08:20.700 INFO:tasks.workunit.client.1.smithi064.stdout:6/898: chown d4/d7/d12/d49 211 1 2024-04-26T21:08:20.700 INFO:tasks.workunit.client.1.smithi064.stdout:6/899: chown d4/la 8998 1 2024-04-26T21:08:20.704 INFO:tasks.workunit.client.0.smithi055.stdout:7/692: mknod d5/d53/dd1/cd4 0 2024-04-26T21:08:20.708 INFO:tasks.workunit.client.1.smithi064.stdout:3/913: truncate d1/d27/d50/f24 2506552 0 2024-04-26T21:08:20.708 INFO:tasks.workunit.client.1.smithi064.stdout:3/914: chown d1/d27/d50/d35/d4c/d7b/d8e/d117 32752456 1 2024-04-26T21:08:20.712 INFO:tasks.workunit.client.0.smithi055.stdout:8/604: creat d3/dbc/fcc x:0 0 0 2024-04-26T21:08:20.713 INFO:tasks.workunit.client.0.smithi055.stdout:5/582: sync 2024-04-26T21:08:20.714 INFO:tasks.workunit.client.0.smithi055.stdout:5/583: dread - d4/df/d13/d26/d3c/d4a/f98 zero size 2024-04-26T21:08:20.714 INFO:tasks.workunit.client.0.smithi055.stdout:0/731: sync 2024-04-26T21:08:20.714 INFO:tasks.workunit.client.0.smithi055.stdout:2/802: rmdir d4/d55/da1 39 2024-04-26T21:08:20.715 INFO:tasks.workunit.client.0.smithi055.stdout:3/758: dread d0/d4/d5/d73/d13/d5c/f8a [0,4194304] 0 2024-04-26T21:08:20.715 INFO:tasks.workunit.client.0.smithi055.stdout:3/759: read d0/d4/d5/d73/f14 [5434029,24181] 0 2024-04-26T21:08:20.716 INFO:tasks.workunit.client.0.smithi055.stdout:9/751: truncate d2/f1a 424172 0 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/666: creat d8/df/d11/db5/fde x:0 0 0 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/667: chown d8/d17/l45 1524702 1 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/668: fdatasync d8/d17/d1b/d7b/d65/f71 0 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/669: truncate d8/f19 2848390 0 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/670: readlink d8/df/d11/d27/d28/d2a/l30 0 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/671: chown d8/d17/d1b/c60 0 1 2024-04-26T21:08:20.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/672: dread - d8/df/d11/d27/d28/da4/daa/fc6 zero size 2024-04-26T21:08:20.722 INFO:tasks.workunit.client.0.smithi055.stdout:1/673: chown d8/df/c1d 120 1 2024-04-26T21:08:20.722 INFO:tasks.workunit.client.0.smithi055.stdout:4/588: rmdir d4/d12/d17 39 2024-04-26T21:08:20.724 INFO:tasks.workunit.client.0.smithi055.stdout:8/605: creat d3/d9/fcd x:0 0 0 2024-04-26T21:08:20.728 INFO:tasks.workunit.client.0.smithi055.stdout:3/760: truncate d0/d4/d5/d73/f2e 1960068 0 2024-04-26T21:08:20.728 INFO:tasks.workunit.client.0.smithi055.stdout:3/761: fdatasync d0/d4/d5/d73/d13/d1a/d46/d72/dd5/f103 0 2024-04-26T21:08:20.731 INFO:tasks.workunit.client.0.smithi055.stdout:2/803: write d4/db/d1f/d32/f5f [912735,59305] 0 2024-04-26T21:08:20.733 INFO:tasks.workunit.client.0.smithi055.stdout:9/752: mknod d2/d46/d9a/d105/d97/dd7/c10a 0 2024-04-26T21:08:20.735 INFO:tasks.workunit.client.0.smithi055.stdout:6/705: link d3/l38 d3/d17/d46/dc2/dde/lf9 0 2024-04-26T21:08:20.736 INFO:tasks.workunit.client.0.smithi055.stdout:1/674: unlink d8/df/c1d 0 2024-04-26T21:08:20.738 INFO:tasks.workunit.client.0.smithi055.stdout:4/589: unlink d4/d12/d17/c5f 0 2024-04-26T21:08:20.738 INFO:tasks.workunit.client.0.smithi055.stdout:4/590: write d4/d18/d1a/f54 [275258,87060] 0 2024-04-26T21:08:20.742 INFO:tasks.workunit.client.0.smithi055.stdout:8/606: unlink d3/dc0/l3e 0 2024-04-26T21:08:20.749 INFO:tasks.workunit.client.0.smithi055.stdout:9/753: link d2/d11/df5/df9/cd5 d2/d46/d9a/d105/db8/dc5/ded/c10b 0 2024-04-26T21:08:20.749 INFO:tasks.workunit.client.0.smithi055.stdout:9/754: readlink d2/d46/d77/d7d/d94/lb9 0 2024-04-26T21:08:20.755 INFO:tasks.workunit.client.0.smithi055.stdout:6/706: creat d3/d17/d19/d71/dca/ffa x:0 0 0 2024-04-26T21:08:20.756 INFO:tasks.workunit.client.0.smithi055.stdout:1/675: mknod d8/d17/d1b/cdf 0 2024-04-26T21:08:20.758 INFO:tasks.workunit.client.1.smithi064.stdout:7/980: dwrite d6/f51 [0,4194304] 0 2024-04-26T21:08:20.759 INFO:tasks.workunit.client.1.smithi064.stdout:7/981: dread - d6/db/d34/dc7/f153 zero size 2024-04-26T21:08:20.759 INFO:tasks.workunit.client.0.smithi055.stdout:5/584: rename d4/d15 to d4/df/d13/d26/d3c/d93/dcb 0 2024-04-26T21:08:20.762 INFO:tasks.workunit.client.0.smithi055.stdout:0/732: rename d9/dc/c33 to d9/dc/d17/ceb 0 2024-04-26T21:08:20.762 INFO:tasks.workunit.client.0.smithi055.stdout:0/733: write d9/dc/d1c/d3e/dc5/fdd [212809,53135] 0 2024-04-26T21:08:20.762 INFO:tasks.workunit.client.0.smithi055.stdout:0/734: truncate d9/dc/d19/ddb/dbd/fd0 552104 0 2024-04-26T21:08:20.780 INFO:tasks.workunit.client.0.smithi055.stdout:4/591: write d4/d26/d42/d2d/f41 [4274924,7420] 0 2024-04-26T21:08:20.786 INFO:tasks.workunit.client.1.smithi064.stdout:6/900: dwrite d4/d7/d12/d38/de6/f110 [0,4194304] 0 2024-04-26T21:08:20.790 INFO:tasks.workunit.client.0.smithi055.stdout:9/755: write d2/d46/d9a/d105/f59 [1851667,66763] 0 2024-04-26T21:08:20.790 INFO:tasks.workunit.client.1.smithi064.stdout:6/901: creat d4/d7/d12/d49/d4b/d5a/d8f/ded/f134 x:0 0 0 2024-04-26T21:08:20.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/902: rmdir d4/d7/d12/d49/d4b/d5a/d8f/d108/d115 39 2024-04-26T21:08:20.800 INFO:tasks.workunit.client.0.smithi055.stdout:4/592: mknod d4/d18/d1a/d49/cc8 0 2024-04-26T21:08:20.800 INFO:tasks.workunit.client.0.smithi055.stdout:4/593: write d4/d18/d1a/f8a [105043,125533] 0 2024-04-26T21:08:20.800 INFO:tasks.workunit.client.0.smithi055.stdout:4/594: truncate d4/d12/d15/f6f 8512419 0 2024-04-26T21:08:20.801 INFO:tasks.workunit.client.1.smithi064.stdout:6/903: rename d4/d7/d12/d49/f5c to d4/d99/f135 0 2024-04-26T21:08:20.801 INFO:tasks.workunit.client.1.smithi064.stdout:6/904: fsync d4/d7/d12/d38/de6/f110 0 2024-04-26T21:08:20.801 INFO:tasks.workunit.client.1.smithi064.stdout:6/905: chown d4/d7/d12/d49/d4b/d7d/d83/d124/c12d 16655619 1 2024-04-26T21:08:20.810 INFO:tasks.workunit.client.1.smithi064.stdout:6/906: mknod d4/d7/d12/d38/de6/dc1/c136 0 2024-04-26T21:08:20.810 INFO:tasks.workunit.client.1.smithi064.stdout:6/907: write d4/d7/d12/d49/d4b/d7d/ffe [1144971,105539] 0 2024-04-26T21:08:20.817 INFO:tasks.workunit.client.1.smithi064.stdout:3/915: dwrite d1/d14/f3e [0,4194304] 0 2024-04-26T21:08:20.817 INFO:tasks.workunit.client.1.smithi064.stdout:7/982: dwrite d6/d15/d88/dca/f126 [0,4194304] 0 2024-04-26T21:08:20.824 INFO:tasks.workunit.client.1.smithi064.stdout:6/908: rename d4/d7/d12/d49/d4b/d5a/d79 to d4/d7/d12/d49/d4b/d7d/d83/d107/d137 0 2024-04-26T21:08:20.824 INFO:tasks.workunit.client.1.smithi064.stdout:6/909: readlink d4/d99/la3 0 2024-04-26T21:08:20.825 INFO:tasks.workunit.client.1.smithi064.stdout:8/845: sync 2024-04-26T21:08:20.827 INFO:tasks.workunit.client.0.smithi055.stdout:6/707: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/fcc [0,4194304] 0 2024-04-26T21:08:20.828 INFO:tasks.workunit.client.0.smithi055.stdout:6/708: creat d3/d17/d46/d54/d66/d6a/d67/ffb x:0 0 0 2024-04-26T21:08:20.828 INFO:tasks.workunit.client.0.smithi055.stdout:6/709: dread - d3/d17/d46/d54/d66/de1/fd5 zero size 2024-04-26T21:08:20.831 INFO:tasks.workunit.client.0.smithi055.stdout:4/595: mkdir d4/d26/d42/d28/d53/d70/dc9 0 2024-04-26T21:08:20.834 INFO:tasks.workunit.client.0.smithi055.stdout:0/735: dwrite d9/dc/d19/ddb/db6/d67/f88 [0,4194304] 0 2024-04-26T21:08:20.834 INFO:tasks.workunit.client.0.smithi055.stdout:0/736: chown d9/dc/d17/f3a 439063 1 2024-04-26T21:08:20.838 INFO:tasks.workunit.client.1.smithi064.stdout:6/910: truncate d4/d7/d12/d49/d4b/d5a/daf/f125 30721 0 2024-04-26T21:08:20.839 INFO:tasks.workunit.client.1.smithi064.stdout:8/846: mkdir d10/d41/d53/d104 0 2024-04-26T21:08:20.853 INFO:tasks.workunit.client.0.smithi055.stdout:6/710: creat d3/d17/d46/dc2/ffc x:0 0 0 2024-04-26T21:08:20.858 INFO:tasks.workunit.client.1.smithi064.stdout:8/847: write d10/d2f/d90/f93 [1604054,108771] 0 2024-04-26T21:08:20.859 INFO:tasks.workunit.client.1.smithi064.stdout:8/848: chown d10/d41/c81 26297705 1 2024-04-26T21:08:20.860 INFO:tasks.workunit.client.0.smithi055.stdout:2/804: dread d4/db/d1f/d32/f5f [0,4194304] 0 2024-04-26T21:08:20.865 INFO:tasks.workunit.client.0.smithi055.stdout:4/596: truncate d4/d18/d1a/f37 352369 0 2024-04-26T21:08:20.865 INFO:tasks.workunit.client.0.smithi055.stdout:0/737: getdents d9/dc/d1c/d3e/dc5/dcc/dc2 0 2024-04-26T21:08:20.865 INFO:tasks.workunit.client.0.smithi055.stdout:0/738: write d9/dc/d1c/d3e/d7d/da3/d82/fd9 [178306,84392] 0 2024-04-26T21:08:20.866 INFO:tasks.workunit.client.0.smithi055.stdout:2/805: mknod d4/db/d1f/d46/d51/c110 0 2024-04-26T21:08:20.866 INFO:tasks.workunit.client.0.smithi055.stdout:2/806: stat d4/dc/d21/ca7 0 2024-04-26T21:08:20.868 INFO:tasks.workunit.client.1.smithi064.stdout:0/892: sync 2024-04-26T21:08:20.869 INFO:tasks.workunit.client.1.smithi064.stdout:0/893: fdatasync dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f96 0 2024-04-26T21:08:20.869 INFO:tasks.workunit.client.1.smithi064.stdout:6/911: read d4/d7/d12/d49/d4b/d56/f82 [957073,83473] 0 2024-04-26T21:08:20.869 INFO:tasks.workunit.client.0.smithi055.stdout:0/739: rmdir d9 39 2024-04-26T21:08:20.870 INFO:tasks.workunit.client.0.smithi055.stdout:0/740: chown d9/dc/d19/ddb/db6/d67 0 1 2024-04-26T21:08:20.871 INFO:tasks.workunit.client.0.smithi055.stdout:1/676: dwrite d8/d17/d6a/f6b [0,4194304] 0 2024-04-26T21:08:20.872 INFO:tasks.workunit.client.0.smithi055.stdout:1/677: readlink d8/df/l80 0 2024-04-26T21:08:20.874 INFO:tasks.workunit.client.1.smithi064.stdout:0/894: symlink dd/d21/dc8/d31/d47/dad/l12d 0 2024-04-26T21:08:20.874 INFO:tasks.workunit.client.1.smithi064.stdout:0/895: readlink dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/l82 0 2024-04-26T21:08:20.874 INFO:tasks.workunit.client.1.smithi064.stdout:0/896: creat dd/d21/dd9/f12e x:0 0 0 2024-04-26T21:08:20.874 INFO:tasks.workunit.client.1.smithi064.stdout:0/897: write dd/f2a [4935213,43753] 0 2024-04-26T21:08:20.879 INFO:tasks.workunit.client.1.smithi064.stdout:6/912: rmdir d4/d7/d12/d49/d4b/d121 0 2024-04-26T21:08:20.880 INFO:tasks.workunit.client.1.smithi064.stdout:6/913: chown d4/f109 36 1 2024-04-26T21:08:20.882 INFO:tasks.workunit.client.0.smithi055.stdout:0/741: rmdir d9/dc/d19/ddb 39 2024-04-26T21:08:20.890 INFO:tasks.workunit.client.0.smithi055.stdout:1/678: symlink d8/d94/le0 0 2024-04-26T21:08:20.894 INFO:tasks.workunit.client.1.smithi064.stdout:0/898: creat dd/d21/dc8/d31/d47/dad/dfd/d74/f12f x:0 0 0 2024-04-26T21:08:20.898 INFO:tasks.workunit.client.1.smithi064.stdout:3/916: dwrite d1/d27/d50/f10 [0,4194304] 0 2024-04-26T21:08:20.898 INFO:tasks.workunit.client.1.smithi064.stdout:3/917: fsync d1/d27/d29/d6f/d72/d7a/d121/fe8 0 2024-04-26T21:08:20.903 INFO:tasks.workunit.client.0.smithi055.stdout:0/742: dread d9/dc/d1c/d3e/dc5/fdd [0,4194304] 0 2024-04-26T21:08:20.903 INFO:tasks.workunit.client.0.smithi055.stdout:8/607: dwrite d3/f14 [4194304,4194304] 0 2024-04-26T21:08:20.908 INFO:tasks.workunit.client.0.smithi055.stdout:1/679: rename d8/df/f6e to d8/d17/d6a/fe1 0 2024-04-26T21:08:20.908 INFO:tasks.workunit.client.0.smithi055.stdout:1/680: fsync d8/d17/d1b/d7b/d65/fa8 0 2024-04-26T21:08:20.908 INFO:tasks.workunit.client.0.smithi055.stdout:1/681: fdatasync d8/d17/d1b/d41/f8f 0 2024-04-26T21:08:20.911 INFO:tasks.workunit.client.1.smithi064.stdout:6/914: getdents d4/d7/d12/d49/d4b/d56/df1 0 2024-04-26T21:08:20.911 INFO:tasks.workunit.client.1.smithi064.stdout:6/915: creat d4/d7/d12/d49/d4b/dc9/f138 x:0 0 0 2024-04-26T21:08:20.912 INFO:tasks.workunit.client.1.smithi064.stdout:6/916: fsync d4/d7/d12/d38/de6/fe7 0 2024-04-26T21:08:20.912 INFO:tasks.workunit.client.0.smithi055.stdout:9/756: dwrite d2/d46/d77/d7d/f83 [0,4194304] 0 2024-04-26T21:08:20.912 INFO:tasks.workunit.client.0.smithi055.stdout:4/597: dread d4/d26/d42/d28/f32 [0,4194304] 0 2024-04-26T21:08:20.913 INFO:tasks.workunit.client.0.smithi055.stdout:6/711: dwrite d3/d17/d46/d54/d66/de1/fe5 [0,4194304] 0 2024-04-26T21:08:20.916 INFO:tasks.workunit.client.1.smithi064.stdout:8/849: dwrite d10/d41/d4e/d54/f9f [0,4194304] 0 2024-04-26T21:08:20.920 INFO:tasks.workunit.client.1.smithi064.stdout:0/899: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/f130 x:0 0 0 2024-04-26T21:08:20.929 INFO:tasks.workunit.client.0.smithi055.stdout:2/807: dwrite d4/db/d56/d4a/d7e/f91 [0,4194304] 0 2024-04-26T21:08:20.929 INFO:tasks.workunit.client.0.smithi055.stdout:2/808: truncate d4/db/d56/f7c 4473927 0 2024-04-26T21:08:20.929 INFO:tasks.workunit.client.1.smithi064.stdout:3/918: rmdir d1/d27/d29/d6f/d72/d95/d105 0 2024-04-26T21:08:20.929 INFO:tasks.workunit.client.1.smithi064.stdout:3/919: chown d1/d27/d29/d6f/d72/d73 1 1 2024-04-26T21:08:20.932 INFO:tasks.workunit.client.0.smithi055.stdout:1/682: rmdir d8 39 2024-04-26T21:08:20.932 INFO:tasks.workunit.client.0.smithi055.stdout:4/598: symlink d4/d26/d42/d28/d53/d71/d7f/da1/lca 0 2024-04-26T21:08:20.935 INFO:tasks.workunit.client.0.smithi055.stdout:0/743: dread d9/d11/d5b/d74/f2e [4194304,4194304] 0 2024-04-26T21:08:20.935 INFO:tasks.workunit.client.0.smithi055.stdout:0/744: dread - d9/dc/d1c/d3b/f60 zero size 2024-04-26T21:08:20.941 INFO:tasks.workunit.client.1.smithi064.stdout:9/911: sync 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:5/873: sync 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:9/912: dread - d0/d4/da/da3/feb zero size 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:9/913: chown d0/d4/da/d31/d34 862532896 1 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:9/914: chown d0/d4/d7/df/l92 361569 1 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:9/915: stat d0/d4/d7/df6 0 2024-04-26T21:08:20.942 INFO:tasks.workunit.client.1.smithi064.stdout:9/916: chown d0/d4/d28/d4f 254 1 2024-04-26T21:08:20.943 INFO:tasks.workunit.client.1.smithi064.stdout:0/900: mkdir dd/d21/dc8/d31/d47/dad/dfd/d18/d64/d131 0 2024-04-26T21:08:20.943 INFO:tasks.workunit.client.1.smithi064.stdout:0/901: stat dd/d21/dc8/l24 0 2024-04-26T21:08:20.958 INFO:tasks.workunit.client.1.smithi064.stdout:3/920: creat d1/d27/d29/d6f/d72/d7a/f13d x:0 0 0 2024-04-26T21:08:20.958 INFO:tasks.workunit.client.1.smithi064.stdout:5/874: symlink dd/da9/d48/d6a/d101/l113 0 2024-04-26T21:08:20.961 INFO:tasks.workunit.client.1.smithi064.stdout:8/850: rmdir d10/d2f/d90/da0 39 2024-04-26T21:08:20.962 INFO:tasks.workunit.client.1.smithi064.stdout:0/902: mkdir dd/d21/dc8/d31/d47/dad/dfd/d74/d132 0 2024-04-26T21:08:20.964 INFO:tasks.workunit.client.0.smithi055.stdout:8/608: dwrite d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:20.964 INFO:tasks.workunit.client.0.smithi055.stdout:2/809: creat d4/dc/db6/f111 x:0 0 0 2024-04-26T21:08:20.966 INFO:tasks.workunit.client.1.smithi064.stdout:7/983: sync 2024-04-26T21:08:20.968 INFO:tasks.workunit.client.1.smithi064.stdout:5/875: creat dd/da9/d48/d6a/d9e/dc2/f114 x:0 0 0 2024-04-26T21:08:20.969 INFO:tasks.workunit.client.1.smithi064.stdout:5/876: getdents dd/da9/d48/d6a/d9e/db9/ded/d110 0 2024-04-26T21:08:20.970 INFO:tasks.workunit.client.0.smithi055.stdout:1/683: creat d8/d17/d1b/d7b/fe2 x:0 0 0 2024-04-26T21:08:20.974 INFO:tasks.workunit.client.0.smithi055.stdout:7/693: sync 2024-04-26T21:08:20.975 INFO:tasks.workunit.client.0.smithi055.stdout:7/694: stat d5/d11/f5d 0 2024-04-26T21:08:20.975 INFO:tasks.workunit.client.1.smithi064.stdout:0/903: link dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f96 dd/d21/dd9/dfc/f133 0 2024-04-26T21:08:20.981 INFO:tasks.workunit.client.1.smithi064.stdout:7/984: rename d6/d9/d3d/f14b to d6/db/d34/d6f/d12c/f15c 0 2024-04-26T21:08:20.983 INFO:tasks.workunit.client.0.smithi055.stdout:4/599: rename d4/d12/d17/f19 to d4/d12/d15/fcb 0 2024-04-26T21:08:20.983 INFO:tasks.workunit.client.0.smithi055.stdout:1/684: dread d8/d17/f5a [0,4194304] 0 2024-04-26T21:08:20.983 INFO:tasks.workunit.client.0.smithi055.stdout:1/685: write d8/df/d11/d27/d28/dd7/faf [567459,88864] 0 2024-04-26T21:08:20.986 INFO:tasks.workunit.client.0.smithi055.stdout:0/745: unlink d9/dc/d19/ddb/db6/d67/fa9 0 2024-04-26T21:08:20.987 INFO:tasks.workunit.client.1.smithi064.stdout:5/877: getdents dd/d12/d4f/d64/df8 0 2024-04-26T21:08:20.993 INFO:tasks.workunit.client.1.smithi064.stdout:0/904: mknod dd/d21/dc8/d31/d47/dad/dfd/d74/d132/c134 0 2024-04-26T21:08:20.993 INFO:tasks.workunit.client.1.smithi064.stdout:7/985: link d6/d15/d88/dca/lcc d6/db/d8e/d90/l15d 0 2024-04-26T21:08:20.994 INFO:tasks.workunit.client.0.smithi055.stdout:7/695: creat d5/d53/d6e/d6c/fd5 x:0 0 0 2024-04-26T21:08:20.997 INFO:tasks.workunit.client.0.smithi055.stdout:9/757: dwrite d2/f1a [0,4194304] 0 2024-04-26T21:08:20.997 INFO:tasks.workunit.client.0.smithi055.stdout:1/686: rename d8/df/d11/d27/d28/dd7/faf to d8/df/d11/d27/d28/da4/daa/fe3 0 2024-04-26T21:08:20.998 INFO:tasks.workunit.client.1.smithi064.stdout:3/921: write d1/d27/d50/d35/d4c/d7b/d82/fd7 [4099345,25890] 0 2024-04-26T21:08:20.998 INFO:tasks.workunit.client.1.smithi064.stdout:3/922: write d1/d27/d50/d35/d4c/d7b/d8e/ff7 [949420,36755] 0 2024-04-26T21:08:20.999 INFO:tasks.workunit.client.1.smithi064.stdout:0/905: mknod dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/c135 0 2024-04-26T21:08:20.999 INFO:tasks.workunit.client.1.smithi064.stdout:0/906: creat dd/d21/df9/d104/f136 x:0 0 0 2024-04-26T21:08:21.000 INFO:tasks.workunit.client.0.smithi055.stdout:8/609: getdents d3/d7c/d9a 0 2024-04-26T21:08:21.001 INFO:tasks.workunit.client.1.smithi064.stdout:9/917: dwrite d0/d4/d7/f46 [0,4194304] 0 2024-04-26T21:08:21.002 INFO:tasks.workunit.client.1.smithi064.stdout:6/917: dwrite d4/d7/d12/d38/f5b [0,4194304] 0 2024-04-26T21:08:21.007 INFO:tasks.workunit.client.0.smithi055.stdout:7/696: mknod d5/d53/d6e/d99/d7f/d6f/dc6/dc8/cd6 0 2024-04-26T21:08:21.007 INFO:tasks.workunit.client.0.smithi055.stdout:7/697: chown d5/d6/d24/d4d/da7/fcc 4310 1 2024-04-26T21:08:21.010 INFO:tasks.workunit.client.0.smithi055.stdout:0/746: dread d9/dc/d1c/d3e/f89 [0,4194304] 0 2024-04-26T21:08:21.010 INFO:tasks.workunit.client.0.smithi055.stdout:0/747: dread - d9/dc/d1c/d3e/d7d/da3/fe6 zero size 2024-04-26T21:08:21.013 INFO:tasks.workunit.client.0.smithi055.stdout:1/687: mknod d8/d17/d33/dcf/ce4 0 2024-04-26T21:08:21.015 INFO:tasks.workunit.client.1.smithi064.stdout:3/923: truncate d1/d27/d29/d6f/d72/da5/d7d/d8d/dd6/f108 60509 0 2024-04-26T21:08:21.018 INFO:tasks.workunit.client.0.smithi055.stdout:8/610: dread d3/d9/d1d/d48/d57/f6f [0,4194304] 0 2024-04-26T21:08:21.023 INFO:tasks.workunit.client.0.smithi055.stdout:7/698: rename d5/cd to d5/d53/d6e/d65/cd7 0 2024-04-26T21:08:21.027 INFO:tasks.workunit.client.0.smithi055.stdout:1/688: dread d8/df/d11/d27/d28/d2a/f93 [0,4194304] 0 2024-04-26T21:08:21.029 INFO:tasks.workunit.client.1.smithi064.stdout:0/907: creat dd/f137 x:0 0 0 2024-04-26T21:08:21.030 INFO:tasks.workunit.client.1.smithi064.stdout:0/908: creat dd/d21/dc8/d31/d43/db4/f138 x:0 0 0 2024-04-26T21:08:21.030 INFO:tasks.workunit.client.0.smithi055.stdout:0/748: symlink d9/dc/d1c/d3e/d7d/da3/d82/lec 0 2024-04-26T21:08:21.031 INFO:tasks.workunit.client.0.smithi055.stdout:0/749: write d9/dc/d1c/d3e/d7d/da3/fe6 [459164,97283] 0 2024-04-26T21:08:21.033 INFO:tasks.workunit.client.1.smithi064.stdout:7/986: dwrite d6/db/f2d [0,4194304] 0 2024-04-26T21:08:21.038 INFO:tasks.workunit.client.0.smithi055.stdout:1/689: mkdir d8/df/d11/d27/de5 0 2024-04-26T21:08:21.040 INFO:tasks.workunit.client.0.smithi055.stdout:9/758: dread d2/d46/d77/fbb [0,4194304] 0 2024-04-26T21:08:21.040 INFO:tasks.workunit.client.0.smithi055.stdout:9/759: fsync d2/d11/fa4 0 2024-04-26T21:08:21.042 INFO:tasks.workunit.client.0.smithi055.stdout:2/810: dwrite d4/fb9 [0,4194304] 0 2024-04-26T21:08:21.043 INFO:tasks.workunit.client.1.smithi064.stdout:9/918: symlink d0/d4/d28/ddb/l12c 0 2024-04-26T21:08:21.043 INFO:tasks.workunit.client.1.smithi064.stdout:9/919: chown d0/d4/d28/df3 0 1 2024-04-26T21:08:21.045 INFO:tasks.workunit.client.1.smithi064.stdout:9/920: dread - d0/d4/da/d26/d47/d9d/fe3 zero size 2024-04-26T21:08:21.045 INFO:tasks.workunit.client.1.smithi064.stdout:9/921: fsync d0/d4/da/f57 0 2024-04-26T21:08:21.045 INFO:tasks.workunit.client.1.smithi064.stdout:9/922: chown d0/da6/la9 50 1 2024-04-26T21:08:21.047 INFO:tasks.workunit.client.1.smithi064.stdout:6/918: unlink d4/d10e/c12e 0 2024-04-26T21:08:21.047 INFO:tasks.workunit.client.1.smithi064.stdout:6/919: chown d4/d7/f1f 53 1 2024-04-26T21:08:21.047 INFO:tasks.workunit.client.1.smithi064.stdout:6/920: read d4/d7/d12/d49/d4b/d5a/daf/db2/f102 [1098731,55770] 0 2024-04-26T21:08:21.047 INFO:tasks.workunit.client.0.smithi055.stdout:7/699: write d5/d11/f5d [1038290,40428] 0 2024-04-26T21:08:21.056 INFO:tasks.workunit.client.0.smithi055.stdout:1/690: rename d8/d17/c2c to d8/d17/d1b/d7b/ce6 0 2024-04-26T21:08:21.056 INFO:tasks.workunit.client.0.smithi055.stdout:1/691: chown d8/d17/d1b/d41/fc0 169659867 1 2024-04-26T21:08:21.062 INFO:tasks.workunit.client.1.smithi064.stdout:5/878: rename dd/d12/d4f/d64/d73 to dd/dd0/d115 0 2024-04-26T21:08:21.062 INFO:tasks.workunit.client.1.smithi064.stdout:3/924: creat d1/d27/d29/d6f/d72/d7a/d121/f13e x:0 0 0 2024-04-26T21:08:21.063 INFO:tasks.workunit.client.1.smithi064.stdout:0/909: mkdir dd/d21/dc8/d31/d47/d139 0 2024-04-26T21:08:21.067 INFO:tasks.workunit.client.1.smithi064.stdout:9/923: mknod d0/d4/da/d26/d100/c12d 0 2024-04-26T21:08:21.067 INFO:tasks.workunit.client.1.smithi064.stdout:9/924: chown d0/d4/da/d26/d47/d9d/fe3 64969484 1 2024-04-26T21:08:21.068 INFO:tasks.workunit.client.0.smithi055.stdout:2/811: unlink d4/d55/da1/fb3 0 2024-04-26T21:08:21.068 INFO:tasks.workunit.client.0.smithi055.stdout:1/692: mkdir d8/d94/de7 0 2024-04-26T21:08:21.069 INFO:tasks.workunit.client.0.smithi055.stdout:9/760: write d2/f3f [666997,119904] 0 2024-04-26T21:08:21.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/925: write d0/d4/da/d26/d5d/f7b [953537,90358] 0 2024-04-26T21:08:21.071 INFO:tasks.workunit.client.1.smithi064.stdout:9/926: fsync d0/da6/fdc 0 2024-04-26T21:08:21.071 INFO:tasks.workunit.client.1.smithi064.stdout:3/925: symlink d1/d27/d29/d6f/dfc/d137/l13f 0 2024-04-26T21:08:21.071 INFO:tasks.workunit.client.1.smithi064.stdout:0/910: creat dd/d21/dc8/d31/d47/dad/dfd/d18/d58/df2/f13a x:0 0 0 2024-04-26T21:08:21.071 INFO:tasks.workunit.client.1.smithi064.stdout:7/987: dread d6/d9/d3d/fba [0,4194304] 0 2024-04-26T21:08:21.072 INFO:tasks.workunit.client.0.smithi055.stdout:2/812: link d4/d1e/d2a/lc6 d4/d49/l112 0 2024-04-26T21:08:21.073 INFO:tasks.workunit.client.1.smithi064.stdout:0/911: symlink dd/d21/dc8/d31/d47/dad/dfd/l13b 0 2024-04-26T21:08:21.074 INFO:tasks.workunit.client.0.smithi055.stdout:7/700: write d5/d53/dd1/f1e [703853,41185] 0 2024-04-26T21:08:21.076 INFO:tasks.workunit.client.0.smithi055.stdout:1/693: rename d8/d17/d33/dc5/f4d to d8/d17/d1b/d7b/d8d/fe8 0 2024-04-26T21:08:21.080 INFO:tasks.workunit.client.1.smithi064.stdout:7/988: symlink d6/d70/da8/dd1/d12e/l15e 0 2024-04-26T21:08:21.080 INFO:tasks.workunit.client.1.smithi064.stdout:7/989: chown d6/d15/d88/dca/fc6 1 1 2024-04-26T21:08:21.080 INFO:tasks.workunit.client.1.smithi064.stdout:7/990: chown d6/d9/d77/f134 224156 1 2024-04-26T21:08:21.081 INFO:tasks.workunit.client.0.smithi055.stdout:9/761: rmdir d2/d46/d77/d79/de0/dff 0 2024-04-26T21:08:21.081 INFO:tasks.workunit.client.0.smithi055.stdout:9/762: write d2/fc0 [1279591,10536] 0 2024-04-26T21:08:21.082 INFO:tasks.workunit.client.1.smithi064.stdout:6/921: dread d4/d7/f35 [0,4194304] 0 2024-04-26T21:08:21.082 INFO:tasks.workunit.client.0.smithi055.stdout:2/813: write d4/db/d8f/df8/f73 [734144,9349] 0 2024-04-26T21:08:21.082 INFO:tasks.workunit.client.0.smithi055.stdout:2/814: write d4/db/d56/d4a/d7e/f93 [504103,7705] 0 2024-04-26T21:08:21.084 INFO:tasks.workunit.client.1.smithi064.stdout:7/991: truncate d6/d70/fa6 2260211 0 2024-04-26T21:08:21.084 INFO:tasks.workunit.client.1.smithi064.stdout:3/926: dread d1/d27/d50/d35/d4c/d7b/d8e/fda [0,4194304] 0 2024-04-26T21:08:21.085 INFO:tasks.workunit.client.1.smithi064.stdout:3/927: read - d1/d27/d29/d6f/d72/d7a/d121/f13e zero size 2024-04-26T21:08:21.086 INFO:tasks.workunit.client.0.smithi055.stdout:7/701: symlink d5/d53/d6e/d99/d7f/d6f/dc6/ld8 0 2024-04-26T21:08:21.086 INFO:tasks.workunit.client.0.smithi055.stdout:7/702: stat d5/d53/d6e/d99/d58 0 2024-04-26T21:08:21.086 INFO:tasks.workunit.client.0.smithi055.stdout:7/703: truncate d5/d6/d24/d4d/da7/fcc 761126 0 2024-04-26T21:08:21.086 INFO:tasks.workunit.client.0.smithi055.stdout:7/704: creat d5/d53/d6e/d6c/fd9 x:0 0 0 2024-04-26T21:08:21.087 INFO:tasks.workunit.client.0.smithi055.stdout:5/585: sync 2024-04-26T21:08:21.087 INFO:tasks.workunit.client.0.smithi055.stdout:3/762: sync 2024-04-26T21:08:21.089 INFO:tasks.workunit.client.1.smithi064.stdout:6/922: unlink d4/d7/d12/d49/d4b/d7d/d83/d107/d137/f86 0 2024-04-26T21:08:21.091 INFO:tasks.workunit.client.0.smithi055.stdout:2/815: link d4/dc/d21/ca7 d4/d14/c113 0 2024-04-26T21:08:21.094 INFO:tasks.workunit.client.0.smithi055.stdout:2/816: creat d4/db/d1f/d32/d57/f114 x:0 0 0 2024-04-26T21:08:21.096 INFO:tasks.workunit.client.1.smithi064.stdout:3/928: creat d1/d27/d50/d35/d4c/d7b/dcd/d126/d136/f140 x:0 0 0 2024-04-26T21:08:21.097 INFO:tasks.workunit.client.1.smithi064.stdout:8/851: sync 2024-04-26T21:08:21.097 INFO:tasks.workunit.client.1.smithi064.stdout:8/852: dread - d10/d41/faa zero size 2024-04-26T21:08:21.097 INFO:tasks.workunit.client.1.smithi064.stdout:8/853: read - d10/d41/ffd zero size 2024-04-26T21:08:21.098 INFO:tasks.workunit.client.0.smithi055.stdout:1/694: write d8/df/d11/d27/d28/d2a/fc9 [6003408,53034] 0 2024-04-26T21:08:21.098 INFO:tasks.workunit.client.0.smithi055.stdout:1/695: write d8/d17/d1b/d41/f8f [171101,87612] 0 2024-04-26T21:08:21.098 INFO:tasks.workunit.client.1.smithi064.stdout:6/923: symlink d4/d7/d12/d49/d4b/d7d/l139 0 2024-04-26T21:08:21.098 INFO:tasks.workunit.client.1.smithi064.stdout:6/924: write d4/d7/d12/dbc/fcd [188195,39418] 0 2024-04-26T21:08:21.099 INFO:tasks.workunit.client.0.smithi055.stdout:5/586: symlink d4/df/d13/lcc 0 2024-04-26T21:08:21.100 INFO:tasks.workunit.client.1.smithi064.stdout:5/879: read dd/d12/f40 [1974638,5432] 0 2024-04-26T21:08:21.101 INFO:tasks.workunit.client.1.smithi064.stdout:5/880: fsync dd/da9/d48/d56/fb1 0 2024-04-26T21:08:21.101 INFO:tasks.workunit.client.1.smithi064.stdout:5/881: chown dd/d12/d18/d1a/d1b/f6c 772269 1 2024-04-26T21:08:21.102 INFO:tasks.workunit.client.0.smithi055.stdout:3/763: dread d0/d4/d5/d73/d47/dcf/f5e [0,4194304] 0 2024-04-26T21:08:21.104 INFO:tasks.workunit.client.1.smithi064.stdout:5/882: unlink dd/da9/d48/d6a/d81/fab 0 2024-04-26T21:08:21.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/912: dread dd/f85 [0,4194304] 0 2024-04-26T21:08:21.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/913: readlink dd/d21/dc8/l126 0 2024-04-26T21:08:21.104 INFO:tasks.workunit.client.1.smithi064.stdout:0/914: chown dd/d21/dc8/d31/d47/dad/dfd/d18/d58/df2 0 1 2024-04-26T21:08:21.105 INFO:tasks.workunit.client.0.smithi055.stdout:9/763: dread d2/d46/d77/ff3 [0,4194304] 0 2024-04-26T21:08:21.109 INFO:tasks.workunit.client.1.smithi064.stdout:6/925: getdents d4/d7/d12/d49/d4b/d5a/daf 0 2024-04-26T21:08:21.110 INFO:tasks.workunit.client.1.smithi064.stdout:9/927: write d0/d4/da/d26/d5d/f68 [1064076,34304] 0 2024-04-26T21:08:21.110 INFO:tasks.workunit.client.1.smithi064.stdout:9/928: dread - d0/d4/da/d26/d47/d9d/fe3 zero size 2024-04-26T21:08:21.110 INFO:tasks.workunit.client.1.smithi064.stdout:5/883: link dd/d12/d18/d1a/d1b/l5f dd/da9/d63/l116 0 2024-04-26T21:08:21.110 INFO:tasks.workunit.client.1.smithi064.stdout:5/884: truncate dd/da9/d48/d6a/d9e/db9/ffe 1681288 0 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/764: rmdir d2/d46/d77/d5f/df1 0 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/765: dread - d2/d46/d9a/d105/f80 zero size 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/766: write d2/d46/d9a/d105/d97/fa2 [306881,115521] 0 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/767: fsync d2/d46/d51/fe7 0 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/768: fsync d2/d46/fd1 0 2024-04-26T21:08:21.113 INFO:tasks.workunit.client.0.smithi055.stdout:9/769: chown d2/d46/d9a/d105/db8/dc5/ccd 12522350 1 2024-04-26T21:08:21.115 INFO:tasks.workunit.client.1.smithi064.stdout:9/929: unlink d0/d4/d7/f2f 0 2024-04-26T21:08:21.115 INFO:tasks.workunit.client.1.smithi064.stdout:9/930: readlink d0/d4/d7/df/l66 0 2024-04-26T21:08:21.117 INFO:tasks.workunit.client.0.smithi055.stdout:2/817: dread d4/fb9 [0,4194304] 0 2024-04-26T21:08:21.118 INFO:tasks.workunit.client.0.smithi055.stdout:2/818: write d4/db/d56/f70 [34804,5074] 0 2024-04-26T21:08:21.118 INFO:tasks.workunit.client.0.smithi055.stdout:2/819: read d4/dc/f1d [279913,67730] 0 2024-04-26T21:08:21.120 INFO:tasks.workunit.client.0.smithi055.stdout:2/820: mkdir d4/dc/d115 0 2024-04-26T21:08:21.122 INFO:tasks.workunit.client.0.smithi055.stdout:2/821: rename d4/dc/d21/f24 to d4/d14/dc5/d107/f116 0 2024-04-26T21:08:21.131 INFO:tasks.workunit.client.1.smithi064.stdout:5/885: dread dd/d12/d4f/d9c/da1/fb7 [0,4194304] 0 2024-04-26T21:08:21.131 INFO:tasks.workunit.client.1.smithi064.stdout:5/886: fdatasync dd/da9/d48/f72 0 2024-04-26T21:08:21.137 INFO:tasks.workunit.client.0.smithi055.stdout:7/705: truncate d5/d11/f5d 3010267 0 2024-04-26T21:08:21.137 INFO:tasks.workunit.client.0.smithi055.stdout:7/706: stat d5/d6/d24/f50 0 2024-04-26T21:08:21.139 INFO:tasks.workunit.client.0.smithi055.stdout:7/707: creat d5/d6/d24/d3b/fda x:0 0 0 2024-04-26T21:08:21.140 INFO:tasks.workunit.client.1.smithi064.stdout:7/992: write d6/d9/f36 [576069,43632] 0 2024-04-26T21:08:21.140 INFO:tasks.workunit.client.1.smithi064.stdout:7/993: write d6/d8c/f9f [4492497,94117] 0 2024-04-26T21:08:21.141 INFO:tasks.workunit.client.0.smithi055.stdout:7/708: rename d5/d53/d6e/d6c/da2 to d5/d6/d24/d4d/da7/ddb 0 2024-04-26T21:08:21.148 INFO:tasks.workunit.client.1.smithi064.stdout:7/994: getdents d6/d8c/d9e 0 2024-04-26T21:08:21.153 INFO:tasks.workunit.client.1.smithi064.stdout:3/929: dread d1/d14/f6a [0,4194304] 0 2024-04-26T21:08:21.153 INFO:tasks.workunit.client.0.smithi055.stdout:2/822: write d4/d49/f87 [5931602,129576] 0 2024-04-26T21:08:21.154 INFO:tasks.workunit.client.0.smithi055.stdout:2/823: creat d4/dc/db6/f117 x:0 0 0 2024-04-26T21:08:21.156 INFO:tasks.workunit.client.1.smithi064.stdout:0/915: dread dd/d21/dc8/d31/d47/dad/dfd/d74/fae [0,4194304] 0 2024-04-26T21:08:21.158 INFO:tasks.workunit.client.0.smithi055.stdout:3/764: dread d0/d4/f44 [0,4194304] 0 2024-04-26T21:08:21.158 INFO:tasks.workunit.client.0.smithi055.stdout:3/765: write d0/d4/d5/d73/d47/d37/d3d/d4c/fca [1028567,68395] 0 2024-04-26T21:08:21.159 INFO:tasks.workunit.client.1.smithi064.stdout:3/930: mkdir d1/d27/d29/d5e/d141 0 2024-04-26T21:08:21.159 INFO:tasks.workunit.client.1.smithi064.stdout:3/931: creat d1/d27/d29/d5e/f142 x:0 0 0 2024-04-26T21:08:21.160 INFO:tasks.workunit.client.1.smithi064.stdout:3/932: write d1/d27/d29/d6f/d72/d7a/d121/fe8 [1041385,120428] 0 2024-04-26T21:08:21.166 INFO:tasks.workunit.client.1.smithi064.stdout:0/916: unlink dd/d21/dc8/d31/d47/lea 0 2024-04-26T21:08:21.167 INFO:tasks.workunit.client.0.smithi055.stdout:1/696: dwrite d8/d17/d1b/f62 [0,4194304] 0 2024-04-26T21:08:21.168 INFO:tasks.workunit.client.1.smithi064.stdout:5/887: truncate dd/da9/d48/d6a/d9e/db9/ffe 1444606 0 2024-04-26T21:08:21.169 INFO:tasks.workunit.client.0.smithi055.stdout:7/709: mkdir d5/d53/d6e/d99/d7f/d6f/ddc 0 2024-04-26T21:08:21.171 INFO:tasks.workunit.client.1.smithi064.stdout:7/995: getdents d6/d15/d88/dca/d5c 0 2024-04-26T21:08:21.172 INFO:tasks.workunit.client.1.smithi064.stdout:7/996: write d6/db/d34/d6f/d81/f84 [1387853,16337] 0 2024-04-26T21:08:21.173 INFO:tasks.workunit.client.1.smithi064.stdout:8/854: dwrite d10/d41/d4e/d59/fdc [0,4194304] 0 2024-04-26T21:08:21.178 INFO:tasks.workunit.client.0.smithi055.stdout:2/824: mknod d4/db/d8f/df8/d5e/c118 0 2024-04-26T21:08:21.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/825: fdatasync d4/d55/d6c/f9e 0 2024-04-26T21:08:21.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/826: creat d4/d14/d33/f119 x:0 0 0 2024-04-26T21:08:21.181 INFO:tasks.workunit.client.1.smithi064.stdout:3/933: rmdir d1/d27/d50/d35/d4c/d7b/dcd/d126 39 2024-04-26T21:08:21.181 INFO:tasks.workunit.client.1.smithi064.stdout:0/917: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/f13c x:0 0 0 2024-04-26T21:08:21.181 INFO:tasks.workunit.client.1.smithi064.stdout:0/918: chown dd/d21/dd9/dfc/f124 153814 1 2024-04-26T21:08:21.181 INFO:tasks.workunit.client.1.smithi064.stdout:0/919: chown dd/d21/dc8/d31/d43/db4 96997327 1 2024-04-26T21:08:21.184 INFO:tasks.workunit.client.0.smithi055.stdout:7/710: symlink d5/d53/d6e/d99/ldd 0 2024-04-26T21:08:21.185 INFO:tasks.workunit.client.1.smithi064.stdout:6/926: dwrite d4/d7/f1f [4194304,4194304] 0 2024-04-26T21:08:21.187 INFO:tasks.workunit.client.1.smithi064.stdout:7/997: rename d6/db/d34/f96 to d6/d15/d88/dca/f15f 0 2024-04-26T21:08:21.187 INFO:tasks.workunit.client.0.smithi055.stdout:6/712: sync 2024-04-26T21:08:21.188 INFO:tasks.workunit.client.0.smithi055.stdout:6/713: write d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86/fa7 [113225,70140] 0 2024-04-26T21:08:21.190 INFO:tasks.workunit.client.0.smithi055.stdout:1/697: write d8/d17/d6a/f6b [1887810,81529] 0 2024-04-26T21:08:21.191 INFO:tasks.workunit.client.1.smithi064.stdout:9/931: dwrite d0/d4/d7/df/da4/fb3 [0,4194304] 0 2024-04-26T21:08:21.195 INFO:tasks.workunit.client.0.smithi055.stdout:7/711: rename d5/d53/d6e/d99/d7f/d6f/da8/fc0 to d5/d53/d6e/d99/d7f/d6f/fde 0 2024-04-26T21:08:21.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/712: write d5/d53/d6e/d99/d75/fad [85712,125505] 0 2024-04-26T21:08:21.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/713: chown d5/d6/d39/c82 482242377 1 2024-04-26T21:08:21.208 INFO:tasks.workunit.client.1.smithi064.stdout:6/927: stat d4/d10e/l12a 0 2024-04-26T21:08:21.209 INFO:tasks.workunit.client.1.smithi064.stdout:8/855: rename d10/f24 to d10/d41/f105 0 2024-04-26T21:08:21.209 INFO:tasks.workunit.client.1.smithi064.stdout:8/856: write d10/d41/fe0 [273595,92628] 0 2024-04-26T21:08:21.209 INFO:tasks.workunit.client.0.smithi055.stdout:2/827: write d4/dc/d21/f43 [498275,90428] 0 2024-04-26T21:08:21.210 INFO:tasks.workunit.client.0.smithi055.stdout:6/714: mknod d3/d9b/cfd 0 2024-04-26T21:08:21.210 INFO:tasks.workunit.client.0.smithi055.stdout:2/828: read - d4/db/d8f/da6/fb4 zero size 2024-04-26T21:08:21.210 INFO:tasks.workunit.client.1.smithi064.stdout:7/998: unlink d6/d15/d67/l3f 0 2024-04-26T21:08:21.210 INFO:tasks.workunit.client.1.smithi064.stdout:7/999: chown d6/d9/d3d/d43/f158 4677 1 2024-04-26T21:08:21.216 INFO:tasks.workunit.client.0.smithi055.stdout:2/829: unlink d4/db/d1f/d46/d51/faf 0 2024-04-26T21:08:21.216 INFO:tasks.workunit.client.0.smithi055.stdout:2/830: truncate d4/db/d1f/d46/fb7 814128 0 2024-04-26T21:08:21.219 INFO:tasks.workunit.client.1.smithi064.stdout:9/932: rmdir d0/d4/d28/df3 39 2024-04-26T21:08:21.223 INFO:tasks.workunit.client.1.smithi064.stdout:5/888: dwrite dd/d12/d18/d1a/d1b/f2c [0,4194304] 0 2024-04-26T21:08:21.223 INFO:tasks.workunit.client.1.smithi064.stdout:5/889: dread - dd/dd0/ff0 zero size 2024-04-26T21:08:21.224 INFO:tasks.workunit.client.0.smithi055.stdout:2/831: symlink d4/dc/l11a 0 2024-04-26T21:08:21.226 INFO:tasks.workunit.client.0.smithi055.stdout:2/832: write d4/db/d26/f8d [1591058,95904] 0 2024-04-26T21:08:21.229 INFO:tasks.workunit.client.1.smithi064.stdout:9/933: mkdir d0/d4/da/d67/dd0/df2/d12e 0 2024-04-26T21:08:21.241 INFO:tasks.workunit.client.1.smithi064.stdout:9/934: dread d0/d4/da/d26/d5e/f69 [0,4194304] 0 2024-04-26T21:08:21.241 INFO:tasks.workunit.client.0.smithi055.stdout:3/766: dwrite d0/d4/d5/d73/f14 [8388608,4194304] 0 2024-04-26T21:08:21.241 INFO:tasks.workunit.client.0.smithi055.stdout:3/767: dread - d0/d4/d16/d18/f106 zero size 2024-04-26T21:08:21.241 INFO:tasks.workunit.client.1.smithi064.stdout:5/890: mkdir dd/d12/d18/d1a/d1f/d117 0 2024-04-26T21:08:21.242 INFO:tasks.workunit.client.1.smithi064.stdout:5/891: write dd/d12/d18/d1a/d1f/d20/f3b [4680619,28003] 0 2024-04-26T21:08:21.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:20 smithi055 ceph-mon[25475]: pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 150 MiB/s rd, 186 MiB/s wr, 285 op/s 2024-04-26T21:08:21.256 INFO:tasks.workunit.client.0.smithi055.stdout:2/833: mkdir d4/d14/dc5/d107/d11b 0 2024-04-26T21:08:21.260 INFO:tasks.workunit.client.1.smithi064.stdout:5/892: unlink dd/da9/d48/d6a/d9e/db9/ff9 0 2024-04-26T21:08:21.268 INFO:tasks.workunit.client.1.smithi064.stdout:5/893: symlink dd/d12/d4f/d9c/l118 0 2024-04-26T21:08:21.268 INFO:tasks.workunit.client.1.smithi064.stdout:5/894: fdatasync dd/d12/d18/d1a/f106 0 2024-04-26T21:08:21.273 INFO:tasks.workunit.client.0.smithi055.stdout:2/834: mknod d4/d14/d33/c11c 0 2024-04-26T21:08:21.279 INFO:tasks.workunit.client.0.smithi055.stdout:3/768: getdents d0/d4/d16/d18 0 2024-04-26T21:08:21.281 INFO:tasks.workunit.client.1.smithi064.stdout:3/934: dwrite d1/d27/d50/f13 [4194304,4194304] 0 2024-04-26T21:08:21.281 INFO:tasks.workunit.client.1.smithi064.stdout:8/857: dwrite d10/d1d/d38/f39 [0,4194304] 0 2024-04-26T21:08:21.288 INFO:tasks.workunit.client.0.smithi055.stdout:2/835: mknod d4/db/c11d 0 2024-04-26T21:08:21.289 INFO:tasks.workunit.client.0.smithi055.stdout:1/698: dwrite d8/df/d11/d27/fc2 [0,4194304] 0 2024-04-26T21:08:21.290 INFO:tasks.workunit.client.1.smithi064.stdout:0/920: dwrite dd/d21/dd9/dfc/f133 [0,4194304] 0 2024-04-26T21:08:21.291 INFO:tasks.workunit.client.0.smithi055.stdout:3/769: dread d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad [0,4194304] 0 2024-04-26T21:08:21.292 INFO:tasks.workunit.client.0.smithi055.stdout:3/770: truncate d0/d4/d5/d73/d13/fe6 1024978 0 2024-04-26T21:08:21.292 INFO:tasks.workunit.client.0.smithi055.stdout:1/699: symlink d8/d17/d1b/d7b/le9 0 2024-04-26T21:08:21.292 INFO:tasks.workunit.client.0.smithi055.stdout:1/700: fsync d8/df/f55 0 2024-04-26T21:08:21.293 INFO:tasks.workunit.client.0.smithi055.stdout:3/771: mknod d0/d4/c10b 0 2024-04-26T21:08:21.300 INFO:tasks.workunit.client.1.smithi064.stdout:0/921: creat dd/d21/dd9/dfc/f13d x:0 0 0 2024-04-26T21:08:21.300 INFO:tasks.workunit.client.0.smithi055.stdout:3/772: rmdir d0/d4/d5/d73/d47/d37/de8 39 2024-04-26T21:08:21.301 INFO:tasks.workunit.client.0.smithi055.stdout:3/773: stat d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/ld4 0 2024-04-26T21:08:21.303 INFO:tasks.workunit.client.0.smithi055.stdout:1/701: getdents d8/df/d11/db5 0 2024-04-26T21:08:21.305 INFO:tasks.workunit.client.1.smithi064.stdout:6/928: dwrite d4/d7/d12/d49/d4b/d5a/d8f/d108/f12b [0,4194304] 0 2024-04-26T21:08:21.305 INFO:tasks.workunit.client.1.smithi064.stdout:9/935: dread d0/f59 [0,4194304] 0 2024-04-26T21:08:21.309 INFO:tasks.workunit.client.1.smithi064.stdout:0/922: symlink dd/d21/dc8/d31/d47/dad/l13e 0 2024-04-26T21:08:21.310 INFO:tasks.workunit.client.1.smithi064.stdout:0/923: truncate dd/d21/dc8/d31/d47/dad/dfd/d18/f49 545944 0 2024-04-26T21:08:21.320 INFO:tasks.workunit.client.1.smithi064.stdout:6/929: rename d4/d7/dce to d4/d7/d12/d49/d4b/d5a/daf/db2/d13a 0 2024-04-26T21:08:21.320 INFO:tasks.workunit.client.1.smithi064.stdout:6/930: chown d4/d7/d12/d49/d4b/d5a/d8f/ded 0 1 2024-04-26T21:08:21.320 INFO:tasks.workunit.client.1.smithi064.stdout:9/936: mkdir d0/d4/da/d67/dd0/df2/d12e/d12f 0 2024-04-26T21:08:21.320 INFO:tasks.workunit.client.1.smithi064.stdout:0/924: getdents dd/d21/dc8/ddf 0 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/836: dread d4/dc/d21/f96 [0,4194304] 0 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/837: chown d4/db/d1f/cf9 586 1 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/838: creat d4/db/d56/f11e x:0 0 0 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/839: write d4/db/fea [886080,106810] 0 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:2/840: dread - d4/db/d1f/d32/d57/f114 zero size 2024-04-26T21:08:21.330 INFO:tasks.workunit.client.0.smithi055.stdout:6/715: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/d62/f6e [0,4194304] 0 2024-04-26T21:08:21.331 INFO:tasks.workunit.client.0.smithi055.stdout:4/600: sync 2024-04-26T21:08:21.340 INFO:tasks.workunit.client.1.smithi064.stdout:9/937: truncate d0/d4/da/d26/d45/d90/fd7 852572 0 2024-04-26T21:08:21.342 INFO:tasks.workunit.client.0.smithi055.stdout:7/714: dwrite d5/f49 [0,4194304] 0 2024-04-26T21:08:21.342 INFO:tasks.workunit.client.0.smithi055.stdout:2/841: symlink d4/dc/db6/l11f 0 2024-04-26T21:08:21.343 INFO:tasks.workunit.client.0.smithi055.stdout:7/715: creat d5/d6/d24/d4d/da7/fdf x:0 0 0 2024-04-26T21:08:21.344 INFO:tasks.workunit.client.1.smithi064.stdout:3/935: dwrite d1/d14/f6a [0,4194304] 0 2024-04-26T21:08:21.347 INFO:tasks.workunit.client.1.smithi064.stdout:0/925: symlink dd/d21/dc8/d31/d43/l13f 0 2024-04-26T21:08:21.347 INFO:tasks.workunit.client.1.smithi064.stdout:0/926: readlink dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/l82 0 2024-04-26T21:08:21.350 INFO:tasks.workunit.client.0.smithi055.stdout:6/716: mkdir d3/d17/d46/d54/d66/d6a/d67/dfe 0 2024-04-26T21:08:21.356 INFO:tasks.workunit.client.1.smithi064.stdout:9/938: getdents d0/d4/d7/df 0 2024-04-26T21:08:21.356 INFO:tasks.workunit.client.1.smithi064.stdout:9/939: dread - d0/d39/f5c zero size 2024-04-26T21:08:21.365 INFO:tasks.workunit.client.1.smithi064.stdout:0/927: link dd/d21/dc8/d31/d43/db4/lf4 dd/d21/df9/l140 0 2024-04-26T21:08:21.370 INFO:tasks.workunit.client.0.smithi055.stdout:7/716: symlink d5/d53/d6e/d99/le0 0 2024-04-26T21:08:21.371 INFO:tasks.workunit.client.1.smithi064.stdout:3/936: write d1/d27/d29/d6f/d72/f40 [1607909,128483] 0 2024-04-26T21:08:21.378 INFO:tasks.workunit.client.0.smithi055.stdout:6/717: mknod d3/d17/d46/cff 0 2024-04-26T21:08:21.378 INFO:tasks.workunit.client.0.smithi055.stdout:3/774: dwrite d0/d4/d5/d73/d47/dcf/ff3 [0,4194304] 0 2024-04-26T21:08:21.378 INFO:tasks.workunit.client.0.smithi055.stdout:2/842: getdents d4/db/d8f/da6 0 2024-04-26T21:08:21.379 INFO:tasks.workunit.client.0.smithi055.stdout:1/702: dwrite d8/d17/d6a/fe1 [0,4194304] 0 2024-04-26T21:08:21.379 INFO:tasks.workunit.client.0.smithi055.stdout:1/703: chown d8/d17/d1b/d7b/d65/fa0 7860 1 2024-04-26T21:08:21.381 INFO:tasks.workunit.client.1.smithi064.stdout:3/937: symlink d1/d27/d29/d6f/d72/da5/d7d/d8a/l143 0 2024-04-26T21:08:21.382 INFO:tasks.workunit.client.1.smithi064.stdout:3/938: write d1/d38/d68/d13a/f13c [782594,39444] 0 2024-04-26T21:08:21.382 INFO:tasks.workunit.client.1.smithi064.stdout:3/939: fsync d1/d27/dee/f132 0 2024-04-26T21:08:21.382 INFO:tasks.workunit.client.1.smithi064.stdout:3/940: chown d1/d27/d29/d6f/d72/fb5 3 1 2024-04-26T21:08:21.383 INFO:tasks.workunit.client.1.smithi064.stdout:6/931: dwrite d4/d7/d12/d38/f5b [0,4194304] 0 2024-04-26T21:08:21.383 INFO:tasks.workunit.client.1.smithi064.stdout:6/932: stat d4/d7/d12/d38/de6/l92 0 2024-04-26T21:08:21.384 INFO:tasks.workunit.client.0.smithi055.stdout:7/717: truncate d5/d6/d24/d3b/f44 5197852 0 2024-04-26T21:08:21.384 INFO:tasks.workunit.client.0.smithi055.stdout:7/718: stat d5/d6/d24/d3b/l8f 0 2024-04-26T21:08:21.393 INFO:tasks.workunit.client.1.smithi064.stdout:3/941: mknod d1/d27/d50/d35/d4c/dd1/c144 0 2024-04-26T21:08:21.393 INFO:tasks.workunit.client.1.smithi064.stdout:3/942: read - d1/d27/d29/d5e/f76 zero size 2024-04-26T21:08:21.393 INFO:tasks.workunit.client.1.smithi064.stdout:3/943: fsync d1/d27/d29/d5e/fbd 0 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:0/750: sync 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:0/751: readlink d9/l14 0 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:0/752: truncate d9/dc/d19/ddb/db6/f8e 932079 0 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:5/587: sync 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:9/770: sync 2024-04-26T21:08:21.395 INFO:tasks.workunit.client.0.smithi055.stdout:8/611: sync 2024-04-26T21:08:21.397 INFO:tasks.workunit.client.0.smithi055.stdout:6/718: write d3/d17/d46/d54/d66/d6a/d51/d58/d62/f78 [2297964,67684] 0 2024-04-26T21:08:21.401 INFO:tasks.workunit.client.0.smithi055.stdout:4/601: dwrite d4/d18/d1a/d49/f9a [0,4194304] 0 2024-04-26T21:08:21.401 INFO:tasks.workunit.client.0.smithi055.stdout:4/602: fsync d4/d26/d42/d2d/f41 0 2024-04-26T21:08:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:20 smithi064 ceph-mon[33404]: pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 150 MiB/s rd, 186 MiB/s wr, 285 op/s 2024-04-26T21:08:21.409 INFO:tasks.workunit.client.1.smithi064.stdout:3/944: mkdir d1/d27/d29/d5e/d13b/d145 0 2024-04-26T21:08:21.412 INFO:tasks.workunit.client.0.smithi055.stdout:6/719: write f0 [2918216,17055] 0 2024-04-26T21:08:21.414 INFO:tasks.workunit.client.0.smithi055.stdout:3/775: rename d0/d4/d5/d73/d13/d1a/d46/d72/f82 to d0/d4/d16/f10c 0 2024-04-26T21:08:21.414 INFO:tasks.workunit.client.0.smithi055.stdout:2/843: symlink d4/dc/db6/l120 0 2024-04-26T21:08:21.414 INFO:tasks.workunit.client.0.smithi055.stdout:2/844: chown d4/db/d26/d9a/fad 44283 1 2024-04-26T21:08:21.415 INFO:tasks.workunit.client.1.smithi064.stdout:3/945: creat d1/d27/d29/d6f/d72/d95/dd9/f146 x:0 0 0 2024-04-26T21:08:21.415 INFO:tasks.workunit.client.0.smithi055.stdout:3/776: getdents d0/d4/d5/db8/dfd 0 2024-04-26T21:08:21.415 INFO:tasks.workunit.client.0.smithi055.stdout:3/777: creat d0/d4/d5/d73/d47/dcf/f10d x:0 0 0 2024-04-26T21:08:21.416 INFO:tasks.workunit.client.0.smithi055.stdout:5/588: mkdir d4/df/d13/d26/d3c/d4a/d3f/d2e/dcd 0 2024-04-26T21:08:21.421 INFO:tasks.workunit.client.0.smithi055.stdout:9/771: symlink d2/d46/d9a/d105/db8/dc5/l10c 0 2024-04-26T21:08:21.422 INFO:tasks.workunit.client.0.smithi055.stdout:8/612: rmdir d3/dc0/d2e/d75/d76/d92/dc7 0 2024-04-26T21:08:21.425 INFO:tasks.workunit.client.1.smithi064.stdout:9/940: dwrite d0/d4/da/d31/d34/fe4 [0,4194304] 0 2024-04-26T21:08:21.430 INFO:tasks.workunit.client.1.smithi064.stdout:3/946: creat d1/d27/d50/d35/d4c/d7b/d82/d9b/f147 x:0 0 0 2024-04-26T21:08:21.435 INFO:tasks.workunit.client.1.smithi064.stdout:5/895: sync 2024-04-26T21:08:21.435 INFO:tasks.workunit.client.0.smithi055.stdout:1/704: dread d8/d17/d1b/d7b/d8d/fe8 [0,4194304] 0 2024-04-26T21:08:21.436 INFO:tasks.workunit.client.1.smithi064.stdout:5/896: fdatasync fb 0 2024-04-26T21:08:21.436 INFO:tasks.workunit.client.0.smithi055.stdout:5/589: rmdir d4/df/d13/d26/d3c/d4a/d3f/d5c 39 2024-04-26T21:08:21.439 INFO:tasks.workunit.client.1.smithi064.stdout:8/858: sync 2024-04-26T21:08:21.441 INFO:tasks.workunit.client.0.smithi055.stdout:9/772: link d2/d11/df5/dfe/c100 d2/d11/df5/dfe/c10d 0 2024-04-26T21:08:21.444 INFO:tasks.workunit.client.1.smithi064.stdout:5/897: rename dd/d12/d18/d1a/l3a to dd/da9/d48/de3/l119 0 2024-04-26T21:08:21.445 INFO:tasks.workunit.client.1.smithi064.stdout:5/898: fsync dd/da9/d63/f7f 0 2024-04-26T21:08:21.456 INFO:tasks.workunit.client.0.smithi055.stdout:1/705: truncate d8/df/d11/d27/fc2 502759 0 2024-04-26T21:08:21.456 INFO:tasks.workunit.client.0.smithi055.stdout:1/706: fsync d8/d17/d1b/d7b/d65/f7d 0 2024-04-26T21:08:21.460 INFO:tasks.workunit.client.1.smithi064.stdout:5/899: rename dd/d12/d18/d25/d67/f93 to dd/da9/d48/d6a/f11a 0 2024-04-26T21:08:21.464 INFO:tasks.workunit.client.1.smithi064.stdout:0/928: dwrite dd/d21/df9/d104/f136 [0,4194304] 0 2024-04-26T21:08:21.465 INFO:tasks.workunit.client.0.smithi055.stdout:9/773: getdents d2/d46/d77/d79/de0 0 2024-04-26T21:08:21.465 INFO:tasks.workunit.client.0.smithi055.stdout:9/774: readlink d2/d11/le2 0 2024-04-26T21:08:21.475 INFO:tasks.workunit.client.1.smithi064.stdout:5/900: symlink dd/da9/d48/d6a/l11b 0 2024-04-26T21:08:21.475 INFO:tasks.workunit.client.1.smithi064.stdout:5/901: write dd/d12/d18/d1a/d1f/d20/f8b [1899467,35625] 0 2024-04-26T21:08:21.486 INFO:tasks.workunit.client.0.smithi055.stdout:1/707: mknod d8/df/d11/d27/d28/da4/cea 0 2024-04-26T21:08:21.486 INFO:tasks.workunit.client.0.smithi055.stdout:1/708: write d8/df/d11/f37 [1003804,83039] 0 2024-04-26T21:08:21.487 INFO:tasks.workunit.client.0.smithi055.stdout:2/845: read d4/d1e/d2a/f6b [2268136,111744] 0 2024-04-26T21:08:21.488 INFO:tasks.workunit.client.0.smithi055.stdout:2/846: write d4/db/f15 [8785910,103105] 0 2024-04-26T21:08:21.488 INFO:tasks.workunit.client.0.smithi055.stdout:2/847: write d4/db/d8f/da6/fb4 [255419,84639] 0 2024-04-26T21:08:21.488 INFO:tasks.workunit.client.0.smithi055.stdout:7/719: dwrite d5/d6/d24/f30 [0,4194304] 0 2024-04-26T21:08:21.489 INFO:tasks.workunit.client.0.smithi055.stdout:7/720: chown d5/d53/d6e/d99/d7f/c77 712160 1 2024-04-26T21:08:21.489 INFO:tasks.workunit.client.0.smithi055.stdout:7/721: write d5/d53/dd1/f8b [1775537,79722] 0 2024-04-26T21:08:21.489 INFO:tasks.workunit.client.0.smithi055.stdout:7/722: readlink d5/d6/d24/d3b/la4 0 2024-04-26T21:08:21.498 INFO:tasks.workunit.client.1.smithi064.stdout:5/902: mknod dd/d12/d4f/da5/c11c 0 2024-04-26T21:08:21.498 INFO:tasks.workunit.client.1.smithi064.stdout:5/903: fsync dd/d12/d18/d1a/d1f/d20/f2d 0 2024-04-26T21:08:21.499 INFO:tasks.workunit.client.1.smithi064.stdout:9/941: write d0/f59 [381379,41988] 0 2024-04-26T21:08:21.499 INFO:tasks.workunit.client.1.smithi064.stdout:9/942: chown d0/d4/da/d26/d47/l11b 2 1 2024-04-26T21:08:21.499 INFO:tasks.workunit.client.1.smithi064.stdout:9/943: readlink d0/d4/da/l21 0 2024-04-26T21:08:21.499 INFO:tasks.workunit.client.1.smithi064.stdout:9/944: fsync d0/d4/da/d26/d5e/fa7 0 2024-04-26T21:08:21.504 INFO:tasks.workunit.client.1.smithi064.stdout:5/904: symlink dd/da9/d48/dac/dc7/l11d 0 2024-04-26T21:08:21.504 INFO:tasks.workunit.client.1.smithi064.stdout:5/905: readlink dd/d12/d18/d1a/d1b/ldb 0 2024-04-26T21:08:21.504 INFO:tasks.workunit.client.1.smithi064.stdout:5/906: chown dd/d12/d18/d25/d32/l51 6849 1 2024-04-26T21:08:21.504 INFO:tasks.workunit.client.1.smithi064.stdout:5/907: chown dd/d12/d18/d25/l75 7 1 2024-04-26T21:08:21.509 INFO:tasks.workunit.client.0.smithi055.stdout:5/590: rename d4/df/d13/d26/d3c to d4/df/dae/dce 0 2024-04-26T21:08:21.511 INFO:tasks.workunit.client.1.smithi064.stdout:3/947: dwrite d1/d27/d50/f2d [4194304,4194304] 0 2024-04-26T21:08:21.515 INFO:tasks.workunit.client.0.smithi055.stdout:0/753: dwrite d9/d11/f46 [0,4194304] 0 2024-04-26T21:08:21.515 INFO:tasks.workunit.client.0.smithi055.stdout:6/720: dwrite d3/d9b/fa2 [0,4194304] 0 2024-04-26T21:08:21.515 INFO:tasks.workunit.client.0.smithi055.stdout:1/709: mknod d8/df/d11/d27/d28/ceb 0 2024-04-26T21:08:21.515 INFO:tasks.workunit.client.0.smithi055.stdout:1/710: stat d8/d17/f77 0 2024-04-26T21:08:21.515 INFO:tasks.workunit.client.0.smithi055.stdout:1/711: creat d8/df/d11/d6c/fec x:0 0 0 2024-04-26T21:08:21.517 INFO:tasks.workunit.client.0.smithi055.stdout:2/848: rename d4/d55/cca to d4/d14/c121 0 2024-04-26T21:08:21.520 INFO:tasks.workunit.client.1.smithi064.stdout:8/859: dwrite d10/d41/d4e/d60/fad [0,4194304] 0 2024-04-26T21:08:21.520 INFO:tasks.workunit.client.0.smithi055.stdout:5/591: write d4/df/dae/dce/d93/dcb/f89 [1097862,124415] 0 2024-04-26T21:08:21.521 INFO:tasks.workunit.client.1.smithi064.stdout:0/929: dwrite dd/d21/dd9/f12e [0,4194304] 0 2024-04-26T21:08:21.524 INFO:tasks.workunit.client.1.smithi064.stdout:5/908: rmdir dd/da9 39 2024-04-26T21:08:21.525 INFO:tasks.workunit.client.0.smithi055.stdout:8/613: dwrite d3/d9/d1d/d48/d57/fb2 [0,4194304] 0 2024-04-26T21:08:21.525 INFO:tasks.workunit.client.0.smithi055.stdout:8/614: stat d3/d9/d1d/d48/d57/d61/l91 0 2024-04-26T21:08:21.525 INFO:tasks.workunit.client.0.smithi055.stdout:0/754: dread d9/dc/d19/ddb/dbd/fd0 [0,4194304] 0 2024-04-26T21:08:21.525 INFO:tasks.workunit.client.0.smithi055.stdout:3/778: dwrite d0/d4/f40 [4194304,4194304] 0 2024-04-26T21:08:21.529 INFO:tasks.workunit.client.1.smithi064.stdout:5/909: write dd/d12/d18/d1a/d1f/d20/f8b [4754516,8833] 0 2024-04-26T21:08:21.530 INFO:tasks.workunit.client.1.smithi064.stdout:3/948: dread d1/d27/d50/d35/d4c/d7b/d82/f12c [0,4194304] 0 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.0.smithi055.stdout:2/849: creat d4/db/d26/f122 x:0 0 0 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.0.smithi055.stdout:6/721: dread d3/d17/d19/f49 [0,4194304] 0 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.0.smithi055.stdout:6/722: write d3/d17/d46/fed [125948,3545] 0 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.0.smithi055.stdout:6/723: read - d3/da5/ff0 zero size 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.0.smithi055.stdout:6/724: chown d3/d9b/ddf 7594 1 2024-04-26T21:08:21.531 INFO:tasks.workunit.client.1.smithi064.stdout:8/860: creat d10/d2f/f106 x:0 0 0 2024-04-26T21:08:21.533 INFO:tasks.workunit.client.0.smithi055.stdout:7/723: rename d5/d6/d24/d3b/f45 to d5/d53/dd1/fe1 0 2024-04-26T21:08:21.534 INFO:tasks.workunit.client.1.smithi064.stdout:5/910: symlink dd/d12/d4f/da5/l11e 0 2024-04-26T21:08:21.535 INFO:tasks.workunit.client.0.smithi055.stdout:2/850: dread d4/db/d56/f70 [0,4194304] 0 2024-04-26T21:08:21.538 INFO:tasks.workunit.client.1.smithi064.stdout:9/945: dwrite d0/d4/da/d26/d45/d90/fbc [0,4194304] 0 2024-04-26T21:08:21.538 INFO:tasks.workunit.client.1.smithi064.stdout:9/946: fdatasync d0/d4/d7/df/fac 0 2024-04-26T21:08:21.541 INFO:tasks.workunit.client.1.smithi064.stdout:3/949: creat d1/d27/d29/d6f/dfc/f148 x:0 0 0 2024-04-26T21:08:21.541 INFO:tasks.workunit.client.1.smithi064.stdout:8/861: mkdir d10/d2f/d56/d107 0 2024-04-26T21:08:21.542 INFO:tasks.workunit.client.0.smithi055.stdout:9/775: write d2/d46/d9a/d105/db8/dc5/ded/fef [700493,25493] 0 2024-04-26T21:08:21.543 INFO:tasks.workunit.client.0.smithi055.stdout:9/776: read d2/d11/f2f [442074,115197] 0 2024-04-26T21:08:21.544 INFO:tasks.workunit.client.0.smithi055.stdout:9/777: fdatasync d2/d46/d77/ff3 0 2024-04-26T21:08:21.544 INFO:tasks.workunit.client.0.smithi055.stdout:9/778: dread - d2/d46/d51/fe9 zero size 2024-04-26T21:08:21.549 INFO:tasks.workunit.client.1.smithi064.stdout:8/862: symlink d10/d41/l108 0 2024-04-26T21:08:21.549 INFO:tasks.workunit.client.1.smithi064.stdout:8/863: dread - d10/fcd zero size 2024-04-26T21:08:21.550 INFO:tasks.workunit.client.1.smithi064.stdout:6/933: sync 2024-04-26T21:08:21.552 INFO:tasks.workunit.client.0.smithi055.stdout:8/615: truncate d3/d9/d1d/f6e 2860799 0 2024-04-26T21:08:21.554 INFO:tasks.workunit.client.0.smithi055.stdout:3/779: symlink d0/d4/d5/d73/d47/d37/l10e 0 2024-04-26T21:08:21.554 INFO:tasks.workunit.client.0.smithi055.stdout:6/725: mknod d3/d17/d46/d54/d66/d6a/d6b/c100 0 2024-04-26T21:08:21.556 INFO:tasks.workunit.client.0.smithi055.stdout:5/592: mknod d4/ccf 0 2024-04-26T21:08:21.557 INFO:tasks.workunit.client.1.smithi064.stdout:0/930: write dd/d21/dd9/f12e [4299233,1669] 0 2024-04-26T21:08:21.557 INFO:tasks.workunit.client.1.smithi064.stdout:3/950: dread d1/d27/d29/d6f/d72/d95/fb8 [0,4194304] 0 2024-04-26T21:08:21.558 INFO:tasks.workunit.client.1.smithi064.stdout:3/951: stat d1/d38/l89 0 2024-04-26T21:08:21.558 INFO:tasks.workunit.client.1.smithi064.stdout:3/952: rename d1/d27/d29/d6f/d72/d95/dd9/f146 to d1/d27/d29/d6f/d72/d95/dd9/f149 0 2024-04-26T21:08:21.558 INFO:tasks.workunit.client.0.smithi055.stdout:7/724: rmdir d5/d6 39 2024-04-26T21:08:21.559 INFO:tasks.workunit.client.0.smithi055.stdout:7/725: write d5/d6/d24/d4d/da7/fcc [1275660,107511] 0 2024-04-26T21:08:21.559 INFO:tasks.workunit.client.1.smithi064.stdout:9/947: write d0/d4/da/d67/dd0/dd2/f99 [3052628,124979] 0 2024-04-26T21:08:21.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/712: rename d8/d17/c7e to d8/d94/d9b/ced 0 2024-04-26T21:08:21.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/713: fdatasync d8/d17/d6a/f99 0 2024-04-26T21:08:21.560 INFO:tasks.workunit.client.0.smithi055.stdout:1/714: truncate d8/d17/d1b/d7b/fe2 100318 0 2024-04-26T21:08:21.561 INFO:tasks.workunit.client.0.smithi055.stdout:2/851: creat d4/db/d8f/da6/d97/f123 x:0 0 0 2024-04-26T21:08:21.561 INFO:tasks.workunit.client.0.smithi055.stdout:2/852: chown d4/d49/f87 9616 1 2024-04-26T21:08:21.563 INFO:tasks.workunit.client.1.smithi064.stdout:5/911: dread dd/d12/f2e [0,4194304] 0 2024-04-26T21:08:21.564 INFO:tasks.workunit.client.1.smithi064.stdout:5/912: read dd/d12/d4f/da5/fa7 [2879,22891] 0 2024-04-26T21:08:21.564 INFO:tasks.workunit.client.1.smithi064.stdout:9/948: mknod d0/d4/d28/d4f/c130 0 2024-04-26T21:08:21.564 INFO:tasks.workunit.client.1.smithi064.stdout:9/949: truncate d0/d4/d7/d102/f12b 381866 0 2024-04-26T21:08:21.564 INFO:tasks.workunit.client.1.smithi064.stdout:9/950: truncate d0/d4/da/d26/d47/d6b/fcb 1050409 0 2024-04-26T21:08:21.567 INFO:tasks.workunit.client.0.smithi055.stdout:5/593: symlink d4/df/dae/dce/d5b/ld0 0 2024-04-26T21:08:21.567 INFO:tasks.workunit.client.0.smithi055.stdout:7/726: unlink d5/d53/dd1/fbf 0 2024-04-26T21:08:21.567 INFO:tasks.workunit.client.0.smithi055.stdout:1/715: rename d8/df/f5c to d8/d17/d1b/d41/fee 0 2024-04-26T21:08:21.568 INFO:tasks.workunit.client.1.smithi064.stdout:3/953: rmdir d1/d27/d29/d5e 39 2024-04-26T21:08:21.570 INFO:tasks.workunit.client.1.smithi064.stdout:5/913: symlink dd/da9/d48/d56/l11f 0 2024-04-26T21:08:21.572 INFO:tasks.workunit.client.1.smithi064.stdout:8/864: dread d10/d1d/f43 [0,4194304] 0 2024-04-26T21:08:21.572 INFO:tasks.workunit.client.0.smithi055.stdout:7/727: read d5/d6/d24/d3b/f4e [146059,108118] 0 2024-04-26T21:08:21.573 INFO:tasks.workunit.client.1.smithi064.stdout:9/951: mkdir d0/d4/d7/d131 0 2024-04-26T21:08:21.574 INFO:tasks.workunit.client.0.smithi055.stdout:5/594: dread d4/df/d13/d26/f4e [0,4194304] 0 2024-04-26T21:08:21.576 INFO:tasks.workunit.client.0.smithi055.stdout:0/755: rename d9/d27/c2f to d9/d27/dcb/ced 0 2024-04-26T21:08:21.577 INFO:tasks.workunit.client.1.smithi064.stdout:3/954: rename d1/d27/d29/d6f/d72/da5/d7d/lc5 to d1/d27/d50/d35/d4c/l14a 0 2024-04-26T21:08:21.578 INFO:tasks.workunit.client.0.smithi055.stdout:1/716: mkdir d8/d17/d1b/d7b/def 0 2024-04-26T21:08:21.578 INFO:tasks.workunit.client.0.smithi055.stdout:1/717: truncate d8/d17/d1b/d41/fee 865561 0 2024-04-26T21:08:21.580 INFO:tasks.workunit.client.1.smithi064.stdout:5/914: truncate dd/d12/f2e 945566 0 2024-04-26T21:08:21.581 INFO:tasks.workunit.client.0.smithi055.stdout:8/616: read d3/d9/d44/fb8 [3336417,28132] 0 2024-04-26T21:08:21.583 INFO:tasks.workunit.client.0.smithi055.stdout:7/728: mknod d5/d11/d8c/ce2 0 2024-04-26T21:08:21.586 INFO:tasks.workunit.client.1.smithi064.stdout:8/865: link d10/d41/d4e/d54/fbe d10/d2f/f109 0 2024-04-26T21:08:21.586 INFO:tasks.workunit.client.1.smithi064.stdout:3/955: mkdir d1/d27/d50/d35/d4c/d7b/d14b 0 2024-04-26T21:08:21.586 INFO:tasks.workunit.client.1.smithi064.stdout:3/956: truncate d1/d27/d29/d6f/d72/d73/f7f 330004 0 2024-04-26T21:08:21.587 INFO:tasks.workunit.client.1.smithi064.stdout:5/915: creat dd/d12/d18/f120 x:0 0 0 2024-04-26T21:08:21.590 INFO:tasks.workunit.client.1.smithi064.stdout:3/957: mknod d1/d38/d68/d13a/c14c 0 2024-04-26T21:08:21.590 INFO:tasks.workunit.client.1.smithi064.stdout:3/958: getdents d1/d27/d29/d5e/d10d 0 2024-04-26T21:08:21.592 INFO:tasks.workunit.client.0.smithi055.stdout:5/595: creat d4/df/dae/dce/d4a/d92/fd1 x:0 0 0 2024-04-26T21:08:21.593 INFO:tasks.workunit.client.0.smithi055.stdout:5/596: write f2 [2182667,92173] 0 2024-04-26T21:08:21.597 INFO:tasks.workunit.client.0.smithi055.stdout:6/726: rename d3/d17/d19/l1c to d3/d17/d46/d54/d66/d6a/d51/l101 0 2024-04-26T21:08:21.597 INFO:tasks.workunit.client.0.smithi055.stdout:0/756: truncate d9/dc/d1c/d3e/fa2 526976 0 2024-04-26T21:08:21.599 INFO:tasks.workunit.client.0.smithi055.stdout:1/718: creat d8/d94/dd9/ff0 x:0 0 0 2024-04-26T21:08:21.601 INFO:tasks.workunit.client.0.smithi055.stdout:7/729: mknod d5/d53/d6e/d65/dc5/dc7/ce3 0 2024-04-26T21:08:21.601 INFO:tasks.workunit.client.0.smithi055.stdout:7/730: fdatasync d5/d6/d24/d3b/f44 0 2024-04-26T21:08:21.604 INFO:tasks.workunit.client.0.smithi055.stdout:5/597: rmdir d4/df/dae 39 2024-04-26T21:08:21.608 INFO:tasks.workunit.client.0.smithi055.stdout:0/757: mkdir d9/dc/d1c/d3e/dc5/dcc/d9c/dee 0 2024-04-26T21:08:21.608 INFO:tasks.workunit.client.0.smithi055.stdout:0/758: write d9/d8b/fe1 [696815,75302] 0 2024-04-26T21:08:21.612 INFO:tasks.workunit.client.0.smithi055.stdout:1/719: mkdir d8/d17/d1b/d7b/df1 0 2024-04-26T21:08:21.618 INFO:tasks.workunit.client.1.smithi064.stdout:6/934: dread d4/d7/d12/d49/d4b/d7d/fa9 [0,4194304] 0 2024-04-26T21:08:21.622 INFO:tasks.workunit.client.0.smithi055.stdout:7/731: fsync d5/d6/d24/f69 0 2024-04-26T21:08:21.625 INFO:tasks.workunit.client.0.smithi055.stdout:5/598: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/ld2 0 2024-04-26T21:08:21.625 INFO:tasks.workunit.client.0.smithi055.stdout:5/599: fdatasync d4/df/d13/d26/f7e 0 2024-04-26T21:08:21.631 INFO:tasks.workunit.client.1.smithi064.stdout:6/935: link d4/d7/d12/d49/d4b/d56/d95/fcb d4/d7/d12/d49/d4b/d101/f13b 0 2024-04-26T21:08:21.631 INFO:tasks.workunit.client.1.smithi064.stdout:6/936: dread - d4/d7/d12/d49/d4b/d5a/daf/db2/ff2 zero size 2024-04-26T21:08:21.634 INFO:tasks.workunit.client.1.smithi064.stdout:3/959: read d1/d14/f6a [2865961,45086] 0 2024-04-26T21:08:21.640 INFO:tasks.workunit.client.1.smithi064.stdout:0/931: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f8a [4194304,4194304] 0 2024-04-26T21:08:21.642 INFO:tasks.workunit.client.1.smithi064.stdout:8/866: dwrite d10/d41/d4e/d54/db3/ff0 [4194304,4194304] 0 2024-04-26T21:08:21.642 INFO:tasks.workunit.client.1.smithi064.stdout:8/867: fsync d10/d41/d4e/d59/f6e 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/720: creat d8/ff2 x:0 0 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/721: creat d8/df/d11/d27/d28/d2a/da7/ff3 x:0 0 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/722: fsync d8/df/d11/d27/fc3 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/723: chown d8/d17/d1b/d7b/d8d/fe8 4121107 1 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/724: write d8/d17/d1b/d7b/fe2 [847656,115830] 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/725: write d8/d17/d6a/f99 [1300500,8711] 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/726: truncate d8/df/d11/d6c/fdb 285631 0 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:1/727: chown d8/d17/d1b/d7b/f90 102616 1 2024-04-26T21:08:21.645 INFO:tasks.workunit.client.0.smithi055.stdout:3/780: dwrite d0/d4/d5/d73/d13/d1a/f35 [4194304,4194304] 0 2024-04-26T21:08:21.647 INFO:tasks.workunit.client.0.smithi055.stdout:7/732: rename d5/d6/d24/d4d/da7/ddb to d5/d11/de4 0 2024-04-26T21:08:21.648 INFO:tasks.workunit.client.1.smithi064.stdout:6/937: creat d4/d7/d12/d49/d4b/d56/dcf/f13c x:0 0 0 2024-04-26T21:08:21.652 INFO:tasks.workunit.client.0.smithi055.stdout:4/603: sync 2024-04-26T21:08:21.653 INFO:tasks.workunit.client.1.smithi064.stdout:3/960: mknod d1/d27/d29/d6f/d72/d7a/c14d 0 2024-04-26T21:08:21.655 INFO:tasks.workunit.client.0.smithi055.stdout:5/600: truncate d4/df/dae/dce/d4a/d3f/d4f/f77 3310725 0 2024-04-26T21:08:21.655 INFO:tasks.workunit.client.0.smithi055.stdout:6/727: dwrite d3/d17/d46/d54/d66/d6a/d51/d58/fcc [4194304,4194304] 0 2024-04-26T21:08:21.655 INFO:tasks.workunit.client.0.smithi055.stdout:6/728: readlink d3/d17/d46/d54/d66/d6a/l33 0 2024-04-26T21:08:21.655 INFO:tasks.workunit.client.0.smithi055.stdout:5/601: write d4/df/dae/dce/d4a/fca [846600,21548] 0 2024-04-26T21:08:21.658 INFO:tasks.workunit.client.1.smithi064.stdout:0/932: unlink dd/d21/dc8/d31/d47/dad/dfd/fe1 0 2024-04-26T21:08:21.667 INFO:tasks.workunit.client.0.smithi055.stdout:7/733: rename d5/c16 to d5/d53/d6e/d99/d7f/d6f/da5/ce5 0 2024-04-26T21:08:21.668 INFO:tasks.workunit.client.1.smithi064.stdout:5/916: dwrite dd/da9/d48/f7e [0,4194304] 0 2024-04-26T21:08:21.668 INFO:tasks.workunit.client.1.smithi064.stdout:8/868: symlink d10/d41/d53/l10a 0 2024-04-26T21:08:21.670 INFO:tasks.workunit.client.1.smithi064.stdout:9/952: dwrite d0/d4/d28/dff/d103/f106 [0,4194304] 0 2024-04-26T21:08:21.673 INFO:tasks.workunit.client.0.smithi055.stdout:6/729: creat d3/d17/d46/d54/d66/f102 x:0 0 0 2024-04-26T21:08:21.676 INFO:tasks.workunit.client.1.smithi064.stdout:3/961: link d1/d27/d29/d6f/d72/d7a/c14d d1/d27/d29/d6f/c14e 0 2024-04-26T21:08:21.678 INFO:tasks.workunit.client.0.smithi055.stdout:4/604: write d4/d12/d17/d3d/f68 [378184,26037] 0 2024-04-26T21:08:21.678 INFO:tasks.workunit.client.0.smithi055.stdout:4/605: stat d4/d12/d15/f6f 0 2024-04-26T21:08:21.679 INFO:tasks.workunit.client.0.smithi055.stdout:5/602: dread d4/df/d13/d26/f8e [0,4194304] 0 2024-04-26T21:08:21.682 INFO:tasks.workunit.client.1.smithi064.stdout:0/933: mknod dd/d21/dc8/d31/d47/dad/dfd/d18/d58/dba/c141 0 2024-04-26T21:08:21.689 INFO:tasks.workunit.client.0.smithi055.stdout:6/730: mkdir d3/d17/d19/d71/dca/d103 0 2024-04-26T21:08:21.695 INFO:tasks.workunit.client.1.smithi064.stdout:5/917: link dd/d12/d4f/dbd/lcc dd/d12/d4f/d9c/da1/l121 0 2024-04-26T21:08:21.695 INFO:tasks.workunit.client.1.smithi064.stdout:5/918: chown dd/d12/d18/d1a/d1f/d20/l68 63934141 1 2024-04-26T21:08:21.700 INFO:tasks.workunit.client.1.smithi064.stdout:9/953: link d0/d4/d7/df/c17 d0/d4/d28/df3/c132 0 2024-04-26T21:08:21.700 INFO:tasks.workunit.client.1.smithi064.stdout:3/962: mknod d1/d27/d50/d35/d4c/dd1/c14f 0 2024-04-26T21:08:21.704 INFO:tasks.workunit.client.1.smithi064.stdout:0/934: rmdir dd/d21/dc8/d31/d47/dad/dfd/d18/d58/dba 39 2024-04-26T21:08:21.704 INFO:tasks.workunit.client.0.smithi055.stdout:6/731: mkdir d3/d17/d46/d54/d66/d6a/d51/d58/d6d/d86/d104 0 2024-04-26T21:08:21.704 INFO:tasks.workunit.client.0.smithi055.stdout:5/603: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/cd3 0 2024-04-26T21:08:21.704 INFO:tasks.workunit.client.0.smithi055.stdout:6/732: creat d3/d17/d46/dc2/dd4/df3/f105 x:0 0 0 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:6/733: read d3/f30 [194793,33277] 0 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:6/734: chown d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/le7 2334275 1 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:6/735: dread - d3/d17/d46/d54/d66/d6a/d67/d83/fec zero size 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:6/736: truncate d3/d17/d25/ff7 469220 0 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:5/604: fsync d4/df/dae/dce/d5b/d83/fa7 0 2024-04-26T21:08:21.705 INFO:tasks.workunit.client.0.smithi055.stdout:5/605: readlink d4/df/dae/dce/d4a/d3f/d2e/l7c 0 2024-04-26T21:08:21.711 INFO:tasks.workunit.client.0.smithi055.stdout:0/759: dwrite d9/dc/d17/f45 [0,4194304] 0 2024-04-26T21:08:21.713 INFO:tasks.workunit.client.0.smithi055.stdout:0/760: fsync d9/dc/f57 0 2024-04-26T21:08:21.714 INFO:tasks.workunit.client.0.smithi055.stdout:0/761: fsync d9/dc/d19/ddb/db6/d67/f88 0 2024-04-26T21:08:21.714 INFO:tasks.workunit.client.0.smithi055.stdout:0/762: chown d9/dc/d1c/d3e/dc5/dcc/d9c 164202955 1 2024-04-26T21:08:21.720 INFO:tasks.workunit.client.0.smithi055.stdout:5/606: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4 0 2024-04-26T21:08:21.721 INFO:tasks.workunit.client.0.smithi055.stdout:3/781: dwrite d0/d4/d5/d73/d13/d27/d50/d6b/d83/ff1 [0,4194304] 0 2024-04-26T21:08:21.723 INFO:tasks.workunit.client.0.smithi055.stdout:6/737: rename d3/da5/ff0 to d3/d17/d46/d54/d66/d6a/d67/d83/d96/d9e/daf/f106 0 2024-04-26T21:08:21.723 INFO:tasks.workunit.client.0.smithi055.stdout:6/738: write d3/d17/d19/d71/f44 [2061555,9567] 0 2024-04-26T21:08:21.725 INFO:tasks.workunit.client.0.smithi055.stdout:3/782: mkdir d0/d4/d16/d18/d10f 0 2024-04-26T21:08:21.732 INFO:tasks.workunit.client.0.smithi055.stdout:6/739: creat d3/d17/d46/d54/d66/d6a/d51/d58/d6d/f107 x:0 0 0 2024-04-26T21:08:21.736 INFO:tasks.workunit.client.0.smithi055.stdout:5/607: rename d4/df/d13/d26/c88 to d4/df/dae/dce/d4a/d3f/d4f/d53/d90/cd5 0 2024-04-26T21:08:21.739 INFO:tasks.workunit.client.0.smithi055.stdout:6/740: mknod d3/d17/d46/d54/d66/d6a/c108 0 2024-04-26T21:08:21.742 INFO:tasks.workunit.client.1.smithi064.stdout:5/919: mknod dd/da9/d48/d6a/d101/c122 0 2024-04-26T21:08:21.746 INFO:tasks.workunit.client.1.smithi064.stdout:0/935: dread dd/d21/dc8/d31/d47/dad/dfd/f2e [0,4194304] 0 2024-04-26T21:08:21.747 INFO:tasks.workunit.client.1.smithi064.stdout:0/936: stat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/ca2 0 2024-04-26T21:08:21.750 INFO:tasks.workunit.client.1.smithi064.stdout:0/937: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/fc4 535267 0 2024-04-26T21:08:21.753 INFO:tasks.workunit.client.1.smithi064.stdout:0/938: symlink dd/d21/dc8/d31/d47/dad/dce/l142 0 2024-04-26T21:08:21.754 INFO:tasks.workunit.client.0.smithi055.stdout:5/608: dread d4/df/f1b [0,4194304] 0 2024-04-26T21:08:21.754 INFO:tasks.workunit.client.0.smithi055.stdout:1/728: dwrite d8/df/d11/d27/d28/dd7/fb0 [0,4194304] 0 2024-04-26T21:08:21.754 INFO:tasks.workunit.client.0.smithi055.stdout:5/609: write d4/df/d13/f4c [3989860,10312] 0 2024-04-26T21:08:21.757 INFO:tasks.workunit.client.0.smithi055.stdout:7/734: dwrite d5/d6/d24/f91 [0,4194304] 0 2024-04-26T21:08:21.757 INFO:tasks.workunit.client.0.smithi055.stdout:5/610: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/dd6 0 2024-04-26T21:08:21.758 INFO:tasks.workunit.client.0.smithi055.stdout:4/606: dwrite d4/d12/d17/fa8 [0,4194304] 0 2024-04-26T21:08:21.758 INFO:tasks.workunit.client.0.smithi055.stdout:1/729: creat d8/df/d11/db5/ff4 x:0 0 0 2024-04-26T21:08:21.758 INFO:tasks.workunit.client.0.smithi055.stdout:1/730: write d8/df/d11/f37 [1519516,19954] 0 2024-04-26T21:08:21.759 INFO:tasks.workunit.client.1.smithi064.stdout:6/938: dwrite d4/d7/d12/d1e/dd4/ff6 [0,4194304] 0 2024-04-26T21:08:21.769 INFO:tasks.workunit.client.0.smithi055.stdout:0/763: dwrite d9/dc/d1c/d3e/dc5/dcc/d4b/fda [0,4194304] 0 2024-04-26T21:08:21.772 INFO:tasks.workunit.client.0.smithi055.stdout:3/783: dwrite d0/f22 [4194304,4194304] 0 2024-04-26T21:08:21.774 INFO:tasks.workunit.client.1.smithi064.stdout:6/939: mknod d4/d7/d12/d49/d4b/d7d/d83/d124/c13d 0 2024-04-26T21:08:21.777 INFO:tasks.workunit.client.1.smithi064.stdout:6/940: truncate d4/d7/fa8 2937264 0 2024-04-26T21:08:21.782 INFO:tasks.workunit.client.0.smithi055.stdout:3/784: dread d0/d4/d5/d73/d13/d27/fc2 [0,4194304] 0 2024-04-26T21:08:21.782 INFO:tasks.workunit.client.0.smithi055.stdout:3/785: dread - d0/d4/d16/d18/d4b/d57/d8e/de0/fe3 zero size 2024-04-26T21:08:21.784 INFO:tasks.workunit.client.0.smithi055.stdout:7/735: symlink d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/le6 0 2024-04-26T21:08:21.785 INFO:tasks.workunit.client.0.smithi055.stdout:7/736: chown d5/d6/d39/cc3 74 1 2024-04-26T21:08:21.788 INFO:tasks.workunit.client.0.smithi055.stdout:4/607: link d4/d12/d15/l33 d4/d26/lcc 0 2024-04-26T21:08:21.794 INFO:tasks.workunit.client.0.smithi055.stdout:1/731: creat d8/d17/d1b/d7b/d8d/ff5 x:0 0 0 2024-04-26T21:08:21.795 INFO:tasks.workunit.client.0.smithi055.stdout:5/611: dwrite d4/df/f3b [0,4194304] 0 2024-04-26T21:08:21.795 INFO:tasks.workunit.client.0.smithi055.stdout:5/612: chown d4/c94 23269223 1 2024-04-26T21:08:21.795 INFO:tasks.workunit.client.0.smithi055.stdout:6/741: rename d3/d17/d46/d54 to d3/d17/d46/d109 0 2024-04-26T21:08:21.796 INFO:tasks.workunit.client.1.smithi064.stdout:6/941: dread d4/d7/d12/d49/d4b/d7d/f91 [0,4194304] 0 2024-04-26T21:08:21.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/942: creat d4/d7/d12/d49/d4b/d56/f13e x:0 0 0 2024-04-26T21:08:21.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/943: chown d4/d7/l93 102623 1 2024-04-26T21:08:21.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/944: readlink d4/d7/d12/d49/d9e/laa 0 2024-04-26T21:08:21.797 INFO:tasks.workunit.client.1.smithi064.stdout:6/945: chown d4/d7/d12/d49/d4b/d5a/d8f 0 1 2024-04-26T21:08:21.798 INFO:tasks.workunit.client.0.smithi055.stdout:3/786: dread d0/d4/d5/d73/d47/d37/f6f [0,4194304] 0 2024-04-26T21:08:21.799 INFO:tasks.workunit.client.0.smithi055.stdout:0/764: truncate d9/dc/d1c/d3e/dc5/dcc/f4a 233841 0 2024-04-26T21:08:21.799 INFO:tasks.workunit.client.0.smithi055.stdout:0/765: dread - d9/dc/d17/d5d/f9e zero size 2024-04-26T21:08:21.800 INFO:tasks.workunit.client.1.smithi064.stdout:5/920: write dd/fda [1186640,95387] 0 2024-04-26T21:08:21.800 INFO:tasks.workunit.client.0.smithi055.stdout:7/737: mkdir d5/d6/d24/d4d/da7/dab/dce/de7 0 2024-04-26T21:08:21.804 INFO:tasks.workunit.client.1.smithi064.stdout:5/921: symlink dd/d12/d4f/l123 0 2024-04-26T21:08:21.804 INFO:tasks.workunit.client.1.smithi064.stdout:5/922: dread - dd/d12/d18/d25/d74/fd1 zero size 2024-04-26T21:08:21.804 INFO:tasks.workunit.client.1.smithi064.stdout:5/923: dread - dd/d12/d18/d1a/f6e zero size 2024-04-26T21:08:21.804 INFO:tasks.workunit.client.1.smithi064.stdout:5/924: truncate dd/d12/d4f/d9c/da1/fc0 1048281 0 2024-04-26T21:08:21.804 INFO:tasks.workunit.client.1.smithi064.stdout:5/925: readlink dd/d12/d4f/d9c/da1/l121 0 2024-04-26T21:08:21.806 INFO:tasks.workunit.client.0.smithi055.stdout:1/732: creat d8/d17/d1b/d7b/d65/ff6 x:0 0 0 2024-04-26T21:08:21.806 INFO:tasks.workunit.client.0.smithi055.stdout:1/733: chown d8/df/d11/d27/d28/f29 28514 1 2024-04-26T21:08:21.806 INFO:tasks.workunit.client.0.smithi055.stdout:1/734: chown d8/d17/d1b/c60 110979350 1 2024-04-26T21:08:21.808 INFO:tasks.workunit.client.0.smithi055.stdout:5/613: creat d4/df/dae/dce/d5b/d83/fd7 x:0 0 0 2024-04-26T21:08:21.808 INFO:tasks.workunit.client.0.smithi055.stdout:5/614: chown d4/df/dae/dce/d93/dcb/f52 5085111 1 2024-04-26T21:08:21.812 INFO:tasks.workunit.client.0.smithi055.stdout:6/742: dread d3/d9b/fa2 [0,4194304] 0 2024-04-26T21:08:21.813 INFO:tasks.workunit.client.0.smithi055.stdout:0/766: mknod d9/d11/cef 0 2024-04-26T21:08:21.816 INFO:tasks.workunit.client.1.smithi064.stdout:5/926: rmdir dd/da9/d48/dac/dc7 39 2024-04-26T21:08:21.819 INFO:tasks.workunit.client.0.smithi055.stdout:7/738: rename d5/d6/d24/l26 to d5/d6/d24/d4d/da7/dab/dae/le8 0 2024-04-26T21:08:21.823 INFO:tasks.workunit.client.0.smithi055.stdout:5/615: dread d4/df/dae/dce/d4a/d3f/d4f/d53/f91 [0,4194304] 0 2024-04-26T21:08:21.834 INFO:tasks.workunit.client.0.smithi055.stdout:6/743: write d3/f5b [1126208,89728] 0 2024-04-26T21:08:21.834 INFO:tasks.workunit.client.0.smithi055.stdout:6/744: truncate d3/d17/d46/d109/d66/d6a/d67/d83/ff2 303281 0 2024-04-26T21:08:21.842 INFO:tasks.workunit.client.0.smithi055.stdout:6/745: mkdir d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf/df5/d10a 0 2024-04-26T21:08:21.844 INFO:tasks.workunit.client.0.smithi055.stdout:0/767: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:08:21.845 INFO:tasks.workunit.client.0.smithi055.stdout:3/787: write d0/d4/d16/f70 [1688372,73905] 0 2024-04-26T21:08:21.848 INFO:tasks.workunit.client.0.smithi055.stdout:3/788: symlink d0/d4/d16/d18/d4b/d57/d8e/db1/l110 0 2024-04-26T21:08:21.850 INFO:tasks.workunit.client.0.smithi055.stdout:3/789: rename d0/d4/d5/f6 to d0/d4/d16/d18/d4b/d57/d8e/de0/f111 0 2024-04-26T21:08:21.853 INFO:tasks.workunit.client.0.smithi055.stdout:0/768: write d9/f64 [20538,46711] 0 2024-04-26T21:08:21.862 INFO:tasks.workunit.client.1.smithi064.stdout:3/963: dwrite d1/d38/f8f [0,4194304] 0 2024-04-26T21:08:21.865 INFO:tasks.workunit.client.1.smithi064.stdout:3/964: rmdir d1/d27/d29/d6f/d72/da5/d7d 39 2024-04-26T21:08:21.865 INFO:tasks.workunit.client.1.smithi064.stdout:3/965: truncate d1/d14/f5a 9001931 0 2024-04-26T21:08:21.866 INFO:tasks.workunit.client.0.smithi055.stdout:3/790: dread d0/d4/d5/f21 [0,4194304] 0 2024-04-26T21:08:21.866 INFO:tasks.workunit.client.0.smithi055.stdout:3/791: fsync d0/d4/d16/d18/d4b/d57/ff4 0 2024-04-26T21:08:21.869 INFO:tasks.workunit.client.0.smithi055.stdout:0/769: dread d9/dc/d1c/d3e/f89 [0,4194304] 0 2024-04-26T21:08:21.870 INFO:tasks.workunit.client.0.smithi055.stdout:0/770: stat d9/dc/d19/ddb/db6/d67 0 2024-04-26T21:08:21.873 INFO:tasks.workunit.client.1.smithi064.stdout:6/946: dwrite d4/d7/d12/d49/d4b/d5a/d8f/f105 [0,4194304] 0 2024-04-26T21:08:21.873 INFO:tasks.workunit.client.1.smithi064.stdout:6/947: creat d4/d7/d12/d49/d4b/dc9/f13f x:0 0 0 2024-04-26T21:08:21.874 INFO:tasks.workunit.client.1.smithi064.stdout:3/966: rename d1/d27/d29/d6f/d72/da5/d7d/df9/c127 to d1/d27/d29/d6f/d72/d26/c150 0 2024-04-26T21:08:21.876 INFO:tasks.workunit.client.1.smithi064.stdout:8/869: sync 2024-04-26T21:08:21.877 INFO:tasks.workunit.client.0.smithi055.stdout:7/739: write d5/d53/d6e/d99/d7f/f96 [2716192,69769] 0 2024-04-26T21:08:21.877 INFO:tasks.workunit.client.0.smithi055.stdout:1/735: dwrite d8/ff2 [0,4194304] 0 2024-04-26T21:08:21.888 INFO:tasks.workunit.client.0.smithi055.stdout:0/771: mkdir d9/df0 0 2024-04-26T21:08:21.898 INFO:tasks.workunit.client.1.smithi064.stdout:3/967: rename d1/d27/d29/d6f/d72/d7a/d99/fd0 to d1/d14/f151 0 2024-04-26T21:08:21.899 INFO:tasks.workunit.client.1.smithi064.stdout:0/939: sync 2024-04-26T21:08:21.899 INFO:tasks.workunit.client.1.smithi064.stdout:9/954: sync 2024-04-26T21:08:21.899 INFO:tasks.workunit.client.1.smithi064.stdout:0/940: chown dd/d21/dc8/d31/d47/dad/dfd/cec 457128 1 2024-04-26T21:08:21.899 INFO:tasks.workunit.client.1.smithi064.stdout:0/941: chown dd/d21/dc8/d31/d47/l54 5874 1 2024-04-26T21:08:21.899 INFO:tasks.workunit.client.1.smithi064.stdout:8/870: mkdir d10/d1d/da3/d10b 0 2024-04-26T21:08:21.903 INFO:tasks.workunit.client.0.smithi055.stdout:1/736: rename d8/df/d11/d27/d28/dd7/l67 to d8/df/d11/db5/lf7 0 2024-04-26T21:08:21.903 INFO:tasks.workunit.client.0.smithi055.stdout:1/737: write d8/df/d11/d27/d28/dd7/fa9 [1535044,111524] 0 2024-04-26T21:08:21.904 INFO:tasks.workunit.client.1.smithi064.stdout:3/968: creat d1/d27/d29/d6f/f152 x:0 0 0 2024-04-26T21:08:21.905 INFO:tasks.workunit.client.1.smithi064.stdout:5/927: dwrite dd/d12/d18/d25/d74/f82 [0,4194304] 0 2024-04-26T21:08:21.905 INFO:tasks.workunit.client.0.smithi055.stdout:0/772: mkdir d9/dc/d19/ddb/db6/df1 0 2024-04-26T21:08:21.907 INFO:tasks.workunit.client.1.smithi064.stdout:9/955: creat d0/da6/f133 x:0 0 0 2024-04-26T21:08:21.907 INFO:tasks.workunit.client.0.smithi055.stdout:7/740: rmdir d5/d6/d24/d3b 39 2024-04-26T21:08:21.909 INFO:tasks.workunit.client.1.smithi064.stdout:0/942: truncate dd/d21/dc8/d31/d43/fa6 53533 0 2024-04-26T21:08:21.910 INFO:tasks.workunit.client.0.smithi055.stdout:5/616: dwrite d4/df/d13/d26/f7e [0,4194304] 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.1.smithi064.stdout:3/969: symlink d1/d27/d50/d35/d4c/d7b/l153 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.1.smithi064.stdout:3/970: write d1/d14/f6a [3251645,41329] 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.1.smithi064.stdout:3/971: truncate d1/d27/d50/d35/d4c/d7b/fdc 380718 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.1.smithi064.stdout:3/972: creat d1/d27/d29/d6f/f154 x:0 0 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.0.smithi055.stdout:1/738: creat d8/d94/de7/ff8 x:0 0 0 2024-04-26T21:08:21.914 INFO:tasks.workunit.client.0.smithi055.stdout:1/739: readlink d8/d17/d6a/la5 0 2024-04-26T21:08:21.918 INFO:tasks.workunit.client.0.smithi055.stdout:0/773: rename d9/dc/d1c/d3e/dc5/dcc/db2/fe7 to d9/d27/daf/ff2 0 2024-04-26T21:08:21.921 INFO:tasks.workunit.client.0.smithi055.stdout:7/741: creat d5/d53/d6e/d99/d7f/fe9 x:0 0 0 2024-04-26T21:08:21.923 INFO:tasks.workunit.client.1.smithi064.stdout:5/928: rename dd/da9/d48/d6a/d9e/db9/ffe to dd/d12/d4f/da5/f124 0 2024-04-26T21:08:21.926 INFO:tasks.workunit.client.0.smithi055.stdout:5/617: dread d4/df/dae/dce/d4a/fca [0,4194304] 0 2024-04-26T21:08:21.926 INFO:tasks.workunit.client.0.smithi055.stdout:1/740: mkdir d8/d17/d1b/d7b/d8d/df9 0 2024-04-26T21:08:21.928 INFO:tasks.workunit.client.1.smithi064.stdout:5/929: write dd/da9/d48/d6a/d81/fb8 [184850,109464] 0 2024-04-26T21:08:21.928 INFO:tasks.workunit.client.1.smithi064.stdout:5/930: dread - dd/d12/d18/d1a/d1f/fff zero size 2024-04-26T21:08:21.931 INFO:tasks.workunit.client.0.smithi055.stdout:0/774: link d9/dc/d17/ceb d9/dab/cf3 0 2024-04-26T21:08:21.931 INFO:tasks.workunit.client.0.smithi055.stdout:0/775: fdatasync d9/dc/d19/ddb/db6/d67/f88 0 2024-04-26T21:08:21.931 INFO:tasks.workunit.client.0.smithi055.stdout:0/776: write d9/dc/d1c/d3b/f60 [817675,127503] 0 2024-04-26T21:08:21.932 INFO:tasks.workunit.client.1.smithi064.stdout:9/956: rename d0/d4/da/d31/f82 to d0/d4/da/d67/dd0/df2/f134 0 2024-04-26T21:08:21.934 INFO:tasks.workunit.client.1.smithi064.stdout:9/957: creat d0/d4/da/d26/d5d/f135 x:0 0 0 2024-04-26T21:08:21.936 INFO:tasks.workunit.client.0.smithi055.stdout:3/792: dwrite d0/de/fbc [0,4194304] 0 2024-04-26T21:08:21.936 INFO:tasks.workunit.client.0.smithi055.stdout:0/777: rename d9/dc/d1c/d3e/d7d/dc1/ldf to d9/dc/d1c/lf4 0 2024-04-26T21:08:21.945 INFO:tasks.workunit.client.1.smithi064.stdout:3/973: rename d1/d38/f6c to d1/d27/d50/f155 0 2024-04-26T21:08:21.945 INFO:tasks.workunit.client.1.smithi064.stdout:3/974: chown d1/d27/l69 119 1 2024-04-26T21:08:21.950 INFO:tasks.workunit.client.1.smithi064.stdout:5/931: write dd/d12/d18/d1a/d1f/f24 [1764919,105192] 0 2024-04-26T21:08:21.952 INFO:tasks.workunit.client.1.smithi064.stdout:5/932: write dd/d12/d18/d25/d32/f5d [94120,48611] 0 2024-04-26T21:08:21.952 INFO:tasks.workunit.client.1.smithi064.stdout:3/975: creat d1/d27/d50/d35/d4c/d7b/dcd/d126/f156 x:0 0 0 2024-04-26T21:08:21.953 INFO:tasks.workunit.client.0.smithi055.stdout:3/793: rmdir d0/d4/d5/d73/d13/d1a/d46/d72/dd5 39 2024-04-26T21:08:21.953 INFO:tasks.workunit.client.0.smithi055.stdout:3/794: write d0/d4/d5/d73/d47/d37/de7/ff8 [252678,87694] 0 2024-04-26T21:08:21.956 INFO:tasks.workunit.client.0.smithi055.stdout:1/741: dread d8/d17/d33/f34 [0,4194304] 0 2024-04-26T21:08:21.957 INFO:tasks.workunit.client.1.smithi064.stdout:3/976: mknod d1/d27/d29/d6f/d72/da5/d7d/d8a/c157 0 2024-04-26T21:08:21.960 INFO:tasks.workunit.client.0.smithi055.stdout:7/742: write d5/d53/d6e/f6b [206703,30799] 0 2024-04-26T21:08:21.961 INFO:tasks.workunit.client.1.smithi064.stdout:9/958: dread d0/d4/da/d26/f23 [0,4194304] 0 2024-04-26T21:08:21.961 INFO:tasks.workunit.client.1.smithi064.stdout:3/977: link d1/d27/d29/d6f/d72/da5/d7d/d8d/c112 d1/d27/d29/d6f/d72/d95/dd9/c158 0 2024-04-26T21:08:21.961 INFO:tasks.workunit.client.1.smithi064.stdout:3/978: fdatasync d1/d27/d29/d5e/f6d 0 2024-04-26T21:08:21.961 INFO:tasks.workunit.client.1.smithi064.stdout:3/979: dread - d1/d27/d29/d6f/f154 zero size 2024-04-26T21:08:21.961 INFO:tasks.workunit.client.1.smithi064.stdout:3/980: write d1/d27/d29/d6f/d72/d73/fef [273487,93804] 0 2024-04-26T21:08:21.962 INFO:tasks.workunit.client.0.smithi055.stdout:1/742: truncate d8/d17/d1b/d41/fee 468074 0 2024-04-26T21:08:21.963 INFO:tasks.workunit.client.1.smithi064.stdout:3/981: read d1/d27/d29/d6f/d72/d73/f10a [82224,75283] 0 2024-04-26T21:08:21.963 INFO:tasks.workunit.client.1.smithi064.stdout:3/982: stat d1/d27/d50/f21 0 2024-04-26T21:08:21.963 INFO:tasks.workunit.client.0.smithi055.stdout:7/743: symlink d5/d11/d8c/lea 0 2024-04-26T21:08:21.964 INFO:tasks.workunit.client.1.smithi064.stdout:3/983: creat d1/d27/d29/d9d/df8/f159 x:0 0 0 2024-04-26T21:08:21.968 INFO:tasks.workunit.client.1.smithi064.stdout:0/943: dwrite dd/f2a [0,4194304] 0 2024-04-26T21:08:21.970 INFO:tasks.workunit.client.0.smithi055.stdout:7/744: mkdir d5/d6/d39/deb 0 2024-04-26T21:08:21.970 INFO:tasks.workunit.client.0.smithi055.stdout:7/745: fdatasync d5/d53/d6e/d99/d75/fb3 0 2024-04-26T21:08:21.970 INFO:tasks.workunit.client.1.smithi064.stdout:0/944: mkdir dd/d21/dd9/d143 0 2024-04-26T21:08:21.971 INFO:tasks.workunit.client.1.smithi064.stdout:5/933: write dd/da9/d63/f84 [490571,51203] 0 2024-04-26T21:08:21.977 INFO:tasks.workunit.client.0.smithi055.stdout:5/618: dwrite d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fa4 [0,4194304] 0 2024-04-26T21:08:21.980 INFO:tasks.workunit.client.1.smithi064.stdout:5/934: mkdir dd/d12/d4f/da5/d125 0 2024-04-26T21:08:21.981 INFO:tasks.workunit.client.1.smithi064.stdout:0/945: getdents dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d42 0 2024-04-26T21:08:21.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/959: write d0/d4/da/d26/d47/d9d/fd5 [2499911,15442] 0 2024-04-26T21:08:21.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/960: stat d0/d4/da/d26/d5e/f9b 0 2024-04-26T21:08:21.981 INFO:tasks.workunit.client.1.smithi064.stdout:9/961: creat d0/d4/da/d26/d5d/f136 x:0 0 0 2024-04-26T21:08:21.982 INFO:tasks.workunit.client.0.smithi055.stdout:9/779: sync 2024-04-26T21:08:21.984 INFO:tasks.workunit.client.1.smithi064.stdout:5/935: rmdir dd/d12/d18/d25/d74 39 2024-04-26T21:08:21.985 INFO:tasks.workunit.client.0.smithi055.stdout:5/619: unlink d4/df/d13/l99 0 2024-04-26T21:08:21.985 INFO:tasks.workunit.client.0.smithi055.stdout:9/780: readlink d2/d46/d77/l74 0 2024-04-26T21:08:21.986 INFO:tasks.workunit.client.0.smithi055.stdout:1/743: dread d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:21.988 INFO:tasks.workunit.client.0.smithi055.stdout:9/781: creat d2/d46/d9a/d105/d97/dd7/f10e x:0 0 0 2024-04-26T21:08:21.991 INFO:tasks.workunit.client.0.smithi055.stdout:1/744: mkdir d8/d94/de7/dfa 0 2024-04-26T21:08:21.993 INFO:tasks.workunit.client.1.smithi064.stdout:5/936: dread dd/d12/d18/f2b [0,4194304] 0 2024-04-26T21:08:21.994 INFO:tasks.workunit.client.0.smithi055.stdout:9/782: mkdir d2/d46/d9a/d105/d97/d9b/d10f 0 2024-04-26T21:08:21.996 INFO:tasks.workunit.client.1.smithi064.stdout:0/946: rmdir dd/d21/dc8/d31/d47/dad/dfd/d18/d64/d131 0 2024-04-26T21:08:21.996 INFO:tasks.workunit.client.1.smithi064.stdout:0/947: stat dd/d21/dc8/d31/d47/dad/dfd/d74/d132 0 2024-04-26T21:08:21.997 INFO:tasks.workunit.client.0.smithi055.stdout:1/745: creat d8/d17/d33/dc5/ffb x:0 0 0 2024-04-26T21:08:21.998 INFO:tasks.workunit.client.0.smithi055.stdout:1/746: chown d8/d17/d1b/d7b/d8d/ff5 1 1 2024-04-26T21:08:21.998 INFO:tasks.workunit.client.0.smithi055.stdout:1/747: dread - d8/d94/fd6 zero size 2024-04-26T21:08:21.998 INFO:tasks.workunit.client.0.smithi055.stdout:1/748: dread - d8/d17/d1b/d7b/d65/fa0 zero size 2024-04-26T21:08:22.002 INFO:tasks.workunit.client.0.smithi055.stdout:9/783: creat d2/d46/d9a/d105/d97/d9b/d10f/f110 x:0 0 0 2024-04-26T21:08:22.002 INFO:tasks.workunit.client.0.smithi055.stdout:9/784: chown d2/d46/d51/cae 30150 1 2024-04-26T21:08:22.002 INFO:tasks.workunit.client.0.smithi055.stdout:9/785: dread - d2/d11/ff2 zero size 2024-04-26T21:08:22.003 INFO:tasks.workunit.client.0.smithi055.stdout:9/786: write d2/d46/d77/f76 [4808647,128225] 0 2024-04-26T21:08:22.003 INFO:tasks.workunit.client.0.smithi055.stdout:9/787: chown d2/d46/d9a/fc3 3344412 1 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/962: mkdir d0/d4/d28/d137 0 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/963: truncate d0/d4/d7/df/f32 4975462 0 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/964: readlink d0/d4/d7/l86 0 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/965: truncate d0/d4/f9e 421244 0 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/966: dread - d0/d4/d28/d4f/f10f zero size 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:9/967: readlink d0/d4/d7/df/l48 0 2024-04-26T21:08:22.004 INFO:tasks.workunit.client.1.smithi064.stdout:0/948: dread dd/d21/dc8/f9c [0,4194304] 0 2024-04-26T21:08:22.006 INFO:tasks.workunit.client.1.smithi064.stdout:5/937: stat dd/d12/d4f/d9c/da1/l121 0 2024-04-26T21:08:22.008 INFO:tasks.workunit.client.0.smithi055.stdout:0/778: dwrite d9/dc/d1c/f4f [0,4194304] 0 2024-04-26T21:08:22.008 INFO:tasks.workunit.client.0.smithi055.stdout:1/749: mkdir d8/d17/d33/dfc 0 2024-04-26T21:08:22.012 INFO:tasks.workunit.client.0.smithi055.stdout:5/620: dread d4/df/d13/f95 [0,4194304] 0 2024-04-26T21:08:22.014 INFO:tasks.workunit.client.0.smithi055.stdout:9/788: mkdir d2/d46/d9a/d105/db8/d111 0 2024-04-26T21:08:22.014 INFO:tasks.workunit.client.0.smithi055.stdout:9/789: write d2/d46/d9a/d105/f47 [204066,93581] 0 2024-04-26T21:08:22.018 INFO:tasks.workunit.client.1.smithi064.stdout:9/968: mknod d0/d4/da/d31/d34/c138 0 2024-04-26T21:08:22.018 INFO:tasks.workunit.client.1.smithi064.stdout:9/969: write d0/d39/f114 [997975,6352] 0 2024-04-26T21:08:22.025 INFO:tasks.workunit.client.1.smithi064.stdout:0/949: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/f70 132300 0 2024-04-26T21:08:22.025 INFO:tasks.workunit.client.1.smithi064.stdout:0/950: fsync dd/d21/dc8/d31/f41 0 2024-04-26T21:08:22.026 INFO:tasks.workunit.client.0.smithi055.stdout:7/746: dwrite d5/d53/d6e/d99/d58/f5f [0,4194304] 0 2024-04-26T21:08:22.035 INFO:tasks.workunit.client.1.smithi064.stdout:5/938: creat dd/dd0/d115/f126 x:0 0 0 2024-04-26T21:08:22.036 INFO:tasks.workunit.client.0.smithi055.stdout:5/621: dread d4/df/dae/dce/d5b/f70 [0,4194304] 0 2024-04-26T21:08:22.036 INFO:tasks.workunit.client.1.smithi064.stdout:9/970: truncate d0/d4/da/d31/fc0 1488437 0 2024-04-26T21:08:22.036 INFO:tasks.workunit.client.1.smithi064.stdout:9/971: dread - d0/d4/da/d26/d45/d90/fb2 zero size 2024-04-26T21:08:22.044 INFO:tasks.workunit.client.1.smithi064.stdout:0/951: mkdir dd/d21/dc8/d31/d47/d144 0 2024-04-26T21:08:22.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/747: mknod d5/d53/d6e/d99/d7f/d6f/da8/cec 0 2024-04-26T21:08:22.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/748: write d5/f9b [908818,94942] 0 2024-04-26T21:08:22.049 INFO:tasks.workunit.client.0.smithi055.stdout:7/749: rename d5/d53/d6e/d99/d7f/d6f to d5/d53/d6e/d99/d7f/d6f/da5/ded 22 2024-04-26T21:08:22.051 INFO:tasks.workunit.client.0.smithi055.stdout:5/622: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8 0 2024-04-26T21:08:22.051 INFO:tasks.workunit.client.0.smithi055.stdout:5/623: stat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e 0 2024-04-26T21:08:22.065 INFO:tasks.workunit.client.1.smithi064.stdout:5/939: creat dd/d12/d18/d25/f127 x:0 0 0 2024-04-26T21:08:22.073 INFO:tasks.workunit.client.0.smithi055.stdout:3/795: dwrite d0/d4/d5/f36 [0,4194304] 0 2024-04-26T21:08:22.122 INFO:tasks.workunit.client.0.smithi055.stdout:3/796: link d0/d4/d5/d73/d13/d27/d50/cb6 d0/d4/d5/d73/d47/d37/de8/c112 0 2024-04-26T21:08:22.127 INFO:tasks.workunit.client.0.smithi055.stdout:9/790: dwrite d2/d46/d9a/d105/f4f [0,4194304] 0 2024-04-26T21:08:22.130 INFO:tasks.workunit.client.0.smithi055.stdout:1/750: dwrite d8/df/d11/d27/fb7 [0,4194304] 0 2024-04-26T21:08:22.130 INFO:tasks.workunit.client.1.smithi064.stdout:6/948: sync 2024-04-26T21:08:22.130 INFO:tasks.workunit.client.1.smithi064.stdout:8/871: sync 2024-04-26T21:08:22.130 INFO:tasks.workunit.client.1.smithi064.stdout:8/872: read - d10/fcd zero size 2024-04-26T21:08:22.135 INFO:tasks.workunit.client.1.smithi064.stdout:6/949: link d4/d7/l40 d4/d7/d12/d49/d4b/d5a/l140 0 2024-04-26T21:08:22.137 INFO:tasks.workunit.client.0.smithi055.stdout:7/750: dwrite d5/d53/d6e/d99/d58/f88 [0,4194304] 0 2024-04-26T21:08:22.139 INFO:tasks.workunit.client.1.smithi064.stdout:6/950: write d4/d7/d12/d49/d4b/d56/dcf/f13c [290397,73059] 0 2024-04-26T21:08:22.139 INFO:tasks.workunit.client.1.smithi064.stdout:6/951: readlink d4/d7/l19 0 2024-04-26T21:08:22.139 INFO:tasks.workunit.client.1.smithi064.stdout:8/873: creat d10/d41/d53/d104/f10c x:0 0 0 2024-04-26T21:08:22.139 INFO:tasks.workunit.client.0.smithi055.stdout:1/751: getdents d8/d17/d1b 0 2024-04-26T21:08:22.142 INFO:tasks.workunit.client.0.smithi055.stdout:7/751: symlink d5/d53/d6e/d6c/lee 0 2024-04-26T21:08:22.143 INFO:tasks.workunit.client.0.smithi055.stdout:7/752: mkdir d5/d6/d24/d4d/da7/dab/dce/de7/def 0 2024-04-26T21:08:22.144 INFO:tasks.workunit.client.0.smithi055.stdout:7/753: symlink d5/d11/lf0 0 2024-04-26T21:08:22.146 INFO:tasks.workunit.client.0.smithi055.stdout:4/608: sync 2024-04-26T21:08:22.147 INFO:tasks.workunit.client.0.smithi055.stdout:8/617: sync 2024-04-26T21:08:22.147 INFO:tasks.workunit.client.0.smithi055.stdout:2/853: sync 2024-04-26T21:08:22.147 INFO:tasks.workunit.client.0.smithi055.stdout:8/618: write d3/dc0/fae [22893,67438] 0 2024-04-26T21:08:22.147 INFO:tasks.workunit.client.0.smithi055.stdout:4/609: write d4/d26/d42/d28/d53/d71/d7f/da1/fb6 [1037917,121797] 0 2024-04-26T21:08:22.148 INFO:tasks.workunit.client.1.smithi064.stdout:6/952: dread d4/d7/f3b [0,4194304] 0 2024-04-26T21:08:22.150 INFO:tasks.workunit.client.1.smithi064.stdout:9/972: dwrite d0/d4/da/d26/d5e/f69 [0,4194304] 0 2024-04-26T21:08:22.150 INFO:tasks.workunit.client.1.smithi064.stdout:8/874: dread f4 [4194304,4194304] 0 2024-04-26T21:08:22.150 INFO:tasks.workunit.client.0.smithi055.stdout:2/854: rmdir d4/dc 39 2024-04-26T21:08:22.150 INFO:tasks.workunit.client.0.smithi055.stdout:2/855: dread - d4/d14/f35 zero size 2024-04-26T21:08:22.150 INFO:tasks.workunit.client.0.smithi055.stdout:1/752: dread d8/df/d11/d27/fc2 [0,4194304] 0 2024-04-26T21:08:22.151 INFO:tasks.workunit.client.1.smithi064.stdout:5/940: dwrite dd/d12/d9a/fe7 [0,4194304] 0 2024-04-26T21:08:22.151 INFO:tasks.workunit.client.1.smithi064.stdout:5/941: chown dd/da9/d48/d56 96 1 2024-04-26T21:08:22.154 INFO:tasks.workunit.client.0.smithi055.stdout:0/779: dwrite d9/dc/d1c/d3e/dc5/dcc/d9c/fe2 [0,4194304] 0 2024-04-26T21:08:22.154 INFO:tasks.workunit.client.0.smithi055.stdout:0/780: readlink d9/d11/l99 0 2024-04-26T21:08:22.155 INFO:tasks.workunit.client.0.smithi055.stdout:8/619: write d3/d9/d1d/d48/d57/f6f [1113687,55365] 0 2024-04-26T21:08:22.155 INFO:tasks.workunit.client.0.smithi055.stdout:3/797: write d0/d4/d5/d73/d13/fe6 [1127042,93886] 0 2024-04-26T21:08:22.155 INFO:tasks.workunit.client.0.smithi055.stdout:3/798: chown d0/d4/d5/d73/d47/d37/d3d 24 1 2024-04-26T21:08:22.155 INFO:tasks.workunit.client.0.smithi055.stdout:0/781: write d9/dc/d19/ddb/dbd/fd0 [51705,112571] 0 2024-04-26T21:08:22.156 INFO:tasks.workunit.client.0.smithi055.stdout:9/791: dread d2/d46/d9a/d105/f59 [0,4194304] 0 2024-04-26T21:08:22.164 INFO:tasks.workunit.client.1.smithi064.stdout:9/973: unlink d0/d4/da/d26/d47/d88/l95 0 2024-04-26T21:08:22.171 INFO:tasks.workunit.client.0.smithi055.stdout:0/782: dread d9/dc/d17/d9a/fad [0,4194304] 0 2024-04-26T21:08:22.171 INFO:tasks.workunit.client.1.smithi064.stdout:3/984: sync 2024-04-26T21:08:22.171 INFO:tasks.workunit.client.1.smithi064.stdout:3/985: creat d1/d27/d29/d6f/d72/d7a/d121/f15a x:0 0 0 2024-04-26T21:08:22.172 INFO:tasks.workunit.client.1.smithi064.stdout:3/986: write d1/d27/d29/d5e/f142 [925917,62451] 0 2024-04-26T21:08:22.172 INFO:tasks.workunit.client.1.smithi064.stdout:3/987: truncate d1/d27/d29/d9d/df8/f159 965325 0 2024-04-26T21:08:22.174 INFO:tasks.workunit.client.1.smithi064.stdout:5/942: mknod dd/d12/c128 0 2024-04-26T21:08:22.175 INFO:tasks.workunit.client.0.smithi055.stdout:8/620: mkdir d3/d9/d1d/d48/d80/dce 0 2024-04-26T21:08:22.175 INFO:tasks.workunit.client.0.smithi055.stdout:6/746: sync 2024-04-26T21:08:22.178 INFO:tasks.workunit.client.0.smithi055.stdout:3/799: rmdir d0/d4/d5/d73/d47/d37 39 2024-04-26T21:08:22.180 INFO:tasks.workunit.client.1.smithi064.stdout:5/943: getdents dd/da9/d48/d6a/d9e/db9/de6 0 2024-04-26T21:08:22.181 INFO:tasks.workunit.client.0.smithi055.stdout:6/747: unlink d3/d17/d46/d109/d66/d6a/d51/d58/d6d/f98 0 2024-04-26T21:08:22.181 INFO:tasks.workunit.client.0.smithi055.stdout:6/748: chown d3/d17/d46/d109/d66/d6a/d51/d58/cdc 521063 1 2024-04-26T21:08:22.183 INFO:tasks.workunit.client.1.smithi064.stdout:8/875: rename d10/d41/d4e/d59/d83 to d10/d10d 0 2024-04-26T21:08:22.183 INFO:tasks.workunit.client.1.smithi064.stdout:8/876: creat d10/d41/d44/f10e x:0 0 0 2024-04-26T21:08:22.184 INFO:tasks.workunit.client.0.smithi055.stdout:0/783: dread d9/dc/d17/d9a/fad [0,4194304] 0 2024-04-26T21:08:22.184 INFO:tasks.workunit.client.1.smithi064.stdout:8/877: creat d10/d2f/d61/f10f x:0 0 0 2024-04-26T21:08:22.184 INFO:tasks.workunit.client.0.smithi055.stdout:8/621: getdents d3/dc0 0 2024-04-26T21:08:22.187 INFO:tasks.workunit.client.1.smithi064.stdout:9/974: write d0/d4/da/d26/d5e/f69 [287519,76592] 0 2024-04-26T21:08:22.188 INFO:tasks.workunit.client.1.smithi064.stdout:5/944: unlink dd/da9/d48/d6a/f11a 0 2024-04-26T21:08:22.193 INFO:tasks.workunit.client.0.smithi055.stdout:0/784: creat d9/d11/d5b/d74/ff5 x:0 0 0 2024-04-26T21:08:22.199 INFO:tasks.workunit.client.1.smithi064.stdout:0/952: sync 2024-04-26T21:08:22.199 INFO:tasks.workunit.client.1.smithi064.stdout:0/953: write dd/d21/dc8/d31/d47/dad/dfd/f2e [786886,57112] 0 2024-04-26T21:08:22.203 INFO:tasks.workunit.client.0.smithi055.stdout:6/749: write d3/d17/f81 [2059129,1853] 0 2024-04-26T21:08:22.203 INFO:tasks.workunit.client.0.smithi055.stdout:3/800: write d0/de/fbc [1652337,100530] 0 2024-04-26T21:08:22.203 INFO:tasks.workunit.client.0.smithi055.stdout:3/801: creat d0/d4/d5/db8/f113 x:0 0 0 2024-04-26T21:08:22.203 INFO:tasks.workunit.client.0.smithi055.stdout:3/802: creat d0/d4/d5/d73/d13/d27/d3b/f114 x:0 0 0 2024-04-26T21:08:22.205 INFO:tasks.workunit.client.0.smithi055.stdout:8/622: getdents d3 0 2024-04-26T21:08:22.210 INFO:tasks.workunit.client.1.smithi064.stdout:9/975: creat d0/d4/da/d26/d5e/dee/f139 x:0 0 0 2024-04-26T21:08:22.210 INFO:tasks.workunit.client.1.smithi064.stdout:9/976: chown d0/d4/da/d26/d47/d88/lc8 40092 1 2024-04-26T21:08:22.210 INFO:tasks.workunit.client.1.smithi064.stdout:9/977: chown d0/d4/da/l6e 2 1 2024-04-26T21:08:22.210 INFO:tasks.workunit.client.1.smithi064.stdout:9/978: read - d0/d4/d28/fe1 zero size 2024-04-26T21:08:22.215 INFO:tasks.workunit.client.0.smithi055.stdout:3/803: getdents d0/d4/d5/d73 0 2024-04-26T21:08:22.220 INFO:tasks.workunit.client.0.smithi055.stdout:8/623: creat d3/d9/d5b/da4/dc5/fcf x:0 0 0 2024-04-26T21:08:22.220 INFO:tasks.workunit.client.1.smithi064.stdout:9/979: creat d0/d4/da/d26/d47/d9d/d76/f13a x:0 0 0 2024-04-26T21:08:22.220 INFO:tasks.workunit.client.1.smithi064.stdout:9/980: dread - d0/d4/d28/d4f/fbe zero size 2024-04-26T21:08:22.221 INFO:tasks.workunit.client.1.smithi064.stdout:9/981: read - d0/d4/da/da3/feb zero size 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:0/785: dread d9/dc/f10 [0,4194304] 0 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:0/786: fsync d9/dc/f8f 0 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/804: rmdir d0/d4/d5/d73/d13/d1a/def 0 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/805: write d0/d4/d16/f70 [2429811,32919] 0 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/806: rename d0/d4/d5/d73/d47/d37/da6 to d0/d4/d5/d73/d47/d37/da6/d115 22 2024-04-26T21:08:22.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/807: chown d0/f22 436 1 2024-04-26T21:08:22.224 INFO:tasks.workunit.client.0.smithi055.stdout:2/856: dwrite d4/db/d56/f11e [0,4194304] 0 2024-04-26T21:08:22.224 INFO:tasks.workunit.client.0.smithi055.stdout:2/857: read - d4/dc/db6/f117 zero size 2024-04-26T21:08:22.225 INFO:tasks.workunit.client.0.smithi055.stdout:2/858: readlink d4/d1e/d2a/l8e 0 2024-04-26T21:08:22.225 INFO:tasks.workunit.client.0.smithi055.stdout:2/859: dread - d4/d14/d17/d6d/f77 zero size 2024-04-26T21:08:22.226 INFO:tasks.workunit.client.1.smithi064.stdout:9/982: creat d0/d4/da/d31/dc2/f13b x:0 0 0 2024-04-26T21:08:22.226 INFO:tasks.workunit.client.0.smithi055.stdout:9/792: dwrite d2/d46/d9a/d105/f9f [0,4194304] 0 2024-04-26T21:08:22.227 INFO:tasks.workunit.client.0.smithi055.stdout:3/808: unlink d0/d4/d16/d18/d4b/c61 0 2024-04-26T21:08:22.228 INFO:tasks.workunit.client.1.smithi064.stdout:9/983: mkdir d0/d4/d28/ddb/d11e/d13c 0 2024-04-26T21:08:22.228 INFO:tasks.workunit.client.0.smithi055.stdout:0/787: symlink d9/dc/d17/d9a/lf6 0 2024-04-26T21:08:22.228 INFO:tasks.workunit.client.0.smithi055.stdout:0/788: chown d9/dc/d1c/d3e/d7d/da3/dca 861988 1 2024-04-26T21:08:22.231 INFO:tasks.workunit.client.0.smithi055.stdout:9/793: creat d2/d11/df5/df9/f112 x:0 0 0 2024-04-26T21:08:22.231 INFO:tasks.workunit.client.0.smithi055.stdout:8/624: symlink d3/ld0 0 2024-04-26T21:08:22.231 INFO:tasks.workunit.client.0.smithi055.stdout:9/794: creat d2/d46/d51/f113 x:0 0 0 2024-04-26T21:08:22.233 INFO:tasks.workunit.client.0.smithi055.stdout:3/809: link d0/c9a d0/d4/d5/d73/d47/dcf/c116 0 2024-04-26T21:08:22.236 INFO:tasks.workunit.client.0.smithi055.stdout:9/795: symlink d2/d46/d77/d7d/da0/l114 0 2024-04-26T21:08:22.236 INFO:tasks.workunit.client.0.smithi055.stdout:3/810: mknod d0/d4/d5/d73/d13/d27/ddb/c117 0 2024-04-26T21:08:22.242 INFO:tasks.workunit.client.0.smithi055.stdout:9/796: mknod d2/d46/d9a/d105/db8/c115 0 2024-04-26T21:08:22.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/811: dread d0/d4/d5/d73/d13/d1a/d46/d55/f59 [0,4194304] 0 2024-04-26T21:08:22.250 INFO:tasks.workunit.client.0.smithi055.stdout:3/812: write d0/d4/d16/d18/d4b/d57/d8e/de0/fe3 [922770,56346] 0 2024-04-26T21:08:22.259 INFO:tasks.workunit.client.0.smithi055.stdout:2/860: read d4/db/d56/d4a/d7e/f91 [294385,67749] 0 2024-04-26T21:08:22.263 INFO:tasks.workunit.client.0.smithi055.stdout:3/813: creat d0/d4/df6/f118 x:0 0 0 2024-04-26T21:08:22.264 INFO:tasks.workunit.client.0.smithi055.stdout:1/753: dwrite d8/df/d11/d27/fb7 [0,4194304] 0 2024-04-26T21:08:22.264 INFO:tasks.workunit.client.0.smithi055.stdout:1/754: write d8/d17/d1b/d7b/d8d/ff5 [206170,123912] 0 2024-04-26T21:08:22.265 INFO:tasks.workunit.client.1.smithi064.stdout:0/954: dwrite dd/fdc [0,4194304] 0 2024-04-26T21:08:22.265 INFO:tasks.workunit.client.1.smithi064.stdout:0/955: truncate dd/df6/ff7 462404 0 2024-04-26T21:08:22.266 INFO:tasks.workunit.client.0.smithi055.stdout:9/797: rmdir d2/d46/d77 39 2024-04-26T21:08:22.269 INFO:tasks.workunit.client.1.smithi064.stdout:3/988: dwrite d1/d27/d50/f74 [0,4194304] 0 2024-04-26T21:08:22.269 INFO:tasks.workunit.client.1.smithi064.stdout:5/945: dwrite dd/d12/d18/d1a/d1f/d20/f47 [8388608,4194304] 0 2024-04-26T21:08:22.273 INFO:tasks.workunit.client.0.smithi055.stdout:3/814: mknod d0/d4/d5/db8/dfd/c119 0 2024-04-26T21:08:22.275 INFO:tasks.workunit.client.0.smithi055.stdout:1/755: truncate d8/df/d11/d27/fc3 3442958 0 2024-04-26T21:08:22.278 INFO:tasks.workunit.client.0.smithi055.stdout:9/798: creat d2/d46/d9a/d105/d97/f116 x:0 0 0 2024-04-26T21:08:22.278 INFO:tasks.workunit.client.0.smithi055.stdout:9/799: stat d2/d46/d9a/d105/f59 0 2024-04-26T21:08:22.282 INFO:tasks.workunit.client.0.smithi055.stdout:3/815: mknod d0/d4/d5/d73/d13/d1a/c11a 0 2024-04-26T21:08:22.285 INFO:tasks.workunit.client.0.smithi055.stdout:1/756: symlink d8/d17/d1b/d7b/d8d/lfd 0 2024-04-26T21:08:22.286 INFO:tasks.workunit.client.0.smithi055.stdout:1/757: chown d8/d17/d1b/d7b/d8d/f79 0 1 2024-04-26T21:08:22.286 INFO:tasks.workunit.client.0.smithi055.stdout:1/758: fsync d8/d94/de7/ff8 0 2024-04-26T21:08:22.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/956: dread dd/d21/dc8/d31/d47/dad/dfd/d74/f80 [0,4194304] 0 2024-04-26T21:08:22.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/957: truncate dd/f137 195909 0 2024-04-26T21:08:22.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/958: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/db1/ff8 526398 0 2024-04-26T21:08:22.287 INFO:tasks.workunit.client.1.smithi064.stdout:0/959: write dd/fc9 [478318,16441] 0 2024-04-26T21:08:22.288 INFO:tasks.workunit.client.0.smithi055.stdout:9/800: symlink d2/d46/d9a/d105/d97/d9b/d10f/l117 0 2024-04-26T21:08:22.288 INFO:tasks.workunit.client.1.smithi064.stdout:3/989: unlink d1/d14/l2b 0 2024-04-26T21:08:22.291 INFO:tasks.workunit.client.1.smithi064.stdout:5/946: unlink dd/fda 0 2024-04-26T21:08:22.295 INFO:tasks.workunit.client.0.smithi055.stdout:9/801: mknod d2/d46/d9a/d105/d97/d9b/d10f/c118 0 2024-04-26T21:08:22.295 INFO:tasks.workunit.client.0.smithi055.stdout:9/802: write d2/d46/d9a/d105/f80 [765058,104127] 0 2024-04-26T21:08:22.296 INFO:tasks.workunit.client.1.smithi064.stdout:0/960: creat dd/d21/db8/f145 x:0 0 0 2024-04-26T21:08:22.296 INFO:tasks.workunit.client.0.smithi055.stdout:9/803: rename d2/d46/d9a/d105/f9f to d2/d46/d77/d7d/dbf/f119 0 2024-04-26T21:08:22.299 INFO:tasks.workunit.client.0.smithi055.stdout:9/804: truncate d2/f55 244005 0 2024-04-26T21:08:22.303 INFO:tasks.workunit.client.0.smithi055.stdout:1/759: read d8/df/d11/d27/d28/d2a/fc9 [2999379,45545] 0 2024-04-26T21:08:22.305 INFO:tasks.workunit.client.0.smithi055.stdout:1/760: symlink d8/df/d11/d27/d28/d2a/da7/lfe 0 2024-04-26T21:08:22.305 INFO:tasks.workunit.client.0.smithi055.stdout:1/761: chown d8/d17/d1b/d41/c49 1 1 2024-04-26T21:08:22.307 INFO:tasks.workunit.client.0.smithi055.stdout:1/762: symlink d8/df/d11/d27/d28/da4/dbe/lff 0 2024-04-26T21:08:22.307 INFO:tasks.workunit.client.1.smithi064.stdout:3/990: dread d1/d27/d50/d35/fd4 [0,4194304] 0 2024-04-26T21:08:22.311 INFO:tasks.workunit.client.1.smithi064.stdout:6/953: sync 2024-04-26T21:08:22.312 INFO:tasks.workunit.client.1.smithi064.stdout:6/954: creat d4/d7/d12/d1e/dd4/f141 x:0 0 0 2024-04-26T21:08:22.312 INFO:tasks.workunit.client.1.smithi064.stdout:6/955: dread - d4/d7/d12/fd9 zero size 2024-04-26T21:08:22.314 INFO:tasks.workunit.client.0.smithi055.stdout:6/750: dwrite d3/d17/d46/d109/d66/fac [0,4194304] 0 2024-04-26T21:08:22.315 INFO:tasks.workunit.client.1.smithi064.stdout:3/991: mknod d1/d27/d50/c15b 0 2024-04-26T21:08:22.316 INFO:tasks.workunit.client.1.smithi064.stdout:0/961: write dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f38 [422983,39121] 0 2024-04-26T21:08:22.316 INFO:tasks.workunit.client.1.smithi064.stdout:0/962: chown dd/cd8 31 1 2024-04-26T21:08:22.320 INFO:tasks.workunit.client.1.smithi064.stdout:3/992: unlink d1/d27/d29/d6f/d72/da5/d7d/d8a/l134 0 2024-04-26T21:08:22.321 INFO:tasks.workunit.client.0.smithi055.stdout:0/789: dwrite d9/d8b/fe1 [0,4194304] 0 2024-04-26T21:08:22.326 INFO:tasks.workunit.client.1.smithi064.stdout:0/963: rename dd/d21/dc8/d31/c59 to dd/d21/dc8/d31/d47/d139/c146 0 2024-04-26T21:08:22.327 INFO:tasks.workunit.client.1.smithi064.stdout:6/956: getdents d4/d7/d12/d49/d4b/d7d 0 2024-04-26T21:08:22.335 INFO:tasks.workunit.client.1.smithi064.stdout:3/993: rename d1/d27/d29/d6f/d72/d26/fcf to d1/d27/d29/d6f/d72/da5/d7d/df9/f15c 0 2024-04-26T21:08:22.338 INFO:tasks.workunit.client.0.smithi055.stdout:0/790: creat d9/d11/d5b/ff7 x:0 0 0 2024-04-26T21:08:22.339 INFO:tasks.workunit.client.1.smithi064.stdout:0/964: creat dd/d21/dc8/d31/d47/d139/f147 x:0 0 0 2024-04-26T21:08:22.339 INFO:tasks.workunit.client.1.smithi064.stdout:0/965: write dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d42/f120 [575833,47698] 0 2024-04-26T21:08:22.339 INFO:tasks.workunit.client.1.smithi064.stdout:0/966: stat dd/d21/dc8/d31/d47/dad/dfd/c127 0 2024-04-26T21:08:22.347 INFO:tasks.workunit.client.1.smithi064.stdout:3/994: rename d1/d27/d29/d6f/d72/d7a/c14d to d1/d27/d50/d35/d4c/dd1/c15d 0 2024-04-26T21:08:22.365 INFO:tasks.workunit.client.0.smithi055.stdout:2/861: dwrite d4/d14/d17/d36/fac [0,4194304] 0 2024-04-26T21:08:22.378 INFO:tasks.workunit.client.0.smithi055.stdout:1/763: dread d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:22.381 INFO:tasks.workunit.client.0.smithi055.stdout:1/764: rename d8/d17/d33/dcf to d8/d17/d1b/d7b/d8d/df9/d100 0 2024-04-26T21:08:22.388 INFO:tasks.workunit.client.0.smithi055.stdout:1/765: rename d8/d17/d1b/d7b/ce6 to d8/d94/de7/dfa/c101 0 2024-04-26T21:08:22.395 INFO:tasks.workunit.client.0.smithi055.stdout:1/766: mkdir d8/d17/d1b/d7b/d65/d102 0 2024-04-26T21:08:22.406 INFO:tasks.workunit.client.0.smithi055.stdout:9/805: dwrite d2/d11/f3b [0,4194304] 0 2024-04-26T21:08:22.407 INFO:tasks.workunit.client.1.smithi064.stdout:6/957: dwrite d4/d7/d12/d49/d4b/d5a/d8f/d108/f12b [0,4194304] 0 2024-04-26T21:08:22.407 INFO:tasks.workunit.client.1.smithi064.stdout:6/958: write d4/d7/d12/d49/d4b/d56/d95/fcb [262175,60190] 0 2024-04-26T21:08:22.407 INFO:tasks.workunit.client.1.smithi064.stdout:6/959: fsync d4/d7/d12/d49/d4b/dc9/f117 0 2024-04-26T21:08:22.410 INFO:tasks.workunit.client.1.smithi064.stdout:6/960: rmdir d4/d7/d12/d49/d4b/d101 39 2024-04-26T21:08:22.411 INFO:tasks.workunit.client.0.smithi055.stdout:9/806: rmdir d2/d46/d9a/d105/d97/d9b/d10f 39 2024-04-26T21:08:22.412 INFO:tasks.workunit.client.0.smithi055.stdout:2/862: dread d4/db/d26/f4d [0,4194304] 0 2024-04-26T21:08:22.413 INFO:tasks.workunit.client.0.smithi055.stdout:3/816: dwrite d0/d4/d16/f26 [4194304,4194304] 0 2024-04-26T21:08:22.413 INFO:tasks.workunit.client.0.smithi055.stdout:3/817: chown d0/d4/d5/d73/d47/d37/c39 225 1 2024-04-26T21:08:22.413 INFO:tasks.workunit.client.1.smithi064.stdout:6/961: mknod d4/d7/d12/d49/d4b/d5a/d8f/c142 0 2024-04-26T21:08:22.416 INFO:tasks.workunit.client.0.smithi055.stdout:0/791: dwrite d9/dc/d1c/d3e/f47 [0,4194304] 0 2024-04-26T21:08:22.416 INFO:tasks.workunit.client.0.smithi055.stdout:0/792: write d9/dc/d1c/d3e/f6a [163456,32453] 0 2024-04-26T21:08:22.419 INFO:tasks.workunit.client.0.smithi055.stdout:9/807: getdents d2/d46 0 2024-04-26T21:08:22.421 INFO:tasks.workunit.client.1.smithi064.stdout:6/962: symlink d4/d7/d12/d38/de6/l143 0 2024-04-26T21:08:22.428 INFO:tasks.workunit.client.0.smithi055.stdout:2/863: rmdir d4/db/d8f/df8 39 2024-04-26T21:08:22.429 INFO:tasks.workunit.client.0.smithi055.stdout:0/793: symlink d9/dab/lf8 0 2024-04-26T21:08:22.431 INFO:tasks.workunit.client.0.smithi055.stdout:9/808: mknod d2/d46/d9a/d105/c11a 0 2024-04-26T21:08:22.431 INFO:tasks.workunit.client.0.smithi055.stdout:9/809: read - d2/d46/d9a/d105/d97/d9b/f107 zero size 2024-04-26T21:08:22.431 INFO:tasks.workunit.client.0.smithi055.stdout:0/794: symlink d9/d11/d5b/lf9 0 2024-04-26T21:08:22.436 INFO:tasks.workunit.client.1.smithi064.stdout:3/995: dwrite d1/d27/d29/d6f/d72/da5/f44 [0,4194304] 0 2024-04-26T21:08:22.445 INFO:tasks.workunit.client.0.smithi055.stdout:1/767: dwrite d8/f35 [0,4194304] 0 2024-04-26T21:08:22.445 INFO:tasks.workunit.client.0.smithi055.stdout:1/768: creat d8/df/d11/db5/f103 x:0 0 0 2024-04-26T21:08:22.447 INFO:tasks.workunit.client.0.smithi055.stdout:1/769: mkdir d8/df/d11/d27/d28/da4/daa/d104 0 2024-04-26T21:08:22.447 INFO:tasks.workunit.client.0.smithi055.stdout:1/770: chown d8/df/d11/db5/ld0 23 1 2024-04-26T21:08:22.449 INFO:tasks.workunit.client.0.smithi055.stdout:2/864: dread d4/d14/d33/f59 [0,4194304] 0 2024-04-26T21:08:22.466 INFO:tasks.workunit.client.0.smithi055.stdout:1/771: dread d8/df/d11/f37 [0,4194304] 0 2024-04-26T21:08:22.466 INFO:tasks.workunit.client.0.smithi055.stdout:1/772: readlink d8/d17/d33/dc5/l38 0 2024-04-26T21:08:22.486 INFO:tasks.workunit.client.0.smithi055.stdout:3/818: dwrite d0/d4/d16/d18/d4b/d57/d8e/ff5 [0,4194304] 0 2024-04-26T21:08:22.487 INFO:tasks.workunit.client.0.smithi055.stdout:3/819: chown d0/f68 228 1 2024-04-26T21:08:22.487 INFO:tasks.workunit.client.0.smithi055.stdout:3/820: write d0/d4/d5/d73/d13/d1a/d46/d55/f59 [1797149,104597] 0 2024-04-26T21:08:22.487 INFO:tasks.workunit.client.0.smithi055.stdout:3/821: write d0/d4/d5/d73/d13/d1a/d46/d72/f60 [4282560,24345] 0 2024-04-26T21:08:22.490 INFO:tasks.workunit.client.0.smithi055.stdout:3/822: unlink d0/d4/d5/d73/d47/dcf/f5e 0 2024-04-26T21:08:22.491 INFO:tasks.workunit.client.0.smithi055.stdout:3/823: link d0/d4/d5/d73/d13/d1a/d46/l97 d0/d4/d16/l11b 0 2024-04-26T21:08:22.493 INFO:tasks.workunit.client.0.smithi055.stdout:3/824: unlink d0/d4/d16/c1e 0 2024-04-26T21:08:22.493 INFO:tasks.workunit.client.0.smithi055.stdout:3/825: chown d0/d4/d5/d73/d13/d1a/cc5 124918348 1 2024-04-26T21:08:22.498 INFO:tasks.workunit.client.0.smithi055.stdout:3/826: mkdir d0/d4/d11c 0 2024-04-26T21:08:22.499 INFO:tasks.workunit.client.0.smithi055.stdout:3/827: rename d0/d4/d5/d73/d13/d27/c2f to d0/d4/d5/d73/d13/d27/d3b/c11d 0 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:5/947: sync 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:9/984: sync 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:8/878: sync 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:0/967: sync 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:9/985: fsync d0/d4/da/d26/d47/d9d/fe3 0 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:9/986: chown d0/d4/da/d26/d45/fbb 443727491 1 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:9/987: getdents d0/d4/da/d26/d45/d90/d10a 0 2024-04-26T21:08:22.503 INFO:tasks.workunit.client.1.smithi064.stdout:0/968: write dd/d21/dc8/d31/d47/dad/dfd/d18/fc0 [1771159,35754] 0 2024-04-26T21:08:22.504 INFO:tasks.workunit.client.1.smithi064.stdout:9/988: write d0/d4/d28/dff/d103/f115 [860500,117481] 0 2024-04-26T21:08:22.504 INFO:tasks.workunit.client.1.smithi064.stdout:9/989: chown d0/d4/da/d26/d5d/cb1 426 1 2024-04-26T21:08:22.506 INFO:tasks.workunit.client.1.smithi064.stdout:0/969: mknod dd/d21/db8/c148 0 2024-04-26T21:08:22.507 INFO:tasks.workunit.client.1.smithi064.stdout:9/990: unlink d0/d4/da/d26/d47/f4b 0 2024-04-26T21:08:22.508 INFO:tasks.workunit.client.1.smithi064.stdout:3/996: dwrite d1/d27/d29/d6f/d72/da5/f7c [0,4194304] 0 2024-04-26T21:08:22.508 INFO:tasks.workunit.client.1.smithi064.stdout:0/970: creat dd/d21/dc8/d31/d47/d144/f149 x:0 0 0 2024-04-26T21:08:22.510 INFO:tasks.workunit.client.1.smithi064.stdout:0/971: truncate dd/d21/dc8/d31/d47/dad/dfd/d74/f92 4144724 0 2024-04-26T21:08:22.511 INFO:tasks.workunit.client.0.smithi055.stdout:0/795: dwrite d9/dc/f57 [4194304,4194304] 0 2024-04-26T21:08:22.511 INFO:tasks.workunit.client.1.smithi064.stdout:5/948: dread dd/d12/d4f/d9c/da1/fc0 [0,4194304] 0 2024-04-26T21:08:22.512 INFO:tasks.workunit.client.1.smithi064.stdout:0/972: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f14a x:0 0 0 2024-04-26T21:08:22.512 INFO:tasks.workunit.client.1.smithi064.stdout:5/949: stat dd/d12/d4f/c5e 0 2024-04-26T21:08:22.514 INFO:tasks.workunit.client.0.smithi055.stdout:3/828: dread d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad [0,4194304] 0 2024-04-26T21:08:22.515 INFO:tasks.workunit.client.1.smithi064.stdout:5/950: creat dd/da9/d48/d6a/d101/f129 x:0 0 0 2024-04-26T21:08:22.519 INFO:tasks.workunit.client.0.smithi055.stdout:3/829: rename d0/d4/d5/d73/d13/d1a/d46/d55/f96 to d0/d4/d16/d18/d4b/f11e 0 2024-04-26T21:08:22.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/830: write d0/d4/d16/f26 [3542489,76876] 0 2024-04-26T21:08:22.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/831: chown d0/f19 413593 1 2024-04-26T21:08:22.520 INFO:tasks.workunit.client.1.smithi064.stdout:5/951: mkdir dd/d12/d18/d1a/d1f/d117/d12a 0 2024-04-26T21:08:22.522 INFO:tasks.workunit.client.1.smithi064.stdout:8/879: dread d10/d41/d44/d5a/da2/fe8 [0,4194304] 0 2024-04-26T21:08:22.522 INFO:tasks.workunit.client.1.smithi064.stdout:8/880: readlink d10/d1d/d38/l67 0 2024-04-26T21:08:22.527 INFO:tasks.workunit.client.0.smithi055.stdout:3/832: rename d0/d4/d5/d73/d13/d27/d50/d6b/d83/fa0 to d0/d4/d5/d73/d13/d27/d3b/dcd/f11f 0 2024-04-26T21:08:22.527 INFO:tasks.workunit.client.1.smithi064.stdout:9/991: dread d0/f59 [0,4194304] 0 2024-04-26T21:08:22.527 INFO:tasks.workunit.client.1.smithi064.stdout:9/992: chown d0/d4/da/d31/d34/df7/l11a 92203 1 2024-04-26T21:08:22.527 INFO:tasks.workunit.client.1.smithi064.stdout:9/993: fdatasync d0/d4/d28/dff/d103/f106 0 2024-04-26T21:08:22.528 INFO:tasks.workunit.client.1.smithi064.stdout:9/994: fsync d0/d4/d7/df/f5f 0 2024-04-26T21:08:22.528 INFO:tasks.workunit.client.1.smithi064.stdout:9/995: chown d0/d4/da/l1c 3577396 1 2024-04-26T21:08:22.528 INFO:tasks.workunit.client.1.smithi064.stdout:9/996: readlink d0/d4/da/l109 0 2024-04-26T21:08:22.529 INFO:tasks.workunit.client.1.smithi064.stdout:3/997: dread d1/d27/d50/f10 [0,4194304] 0 2024-04-26T21:08:22.530 INFO:tasks.workunit.client.1.smithi064.stdout:5/952: creat dd/da9/d48/dac/d8a/f12b x:0 0 0 2024-04-26T21:08:22.533 INFO:tasks.workunit.client.0.smithi055.stdout:0/796: write d9/dc/d1c/d3e/f6a [16197,23598] 0 2024-04-26T21:08:22.533 INFO:tasks.workunit.client.1.smithi064.stdout:8/881: symlink d10/d2f/d56/d107/l110 0 2024-04-26T21:08:22.533 INFO:tasks.workunit.client.1.smithi064.stdout:8/882: truncate d10/d2f/d90/f101 691828 0 2024-04-26T21:08:22.546 INFO:tasks.workunit.client.0.smithi055.stdout:3/833: dread d0/d4/d5/d73/d13/d27/d50/d6b/fc1 [0,4194304] 0 2024-04-26T21:08:22.547 INFO:tasks.workunit.client.1.smithi064.stdout:3/998: mkdir d1/d27/d29/d9d/df8/d15e 0 2024-04-26T21:08:22.547 INFO:tasks.workunit.client.1.smithi064.stdout:3/999: write d1/d27/d29/d6f/d72/d95/dd9/f149 [211419,16484] 0 2024-04-26T21:08:22.547 INFO:tasks.workunit.client.1.smithi064.stdout:6/963: sync 2024-04-26T21:08:22.547 INFO:tasks.workunit.client.1.smithi064.stdout:6/964: truncate d4/d7/d12/d49/d4b/d7d/d83/d107/d137/fef 767037 0 2024-04-26T21:08:22.549 INFO:tasks.workunit.client.0.smithi055.stdout:2/865: dwrite d4/d14/d33/f42 [0,4194304] 0 2024-04-26T21:08:22.550 INFO:tasks.workunit.client.1.smithi064.stdout:9/997: truncate d0/d4/da/d67/dd0/dd2/f105 663109 0 2024-04-26T21:08:22.554 INFO:tasks.workunit.client.1.smithi064.stdout:9/998: symlink d0/d4/d28/dff/l13d 0 2024-04-26T21:08:22.554 INFO:tasks.workunit.client.1.smithi064.stdout:9/999: chown d0/d4/da/d26/d5d/fa8 2058 1 2024-04-26T21:08:22.555 INFO:tasks.workunit.client.0.smithi055.stdout:1/773: dwrite d8/f31 [0,4194304] 0 2024-04-26T21:08:22.555 INFO:tasks.workunit.client.0.smithi055.stdout:1/774: chown d8/df/d11/d27/d28/d2a/da7/lfe 11504 1 2024-04-26T21:08:22.555 INFO:tasks.workunit.client.0.smithi055.stdout:1/775: creat d8/d94/de7/f105 x:0 0 0 2024-04-26T21:08:22.555 INFO:tasks.workunit.client.0.smithi055.stdout:0/797: dread d9/d11/f46 [0,4194304] 0 2024-04-26T21:08:22.559 INFO:tasks.workunit.client.0.smithi055.stdout:1/776: rename d8/d94/de7/f105 to d8/d94/d9b/f106 0 2024-04-26T21:08:22.561 INFO:tasks.workunit.client.0.smithi055.stdout:0/798: rename d9/dc/d1c/d3e/d7d/f86 to d9/dc/d1c/d3e/ffa 0 2024-04-26T21:08:22.561 INFO:tasks.workunit.client.0.smithi055.stdout:0/799: write d9/d11/d59/f7f [868416,58189] 0 2024-04-26T21:08:22.561 INFO:tasks.workunit.client.0.smithi055.stdout:0/800: fsync d9/dc/d19/ddb/db6/d6c/d7a/f95 0 2024-04-26T21:08:22.562 INFO:tasks.workunit.client.0.smithi055.stdout:0/801: creat d9/ffb x:0 0 0 2024-04-26T21:08:22.593 INFO:tasks.workunit.client.1.smithi064.stdout:5/953: dwrite dd/da9/d48/f7e [0,4194304] 0 2024-04-26T21:08:22.593 INFO:tasks.workunit.client.1.smithi064.stdout:5/954: write dd/dd0/d115/f112 [409717,44920] 0 2024-04-26T21:08:22.593 INFO:tasks.workunit.client.1.smithi064.stdout:5/955: stat dd/da9/d48/f72 0 2024-04-26T21:08:22.596 INFO:tasks.workunit.client.1.smithi064.stdout:5/956: creat dd/da9/d48/d6a/f12c x:0 0 0 2024-04-26T21:08:22.600 INFO:tasks.workunit.client.1.smithi064.stdout:5/957: creat dd/da9/d48/d6a/d9e/db9/f12d x:0 0 0 2024-04-26T21:08:22.601 INFO:tasks.workunit.client.1.smithi064.stdout:0/973: dwrite dd/d21/dc8/d31/d47/dad/dfd/d74/d1d/f6d [0,4194304] 0 2024-04-26T21:08:22.607 INFO:tasks.workunit.client.1.smithi064.stdout:5/958: mkdir dd/da9/d48/d6a/d9e/d12e 0 2024-04-26T21:08:22.607 INFO:tasks.workunit.client.1.smithi064.stdout:5/959: stat dd/d12/d4f/dbd/lcc 0 2024-04-26T21:08:22.610 INFO:tasks.workunit.client.0.smithi055.stdout:0/802: dread d9/dc/d1c/d3e/d7d/da3/fe6 [0,4194304] 0 2024-04-26T21:08:22.614 INFO:tasks.workunit.client.1.smithi064.stdout:0/974: symlink dd/d21/df9/d104/l14b 0 2024-04-26T21:08:22.615 INFO:tasks.workunit.client.0.smithi055.stdout:2/866: dread d4/db/d56/f11e [0,4194304] 0 2024-04-26T21:08:22.617 INFO:tasks.workunit.client.0.smithi055.stdout:2/867: mknod d4/d1e/d2a/c124 0 2024-04-26T21:08:22.617 INFO:tasks.workunit.client.0.smithi055.stdout:2/868: creat d4/dc/db6/f125 x:0 0 0 2024-04-26T21:08:22.617 INFO:tasks.workunit.client.0.smithi055.stdout:2/869: chown d4/d55/dde 124830425 1 2024-04-26T21:08:22.619 INFO:tasks.workunit.client.1.smithi064.stdout:8/883: dwrite d10/d41/d4e/d54/fbe [4194304,4194304] 0 2024-04-26T21:08:22.619 INFO:tasks.workunit.client.1.smithi064.stdout:8/884: readlink d10/d1d/l48 0 2024-04-26T21:08:22.619 INFO:tasks.workunit.client.1.smithi064.stdout:6/965: dwrite d4/d7/d12/d49/d4b/dc9/f138 [0,4194304] 0 2024-04-26T21:08:22.620 INFO:tasks.workunit.client.0.smithi055.stdout:0/803: dread d9/dc/d1c/d3b/f94 [0,4194304] 0 2024-04-26T21:08:22.624 INFO:tasks.workunit.client.1.smithi064.stdout:8/885: link d10/d41/d4e/d54/fbe d10/d41/d53/d104/f111 0 2024-04-26T21:08:22.624 INFO:tasks.workunit.client.1.smithi064.stdout:6/966: symlink d4/d7/d12/d49/d4b/d101/l144 0 2024-04-26T21:08:22.624 INFO:tasks.workunit.client.0.smithi055.stdout:1/777: dwrite d8/d17/d1b/d7b/d65/fa0 [0,4194304] 0 2024-04-26T21:08:22.626 INFO:tasks.workunit.client.0.smithi055.stdout:1/778: unlink d8/d17/f5a 0 2024-04-26T21:08:22.627 INFO:tasks.workunit.client.0.smithi055.stdout:1/779: symlink d8/df/d11/d27/d28/da4/daa/d104/l107 0 2024-04-26T21:08:22.627 INFO:tasks.workunit.client.0.smithi055.stdout:1/780: write d8/d17/fae [58306,37992] 0 2024-04-26T21:08:22.629 INFO:tasks.workunit.client.0.smithi055.stdout:3/834: dwrite d0/d4/d5/d73/d47/f76 [0,4194304] 0 2024-04-26T21:08:22.629 INFO:tasks.workunit.client.1.smithi064.stdout:5/960: dread dd/da9/d63/f7f [0,4194304] 0 2024-04-26T21:08:22.630 INFO:tasks.workunit.client.1.smithi064.stdout:5/961: creat dd/d12/d18/d25/d67/f12f x:0 0 0 2024-04-26T21:08:22.630 INFO:tasks.workunit.client.1.smithi064.stdout:5/962: chown dd/d12/d18/d25/d74/fd1 102591 1 2024-04-26T21:08:22.636 INFO:tasks.workunit.client.1.smithi064.stdout:0/975: write dd/f2a [3397410,74093] 0 2024-04-26T21:08:22.636 INFO:tasks.workunit.client.1.smithi064.stdout:0/976: chown dd/d21/dc8/d31/d47/dad/dfd/d18/d58/l60 19516592 1 2024-04-26T21:08:22.638 INFO:tasks.workunit.client.1.smithi064.stdout:0/977: mkdir dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d14c 0 2024-04-26T21:08:22.639 INFO:tasks.workunit.client.0.smithi055.stdout:0/804: write d9/dc/d17/f45 [2814333,4786] 0 2024-04-26T21:08:22.640 INFO:tasks.workunit.client.0.smithi055.stdout:0/805: mknod d9/df0/cfc 0 2024-04-26T21:08:22.643 INFO:tasks.workunit.client.1.smithi064.stdout:8/886: dread d10/d41/d4e/d59/fdc [0,4194304] 0 2024-04-26T21:08:22.644 INFO:tasks.workunit.client.1.smithi064.stdout:8/887: fdatasync d10/d2f/d61/f10f 0 2024-04-26T21:08:22.648 INFO:tasks.workunit.client.1.smithi064.stdout:8/888: link d10/d41/d4e/l6f d10/d2f/d90/da0/l112 0 2024-04-26T21:08:22.650 INFO:tasks.workunit.client.0.smithi055.stdout:1/781: dread d8/f12 [4194304,4194304] 0 2024-04-26T21:08:22.651 INFO:tasks.workunit.client.1.smithi064.stdout:8/889: creat d10/d2f/d56/f113 x:0 0 0 2024-04-26T21:08:22.653 INFO:tasks.workunit.client.1.smithi064.stdout:8/890: write d10/d2f/f106 [385953,83792] 0 2024-04-26T21:08:22.653 INFO:tasks.workunit.client.1.smithi064.stdout:5/963: fsync dd/da9/d48/d6a/d9e/db9/f12d 0 2024-04-26T21:08:22.654 INFO:tasks.workunit.client.1.smithi064.stdout:5/964: mkdir dd/da9/d48/d6a/d9e/db9/ded/d130 0 2024-04-26T21:08:22.655 INFO:tasks.workunit.client.1.smithi064.stdout:5/965: fsync dd/d12/fcf 0 2024-04-26T21:08:22.656 INFO:tasks.workunit.client.1.smithi064.stdout:5/966: creat dd/d12/d18/d1a/d1f/dca/f131 x:0 0 0 2024-04-26T21:08:22.659 INFO:tasks.workunit.client.1.smithi064.stdout:0/978: write dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/f9f [3356176,52177] 0 2024-04-26T21:08:22.659 INFO:tasks.workunit.client.1.smithi064.stdout:0/979: chown dd/d21/dc8/d31/d47/dad/dfd/d18/cbc 1 1 2024-04-26T21:08:22.660 INFO:tasks.workunit.client.1.smithi064.stdout:5/967: symlink dd/d12/d18/l132 0 2024-04-26T21:08:22.660 INFO:tasks.workunit.client.1.smithi064.stdout:5/968: chown dd/dd0/ff0 117713 1 2024-04-26T21:08:22.662 INFO:tasks.workunit.client.1.smithi064.stdout:0/980: mkdir dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/d7b/d10d/d11d/d11b/d14d 0 2024-04-26T21:08:22.662 INFO:tasks.workunit.client.1.smithi064.stdout:0/981: chown dd/d21/dc8/d31/d47/dad/dfd/f2e 90 1 2024-04-26T21:08:22.664 INFO:tasks.workunit.client.1.smithi064.stdout:5/969: creat dd/da9/d48/d6a/d9e/db9/ded/d130/f133 x:0 0 0 2024-04-26T21:08:22.665 INFO:tasks.workunit.client.1.smithi064.stdout:0/982: creat dd/d21/dc8/d31/d47/dad/dce/f14e x:0 0 0 2024-04-26T21:08:22.667 INFO:tasks.workunit.client.0.smithi055.stdout:1/782: link d8/df/d11/d27/d28/da4/daa/fe3 d8/d94/de7/f108 0 2024-04-26T21:08:22.667 INFO:tasks.workunit.client.0.smithi055.stdout:1/783: creat d8/d94/f109 x:0 0 0 2024-04-26T21:08:22.671 INFO:tasks.workunit.client.0.smithi055.stdout:1/784: creat d8/df/d11/d27/d28/da4/dbe/f10a x:0 0 0 2024-04-26T21:08:22.672 INFO:tasks.workunit.client.0.smithi055.stdout:1/785: mkdir d8/d17/d1b/d10b 0 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:4/610: sync 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:5/624: sync 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:7/754: sync 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:4/611: chown d4/d26/d42/d28/c29 10670 1 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:5/625: chown d4/df/d13/cb7 200 1 2024-04-26T21:08:22.674 INFO:tasks.workunit.client.0.smithi055.stdout:7/755: write d5/d53/d6e/d99/d7f/fe9 [760807,94083] 0 2024-04-26T21:08:22.675 INFO:tasks.workunit.client.0.smithi055.stdout:1/786: getdents d8/df/d11/d27/d28/da4/daa 0 2024-04-26T21:08:22.675 INFO:tasks.workunit.client.0.smithi055.stdout:1/787: creat d8/df/d11/db5/f10c x:0 0 0 2024-04-26T21:08:22.678 INFO:tasks.workunit.client.0.smithi055.stdout:4/612: mknod d4/d18/d8e/ccd 0 2024-04-26T21:08:22.678 INFO:tasks.workunit.client.0.smithi055.stdout:4/613: creat d4/d26/d42/d28/d53/d71/d7f/da1/fce x:0 0 0 2024-04-26T21:08:22.679 INFO:tasks.workunit.client.0.smithi055.stdout:5/626: symlink d4/df/dae/ld9 0 2024-04-26T21:08:22.683 INFO:tasks.workunit.client.1.smithi064.stdout:8/891: dread d10/d41/f105 [0,4194304] 0 2024-04-26T21:08:22.683 INFO:tasks.workunit.client.0.smithi055.stdout:0/806: write d9/dc/d1c/d3e/dc5/dcc/f4a [703552,77980] 0 2024-04-26T21:08:22.684 INFO:tasks.workunit.client.0.smithi055.stdout:0/807: stat d9/dc/d19/ddb/db6/d6c/d7a/l87 0 2024-04-26T21:08:22.687 INFO:tasks.workunit.client.0.smithi055.stdout:4/614: mknod d4/d26/ccf 0 2024-04-26T21:08:22.687 INFO:tasks.workunit.client.0.smithi055.stdout:0/808: read d9/dc/d17/d5d/f7c [113938,37524] 0 2024-04-26T21:08:22.687 INFO:tasks.workunit.client.0.smithi055.stdout:4/615: fsync d4/d26/f99 0 2024-04-26T21:08:22.687 INFO:tasks.workunit.client.0.smithi055.stdout:0/809: creat d9/d8b/ffd x:0 0 0 2024-04-26T21:08:22.688 INFO:tasks.workunit.client.0.smithi055.stdout:5/627: mkdir d4/df/dae/dce/d5b/d83/dda 0 2024-04-26T21:08:22.689 INFO:tasks.workunit.client.0.smithi055.stdout:5/628: dread - d4/df/dae/dce/d4a/d3f/d2e/f54 zero size 2024-04-26T21:08:22.689 INFO:tasks.workunit.client.0.smithi055.stdout:5/629: write d4/df/dae/dce/d93/dcb/f1f [5205031,85604] 0 2024-04-26T21:08:22.689 INFO:tasks.workunit.client.0.smithi055.stdout:7/756: rmdir d5/d53/d6e/d99/d58 39 2024-04-26T21:08:22.690 INFO:tasks.workunit.client.0.smithi055.stdout:4/616: symlink d4/d26/d42/d28/ld0 0 2024-04-26T21:08:22.691 INFO:tasks.workunit.client.0.smithi055.stdout:0/810: mkdir d9/dc/d1c/d3e/dc5/dcc/d4b/dfe 0 2024-04-26T21:08:22.692 INFO:tasks.workunit.client.1.smithi064.stdout:0/983: dread dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/fa8 [0,4194304] 0 2024-04-26T21:08:22.692 INFO:tasks.workunit.client.1.smithi064.stdout:0/984: creat dd/d21/dc8/d31/d47/dad/dfd/d74/d4f/f14f x:0 0 0 2024-04-26T21:08:22.692 INFO:tasks.workunit.client.0.smithi055.stdout:5/630: creat d4/df/dae/dce/d4a/d3f/fdb x:0 0 0 2024-04-26T21:08:22.693 INFO:tasks.workunit.client.0.smithi055.stdout:4/617: truncate d4/d18/d1a/f7d 2618438 0 2024-04-26T21:08:22.693 INFO:tasks.workunit.client.0.smithi055.stdout:0/811: symlink d9/dc/d1c/d3e/dc5/dcc/lff 0 2024-04-26T21:08:22.694 INFO:tasks.workunit.client.0.smithi055.stdout:5/631: mkdir d4/df/d13/d26/d63/ddc 0 2024-04-26T21:08:22.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/618: unlink d4/d12/d17/d3d/f68 0 2024-04-26T21:08:22.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/619: dread - d4/d12/d17/d3d/f45 zero size 2024-04-26T21:08:22.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/620: chown d4/d12/d17/fa8 7761 1 2024-04-26T21:08:22.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/621: chown d4/d12/d17/l78 25836 1 2024-04-26T21:08:22.696 INFO:tasks.workunit.client.0.smithi055.stdout:0/812: stat d9/dc/d1c/lf4 0 2024-04-26T21:08:22.697 INFO:tasks.workunit.client.0.smithi055.stdout:0/813: creat d9/dc/d1c/d3e/dc5/dcc/d9c/f100 x:0 0 0 2024-04-26T21:08:22.698 INFO:tasks.workunit.client.0.smithi055.stdout:5/632: write d4/df/dae/dce/d4a/d3f/d4f/d53/f62 [547821,38381] 0 2024-04-26T21:08:22.698 INFO:tasks.workunit.client.0.smithi055.stdout:5/633: readlink d4/df/dae/dce/d4a/d3f/d5c/lac 0 2024-04-26T21:08:22.699 INFO:tasks.workunit.client.0.smithi055.stdout:5/634: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ldd 0 2024-04-26T21:08:22.706 INFO:tasks.workunit.client.0.smithi055.stdout:1/788: dread d8/d17/d1b/d7b/d8d/f88 [0,4194304] 0 2024-04-26T21:08:22.708 INFO:tasks.workunit.client.0.smithi055.stdout:7/757: dread d5/d6/d24/d3b/f42 [0,4194304] 0 2024-04-26T21:08:22.708 INFO:tasks.workunit.client.0.smithi055.stdout:7/758: truncate d5/d6/d24/d4d/f55 3480713 0 2024-04-26T21:08:22.712 INFO:tasks.workunit.client.1.smithi064.stdout:0/985: dread dd/d21/dc8/d31/d47/dad/dfd/d18/d64/f86 [0,4194304] 0 2024-04-26T21:08:22.712 INFO:tasks.workunit.client.0.smithi055.stdout:7/759: creat d5/d6/d39/deb/ff1 x:0 0 0 2024-04-26T21:08:22.714 INFO:tasks.workunit.client.0.smithi055.stdout:3/835: dwrite d0/d4/d16/d18/d4b/d57/d8e/de0/fe3 [0,4194304] 0 2024-04-26T21:08:22.714 INFO:tasks.workunit.client.0.smithi055.stdout:0/814: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:08:22.715 INFO:tasks.workunit.client.1.smithi064.stdout:8/892: read d10/d41/d4e/d59/fdc [2175349,44528] 0 2024-04-26T21:08:22.715 INFO:tasks.workunit.client.1.smithi064.stdout:8/893: readlink d10/d2f/d90/lda 0 2024-04-26T21:08:22.716 INFO:tasks.workunit.client.0.smithi055.stdout:1/789: dread d8/d17/d1b/d41/fee [0,4194304] 0 2024-04-26T21:08:22.716 INFO:tasks.workunit.client.0.smithi055.stdout:4/622: dread d4/d12/d15/f6f [0,4194304] 0 2024-04-26T21:08:22.717 INFO:tasks.workunit.client.1.smithi064.stdout:6/967: dwrite d4/d7/d12/d49/f11e [0,4194304] 0 2024-04-26T21:08:22.717 INFO:tasks.workunit.client.1.smithi064.stdout:6/968: fsync d4/d7/d12/d49/d4b/d56/df1/f127 0 2024-04-26T21:08:22.717 INFO:tasks.workunit.client.1.smithi064.stdout:6/969: dread - d4/d7/d12/d49/d4b/d5a/daf/db2/fd6 zero size 2024-04-26T21:08:22.717 INFO:tasks.workunit.client.1.smithi064.stdout:6/970: creat d4/d7/d12/d49/d4b/d56/dcf/f145 x:0 0 0 2024-04-26T21:08:22.717 INFO:tasks.workunit.client.1.smithi064.stdout:6/971: write d4/d7/d12/dbc/f126 [2822,11789] 0 2024-04-26T21:08:22.721 INFO:tasks.workunit.client.0.smithi055.stdout:1/790: symlink d8/df/d11/d27/d28/dd7/l10d 0 2024-04-26T21:08:22.721 INFO:tasks.workunit.client.0.smithi055.stdout:3/836: symlink d0/d4/d5/d73/d47/d37/de7/l120 0 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:4/623: truncate d4/d26/d42/d28/d53/d71/d7f/f9d 1408863 0 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/635: dread d4/f8 [0,4194304] 0 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/636: dread - d4/df/dae/dce/d4a/d3f/d5c/db9/fc1 zero size 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/637: truncate d4/df/d13/d26/d63/fb6 717446 0 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/638: fsync d4/df/dae/dce/d93/dcb/fb8 0 2024-04-26T21:08:22.728 INFO:tasks.workunit.client.0.smithi055.stdout:1/791: rename d8/d17/d33/dfc to d8/d17/d1b/d10e 0 2024-04-26T21:08:22.729 INFO:tasks.workunit.client.0.smithi055.stdout:0/815: dread d9/dc/d19/ddb/db6/d6c/f84 [0,4194304] 0 2024-04-26T21:08:22.730 INFO:tasks.workunit.client.0.smithi055.stdout:7/760: dread d5/d53/d6e/d6c/f84 [0,4194304] 0 2024-04-26T21:08:22.734 INFO:tasks.workunit.client.1.smithi064.stdout:8/894: truncate d10/d41/d4e/d54/f57 2239578 0 2024-04-26T21:08:22.734 INFO:tasks.workunit.client.1.smithi064.stdout:8/895: stat d10/d41/d4e/d54/fcf 0 2024-04-26T21:08:22.740 INFO:tasks.workunit.client.1.smithi064.stdout:8/896: dread d10/d41/d4e/d54/fce [0,4194304] 0 2024-04-26T21:08:22.740 INFO:tasks.workunit.client.1.smithi064.stdout:8/897: write d10/d41/d44/f10e [462471,98799] 0 2024-04-26T21:08:22.740 INFO:tasks.workunit.client.1.smithi064.stdout:8/898: chown d10/d41/d4e/d54/faf 81447229 1 2024-04-26T21:08:22.742 INFO:tasks.workunit.client.0.smithi055.stdout:5/639: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fde x:0 0 0 2024-04-26T21:08:22.747 INFO:tasks.workunit.client.0.smithi055.stdout:7/761: creat d5/d6/ff2 x:0 0 0 2024-04-26T21:08:22.753 INFO:tasks.workunit.client.1.smithi064.stdout:6/972: write d4/d7/d12/d38/f3f [5008938,89583] 0 2024-04-26T21:08:22.753 INFO:tasks.workunit.client.1.smithi064.stdout:6/973: chown d4/d7/f62 254 1 2024-04-26T21:08:22.758 INFO:tasks.workunit.client.1.smithi064.stdout:8/899: mkdir d10/d41/d114 0 2024-04-26T21:08:22.758 INFO:tasks.workunit.client.1.smithi064.stdout:8/900: fdatasync d10/d41/d44/d5a/da2/fef 0 2024-04-26T21:08:22.764 INFO:tasks.workunit.client.1.smithi064.stdout:6/974: creat d4/d7/d12/d49/d4b/d5a/daf/f146 x:0 0 0 2024-04-26T21:08:22.765 INFO:tasks.workunit.client.0.smithi055.stdout:1/792: dread d8/df/d11/d27/d28/da4/daa/fe3 [0,4194304] 0 2024-04-26T21:08:22.767 INFO:tasks.workunit.client.0.smithi055.stdout:5/640: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/fdf x:0 0 0 2024-04-26T21:08:22.773 INFO:tasks.workunit.client.1.smithi064.stdout:6/975: unlink d4/d7/fa8 0 2024-04-26T21:08:22.774 INFO:tasks.workunit.client.0.smithi055.stdout:4/624: dwrite d4/d12/d17/d3d/faa [0,4194304] 0 2024-04-26T21:08:22.777 INFO:tasks.workunit.client.1.smithi064.stdout:8/901: dread d10/d1d/f30 [0,4194304] 0 2024-04-26T21:08:22.777 INFO:tasks.workunit.client.1.smithi064.stdout:8/902: write d10/d1d/d38/f98 [4383240,5213] 0 2024-04-26T21:08:22.779 INFO:tasks.workunit.client.1.smithi064.stdout:0/986: dwrite dd/d21/dc8/d31/d47/dad/dce/fd2 [4194304,4194304] 0 2024-04-26T21:08:22.780 INFO:tasks.workunit.client.0.smithi055.stdout:3/837: dwrite d0/d4/d16/d18/d4b/d57/f67 [0,4194304] 0 2024-04-26T21:08:22.785 INFO:tasks.workunit.client.0.smithi055.stdout:1/793: rename d8/df/d11/d27/d28/d2a/l30 to d8/df/d11/d27/d28/d2a/da7/l10f 0 2024-04-26T21:08:22.785 INFO:tasks.workunit.client.0.smithi055.stdout:1/794: readlink d8/d17/d1b/d7b/d65/l83 0 2024-04-26T21:08:22.797 INFO:tasks.workunit.client.0.smithi055.stdout:4/625: truncate d4/f21 6565455 0 2024-04-26T21:08:22.798 INFO:tasks.workunit.client.1.smithi064.stdout:0/987: symlink dd/d21/dc8/d31/d43/db4/l150 0 2024-04-26T21:08:22.800 INFO:tasks.workunit.client.0.smithi055.stdout:1/795: unlink d8/d17/l45 0 2024-04-26T21:08:22.802 INFO:tasks.workunit.client.0.smithi055.stdout:1/796: mknod d8/d17/d1b/c110 0 2024-04-26T21:08:22.804 INFO:tasks.workunit.client.0.smithi055.stdout:1/797: read d8/d17/fae [17914,120058] 0 2024-04-26T21:08:22.826 INFO:tasks.workunit.client.1.smithi064.stdout:6/976: dwrite d4/d7/f4d [4194304,4194304] 0 2024-04-26T21:08:22.832 INFO:tasks.workunit.client.0.smithi055.stdout:7/762: dwrite d5/d6/d24/f30 [0,4194304] 0 2024-04-26T21:08:22.832 INFO:tasks.workunit.client.1.smithi064.stdout:6/977: write d4/d7/d12/d38/f61 [157655,126315] 0 2024-04-26T21:08:22.833 INFO:tasks.workunit.client.0.smithi055.stdout:7/763: truncate d5/f83 881209 0 2024-04-26T21:08:22.834 INFO:tasks.workunit.client.1.smithi064.stdout:6/978: getdents d4/d7/d12/d49/d9e 0 2024-04-26T21:08:22.839 INFO:tasks.workunit.client.0.smithi055.stdout:0/816: dwrite d9/dc/d1c/d3b/f60 [0,4194304] 0 2024-04-26T21:08:22.870 INFO:tasks.workunit.client.0.smithi055.stdout:4/626: dwrite d4/d26/d42/d2d/f3a [0,4194304] 0 2024-04-26T21:08:22.872 INFO:tasks.workunit.client.0.smithi055.stdout:4/627: mkdir d4/d12/d61/dd1 0 2024-04-26T21:08:22.872 INFO:tasks.workunit.client.0.smithi055.stdout:4/628: read - d4/d26/fa3 zero size 2024-04-26T21:08:22.873 INFO:tasks.workunit.client.0.smithi055.stdout:1/798: dwrite d8/d17/d1b/d7b/fe2 [0,4194304] 0 2024-04-26T21:08:22.873 INFO:tasks.workunit.client.0.smithi055.stdout:1/799: fsync d8/d17/d1b/d7b/d8d/f54 0 2024-04-26T21:08:22.875 INFO:tasks.workunit.client.0.smithi055.stdout:1/800: creat d8/d17/d33/f111 x:0 0 0 2024-04-26T21:08:22.876 INFO:tasks.workunit.client.0.smithi055.stdout:1/801: mknod d8/df/c112 0 2024-04-26T21:08:22.884 INFO:tasks.workunit.client.0.smithi055.stdout:3/838: dwrite d0/d4/d5/d73/d47/d37/dbd/fbe [0,4194304] 0 2024-04-26T21:08:22.891 INFO:tasks.workunit.client.0.smithi055.stdout:4/629: dread d4/f36 [4194304,4194304] 0 2024-04-26T21:08:22.891 INFO:tasks.workunit.client.0.smithi055.stdout:4/630: readlink d4/d26/d42/d28/d53/d71/l80 0 2024-04-26T21:08:22.893 INFO:tasks.workunit.client.0.smithi055.stdout:4/631: creat d4/d12/d17/d3d/fd2 x:0 0 0 2024-04-26T21:08:22.893 INFO:tasks.workunit.client.0.smithi055.stdout:4/632: write d4/d18/d1a/f8a [810602,3679] 0 2024-04-26T21:08:22.894 INFO:tasks.workunit.client.0.smithi055.stdout:4/633: mknod d4/d18/d86/cd3 0 2024-04-26T21:08:22.907 INFO:tasks.workunit.client.0.smithi055.stdout:0/817: dwrite d9/dc/d1c/d3e/d7d/da3/f6d [0,4194304] 0 2024-04-26T21:08:22.908 INFO:tasks.workunit.client.0.smithi055.stdout:0/818: mkdir d9/dc/d17/d9a/d101 0 2024-04-26T21:08:22.910 INFO:tasks.workunit.client.0.smithi055.stdout:0/819: mkdir d9/d27/dcb/d102 0 2024-04-26T21:08:22.911 INFO:tasks.workunit.client.0.smithi055.stdout:0/820: mkdir d9/d27/dcb/d103 0 2024-04-26T21:08:22.911 INFO:tasks.workunit.client.0.smithi055.stdout:0/821: creat d9/dc/d17/d9a/f104 x:0 0 0 2024-04-26T21:08:22.915 INFO:tasks.workunit.client.0.smithi055.stdout:0/822: rename d9/dc/d19/fa5 to d9/d11/d59/f105 0 2024-04-26T21:08:22.919 INFO:tasks.workunit.client.0.smithi055.stdout:0/823: rename d9/dc/d1c/d3b to d9/d11/d59/d78/d106 0 2024-04-26T21:08:22.921 INFO:tasks.workunit.client.0.smithi055.stdout:0/824: creat d9/dc/d1c/d3e/dcd/f107 x:0 0 0 2024-04-26T21:08:22.922 INFO:tasks.workunit.client.0.smithi055.stdout:0/825: mknod d9/d11/d59/c108 0 2024-04-26T21:08:22.950 INFO:tasks.workunit.client.1.smithi064.stdout:8/903: dwrite d10/d2f/f109 [0,4194304] 0 2024-04-26T21:08:22.952 INFO:tasks.workunit.client.1.smithi064.stdout:8/904: symlink d10/d41/d114/l115 0 2024-04-26T21:08:22.952 INFO:tasks.workunit.client.1.smithi064.stdout:8/905: fsync d10/d41/f105 0 2024-04-26T21:08:22.952 INFO:tasks.workunit.client.1.smithi064.stdout:8/906: dread - d10/d41/d4e/d59/d5d/d79/ddf/ff6 zero size 2024-04-26T21:08:22.956 INFO:tasks.workunit.client.1.smithi064.stdout:5/970: sync 2024-04-26T21:08:22.956 INFO:tasks.workunit.client.1.smithi064.stdout:8/907: creat d10/d41/d4e/f116 x:0 0 0 2024-04-26T21:08:22.960 INFO:tasks.workunit.client.0.smithi055.stdout:9/810: sync 2024-04-26T21:08:22.960 INFO:tasks.workunit.client.0.smithi055.stdout:6/751: sync 2024-04-26T21:08:22.960 INFO:tasks.workunit.client.0.smithi055.stdout:8/625: sync 2024-04-26T21:08:22.966 INFO:tasks.workunit.client.0.smithi055.stdout:7/764: dwrite d5/d53/d6e/d99/d7f/f8e [0,4194304] 0 2024-04-26T21:08:22.967 INFO:tasks.workunit.client.1.smithi064.stdout:5/971: creat dd/f134 x:0 0 0 2024-04-26T21:08:22.967 INFO:tasks.workunit.client.1.smithi064.stdout:8/908: symlink d10/d41/d4e/l117 0 2024-04-26T21:08:22.967 INFO:tasks.workunit.client.1.smithi064.stdout:8/909: write d10/d41/d53/d104/f10c [42730,86834] 0 2024-04-26T21:08:22.967 INFO:tasks.workunit.client.0.smithi055.stdout:3/839: dwrite d0/d4/d5/d73/d13/d1a/f54 [4194304,4194304] 0 2024-04-26T21:08:22.968 INFO:tasks.workunit.client.1.smithi064.stdout:0/988: dwrite dd/d21/dc8/d31/d47/dad/dfd/d18/d58/f93 [4194304,4194304] 0 2024-04-26T21:08:22.968 INFO:tasks.workunit.client.1.smithi064.stdout:0/989: stat dd/d21/dd9/dfc 0 2024-04-26T21:08:22.968 INFO:tasks.workunit.client.1.smithi064.stdout:0/990: creat dd/df6/f151 x:0 0 0 2024-04-26T21:08:22.969 INFO:tasks.workunit.client.1.smithi064.stdout:0/991: creat dd/d21/dd9/dfc/f152 x:0 0 0 2024-04-26T21:08:22.969 INFO:tasks.workunit.client.0.smithi055.stdout:9/811: mkdir d2/d46/d77/d79/d11b 0 2024-04-26T21:08:22.974 INFO:tasks.workunit.client.0.smithi055.stdout:6/752: mkdir d3/d17/d46/d109/d66/d6a/d67/d83/d10b 0 2024-04-26T21:08:22.975 INFO:tasks.workunit.client.0.smithi055.stdout:6/753: write d3/da1/de3/f8d [1824250,89060] 0 2024-04-26T21:08:22.979 INFO:tasks.workunit.client.0.smithi055.stdout:4/634: dwrite d4/d26/d42/d28/d53/d71/fb4 [4194304,4194304] 0 2024-04-26T21:08:22.980 INFO:tasks.workunit.client.0.smithi055.stdout:0/826: dwrite d9/d8b/ffd [0,4194304] 0 2024-04-26T21:08:22.982 INFO:tasks.workunit.client.0.smithi055.stdout:7/765: symlink d5/d11/de4/lf3 0 2024-04-26T21:08:22.987 INFO:tasks.workunit.client.1.smithi064.stdout:6/979: dwrite d4/d7/f62 [4194304,4194304] 0 2024-04-26T21:08:22.989 INFO:tasks.workunit.client.0.smithi055.stdout:9/812: rename d2/d46/d9a/d105/d97/d9b/d10f/f110 to d2/d11/f11c 0 2024-04-26T21:08:22.990 INFO:tasks.workunit.client.0.smithi055.stdout:1/802: dwrite d8/f15 [4194304,4194304] 0 2024-04-26T21:08:22.995 INFO:tasks.workunit.client.0.smithi055.stdout:4/635: dread d4/d26/d42/dbb/f9b [4194304,4194304] 0 2024-04-26T21:08:22.997 INFO:tasks.workunit.client.0.smithi055.stdout:3/840: read d0/d4/d5/d73/d13/d27/d3b/dcd/f11f [953746,22078] 0 2024-04-26T21:08:22.997 INFO:tasks.workunit.client.0.smithi055.stdout:3/841: write d0/d4/d5/d73/d13/d27/d50/d6b/f7d [2700632,107177] 0 2024-04-26T21:08:22.997 INFO:tasks.workunit.client.0.smithi055.stdout:3/842: creat d0/d4/d16/d18/d4b/d57/d8e/db1/f121 x:0 0 0 2024-04-26T21:08:22.998 INFO:tasks.workunit.client.0.smithi055.stdout:3/843: fsync d0/d4/d16/d18/f5d 0 2024-04-26T21:08:23.006 INFO:tasks.workunit.client.0.smithi055.stdout:9/813: dread d2/f5a [0,4194304] 0 2024-04-26T21:08:23.010 INFO:tasks.workunit.client.0.smithi055.stdout:0/827: rmdir d9/dc/d19/ddb/db6/d6c 39 2024-04-26T21:08:23.013 INFO:tasks.workunit.client.0.smithi055.stdout:8/626: dwrite d3/dc0/f9f [0,4194304] 0 2024-04-26T21:08:23.015 INFO:tasks.workunit.client.0.smithi055.stdout:7/766: symlink d5/d6/d24/d52/lf4 0 2024-04-26T21:08:23.015 INFO:tasks.workunit.client.0.smithi055.stdout:4/636: dread d4/d18/d8e/d9e/fb1 [0,4194304] 0 2024-04-26T21:08:23.015 INFO:tasks.workunit.client.0.smithi055.stdout:4/637: stat d4/d26/d42/d28/d53/d70/f75 0 2024-04-26T21:08:23.015 INFO:tasks.workunit.client.0.smithi055.stdout:4/638: chown d4/d26/d42/d28/d53/d71/d7f 4 1 2024-04-26T21:08:23.016 INFO:tasks.workunit.client.0.smithi055.stdout:1/803: dread d8/d17/d6a/f52 [0,4194304] 0 2024-04-26T21:08:23.016 INFO:tasks.workunit.client.0.smithi055.stdout:1/804: fsync d8/d94/de7/ff8 0 2024-04-26T21:08:23.018 INFO:tasks.workunit.client.0.smithi055.stdout:6/754: dread d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/fc3 [0,4194304] 0 2024-04-26T21:08:23.024 INFO:tasks.workunit.client.1.smithi064.stdout:6/980: write d4/d7/d12/d49/d4b/d56/df1/f127 [1345851,73773] 0 2024-04-26T21:08:23.024 INFO:tasks.workunit.client.1.smithi064.stdout:6/981: creat d4/d7/d12/d49/d4b/d5a/d8f/f147 x:0 0 0 2024-04-26T21:08:23.030 INFO:tasks.workunit.client.1.smithi064.stdout:0/992: dwrite dd/d21/dc8/d31/d47/f53 [4194304,4194304] 0 2024-04-26T21:08:23.030 INFO:tasks.workunit.client.1.smithi064.stdout:0/993: write dd/d21/dc8/d31/d43/db4/f138 [302168,4007] 0 2024-04-26T21:08:23.031 INFO:tasks.workunit.client.1.smithi064.stdout:8/910: dwrite d10/d10d/fff [0,4194304] 0 2024-04-26T21:08:23.031 INFO:tasks.workunit.client.1.smithi064.stdout:8/911: stat d10/d1d/fbc 0 2024-04-26T21:08:23.032 INFO:tasks.workunit.client.1.smithi064.stdout:5/972: dwrite dd/d12/d4f/d9c/da1/fb7 [0,4194304] 0 2024-04-26T21:08:23.032 INFO:tasks.workunit.client.1.smithi064.stdout:5/973: creat dd/da9/d48/d6a/d101/f135 x:0 0 0 2024-04-26T21:08:23.034 INFO:tasks.workunit.client.0.smithi055.stdout:3/844: mkdir d0/d4/d5/d73/d13/d5c/d122 0 2024-04-26T21:08:23.035 INFO:tasks.workunit.client.1.smithi064.stdout:6/982: mknod d4/d7/d12/dbc/c148 0 2024-04-26T21:08:23.037 INFO:tasks.workunit.client.0.smithi055.stdout:9/814: rename d2/d11/c20 to d2/d46/d9a/d105/d97/d9b/d10f/c11d 0 2024-04-26T21:08:23.042 INFO:tasks.workunit.client.0.smithi055.stdout:0/828: unlink d9/dc/d19/ddb/db6/d6c/ca6 0 2024-04-26T21:08:23.043 INFO:tasks.workunit.client.1.smithi064.stdout:0/994: symlink dd/d21/db8/l153 0 2024-04-26T21:08:23.048 INFO:tasks.workunit.client.0.smithi055.stdout:4/639: rmdir d4/d18 39 2024-04-26T21:08:23.049 INFO:tasks.workunit.client.0.smithi055.stdout:4/640: stat d4/d18/d1a/lab 0 2024-04-26T21:08:23.050 INFO:tasks.workunit.client.0.smithi055.stdout:4/641: read d4/d18/d1a/f8a [564791,117431] 0 2024-04-26T21:08:23.054 INFO:tasks.workunit.client.0.smithi055.stdout:6/755: creat d3/d9b/f10c x:0 0 0 2024-04-26T21:08:23.055 INFO:tasks.workunit.client.0.smithi055.stdout:6/756: write d3/f5b [2482279,7154] 0 2024-04-26T21:08:23.055 INFO:tasks.workunit.client.0.smithi055.stdout:6/757: chown d3/d17/f18 505371 1 2024-04-26T21:08:23.055 INFO:tasks.workunit.client.0.smithi055.stdout:6/758: readlink d3/d17/l3b 0 2024-04-26T21:08:23.055 INFO:tasks.workunit.client.0.smithi055.stdout:6/759: write d3/d17/d46/d109/d66/d6a/d67/f89 [6288125,47499] 0 2024-04-26T21:08:23.059 INFO:tasks.workunit.client.0.smithi055.stdout:3/845: unlink d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/ld4 0 2024-04-26T21:08:23.076 INFO:tasks.workunit.client.0.smithi055.stdout:9/815: read d2/d46/d77/f89 [3491224,21698] 0 2024-04-26T21:08:23.076 INFO:tasks.workunit.client.0.smithi055.stdout:9/816: chown d2/d46/d9a/d105/c32 1 1 2024-04-26T21:08:23.076 INFO:tasks.workunit.client.0.smithi055.stdout:9/817: fsync d2/fc8 0 2024-04-26T21:08:23.076 INFO:tasks.workunit.client.0.smithi055.stdout:9/818: truncate d2/d46/d77/d7d/da8/ff8 947059 0 2024-04-26T21:08:23.077 INFO:tasks.workunit.client.1.smithi064.stdout:5/974: mknod dd/d12/d4f/c136 0 2024-04-26T21:08:23.083 INFO:tasks.workunit.client.1.smithi064.stdout:6/983: getdents d4/d7/d12/d49/d4b/d7d/d83/d107 0 2024-04-26T21:08:23.088 INFO:tasks.workunit.client.1.smithi064.stdout:0/995: truncate dd/d21/dc8/d31/d5c/feb 425878 0 2024-04-26T21:08:23.093 INFO:tasks.workunit.client.0.smithi055.stdout:8/627: dwrite d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:08:23.094 INFO:tasks.workunit.client.0.smithi055.stdout:1/805: dwrite d8/df/d11/d27/d28/d2a/f93 [0,4194304] 0 2024-04-26T21:08:23.103 INFO:tasks.workunit.client.0.smithi055.stdout:8/628: truncate d3/d9/d44/fb8 901737 0 2024-04-26T21:08:23.105 INFO:tasks.workunit.client.0.smithi055.stdout:1/806: mkdir d8/d17/d1b/d10e/d113 0 2024-04-26T21:08:23.109 INFO:tasks.workunit.client.0.smithi055.stdout:1/807: mkdir d8/df/d11/d27/d28/d2a/d114 0 2024-04-26T21:08:23.109 INFO:tasks.workunit.client.0.smithi055.stdout:1/808: chown d8/df/d11/d27/d28/dd7/l70 281 1 2024-04-26T21:08:23.111 INFO:tasks.workunit.client.1.smithi064.stdout:6/984: truncate d4/d7/d12/d1e/f2b 3483141 0 2024-04-26T21:08:23.114 INFO:tasks.workunit.client.0.smithi055.stdout:2/870: sync 2024-04-26T21:08:23.128 INFO:tasks.workunit.client.0.smithi055.stdout:3/846: write d0/ffc [1605970,43493] 0 2024-04-26T21:08:23.129 INFO:tasks.workunit.client.0.smithi055.stdout:3/847: stat d0/d4/d5/d73/d47/d37/dbd/fbe 0 2024-04-26T21:08:23.129 INFO:tasks.workunit.client.0.smithi055.stdout:4/642: dwrite d4/d18/d1a/f8a [0,4194304] 0 2024-04-26T21:08:23.152 INFO:tasks.workunit.client.0.smithi055.stdout:6/760: dwrite d3/d17/d46/d109/d66/d6a/d51/f85 [0,4194304] 0 2024-04-26T21:08:23.152 INFO:tasks.workunit.client.0.smithi055.stdout:6/761: dread - d3/d17/d46/d109/d66/f102 zero size 2024-04-26T21:08:23.152 INFO:tasks.workunit.client.0.smithi055.stdout:6/762: chown d3/d17/d19/f36 873 1 2024-04-26T21:08:23.152 INFO:tasks.workunit.client.0.smithi055.stdout:6/763: truncate d3/d17/d46/d109/d66/d6a/d67/d83/ff2 700839 0 2024-04-26T21:08:23.155 INFO:tasks.workunit.client.1.smithi064.stdout:5/975: dwrite dd/d12/f40 [8388608,4194304] 0 2024-04-26T21:08:23.155 INFO:tasks.workunit.client.1.smithi064.stdout:5/976: chown dd/d12/fcf 12933549 1 2024-04-26T21:08:23.155 INFO:tasks.workunit.client.1.smithi064.stdout:5/977: chown dd/d12/d18/d1a/d1f/d20/f8b 1130 1 2024-04-26T21:08:23.156 INFO:tasks.workunit.client.0.smithi055.stdout:9/819: dwrite d2/d46/d9a/d105/f4f [0,4194304] 0 2024-04-26T21:08:23.156 INFO:tasks.workunit.client.0.smithi055.stdout:9/820: write d2/d46/d77/d79/fee [19330,51714] 0 2024-04-26T21:08:23.162 INFO:tasks.workunit.client.1.smithi064.stdout:0/996: dwrite dd/d21/dc8/d31/d47/dad/dfd/f7e [0,4194304] 0 2024-04-26T21:08:23.162 INFO:tasks.workunit.client.1.smithi064.stdout:0/997: truncate dd/d21/dd9/dfc/f13d 254032 0 2024-04-26T21:08:23.182 INFO:tasks.workunit.client.0.smithi055.stdout:2/871: dread d4/d14/d17/d6d/f72 [0,4194304] 0 2024-04-26T21:08:23.182 INFO:tasks.workunit.client.1.smithi064.stdout:6/985: dwrite d4/d7/fd7 [0,4194304] 0 2024-04-26T21:08:23.182 INFO:tasks.workunit.client.1.smithi064.stdout:6/986: chown d4/d7/d12/d38/de6/dc1 3590 1 2024-04-26T21:08:23.183 INFO:tasks.workunit.client.1.smithi064.stdout:6/987: read d4/d7/d12/d49/d4b/d101/f13b [292258,21372] 0 2024-04-26T21:08:23.183 INFO:tasks.workunit.client.1.smithi064.stdout:0/998: read dd/d21/dc8/d31/d47/dad/dfd/f129 [2195026,29831] 0 2024-04-26T21:08:23.186 INFO:tasks.workunit.client.0.smithi055.stdout:1/809: dwrite d8/d17/d1b/d7b/d65/fcc [0,4194304] 0 2024-04-26T21:08:23.198 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:23 smithi055 ceph-mon[25475]: pgmap v44: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 219 MiB/s rd, 279 MiB/s wr, 428 op/s 2024-04-26T21:08:23.203 INFO:tasks.workunit.client.0.smithi055.stdout:7/767: dwrite d5/f83 [0,4194304] 0 2024-04-26T21:08:23.203 INFO:tasks.workunit.client.0.smithi055.stdout:7/768: chown d5/d53/d6e/d99/d7f/l9e 1756316145 1 2024-04-26T21:08:23.212 INFO:tasks.workunit.client.0.smithi055.stdout:3/848: dread d0/f19 [0,4194304] 0 2024-04-26T21:08:23.212 INFO:tasks.workunit.client.0.smithi055.stdout:3/849: readlink d0/d4/d5/d73/d13/d1a/la1 0 2024-04-26T21:08:23.222 INFO:tasks.workunit.client.0.smithi055.stdout:4/643: symlink d4/d18/d86/da6/ld4 0 2024-04-26T21:08:23.230 INFO:tasks.workunit.client.1.smithi064.stdout:5/978: creat dd/d12/d4f/da5/d125/f137 x:0 0 0 2024-04-26T21:08:23.230 INFO:tasks.workunit.client.1.smithi064.stdout:5/979: write dd/d12/d18/d1a/f6e [616855,95657] 0 2024-04-26T21:08:23.235 INFO:tasks.workunit.client.0.smithi055.stdout:6/764: mknod d3/d17/d46/d109/d66/d6a/d6b/c10d 0 2024-04-26T21:08:23.244 INFO:tasks.workunit.client.0.smithi055.stdout:9/821: creat d2/d46/d77/d7d/da0/f11e x:0 0 0 2024-04-26T21:08:23.245 INFO:tasks.workunit.client.0.smithi055.stdout:8/629: dwrite d3/d77/da9/fb6 [0,4194304] 0 2024-04-26T21:08:23.308 INFO:tasks.workunit.client.0.smithi055.stdout:8/630: dwrite d3/d7c/faf [0,4194304] 0 2024-04-26T21:08:23.309 INFO:tasks.workunit.client.0.smithi055.stdout:1/810: truncate d8/d17/fae 81268 0 2024-04-26T21:08:23.323 INFO:tasks.workunit.client.1.smithi064.stdout:0/999: symlink dd/d21/df9/d104/l154 0 2024-04-26T21:08:23.345 INFO:tasks.workunit.client.0.smithi055.stdout:7/769: creat d5/d6/d24/d4d/da7/dab/dce/ff5 x:0 0 0 2024-04-26T21:08:23.345 INFO:tasks.workunit.client.0.smithi055.stdout:7/770: dread - d5/d6/d24/dcf/f97 zero size 2024-04-26T21:08:23.361 INFO:tasks.workunit.client.0.smithi055.stdout:3/850: creat d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3/f123 x:0 0 0 2024-04-26T21:08:23.380 INFO:tasks.workunit.client.0.smithi055.stdout:4/644: creat d4/d26/d42/d28/d53/d71/d7f/fd5 x:0 0 0 2024-04-26T21:08:23.382 INFO:tasks.workunit.client.0.smithi055.stdout:9/822: creat d2/d46/d77/d7d/dbf/f11f x:0 0 0 2024-04-26T21:08:23.382 INFO:tasks.workunit.client.0.smithi055.stdout:9/823: readlink d2/d46/d77/l4c 0 2024-04-26T21:08:23.388 INFO:tasks.workunit.client.0.smithi055.stdout:8/631: mknod d3/dc0/d2e/d75/d76/cd1 0 2024-04-26T21:08:23.389 INFO:tasks.workunit.client.0.smithi055.stdout:1/811: mknod d8/df/d11/d27/d28/c115 0 2024-04-26T21:08:23.389 INFO:tasks.workunit.client.0.smithi055.stdout:1/812: fdatasync d8/df/d11/d27/d28/d2a/da7/ff3 0 2024-04-26T21:08:23.392 INFO:tasks.workunit.client.0.smithi055.stdout:7/771: mknod d5/d53/d6e/d65/cf6 0 2024-04-26T21:08:23.393 INFO:tasks.workunit.client.0.smithi055.stdout:7/772: dread - d5/d53/d6e/fa0 zero size 2024-04-26T21:08:23.393 INFO:tasks.workunit.client.0.smithi055.stdout:7/773: fdatasync d5/d6/d24/d4d/da7/dab/dae/fb9 0 2024-04-26T21:08:23.394 INFO:tasks.workunit.client.0.smithi055.stdout:3/851: creat d0/d4/d5/f124 x:0 0 0 2024-04-26T21:08:23.396 INFO:tasks.workunit.client.0.smithi055.stdout:4/645: getdents d4/d12/d61/d93 0 2024-04-26T21:08:23.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/824: creat d2/d46/d9a/d105/db8/dc5/f120 x:0 0 0 2024-04-26T21:08:23.401 INFO:tasks.workunit.client.0.smithi055.stdout:8/632: creat d3/dc0/d2e/da6/fd2 x:0 0 0 2024-04-26T21:08:23.401 INFO:tasks.workunit.client.0.smithi055.stdout:8/633: stat d3/c6 0 2024-04-26T21:08:23.404 INFO:tasks.workunit.client.0.smithi055.stdout:2/872: rename d4/dc/db6 to d4/db/d56/d4a/d7e/d126 0 2024-04-26T21:08:23.404 INFO:tasks.workunit.client.0.smithi055.stdout:2/873: write d4/db/d1f/d46/fb7 [859221,49576] 0 2024-04-26T21:08:23.404 INFO:tasks.workunit.client.0.smithi055.stdout:2/874: write d4/d14/d17/d6d/f77 [484929,44244] 0 2024-04-26T21:08:23.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:23 smithi064 ceph-mon[33404]: pgmap v44: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 219 MiB/s rd, 279 MiB/s wr, 428 op/s 2024-04-26T21:08:23.410 INFO:tasks.workunit.client.0.smithi055.stdout:2/875: mknod d4/d1e/d90/dbc/c127 0 2024-04-26T21:08:23.417 INFO:tasks.workunit.client.0.smithi055.stdout:9/825: dread d2/d46/d9a/d105/f4f [0,4194304] 0 2024-04-26T21:08:23.417 INFO:tasks.workunit.client.0.smithi055.stdout:9/826: fdatasync d2/d46/d9a/da7/fa9 0 2024-04-26T21:08:23.417 INFO:tasks.workunit.client.0.smithi055.stdout:6/765: rename d3/d9b to d3/d17/d19/d71/dca/dcb/d10e 0 2024-04-26T21:08:23.441 INFO:tasks.workunit.client.1.smithi064.stdout:5/980: mkdir dd/d12/d18/d25/d138 0 2024-04-26T21:08:23.441 INFO:tasks.workunit.client.1.smithi064.stdout:5/981: readlink dd/da9/d48/d6a/d9e/db9/de6/l10e 0 2024-04-26T21:08:23.441 INFO:tasks.workunit.client.1.smithi064.stdout:8/912: sync 2024-04-26T21:08:23.445 INFO:tasks.workunit.client.1.smithi064.stdout:5/982: creat dd/d12/d4f/d64/f139 x:0 0 0 2024-04-26T21:08:23.445 INFO:tasks.workunit.client.1.smithi064.stdout:5/983: truncate dd/d12/d4f/d64/df8/f103 433502 0 2024-04-26T21:08:23.447 INFO:tasks.workunit.client.1.smithi064.stdout:5/984: rmdir dd/d12/d18/d25/d138 0 2024-04-26T21:08:23.451 INFO:tasks.workunit.client.0.smithi055.stdout:6/766: rmdir d3/d17/d19/d7b 39 2024-04-26T21:08:23.452 INFO:tasks.workunit.client.0.smithi055.stdout:6/767: write d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/fa7 [1048974,39867] 0 2024-04-26T21:08:23.455 INFO:tasks.workunit.client.0.smithi055.stdout:6/768: link d3/d17/d19/d7b/d8f/l93 d3/da1/de3/db6/l10f 0 2024-04-26T21:08:23.456 INFO:tasks.workunit.client.1.smithi064.stdout:8/913: dread d10/f4d [0,4194304] 0 2024-04-26T21:08:23.457 INFO:tasks.workunit.client.0.smithi055.stdout:6/769: symlink d3/d17/d46/d109/d66/d6a/d67/d83/l110 0 2024-04-26T21:08:23.461 INFO:tasks.workunit.client.0.smithi055.stdout:2/876: mkdir d4/d49/d128 0 2024-04-26T21:08:23.461 INFO:tasks.workunit.client.0.smithi055.stdout:2/877: creat d4/d1e/dba/f129 x:0 0 0 2024-04-26T21:08:23.461 INFO:tasks.workunit.client.0.smithi055.stdout:2/878: read d4/db/d26/d9a/fad [3574966,50185] 0 2024-04-26T21:08:23.463 INFO:tasks.workunit.client.0.smithi055.stdout:3/852: creat d0/d4/d16/d18/d4b/d57/d8e/f125 x:0 0 0 2024-04-26T21:08:23.465 INFO:tasks.workunit.client.0.smithi055.stdout:2/879: rmdir d4/db/d8f/da6 39 2024-04-26T21:08:23.468 INFO:tasks.workunit.client.0.smithi055.stdout:3/853: rmdir d0/d4/df6 39 2024-04-26T21:08:23.477 INFO:tasks.workunit.client.0.smithi055.stdout:1/813: rename d8/d94/le0 to d8/d17/d6a/l116 0 2024-04-26T21:08:23.477 INFO:tasks.workunit.client.0.smithi055.stdout:1/814: chown d8/df/d11/db5/ld0 2032 1 2024-04-26T21:08:23.480 INFO:tasks.workunit.client.0.smithi055.stdout:3/854: rename d0/d4/d16/l1c to d0/de/l126 0 2024-04-26T21:08:23.480 INFO:tasks.workunit.client.0.smithi055.stdout:3/855: chown d0/la5 575 1 2024-04-26T21:08:23.485 INFO:tasks.workunit.client.0.smithi055.stdout:7/774: dwrite d5/d53/d6e/d99/d75/fad [0,4194304] 0 2024-04-26T21:08:23.485 INFO:tasks.workunit.client.0.smithi055.stdout:7/775: write d5/d53/d6e/d65/f94 [1083583,106865] 0 2024-04-26T21:08:23.485 INFO:tasks.workunit.client.0.smithi055.stdout:1/815: unlink d8/df/d11/d27/d28/d2a/da7/fd3 0 2024-04-26T21:08:23.485 INFO:tasks.workunit.client.0.smithi055.stdout:3/856: rename d0/d4/d5/d73/d13/d27/d50/d6b/ffb to d0/d4/d5/f127 0 2024-04-26T21:08:23.495 INFO:tasks.workunit.client.0.smithi055.stdout:1/816: readlink d8/ld 0 2024-04-26T21:08:23.498 INFO:tasks.workunit.client.0.smithi055.stdout:3/857: truncate d0/d4/d5/d73/d13/d27/d50/d6b/f9e 3977124 0 2024-04-26T21:08:23.499 INFO:tasks.workunit.client.1.smithi064.stdout:6/988: rename d4/d7/d12/d49/d4b/d56/d95/f9a to d4/d7/d12/d49/d4b/d5a/daf/f149 0 2024-04-26T21:08:23.499 INFO:tasks.workunit.client.1.smithi064.stdout:6/989: truncate d4/d7/d12/d49/d4b/d56/dcf/f13c 539261 0 2024-04-26T21:08:23.499 INFO:tasks.workunit.client.1.smithi064.stdout:6/990: chown d4/d7/d12/dbc/fcd 145 1 2024-04-26T21:08:23.502 INFO:tasks.workunit.client.1.smithi064.stdout:8/914: rename d10/d41/d44/d7d/f7f to d10/d41/d44/f118 0 2024-04-26T21:08:23.503 INFO:tasks.workunit.client.0.smithi055.stdout:3/858: mknod d0/d4/d5/d73/d13/d1a/c128 0 2024-04-26T21:08:23.503 INFO:tasks.workunit.client.0.smithi055.stdout:8/634: dwrite d3/d9/d1d/d48/d4b/f6b [0,4194304] 0 2024-04-26T21:08:23.507 INFO:tasks.workunit.client.1.smithi064.stdout:6/991: unlink d4/d7/d33/f34 0 2024-04-26T21:08:23.516 INFO:tasks.workunit.client.0.smithi055.stdout:1/817: dread d8/f15 [0,4194304] 0 2024-04-26T21:08:23.516 INFO:tasks.workunit.client.0.smithi055.stdout:2/880: dwrite d4/d1e/d2a/f30 [0,4194304] 0 2024-04-26T21:08:23.517 INFO:tasks.workunit.client.1.smithi064.stdout:6/992: unlink d4/d7/d12/d49/d4b/d7d/d83/d124/c13d 0 2024-04-26T21:08:23.517 INFO:tasks.workunit.client.1.smithi064.stdout:6/993: stat d4/d7/d12/d49/d9e 0 2024-04-26T21:08:23.517 INFO:tasks.workunit.client.1.smithi064.stdout:6/994: write d4/d7/d12/d38/f5b [4286090,8849] 0 2024-04-26T21:08:23.519 INFO:tasks.workunit.client.0.smithi055.stdout:8/635: truncate d3/d9/d44/f67 3139639 0 2024-04-26T21:08:23.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/859: mknod d0/d4/d5/d73/d13/d1a/d46/d72/dd5/c129 0 2024-04-26T21:08:23.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/860: write d0/d4/d5/d73/d47/d37/fce [259836,7444] 0 2024-04-26T21:08:23.520 INFO:tasks.workunit.client.0.smithi055.stdout:3/861: creat d0/d4/d16/d18/d4b/d57/d8e/db1/f12a x:0 0 0 2024-04-26T21:08:23.525 INFO:tasks.workunit.client.0.smithi055.stdout:1/818: rename d8/df/d11/d27/d28/d2a/da7/ff3 to d8/df/d11/db5/f117 0 2024-04-26T21:08:23.528 INFO:tasks.workunit.client.0.smithi055.stdout:2/881: unlink d4/d14/l54 0 2024-04-26T21:08:23.529 INFO:tasks.workunit.client.0.smithi055.stdout:2/882: fdatasync d4/db/f25 0 2024-04-26T21:08:23.530 INFO:tasks.workunit.client.0.smithi055.stdout:8/636: rmdir d3/dc0/d2e/d75 39 2024-04-26T21:08:23.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/862: rename d0/d4/d5/d73/d13/d1a/d46/d72/d69/fbb to d0/de/f12b 0 2024-04-26T21:08:23.536 INFO:tasks.workunit.client.0.smithi055.stdout:3/863: chown d0/d4/d5/d73/d13/d27/ddb 771578415 1 2024-04-26T21:08:23.537 INFO:tasks.workunit.client.0.smithi055.stdout:1/819: mknod d8/d17/d1b/d7b/c118 0 2024-04-26T21:08:23.538 INFO:tasks.workunit.client.0.smithi055.stdout:2/883: mknod d4/db/d8f/c12a 0 2024-04-26T21:08:23.540 INFO:tasks.workunit.client.0.smithi055.stdout:3/864: unlink d0/de/c6e 0 2024-04-26T21:08:23.541 INFO:tasks.workunit.client.0.smithi055.stdout:1/820: creat d8/d17/d6a/f119 x:0 0 0 2024-04-26T21:08:23.542 INFO:tasks.workunit.client.0.smithi055.stdout:2/884: rmdir d4/db/d8f/da6 39 2024-04-26T21:08:23.543 INFO:tasks.workunit.client.0.smithi055.stdout:2/885: read d4/db/d56/d4a/d7e/f91 [2103747,29966] 0 2024-04-26T21:08:23.544 INFO:tasks.workunit.client.0.smithi055.stdout:1/821: symlink d8/d94/d9b/l11a 0 2024-04-26T21:08:23.548 INFO:tasks.workunit.client.0.smithi055.stdout:0/829: sync 2024-04-26T21:08:23.549 INFO:tasks.workunit.client.0.smithi055.stdout:5/641: sync 2024-04-26T21:08:23.549 INFO:tasks.workunit.client.0.smithi055.stdout:5/642: stat d4/df/dae/dce/d4a/f56 0 2024-04-26T21:08:23.549 INFO:tasks.workunit.client.0.smithi055.stdout:7/776: dwrite d5/d53/dd1/f14 [4194304,4194304] 0 2024-04-26T21:08:23.552 INFO:tasks.workunit.client.0.smithi055.stdout:0/830: unlink d9/d11/d5b/ff7 0 2024-04-26T21:08:23.554 INFO:tasks.workunit.client.0.smithi055.stdout:5/643: symlink d4/df/dae/dce/d93/dcb/db4/le0 0 2024-04-26T21:08:23.555 INFO:tasks.workunit.client.0.smithi055.stdout:5/644: dread - d4/df/dae/dce/d4a/d3f/fdb zero size 2024-04-26T21:08:23.556 INFO:tasks.workunit.client.0.smithi055.stdout:8/637: dread d3/d9/d1d/f53 [0,4194304] 0 2024-04-26T21:08:23.557 INFO:tasks.workunit.client.0.smithi055.stdout:3/865: dread d0/d4/d5/d73/d13/d1a/d46/fae [0,4194304] 0 2024-04-26T21:08:23.559 INFO:tasks.workunit.client.0.smithi055.stdout:8/638: creat d3/fd3 x:0 0 0 2024-04-26T21:08:23.559 INFO:tasks.workunit.client.0.smithi055.stdout:7/777: rmdir d5/d53/d6e/d99/d7f/d6f/da8 39 2024-04-26T21:08:23.560 INFO:tasks.workunit.client.0.smithi055.stdout:7/778: creat d5/d6/d39/deb/ff7 x:0 0 0 2024-04-26T21:08:23.560 INFO:tasks.workunit.client.0.smithi055.stdout:9/827: write d2/f22 [676549,115420] 0 2024-04-26T21:08:23.561 INFO:tasks.workunit.client.0.smithi055.stdout:5/645: symlink d4/le1 0 2024-04-26T21:08:23.563 INFO:tasks.workunit.client.0.smithi055.stdout:3/866: unlink d0/d4/d5/d73/d13/d1a/f35 0 2024-04-26T21:08:23.563 INFO:tasks.workunit.client.0.smithi055.stdout:3/867: write d0/d4/d5/d73/d13/d1a/d46/d72/d69/fb3 [4527306,3650] 0 2024-04-26T21:08:23.563 INFO:tasks.workunit.client.0.smithi055.stdout:3/868: write d0/d4/d16/d18/d4b/d57/d8e/db1/f12a [939939,73834] 0 2024-04-26T21:08:23.564 INFO:tasks.workunit.client.0.smithi055.stdout:8/639: creat d3/d9/d1d/d48/d57/d61/d9b/fd4 x:0 0 0 2024-04-26T21:08:23.565 INFO:tasks.workunit.client.0.smithi055.stdout:2/886: dread d4/d55/d6c/fa0 [0,4194304] 0 2024-04-26T21:08:23.567 INFO:tasks.workunit.client.0.smithi055.stdout:7/779: mknod d5/d6/d39/dbc/cf8 0 2024-04-26T21:08:23.572 INFO:tasks.workunit.client.0.smithi055.stdout:9/828: rename d2/d11/fc2 to d2/d46/d9a/d105/d97/f121 0 2024-04-26T21:08:23.575 INFO:tasks.workunit.client.0.smithi055.stdout:7/780: mkdir d5/d11/de4/df9 0 2024-04-26T21:08:23.576 INFO:tasks.workunit.client.0.smithi055.stdout:7/781: write d5/d6/d24/d52/f5e [1898029,99657] 0 2024-04-26T21:08:23.576 INFO:tasks.workunit.client.0.smithi055.stdout:7/782: dread - d5/d53/d6e/d6c/fd5 zero size 2024-04-26T21:08:23.576 INFO:tasks.workunit.client.0.smithi055.stdout:7/783: stat d5/d6/d24/f30 0 2024-04-26T21:08:23.577 INFO:tasks.workunit.client.0.smithi055.stdout:0/831: dread d9/dc/d1c/d3e/dc5/dcc/d9c/fe2 [0,4194304] 0 2024-04-26T21:08:23.579 INFO:tasks.workunit.client.0.smithi055.stdout:0/832: mknod d9/dc/d19/ddb/db6/d6c/c109 0 2024-04-26T21:08:23.580 INFO:tasks.workunit.client.0.smithi055.stdout:0/833: creat d9/dc/d1c/d3e/d7d/da3/dca/f10a x:0 0 0 2024-04-26T21:08:23.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/822: unlink d8/df/c32 0 2024-04-26T21:08:23.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/823: fsync d8/d17/d6a/f6b 0 2024-04-26T21:08:23.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/824: readlink d8/d17/d1b/l8b 0 2024-04-26T21:08:23.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/825: stat d8/d17/d1b/d7b/d8d/ff5 0 2024-04-26T21:08:23.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/826: truncate d8/d17/d33/f111 563862 0 2024-04-26T21:08:23.592 INFO:tasks.workunit.client.0.smithi055.stdout:2/887: dread d4/d55/d6c/f94 [0,4194304] 0 2024-04-26T21:08:23.593 INFO:tasks.workunit.client.0.smithi055.stdout:8/640: mkdir d3/d77/dd5 0 2024-04-26T21:08:23.597 INFO:tasks.workunit.client.0.smithi055.stdout:2/888: mknod d4/d1e/dba/c12b 0 2024-04-26T21:08:23.598 INFO:tasks.workunit.client.0.smithi055.stdout:8/641: mkdir d3/dc0/d2e/db3/dd6 0 2024-04-26T21:08:23.600 INFO:tasks.workunit.client.0.smithi055.stdout:2/889: symlink d4/db/d1f/l12c 0 2024-04-26T21:08:23.602 INFO:tasks.workunit.client.0.smithi055.stdout:8/642: symlink d3/dc0/d2e/d75/dcb/ld7 0 2024-04-26T21:08:23.610 INFO:tasks.workunit.client.0.smithi055.stdout:8/643: mknod d3/dc0/cd8 0 2024-04-26T21:08:23.610 INFO:tasks.workunit.client.0.smithi055.stdout:8/644: truncate d3/dbc/fcc 353705 0 2024-04-26T21:08:23.610 INFO:tasks.workunit.client.0.smithi055.stdout:8/645: write d3/d77/fc6 [303442,130076] 0 2024-04-26T21:08:23.612 INFO:tasks.workunit.client.0.smithi055.stdout:3/869: dread d0/d4/d5/d73/d13/d1a/d46/fae [0,4194304] 0 2024-04-26T21:08:23.612 INFO:tasks.workunit.client.0.smithi055.stdout:3/870: fdatasync d0/d4/d5/d73/d47/d37/d3d/fed 0 2024-04-26T21:08:23.628 INFO:tasks.workunit.client.0.smithi055.stdout:8/646: write d3/d77/da9/fb6 [2816940,100979] 0 2024-04-26T21:08:23.631 INFO:tasks.workunit.client.0.smithi055.stdout:8/647: fdatasync d3/fc3 0 2024-04-26T21:08:23.633 INFO:tasks.workunit.client.0.smithi055.stdout:8/648: mknod d3/d9/d1d/d48/d57/cd9 0 2024-04-26T21:08:23.634 INFO:tasks.workunit.client.0.smithi055.stdout:8/649: creat d3/d77/da9/fda x:0 0 0 2024-04-26T21:08:23.644 INFO:tasks.workunit.client.0.smithi055.stdout:5/646: dwrite d4/df/d13/d26/f4e [0,4194304] 0 2024-04-26T21:08:23.648 INFO:tasks.workunit.client.0.smithi055.stdout:9/829: write d2/d46/d51/fb2 [2548590,112262] 0 2024-04-26T21:08:23.652 INFO:tasks.workunit.client.1.smithi064.stdout:5/985: sync 2024-04-26T21:08:23.652 INFO:tasks.workunit.client.1.smithi064.stdout:8/915: sync 2024-04-26T21:08:23.652 INFO:tasks.workunit.client.1.smithi064.stdout:8/916: fdatasync d10/d41/d44/f51 0 2024-04-26T21:08:23.653 INFO:tasks.workunit.client.1.smithi064.stdout:6/995: sync 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.0.smithi055.stdout:1/827: dwrite d8/d17/d1b/d7b/d8d/f7a [0,4194304] 0 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.0.smithi055.stdout:0/834: read d9/d8b/ffd [2362045,126444] 0 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.1.smithi064.stdout:6/996: write d4/d7/d33/fdd [891858,26889] 0 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.1.smithi064.stdout:8/917: truncate d10/d2f/d90/f103 959486 0 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.1.smithi064.stdout:6/997: write d4/d7/d12/d49/d4b/d5a/daf/f113 [863855,30996] 0 2024-04-26T21:08:23.654 INFO:tasks.workunit.client.1.smithi064.stdout:6/998: readlink d4/d7/d33/l76 0 2024-04-26T21:08:23.657 INFO:tasks.workunit.client.1.smithi064.stdout:5/986: link dd/d12/d18/d1a/d1b/f5b dd/da9/d48/d6a/d9e/db9/f13a 0 2024-04-26T21:08:23.660 INFO:tasks.workunit.client.1.smithi064.stdout:6/999: truncate d4/d7/d33/f50 2514820 0 2024-04-26T21:08:23.665 INFO:tasks.workunit.client.1.smithi064.stdout:5/987: getdents dd/d12/d4f/dbd/d105 0 2024-04-26T21:08:23.665 INFO:tasks.workunit.client.1.smithi064.stdout:5/988: truncate dd/da9/fd7 63204 0 2024-04-26T21:08:23.665 INFO:tasks.workunit.client.1.smithi064.stdout:5/989: write dd/d12/d18/d1a/d1f/dca/f131 [805032,96642] 0 2024-04-26T21:08:23.667 INFO:tasks.workunit.client.0.smithi055.stdout:0/835: link d9/dc/d1c/f85 d9/dc/d1c/d3e/d7d/da3/dce/f10b 0 2024-04-26T21:08:23.667 INFO:tasks.workunit.client.0.smithi055.stdout:0/836: fsync d9/dc/d19/f24 0 2024-04-26T21:08:23.667 INFO:tasks.workunit.client.0.smithi055.stdout:0/837: fsync d9/dc/d17/f3f 0 2024-04-26T21:08:23.669 INFO:tasks.workunit.client.0.smithi055.stdout:6/770: write d3/d17/d46/d109/d66/d6a/fab [1090035,35808] 0 2024-04-26T21:08:23.673 INFO:tasks.workunit.client.0.smithi055.stdout:5/647: dread d4/df/dae/dce/d4a/d3f/d4f/d53/f91 [0,4194304] 0 2024-04-26T21:08:23.673 INFO:tasks.workunit.client.0.smithi055.stdout:5/648: chown d4/df/dae/dce/d93/laf 35 1 2024-04-26T21:08:23.674 INFO:tasks.workunit.client.0.smithi055.stdout:0/838: mknod d9/dc/d1c/c10c 0 2024-04-26T21:08:23.675 INFO:tasks.workunit.client.1.smithi064.stdout:8/918: dread d10/d1d/d38/f98 [0,4194304] 0 2024-04-26T21:08:23.675 INFO:tasks.workunit.client.1.smithi064.stdout:8/919: readlink d10/d41/d44/d7d/lf1 0 2024-04-26T21:08:23.676 INFO:tasks.workunit.client.1.smithi064.stdout:5/990: getdents dd/d12/d4f/dbd 0 2024-04-26T21:08:23.679 INFO:tasks.workunit.client.1.smithi064.stdout:8/920: mkdir d10/d119 0 2024-04-26T21:08:23.680 INFO:tasks.workunit.client.1.smithi064.stdout:8/921: write d10/d2f/f106 [1390851,84083] 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:2/890: write d4/d14/d17/d36/fac [1934906,12287] 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:2/891: chown d4/db/d1f/d46/c83 906053 1 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:2/892: stat d4/db/d1f/d46/fb7 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:2/893: chown d4/db/d8f/df8/ldb 11505938 1 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:7/784: dwrite d5/d6/d24/f27 [4194304,4194304] 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:7/785: readlink d5/d53/dd1/le 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:3/871: dwrite d0/de/fbc [0,4194304] 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:1/828: dread d8/df/d11/d27/d28/d2a/fc9 [0,4194304] 0 2024-04-26T21:08:23.681 INFO:tasks.workunit.client.0.smithi055.stdout:9/830: dread d2/f55 [0,4194304] 0 2024-04-26T21:08:23.682 INFO:tasks.workunit.client.0.smithi055.stdout:6/771: dread d3/d17/d19/d71/f53 [0,4194304] 0 2024-04-26T21:08:23.687 INFO:tasks.workunit.client.0.smithi055.stdout:5/649: mkdir d4/df/dae/dce/dc0/de2 0 2024-04-26T21:08:23.687 INFO:tasks.workunit.client.1.smithi064.stdout:5/991: getdents dd/da9/d48/d56 0 2024-04-26T21:08:23.693 INFO:tasks.workunit.client.0.smithi055.stdout:0/839: symlink d9/dc/d1c/d3e/dcd/l10d 0 2024-04-26T21:08:23.693 INFO:tasks.workunit.client.1.smithi064.stdout:8/922: write d10/d2f/d61/f88 [2316589,50326] 0 2024-04-26T21:08:23.694 INFO:tasks.workunit.client.0.smithi055.stdout:7/786: mkdir d5/d6/d24/d4d/da7/dab/dce/de7/dfa 0 2024-04-26T21:08:23.696 INFO:tasks.workunit.client.0.smithi055.stdout:5/650: creat d4/df/d13/d26/d63/ddc/fe3 x:0 0 0 2024-04-26T21:08:23.698 INFO:tasks.workunit.client.1.smithi064.stdout:8/923: write d10/d10d/fe4 [339140,53160] 0 2024-04-26T21:08:23.698 INFO:tasks.workunit.client.1.smithi064.stdout:8/924: chown d10/d10d/ffb 0 1 2024-04-26T21:08:23.701 INFO:tasks.workunit.client.1.smithi064.stdout:8/925: unlink d10/d41/d4e/d60/l89 0 2024-04-26T21:08:23.702 INFO:tasks.workunit.client.0.smithi055.stdout:7/787: link d5/d53/d6e/d99/ldd d5/d53/d6e/d65/dc5/dc7/lfb 0 2024-04-26T21:08:23.702 INFO:tasks.workunit.client.0.smithi055.stdout:7/788: fdatasync d5/d53/d6e/d99/d58/f88 0 2024-04-26T21:08:23.702 INFO:tasks.workunit.client.0.smithi055.stdout:7/789: stat d5/d6/d24/d4d/lbe 0 2024-04-26T21:08:23.708 INFO:tasks.workunit.client.0.smithi055.stdout:0/840: dread d9/dc/d1c/d3e/dc5/dcc/d4b/fda [0,4194304] 0 2024-04-26T21:08:23.708 INFO:tasks.workunit.client.0.smithi055.stdout:0/841: fsync d9/dc/d1c/d3e/d7d/fd2 0 2024-04-26T21:08:23.752 INFO:tasks.workunit.client.0.smithi055.stdout:3/872: dwrite d0/d4/d5/db8/fee [0,4194304] 0 2024-04-26T21:08:23.754 INFO:tasks.workunit.client.0.smithi055.stdout:3/873: mkdir d0/d4/d5/d73/d47/dcf/d12c 0 2024-04-26T21:08:23.773 INFO:tasks.workunit.client.0.smithi055.stdout:3/874: dread d0/d4/d5/d73/d47/d37/d3d/d4c/fca [0,4194304] 0 2024-04-26T21:08:23.773 INFO:tasks.workunit.client.0.smithi055.stdout:6/772: dwrite d3/f64 [0,4194304] 0 2024-04-26T21:08:23.773 INFO:tasks.workunit.client.0.smithi055.stdout:2/894: dwrite d4/d55/d6c/fd0 [0,4194304] 0 2024-04-26T21:08:23.773 INFO:tasks.workunit.client.0.smithi055.stdout:0/842: dread d9/dc/d1c/d3e/f89 [0,4194304] 0 2024-04-26T21:08:23.776 INFO:tasks.workunit.client.0.smithi055.stdout:0/843: write d9/dc/d17/d5d/fbc [401209,46477] 0 2024-04-26T21:08:23.776 INFO:tasks.workunit.client.0.smithi055.stdout:0/844: stat d9/d11/d5b/f90 0 2024-04-26T21:08:23.776 INFO:tasks.workunit.client.0.smithi055.stdout:0/845: dread - d9/dc/d19/fd4 zero size 2024-04-26T21:08:23.776 INFO:tasks.workunit.client.0.smithi055.stdout:3/875: link d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3/fd8 d0/d4/d5/f12d 0 2024-04-26T21:08:23.779 INFO:tasks.workunit.client.0.smithi055.stdout:6/773: unlink d3/d17/d46/d109/d66/fb5 0 2024-04-26T21:08:23.781 INFO:tasks.workunit.client.0.smithi055.stdout:2/895: truncate d4/d14/d17/d6d/f72 1603562 0 2024-04-26T21:08:23.783 INFO:tasks.workunit.client.0.smithi055.stdout:0/846: symlink d9/dab/l10e 0 2024-04-26T21:08:23.789 INFO:tasks.workunit.client.0.smithi055.stdout:2/896: rename d4/dc/d21 to d4/d14/dc5/d107/d12d 0 2024-04-26T21:08:23.791 INFO:tasks.workunit.client.1.smithi064.stdout:8/926: dwrite d10/d41/d53/f9b [0,4194304] 0 2024-04-26T21:08:23.791 INFO:tasks.workunit.client.1.smithi064.stdout:5/992: dwrite dd/d12/f49 [0,4194304] 0 2024-04-26T21:08:23.791 INFO:tasks.workunit.client.0.smithi055.stdout:7/790: dwrite d5/d6/d24/d4d/f60 [0,4194304] 0 2024-04-26T21:08:23.792 INFO:tasks.workunit.client.0.smithi055.stdout:1/829: dwrite d8/df/d11/d6c/f73 [0,4194304] 0 2024-04-26T21:08:23.794 INFO:tasks.workunit.client.0.smithi055.stdout:2/897: dread d4/db/d8f/df8/d5e/d7d/fe9 [0,4194304] 0 2024-04-26T21:08:23.794 INFO:tasks.workunit.client.0.smithi055.stdout:2/898: fdatasync d4/db/d8f/da6/fb4 0 2024-04-26T21:08:23.809 INFO:tasks.workunit.client.1.smithi064.stdout:8/927: rename d10/d10d/c8f to d10/c11a 0 2024-04-26T21:08:23.810 INFO:tasks.workunit.client.1.smithi064.stdout:5/993: dread dd/d12/d9a/fe7 [0,4194304] 0 2024-04-26T21:08:23.811 INFO:tasks.workunit.client.0.smithi055.stdout:3/876: dread d0/d4/d5/d73/d47/dcf/ff3 [0,4194304] 0 2024-04-26T21:08:23.811 INFO:tasks.workunit.client.0.smithi055.stdout:3/877: stat d0/d4/d5/d73/d13/d27 0 2024-04-26T21:08:23.811 INFO:tasks.workunit.client.0.smithi055.stdout:7/791: rmdir d5/d6/d39 39 2024-04-26T21:08:23.811 INFO:tasks.workunit.client.0.smithi055.stdout:7/792: chown d5/d6/d24/d3b/lba 162 1 2024-04-26T21:08:23.811 INFO:tasks.workunit.client.0.smithi055.stdout:3/878: write d0/d4/d5/d73/d13/d1a/d46/d72/dd5/fe1 [759167,127378] 0 2024-04-26T21:08:23.814 INFO:tasks.workunit.client.1.smithi064.stdout:8/928: creat d10/d2f/d56/d107/f11b x:0 0 0 2024-04-26T21:08:23.817 INFO:tasks.workunit.client.0.smithi055.stdout:7/793: link d5/d53/d6e/d99/d7f/d6f/dc6/dc8/fb7 d5/d53/d6e/d99/d75/ffc 0 2024-04-26T21:08:23.817 INFO:tasks.workunit.client.0.smithi055.stdout:7/794: chown d5/d53/d6e/d99/d7f/l9e 2 1 2024-04-26T21:08:23.817 INFO:tasks.workunit.client.0.smithi055.stdout:3/879: rmdir d0/d4/df6 39 2024-04-26T21:08:23.819 INFO:tasks.workunit.client.1.smithi064.stdout:8/929: creat d10/d41/d4e/d54/dc3/f11c x:0 0 0 2024-04-26T21:08:23.819 INFO:tasks.workunit.client.1.smithi064.stdout:5/994: dread dd/da9/d48/d6a/f79 [0,4194304] 0 2024-04-26T21:08:23.820 INFO:tasks.workunit.client.0.smithi055.stdout:0/847: write d9/dc/f57 [2204563,19078] 0 2024-04-26T21:08:23.820 INFO:tasks.workunit.client.0.smithi055.stdout:0/848: stat d9/dc/d1c/d3e/dc5/dcc/la4 0 2024-04-26T21:08:23.822 INFO:tasks.workunit.client.1.smithi064.stdout:5/995: rename dd/da9/d63/f7f to dd/dd0/f13b 0 2024-04-26T21:08:23.824 INFO:tasks.workunit.client.0.smithi055.stdout:0/849: mkdir d9/dc/d19/ddb/db6/d6c/d10f 0 2024-04-26T21:08:23.826 INFO:tasks.workunit.client.1.smithi064.stdout:5/996: mkdir dd/d12/d4f/d64/df8/d13c 0 2024-04-26T21:08:23.826 INFO:tasks.workunit.client.0.smithi055.stdout:0/850: symlink d9/dc/d1c/d3e/d7d/da3/l110 0 2024-04-26T21:08:23.829 INFO:tasks.workunit.client.0.smithi055.stdout:0/851: write d9/dc/d1c/d3e/f89 [1361084,106530] 0 2024-04-26T21:08:23.829 INFO:tasks.workunit.client.1.smithi064.stdout:5/997: symlink dd/d12/d4f/d9c/da1/l13d 0 2024-04-26T21:08:23.829 INFO:tasks.workunit.client.1.smithi064.stdout:5/998: write dd/f16 [3060085,6175] 0 2024-04-26T21:08:23.832 INFO:tasks.workunit.client.1.smithi064.stdout:5/999: truncate dd/dd0/f13b 1933471 0 2024-04-26T21:08:23.834 INFO:tasks.workunit.client.0.smithi055.stdout:6/774: dwrite d3/d17/d25/d5f/d90/fb0 [0,4194304] 0 2024-04-26T21:08:23.862 INFO:tasks.workunit.client.0.smithi055.stdout:0/852: write d9/dc/d1c/f26 [2815210,32231] 0 2024-04-26T21:08:23.873 INFO:tasks.workunit.client.0.smithi055.stdout:0/853: fsync d9/dc/d1c/d3e/f89 0 2024-04-26T21:08:23.879 INFO:tasks.workunit.client.0.smithi055.stdout:2/899: dwrite d4/db/d56/f70 [0,4194304] 0 2024-04-26T21:08:23.880 INFO:tasks.workunit.client.0.smithi055.stdout:2/900: fsync d4/db/d26/d9a/fad 0 2024-04-26T21:08:23.880 INFO:tasks.workunit.client.0.smithi055.stdout:2/901: write d4/db/d8f/da6/f105 [484251,9207] 0 2024-04-26T21:08:23.880 INFO:tasks.workunit.client.0.smithi055.stdout:2/902: chown d4/d1e/l65 578203917 1 2024-04-26T21:08:23.884 INFO:tasks.workunit.client.0.smithi055.stdout:2/903: creat d4/d55/da1/f12e x:0 0 0 2024-04-26T21:08:23.884 INFO:tasks.workunit.client.0.smithi055.stdout:2/904: truncate d4/d1e/d2a/fd6 291044 0 2024-04-26T21:08:23.884 INFO:tasks.workunit.client.0.smithi055.stdout:2/905: write d4/db/d1f/f67 [5031997,86282] 0 2024-04-26T21:08:23.887 INFO:tasks.workunit.client.0.smithi055.stdout:2/906: symlink d4/db/d1f/df6/l12f 0 2024-04-26T21:08:23.891 INFO:tasks.workunit.client.0.smithi055.stdout:2/907: rename d4/d14/dc5/d107/d12d/ca7 to d4/d14/d17/d36/df5/c130 0 2024-04-26T21:08:23.891 INFO:tasks.workunit.client.0.smithi055.stdout:7/795: dwrite d5/d53/dd1/f7e [0,4194304] 0 2024-04-26T21:08:23.891 INFO:tasks.workunit.client.0.smithi055.stdout:2/908: read d4/db/d26/f9f [37749,59552] 0 2024-04-26T21:08:23.892 INFO:tasks.workunit.client.0.smithi055.stdout:2/909: write d4/db/d1f/d32/d57/fed [753570,106426] 0 2024-04-26T21:08:23.892 INFO:tasks.workunit.client.0.smithi055.stdout:2/910: chown d4/d7f/lf2 4346054 1 2024-04-26T21:08:23.892 INFO:tasks.workunit.client.1.smithi064.stdout:8/930: dwrite d10/d41/ffd [0,4194304] 0 2024-04-26T21:08:23.893 INFO:tasks.workunit.client.0.smithi055.stdout:2/911: write d4/db/d8f/da6/f105 [390007,86207] 0 2024-04-26T21:08:23.895 INFO:tasks.workunit.client.1.smithi064.stdout:8/931: rmdir d10/d41/d4e/d59/d5d/dea 39 2024-04-26T21:08:23.901 INFO:tasks.workunit.client.0.smithi055.stdout:3/880: dwrite d0/d4/d5/d73/d13/d1a/f54 [4194304,4194304] 0 2024-04-26T21:08:23.904 INFO:tasks.workunit.client.0.smithi055.stdout:3/881: getdents d0 0 2024-04-26T21:08:23.904 INFO:tasks.workunit.client.0.smithi055.stdout:3/882: chown d0/d4/d5/d73/d47/d37/d3d/fed 328858 1 2024-04-26T21:08:23.905 INFO:tasks.workunit.client.0.smithi055.stdout:3/883: mkdir d0/d4/d16/d12e 0 2024-04-26T21:08:23.905 INFO:tasks.workunit.client.0.smithi055.stdout:3/884: fsync d0/d4/d5/f2c 0 2024-04-26T21:08:23.908 INFO:tasks.workunit.client.0.smithi055.stdout:3/885: rename d0/d4/d16/d18/d4b/d57/d8e/db1/f12a to d0/d4/d5/d73/d13/f12f 0 2024-04-26T21:08:23.914 INFO:tasks.workunit.client.1.smithi064.stdout:8/932: write d10/d41/f77 [6908170,19612] 0 2024-04-26T21:08:23.914 INFO:tasks.workunit.client.0.smithi055.stdout:6/775: dwrite d3/d17/fc8 [0,4194304] 0 2024-04-26T21:08:23.918 INFO:tasks.workunit.client.1.smithi064.stdout:8/933: link d10/d41/d4e/d54/fbe d10/d41/d4e/d59/d5d/dd9/f11d 0 2024-04-26T21:08:23.921 INFO:tasks.workunit.client.0.smithi055.stdout:6/776: rename d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/ld9 to d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/d104/l111 0 2024-04-26T21:08:23.921 INFO:tasks.workunit.client.0.smithi055.stdout:2/912: write d4/d1e/f4f [5078153,65238] 0 2024-04-26T21:08:23.929 INFO:tasks.workunit.client.0.smithi055.stdout:3/886: dread d0/d4/d5/f62 [0,4194304] 0 2024-04-26T21:08:23.932 INFO:tasks.workunit.client.0.smithi055.stdout:0/854: dwrite d9/dc/d17/f3f [0,4194304] 0 2024-04-26T21:08:23.932 INFO:tasks.workunit.client.0.smithi055.stdout:0/855: write d9/dc/d19/ddb/fa0 [893282,93850] 0 2024-04-26T21:08:23.934 INFO:tasks.workunit.client.0.smithi055.stdout:0/856: write d9/dc/f10 [3321228,17536] 0 2024-04-26T21:08:23.934 INFO:tasks.workunit.client.0.smithi055.stdout:6/777: dread d3/d17/d25/fbb [0,4194304] 0 2024-04-26T21:08:23.937 INFO:tasks.workunit.client.0.smithi055.stdout:3/887: link d0/d4/d16/d18/d4b/d57/f67 d0/d4/d5/d73/d13/d27/d3b/dcd/f130 0 2024-04-26T21:08:23.937 INFO:tasks.workunit.client.0.smithi055.stdout:3/888: chown d0/d4/d5/d73/l81 2 1 2024-04-26T21:08:23.942 INFO:tasks.workunit.client.0.smithi055.stdout:6/778: rename d3/d17/d46/d109/d66/d6a/f56 to d3/d17/d46/d109/d66/d6a/d51/d58/d6d/f112 0 2024-04-26T21:08:23.943 INFO:tasks.workunit.client.0.smithi055.stdout:6/779: chown d3/da1/de3/db6 153 1 2024-04-26T21:08:23.943 INFO:tasks.workunit.client.0.smithi055.stdout:6/780: stat d3/d17/f81 0 2024-04-26T21:08:23.943 INFO:tasks.workunit.client.0.smithi055.stdout:6/781: fdatasync d3/d17/d46/d109/d66/d6a/d51/d58/d6d/f112 0 2024-04-26T21:08:23.951 INFO:tasks.workunit.client.0.smithi055.stdout:6/782: rmdir d3/da1/de3/db6 39 2024-04-26T21:08:23.951 INFO:tasks.workunit.client.0.smithi055.stdout:6/783: stat d3/d17/f18 0 2024-04-26T21:08:23.957 INFO:tasks.workunit.client.0.smithi055.stdout:6/784: creat d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 x:0 0 0 2024-04-26T21:08:23.973 INFO:tasks.workunit.client.1.smithi064.stdout:8/934: dwrite d10/d2f/d90/f93 [4194304,4194304] 0 2024-04-26T21:08:23.973 INFO:tasks.workunit.client.1.smithi064.stdout:8/935: creat d10/d41/d44/d5a/da2/f11e x:0 0 0 2024-04-26T21:08:23.976 INFO:tasks.workunit.client.0.smithi055.stdout:7/796: dwrite d5/d53/dd1/f7e [0,4194304] 0 2024-04-26T21:08:23.994 INFO:tasks.workunit.client.0.smithi055.stdout:3/889: dwrite d0/d4/d5/d73/d13/f7e [0,4194304] 0 2024-04-26T21:08:24.009 INFO:tasks.workunit.client.0.smithi055.stdout:3/890: dread d0/d4/d16/d18/d4b/d57/f67 [0,4194304] 0 2024-04-26T21:08:24.010 INFO:tasks.workunit.client.0.smithi055.stdout:6/785: dwrite d3/d17/d46/f7f [0,4194304] 0 2024-04-26T21:08:24.011 INFO:tasks.workunit.client.0.smithi055.stdout:3/891: getdents d0/d4 0 2024-04-26T21:08:24.011 INFO:tasks.workunit.client.0.smithi055.stdout:3/892: readlink d0/d4/d5/lc 0 2024-04-26T21:08:24.011 INFO:tasks.workunit.client.0.smithi055.stdout:3/893: readlink d0/d4/d5/lcb 0 2024-04-26T21:08:24.011 INFO:tasks.workunit.client.1.smithi064.stdout:8/936: dwrite d10/d41/d44/f100 [0,4194304] 0 2024-04-26T21:08:24.013 INFO:tasks.workunit.client.1.smithi064.stdout:8/937: rmdir d10/d41/d4e/d59/d5d/d79/ddf/df2 0 2024-04-26T21:08:24.015 INFO:tasks.workunit.client.1.smithi064.stdout:8/938: truncate f4 4168883 0 2024-04-26T21:08:24.017 INFO:tasks.workunit.client.0.smithi055.stdout:3/894: unlink d0/d4/d5/d73/d47/d37/fce 0 2024-04-26T21:08:24.017 INFO:tasks.workunit.client.0.smithi055.stdout:3/895: write d0/d4/d5/f127 [80390,65599] 0 2024-04-26T21:08:24.017 INFO:tasks.workunit.client.0.smithi055.stdout:3/896: write d0/d4/d5/d73/d13/d1a/d46/d72/fd1 [1029846,129220] 0 2024-04-26T21:08:24.020 INFO:tasks.workunit.client.0.smithi055.stdout:6/786: mknod d3/c114 0 2024-04-26T21:08:24.020 INFO:tasks.workunit.client.0.smithi055.stdout:6/787: chown d3/d17/d25/f9c 3707 1 2024-04-26T21:08:24.020 INFO:tasks.workunit.client.1.smithi064.stdout:8/939: rmdir d10/d2f/d56/d107 39 2024-04-26T21:08:24.020 INFO:tasks.workunit.client.1.smithi064.stdout:8/940: write d10/d41/d4e/d54/dc3/f11c [1033505,122577] 0 2024-04-26T21:08:24.022 INFO:tasks.workunit.client.1.smithi064.stdout:8/941: rename d10/d41/d4e/d59/fc6 to d10/d41/d53/f11f 0 2024-04-26T21:08:24.023 INFO:tasks.workunit.client.0.smithi055.stdout:6/788: write d3/d17/d19/f49 [552709,127045] 0 2024-04-26T21:08:24.024 INFO:tasks.workunit.client.1.smithi064.stdout:8/942: creat d10/d2f/d90/da0/f120 x:0 0 0 2024-04-26T21:08:24.024 INFO:tasks.workunit.client.1.smithi064.stdout:8/943: creat d10/d2f/f121 x:0 0 0 2024-04-26T21:08:24.025 INFO:tasks.workunit.client.0.smithi055.stdout:2/913: dwrite d4/db/d26/f122 [0,4194304] 0 2024-04-26T21:08:24.025 INFO:tasks.workunit.client.0.smithi055.stdout:2/914: read d4/db/d26/f4d [290400,89951] 0 2024-04-26T21:08:24.025 INFO:tasks.workunit.client.0.smithi055.stdout:2/915: readlink d4/db/d1f/df6/l12f 0 2024-04-26T21:08:24.034 INFO:tasks.workunit.client.0.smithi055.stdout:3/897: write d0/d4/d5/d73/d13/d1a/f24 [4858774,44609] 0 2024-04-26T21:08:24.040 INFO:tasks.workunit.client.0.smithi055.stdout:2/916: write d4/db/d26/d9a/f10f [981767,121950] 0 2024-04-26T21:08:24.041 INFO:tasks.workunit.client.0.smithi055.stdout:2/917: unlink d4/d1e/l76 0 2024-04-26T21:08:24.042 INFO:tasks.workunit.client.0.smithi055.stdout:2/918: creat d4/db/d8f/da6/dfc/f131 x:0 0 0 2024-04-26T21:08:24.055 INFO:tasks.workunit.client.0.smithi055.stdout:4/646: sync 2024-04-26T21:08:24.056 INFO:tasks.workunit.client.0.smithi055.stdout:4/647: mknod d4/d12/d61/d93/cd6 0 2024-04-26T21:08:24.058 INFO:tasks.workunit.client.0.smithi055.stdout:4/648: rename d4/d12/d17/d3d/cbc to d4/d18/d86/cd7 0 2024-04-26T21:08:24.058 INFO:tasks.workunit.client.0.smithi055.stdout:4/649: dread - d4/d26/d42/d28/d53/d71/fb7 zero size 2024-04-26T21:08:24.059 INFO:tasks.workunit.client.0.smithi055.stdout:4/650: symlink d4/d18/d1a/d49/dae/dc0/ld8 0 2024-04-26T21:08:24.060 INFO:tasks.workunit.client.0.smithi055.stdout:4/651: link d4/d12/d57/c6a d4/d26/d42/d2d/cd9 0 2024-04-26T21:08:24.060 INFO:tasks.workunit.client.0.smithi055.stdout:4/652: write d4/d26/d42/d56/f96 [379397,89531] 0 2024-04-26T21:08:24.074 INFO:tasks.workunit.client.0.smithi055.stdout:7/797: dwrite d5/d6/f41 [0,4194304] 0 2024-04-26T21:08:24.076 INFO:tasks.workunit.client.0.smithi055.stdout:7/798: creat d5/d53/d6e/d99/d7f/d6f/dc6/dc8/ffd x:0 0 0 2024-04-26T21:08:24.076 INFO:tasks.workunit.client.0.smithi055.stdout:7/799: chown d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/cc2 114973 1 2024-04-26T21:08:24.077 INFO:tasks.workunit.client.0.smithi055.stdout:7/800: truncate d5/d6/d24/d3b/f4e 945658 0 2024-04-26T21:08:24.098 INFO:tasks.workunit.client.1.smithi064.stdout:8/944: dwrite d10/d41/d53/f64 [0,4194304] 0 2024-04-26T21:08:24.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/653: write d4/f11 [5114973,20621] 0 2024-04-26T21:08:24.104 INFO:tasks.workunit.client.0.smithi055.stdout:6/789: dwrite d3/d17/d25/f2b [0,4194304] 0 2024-04-26T21:08:24.116 INFO:tasks.workunit.client.0.smithi055.stdout:6/790: truncate d3/d17/d25/f2b 819680 0 2024-04-26T21:08:24.119 INFO:tasks.workunit.client.0.smithi055.stdout:6/791: link d3/d17/faa d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/d104/f115 0 2024-04-26T21:08:24.119 INFO:tasks.workunit.client.0.smithi055.stdout:6/792: write d3/d17/d46/d109/fe2 [666654,86397] 0 2024-04-26T21:08:24.119 INFO:tasks.workunit.client.0.smithi055.stdout:6/793: write d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 [334701,119126] 0 2024-04-26T21:08:24.121 INFO:tasks.workunit.client.1.smithi064.stdout:8/945: dread d10/d41/d4e/fbb [4194304,4194304] 0 2024-04-26T21:08:24.129 INFO:tasks.workunit.client.0.smithi055.stdout:3/898: dwrite d0/d4/d16/d18/d4b/d57/f67 [0,4194304] 0 2024-04-26T21:08:24.129 INFO:tasks.workunit.client.0.smithi055.stdout:3/899: read d0/d4/d5/f2c [1242305,58778] 0 2024-04-26T21:08:24.130 INFO:tasks.workunit.client.1.smithi064.stdout:8/946: dread d10/d41/d4e/d54/fcf [0,4194304] 0 2024-04-26T21:08:24.132 INFO:tasks.workunit.client.1.smithi064.stdout:8/947: creat d10/d41/d4e/d59/f122 x:0 0 0 2024-04-26T21:08:24.138 INFO:tasks.workunit.client.0.smithi055.stdout:6/794: read d3/d17/d19/f1e [1017200,64302] 0 2024-04-26T21:08:24.138 INFO:tasks.workunit.client.0.smithi055.stdout:6/795: write d3/da1/de3/db6/fea [517070,15471] 0 2024-04-26T21:08:24.140 INFO:tasks.workunit.client.0.smithi055.stdout:6/796: mkdir d3/d17/d25/d5f/d90/d116 0 2024-04-26T21:08:24.140 INFO:tasks.workunit.client.0.smithi055.stdout:6/797: chown d3/d17/d46/d109/d66/d6a/d51/d58/d6d 104232 1 2024-04-26T21:08:24.143 INFO:tasks.workunit.client.0.smithi055.stdout:6/798: creat d3/d17/d46/d109/d66/d6a/d51/f117 x:0 0 0 2024-04-26T21:08:24.143 INFO:tasks.workunit.client.0.smithi055.stdout:6/799: chown d3/d17/d19/d7b 23 1 2024-04-26T21:08:24.143 INFO:tasks.workunit.client.0.smithi055.stdout:6/800: fdatasync d3/d17/d46/d109/d66/d6a/d67/f99 0 2024-04-26T21:08:24.144 INFO:tasks.workunit.client.0.smithi055.stdout:6/801: creat d3/d17/d25/d5f/d90/d116/f118 x:0 0 0 2024-04-26T21:08:24.144 INFO:tasks.workunit.client.0.smithi055.stdout:6/802: write d3/f30 [1475364,76011] 0 2024-04-26T21:08:24.146 INFO:tasks.workunit.client.0.smithi055.stdout:6/803: creat d3/d17/d46/d109/d66/d6a/d67/d83/d96/f119 x:0 0 0 2024-04-26T21:08:24.147 INFO:tasks.workunit.client.0.smithi055.stdout:6/804: read d3/d17/d19/d71/dca/dcb/d10e/fb4 [199598,120772] 0 2024-04-26T21:08:24.149 INFO:tasks.workunit.client.0.smithi055.stdout:6/805: rename d3/d17/f81 to d3/d17/d46/d109/d66/d6a/d51/d58/d62/f11a 0 2024-04-26T21:08:24.149 INFO:tasks.workunit.client.0.smithi055.stdout:6/806: dread - d3/d17/d46/d109/d66/d6a/d67/f99 zero size 2024-04-26T21:08:24.150 INFO:tasks.workunit.client.0.smithi055.stdout:6/807: symlink d3/d17/d19/d71/dca/d103/l11b 0 2024-04-26T21:08:24.164 INFO:tasks.workunit.client.0.smithi055.stdout:7/801: dwrite d5/d53/d6e/d6c/fd5 [0,4194304] 0 2024-04-26T21:08:24.184 INFO:tasks.workunit.client.0.smithi055.stdout:7/802: write d5/d6/d24/f91 [3616568,10355] 0 2024-04-26T21:08:24.188 INFO:tasks.workunit.client.0.smithi055.stdout:7/803: mknod d5/d53/dd1/cfe 0 2024-04-26T21:08:24.193 INFO:tasks.workunit.client.0.smithi055.stdout:2/919: dwrite d4/db/d1f/d46/d51/fbb [0,4194304] 0 2024-04-26T21:08:24.199 INFO:tasks.workunit.client.1.smithi064.stdout:8/948: dwrite d10/d10d/ffb [0,4194304] 0 2024-04-26T21:08:24.200 INFO:tasks.workunit.client.0.smithi055.stdout:4/654: dwrite d4/d12/d15/fcb [0,4194304] 0 2024-04-26T21:08:24.201 INFO:tasks.workunit.client.1.smithi064.stdout:8/949: mkdir d10/d2f/d56/d123 0 2024-04-26T21:08:24.203 INFO:tasks.workunit.client.0.smithi055.stdout:4/655: rmdir d4/d18/d1a/d49 39 2024-04-26T21:08:24.206 INFO:tasks.workunit.client.0.smithi055.stdout:7/804: truncate d5/d53/d6e/d6c/fd5 394839 0 2024-04-26T21:08:24.207 INFO:tasks.workunit.client.0.smithi055.stdout:7/805: symlink d5/d6/d39/deb/lff 0 2024-04-26T21:08:24.214 INFO:tasks.workunit.client.0.smithi055.stdout:6/808: dwrite d3/d17/f94 [0,4194304] 0 2024-04-26T21:08:24.219 INFO:tasks.workunit.client.0.smithi055.stdout:6/809: rename d3/d17/d19/d71/dca/dcb/d10e/lbf to d3/d17/d19/d71/dca/d103/l11c 0 2024-04-26T21:08:24.221 INFO:tasks.workunit.client.0.smithi055.stdout:6/810: rename d3/d17/d46/l80 to d3/d17/d19/d71/dca/dcb/l11d 0 2024-04-26T21:08:24.221 INFO:tasks.workunit.client.0.smithi055.stdout:3/900: dwrite d0/d4/d5/d73/d13/d27/d3b/dcd/f130 [0,4194304] 0 2024-04-26T21:08:24.221 INFO:tasks.workunit.client.0.smithi055.stdout:3/901: chown d0/de/l126 21502 1 2024-04-26T21:08:24.221 INFO:tasks.workunit.client.0.smithi055.stdout:3/902: write d0/d4/df6/f118 [265749,30226] 0 2024-04-26T21:08:24.222 INFO:tasks.workunit.client.0.smithi055.stdout:3/903: write d0/d4/d5/d73/d13/fe4 [818398,79423] 0 2024-04-26T21:08:24.223 INFO:tasks.workunit.client.0.smithi055.stdout:5/651: sync 2024-04-26T21:08:24.224 INFO:tasks.workunit.client.0.smithi055.stdout:9/831: sync 2024-04-26T21:08:24.224 INFO:tasks.workunit.client.0.smithi055.stdout:0/857: sync 2024-04-26T21:08:24.224 INFO:tasks.workunit.client.0.smithi055.stdout:0/858: chown d9/d8b/fe1 0 1 2024-04-26T21:08:24.224 INFO:tasks.workunit.client.0.smithi055.stdout:1/830: sync 2024-04-26T21:08:24.224 INFO:tasks.workunit.client.0.smithi055.stdout:1/831: truncate d8/d94/dd9/ff0 344335 0 2024-04-26T21:08:24.225 INFO:tasks.workunit.client.0.smithi055.stdout:8/650: sync 2024-04-26T21:08:24.238 INFO:tasks.workunit.client.0.smithi055.stdout:0/859: creat d9/dc/d19/ddb/db6/d67/f111 x:0 0 0 2024-04-26T21:08:24.239 INFO:tasks.workunit.client.0.smithi055.stdout:9/832: getdents d2/d11 0 2024-04-26T21:08:24.240 INFO:tasks.workunit.client.0.smithi055.stdout:9/833: truncate d2/d46/d9a/da7/fdb 206946 0 2024-04-26T21:08:24.242 INFO:tasks.workunit.client.0.smithi055.stdout:0/860: unlink l3 0 2024-04-26T21:08:24.242 INFO:tasks.workunit.client.0.smithi055.stdout:0/861: creat d9/dc/d1c/d3e/dc5/dcc/d4b/f112 x:0 0 0 2024-04-26T21:08:24.244 INFO:tasks.workunit.client.0.smithi055.stdout:1/832: dread d8/d17/d1b/d7b/d8d/f79 [0,4194304] 0 2024-04-26T21:08:24.244 INFO:tasks.workunit.client.0.smithi055.stdout:1/833: stat d8/df/d11/d27/ca1 0 2024-04-26T21:08:24.246 INFO:tasks.workunit.client.0.smithi055.stdout:9/834: creat d2/d46/d77/f122 x:0 0 0 2024-04-26T21:08:24.249 INFO:tasks.workunit.client.0.smithi055.stdout:1/834: creat d8/df/d11/d27/d28/f11b x:0 0 0 2024-04-26T21:08:24.250 INFO:tasks.workunit.client.0.smithi055.stdout:9/835: creat d2/d46/d77/d79/de0/f123 x:0 0 0 2024-04-26T21:08:24.252 INFO:tasks.workunit.client.0.smithi055.stdout:5/652: write d4/df/dae/dce/d4a/f56 [4187632,660] 0 2024-04-26T21:08:24.252 INFO:tasks.workunit.client.0.smithi055.stdout:5/653: stat d4/df/dae/dce/d93/dcb/f1f 0 2024-04-26T21:08:24.258 INFO:tasks.workunit.client.0.smithi055.stdout:1/835: truncate d8/d17/d6a/f99 327662 0 2024-04-26T21:08:24.260 INFO:tasks.workunit.client.0.smithi055.stdout:1/836: truncate d8/d17/d1b/d41/f8f 1139083 0 2024-04-26T21:08:24.264 INFO:tasks.workunit.client.0.smithi055.stdout:5/654: symlink d4/df/dae/dce/d5b/le4 0 2024-04-26T21:08:24.267 INFO:tasks.workunit.client.0.smithi055.stdout:7/806: dread d5/d53/d6e/d99/d58/f5f [0,4194304] 0 2024-04-26T21:08:24.267 INFO:tasks.workunit.client.0.smithi055.stdout:7/807: fsync d5/d6/ff2 0 2024-04-26T21:08:24.267 INFO:tasks.workunit.client.0.smithi055.stdout:5/655: symlink d4/df/dae/dce/d4a/d92/le5 0 2024-04-26T21:08:24.267 INFO:tasks.workunit.client.0.smithi055.stdout:5/656: chown d4/df/dae/dce/c49 90 1 2024-04-26T21:08:24.269 INFO:tasks.workunit.client.0.smithi055.stdout:5/657: creat d4/df/d13/d26/fe6 x:0 0 0 2024-04-26T21:08:24.269 INFO:tasks.workunit.client.0.smithi055.stdout:5/658: fsync d4/df/dae/dce/d93/dcb/f89 0 2024-04-26T21:08:24.281 INFO:tasks.workunit.client.0.smithi055.stdout:8/651: dread d3/dc0/fae [0,4194304] 0 2024-04-26T21:08:24.281 INFO:tasks.workunit.client.0.smithi055.stdout:8/652: write d3/d9/d44/fb8 [805192,128730] 0 2024-04-26T21:08:24.281 INFO:tasks.workunit.client.0.smithi055.stdout:8/653: write d3/dc0/d2e/da6/fd2 [585707,104352] 0 2024-04-26T21:08:24.284 INFO:tasks.workunit.client.0.smithi055.stdout:8/654: mknod d3/d77/da9/cdb 0 2024-04-26T21:08:24.285 INFO:tasks.workunit.client.1.smithi064.stdout:8/950: dwrite d10/d41/f77 [8388608,4194304] 0 2024-04-26T21:08:24.286 INFO:tasks.workunit.client.0.smithi055.stdout:8/655: mkdir d3/dc0/d2e/ddc 0 2024-04-26T21:08:24.287 INFO:tasks.workunit.client.0.smithi055.stdout:8/656: write d3/d9/d44/fb8 [15017,61563] 0 2024-04-26T21:08:24.290 INFO:tasks.workunit.client.1.smithi064.stdout:8/951: mknod d10/d1d/da3/d10b/c124 0 2024-04-26T21:08:24.290 INFO:tasks.workunit.client.1.smithi064.stdout:8/952: truncate d10/d1d/da3/fd5 160899 0 2024-04-26T21:08:24.293 INFO:tasks.workunit.client.0.smithi055.stdout:8/657: creat d3/d9/d1d/d48/fdd x:0 0 0 2024-04-26T21:08:24.293 INFO:tasks.workunit.client.0.smithi055.stdout:1/837: dread d8/d17/d1b/d7b/d8d/f54 [0,4194304] 0 2024-04-26T21:08:24.296 INFO:tasks.workunit.client.0.smithi055.stdout:8/658: creat d3/dc0/d2e/d75/d76/fde x:0 0 0 2024-04-26T21:08:24.296 INFO:tasks.workunit.client.1.smithi064.stdout:8/953: read d10/d41/d4e/d59/d5d/d79/fd6 [377781,17292] 0 2024-04-26T21:08:24.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/659: creat d3/d9/d1d/d48/d57/fdf x:0 0 0 2024-04-26T21:08:24.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/660: dread - d3/d9/d5b/da4/dc5/fcf zero size 2024-04-26T21:08:24.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/661: read - d3/d9/d1d/d48/d57/d61/f8c zero size 2024-04-26T21:08:24.299 INFO:tasks.workunit.client.0.smithi055.stdout:8/662: chown d3/d9/d1d/d48/d4b/l54 1342530 1 2024-04-26T21:08:24.301 INFO:tasks.workunit.client.0.smithi055.stdout:4/656: dwrite d4/ff [0,4194304] 0 2024-04-26T21:08:24.301 INFO:tasks.workunit.client.1.smithi064.stdout:8/954: symlink d10/d41/d4e/l125 0 2024-04-26T21:08:24.305 INFO:tasks.workunit.client.0.smithi055.stdout:8/663: getdents d3/d9/d5b/da4 0 2024-04-26T21:08:24.305 INFO:tasks.workunit.client.0.smithi055.stdout:8/664: chown d3/dc0/l2a 150680 1 2024-04-26T21:08:24.306 INFO:tasks.workunit.client.1.smithi064.stdout:8/955: mknod d10/d1d/da3/c126 0 2024-04-26T21:08:24.306 INFO:tasks.workunit.client.1.smithi064.stdout:8/956: write d10/d41/fe0 [3845769,56562] 0 2024-04-26T21:08:24.309 INFO:tasks.workunit.client.0.smithi055.stdout:4/657: rename d4/d26/d42/d28/d53/d71/d7f/da1/ca2 to d4/d18/d8e/cda 0 2024-04-26T21:08:24.311 INFO:tasks.workunit.client.1.smithi064.stdout:8/957: creat d10/d41/d4e/d59/d5d/dea/df4/f127 x:0 0 0 2024-04-26T21:08:24.314 INFO:tasks.workunit.client.0.smithi055.stdout:2/920: dwrite d4/db/d1f/d32/d57/fd1 [0,4194304] 0 2024-04-26T21:08:24.314 INFO:tasks.workunit.client.0.smithi055.stdout:8/665: rename d3/d9/d1d/d48/c87 to d3/d9/d1d/d48/d80/ce0 0 2024-04-26T21:08:24.315 INFO:tasks.workunit.client.0.smithi055.stdout:0/862: dwrite d9/dc/d19/ddb/db6/d6c/f84 [0,4194304] 0 2024-04-26T21:08:24.316 INFO:tasks.workunit.client.0.smithi055.stdout:4/658: creat d4/d12/d17/fdb x:0 0 0 2024-04-26T21:08:24.316 INFO:tasks.workunit.client.1.smithi064.stdout:8/958: mkdir d10/d2f/d128 0 2024-04-26T21:08:24.317 INFO:tasks.workunit.client.0.smithi055.stdout:7/808: dwrite d5/d6/d24/d3b/f3c [0,4194304] 0 2024-04-26T21:08:24.319 INFO:tasks.workunit.client.0.smithi055.stdout:5/659: getdents d4/df/d13/d26 0 2024-04-26T21:08:24.326 INFO:tasks.workunit.client.0.smithi055.stdout:2/921: truncate d4/db/d56/f7c 966105 0 2024-04-26T21:08:24.326 INFO:tasks.workunit.client.0.smithi055.stdout:2/922: fsync d4/db/d8f/df8/f73 0 2024-04-26T21:08:24.330 INFO:tasks.workunit.client.1.smithi064.stdout:8/959: truncate d10/d41/d4e/d59/fc5 997067 0 2024-04-26T21:08:24.331 INFO:tasks.workunit.client.0.smithi055.stdout:9/836: dwrite d2/d46/d9a/da7/fdb [0,4194304] 0 2024-04-26T21:08:24.331 INFO:tasks.workunit.client.0.smithi055.stdout:6/811: dwrite d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/d104/f115 [0,4194304] 0 2024-04-26T21:08:24.331 INFO:tasks.workunit.client.0.smithi055.stdout:6/812: chown d3/d17/d46/d109/d66/d6a/d51/d58/d62/f78 455024 1 2024-04-26T21:08:24.335 INFO:tasks.workunit.client.0.smithi055.stdout:3/904: dwrite d0/d4/d5/d73/d13/f12f [0,4194304] 0 2024-04-26T21:08:24.336 INFO:tasks.workunit.client.0.smithi055.stdout:3/905: fdatasync d0/d4/d16/d18/d4b/d57/d8e/de0/f111 0 2024-04-26T21:08:24.336 INFO:tasks.workunit.client.1.smithi064.stdout:8/960: rename d10/d1d/c35 to d10/d2f/d90/c129 0 2024-04-26T21:08:24.345 INFO:tasks.workunit.client.1.smithi064.stdout:8/961: rename d10/f9e to d10/f12a 0 2024-04-26T21:08:24.350 INFO:tasks.workunit.client.0.smithi055.stdout:2/923: creat d4/db/d1f/d32/dcd/f132 x:0 0 0 2024-04-26T21:08:24.354 INFO:tasks.workunit.client.0.smithi055.stdout:8/666: rmdir d3/d9/d5b/da4/dc5 39 2024-04-26T21:08:24.355 INFO:tasks.workunit.client.0.smithi055.stdout:9/837: creat d2/d46/d77/f124 x:0 0 0 2024-04-26T21:08:24.359 INFO:tasks.workunit.client.0.smithi055.stdout:0/863: mkdir d9/dc/d1c/d3e/dc5/dcc/d4b/d113 0 2024-04-26T21:08:24.359 INFO:tasks.workunit.client.0.smithi055.stdout:0/864: fsync d9/dc/d1c/d3e/dc5/dcc/f44 0 2024-04-26T21:08:24.360 INFO:tasks.workunit.client.0.smithi055.stdout:2/924: unlink d4/d14/dc5/ce1 0 2024-04-26T21:08:24.362 INFO:tasks.workunit.client.0.smithi055.stdout:1/838: dwrite d8/d17/d1b/d7b/d65/fa8 [0,4194304] 0 2024-04-26T21:08:24.365 INFO:tasks.workunit.client.0.smithi055.stdout:8/667: symlink d3/d9/d1d/d48/d57/d61/d9b/le1 0 2024-04-26T21:08:24.365 INFO:tasks.workunit.client.0.smithi055.stdout:0/865: mknod d9/dc/d19/ddb/db6/d6c/d10f/c114 0 2024-04-26T21:08:24.376 INFO:tasks.workunit.client.0.smithi055.stdout:6/813: write d3/d17/d19/d71/f44 [1040558,3528] 0 2024-04-26T21:08:24.378 INFO:tasks.workunit.client.0.smithi055.stdout:2/925: write d4/db/d1f/d46/fee [1538044,92331] 0 2024-04-26T21:08:24.378 INFO:tasks.workunit.client.0.smithi055.stdout:2/926: stat d4/dc/l11a 0 2024-04-26T21:08:24.378 INFO:tasks.workunit.client.0.smithi055.stdout:2/927: getdents d4/d49/d128 0 2024-04-26T21:08:24.381 INFO:tasks.workunit.client.0.smithi055.stdout:6/814: rename d3/d17/d46/d109/d66/d6a/l2a to d3/d17/d46/dc2/dd4/l11e 0 2024-04-26T21:08:24.381 INFO:tasks.workunit.client.0.smithi055.stdout:6/815: getdents d3/d17/d46/d109/d66/d6a/d67/dfe 0 2024-04-26T21:08:24.386 INFO:tasks.workunit.client.0.smithi055.stdout:8/668: read d3/d9/d1d/d48/d57/fb2 [1918855,59107] 0 2024-04-26T21:08:24.394 INFO:tasks.workunit.client.0.smithi055.stdout:5/660: dread d4/df/f3b [0,4194304] 0 2024-04-26T21:08:24.394 INFO:tasks.workunit.client.0.smithi055.stdout:5/661: write d4/df/dae/dce/d4a/f8a [124892,67001] 0 2024-04-26T21:08:24.396 INFO:tasks.workunit.client.0.smithi055.stdout:4/659: dread d4/d18/d1a/f7d [0,4194304] 0 2024-04-26T21:08:24.397 INFO:tasks.workunit.client.0.smithi055.stdout:4/660: chown d4/d18/d1a/d49/f9a 10 1 2024-04-26T21:08:24.397 INFO:tasks.workunit.client.0.smithi055.stdout:8/669: creat d3/d89/daa/fe2 x:0 0 0 2024-04-26T21:08:24.399 INFO:tasks.workunit.client.0.smithi055.stdout:7/809: dwrite d5/d11/f2f [0,4194304] 0 2024-04-26T21:08:24.400 INFO:tasks.workunit.client.0.smithi055.stdout:5/662: rmdir d4/df/dae/dce/d4a/d3f/d4f/d53/dd6 0 2024-04-26T21:08:24.402 INFO:tasks.workunit.client.0.smithi055.stdout:8/670: symlink d3/d9/d1d/d48/d57/le3 0 2024-04-26T21:08:24.402 INFO:tasks.workunit.client.0.smithi055.stdout:8/671: readlink d3/d9/d1d/d48/d57/l7b 0 2024-04-26T21:08:24.402 INFO:tasks.workunit.client.0.smithi055.stdout:8/672: dread - d3/d9/d1d/d48/d57/d61/d9b/f9e zero size 2024-04-26T21:08:24.411 INFO:tasks.workunit.client.0.smithi055.stdout:7/810: mkdir d5/d53/d6e/d99/d7f/d6f/ddc/d100 0 2024-04-26T21:08:24.412 INFO:tasks.workunit.client.0.smithi055.stdout:5/663: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fe7 x:0 0 0 2024-04-26T21:08:24.412 INFO:tasks.workunit.client.0.smithi055.stdout:8/673: unlink d3/d9/c10 0 2024-04-26T21:08:24.415 INFO:tasks.workunit.client.0.smithi055.stdout:5/664: rmdir d4 39 2024-04-26T21:08:24.415 INFO:tasks.workunit.client.0.smithi055.stdout:5/665: readlink d4/df/d13/d26/l2b 0 2024-04-26T21:08:24.418 INFO:tasks.workunit.client.0.smithi055.stdout:4/661: write d4/f13 [3542680,57240] 0 2024-04-26T21:08:24.418 INFO:tasks.workunit.client.0.smithi055.stdout:4/662: chown d4/d26/d42/d28/d53/d71/lc5 34891 1 2024-04-26T21:08:24.418 INFO:tasks.workunit.client.0.smithi055.stdout:4/663: chown d4/d26/d42/d28/d53/d70/f8f 7 1 2024-04-26T21:08:24.418 INFO:tasks.workunit.client.0.smithi055.stdout:6/816: write d3/d17/d46/d109/d66/fac [3265428,72348] 0 2024-04-26T21:08:24.418 INFO:tasks.workunit.client.1.smithi064.stdout:8/962: dwrite d10/d41/d4e/d59/fdc [0,4194304] 0 2024-04-26T21:08:24.421 INFO:tasks.workunit.client.0.smithi055.stdout:7/811: dread d5/d6/d39/dbc/fcb [0,4194304] 0 2024-04-26T21:08:24.422 INFO:tasks.workunit.client.0.smithi055.stdout:6/817: mkdir d3/d17/d19/d71/dca/dcb/d10e/ddf/d11f 0 2024-04-26T21:08:24.422 INFO:tasks.workunit.client.0.smithi055.stdout:6/818: stat d3/d17/d19/d71/c97 0 2024-04-26T21:08:24.422 INFO:tasks.workunit.client.0.smithi055.stdout:6/819: write d3/f5b [1657263,102676] 0 2024-04-26T21:08:24.433 INFO:tasks.workunit.client.1.smithi064.stdout:8/963: symlink d10/d41/d53/l12b 0 2024-04-26T21:08:24.435 INFO:tasks.workunit.client.0.smithi055.stdout:6/820: unlink d3/d17/d19/l65 0 2024-04-26T21:08:24.437 INFO:tasks.workunit.client.0.smithi055.stdout:7/812: read d5/d53/d6e/d65/f94 [761076,56786] 0 2024-04-26T21:08:24.437 INFO:tasks.workunit.client.0.smithi055.stdout:7/813: chown d5/d53/dd1 13 1 2024-04-26T21:08:24.440 INFO:tasks.workunit.client.0.smithi055.stdout:6/821: mknod d3/d17/d46/d109/d66/d6a/d67/d83/d96/c120 0 2024-04-26T21:08:24.443 INFO:tasks.workunit.client.0.smithi055.stdout:6/822: rename d3/d17/d46/d109/d66/d6a/d51/d58/d62/f6e to d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/f121 0 2024-04-26T21:08:24.474 INFO:tasks.workunit.client.1.smithi064.stdout:8/964: truncate d10/d2f/d90/f103 805717 0 2024-04-26T21:08:24.477 INFO:tasks.workunit.client.1.smithi064.stdout:8/965: link l1 d10/d41/d4e/d60/l12c 0 2024-04-26T21:08:24.479 INFO:tasks.workunit.client.1.smithi064.stdout:8/966: creat d10/d1d/d38/f12d x:0 0 0 2024-04-26T21:08:24.479 INFO:tasks.workunit.client.1.smithi064.stdout:8/967: truncate d10/d41/d4e/d54/fbe 9143544 0 2024-04-26T21:08:24.479 INFO:tasks.workunit.client.1.smithi064.stdout:8/968: write d10/d1d/f30 [4067385,61115] 0 2024-04-26T21:08:24.479 INFO:tasks.workunit.client.1.smithi064.stdout:8/969: creat d10/d41/d4e/d54/db3/f12e x:0 0 0 2024-04-26T21:08:24.481 INFO:tasks.workunit.client.1.smithi064.stdout:8/970: symlink d10/d41/d4e/d59/l12f 0 2024-04-26T21:08:24.482 INFO:tasks.workunit.client.1.smithi064.stdout:8/971: chown d10/d1d/d38/fb0 1587767 1 2024-04-26T21:08:24.483 INFO:tasks.workunit.client.1.smithi064.stdout:8/972: mkdir d10/d41/d53/d104/d130 0 2024-04-26T21:08:24.484 INFO:tasks.workunit.client.0.smithi055.stdout:0/866: dwrite d9/dc/d1c/d3e/dc5/dcc/d4b/fda [0,4194304] 0 2024-04-26T21:08:24.484 INFO:tasks.workunit.client.0.smithi055.stdout:0/867: chown d9/dc/d1c/d3e/f6a 0 1 2024-04-26T21:08:24.484 INFO:tasks.workunit.client.0.smithi055.stdout:2/928: dwrite d4/d55/f10a [0,4194304] 0 2024-04-26T21:08:24.485 INFO:tasks.workunit.client.0.smithi055.stdout:2/929: fdatasync d4/db/d8f/df8/d5e/d7d/fe9 0 2024-04-26T21:08:24.487 INFO:tasks.workunit.client.0.smithi055.stdout:6/823: dread d3/d17/d25/fbb [0,4194304] 0 2024-04-26T21:08:24.487 INFO:tasks.workunit.client.0.smithi055.stdout:6/824: dread - d3/d17/d46/d109/d66/d6a/d67/ffb zero size 2024-04-26T21:08:24.487 INFO:tasks.workunit.client.0.smithi055.stdout:6/825: fdatasync d3/d17/d46/d109/fe2 0 2024-04-26T21:08:24.488 INFO:tasks.workunit.client.1.smithi064.stdout:8/973: mknod d10/c131 0 2024-04-26T21:08:24.499 INFO:tasks.workunit.client.0.smithi055.stdout:4/664: dread d4/d12/d15/f6f [0,4194304] 0 2024-04-26T21:08:24.517 INFO:tasks.workunit.client.0.smithi055.stdout:0/868: chown d9/d11/d59/d78/d106/f60 1425 1 2024-04-26T21:08:24.518 INFO:tasks.workunit.client.0.smithi055.stdout:6/826: link d3/d17/d46/d109/d66/d6a/d51/d58/fcc d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f122 0 2024-04-26T21:08:24.520 INFO:tasks.workunit.client.0.smithi055.stdout:5/666: dwrite d4/df/d13/d26/f8f [0,4194304] 0 2024-04-26T21:08:24.528 INFO:tasks.workunit.client.0.smithi055.stdout:6/827: mknod d3/d17/d19/d7b/c123 0 2024-04-26T21:08:24.532 INFO:tasks.workunit.client.0.smithi055.stdout:0/869: truncate d9/dc/d1c/f26 717661 0 2024-04-26T21:08:24.532 INFO:tasks.workunit.client.0.smithi055.stdout:1/839: dwrite d8/d17/d1b/d41/fee [0,4194304] 0 2024-04-26T21:08:24.532 INFO:tasks.workunit.client.0.smithi055.stdout:4/665: read d4/d12/d17/fa8 [2881643,28756] 0 2024-04-26T21:08:24.549 INFO:tasks.workunit.client.0.smithi055.stdout:7/814: dwrite d5/d6/f4c [0,4194304] 0 2024-04-26T21:08:24.550 INFO:tasks.workunit.client.0.smithi055.stdout:7/815: fdatasync d5/d6/d24/d4d/da7/fcc 0 2024-04-26T21:08:24.560 INFO:tasks.workunit.client.1.smithi064.stdout:8/974: dwrite d10/d41/d44/d5a/f62 [4194304,4194304] 0 2024-04-26T21:08:24.560 INFO:tasks.workunit.client.1.smithi064.stdout:8/975: truncate d10/d41/d4e/f116 929414 0 2024-04-26T21:08:24.565 INFO:tasks.workunit.client.0.smithi055.stdout:2/930: dwrite d4/db/d26/d9a/fad [0,4194304] 0 2024-04-26T21:08:24.565 INFO:tasks.workunit.client.1.smithi064.stdout:8/976: mkdir d10/d41/d53/d104/d132 0 2024-04-26T21:08:24.567 INFO:tasks.workunit.client.0.smithi055.stdout:1/840: link d8/ff2 d8/d17/d1b/d7b/d8d/f11c 0 2024-04-26T21:08:24.567 INFO:tasks.workunit.client.0.smithi055.stdout:1/841: dread - d8/df/d11/db5/f10c zero size 2024-04-26T21:08:24.569 INFO:tasks.workunit.client.0.smithi055.stdout:4/666: creat d4/d12/d61/fdc x:0 0 0 2024-04-26T21:08:24.571 INFO:tasks.workunit.client.1.smithi064.stdout:8/977: rename d10/d41/d4e/d59/d5d/ca4 to d10/d41/d44/d5a/da2/c133 0 2024-04-26T21:08:24.572 INFO:tasks.workunit.client.0.smithi055.stdout:5/667: read d4/df/d13/d26/f8e [1483641,120420] 0 2024-04-26T21:08:24.578 INFO:tasks.workunit.client.1.smithi064.stdout:8/978: creat d10/d41/d4e/de3/f134 x:0 0 0 2024-04-26T21:08:24.578 INFO:tasks.workunit.client.1.smithi064.stdout:8/979: fdatasync d10/d41/d44/d5a/da2/fef 0 2024-04-26T21:08:24.579 INFO:tasks.workunit.client.0.smithi055.stdout:7/816: symlink d5/d53/d6e/d65/l101 0 2024-04-26T21:08:24.579 INFO:tasks.workunit.client.0.smithi055.stdout:4/667: rmdir d4/d26/d42/dbb 39 2024-04-26T21:08:24.579 INFO:tasks.workunit.client.0.smithi055.stdout:4/668: write d4/d26/d42/d2d/f3a [4303545,101712] 0 2024-04-26T21:08:24.582 INFO:tasks.workunit.client.1.smithi064.stdout:8/980: rmdir d10/d1d/d38/dee 0 2024-04-26T21:08:24.582 INFO:tasks.workunit.client.1.smithi064.stdout:8/981: write d10/d1d/da3/fab [1102436,4960] 0 2024-04-26T21:08:24.583 INFO:tasks.workunit.client.0.smithi055.stdout:5/668: symlink d4/df/dae/dce/d5b/le8 0 2024-04-26T21:08:24.583 INFO:tasks.workunit.client.0.smithi055.stdout:5/669: write d4/df/dae/dce/d93/dcb/f1f [2407768,97018] 0 2024-04-26T21:08:24.585 INFO:tasks.workunit.client.0.smithi055.stdout:2/931: dread d4/db/d1f/f67 [0,4194304] 0 2024-04-26T21:08:24.585 INFO:tasks.workunit.client.0.smithi055.stdout:7/817: truncate d5/d53/dd1/f8b 983423 0 2024-04-26T21:08:24.585 INFO:tasks.workunit.client.0.smithi055.stdout:7/818: write d5/d6/d39/dbc/fcb [299381,38116] 0 2024-04-26T21:08:24.587 INFO:tasks.workunit.client.1.smithi064.stdout:8/982: symlink d10/d41/d4e/d59/d5d/d79/ddf/l135 0 2024-04-26T21:08:24.587 INFO:tasks.workunit.client.1.smithi064.stdout:8/983: chown d10/d1d/c27 361424 1 2024-04-26T21:08:24.588 INFO:tasks.workunit.client.0.smithi055.stdout:1/842: getdents d8/d17/d33/dc5 0 2024-04-26T21:08:24.588 INFO:tasks.workunit.client.0.smithi055.stdout:1/843: creat d8/df/d11/d27/d28/f11d x:0 0 0 2024-04-26T21:08:24.590 INFO:tasks.workunit.client.0.smithi055.stdout:6/828: dwrite d3/d17/d25/d5f/d90/f69 [4194304,4194304] 0 2024-04-26T21:08:24.591 INFO:tasks.workunit.client.1.smithi064.stdout:8/984: symlink d10/d41/d44/d5a/l136 0 2024-04-26T21:08:24.592 INFO:tasks.workunit.client.0.smithi055.stdout:4/669: link d4/d26/d42/dbb/f3b d4/d26/d42/dbb/fdd 0 2024-04-26T21:08:24.595 INFO:tasks.workunit.client.0.smithi055.stdout:5/670: symlink d4/df/dae/dce/d93/le9 0 2024-04-26T21:08:24.595 INFO:tasks.workunit.client.0.smithi055.stdout:5/671: fsync d4/df/d13/f81 0 2024-04-26T21:08:24.596 INFO:tasks.workunit.client.1.smithi064.stdout:8/985: creat d10/d41/f137 x:0 0 0 2024-04-26T21:08:24.600 INFO:tasks.workunit.client.0.smithi055.stdout:7/819: mknod d5/d53/d6e/d6c/c102 0 2024-04-26T21:08:24.600 INFO:tasks.workunit.client.0.smithi055.stdout:7/820: fsync d5/d53/d6e/d65/f7c 0 2024-04-26T21:08:24.605 INFO:tasks.workunit.client.1.smithi064.stdout:8/986: rmdir d10/d41/d4e/d54/db3 39 2024-04-26T21:08:24.606 INFO:tasks.workunit.client.0.smithi055.stdout:1/844: getdents d8/d17/d1b/d10e 0 2024-04-26T21:08:24.607 INFO:tasks.workunit.client.0.smithi055.stdout:1/845: write d8/d94/f109 [815306,25504] 0 2024-04-26T21:08:24.607 INFO:tasks.workunit.client.0.smithi055.stdout:1/846: creat d8/d17/d1b/d7b/f11e x:0 0 0 2024-04-26T21:08:24.609 INFO:tasks.workunit.client.1.smithi064.stdout:8/987: rename d10/d41/d4e/d54/faf to d10/d1d/d38/f138 0 2024-04-26T21:08:24.609 INFO:tasks.workunit.client.0.smithi055.stdout:6/829: rmdir d3/da1 39 2024-04-26T21:08:24.610 INFO:tasks.workunit.client.0.smithi055.stdout:6/830: stat d3/d17/d19/d7b/d8f 0 2024-04-26T21:08:24.614 INFO:tasks.workunit.client.0.smithi055.stdout:4/670: rename d4/d18/d1a to d4/d26/d42/dbb/dde 0 2024-04-26T21:08:24.615 INFO:tasks.workunit.client.0.smithi055.stdout:5/672: mkdir d4/df/dea 0 2024-04-26T21:08:24.616 INFO:tasks.workunit.client.0.smithi055.stdout:0/870: dwrite d9/dc/d19/ddb/db6/fbe [0,4194304] 0 2024-04-26T21:08:24.624 INFO:tasks.workunit.client.0.smithi055.stdout:4/671: dread d4/f1d [0,4194304] 0 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:6/831: rmdir d3/da1/de3 39 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:6/832: stat d3/da1/de3/f8d 0 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:5/673: mknod d4/df/dae/dce/dc0/de2/ceb 0 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:5/674: write d4/df/dae/dce/d93/dcb/f1f [970493,13562] 0 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:0/871: truncate d9/dc/d1c/d3e/dc5/dcc/db2/fbb 778110 0 2024-04-26T21:08:24.631 INFO:tasks.workunit.client.0.smithi055.stdout:7/821: dread d5/d53/d6e/d99/d7f/d6f/f95 [0,4194304] 0 2024-04-26T21:08:24.634 INFO:tasks.workunit.client.0.smithi055.stdout:4/672: creat d4/d18/d86/fdf x:0 0 0 2024-04-26T21:08:24.634 INFO:tasks.workunit.client.0.smithi055.stdout:4/673: chown d4/d26/d42/d28/d53/d71/d7f/f88 21040465 1 2024-04-26T21:08:24.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/675: unlink d4/df/d13/d26/d63/lb5 0 2024-04-26T21:08:24.642 INFO:tasks.workunit.client.0.smithi055.stdout:1/847: write d8/f19 [928392,57879] 0 2024-04-26T21:08:24.642 INFO:tasks.workunit.client.0.smithi055.stdout:1/848: readlink d8/df/d11/l1c 0 2024-04-26T21:08:24.642 INFO:tasks.workunit.client.0.smithi055.stdout:1/849: write d8/d94/fd6 [982437,92778] 0 2024-04-26T21:08:24.642 INFO:tasks.workunit.client.0.smithi055.stdout:7/822: mknod d5/d11/de4/df9/c103 0 2024-04-26T21:08:24.648 INFO:tasks.workunit.client.0.smithi055.stdout:7/823: mknod d5/d53/dd1/c104 0 2024-04-26T21:08:24.648 INFO:tasks.workunit.client.0.smithi055.stdout:4/674: creat d4/d26/d42/d28/d53/fe0 x:0 0 0 2024-04-26T21:08:24.649 INFO:tasks.workunit.client.0.smithi055.stdout:4/675: dread - d4/d26/d42/d28/d53/d71/d7f/fd5 zero size 2024-04-26T21:08:24.649 INFO:tasks.workunit.client.0.smithi055.stdout:4/676: write d4/d26/d42/d28/d53/d71/d7f/f88 [330179,93538] 0 2024-04-26T21:08:24.650 INFO:tasks.workunit.client.0.smithi055.stdout:7/824: rmdir d5/d53 39 2024-04-26T21:08:24.650 INFO:tasks.workunit.client.0.smithi055.stdout:7/825: write d5/d6/d24/f50 [2270804,62820] 0 2024-04-26T21:08:24.650 INFO:tasks.workunit.client.1.smithi064.stdout:8/988: dwrite d10/f47 [0,4194304] 0 2024-04-26T21:08:24.650 INFO:tasks.workunit.client.1.smithi064.stdout:8/989: write d10/d2f/f121 [717800,122156] 0 2024-04-26T21:08:24.650 INFO:tasks.workunit.client.1.smithi064.stdout:8/990: chown d10/d41/d4e/de3/f134 102623 1 2024-04-26T21:08:24.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/677: link d4/d26/d42/dbb/dde/d49/cc8 d4/d26/ce1 0 2024-04-26T21:08:24.654 INFO:tasks.workunit.client.0.smithi055.stdout:4/678: chown d4/d26/d42/d2d/cd9 14318 1 2024-04-26T21:08:24.654 INFO:tasks.workunit.client.0.smithi055.stdout:7/826: mkdir d5/d11/d8c/d105 0 2024-04-26T21:08:24.654 INFO:tasks.workunit.client.0.smithi055.stdout:7/827: stat d5/d53/d6e/d99/d7f/d6f 0 2024-04-26T21:08:24.656 INFO:tasks.workunit.client.1.smithi064.stdout:8/991: mknod d10/d41/d44/d5a/c139 0 2024-04-26T21:08:24.656 INFO:tasks.workunit.client.1.smithi064.stdout:8/992: truncate d10/d41/d44/f10e 586055 0 2024-04-26T21:08:24.656 INFO:tasks.workunit.client.1.smithi064.stdout:8/993: readlink d10/d2f/d61/le6 0 2024-04-26T21:08:24.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/679: truncate d4/d18/f89 4202752 0 2024-04-26T21:08:24.658 INFO:tasks.workunit.client.1.smithi064.stdout:8/994: rename d10/d41/d53/l12b to d10/d41/d53/d104/d132/l13a 0 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/995: mknod d10/d2f/c13b 0 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/996: chown d10/d41/d4e/d59/d5d 414286450 1 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/997: dread - d10/d2f/d61/f10f zero size 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/998: fsync d10/d1d/f85 0 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.1.smithi064.stdout:8/999: creat d10/d2f/f13c x:0 0 0 2024-04-26T21:08:24.664 INFO:tasks.workunit.client.0.smithi055.stdout:4/680: rename d4/d26/ce1 to d4/ce2 0 2024-04-26T21:08:24.666 INFO:tasks.workunit.client.0.smithi055.stdout:4/681: truncate d4/d26/d42/d28/d53/d70/f75 657565 0 2024-04-26T21:08:24.667 INFO:tasks.workunit.client.0.smithi055.stdout:4/682: truncate d4/d12/d15/f16 4539794 0 2024-04-26T21:08:24.670 INFO:tasks.workunit.client.0.smithi055.stdout:1/850: dread d8/df/d11/d27/d28/d2a/f93 [0,4194304] 0 2024-04-26T21:08:24.670 INFO:tasks.workunit.client.0.smithi055.stdout:1/851: stat d8/d17/d1b/d7b/d65/fa8 0 2024-04-26T21:08:24.672 INFO:tasks.workunit.client.1.smithi064.stderr:+ rm -rf -- ./tmp.014p80PyRj 2024-04-26T21:08:24.697 INFO:tasks.workunit.client.0.smithi055.stdout:2/932: dwrite d4/db/d56/f7c [0,4194304] 0 2024-04-26T21:08:24.698 INFO:tasks.workunit.client.0.smithi055.stdout:6/833: write f0 [7205982,79681] 0 2024-04-26T21:08:24.699 INFO:tasks.workunit.client.0.smithi055.stdout:2/933: symlink d4/dc/l133 0 2024-04-26T21:08:24.699 INFO:tasks.workunit.client.0.smithi055.stdout:2/934: dread - d4/db/d1f/d32/dcd/f132 zero size 2024-04-26T21:08:24.700 INFO:tasks.workunit.client.0.smithi055.stdout:2/935: write d4/db/d56/d4a/d7e/d126/f117 [524509,77298] 0 2024-04-26T21:08:24.700 INFO:tasks.workunit.client.0.smithi055.stdout:6/834: symlink d3/d17/l124 0 2024-04-26T21:08:24.702 INFO:tasks.workunit.client.0.smithi055.stdout:2/936: symlink d4/db/d56/l134 0 2024-04-26T21:08:24.708 INFO:tasks.workunit.client.0.smithi055.stdout:2/937: rmdir d4/d14/d17/d36 39 2024-04-26T21:08:24.708 INFO:tasks.workunit.client.0.smithi055.stdout:2/938: chown d4/dc/f71 54105523 1 2024-04-26T21:08:24.714 INFO:tasks.workunit.client.0.smithi055.stdout:0/872: dwrite d9/dc/d1c/d3e/dc5/dcc/d4b/fc6 [0,4194304] 0 2024-04-26T21:08:24.715 INFO:tasks.workunit.client.0.smithi055.stdout:0/873: chown d9/dc/d1c/d3e/d7d/da3/l110 62 1 2024-04-26T21:08:24.716 INFO:tasks.workunit.client.0.smithi055.stdout:2/939: link d4/db/d1f/d32/f3e d4/db/d1f/f135 0 2024-04-26T21:08:24.720 INFO:tasks.workunit.client.0.smithi055.stdout:1/852: dread d8/d17/d33/f89 [0,4194304] 0 2024-04-26T21:08:24.724 INFO:tasks.workunit.client.0.smithi055.stdout:1/853: write d8/d94/de7/f108 [525939,19059] 0 2024-04-26T21:08:24.727 INFO:tasks.workunit.client.0.smithi055.stdout:7/828: dwrite d5/d6/d24/d3b/f42 [0,4194304] 0 2024-04-26T21:08:24.727 INFO:tasks.workunit.client.0.smithi055.stdout:7/829: stat d5/d6/d24/d3b/fda 0 2024-04-26T21:08:24.727 INFO:tasks.workunit.client.0.smithi055.stdout:7/830: fsync d5/d53/d6e/d65/f7c 0 2024-04-26T21:08:24.733 INFO:tasks.workunit.client.0.smithi055.stdout:4/683: dwrite d4/d18/d86/da6/f7b [0,4194304] 0 2024-04-26T21:08:24.734 INFO:tasks.workunit.client.0.smithi055.stdout:0/874: dread d9/dc/d1c/d3e/dc5/dcc/f92 [0,4194304] 0 2024-04-26T21:08:24.734 INFO:tasks.workunit.client.0.smithi055.stdout:0/875: chown d9/d11/f46 3896 1 2024-04-26T21:08:24.739 INFO:tasks.workunit.client.0.smithi055.stdout:6/835: dwrite d3/d17/d25/dc7/fe6 [0,4194304] 0 2024-04-26T21:08:24.754 INFO:tasks.workunit.client.0.smithi055.stdout:1/854: symlink d8/df/l11f 0 2024-04-26T21:08:24.759 INFO:tasks.workunit.client.0.smithi055.stdout:7/831: mknod d5/d6/d24/d4d/da7/dab/c106 0 2024-04-26T21:08:24.760 INFO:tasks.workunit.client.0.smithi055.stdout:7/832: chown d5/d53/d6e/d99/d75/c7b 0 1 2024-04-26T21:08:24.767 INFO:tasks.workunit.client.0.smithi055.stdout:3/906: sync 2024-04-26T21:08:24.777 INFO:tasks.workunit.client.0.smithi055.stdout:3/907: dread d0/d4/d5/d73/d13/f1d [0,4194304] 0 2024-04-26T21:08:24.777 INFO:tasks.workunit.client.0.smithi055.stdout:3/908: dread - d0/d4/d5/d73/d47/d37/d3d/fed zero size 2024-04-26T21:08:24.781 INFO:tasks.workunit.client.0.smithi055.stdout:1/855: mkdir d8/d17/d1b/d41/d120 0 2024-04-26T21:08:24.784 INFO:tasks.workunit.client.0.smithi055.stdout:0/876: rename d9/dc/d1c/f9f to d9/d8b/f115 0 2024-04-26T21:08:24.786 INFO:tasks.workunit.client.0.smithi055.stdout:3/909: mkdir d0/d4/d131 0 2024-04-26T21:08:24.791 INFO:tasks.workunit.client.0.smithi055.stdout:1/856: symlink d8/df/d11/db5/l121 0 2024-04-26T21:08:24.791 INFO:tasks.workunit.client.0.smithi055.stdout:0/877: creat d9/dc/d1c/d3e/dc5/dcc/d4b/dfe/f116 x:0 0 0 2024-04-26T21:08:24.794 INFO:tasks.workunit.client.0.smithi055.stdout:1/857: link d8/d17/d1b/d7b/f90 d8/d17/d1b/d10b/f122 0 2024-04-26T21:08:24.812 INFO:tasks.workunit.client.0.smithi055.stdout:0/878: write d9/dc/d1c/d3e/fd3 [232508,127276] 0 2024-04-26T21:08:24.815 INFO:tasks.workunit.client.0.smithi055.stdout:0/879: symlink d9/dc/d19/ddb/db6/d67/l117 0 2024-04-26T21:08:24.815 INFO:tasks.workunit.client.0.smithi055.stdout:0/880: chown d9/dc/d1c/d3e/dc5/dcc/d4b/f112 3947184 1 2024-04-26T21:08:24.815 INFO:tasks.workunit.client.0.smithi055.stdout:0/881: chown d9/dc/d1c/d3e/d7d/da3/d82/ca8 1 1 2024-04-26T21:08:24.818 INFO:tasks.workunit.client.0.smithi055.stdout:0/882: mknod d9/d27/daf/c118 0 2024-04-26T21:08:24.822 INFO:tasks.workunit.client.0.smithi055.stdout:6/836: dwrite d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/fa7 [0,4194304] 0 2024-04-26T21:08:24.837 INFO:tasks.workunit.client.0.smithi055.stdout:6/837: dread d3/d17/d25/dc7/fe6 [0,4194304] 0 2024-04-26T21:08:24.864 INFO:tasks.workunit.client.0.smithi055.stdout:7/833: dwrite d5/d6/d39/deb/ff7 [0,4194304] 0 2024-04-26T21:08:24.872 INFO:tasks.workunit.client.0.smithi055.stdout:7/834: mknod d5/d53/d6e/d99/d7f/d6f/ddc/c107 0 2024-04-26T21:08:24.875 INFO:tasks.workunit.client.0.smithi055.stdout:7/835: truncate d5/f57 2089331 0 2024-04-26T21:08:24.876 INFO:tasks.workunit.client.0.smithi055.stdout:7/836: read - d5/d53/d6e/d99/d7f/d6f/fde zero size 2024-04-26T21:08:24.878 INFO:tasks.workunit.client.0.smithi055.stdout:8/674: sync 2024-04-26T21:08:24.879 INFO:tasks.workunit.client.0.smithi055.stdout:9/838: sync 2024-04-26T21:08:24.887 INFO:tasks.workunit.client.0.smithi055.stdout:6/838: dwrite d3/d17/d46/d109/d66/d6a/d51/f117 [0,4194304] 0 2024-04-26T21:08:24.888 INFO:tasks.workunit.client.0.smithi055.stdout:0/883: dwrite d9/dc/d1c/d3e/dc5/dcc/d9c/fe2 [0,4194304] 0 2024-04-26T21:08:24.890 INFO:tasks.workunit.client.0.smithi055.stdout:0/884: mknod d9/dc/d1c/d3e/dc5/dcc/c119 0 2024-04-26T21:08:24.898 INFO:tasks.workunit.client.0.smithi055.stdout:6/839: dread d3/d17/d25/d5f/ff6 [0,4194304] 0 2024-04-26T21:08:24.961 INFO:tasks.workunit.client.0.smithi055.stdout:6/840: rename d3/d17/d25/dc7/fe6 to d3/d17/d25/dc7/f125 0 2024-04-26T21:08:24.962 INFO:tasks.workunit.client.0.smithi055.stdout:6/841: fsync d3/d17/d25/ff7 0 2024-04-26T21:08:24.971 INFO:tasks.workunit.client.0.smithi055.stdout:0/885: dwrite d9/dc/d17/f45 [0,4194304] 0 2024-04-26T21:08:24.974 INFO:tasks.workunit.client.0.smithi055.stdout:0/886: write d9/dc/d1c/d3e/dc5/fdd [465458,122272] 0 2024-04-26T21:08:24.981 INFO:tasks.workunit.client.0.smithi055.stdout:0/887: dread d9/dc/d19/ddb/dbd/fd0 [0,4194304] 0 2024-04-26T21:08:24.988 INFO:tasks.workunit.client.0.smithi055.stdout:6/842: dread d3/f64 [0,4194304] 0 2024-04-26T21:08:24.990 INFO:tasks.workunit.client.0.smithi055.stdout:7/837: dwrite d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/fca [0,4194304] 0 2024-04-26T21:08:24.990 INFO:tasks.workunit.client.0.smithi055.stdout:6/843: symlink d3/d17/d46/dc2/dd4/l126 0 2024-04-26T21:08:24.990 INFO:tasks.workunit.client.0.smithi055.stdout:7/838: fdatasync d5/d6/d24/d4d/f73 0 2024-04-26T21:08:24.990 INFO:tasks.workunit.client.0.smithi055.stdout:7/839: chown d5/d53/d6e/d99/d75 368 1 2024-04-26T21:08:25.000 INFO:tasks.workunit.client.0.smithi055.stdout:6/844: rename d3/d17/d46/d109/d66/d6a/l33 to d3/d17/d46/d109/d66/d6a/d67/dfe/l127 0 2024-04-26T21:08:25.003 INFO:tasks.workunit.client.0.smithi055.stdout:6/845: read d3/d17/d46/d109/d66/d6a/d51/d58/d62/f11a [854713,80060] 0 2024-04-26T21:08:25.005 INFO:tasks.workunit.client.0.smithi055.stdout:6/846: getdents d3/d17/d19/d71/dca/dcb/d10e/ddf 0 2024-04-26T21:08:25.009 INFO:tasks.workunit.client.0.smithi055.stdout:6/847: creat d3/d17/d46/dc2/dd4/df3/f128 x:0 0 0 2024-04-26T21:08:25.009 INFO:tasks.workunit.client.0.smithi055.stdout:6/848: truncate d3/d17/d25/fc6 493773 0 2024-04-26T21:08:25.018 INFO:tasks.workunit.client.0.smithi055.stdout:0/888: dread d9/dc/d1c/d3e/f47 [0,4194304] 0 2024-04-26T21:08:25.019 INFO:tasks.workunit.client.0.smithi055.stdout:0/889: symlink d9/dc/d19/ddb/db6/d67/l11a 0 2024-04-26T21:08:25.019 INFO:tasks.workunit.client.0.smithi055.stdout:0/890: chown d9/d8b/lb5 385259 1 2024-04-26T21:08:25.020 INFO:tasks.workunit.client.0.smithi055.stdout:0/891: getdents d9/dc/d1c/d3e/dc5/dcc/d9c 0 2024-04-26T21:08:25.021 INFO:tasks.workunit.client.0.smithi055.stdout:6/849: dread d3/d17/d25/d5f/d90/fb0 [0,4194304] 0 2024-04-26T21:08:25.021 INFO:tasks.workunit.client.0.smithi055.stdout:0/892: mknod d9/dc/d1c/d3e/dc5/dcc/d4b/dfe/c11b 0 2024-04-26T21:08:25.022 INFO:tasks.workunit.client.0.smithi055.stdout:7/840: write d5/d6/d24/f27 [4816964,26961] 0 2024-04-26T21:08:25.022 INFO:tasks.workunit.client.0.smithi055.stdout:7/841: chown d5/d53/d6e/d99/d7f/d6f/fde 0 1 2024-04-26T21:08:25.022 INFO:tasks.workunit.client.0.smithi055.stdout:6/850: mkdir d3/d17/d19/d71/dca/dcb/d10e/d129 0 2024-04-26T21:08:25.024 INFO:tasks.workunit.client.0.smithi055.stdout:7/842: unlink d5/d53/d6e/d99/d7f/d6f/da8/cb4 0 2024-04-26T21:08:25.031 INFO:tasks.workunit.client.0.smithi055.stdout:8/675: dwrite d3/d9/d1d/d48/d57/fb2 [0,4194304] 0 2024-04-26T21:08:25.031 INFO:tasks.workunit.client.0.smithi055.stdout:8/676: chown d3/dc0/f86 15974392 1 2024-04-26T21:08:25.034 INFO:tasks.workunit.client.0.smithi055.stdout:6/851: rmdir d3/d17/d46/dc2 39 2024-04-26T21:08:25.034 INFO:tasks.workunit.client.0.smithi055.stdout:6/852: stat d3/c114 0 2024-04-26T21:08:25.037 INFO:tasks.workunit.client.0.smithi055.stdout:8/677: mknod d3/d77/da9/ce4 0 2024-04-26T21:08:25.037 INFO:tasks.workunit.client.0.smithi055.stdout:8/678: truncate d3/d9/d44/f58 1723164 0 2024-04-26T21:08:25.041 INFO:tasks.workunit.client.0.smithi055.stdout:6/853: rename d3/d17/d25/d5f/d90/l55 to d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/d104/l12a 0 2024-04-26T21:08:25.041 INFO:tasks.workunit.client.0.smithi055.stdout:6/854: creat d3/d17/d46/d109/d66/d6a/d51/f12b x:0 0 0 2024-04-26T21:08:25.041 INFO:tasks.workunit.client.0.smithi055.stdout:6/855: fsync d3/fbe 0 2024-04-26T21:08:25.046 INFO:tasks.workunit.client.0.smithi055.stdout:8/679: creat d3/d77/fe5 x:0 0 0 2024-04-26T21:08:25.046 INFO:tasks.workunit.client.0.smithi055.stdout:8/680: readlink d3/d9/d1d/l3c 0 2024-04-26T21:08:25.046 INFO:tasks.workunit.client.0.smithi055.stdout:7/843: read d5/d6/d24/d4d/f55 [2002613,59338] 0 2024-04-26T21:08:25.048 INFO:tasks.workunit.client.0.smithi055.stdout:6/856: dread d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 [0,4194304] 0 2024-04-26T21:08:25.048 INFO:tasks.workunit.client.0.smithi055.stdout:6/857: chown d3/d17/d25/c2c 50 1 2024-04-26T21:08:25.050 INFO:tasks.workunit.client.0.smithi055.stdout:8/681: truncate d3/d77/da9/fb6 3173537 0 2024-04-26T21:08:25.051 INFO:tasks.workunit.client.0.smithi055.stdout:7/844: truncate d5/d6/d24/d4d/da7/dab/dae/fb9 6592837 0 2024-04-26T21:08:25.053 INFO:tasks.workunit.client.0.smithi055.stdout:6/858: mkdir d3/d17/d46/d109/d66/d6a/d12c 0 2024-04-26T21:08:25.055 INFO:tasks.workunit.client.0.smithi055.stdout:8/682: symlink d3/dc0/d2e/ddc/le6 0 2024-04-26T21:08:25.058 INFO:tasks.workunit.client.0.smithi055.stdout:7/845: rename d5/d6/d24/d4d/f55 to d5/d53/d6e/d99/d58/f108 0 2024-04-26T21:08:25.058 INFO:tasks.workunit.client.0.smithi055.stdout:7/846: write d5/d6/d24/d3b/fda [936483,87252] 0 2024-04-26T21:08:25.059 INFO:tasks.workunit.client.0.smithi055.stdout:6/859: mkdir d3/d17/d46/d109/d66/d6a/d12d 0 2024-04-26T21:08:25.059 INFO:tasks.workunit.client.0.smithi055.stdout:6/860: chown d3/d17/d19/l8e 38058 1 2024-04-26T21:08:25.059 INFO:tasks.workunit.client.0.smithi055.stdout:6/861: chown d3/d17/d19/d7b/l9d 197 1 2024-04-26T21:08:25.060 INFO:tasks.workunit.client.0.smithi055.stdout:8/683: getdents d3/d9/d1d/d48/d80 0 2024-04-26T21:08:25.062 INFO:tasks.workunit.client.0.smithi055.stdout:7/847: rename d5/d6/d24/d4d/da7/dab/dce/de7/dfa to d5/d11/d8c/d105/d109 0 2024-04-26T21:08:25.066 INFO:tasks.workunit.client.0.smithi055.stdout:8/684: link d3/lb7 d3/dc0/d2e/d75/d76/le7 0 2024-04-26T21:08:25.070 INFO:tasks.workunit.client.0.smithi055.stdout:7/848: mknod d5/d53/c10a 0 2024-04-26T21:08:25.071 INFO:tasks.workunit.client.0.smithi055.stdout:7/849: write d5/d53/dd1/f1e [1717944,73939] 0 2024-04-26T21:08:25.072 INFO:tasks.workunit.client.0.smithi055.stdout:0/893: dwrite d9/dc/d17/f45 [0,4194304] 0 2024-04-26T21:08:25.073 INFO:tasks.workunit.client.0.smithi055.stdout:8/685: symlink d3/d77/da9/le8 0 2024-04-26T21:08:25.073 INFO:tasks.workunit.client.0.smithi055.stdout:0/894: write d9/dc/d19/f24 [4772467,63711] 0 2024-04-26T21:08:25.073 INFO:tasks.workunit.client.0.smithi055.stdout:0/895: fsync d9/d11/d5b/f90 0 2024-04-26T21:08:25.075 INFO:tasks.workunit.client.0.smithi055.stdout:6/862: write d3/d17/d46/d109/d66/d6a/d51/d58/fcc [4823197,109926] 0 2024-04-26T21:08:25.075 INFO:tasks.workunit.client.0.smithi055.stdout:6/863: fdatasync d3/d17/d19/d7b/feb 0 2024-04-26T21:08:25.075 INFO:tasks.workunit.client.0.smithi055.stdout:6/864: readlink d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf/lef 0 2024-04-26T21:08:25.088 INFO:tasks.workunit.client.0.smithi055.stdout:8/686: creat d3/d9/d1d/d48/d80/fe9 x:0 0 0 2024-04-26T21:08:25.088 INFO:tasks.workunit.client.0.smithi055.stdout:8/687: dread - d3/d7c/d9a/fc8 zero size 2024-04-26T21:08:25.088 INFO:tasks.workunit.client.0.smithi055.stdout:8/688: chown d3/d9/d44/lac 43 1 2024-04-26T21:08:25.090 INFO:tasks.workunit.client.0.smithi055.stdout:0/896: creat d9/d27/dcb/d103/f11c x:0 0 0 2024-04-26T21:08:25.091 INFO:tasks.workunit.client.0.smithi055.stdout:6/865: mknod d3/d17/d25/d5f/d90/c12e 0 2024-04-26T21:08:25.091 INFO:tasks.workunit.client.0.smithi055.stdout:6/866: readlink d3/d17/d19/d71/dca/dcb/l11d 0 2024-04-26T21:08:25.095 INFO:tasks.workunit.client.0.smithi055.stdout:7/850: rmdir d5/d53/d6e/d99/d7f/d6f/dc6/dc8 39 2024-04-26T21:08:25.095 INFO:tasks.workunit.client.0.smithi055.stdout:7/851: truncate d5/d53/d6e/d99/d7f/f96 4585940 0 2024-04-26T21:08:25.099 INFO:tasks.workunit.client.0.smithi055.stdout:8/689: creat d3/dc0/d2e/db3/fea x:0 0 0 2024-04-26T21:08:25.100 INFO:tasks.workunit.client.0.smithi055.stdout:0/897: mkdir d9/dc/d17/d9a/d101/d11d 0 2024-04-26T21:08:25.102 INFO:tasks.workunit.client.0.smithi055.stdout:7/852: link d5/d6/d24/d4d/da7/fcc d5/d6/d24/d4d/da7/dab/f10b 0 2024-04-26T21:08:25.103 INFO:tasks.workunit.client.0.smithi055.stdout:8/690: unlink d3/d9/d5b/f79 0 2024-04-26T21:08:25.144 INFO:tasks.workunit.client.0.smithi055.stdout:8/691: write d3/d9/d44/f58 [1048872,70110] 0 2024-04-26T21:08:25.160 INFO:tasks.workunit.client.0.smithi055.stdout:8/692: write d3/d9/d1d/f6e [209773,12003] 0 2024-04-26T21:08:25.160 INFO:tasks.workunit.client.0.smithi055.stdout:8/693: truncate d3/d89/daa/fe2 76611 0 2024-04-26T21:08:25.160 INFO:tasks.workunit.client.0.smithi055.stdout:6/867: dwrite d3/d17/f94 [0,4194304] 0 2024-04-26T21:08:25.160 INFO:tasks.workunit.client.0.smithi055.stdout:6/868: write d3/d17/d46/d109/d66/d6a/d67/d83/d96/f119 [694972,7664] 0 2024-04-26T21:08:25.170 INFO:tasks.workunit.client.0.smithi055.stdout:6/869: rmdir d3/d17/d19/d71/dca/dcb/d10e/d129 0 2024-04-26T21:08:25.178 INFO:tasks.workunit.client.0.smithi055.stdout:8/694: dread d3/d9/f5c [0,4194304] 0 2024-04-26T21:08:25.178 INFO:tasks.workunit.client.0.smithi055.stdout:5/676: sync 2024-04-26T21:08:25.179 INFO:tasks.workunit.client.0.smithi055.stdout:7/853: dwrite d5/d6/d24/d3b/fda [0,4194304] 0 2024-04-26T21:08:25.181 INFO:tasks.workunit.client.0.smithi055.stdout:8/695: write d3/fd3 [484857,40316] 0 2024-04-26T21:08:25.184 INFO:tasks.workunit.client.0.smithi055.stdout:5/677: creat d4/df/dea/fec x:0 0 0 2024-04-26T21:08:25.185 INFO:tasks.workunit.client.0.smithi055.stdout:5/678: dread - d4/df/dae/dce/d4a/d3f/d4f/d53/faa zero size 2024-04-26T21:08:25.190 INFO:tasks.workunit.client.0.smithi055.stdout:5/679: link d4/df/dae/dce/d4a/d3f/d5c/db9/fc1 d4/df/dae/dce/d4a/d3f/d2e/d82/fed 0 2024-04-26T21:08:25.192 INFO:tasks.workunit.client.0.smithi055.stdout:4/684: sync 2024-04-26T21:08:25.192 INFO:tasks.workunit.client.0.smithi055.stdout:2/940: sync 2024-04-26T21:08:25.192 INFO:tasks.workunit.client.0.smithi055.stdout:1/858: sync 2024-04-26T21:08:25.192 INFO:tasks.workunit.client.0.smithi055.stdout:1/859: chown d8/ff2 622065 1 2024-04-26T21:08:25.195 INFO:tasks.workunit.client.0.smithi055.stdout:5/680: link d4/ccf d4/df/dae/dce/d93/dcb/cee 0 2024-04-26T21:08:25.195 INFO:tasks.workunit.client.0.smithi055.stdout:5/681: chown d4/df/dae/dce/d4a/d3f/d4f/d53/d87/la3 84 1 2024-04-26T21:08:25.197 INFO:tasks.workunit.client.0.smithi055.stdout:4/685: mkdir d4/d26/d42/dbb/dde/de3 0 2024-04-26T21:08:25.198 INFO:tasks.workunit.client.0.smithi055.stdout:4/686: truncate d4/d26/d42/dbb/dde/f37 578747 0 2024-04-26T21:08:25.198 INFO:tasks.workunit.client.0.smithi055.stdout:4/687: chown d4/d18/c22 1153927 1 2024-04-26T21:08:25.198 INFO:tasks.workunit.client.0.smithi055.stdout:4/688: chown d4/d12/d61/d6b/laf 63144607 1 2024-04-26T21:08:25.199 INFO:tasks.workunit.client.0.smithi055.stdout:7/854: write d5/f29 [1882537,63709] 0 2024-04-26T21:08:25.201 INFO:tasks.workunit.client.0.smithi055.stdout:2/941: mkdir d4/db/d26/d9a/dc3/d136 0 2024-04-26T21:08:25.203 INFO:tasks.workunit.client.0.smithi055.stdout:5/682: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/d87/def 0 2024-04-26T21:08:25.203 INFO:tasks.workunit.client.0.smithi055.stdout:1/860: symlink d8/d17/d1b/d7b/def/l123 0 2024-04-26T21:08:25.203 INFO:tasks.workunit.client.0.smithi055.stdout:5/683: write d4/df/d13/d26/d63/fc3 [4913064,65934] 0 2024-04-26T21:08:25.203 INFO:tasks.workunit.client.0.smithi055.stdout:5/684: readlink d4/l85 0 2024-04-26T21:08:25.206 INFO:tasks.workunit.client.0.smithi055.stdout:4/689: creat d4/d26/d42/fe4 x:0 0 0 2024-04-26T21:08:25.206 INFO:tasks.workunit.client.0.smithi055.stdout:4/690: write d4/d26/d42/d28/d53/d70/f8f [34034,34510] 0 2024-04-26T21:08:25.209 INFO:tasks.workunit.client.0.smithi055.stdout:2/942: truncate d4/db/d56/f11e 3333948 0 2024-04-26T21:08:25.209 INFO:tasks.workunit.client.0.smithi055.stdout:2/943: chown d4/d55/d6c/fa2 2774 1 2024-04-26T21:08:25.212 INFO:tasks.workunit.client.0.smithi055.stdout:1/861: symlink d8/d17/d1b/d10e/d113/l124 0 2024-04-26T21:08:25.212 INFO:tasks.workunit.client.0.smithi055.stdout:1/862: stat d8/d17/d1b/c110 0 2024-04-26T21:08:25.212 INFO:tasks.workunit.client.0.smithi055.stdout:5/685: rmdir d4/df/dae/dce/d4a/d3f/da1 39 2024-04-26T21:08:25.213 INFO:tasks.workunit.client.0.smithi055.stdout:5/686: truncate d4/df/d13/f97 4700539 0 2024-04-26T21:08:25.214 INFO:tasks.workunit.client.0.smithi055.stdout:4/691: truncate d4/d12/d17/fa8 1955444 0 2024-04-26T21:08:25.215 INFO:tasks.workunit.client.0.smithi055.stdout:2/944: symlink d4/db/d1f/d32/d57/l137 0 2024-04-26T21:08:25.216 INFO:tasks.workunit.client.0.smithi055.stdout:1/863: symlink d8/df/d11/d27/de5/l125 0 2024-04-26T21:08:25.216 INFO:tasks.workunit.client.0.smithi055.stdout:1/864: fdatasync d8/df/d11/d27/d28/f40 0 2024-04-26T21:08:25.216 INFO:tasks.workunit.client.0.smithi055.stdout:1/865: fsync d8/df/d11/d27/fc2 0 2024-04-26T21:08:25.216 INFO:tasks.workunit.client.0.smithi055.stdout:1/866: readlink d8/d17/d1b/d10e/d113/l124 0 2024-04-26T21:08:25.216 INFO:tasks.workunit.client.0.smithi055.stdout:1/867: fsync d8/df/f8e 0 2024-04-26T21:08:25.217 INFO:tasks.workunit.client.0.smithi055.stdout:4/692: creat d4/d12/d61/dd1/fe5 x:0 0 0 2024-04-26T21:08:25.219 INFO:tasks.workunit.client.0.smithi055.stdout:2/945: unlink d4/db/d8f/df8/d5e/d7d/fe9 0 2024-04-26T21:08:25.222 INFO:tasks.workunit.client.0.smithi055.stdout:4/693: symlink d4/d12/d17/d3d/le6 0 2024-04-26T21:08:25.223 INFO:tasks.workunit.client.0.smithi055.stdout:2/946: mknod d4/db/d1f/df6/c138 0 2024-04-26T21:08:25.227 INFO:tasks.workunit.client.0.smithi055.stdout:2/947: creat d4/db/d8f/da6/dfc/f139 x:0 0 0 2024-04-26T21:08:25.227 INFO:tasks.workunit.client.0.smithi055.stdout:0/898: dwrite d9/dc/d19/f24 [4194304,4194304] 0 2024-04-26T21:08:25.227 INFO:tasks.workunit.client.0.smithi055.stdout:4/694: creat d4/d26/d42/d28/db9/fe7 x:0 0 0 2024-04-26T21:08:25.231 INFO:tasks.workunit.client.0.smithi055.stdout:6/870: dwrite d3/d17/fc8 [0,4194304] 0 2024-04-26T21:08:25.237 INFO:tasks.workunit.client.0.smithi055.stdout:5/687: write d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fa4 [1671995,110967] 0 2024-04-26T21:08:25.237 INFO:tasks.workunit.client.0.smithi055.stdout:6/871: symlink d3/d17/d46/dc2/dde/l12f 0 2024-04-26T21:08:25.238 INFO:tasks.workunit.client.0.smithi055.stdout:6/872: chown d3/d17/d19/d71/dca/d103 1572 1 2024-04-26T21:08:25.245 INFO:tasks.workunit.client.0.smithi055.stdout:5/688: getdents d4/df/dae/dce/d4a/d3f/d2e/d82 0 2024-04-26T21:08:25.250 INFO:tasks.workunit.client.0.smithi055.stdout:4/695: dread d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:25.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:25 smithi055 ceph-mon[25475]: pgmap v45: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 148 MiB/s rd, 186 MiB/s wr, 292 op/s 2024-04-26T21:08:25.265 INFO:tasks.workunit.client.0.smithi055.stdout:8/696: dwrite d3/d9/d1d/d48/d57/d61/f8c [0,4194304] 0 2024-04-26T21:08:25.265 INFO:tasks.workunit.client.0.smithi055.stdout:5/689: creat d4/df/d13/d26/ff0 x:0 0 0 2024-04-26T21:08:25.266 INFO:tasks.workunit.client.0.smithi055.stdout:5/690: fsync d4/df/dae/dce/d4a/f8a 0 2024-04-26T21:08:25.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/873: rmdir d3/d17/d19 39 2024-04-26T21:08:25.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/874: fdatasync d3/d17/d46/d109/d66/d6a/d67/d83/f8a 0 2024-04-26T21:08:25.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/875: chown d3/d17/d19/f3d 7955 1 2024-04-26T21:08:25.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/876: read - d3/d17/d46/d109/d66/d6a/d67/d83/fec zero size 2024-04-26T21:08:25.272 INFO:tasks.workunit.client.0.smithi055.stdout:4/696: mkdir d4/d26/d42/dbb/de8 0 2024-04-26T21:08:25.276 INFO:tasks.workunit.client.0.smithi055.stdout:4/697: getdents d4/d18 0 2024-04-26T21:08:25.278 INFO:tasks.workunit.client.0.smithi055.stdout:4/698: symlink d4/d26/d42/d28/le9 0 2024-04-26T21:08:25.281 INFO:tasks.workunit.client.0.smithi055.stdout:4/699: creat d4/d18/d86/da6/fea x:0 0 0 2024-04-26T21:08:25.283 INFO:tasks.workunit.client.0.smithi055.stdout:4/700: symlink d4/d26/d42/d56/leb 0 2024-04-26T21:08:25.285 INFO:tasks.workunit.client.0.smithi055.stdout:4/701: creat d4/d26/d42/d28/d53/d70/dc9/fec x:0 0 0 2024-04-26T21:08:25.286 INFO:tasks.workunit.client.0.smithi055.stdout:2/948: dwrite d4/db/d1f/d46/fee [4194304,4194304] 0 2024-04-26T21:08:25.287 INFO:tasks.workunit.client.0.smithi055.stdout:5/691: dread d4/df/dae/dce/d93/dcb/fa8 [0,4194304] 0 2024-04-26T21:08:25.288 INFO:tasks.workunit.client.0.smithi055.stdout:4/702: getdents d4/d26/d42/dbb/dde 0 2024-04-26T21:08:25.289 INFO:tasks.workunit.client.0.smithi055.stdout:2/949: mkdir d4/dc/d13a 0 2024-04-26T21:08:25.291 INFO:tasks.workunit.client.0.smithi055.stdout:5/692: creat d4/df/dae/dce/d4a/d3f/d2e/d82/ff1 x:0 0 0 2024-04-26T21:08:25.291 INFO:tasks.workunit.client.0.smithi055.stdout:5/693: readlink d4/df/d13/d26/l48 0 2024-04-26T21:08:25.292 INFO:tasks.workunit.client.0.smithi055.stdout:3/910: sync 2024-04-26T21:08:25.292 INFO:tasks.workunit.client.0.smithi055.stdout:9/839: sync 2024-04-26T21:08:25.295 INFO:tasks.workunit.client.0.smithi055.stdout:4/703: unlink d4/f21 0 2024-04-26T21:08:25.295 INFO:tasks.workunit.client.0.smithi055.stdout:2/950: symlink d4/db/d1f/d46/l13b 0 2024-04-26T21:08:25.298 INFO:tasks.workunit.client.0.smithi055.stdout:5/694: link d4/df/l41 d4/df/dae/dce/d4a/d3f/d4f/d53/d87/lf2 0 2024-04-26T21:08:25.300 INFO:tasks.workunit.client.0.smithi055.stdout:9/840: creat d2/d46/d77/d79/f125 x:0 0 0 2024-04-26T21:08:25.304 INFO:tasks.workunit.client.0.smithi055.stdout:4/704: rename d4/d26/d42/d28/d53/d71/d7f/f88 to d4/d26/d42/dbb/dde/d49/dae/fed 0 2024-04-26T21:08:25.305 INFO:tasks.workunit.client.0.smithi055.stdout:2/951: mknod d4/db/d8f/df8/c13c 0 2024-04-26T21:08:25.315 INFO:tasks.workunit.client.0.smithi055.stdout:5/695: creat d4/df/dae/dce/d4a/d3f/d5c/db9/ff3 x:0 0 0 2024-04-26T21:08:25.315 INFO:tasks.workunit.client.0.smithi055.stdout:5/696: chown d4/df/d13/f95 115387 1 2024-04-26T21:08:25.315 INFO:tasks.workunit.client.0.smithi055.stdout:5/697: write d4/df/dae/dce/d4a/d3f/d4f/f75 [4592018,33502] 0 2024-04-26T21:08:25.316 INFO:tasks.workunit.client.0.smithi055.stdout:5/698: write d4/df/dae/dce/d4a/d3f/d4f/d53/f62 [907348,44747] 0 2024-04-26T21:08:25.316 INFO:tasks.workunit.client.0.smithi055.stdout:5/699: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/ff4 x:0 0 0 2024-04-26T21:08:25.326 INFO:tasks.workunit.client.0.smithi055.stdout:2/952: creat d4/d14/dc5/d107/f13d x:0 0 0 2024-04-26T21:08:25.326 INFO:tasks.workunit.client.0.smithi055.stdout:2/953: write d4/db/d56/f7c [4411231,2940] 0 2024-04-26T21:08:25.327 INFO:tasks.workunit.client.0.smithi055.stdout:2/954: stat d4/db/d8f/ff0 0 2024-04-26T21:08:25.327 INFO:tasks.workunit.client.0.smithi055.stdout:2/955: read - d4/d55/d6c/f9e zero size 2024-04-26T21:08:25.327 INFO:tasks.workunit.client.0.smithi055.stdout:4/705: getdents d4/d12/d57 0 2024-04-26T21:08:25.335 INFO:tasks.workunit.client.0.smithi055.stdout:2/956: mkdir d4/db/d56/d13e 0 2024-04-26T21:08:25.337 INFO:tasks.workunit.client.0.smithi055.stdout:2/957: creat d4/d14/dc5/d107/d12d/f13f x:0 0 0 2024-04-26T21:08:25.337 INFO:tasks.workunit.client.0.smithi055.stdout:2/958: stat d4/db/d8f/da6/d97/ldc 0 2024-04-26T21:08:25.338 INFO:tasks.workunit.client.0.smithi055.stdout:2/959: symlink d4/db/d8f/da6/l140 0 2024-04-26T21:08:25.364 INFO:tasks.workunit.client.0.smithi055.stdout:7/855: dwrite d5/f29 [0,4194304] 0 2024-04-26T21:08:25.364 INFO:tasks.workunit.client.0.smithi055.stdout:9/841: dwrite d2/d46/fd1 [0,4194304] 0 2024-04-26T21:08:25.364 INFO:tasks.workunit.client.0.smithi055.stdout:7/856: write d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/fcd [11316,73762] 0 2024-04-26T21:08:25.371 INFO:tasks.workunit.client.0.smithi055.stdout:9/842: mkdir d2/d46/d9a/d105/d97/d126 0 2024-04-26T21:08:25.371 INFO:tasks.workunit.client.0.smithi055.stdout:9/843: dread - d2/d46/d9a/d105/db8/dc5/f120 zero size 2024-04-26T21:08:25.373 INFO:tasks.workunit.client.0.smithi055.stdout:7/857: getdents d5/d53/d6e/d99/d7f/d6f/da5 0 2024-04-26T21:08:25.376 INFO:tasks.workunit.client.0.smithi055.stdout:9/844: symlink d2/d46/d9a/d105/db8/l127 0 2024-04-26T21:08:25.379 INFO:tasks.workunit.client.0.smithi055.stdout:5/700: dwrite d4/df/d13/d26/f4e [0,4194304] 0 2024-04-26T21:08:25.380 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:25 smithi064 ceph-mon[33404]: pgmap v45: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 148 MiB/s rd, 186 MiB/s wr, 292 op/s 2024-04-26T21:08:25.382 INFO:tasks.workunit.client.0.smithi055.stdout:9/845: creat d2/d46/d77/d79/d11b/f128 x:0 0 0 2024-04-26T21:08:25.385 INFO:tasks.workunit.client.0.smithi055.stdout:3/911: dwrite d0/d4/df6/f118 [0,4194304] 0 2024-04-26T21:08:25.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/706: dwrite d4/d18/d8e/d9e/fa0 [0,4194304] 0 2024-04-26T21:08:25.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/707: write d4/d12/d17/f6e [1688135,68078] 0 2024-04-26T21:08:25.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/708: dread - d4/d12/d61/dd1/fe5 zero size 2024-04-26T21:08:25.391 INFO:tasks.workunit.client.0.smithi055.stdout:9/846: link d2/d46/d9a/d105/d97/dd7/f10e d2/d11/f129 0 2024-04-26T21:08:25.393 INFO:tasks.workunit.client.0.smithi055.stdout:5/701: getdents d4/df/d13/d26/d63/ddc 0 2024-04-26T21:08:25.396 INFO:tasks.workunit.client.0.smithi055.stdout:5/702: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/dc9/cf5 0 2024-04-26T21:08:25.396 INFO:tasks.workunit.client.0.smithi055.stdout:5/703: chown d4/df/dae/dce/d4a/d3f/d4f/f77 15865 1 2024-04-26T21:08:25.396 INFO:tasks.workunit.client.0.smithi055.stdout:5/704: truncate d4/df/d13/d26/d63/ddc/fe3 942278 0 2024-04-26T21:08:25.397 INFO:tasks.workunit.client.0.smithi055.stdout:9/847: rename d2/d46/d77/c40 to d2/d46/d9a/d105/d97/d9b/c12a 0 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/848: creat d2/d46/d9a/d105/db8/dc5/f12b x:0 0 0 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/849: dread - d2/d11/fd2 zero size 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/850: write d2/d46/d9a/d105/fc1 [914912,47805] 0 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/851: fdatasync d2/d11/f1f 0 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:9/852: write d2/fc8 [1642015,112627] 0 2024-04-26T21:08:25.399 INFO:tasks.workunit.client.0.smithi055.stdout:3/912: dread d0/d4/d5/d73/d13/d27/d50/d6b/d83/fad [0,4194304] 0 2024-04-26T21:08:25.400 INFO:tasks.workunit.client.0.smithi055.stdout:9/853: rename d2/d46/d9a/d105/db8/dc5/ded to d2/d46/d9a/d105/d97/dd7/d12c 0 2024-04-26T21:08:25.421 INFO:tasks.workunit.client.0.smithi055.stdout:7/858: dread d5/d53/d6e/d99/d7f/d6f/dc6/dc8/db1/fca [0,4194304] 0 2024-04-26T21:08:25.432 INFO:tasks.workunit.client.0.smithi055.stdout:4/709: dread d4/d26/d42/d28/d53/d71/fb4 [0,4194304] 0 2024-04-26T21:08:25.433 INFO:tasks.workunit.client.0.smithi055.stdout:2/960: dwrite d4/db/d1f/f67 [0,4194304] 0 2024-04-26T21:08:25.437 INFO:tasks.workunit.client.0.smithi055.stdout:4/710: symlink d4/d26/d42/lee 0 2024-04-26T21:08:25.437 INFO:tasks.workunit.client.0.smithi055.stdout:4/711: readlink d4/d26/d42/d28/d53/d71/d7f/da1/lca 0 2024-04-26T21:08:25.440 INFO:tasks.workunit.client.0.smithi055.stdout:2/961: truncate d4/db/f25 221340 0 2024-04-26T21:08:25.440 INFO:tasks.workunit.client.0.smithi055.stdout:2/962: write d4/dc/f8b [269543,9098] 0 2024-04-26T21:08:25.440 INFO:tasks.workunit.client.0.smithi055.stdout:2/963: chown d4/db/l45 745 1 2024-04-26T21:08:25.447 INFO:tasks.workunit.client.0.smithi055.stdout:9/854: rename d2/d46/d9a/d105/d97 to d2/d46/d12d 0 2024-04-26T21:08:25.447 INFO:tasks.workunit.client.0.smithi055.stdout:9/855: stat d2/d46/d9a/d105/db8/dc5/f120 0 2024-04-26T21:08:25.447 INFO:tasks.workunit.client.0.smithi055.stdout:2/964: creat d4/db/d26/d9a/dc3/f141 x:0 0 0 2024-04-26T21:08:25.449 INFO:tasks.workunit.client.0.smithi055.stdout:5/705: dwrite d4/df/d13/d26/f8f [4194304,4194304] 0 2024-04-26T21:08:25.449 INFO:tasks.workunit.client.0.smithi055.stdout:5/706: truncate d4/df/dae/dce/d4a/fb3 6997 0 2024-04-26T21:08:25.469 INFO:tasks.workunit.client.0.smithi055.stdout:2/965: dread d4/d14/dc5/d107/f116 [0,4194304] 0 2024-04-26T21:08:25.511 INFO:tasks.workunit.client.0.smithi055.stdout:5/707: dread d4/df/dae/dce/d93/dcb/f89 [0,4194304] 0 2024-04-26T21:08:25.539 INFO:tasks.workunit.client.0.smithi055.stdout:7/859: dwrite d5/d53/d6e/d65/dc5/dc7/fc9 [0,4194304] 0 2024-04-26T21:08:25.539 INFO:tasks.workunit.client.0.smithi055.stdout:7/860: truncate d5/d6/d24/dcf/f97 972466 0 2024-04-26T21:08:25.539 INFO:tasks.workunit.client.0.smithi055.stdout:7/861: stat d5/d11/d8c/d105/d109 0 2024-04-26T21:08:25.541 INFO:tasks.workunit.client.0.smithi055.stdout:7/862: symlink d5/d53/d6e/d65/l10c 0 2024-04-26T21:08:25.544 INFO:tasks.workunit.client.0.smithi055.stdout:4/712: dwrite d4/d26/d42/dbb/f3b [4194304,4194304] 0 2024-04-26T21:08:25.544 INFO:tasks.workunit.client.0.smithi055.stdout:4/713: chown d4/f30 208 1 2024-04-26T21:08:25.546 INFO:tasks.workunit.client.0.smithi055.stdout:9/856: dwrite d2/f3f [0,4194304] 0 2024-04-26T21:08:25.546 INFO:tasks.workunit.client.0.smithi055.stdout:9/857: chown d2/d46/d51/c81 197 1 2024-04-26T21:08:25.574 INFO:tasks.workunit.client.0.smithi055.stdout:5/708: dwrite d4/df/dae/dce/d4a/d3f/f2c [0,4194304] 0 2024-04-26T21:08:25.575 INFO:tasks.workunit.client.0.smithi055.stdout:2/966: dwrite d4/db/d26/f8d [0,4194304] 0 2024-04-26T21:08:25.576 INFO:tasks.workunit.client.0.smithi055.stdout:2/967: write d4/db/d8f/da6/d97/f123 [380423,31305] 0 2024-04-26T21:08:25.577 INFO:tasks.workunit.client.0.smithi055.stdout:5/709: write f2 [1440028,5045] 0 2024-04-26T21:08:25.578 INFO:tasks.workunit.client.0.smithi055.stdout:5/710: chown d4/df/dae/dce/d5b/d83/fa7 18110147 1 2024-04-26T21:08:25.578 INFO:tasks.workunit.client.0.smithi055.stdout:5/711: chown d4/df/dae/dce/d4a/d3f/d4f/d53/d90 2619521 1 2024-04-26T21:08:25.578 INFO:tasks.workunit.client.0.smithi055.stdout:5/712: chown d4/df/d13/cb7 55 1 2024-04-26T21:08:25.578 INFO:tasks.workunit.client.0.smithi055.stdout:5/713: chown d4/df/dae/dce/d4a/d3f/d4f/d53/d90/lc6 93884911 1 2024-04-26T21:08:25.609 INFO:tasks.workunit.client.0.smithi055.stdout:2/968: creat d4/d14/f142 x:0 0 0 2024-04-26T21:08:25.609 INFO:tasks.workunit.client.0.smithi055.stdout:2/969: rename d4/db/d8f/da6 to d4/db/d8f/da6/d143 22 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:3/913: sync 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:8/697: sync 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:1/868: sync 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:8/698: chown d3/dc0/d2e/ddc/le6 130423010 1 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:1/869: chown d8/d17/d1b/d7b/d65/lb4 28 1 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:6/877: sync 2024-04-26T21:08:25.610 INFO:tasks.workunit.client.0.smithi055.stdout:0/899: sync 2024-04-26T21:08:25.612 INFO:tasks.workunit.client.0.smithi055.stdout:4/714: dwrite d4/d12/d15/fcb [4194304,4194304] 0 2024-04-26T21:08:25.613 INFO:tasks.workunit.client.0.smithi055.stdout:2/970: mknod d4/dda/c144 0 2024-04-26T21:08:25.621 INFO:tasks.workunit.client.0.smithi055.stdout:3/914: rmdir d0/d4/d5/d73/d47/d37/de7/dff 39 2024-04-26T21:08:25.625 INFO:tasks.workunit.client.0.smithi055.stdout:8/699: link d3/dc0/d2e/f62 d3/d7c/d9a/feb 0 2024-04-26T21:08:25.635 INFO:tasks.workunit.client.0.smithi055.stdout:6/878: mknod d3/d17/d25/d5f/d90/c130 0 2024-04-26T21:08:25.635 INFO:tasks.workunit.client.0.smithi055.stdout:6/879: write d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/fe4 [261615,127308] 0 2024-04-26T21:08:25.635 INFO:tasks.workunit.client.0.smithi055.stdout:1/870: symlink d8/d17/d1b/d7b/df1/l126 0 2024-04-26T21:08:25.637 INFO:tasks.workunit.client.0.smithi055.stdout:0/900: rename d9/d11/d59/d78/d106/f60 to d9/dc/d1c/d3e/dc5/dcc/d4b/f11e 0 2024-04-26T21:08:25.639 INFO:tasks.workunit.client.0.smithi055.stdout:0/901: write d9/dc/d17/d5d/f9e [985400,112611] 0 2024-04-26T21:08:25.643 INFO:tasks.workunit.client.0.smithi055.stdout:2/971: link d4/db/d8f/ff0 d4/d1e/d90/f145 0 2024-04-26T21:08:25.643 INFO:tasks.workunit.client.0.smithi055.stdout:8/700: truncate d3/d9/d1d/d48/d4b/fb4 2506069 0 2024-04-26T21:08:25.644 INFO:tasks.workunit.client.0.smithi055.stdout:0/902: truncate d9/d11/d5b/f90 1266743 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:0/903: write d9/dc/d19/ddb/dbd/fd0 [553954,120943] 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:0/904: readlink d9/d11/d5b/d74/l3c 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:0/905: chown d9/dc/d17/d5d 0 1 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:0/906: stat d9 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:0/907: stat d9/d11/d59/d78/la7 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:3/915: dread d0/d4/d5/d73/f14 [0,4194304] 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:3/916: read d0/d4/d16/d18/f30 [2377950,83216] 0 2024-04-26T21:08:25.645 INFO:tasks.workunit.client.0.smithi055.stdout:3/917: write d0/d4/d5/d73/d13/d27/d3b/faf [4396791,15484] 0 2024-04-26T21:08:25.647 INFO:tasks.workunit.client.0.smithi055.stdout:2/972: mkdir d4/db/d26/d9a/d146 0 2024-04-26T21:08:25.647 INFO:tasks.workunit.client.0.smithi055.stdout:2/973: chown d4/db/d8f/da6/l6f 30297102 1 2024-04-26T21:08:25.647 INFO:tasks.workunit.client.0.smithi055.stdout:2/974: truncate d4/d14/d17/f5d 1831342 0 2024-04-26T21:08:25.648 INFO:tasks.workunit.client.0.smithi055.stdout:6/880: dread d3/da1/fcf [0,4194304] 0 2024-04-26T21:08:25.648 INFO:tasks.workunit.client.0.smithi055.stdout:6/881: chown d3/d17/d25/d5f/d90/lad 6414995 1 2024-04-26T21:08:25.650 INFO:tasks.workunit.client.0.smithi055.stdout:4/715: dread d4/d26/d42/d28/d53/d70/f75 [0,4194304] 0 2024-04-26T21:08:25.655 INFO:tasks.workunit.client.0.smithi055.stdout:3/918: symlink d0/d4/d16/d12e/l132 0 2024-04-26T21:08:25.658 INFO:tasks.workunit.client.0.smithi055.stdout:6/882: write d3/d17/d46/d109/d66/d6a/d67/d83/d96/f119 [161377,51497] 0 2024-04-26T21:08:25.659 INFO:tasks.workunit.client.0.smithi055.stdout:0/908: link d9/df0/cfc d9/dc/c11f 0 2024-04-26T21:08:25.664 INFO:tasks.workunit.client.0.smithi055.stdout:4/716: link d4/d12/d17/d3d/fd2 d4/d26/d42/dbb/dde/de3/fef 0 2024-04-26T21:08:25.664 INFO:tasks.workunit.client.0.smithi055.stdout:4/717: readlink d4/d18/d86/da6/ld4 0 2024-04-26T21:08:25.664 INFO:tasks.workunit.client.0.smithi055.stdout:1/871: dread d8/df/d11/d27/d28/d2a/f58 [0,4194304] 0 2024-04-26T21:08:25.668 INFO:tasks.workunit.client.0.smithi055.stdout:0/909: creat d9/dc/d1c/d3e/dc5/dcc/d9c/dee/f120 x:0 0 0 2024-04-26T21:08:25.669 INFO:tasks.workunit.client.0.smithi055.stdout:0/910: write d9/d11/d5b/f90 [2061359,68677] 0 2024-04-26T21:08:25.670 INFO:tasks.workunit.client.0.smithi055.stdout:3/919: dread d0/d4/d5/d73/d47/d37/de7/ff8 [0,4194304] 0 2024-04-26T21:08:25.674 INFO:tasks.workunit.client.0.smithi055.stdout:5/714: dwrite d4/df/d13/d26/f58 [0,4194304] 0 2024-04-26T21:08:25.679 INFO:tasks.workunit.client.0.smithi055.stdout:4/718: creat d4/d26/d42/d28/d53/d70/ff0 x:0 0 0 2024-04-26T21:08:25.679 INFO:tasks.workunit.client.0.smithi055.stdout:4/719: creat d4/d18/d86/da6/ff1 x:0 0 0 2024-04-26T21:08:25.696 INFO:tasks.workunit.client.0.smithi055.stdout:4/720: mkdir d4/d26/d42/dbb/dde/d49/df2 0 2024-04-26T21:08:25.713 INFO:tasks.workunit.client.0.smithi055.stdout:6/883: dread d3/d17/d46/f7f [0,4194304] 0 2024-04-26T21:08:25.714 INFO:tasks.workunit.client.0.smithi055.stdout:6/884: write d3/d17/d46/d109/d66/d6a/d51/d58/d62/f78 [2142628,53166] 0 2024-04-26T21:08:25.724 INFO:tasks.workunit.client.0.smithi055.stdout:2/975: write d4/db/d1f/d32/f3e [4013031,68545] 0 2024-04-26T21:08:25.726 INFO:tasks.workunit.client.0.smithi055.stdout:6/885: mknod d3/da1/c131 0 2024-04-26T21:08:25.733 INFO:tasks.workunit.client.0.smithi055.stdout:1/872: read d8/d17/d6a/fe1 [3840466,43579] 0 2024-04-26T21:08:25.733 INFO:tasks.workunit.client.0.smithi055.stdout:1/873: write d8/df/d11/fdc [1200246,117456] 0 2024-04-26T21:08:25.737 INFO:tasks.workunit.client.0.smithi055.stdout:0/911: dwrite d9/dc/f10 [0,4194304] 0 2024-04-26T21:08:25.737 INFO:tasks.workunit.client.0.smithi055.stdout:0/912: dread - d9/d27/dcb/d103/f11c zero size 2024-04-26T21:08:25.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/920: write d0/d4/d5/d73/d13/d27/d3b/faf [299792,128921] 0 2024-04-26T21:08:25.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/921: fsync d0/d4/d5/d73/d13/fe4 0 2024-04-26T21:08:25.741 INFO:tasks.workunit.client.0.smithi055.stdout:3/922: stat d0/f34 0 2024-04-26T21:08:25.748 INFO:tasks.workunit.client.0.smithi055.stdout:2/976: write d4/db/d26/d9a/fad [1720261,19522] 0 2024-04-26T21:08:25.748 INFO:tasks.workunit.client.0.smithi055.stdout:8/701: dwrite d3/dc0/d2e/d75/d76/d92/fbf [0,4194304] 0 2024-04-26T21:08:25.749 INFO:tasks.workunit.client.0.smithi055.stdout:1/874: mknod d8/df/d11/d27/d28/da4/c127 0 2024-04-26T21:08:25.749 INFO:tasks.workunit.client.0.smithi055.stdout:1/875: fsync d8/d17/d1b/d7b/d65/fa8 0 2024-04-26T21:08:25.753 INFO:tasks.workunit.client.0.smithi055.stdout:0/913: getdents d9/d27/dcb 0 2024-04-26T21:08:25.756 INFO:tasks.workunit.client.0.smithi055.stdout:8/702: dread d3/d89/daa/fe2 [0,4194304] 0 2024-04-26T21:08:25.757 INFO:tasks.workunit.client.0.smithi055.stdout:2/977: dread d4/dc/f1d [0,4194304] 0 2024-04-26T21:08:25.765 INFO:tasks.workunit.client.0.smithi055.stdout:1/876: mknod d8/d17/d1b/d7b/d8d/df9/d100/c128 0 2024-04-26T21:08:25.773 INFO:tasks.workunit.client.0.smithi055.stdout:0/914: creat d9/dc/d1c/d3e/d7d/dc1/f121 x:0 0 0 2024-04-26T21:08:25.773 INFO:tasks.workunit.client.0.smithi055.stdout:8/703: symlink d3/d9/d5b/lec 0 2024-04-26T21:08:25.777 INFO:tasks.workunit.client.0.smithi055.stdout:8/704: creat d3/d9/d1d/d48/d80/fed x:0 0 0 2024-04-26T21:08:25.777 INFO:tasks.workunit.client.0.smithi055.stdout:5/715: dwrite d4/df/d13/f81 [0,4194304] 0 2024-04-26T21:08:25.780 INFO:tasks.workunit.client.0.smithi055.stdout:2/978: creat d4/db/d56/d13e/f147 x:0 0 0 2024-04-26T21:08:25.784 INFO:tasks.workunit.client.0.smithi055.stdout:8/705: dread d3/dc0/f32 [0,4194304] 0 2024-04-26T21:08:25.788 INFO:tasks.workunit.client.0.smithi055.stdout:3/923: rmdir d0/d4/d5/d73/d13/d1a/d46/d55 39 2024-04-26T21:08:25.788 INFO:tasks.workunit.client.0.smithi055.stdout:3/924: truncate d0/f68 2258724 0 2024-04-26T21:08:25.815 INFO:tasks.workunit.client.0.smithi055.stdout:4/721: dwrite d4/fc3 [0,4194304] 0 2024-04-26T21:08:25.815 INFO:tasks.workunit.client.0.smithi055.stdout:4/722: truncate d4/d12/d17/fa8 2273900 0 2024-04-26T21:08:25.815 INFO:tasks.workunit.client.0.smithi055.stdout:6/886: dread d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/fa7 [0,4194304] 0 2024-04-26T21:08:25.815 INFO:tasks.workunit.client.0.smithi055.stdout:6/887: truncate d3/d17/d46/dc2/fc5 299918 0 2024-04-26T21:08:25.821 INFO:tasks.workunit.client.0.smithi055.stdout:1/877: dwrite d8/d17/d1b/d7b/fe2 [4194304,4194304] 0 2024-04-26T21:08:25.826 INFO:tasks.workunit.client.0.smithi055.stdout:1/878: dread d8/df/d11/d6c/fdb [0,4194304] 0 2024-04-26T21:08:25.826 INFO:tasks.workunit.client.0.smithi055.stdout:1/879: chown d8/d94/de7/dfa 604237530 1 2024-04-26T21:08:25.829 INFO:tasks.workunit.client.0.smithi055.stdout:2/979: truncate d4/d14/d17/d6d/f77 410482 0 2024-04-26T21:08:25.831 INFO:tasks.workunit.client.0.smithi055.stdout:6/888: dread d3/f16 [0,4194304] 0 2024-04-26T21:08:25.836 INFO:tasks.workunit.client.0.smithi055.stdout:8/706: creat d3/d9/d5b/fee x:0 0 0 2024-04-26T21:08:25.837 INFO:tasks.workunit.client.0.smithi055.stdout:0/915: dwrite d9/dc/f8f [0,4194304] 0 2024-04-26T21:08:25.838 INFO:tasks.workunit.client.0.smithi055.stdout:3/925: unlink d0/d4/d5/d73/d13/d1a/d46/d72/fd1 0 2024-04-26T21:08:25.838 INFO:tasks.workunit.client.0.smithi055.stdout:3/926: chown d0/d4/d5/d73/d13/d27 4088268 1 2024-04-26T21:08:25.842 INFO:tasks.workunit.client.0.smithi055.stdout:5/716: rmdir d4/df/dae/dce/d4a/d3f/d2e/d82 39 2024-04-26T21:08:25.850 INFO:tasks.workunit.client.0.smithi055.stdout:1/880: dread d8/d17/d33/f82 [0,4194304] 0 2024-04-26T21:08:25.859 INFO:tasks.workunit.client.0.smithi055.stdout:7/863: sync 2024-04-26T21:08:25.860 INFO:tasks.workunit.client.0.smithi055.stdout:9/858: sync 2024-04-26T21:08:25.866 INFO:tasks.workunit.client.0.smithi055.stdout:2/980: mkdir d4/d49/d148 0 2024-04-26T21:08:25.870 INFO:tasks.workunit.client.0.smithi055.stdout:8/707: dread d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:25.870 INFO:tasks.workunit.client.0.smithi055.stdout:8/708: fsync d3/d7c/faf 0 2024-04-26T21:08:25.871 INFO:tasks.workunit.client.0.smithi055.stdout:3/927: symlink d0/d4/df6/l133 0 2024-04-26T21:08:25.881 INFO:tasks.workunit.client.0.smithi055.stdout:0/916: dwrite d9/dc/f57 [4194304,4194304] 0 2024-04-26T21:08:25.881 INFO:tasks.workunit.client.0.smithi055.stdout:0/917: write d9/dc/d1c/d3e/dc5/dcc/d9c/dee/f120 [585396,100565] 0 2024-04-26T21:08:25.882 INFO:tasks.workunit.client.0.smithi055.stdout:4/723: rmdir d4/d12/d61 39 2024-04-26T21:08:25.886 INFO:tasks.workunit.client.0.smithi055.stdout:5/717: unlink d4/df/dae/dce/d4a/d3f/d4f/c9b 0 2024-04-26T21:08:25.886 INFO:tasks.workunit.client.0.smithi055.stdout:5/718: truncate d4/df/dae/dce/d4a/f8a 1069018 0 2024-04-26T21:08:25.888 INFO:tasks.workunit.client.0.smithi055.stdout:7/864: symlink d5/d6/d24/d4d/da7/dab/dce/de7/def/l10d 0 2024-04-26T21:08:25.893 INFO:tasks.workunit.client.0.smithi055.stdout:8/709: write d3/d9/fab [2171600,79262] 0 2024-04-26T21:08:25.893 INFO:tasks.workunit.client.0.smithi055.stdout:8/710: fsync d3/d9/d44/fb8 0 2024-04-26T21:08:25.893 INFO:tasks.workunit.client.0.smithi055.stdout:8/711: creat d3/dc0/d2e/db3/fef x:0 0 0 2024-04-26T21:08:25.893 INFO:tasks.workunit.client.0.smithi055.stdout:9/859: rename d2/d46/d77/d5f/l7f to d2/d46/d77/d7d/l12e 0 2024-04-26T21:08:25.894 INFO:tasks.workunit.client.0.smithi055.stdout:0/918: symlink d9/dc/d17/l122 0 2024-04-26T21:08:25.895 INFO:tasks.workunit.client.0.smithi055.stdout:4/724: symlink d4/d12/d61/lf3 0 2024-04-26T21:08:25.898 INFO:tasks.workunit.client.0.smithi055.stdout:5/719: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ff6 x:0 0 0 2024-04-26T21:08:25.908 INFO:tasks.workunit.client.0.smithi055.stdout:8/712: mknod d3/d89/cf0 0 2024-04-26T21:08:25.909 INFO:tasks.workunit.client.0.smithi055.stdout:8/713: stat d3/d9/d1d/d48/d57/d61/f97 0 2024-04-26T21:08:25.909 INFO:tasks.workunit.client.0.smithi055.stdout:9/860: truncate d2/d11/f73 319024 0 2024-04-26T21:08:25.914 INFO:tasks.workunit.client.0.smithi055.stdout:7/865: rename d5/d53/dd1/fe1 to d5/d11/d8c/d105/d109/f10e 0 2024-04-26T21:08:25.925 INFO:tasks.workunit.client.0.smithi055.stdout:0/919: link d9/dc/d19/ddb/db6/f8e d9/d11/d59/f123 0 2024-04-26T21:08:25.929 INFO:tasks.workunit.client.0.smithi055.stdout:5/720: rmdir d4/df/dae/dce/d4a/d3f/d4f/d53 39 2024-04-26T21:08:25.938 INFO:tasks.workunit.client.0.smithi055.stdout:7/866: dread d5/d53/d6e/d65/f94 [0,4194304] 0 2024-04-26T21:08:25.944 INFO:tasks.workunit.client.0.smithi055.stdout:4/725: write d4/d26/d42/dbb/dde/f37 [408219,33684] 0 2024-04-26T21:08:25.945 INFO:tasks.workunit.client.0.smithi055.stdout:4/726: write d4/d26/fa3 [1014844,102387] 0 2024-04-26T21:08:25.950 INFO:tasks.workunit.client.0.smithi055.stdout:1/881: dwrite d8/d17/d1b/d7b/d65/fa8 [0,4194304] 0 2024-04-26T21:08:25.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/920: chown d9/dab 1168211385 1 2024-04-26T21:08:25.950 INFO:tasks.workunit.client.0.smithi055.stdout:0/921: write d9/dc/d1c/d3e/dc5/dcc/d9c/f100 [459035,22312] 0 2024-04-26T21:08:25.955 INFO:tasks.workunit.client.0.smithi055.stdout:7/867: unlink d5/d6/d24/d4d/da7/dab/dce/ff5 0 2024-04-26T21:08:25.956 INFO:tasks.workunit.client.0.smithi055.stdout:4/727: symlink d4/d18/d86/da6/lf4 0 2024-04-26T21:08:25.961 INFO:tasks.workunit.client.0.smithi055.stdout:2/981: dread d4/db/d8f/df8/f73 [0,4194304] 0 2024-04-26T21:08:25.961 INFO:tasks.workunit.client.0.smithi055.stdout:2/982: creat d4/db/d8f/f149 x:0 0 0 2024-04-26T21:08:25.964 INFO:tasks.workunit.client.0.smithi055.stdout:4/728: read d4/d12/d17/f6e [1390993,18285] 0 2024-04-26T21:08:25.966 INFO:tasks.workunit.client.0.smithi055.stdout:0/922: mkdir d9/dab/d124 0 2024-04-26T21:08:25.969 INFO:tasks.workunit.client.0.smithi055.stdout:2/983: truncate d4/db/d56/d4a/d7e/f93 414968 0 2024-04-26T21:08:25.969 INFO:tasks.workunit.client.0.smithi055.stdout:2/984: write d4/d55/d6c/f94 [3050291,69245] 0 2024-04-26T21:08:25.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/923: rmdir d9/dc/d1c 39 2024-04-26T21:08:25.973 INFO:tasks.workunit.client.0.smithi055.stdout:0/924: readlink d9/dc/d17/l38 0 2024-04-26T21:08:25.978 INFO:tasks.workunit.client.0.smithi055.stdout:4/729: getdents d4/d26/d42/d28/d53/d70/dc9 0 2024-04-26T21:08:25.979 INFO:tasks.workunit.client.0.smithi055.stdout:0/925: mknod d9/dc/d19/ddb/db6/d67/c125 0 2024-04-26T21:08:25.981 INFO:tasks.workunit.client.0.smithi055.stdout:3/928: dwrite d0/d4/d5/d73/d47/f76 [4194304,4194304] 0 2024-04-26T21:08:25.981 INFO:tasks.workunit.client.0.smithi055.stdout:3/929: readlink d0/d4/d5/d73/d47/dcf/l65 0 2024-04-26T21:08:25.987 INFO:tasks.workunit.client.0.smithi055.stdout:4/730: truncate d4/f36 5348499 0 2024-04-26T21:08:25.987 INFO:tasks.workunit.client.0.smithi055.stdout:1/882: dread d8/df/d11/d27/fc3 [0,4194304] 0 2024-04-26T21:08:25.991 INFO:tasks.workunit.client.0.smithi055.stdout:7/868: dread d5/d6/d24/d3b/fda [0,4194304] 0 2024-04-26T21:08:25.994 INFO:tasks.workunit.client.0.smithi055.stdout:8/714: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:25.994 INFO:tasks.workunit.client.0.smithi055.stdout:8/715: chown d3/d9/d1d/f85 1564396 1 2024-04-26T21:08:26.002 INFO:tasks.workunit.client.0.smithi055.stdout:1/883: symlink d8/d17/d33/l129 0 2024-04-26T21:08:26.003 INFO:tasks.workunit.client.0.smithi055.stdout:8/716: rename d3/dc0/d2e/db3/dd6 to d3/d9/d1d/d48/d80/dce/df1 0 2024-04-26T21:08:26.004 INFO:tasks.workunit.client.0.smithi055.stdout:7/869: dread d5/d53/d6e/d65/f7c [0,4194304] 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:1/884: truncate d8/df/d11/d27/fc3 2380717 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:1/885: fdatasync d8/d17/d6a/fe1 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/717: link d3/d9/d1d/f85 d3/dc0/d2e/d75/dcb/ff2 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/718: fsync d3/d9/d1d/d48/d57/fb2 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:0/926: write d9/dc/d1c/f4f [2099987,106407] 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/719: fsync d3/d77/da9/fda 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/720: dread - d3/d9/d1d/d48/fa2 zero size 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:0/927: truncate d9/dc/d1c/d3e/f47 4380178 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/721: fsync d3/dc0/d2e/f56 0 2024-04-26T21:08:26.015 INFO:tasks.workunit.client.0.smithi055.stdout:7/870: dread d5/d53/d6e/d65/f7c [0,4194304] 0 2024-04-26T21:08:26.018 INFO:tasks.workunit.client.0.smithi055.stdout:0/928: rename d9/dc/f8f to d9/dc/d1c/d3e/dc5/dcc/d4b/d113/f126 0 2024-04-26T21:08:26.018 INFO:tasks.workunit.client.0.smithi055.stdout:0/929: write d9/dc/d17/d9a/f104 [284201,90859] 0 2024-04-26T21:08:26.018 INFO:tasks.workunit.client.0.smithi055.stdout:8/722: link d3/d9/d5b/fee d3/d9/ff3 0 2024-04-26T21:08:26.019 INFO:tasks.workunit.client.0.smithi055.stdout:3/930: dread d0/f34 [0,4194304] 0 2024-04-26T21:08:26.020 INFO:tasks.workunit.client.0.smithi055.stdout:2/985: dwrite d4/d1e/d90/dbc/f10d [0,4194304] 0 2024-04-26T21:08:26.020 INFO:tasks.workunit.client.0.smithi055.stdout:7/871: dread d5/d53/d6e/f6b [0,4194304] 0 2024-04-26T21:08:26.020 INFO:tasks.workunit.client.0.smithi055.stdout:7/872: chown d5/d53/d6e/d99/d75/c7b 217990 1 2024-04-26T21:08:26.020 INFO:tasks.workunit.client.0.smithi055.stdout:7/873: dread - d5/d6/d24/d4d/f73 zero size 2024-04-26T21:08:26.021 INFO:tasks.workunit.client.0.smithi055.stdout:0/930: write d9/dc/d19/ddb/db6/f8e [259631,27220] 0 2024-04-26T21:08:26.021 INFO:tasks.workunit.client.0.smithi055.stdout:0/931: stat d9/dc/d17/d5d/l76 0 2024-04-26T21:08:26.024 INFO:tasks.workunit.client.0.smithi055.stdout:3/931: symlink d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/l134 0 2024-04-26T21:08:26.029 INFO:tasks.workunit.client.0.smithi055.stdout:2/986: creat d4/db/d1f/d46/d51/f14a x:0 0 0 2024-04-26T21:08:26.036 INFO:tasks.workunit.client.0.smithi055.stdout:1/886: write d8/f12 [3267832,87019] 0 2024-04-26T21:08:26.041 INFO:tasks.workunit.client.0.smithi055.stdout:3/932: creat d0/d4/d131/f135 x:0 0 0 2024-04-26T21:08:26.047 INFO:tasks.workunit.client.0.smithi055.stdout:1/887: rename d8/df/d11/d27/fc3 to d8/df/d11/db5/f12a 0 2024-04-26T21:08:26.047 INFO:tasks.workunit.client.0.smithi055.stdout:1/888: readlink d8/df/d11/d27/l97 0 2024-04-26T21:08:26.047 INFO:tasks.workunit.client.0.smithi055.stdout:1/889: dread - d8/d17/d1b/d7b/f11e zero size 2024-04-26T21:08:26.051 INFO:tasks.workunit.client.0.smithi055.stdout:3/933: rename d0/d4/d5/d73/d13/d27/d50/cb6 to d0/d4/d16/d18/d10f/c136 0 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:7/874: dread d5/d53/d6e/d99/d7f/f96 [0,4194304] 0 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:7/875: stat d5/d6/d24/d4d/da7/dab/laf 0 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:7/876: chown d5/d6/d24/d3b/f44 908 1 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:1/890: rmdir d8/d17/d1b/d7b/d8d/df9/d100 39 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:1/891: fdatasync d8/f86 0 2024-04-26T21:08:26.052 INFO:tasks.workunit.client.0.smithi055.stdout:1/892: dread - d8/f86 zero size 2024-04-26T21:08:26.058 INFO:tasks.workunit.client.0.smithi055.stdout:3/934: symlink d0/d4/d16/d18/d4b/l137 0 2024-04-26T21:08:26.060 INFO:tasks.workunit.client.0.smithi055.stdout:7/877: mkdir d5/d6/d10f 0 2024-04-26T21:08:26.060 INFO:tasks.workunit.client.0.smithi055.stdout:7/878: truncate d5/d53/d6e/d99/d75/ffc 192680 0 2024-04-26T21:08:26.067 INFO:tasks.workunit.client.0.smithi055.stdout:1/893: creat d8/df/d11/d27/d28/da4/f12b x:0 0 0 2024-04-26T21:08:26.067 INFO:tasks.workunit.client.0.smithi055.stdout:1/894: chown d8/df/d11/d27/d28/da4/dbe 120 1 2024-04-26T21:08:26.067 INFO:tasks.workunit.client.0.smithi055.stdout:1/895: chown d8/d94/cdd 7202 1 2024-04-26T21:08:26.067 INFO:tasks.workunit.client.0.smithi055.stdout:1/896: chown d8/lcb 19321573 1 2024-04-26T21:08:26.068 INFO:tasks.workunit.client.0.smithi055.stdout:7/879: creat d5/d6/d39/dbc/f110 x:0 0 0 2024-04-26T21:08:26.068 INFO:tasks.workunit.client.0.smithi055.stdout:7/880: chown d5/f83 3098 1 2024-04-26T21:08:26.073 INFO:tasks.workunit.client.0.smithi055.stdout:7/881: rename d5/d53/d6e/d99/d7f/d6f/dc6/dc8 to d5/d53/d6e/d65/d111 0 2024-04-26T21:08:26.077 INFO:tasks.workunit.client.0.smithi055.stdout:3/935: read d0/d4/d5/f62 [1318496,10000] 0 2024-04-26T21:08:26.087 INFO:tasks.workunit.client.0.smithi055.stdout:3/936: rename d0/d4/d5/d73/d47/dcf/f10d to d0/d4/d5/d73/d13/d1a/d46/d72/f138 0 2024-04-26T21:08:26.098 INFO:tasks.workunit.client.0.smithi055.stdout:3/937: rmdir d0/d4/d5/d73/d47/d37/dbd 39 2024-04-26T21:08:26.098 INFO:tasks.workunit.client.0.smithi055.stdout:3/938: fdatasync d0/d4/d5/d73/d47/d37/dbd/fdf 0 2024-04-26T21:08:26.108 INFO:tasks.workunit.client.0.smithi055.stdout:2/987: dwrite d4/dc/f8b [0,4194304] 0 2024-04-26T21:08:26.109 INFO:tasks.workunit.client.0.smithi055.stdout:3/939: unlink d0/d4/f44 0 2024-04-26T21:08:26.110 INFO:tasks.workunit.client.0.smithi055.stdout:3/940: chown d0/d4/d5/f127 198742 1 2024-04-26T21:08:26.136 INFO:tasks.workunit.client.0.smithi055.stdout:8/723: dwrite d3/d9/d1d/d48/d57/d61/f97 [0,4194304] 0 2024-04-26T21:08:26.137 INFO:tasks.workunit.client.0.smithi055.stdout:3/941: creat d0/d4/d5/d73/d47/d37/d3d/d4c/f139 x:0 0 0 2024-04-26T21:08:26.140 INFO:tasks.workunit.client.0.smithi055.stdout:2/988: dread d4/db/d56/d4a/d7e/f91 [0,4194304] 0 2024-04-26T21:08:26.143 INFO:tasks.workunit.client.0.smithi055.stdout:7/882: dwrite d5/d6/ff [0,4194304] 0 2024-04-26T21:08:26.150 INFO:tasks.workunit.client.0.smithi055.stdout:3/942: creat d0/d4/d5/d73/d13/d27/d3b/dcd/f13a x:0 0 0 2024-04-26T21:08:26.155 INFO:tasks.workunit.client.0.smithi055.stdout:0/932: dwrite d9/d11/d5b/d74/f2e [4194304,4194304] 0 2024-04-26T21:08:26.155 INFO:tasks.workunit.client.0.smithi055.stdout:0/933: chown d9/dc/d1c/d3e/dc5/dcc/d4b 8383 1 2024-04-26T21:08:26.155 INFO:tasks.workunit.client.0.smithi055.stdout:0/934: fsync d9/dc/d1c/d3e/dc5/dcc/d4b/dfe/f116 0 2024-04-26T21:08:26.157 INFO:tasks.workunit.client.0.smithi055.stdout:7/883: rmdir d5/d53/d6e/d99/d7f/d6f/ddc/d100 0 2024-04-26T21:08:26.157 INFO:tasks.workunit.client.0.smithi055.stdout:7/884: write d5/d53/d6e/d99/d75/fb3 [727362,117505] 0 2024-04-26T21:08:26.164 INFO:tasks.workunit.client.0.smithi055.stdout:3/943: symlink d0/d4/d5/d73/d13/d27/d3b/dcd/l13b 0 2024-04-26T21:08:26.175 INFO:tasks.workunit.client.0.smithi055.stdout:0/935: symlink d9/dc/d19/ddb/db6/d6c/d10f/l127 0 2024-04-26T21:08:26.175 INFO:tasks.workunit.client.0.smithi055.stdout:7/885: mknod d5/d53/d6e/d65/dc5/dc7/c112 0 2024-04-26T21:08:26.175 INFO:tasks.workunit.client.0.smithi055.stdout:3/944: link d0/d4/d5/f2c d0/d4/d5/d73/d13/d27/d50/d6b/d83/d93/dd3/f13c 0 2024-04-26T21:08:26.175 INFO:tasks.workunit.client.0.smithi055.stdout:7/886: chown d5/d6/d39/deb/ff1 2237699 1 2024-04-26T21:08:26.175 INFO:tasks.workunit.client.0.smithi055.stdout:7/887: chown d5/d53/d6e/d65/d111/db1/le6 499 1 2024-04-26T21:08:26.179 INFO:tasks.workunit.client.0.smithi055.stdout:3/945: write d0/d4/d5/d73/d47/d37/da6/f108 [255848,112525] 0 2024-04-26T21:08:26.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/989: dread d4/db/d26/d9a/f10f [0,4194304] 0 2024-04-26T21:08:26.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/990: chown d4/d14/d33/c60 18775 1 2024-04-26T21:08:26.179 INFO:tasks.workunit.client.0.smithi055.stdout:2/991: creat d4/d14/f14b x:0 0 0 2024-04-26T21:08:26.188 INFO:tasks.workunit.client.0.smithi055.stdout:1/897: dwrite d8/d94/de7/ff8 [0,4194304] 0 2024-04-26T21:08:26.191 INFO:tasks.workunit.client.0.smithi055.stdout:0/936: dread d9/d11/d59/f123 [0,4194304] 0 2024-04-26T21:08:26.191 INFO:tasks.workunit.client.0.smithi055.stdout:0/937: fdatasync d9/dc/d1c/d3e/d7d/da3/f6d 0 2024-04-26T21:08:26.201 INFO:tasks.workunit.client.0.smithi055.stdout:7/888: dread d5/d6/d24/d52/f5e [0,4194304] 0 2024-04-26T21:08:26.201 INFO:tasks.workunit.client.0.smithi055.stdout:7/889: readlink d5/d6/d39/l5a 0 2024-04-26T21:08:26.204 INFO:tasks.workunit.client.0.smithi055.stdout:2/992: rename d4/db/d1f/d46/d51/c110 to d4/d14/dc5/d107/c14c 0 2024-04-26T21:08:26.204 INFO:tasks.workunit.client.0.smithi055.stdout:2/993: write d4/db/d1f/d46/fb7 [1635270,126] 0 2024-04-26T21:08:26.208 INFO:tasks.workunit.client.0.smithi055.stdout:7/890: creat d5/d53/f113 x:0 0 0 2024-04-26T21:08:26.209 INFO:tasks.workunit.client.0.smithi055.stdout:2/994: mknod d4/d49/d148/c14d 0 2024-04-26T21:08:26.218 INFO:tasks.workunit.client.0.smithi055.stdout:8/724: dwrite d3/f14 [0,4194304] 0 2024-04-26T21:08:26.219 INFO:tasks.workunit.client.0.smithi055.stdout:1/898: mknod d8/c12c 0 2024-04-26T21:08:26.219 INFO:tasks.workunit.client.0.smithi055.stdout:1/899: write d8/df/d11/d27/d28/d2a/fc9 [2620744,96520] 0 2024-04-26T21:08:26.224 INFO:tasks.workunit.client.0.smithi055.stdout:2/995: symlink d4/db/d26/d9a/dc3/l14e 0 2024-04-26T21:08:26.224 INFO:tasks.workunit.client.0.smithi055.stdout:2/996: fsync d4/db/d26/d9a/dc3/f141 0 2024-04-26T21:08:26.235 INFO:tasks.workunit.client.0.smithi055.stdout:7/891: write d5/d53/f8a [3698255,38171] 0 2024-04-26T21:08:26.235 INFO:tasks.workunit.client.0.smithi055.stdout:7/892: dread - d5/d6/d24/dcf/fac zero size 2024-04-26T21:08:26.235 INFO:tasks.workunit.client.0.smithi055.stdout:7/893: chown d5/d53/d6e/d99/le0 7 1 2024-04-26T21:08:26.235 INFO:tasks.workunit.client.0.smithi055.stdout:3/946: dwrite d0/d4/d5/d73/d13/d1a/d46/fda [0,4194304] 0 2024-04-26T21:08:26.248 INFO:tasks.workunit.client.0.smithi055.stdout:3/947: dread d0/d4/d5/d73/d47/d37/d3d/d4c/fca [0,4194304] 0 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:08:26.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr fail", "who": "smithi064.tchyje"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: Activating manager daemon smithi055.ybbowr 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd='[{"prefix": "mgr fail", "who": "smithi064.tchyje"}]': finished 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: mgrmap e27: smithi055.ybbowr(active, starting, since 0.017041s) 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:08:26.259 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: Manager daemon smithi055.ybbowr is now available 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:08:26.260 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:26 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:08:26.266 INFO:tasks.workunit.client.0.smithi055.stdout:7/894: truncate d5/d53/d6e/d99/d58/f88 1183579 0 2024-04-26T21:08:26.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/895: truncate d5/d11/f1a 1508037 0 2024-04-26T21:08:26.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/896: stat d5/d6/d24/d4d/da7/dab/dae 0 2024-04-26T21:08:26.274 INFO:tasks.workunit.client.0.smithi055.stdout:3/948: dread d0/d4/d5/d73/d13/d27/d3b/dcd/f11f [0,4194304] 0 2024-04-26T21:08:26.279 INFO:tasks.workunit.client.0.smithi055.stdout:0/938: dwrite d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:08:26.282 INFO:tasks.workunit.client.0.smithi055.stdout:8/725: dwrite d3/dc0/f86 [4194304,4194304] 0 2024-04-26T21:08:26.288 INFO:tasks.workunit.client.0.smithi055.stdout:7/897: dread d5/d6/d24/d4d/da7/dab/dae/fb9 [4194304,4194304] 0 2024-04-26T21:08:26.290 INFO:tasks.workunit.client.0.smithi055.stdout:8/726: symlink d3/d7c/lf4 0 2024-04-26T21:08:26.292 INFO:tasks.workunit.client.0.smithi055.stdout:7/898: truncate d5/d11/f2f 9720 0 2024-04-26T21:08:26.294 INFO:tasks.workunit.client.0.smithi055.stdout:7/899: mkdir d5/d11/d8c/d114 0 2024-04-26T21:08:26.295 INFO:tasks.workunit.client.0.smithi055.stdout:0/939: dread d9/d8b/ffd [0,4194304] 0 2024-04-26T21:08:26.298 INFO:tasks.workunit.client.0.smithi055.stdout:7/900: symlink d5/d6/d24/d4d/da7/dab/dae/l115 0 2024-04-26T21:08:26.298 INFO:tasks.workunit.client.0.smithi055.stdout:7/901: write d5/d6/f41 [1522892,14686] 0 2024-04-26T21:08:26.302 INFO:tasks.workunit.client.0.smithi055.stdout:0/940: rmdir d9/dc/d17/d9a/d101 39 2024-04-26T21:08:26.306 INFO:tasks.workunit.client.0.smithi055.stdout:6/889: sync 2024-04-26T21:08:26.310 INFO:tasks.workunit.client.0.smithi055.stdout:6/890: unlink d3/d17/d46/dc2/dde/l12f 0 2024-04-26T21:08:26.311 INFO:tasks.workunit.client.0.smithi055.stdout:6/891: write d3/d17/d46/d109/d66/d6a/d51/d58/d62/fa4 [1701570,59490] 0 2024-04-26T21:08:26.311 INFO:tasks.workunit.client.0.smithi055.stdout:6/892: stat d3/d17/d46/d109/d66/d6a/d67/d83/f8a 0 2024-04-26T21:08:26.321 INFO:tasks.workunit.client.0.smithi055.stdout:7/902: write d5/d53/dd1/f7e [3780775,6896] 0 2024-04-26T21:08:26.321 INFO:tasks.workunit.client.0.smithi055.stdout:7/903: stat d5/d6/d24/d3b/l8f 0 2024-04-26T21:08:26.321 INFO:tasks.workunit.client.0.smithi055.stdout:6/893: link d3/d17/d46/dc2/dd4/l11e d3/d17/d46/d109/d66/d6a/d67/d83/d96/l132 0 2024-04-26T21:08:26.323 INFO:tasks.workunit.client.0.smithi055.stdout:0/941: dread d9/dc/d19/ddb/db6/d6c/f84 [0,4194304] 0 2024-04-26T21:08:26.328 INFO:tasks.workunit.client.0.smithi055.stdout:6/894: symlink d3/d17/d46/l133 0 2024-04-26T21:08:26.328 INFO:tasks.workunit.client.0.smithi055.stdout:6/895: write d3/d17/d46/d109/d66/d6a/d51/d58/d6d/f107 [639388,113152] 0 2024-04-26T21:08:26.330 INFO:tasks.workunit.client.0.smithi055.stdout:0/942: fsync d9/f5a 0 2024-04-26T21:08:26.330 INFO:tasks.workunit.client.0.smithi055.stdout:0/943: dread - d9/dc/d1c/d3e/d7d/da3/dca/f10a zero size 2024-04-26T21:08:26.330 INFO:tasks.workunit.client.0.smithi055.stdout:0/944: fdatasync d9/d27/daf/ff2 0 2024-04-26T21:08:26.330 INFO:tasks.workunit.client.0.smithi055.stdout:0/945: fsync d9/dc/d1c/d3e/dcd/f107 0 2024-04-26T21:08:26.332 INFO:tasks.workunit.client.0.smithi055.stdout:6/896: unlink d3/d17/d25/l63 0 2024-04-26T21:08:26.340 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.340 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: Upgrade: Need to upgrade myself (mgr.smithi064.tchyje) 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "mgr fail", "who": "smithi064.tchyje"}]: dispatch 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: Activating manager daemon smithi055.ybbowr 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:08:26.341 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.24377 172.21.15.64:0/2757554689' entity='mgr.smithi064.tchyje' cmd='[{"prefix": "mgr fail", "who": "smithi064.tchyje"}]': finished 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: mgrmap e27: smithi055.ybbowr(active, starting, since 0.017041s) 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:08:26.342 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: Manager daemon smithi055.ybbowr is now available 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:26.343 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:26.344 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:08:26.344 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:08:26.344 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:08:26.344 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:26 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:08:26.345 INFO:tasks.workunit.client.0.smithi055.stdout:0/946: creat d9/d11/d59/d78/d106/f128 x:0 0 0 2024-04-26T21:08:26.345 INFO:tasks.workunit.client.0.smithi055.stdout:3/949: dwrite d0/d4/d5/d73/d47/d37/d3d/d4c/f139 [0,4194304] 0 2024-04-26T21:08:26.345 INFO:tasks.workunit.client.0.smithi055.stdout:6/897: creat d3/d17/d25/d5f/f134 x:0 0 0 2024-04-26T21:08:26.359 INFO:tasks.workunit.client.0.smithi055.stdout:6/898: truncate d3/d17/d46/d109/d66/d6a/d51/d58/d62/f78 3916887 0 2024-04-26T21:08:26.359 INFO:tasks.workunit.client.0.smithi055.stdout:6/899: fsync d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 0 2024-04-26T21:08:26.377 INFO:tasks.workunit.client.0.smithi055.stdout:7/904: truncate d5/d6/f41 1691125 0 2024-04-26T21:08:26.377 INFO:tasks.workunit.client.0.smithi055.stdout:7/905: fsync d5/d53/d6e/d99/d58/fbb 0 2024-04-26T21:08:26.377 INFO:tasks.workunit.client.0.smithi055.stdout:6/900: unlink d3/d17/d25/d5f/d90/lad 0 2024-04-26T21:08:26.384 INFO:tasks.workunit.client.0.smithi055.stdout:6/901: symlink d3/d17/d46/d109/d66/d6a/d51/d58/l135 0 2024-04-26T21:08:26.384 INFO:tasks.workunit.client.0.smithi055.stdout:6/902: chown d3/d17/d46/d109/d66/d6a/d67/d83/d10b 2 1 2024-04-26T21:08:26.384 INFO:tasks.workunit.client.0.smithi055.stdout:6/903: readlink d3/d17/d46/d109/d66/d6a/d51/d58/l135 0 2024-04-26T21:08:26.407 INFO:tasks.workunit.client.0.smithi055.stdout:7/906: dread d5/d6/d24/f50 [0,4194304] 0 2024-04-26T21:08:26.414 INFO:tasks.workunit.client.0.smithi055.stdout:7/907: creat d5/d11/d8c/f116 x:0 0 0 2024-04-26T21:08:26.414 INFO:tasks.workunit.client.0.smithi055.stdout:7/908: write d5/d6/f31 [1046337,5671] 0 2024-04-26T21:08:26.415 INFO:tasks.workunit.client.0.smithi055.stdout:6/904: dread d3/f8b [0,4194304] 0 2024-04-26T21:08:26.417 INFO:tasks.workunit.client.0.smithi055.stdout:7/909: truncate d5/d53/d6e/d99/d7f/d6f/f95 3039902 0 2024-04-26T21:08:26.427 INFO:tasks.workunit.client.0.smithi055.stdout:7/910: symlink d5/d6/d24/d4d/da7/l117 0 2024-04-26T21:08:26.427 INFO:tasks.workunit.client.0.smithi055.stdout:0/947: dwrite d9/dc/d1c/d3e/dc5/dcc/f44 [4194304,4194304] 0 2024-04-26T21:08:26.427 INFO:tasks.workunit.client.0.smithi055.stdout:0/948: truncate d9/dc/d17/f3f 4582213 0 2024-04-26T21:08:26.427 INFO:tasks.workunit.client.0.smithi055.stdout:0/949: fdatasync d9/dc/d19/ddb/db6/d6c/d7a/f95 0 2024-04-26T21:08:26.430 INFO:tasks.workunit.client.0.smithi055.stdout:0/950: creat d9/dc/d1c/d3e/d7d/da3/dca/f129 x:0 0 0 2024-04-26T21:08:26.433 INFO:tasks.workunit.client.0.smithi055.stdout:3/950: dwrite d0/d4/d5/d73/d13/d27/d3b/faf [4194304,4194304] 0 2024-04-26T21:08:26.435 INFO:tasks.workunit.client.0.smithi055.stdout:0/951: symlink d9/dc/d1c/d3e/dc5/dcc/d9c/l12a 0 2024-04-26T21:08:26.436 INFO:tasks.workunit.client.0.smithi055.stdout:0/952: chown d9/d11/d59/d78/ccf 10130 1 2024-04-26T21:08:26.436 INFO:tasks.workunit.client.0.smithi055.stdout:0/953: chown d9/d11/d59/d78/d106/f128 5 1 2024-04-26T21:08:26.439 INFO:tasks.workunit.client.0.smithi055.stdout:3/951: rename d0/d4/d5/lc to d0/d4/d5/d73/d13/d1a/d46/d72/l13d 0 2024-04-26T21:08:26.440 INFO:tasks.workunit.client.0.smithi055.stdout:3/952: creat d0/d4/d5/f13e x:0 0 0 2024-04-26T21:08:26.440 INFO:tasks.workunit.client.0.smithi055.stdout:0/954: mkdir d9/dc/d1c/d3e/d7d/d12b 0 2024-04-26T21:08:26.448 INFO:tasks.workunit.client.0.smithi055.stdout:3/953: getdents d0/d4/d5/d73/d13/d27/ddb 0 2024-04-26T21:08:26.451 INFO:tasks.workunit.client.0.smithi055.stdout:0/955: mknod d9/dc/d1c/d3e/d7d/da3/dce/c12c 0 2024-04-26T21:08:26.451 INFO:tasks.workunit.client.0.smithi055.stdout:0/956: truncate d9/dc/d17/d5d/fbc 522054 0 2024-04-26T21:08:26.456 INFO:tasks.workunit.client.0.smithi055.stdout:0/957: rmdir d9/dc/d17 39 2024-04-26T21:08:26.460 INFO:tasks.workunit.client.0.smithi055.stdout:3/954: rmdir d0/d4/d16 39 2024-04-26T21:08:26.465 INFO:tasks.workunit.client.0.smithi055.stdout:3/955: creat d0/d4/d16/d18/d4b/d57/d8e/f13f x:0 0 0 2024-04-26T21:08:26.465 INFO:tasks.workunit.client.0.smithi055.stdout:3/956: write d0/d4/d5/d73/d13/d27/d3b/dcd/f11f [1653373,118513] 0 2024-04-26T21:08:26.470 INFO:tasks.workunit.client.0.smithi055.stdout:3/957: mknod d0/d4/d5/d73/d13/d5c/c140 0 2024-04-26T21:08:26.471 INFO:tasks.workunit.client.0.smithi055.stdout:3/958: creat d0/d4/d131/f141 x:0 0 0 2024-04-26T21:08:26.473 INFO:tasks.workunit.client.0.smithi055.stdout:3/959: read d0/d4/d16/d18/f5d [2406191,94187] 0 2024-04-26T21:08:26.473 INFO:tasks.workunit.client.0.smithi055.stdout:3/960: chown d0/d4/d16/d18/d4b/d57/d8e/ff5 206 1 2024-04-26T21:08:26.483 INFO:tasks.workunit.client.0.smithi055.stdout:6/905: dwrite d3/d17/d46/d109/d66/d6a/d51/f12b [0,4194304] 0 2024-04-26T21:08:26.506 INFO:tasks.workunit.client.0.smithi055.stdout:6/906: dread d3/d17/d46/d109/d66/d6a/d51/d58/d62/f11a [0,4194304] 0 2024-04-26T21:08:26.507 INFO:tasks.workunit.client.0.smithi055.stdout:7/911: dwrite d5/d6/d39/dbc/f110 [0,4194304] 0 2024-04-26T21:08:26.508 INFO:tasks.workunit.client.0.smithi055.stdout:6/907: getdents d3/da1 0 2024-04-26T21:08:26.529 INFO:tasks.workunit.client.0.smithi055.stdout:7/912: creat d5/d53/d6e/d99/d58/f118 x:0 0 0 2024-04-26T21:08:26.530 INFO:tasks.workunit.client.0.smithi055.stdout:7/913: truncate d5/d6/d24/d4d/da7/dab/f10b 2281371 0 2024-04-26T21:08:26.530 INFO:tasks.workunit.client.0.smithi055.stdout:6/908: truncate d3/d17/faa 33045 0 2024-04-26T21:08:26.531 INFO:tasks.workunit.client.0.smithi055.stdout:7/914: creat d5/d53/d6e/d99/d7f/d6f/dc6/f119 x:0 0 0 2024-04-26T21:08:26.532 INFO:tasks.workunit.client.0.smithi055.stdout:6/909: mknod d3/d17/d46/dc2/dde/c136 0 2024-04-26T21:08:26.532 INFO:tasks.workunit.client.0.smithi055.stdout:6/910: dread - d3/d17/d19/d7b/feb zero size 2024-04-26T21:08:26.535 INFO:tasks.workunit.client.0.smithi055.stdout:7/915: rename d5/d6/d24/d3b/c3d to d5/d53/d6e/c11a 0 2024-04-26T21:08:26.538 INFO:tasks.workunit.client.0.smithi055.stdout:3/961: dwrite d0/d4/d5/d73/d47/d37/de7/ff8 [0,4194304] 0 2024-04-26T21:08:26.538 INFO:tasks.workunit.client.0.smithi055.stdout:3/962: chown d0/d4/d5/lcb 1075150 1 2024-04-26T21:08:26.538 INFO:tasks.workunit.client.0.smithi055.stdout:3/963: chown d0/d4/d16/d18/d4b/d57/d8e/de0 13 1 2024-04-26T21:08:26.538 INFO:tasks.workunit.client.0.smithi055.stdout:3/964: chown d0/d4/d5/d73/d47/d37/de8/c112 559827 1 2024-04-26T21:08:26.543 INFO:tasks.workunit.client.0.smithi055.stdout:7/916: mknod d5/d6/d24/d4d/da7/dab/dce/de7/c11b 0 2024-04-26T21:08:26.543 INFO:tasks.workunit.client.0.smithi055.stdout:7/917: stat d5/d53/d6e/d99/d75/c7b 0 2024-04-26T21:08:26.568 INFO:tasks.workunit.client.0.smithi055.stdout:4/731: sync 2024-04-26T21:08:26.568 INFO:tasks.workunit.client.0.smithi055.stdout:5/721: sync 2024-04-26T21:08:26.568 INFO:tasks.workunit.client.0.smithi055.stdout:4/732: stat d4/d18/d8e/d9e 0 2024-04-26T21:08:26.568 INFO:tasks.workunit.client.0.smithi055.stdout:9/861: sync 2024-04-26T21:08:26.568 INFO:tasks.workunit.client.0.smithi055.stdout:9/862: symlink d2/d11/l12f 0 2024-04-26T21:08:26.574 INFO:tasks.workunit.client.0.smithi055.stdout:9/863: getdents d2/d46/d77/d7d/da0 0 2024-04-26T21:08:26.574 INFO:tasks.workunit.client.0.smithi055.stdout:9/864: fdatasync d2/d46/d77/d5f/f69 0 2024-04-26T21:08:26.574 INFO:tasks.workunit.client.0.smithi055.stdout:9/865: chown d2/d46/d77/ff3 2030 1 2024-04-26T21:08:26.582 INFO:tasks.workunit.client.0.smithi055.stdout:5/722: dread f2 [0,4194304] 0 2024-04-26T21:08:26.582 INFO:tasks.workunit.client.0.smithi055.stdout:4/733: dread d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:26.585 INFO:tasks.workunit.client.0.smithi055.stdout:9/866: mknod d2/d46/d12d/d9b/c130 0 2024-04-26T21:08:26.590 INFO:tasks.workunit.client.0.smithi055.stdout:5/723: creat d4/df/dae/dce/d93/dc4/ff7 x:0 0 0 2024-04-26T21:08:26.597 INFO:tasks.workunit.client.0.smithi055.stdout:4/734: symlink d4/d12/d17/d3d/lf5 0 2024-04-26T21:08:26.597 INFO:tasks.workunit.client.0.smithi055.stdout:4/735: fdatasync d4/f11 0 2024-04-26T21:08:26.601 INFO:tasks.workunit.client.0.smithi055.stdout:9/867: mknod d2/d46/d77/d7d/c131 0 2024-04-26T21:08:26.601 INFO:tasks.workunit.client.0.smithi055.stdout:9/868: stat d2/d46/d77/d7d/dbf/cdd 0 2024-04-26T21:08:26.609 INFO:tasks.workunit.client.0.smithi055.stdout:9/869: mkdir d2/d46/d9a/d105/db8/d111/d132 0 2024-04-26T21:08:26.614 INFO:tasks.workunit.client.0.smithi055.stdout:9/870: creat d2/d46/d12d/d9b/f133 x:0 0 0 2024-04-26T21:08:26.614 INFO:tasks.workunit.client.0.smithi055.stdout:9/871: chown d2/d46/d9a/d105/db8/dc5/ccd 150015 1 2024-04-26T21:08:26.614 INFO:tasks.workunit.client.0.smithi055.stdout:9/872: readlink d2/d46/d12d/d9b/la3 0 2024-04-26T21:08:26.622 INFO:tasks.workunit.client.0.smithi055.stdout:9/873: unlink d2/d46/d51/c56 0 2024-04-26T21:08:26.622 INFO:tasks.workunit.client.0.smithi055.stdout:9/874: chown d2/d46/d12d/d9b/l9c 1686842 1 2024-04-26T21:08:26.625 INFO:tasks.workunit.client.0.smithi055.stdout:7/918: dread d5/d53/d6e/d99/d7f/f8e [0,4194304] 0 2024-04-26T21:08:26.627 INFO:tasks.workunit.client.0.smithi055.stdout:9/875: chown d2/d46/d77/l3a 67 1 2024-04-26T21:08:26.627 INFO:tasks.workunit.client.0.smithi055.stdout:7/919: chown d5/d6/d24/d52/c62 478 1 2024-04-26T21:08:26.627 INFO:tasks.workunit.client.0.smithi055.stdout:7/920: stat d5/d53/d6e/d65 0 2024-04-26T21:08:26.632 INFO:tasks.workunit.client.0.smithi055.stdout:3/965: dwrite d0/d4/d16/d18/d4b/f89 [0,4194304] 0 2024-04-26T21:08:26.641 INFO:tasks.workunit.client.0.smithi055.stdout:6/911: dwrite d3/d17/d46/d109/fe2 [0,4194304] 0 2024-04-26T21:08:26.645 INFO:tasks.workunit.client.0.smithi055.stdout:6/912: getdents d3/d17/d46/d109/d66/de1 0 2024-04-26T21:08:26.649 INFO:tasks.workunit.client.0.smithi055.stdout:3/966: dread d0/d4/d5/d73/f2e [0,4194304] 0 2024-04-26T21:08:26.649 INFO:tasks.workunit.client.0.smithi055.stdout:3/967: chown d0/d4/d16/d18/d4b/d57/d8e/de0/f111 27 1 2024-04-26T21:08:26.649 INFO:tasks.workunit.client.0.smithi055.stdout:6/913: rmdir d3/d17/d46/dc2/dd4 39 2024-04-26T21:08:26.649 INFO:tasks.workunit.client.0.smithi055.stdout:5/724: dwrite d4/df/dae/dce/d4a/d3f/d4f/f75 [0,4194304] 0 2024-04-26T21:08:26.658 INFO:tasks.workunit.client.0.smithi055.stdout:6/914: dread d3/d17/d25/f9c [0,4194304] 0 2024-04-26T21:08:26.667 INFO:tasks.workunit.client.0.smithi055.stdout:5/725: creat d4/df/dae/dce/d5b/d83/dda/ff8 x:0 0 0 2024-04-26T21:08:26.674 INFO:tasks.workunit.client.0.smithi055.stdout:4/736: dwrite d4/f9 [0,4194304] 0 2024-04-26T21:08:26.677 INFO:tasks.workunit.client.0.smithi055.stdout:6/915: getdents d3/d17/d25/d5f/d90 0 2024-04-26T21:08:26.686 INFO:tasks.workunit.client.0.smithi055.stdout:9/876: dwrite d2/d46/d9a/d105/f21 [4194304,4194304] 0 2024-04-26T21:08:26.686 INFO:tasks.workunit.client.0.smithi055.stdout:9/877: chown d2/d11/l38 0 1 2024-04-26T21:08:26.686 INFO:tasks.workunit.client.0.smithi055.stdout:6/916: link d3/d17/d46/dc2/ffc d3/d17/d19/f137 0 2024-04-26T21:08:26.686 INFO:tasks.workunit.client.0.smithi055.stdout:6/917: readlink d3/d17/d46/d109/d66/d6a/d51/d58/l61 0 2024-04-26T21:08:26.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/918: symlink d3/d17/d19/d7b/l138 0 2024-04-26T21:08:26.690 INFO:tasks.workunit.client.0.smithi055.stdout:6/919: chown d3/d17/d46/d109/d66/d6a/d12c 3994878 1 2024-04-26T21:08:26.700 INFO:tasks.workunit.client.0.smithi055.stdout:4/737: dread d4/d18/d8e/d9e/fa0 [0,4194304] 0 2024-04-26T21:08:26.700 INFO:tasks.workunit.client.0.smithi055.stdout:4/738: chown d4/d26/d42/dbb/dde/f7d 2623001 1 2024-04-26T21:08:26.707 INFO:tasks.workunit.client.0.smithi055.stdout:9/878: dread d2/d46/d77/f76 [0,4194304] 0 2024-04-26T21:08:26.717 INFO:tasks.workunit.client.0.smithi055.stdout:4/739: write d4/d12/d15/f6f [3004330,44986] 0 2024-04-26T21:08:26.719 INFO:tasks.workunit.client.0.smithi055.stdout:4/740: rename d4/d18/d86/cd3 to d4/d12/d61/dd1/cf6 0 2024-04-26T21:08:26.719 INFO:tasks.workunit.client.0.smithi055.stdout:4/741: creat d4/d26/d42/ff7 x:0 0 0 2024-04-26T21:08:26.720 INFO:tasks.workunit.client.0.smithi055.stdout:4/742: write d4/d26/fa3 [1172674,54075] 0 2024-04-26T21:08:26.720 INFO:tasks.workunit.client.0.smithi055.stdout:9/879: dread d2/d46/d77/d7d/da8/ff8 [0,4194304] 0 2024-04-26T21:08:26.758 INFO:tasks.workunit.client.0.smithi055.stdout:1/900: sync 2024-04-26T21:08:26.758 INFO:tasks.workunit.client.0.smithi055.stdout:1/901: write d8/d94/f109 [1536147,123618] 0 2024-04-26T21:08:26.762 INFO:tasks.workunit.client.0.smithi055.stdout:1/902: link d8/d17/d1b/c56 d8/d17/d1b/d7b/c12d 0 2024-04-26T21:08:26.763 INFO:tasks.workunit.client.0.smithi055.stdout:1/903: creat d8/d17/d1b/d10e/f12e x:0 0 0 2024-04-26T21:08:26.767 INFO:tasks.workunit.client.0.smithi055.stdout:1/904: creat d8/f12f x:0 0 0 2024-04-26T21:08:26.767 INFO:tasks.workunit.client.0.smithi055.stdout:3/968: dwrite d0/d4/d5/d73/d47/d37/f6f [0,4194304] 0 2024-04-26T21:08:26.776 INFO:tasks.workunit.client.0.smithi055.stdout:4/743: dwrite d4/d18/d86/fdf [0,4194304] 0 2024-04-26T21:08:26.776 INFO:tasks.workunit.client.0.smithi055.stdout:4/744: chown d4/d26/d42/d28/d53/d71/lc5 3 1 2024-04-26T21:08:26.776 INFO:tasks.workunit.client.0.smithi055.stdout:4/745: creat d4/d18/d86/da6/ff8 x:0 0 0 2024-04-26T21:08:26.781 INFO:tasks.workunit.client.0.smithi055.stdout:3/969: creat d0/d4/d5/d73/d13/d27/d50/d6b/f142 x:0 0 0 2024-04-26T21:08:26.790 INFO:tasks.workunit.client.0.smithi055.stdout:4/746: rename d4/l64 to d4/d12/d61/d93/lf9 0 2024-04-26T21:08:26.790 INFO:tasks.workunit.client.0.smithi055.stdout:4/747: symlink d4/d12/d17/d3d/lfa 0 2024-04-26T21:08:26.791 INFO:tasks.workunit.client.0.smithi055.stdout:4/748: rename d4/d26/d42/dbb/dde/d49/c9c to d4/d26/d42/dbb/dde/d49/cfb 0 2024-04-26T21:08:26.792 INFO:tasks.workunit.client.0.smithi055.stdout:4/749: chown d4/d26/d42/d28/d53/d70/dc9 400819463 1 2024-04-26T21:08:26.797 INFO:tasks.workunit.client.0.smithi055.stdout:4/750: rename d4/d26/d42/d28/d53/d71/d7f/da1 to d4/d26/d42/dbb/dde/de3/dfc 0 2024-04-26T21:08:26.803 INFO:tasks.workunit.client.0.smithi055.stdout:1/905: dwrite d8/d17/d1b/d41/fc0 [0,4194304] 0 2024-04-26T21:08:26.842 INFO:tasks.workunit.client.0.smithi055.stdout:4/751: dwrite d4/d26/d42/d28/d53/fe0 [0,4194304] 0 2024-04-26T21:08:26.846 INFO:tasks.workunit.client.0.smithi055.stdout:4/752: creat d4/d26/d42/dbb/dde/ffd x:0 0 0 2024-04-26T21:08:26.846 INFO:tasks.workunit.client.0.smithi055.stdout:4/753: chown d4 21 1 2024-04-26T21:08:26.848 INFO:tasks.workunit.client.0.smithi055.stdout:4/754: mkdir d4/d26/d42/d28/d53/dfe 0 2024-04-26T21:08:26.849 INFO:tasks.workunit.client.0.smithi055.stdout:4/755: mkdir d4/d26/d42/d28/d53/dfe/dff 0 2024-04-26T21:08:26.849 INFO:tasks.workunit.client.0.smithi055.stdout:4/756: stat d4/d26/d42/dbb/f25 0 2024-04-26T21:08:26.857 INFO:tasks.workunit.client.0.smithi055.stdout:4/757: write d4/d26/d42/d28/f32 [352916,128964] 0 2024-04-26T21:08:26.857 INFO:tasks.workunit.client.0.smithi055.stdout:4/758: chown d4/d26/d42/dbb/dde/de3/dfc/fce 204173858 1 2024-04-26T21:08:26.858 INFO:tasks.workunit.client.0.smithi055.stdout:4/759: dread - d4/d26/d42/dbb/dde/d49/f8d zero size 2024-04-26T21:08:26.859 INFO:tasks.workunit.client.0.smithi055.stdout:4/760: link d4/fc3 d4/d26/d42/d28/d53/f100 0 2024-04-26T21:08:26.860 INFO:tasks.workunit.client.0.smithi055.stdout:4/761: mkdir d4/d26/d42/dbb/d101 0 2024-04-26T21:08:26.861 INFO:tasks.workunit.client.0.smithi055.stdout:4/762: truncate d4/d12/d61/fa5 769061 0 2024-04-26T21:08:26.862 INFO:tasks.workunit.client.0.smithi055.stdout:1/906: dwrite d8/d17/f77 [0,4194304] 0 2024-04-26T21:08:26.862 INFO:tasks.workunit.client.0.smithi055.stdout:1/907: write d8/df/d11/db5/ff4 [524953,18143] 0 2024-04-26T21:08:26.865 INFO:tasks.workunit.client.0.smithi055.stdout:1/908: mknod d8/d17/d1b/d7b/d65/c130 0 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:8/727: sync 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:2/997: sync 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:0/958: sync 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:8/728: truncate d3/d9/d1d/fca 526880 0 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:0/959: write d9/f64 [1600078,55092] 0 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:0/960: stat d9/dc/d1c/d3e/dc5/dcc/d9c/dee 0 2024-04-26T21:08:26.883 INFO:tasks.workunit.client.0.smithi055.stdout:0/961: truncate d9/dc/d1c/d3e/dcd/f107 634500 0 2024-04-26T21:08:26.886 INFO:tasks.workunit.client.0.smithi055.stdout:8/729: dread d3/d9/f2d [0,4194304] 0 2024-04-26T21:08:26.886 INFO:tasks.workunit.client.0.smithi055.stdout:8/730: chown d3/d9/d1d/d48/d80/ce0 13 1 2024-04-26T21:08:26.887 INFO:tasks.workunit.client.0.smithi055.stdout:2/998: mkdir d4/d1e/d90/d14f 0 2024-04-26T21:08:26.901 INFO:tasks.workunit.client.0.smithi055.stdout:0/962: dread d9/d11/d59/fb1 [0,4194304] 0 2024-04-26T21:08:26.928 INFO:tasks.workunit.client.0.smithi055.stdout:8/731: unlink d3/d9/f5c 0 2024-04-26T21:08:26.929 INFO:tasks.workunit.client.0.smithi055.stdout:8/732: chown d3/d9/d1d/l3c 32306 1 2024-04-26T21:08:26.929 INFO:tasks.workunit.client.0.smithi055.stdout:8/733: fsync d3/dc0/d2e/f62 0 2024-04-26T21:08:26.930 INFO:tasks.workunit.client.0.smithi055.stdout:0/963: fsync d9/ffb 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/964: dread d9/dc/d1c/d3e/dc5/fdd [0,4194304] 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/965: chown d9/dc/d1c/d3e/dc5/fdd 1170407697 1 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/966: readlink d9/d8b/lb5 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/967: chown d9/dc 6485 1 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:1/909: write d8/d94/de7/ff8 [2355135,45251] 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/968: fsync d9/dc/d1c/f26 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:0/969: fsync d9/dc/d19/ddb/fa0 0 2024-04-26T21:08:26.944 INFO:tasks.workunit.client.0.smithi055.stdout:4/763: dwrite d4/d26/f99 [0,4194304] 0 2024-04-26T21:08:26.947 INFO:tasks.workunit.client.0.smithi055.stdout:1/910: mknod d8/c131 0 2024-04-26T21:08:26.947 INFO:tasks.workunit.client.0.smithi055.stdout:1/911: dread - d8/f12f zero size 2024-04-26T21:08:26.959 INFO:tasks.workunit.client.0.smithi055.stdout:0/970: dread d9/dc/d1c/d3e/d7d/da3/d82/fd9 [0,4194304] 0 2024-04-26T21:08:26.969 INFO:tasks.workunit.client.0.smithi055.stdout:2/999: dwrite d4/db/d56/f70 [0,4194304] 0 2024-04-26T21:08:26.993 INFO:tasks.workunit.client.0.smithi055.stdout:8/734: dwrite d3/d9/d1d/d48/d57/d61/f97 [4194304,4194304] 0 2024-04-26T21:08:26.999 INFO:tasks.workunit.client.0.smithi055.stdout:8/735: rename d3/dc0/d2e/d75/l7a to d3/d9/d1d/d48/d57/lf5 0 2024-04-26T21:08:26.999 INFO:tasks.workunit.client.0.smithi055.stdout:8/736: dread - d3/d77/da9/fda zero size 2024-04-26T21:08:27.000 INFO:tasks.workunit.client.0.smithi055.stdout:8/737: chown d3/d9/c51 0 1 2024-04-26T21:08:27.051 INFO:tasks.workunit.client.0.smithi055.stdout:4/764: dwrite d4/d26/d42/d28/d53/f100 [0,4194304] 0 2024-04-26T21:08:27.051 INFO:tasks.workunit.client.0.smithi055.stdout:4/765: truncate d4/d26/d42/dbb/dde/f37 1372505 0 2024-04-26T21:08:27.056 INFO:tasks.workunit.client.0.smithi055.stdout:1/912: dwrite d8/df/d11/d27/d28/d2a/f96 [0,4194304] 0 2024-04-26T21:08:27.057 INFO:tasks.workunit.client.0.smithi055.stdout:0/971: dwrite d9/dc/d1c/d3e/ffa [4194304,4194304] 0 2024-04-26T21:08:27.058 INFO:tasks.workunit.client.0.smithi055.stdout:4/766: getdents d4/d18/d8e/d9e 0 2024-04-26T21:08:27.060 INFO:tasks.workunit.client.0.smithi055.stdout:8/738: dwrite d3/d9/f8e [4194304,4194304] 0 2024-04-26T21:08:27.066 INFO:tasks.workunit.client.0.smithi055.stdout:1/913: rmdir d8/d17/d1b/d7b/d8d/df9 39 2024-04-26T21:08:27.066 INFO:tasks.workunit.client.0.smithi055.stdout:1/914: chown d8/df/d11/d27/d28/ceb 1294346 1 2024-04-26T21:08:27.066 INFO:tasks.workunit.client.0.smithi055.stdout:1/915: chown d8/d17/d6a/fbd 63 1 2024-04-26T21:08:27.069 INFO:tasks.workunit.client.0.smithi055.stdout:0/972: symlink d9/dc/d1c/d3e/dc5/l12d 0 2024-04-26T21:08:27.070 INFO:tasks.workunit.client.0.smithi055.stdout:4/767: mkdir d4/d26/d42/d102 0 2024-04-26T21:08:27.070 INFO:tasks.workunit.client.0.smithi055.stdout:4/768: truncate d4/d18/d86/da6/fea 705187 0 2024-04-26T21:08:27.070 INFO:tasks.workunit.client.0.smithi055.stdout:4/769: dread - d4/d26/d42/d2d/f4f zero size 2024-04-26T21:08:27.076 INFO:tasks.workunit.client.0.smithi055.stdout:8/739: write d3/f41 [3022782,686] 0 2024-04-26T21:08:27.076 INFO:tasks.workunit.client.0.smithi055.stdout:8/740: write d3/d7c/d9a/fc8 [73277,45169] 0 2024-04-26T21:08:27.081 INFO:tasks.workunit.client.0.smithi055.stdout:1/916: symlink d8/df/d11/d27/d28/da4/daa/l132 0 2024-04-26T21:08:27.081 INFO:tasks.workunit.client.0.smithi055.stdout:0/973: creat d9/f12e x:0 0 0 2024-04-26T21:08:27.083 INFO:tasks.workunit.client.0.smithi055.stdout:4/770: unlink d4/d12/d17/fdb 0 2024-04-26T21:08:27.100 INFO:tasks.workunit.client.0.smithi055.stdout:8/741: dread d3/d9/d1d/d48/d4b/fb4 [0,4194304] 0 2024-04-26T21:08:27.102 INFO:tasks.workunit.client.0.smithi055.stdout:8/742: symlink d3/d9/d1d/d48/d57/d61/lf6 0 2024-04-26T21:08:27.102 INFO:tasks.workunit.client.0.smithi055.stdout:8/743: write d3/dc0/fae [390370,75676] 0 2024-04-26T21:08:27.102 INFO:tasks.workunit.client.0.smithi055.stdout:8/744: write d3/d9/d1d/d48/d57/fdf [219414,56858] 0 2024-04-26T21:08:27.103 INFO:tasks.workunit.client.0.smithi055.stdout:0/974: dread d9/dc/d17/f1e [0,4194304] 0 2024-04-26T21:08:27.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/771: dread d4/ff [0,4194304] 0 2024-04-26T21:08:27.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/772: dread - d4/d12/d17/d3d/f45 zero size 2024-04-26T21:08:27.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/773: stat d4/d26/d42/d28/d53/f100 0 2024-04-26T21:08:27.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/774: write d4/d26/d42/dbb/dde/d49/fbe [886889,63629] 0 2024-04-26T21:08:27.104 INFO:tasks.workunit.client.0.smithi055.stdout:4/775: truncate d4/d26/d42/d2d/f3a 4679413 0 2024-04-26T21:08:27.108 INFO:tasks.workunit.client.0.smithi055.stdout:4/776: rename d4/d12/d17/l78 to d4/d26/d42/d28/d53/dfe/dff/l103 0 2024-04-26T21:08:27.122 INFO:tasks.workunit.client.0.smithi055.stdout:1/917: dwrite d8/df/d11/d27/d28/dd7/fb0 [0,4194304] 0 2024-04-26T21:08:27.122 INFO:tasks.workunit.client.0.smithi055.stdout:1/918: truncate d8/d17/d6a/f119 502303 0 2024-04-26T21:08:27.128 INFO:tasks.workunit.client.0.smithi055.stdout:1/919: truncate d8/f31 1908526 0 2024-04-26T21:08:27.128 INFO:tasks.workunit.client.0.smithi055.stdout:1/920: fsync d8/df/d11/d27/d28/f72 0 2024-04-26T21:08:27.128 INFO:tasks.workunit.client.0.smithi055.stdout:0/975: dread d9/dc/d1c/d3e/dc5/dcc/d4b/fda [0,4194304] 0 2024-04-26T21:08:27.160 INFO:tasks.workunit.client.0.smithi055.stdout:4/777: write d4/d26/d42/dbb/fdd [2575757,117184] 0 2024-04-26T21:08:27.165 INFO:tasks.workunit.client.0.smithi055.stdout:4/778: unlink d4/d18/d86/da6/f7b 0 2024-04-26T21:08:27.167 INFO:tasks.workunit.client.0.smithi055.stdout:4/779: unlink d4/d26/cb8 0 2024-04-26T21:08:27.176 INFO:tasks.workunit.client.0.smithi055.stdout:0/976: dread d9/d11/d5b/d74/f2e [0,4194304] 0 2024-04-26T21:08:27.176 INFO:tasks.workunit.client.0.smithi055.stdout:8/745: dwrite d3/d9/d1d/f25 [0,4194304] 0 2024-04-26T21:08:27.176 INFO:tasks.workunit.client.0.smithi055.stdout:8/746: stat d3/d77/da9/le8 0 2024-04-26T21:08:27.176 INFO:tasks.workunit.client.0.smithi055.stdout:0/977: creat d9/dc/d1c/d3e/d7d/d12b/f12f x:0 0 0 2024-04-26T21:08:27.212 INFO:tasks.workunit.client.0.smithi055.stdout:0/978: mkdir d9/d130 0 2024-04-26T21:08:27.231 INFO:tasks.workunit.client.0.smithi055.stdout:7/921: sync 2024-04-26T21:08:27.231 INFO:tasks.workunit.client.0.smithi055.stdout:7/922: chown d5/d6/d24/d4d/da7/l117 102 1 2024-04-26T21:08:27.232 INFO:tasks.workunit.client.0.smithi055.stdout:1/921: dwrite d8/df/d11/d27/d28/d2a/fc9 [0,4194304] 0 2024-04-26T21:08:27.232 INFO:tasks.workunit.client.0.smithi055.stdout:1/922: chown d8/df/d11/d27/d28/ceb 0 1 2024-04-26T21:08:27.232 INFO:tasks.workunit.client.0.smithi055.stdout:1/923: dread - d8/d17/d1b/d7b/f11e zero size 2024-04-26T21:08:27.236 INFO:tasks.workunit.client.0.smithi055.stdout:3/970: sync 2024-04-26T21:08:27.236 INFO:tasks.workunit.client.0.smithi055.stdout:5/726: sync 2024-04-26T21:08:27.236 INFO:tasks.workunit.client.0.smithi055.stdout:4/780: dwrite d4/fc4 [0,4194304] 0 2024-04-26T21:08:27.238 INFO:tasks.workunit.client.0.smithi055.stdout:5/727: rename d4/df/dae/dce/d4a/d3f/cb0 to d4/df/dae/cf9 0 2024-04-26T21:08:27.246 INFO:tasks.workunit.client.0.smithi055.stdout:4/781: symlink d4/d26/d42/dbb/d101/l104 0 2024-04-26T21:08:27.249 INFO:tasks.workunit.client.0.smithi055.stdout:5/728: mkdir d4/df/dae/dce/d4a/d3f/dfa 0 2024-04-26T21:08:27.250 INFO:tasks.workunit.client.0.smithi055.stdout:4/782: mkdir d4/d26/d42/d28/d53/d71/d7f/d105 0 2024-04-26T21:08:27.253 INFO:tasks.workunit.client.0.smithi055.stdout:8/747: dwrite d3/fd3 [0,4194304] 0 2024-04-26T21:08:27.254 INFO:tasks.workunit.client.0.smithi055.stdout:5/729: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/cfb 0 2024-04-26T21:08:27.255 INFO:tasks.workunit.client.0.smithi055.stdout:5/730: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/ffc x:0 0 0 2024-04-26T21:08:27.255 INFO:tasks.workunit.client.0.smithi055.stdout:5/731: chown d4/f9 99186 1 2024-04-26T21:08:27.255 INFO:tasks.workunit.client.0.smithi055.stdout:4/783: unlink d4/d12/d15/l35 0 2024-04-26T21:08:27.263 INFO:tasks.workunit.client.0.smithi055.stdout:4/784: getdents d4/d26/d42/dbb/dde/d49/dae/dc0 0 2024-04-26T21:08:27.263 INFO:tasks.workunit.client.0.smithi055.stdout:6/920: sync 2024-04-26T21:08:27.265 INFO:tasks.workunit.client.0.smithi055.stdout:9/880: sync 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:7/923: write d5/d53/d6e/d65/d111/fb7 [459667,14150] 0 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:3/971: write d0/d4/d5/d73/d13/d1a/f54 [6806410,26506] 0 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:3/972: write d0/de/f12b [3385300,75025] 0 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:0/979: dwrite d9/dc/d1c/f26 [0,4194304] 0 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:3/973: stat d0/d4/d5/d73/d13/d27/d50/d6b/d83/ff1 0 2024-04-26T21:08:27.266 INFO:tasks.workunit.client.0.smithi055.stdout:3/974: creat d0/d4/d5/d73/d13/d27/d3b/f143 x:0 0 0 2024-04-26T21:08:27.267 INFO:tasks.workunit.client.0.smithi055.stdout:6/921: symlink d3/d17/d46/d109/d66/d6a/d67/d83/d10b/l139 0 2024-04-26T21:08:27.267 INFO:tasks.workunit.client.0.smithi055.stdout:6/922: chown d3/d17/d25/f47 0 1 2024-04-26T21:08:27.267 INFO:tasks.workunit.client.0.smithi055.stdout:6/923: fdatasync d3/d17/d46/dc2/dd4/df3/f105 0 2024-04-26T21:08:27.268 INFO:tasks.workunit.client.0.smithi055.stdout:6/924: chown d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/cb3 20 1 2024-04-26T21:08:27.271 INFO:tasks.workunit.client.0.smithi055.stdout:1/924: dwrite d8/df/d11/d27/f3a [0,4194304] 0 2024-04-26T21:08:27.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/924: rename d5/d53/dd1/cfe to d5/d6/d24/d4d/da7/c11c 0 2024-04-26T21:08:27.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/925: fdatasync d5/d6/d24/d4d/f73 0 2024-04-26T21:08:27.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/926: write d5/d53/d6e/f6b [1087341,41339] 0 2024-04-26T21:08:27.273 INFO:tasks.workunit.client.0.smithi055.stdout:7/927: write d5/d53/d6e/d99/d58/f88 [2224043,86560] 0 2024-04-26T21:08:27.276 INFO:tasks.workunit.client.0.smithi055.stdout:0/980: link d9/dab/cf3 d9/dc/d1c/c131 0 2024-04-26T21:08:27.276 INFO:tasks.workunit.client.0.smithi055.stdout:3/975: mkdir d0/d4/d5/d73/d47/d37/d144 0 2024-04-26T21:08:27.281 INFO:tasks.workunit.client.0.smithi055.stdout:6/925: symlink d3/d17/d19/d71/dca/dcb/d10e/ddf/l13a 0 2024-04-26T21:08:27.283 INFO:tasks.workunit.client.0.smithi055.stdout:4/785: write d4/d12/d17/f7e [504567,45109] 0 2024-04-26T21:08:27.284 INFO:tasks.workunit.client.0.smithi055.stdout:1/925: mkdir d8/d17/d1b/d41/d133 0 2024-04-26T21:08:27.288 INFO:tasks.workunit.client.0.smithi055.stdout:0/981: dread d9/dc/d17/d9a/fad [0,4194304] 0 2024-04-26T21:08:27.288 INFO:tasks.workunit.client.0.smithi055.stdout:0/982: chown d9/dc/d17/l1b 0 1 2024-04-26T21:08:27.290 INFO:tasks.workunit.client.0.smithi055.stdout:9/881: write d2/d46/d77/d7d/da8/ff8 [1073119,59527] 0 2024-04-26T21:08:27.293 INFO:tasks.workunit.client.0.smithi055.stdout:3/976: creat d0/d4/d11c/f145 x:0 0 0 2024-04-26T21:08:27.295 INFO:tasks.workunit.client.0.smithi055.stdout:6/926: symlink d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/l13b 0 2024-04-26T21:08:27.295 INFO:tasks.workunit.client.0.smithi055.stdout:6/927: chown d3/d17/d46/d109/d66/d6a/d6b/l72 775438319 1 2024-04-26T21:08:27.299 INFO:tasks.workunit.client.0.smithi055.stdout:1/926: link d8/df/d11/db5/f103 d8/d17/d6a/f134 0 2024-04-26T21:08:27.299 INFO:tasks.workunit.client.0.smithi055.stdout:1/927: chown d8/c12c 13 1 2024-04-26T21:08:27.300 INFO:tasks.workunit.client.0.smithi055.stdout:9/882: truncate d2/d46/d77/fb5 3729958 0 2024-04-26T21:08:27.302 INFO:tasks.workunit.client.0.smithi055.stdout:6/928: unlink d3/d17/d19/d71/l40 0 2024-04-26T21:08:27.307 INFO:tasks.workunit.client.0.smithi055.stdout:4/786: dread d4/d26/d42/dbb/dde/d49/fa9 [0,4194304] 0 2024-04-26T21:08:27.313 INFO:tasks.workunit.client.0.smithi055.stdout:6/929: mknod d3/da5/c13c 0 2024-04-26T21:08:27.316 INFO:tasks.workunit.client.0.smithi055.stdout:1/928: rmdir d8/d17/d1b/d7b 39 2024-04-26T21:08:27.316 INFO:tasks.workunit.client.0.smithi055.stdout:1/929: fsync d8/d17/d1b/f62 0 2024-04-26T21:08:27.322 INFO:tasks.workunit.client.0.smithi055.stdout:6/930: rename d3/d17/d46/l7a to d3/d17/d46/d109/l13d 0 2024-04-26T21:08:27.331 INFO:tasks.workunit.client.0.smithi055.stdout:6/931: symlink d3/d17/d46/d109/d66/l13e 0 2024-04-26T21:08:27.331 INFO:tasks.workunit.client.0.smithi055.stdout:6/932: chown d3/d17/d46/d109/d66/d6a/d51/d58 1342 1 2024-04-26T21:08:27.334 INFO:tasks.workunit.client.0.smithi055.stdout:5/732: dwrite d4/df/f6b [0,4194304] 0 2024-04-26T21:08:27.358 INFO:tasks.workunit.client.0.smithi055.stdout:4/787: dread d4/d12/d15/f79 [0,4194304] 0 2024-04-26T21:08:27.370 INFO:tasks.workunit.client.0.smithi055.stdout:9/883: dwrite d2/d46/d77/d79/de0/f123 [0,4194304] 0 2024-04-26T21:08:27.370 INFO:tasks.workunit.client.0.smithi055.stdout:9/884: dread - d2/d46/d12d/fe5 zero size 2024-04-26T21:08:27.376 INFO:tasks.workunit.client.0.smithi055.stdout:6/933: truncate d3/d17/d19/f1e 3400917 0 2024-04-26T21:08:27.378 INFO:tasks.workunit.client.0.smithi055.stdout:4/788: dread d4/d12/d17/fa8 [0,4194304] 0 2024-04-26T21:08:27.386 INFO:tasks.workunit.client.0.smithi055.stdout:0/983: dwrite d9/dc/d1c/d3e/dc5/dcc/f92 [0,4194304] 0 2024-04-26T21:08:27.386 INFO:tasks.workunit.client.0.smithi055.stdout:0/984: chown d9/dc/d1c/d3e/dc5/dcc/c63 1117 1 2024-04-26T21:08:27.386 INFO:tasks.workunit.client.0.smithi055.stdout:0/985: dread - d9/dc/d1c/d3e/dc5/dcc/d4b/dfe/f116 zero size 2024-04-26T21:08:27.386 INFO:tasks.workunit.client.0.smithi055.stdout:5/733: creat d4/df/dae/dce/d93/dcb/ffd x:0 0 0 2024-04-26T21:08:27.386 INFO:tasks.workunit.client.0.smithi055.stdout:0/986: write d9/dc/d19/fd4 [351546,96074] 0 2024-04-26T21:08:27.391 INFO:tasks.workunit.client.0.smithi055.stdout:7/928: dwrite d5/d6/d24/d3b/f44 [0,4194304] 0 2024-04-26T21:08:27.391 INFO:tasks.workunit.client.0.smithi055.stdout:7/929: readlink d5/d53/d6e/lb2 0 2024-04-26T21:08:27.391 INFO:tasks.workunit.client.0.smithi055.stdout:7/930: chown d5/d11/c81 4700 1 2024-04-26T21:08:27.413 INFO:tasks.workunit.client.0.smithi055.stdout:6/934: unlink d3/d17/d46/d109/d66/d6a/d51/l101 0 2024-04-26T21:08:27.427 INFO:tasks.workunit.client.0.smithi055.stdout:1/930: dwrite d8/d17/d1b/d7b/fe2 [0,4194304] 0 2024-04-26T21:08:27.432 INFO:tasks.workunit.client.0.smithi055.stdout:0/987: dread d9/dc/d1c/d3e/f47 [0,4194304] 0 2024-04-26T21:08:27.432 INFO:tasks.workunit.client.0.smithi055.stdout:7/931: creat d5/d6/d24/d4d/f11d x:0 0 0 2024-04-26T21:08:27.432 INFO:tasks.workunit.client.0.smithi055.stdout:0/988: truncate d9/dc/d17/d5d/fbc 806195 0 2024-04-26T21:08:27.436 INFO:tasks.workunit.client.0.smithi055.stdout:4/789: link d4/d26/d42/dbb/fdd d4/d18/d86/da6/f106 0 2024-04-26T21:08:27.439 INFO:tasks.workunit.client.0.smithi055.stdout:1/931: link d8/df/d11/d27/d28/c9e d8/df/d11/d27/d28/da4/daa/c135 0 2024-04-26T21:08:27.443 INFO:tasks.workunit.client.0.smithi055.stdout:7/932: rename d5/d53/d6e/d65/l101 to d5/d11/d8c/d114/l11e 0 2024-04-26T21:08:27.450 INFO:tasks.workunit.client.0.smithi055.stdout:5/734: dwrite d4/df/dae/dce/d4a/f5e [0,4194304] 0 2024-04-26T21:08:27.450 INFO:tasks.workunit.client.0.smithi055.stdout:5/735: write d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/fdf [175939,106792] 0 2024-04-26T21:08:27.450 INFO:tasks.workunit.client.0.smithi055.stdout:4/790: rename d4/d26/d42/d56/f96 to d4/d26/d42/d56/f107 0 2024-04-26T21:08:27.454 INFO:tasks.workunit.client.0.smithi055.stdout:1/932: rename d8/c1e to d8/d17/d1b/d7b/d8d/df9/c136 0 2024-04-26T21:08:27.455 INFO:tasks.workunit.client.0.smithi055.stdout:0/989: getdents d9/dc/d1c/d3e/dc5/dcc/db2 0 2024-04-26T21:08:27.458 INFO:tasks.workunit.client.0.smithi055.stdout:5/736: dread d4/df/dae/dce/d4a/d3f/f6a [0,4194304] 0 2024-04-26T21:08:27.461 INFO:tasks.workunit.client.0.smithi055.stdout:4/791: truncate d4/d12/d57/f8b 1750281 0 2024-04-26T21:08:27.461 INFO:tasks.workunit.client.0.smithi055.stdout:4/792: fsync d4/d26/d42/dbb/dde/f8a 0 2024-04-26T21:08:27.465 INFO:tasks.workunit.client.0.smithi055.stdout:1/933: rename d8/d17/d1b/d7b/d8d/f11c to d8/d17/d33/dc5/f137 0 2024-04-26T21:08:27.465 INFO:tasks.workunit.client.0.smithi055.stdout:5/737: mknod d4/df/dae/dce/d4a/d3f/da1/cfe 0 2024-04-26T21:08:27.469 INFO:tasks.workunit.client.0.smithi055.stdout:0/990: dread d9/dc/d1c/d3e/dc5/dcc/d9c/f100 [0,4194304] 0 2024-04-26T21:08:27.470 INFO:tasks.workunit.client.0.smithi055.stdout:0/991: chown d9/dc/d1c/d3e/d7d/dc1 490521 1 2024-04-26T21:08:27.471 INFO:tasks.workunit.client.0.smithi055.stdout:1/934: mknod d8/d94/de7/dfa/c138 0 2024-04-26T21:08:27.471 INFO:tasks.workunit.client.0.smithi055.stdout:1/935: fsync d8/d17/d33/dc5/f81 0 2024-04-26T21:08:27.471 INFO:tasks.workunit.client.0.smithi055.stdout:1/936: read - d8/d17/d6a/f134 zero size 2024-04-26T21:08:27.473 INFO:tasks.workunit.client.0.smithi055.stdout:5/738: mkdir d4/df/dae/dce/d5b/d83/dff 0 2024-04-26T21:08:27.473 INFO:tasks.workunit.client.0.smithi055.stdout:5/739: chown d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/ffc 21 1 2024-04-26T21:08:27.473 INFO:tasks.workunit.client.0.smithi055.stdout:0/992: symlink d9/dc/d17/d9a/l132 0 2024-04-26T21:08:27.479 INFO:tasks.workunit.client.0.smithi055.stdout:5/740: unlink d4/df/dae/dce/c49 0 2024-04-26T21:08:27.481 INFO:tasks.workunit.client.0.smithi055.stdout:7/933: dwrite d5/d53/d6e/d99/d75/fb3 [0,4194304] 0 2024-04-26T21:08:27.485 INFO:tasks.workunit.client.0.smithi055.stdout:0/993: dread d9/dc/d1c/d3e/dc5/dcc/f4a [0,4194304] 0 2024-04-26T21:08:27.485 INFO:tasks.workunit.client.0.smithi055.stdout:0/994: chown d9/d11/d59/fb1 392345073 1 2024-04-26T21:08:27.491 INFO:tasks.workunit.client.0.smithi055.stdout:7/934: creat d5/d11/d8c/d114/f11f x:0 0 0 2024-04-26T21:08:27.494 INFO:tasks.workunit.client.0.smithi055.stdout:7/935: truncate d5/d53/dd1/f14 7270740 0 2024-04-26T21:08:27.498 INFO:tasks.workunit.client.0.smithi055.stdout:7/936: truncate d5/d53/dd1/f1e 4092489 0 2024-04-26T21:08:27.498 INFO:tasks.workunit.client.0.smithi055.stdout:7/937: chown d5/d6/d39/cc3 18 1 2024-04-26T21:08:27.498 INFO:tasks.workunit.client.0.smithi055.stdout:7/938: fsync d5/d6/f4c 0 2024-04-26T21:08:27.499 INFO:tasks.workunit.client.0.smithi055.stdout:7/939: write d5/d6/d24/d3b/f4e [855372,63243] 0 2024-04-26T21:08:27.501 INFO:tasks.workunit.client.0.smithi055.stdout:0/995: rename d9/d11/d59/d78/d106 to d9/dc/d1c/d3e/dc5/dcc/d9c/d133 0 2024-04-26T21:08:27.501 INFO:tasks.workunit.client.0.smithi055.stdout:0/996: write d9/d11/d5b/d74/ff5 [923727,29093] 0 2024-04-26T21:08:27.505 INFO:tasks.workunit.client.0.smithi055.stdout:0/997: creat d9/dc/d1c/d3e/dc5/dcc/d9c/f134 x:0 0 0 2024-04-26T21:08:27.511 INFO:tasks.workunit.client.0.smithi055.stdout:0/998: creat d9/dc/d17/d9a/d101/d11d/f135 x:0 0 0 2024-04-26T21:08:27.513 INFO:tasks.workunit.client.0.smithi055.stdout:0/999: mknod d9/dc/d1c/d3e/d7d/c136 0 2024-04-26T21:08:27.526 INFO:tasks.workunit.client.0.smithi055.stdout:4/793: write d4/d26/d42/dbb/f9b [6016948,82214] 0 2024-04-26T21:08:27.540 INFO:tasks.workunit.client.0.smithi055.stdout:7/940: dread d5/d6/d24/f27 [4194304,4194304] 0 2024-04-26T21:08:27.550 INFO:tasks.workunit.client.0.smithi055.stdout:5/741: dwrite d4/df/dae/dce/d4a/d3f/d2e/f54 [0,4194304] 0 2024-04-26T21:08:27.585 INFO:tasks.workunit.client.0.smithi055.stdout:1/937: dwrite d8/d17/d6a/fe1 [0,4194304] 0 2024-04-26T21:08:27.595 INFO:tasks.workunit.client.0.smithi055.stdout:1/938: creat d8/d17/d1b/d7b/d65/f139 x:0 0 0 2024-04-26T21:08:27.595 INFO:tasks.workunit.client.0.smithi055.stdout:1/939: stat d8/df/c13 0 2024-04-26T21:08:27.599 INFO:tasks.workunit.client.0.smithi055.stdout:1/940: symlink d8/d17/d33/l13a 0 2024-04-26T21:08:27.600 INFO:tasks.workunit.client.0.smithi055.stdout:1/941: chown d8/df/d11/d27/fc2 183054 1 2024-04-26T21:08:27.603 INFO:tasks.workunit.client.0.smithi055.stdout:1/942: symlink d8/df/d11/d27/d28/d2a/da7/l13b 0 2024-04-26T21:08:27.611 INFO:tasks.workunit.client.0.smithi055.stdout:1/943: getdents d8/d94/de7 0 2024-04-26T21:08:27.614 INFO:tasks.workunit.client.0.smithi055.stdout:1/944: symlink d8/d94/dd9/l13c 0 2024-04-26T21:08:27.623 INFO:tasks.workunit.client.0.smithi055.stdout:5/742: dwrite d4/df/dae/dce/d4a/d3f/d4f/d53/fbc [0,4194304] 0 2024-04-26T21:08:27.636 INFO:tasks.workunit.client.0.smithi055.stdout:4/794: dwrite d4/d18/d86/da6/f106 [4194304,4194304] 0 2024-04-26T21:08:27.639 INFO:tasks.workunit.client.0.smithi055.stdout:5/743: symlink d4/df/dae/dce/d93/dcb/l100 0 2024-04-26T21:08:27.650 INFO:tasks.workunit.client.0.smithi055.stdout:5/744: mkdir d4/d101 0 2024-04-26T21:08:27.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:27 smithi064 ceph-mon[33404]: mgrmap e28: smithi055.ybbowr(active, since 1.03535s) 2024-04-26T21:08:27.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:27 smithi064 ceph-mon[33404]: [26/Apr/2024:21:08:26] ENGINE Bus STARTING 2024-04-26T21:08:27.659 INFO:tasks.workunit.client.0.smithi055.stdout:5/745: getdents d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8 0 2024-04-26T21:08:27.667 INFO:tasks.workunit.client.0.smithi055.stdout:5/746: mknod d4/df/dae/dce/d93/dcb/c102 0 2024-04-26T21:08:27.670 INFO:tasks.workunit.client.0.smithi055.stdout:5/747: getdents d4/df/dae/dce/d4a/d3f/d2e/d82 0 2024-04-26T21:08:27.671 INFO:tasks.workunit.client.0.smithi055.stdout:5/748: write d4/df/dae/dce/d4a/d3f/d5c/db9/fc1 [384637,83698] 0 2024-04-26T21:08:27.671 INFO:tasks.workunit.client.0.smithi055.stdout:5/749: chown d4/df/d13/ca9 1847 1 2024-04-26T21:08:27.671 INFO:tasks.workunit.client.0.smithi055.stdout:5/750: readlink d4/df/dae/dce/d4a/d3f/d5c/lac 0 2024-04-26T21:08:27.676 INFO:tasks.workunit.client.0.smithi055.stdout:4/795: truncate d4/d26/d42/dbb/f9b 1861085 0 2024-04-26T21:08:27.676 INFO:tasks.workunit.client.0.smithi055.stdout:4/796: chown d4/d26/d42/d28/d53/d71/l91 25 1 2024-04-26T21:08:27.676 INFO:tasks.workunit.client.0.smithi055.stdout:4/797: fdatasync d4/d18/d86/da6/fea 0 2024-04-26T21:08:27.677 INFO:tasks.workunit.client.0.smithi055.stdout:4/798: fsync d4/d18/d8e/fb3 0 2024-04-26T21:08:27.680 INFO:tasks.workunit.client.0.smithi055.stdout:5/751: rename d4/df/dae/dce/d93/dcb/ffd to d4/df/d13/d26/d63/ddc/f103 0 2024-04-26T21:08:27.692 INFO:tasks.workunit.client.0.smithi055.stdout:1/945: dwrite d8/df/d11/db5/ff4 [0,4194304] 0 2024-04-26T21:08:27.706 INFO:tasks.workunit.client.0.smithi055.stdout:4/799: write d4/d12/d15/f67 [1771351,54926] 0 2024-04-26T21:08:27.709 INFO:tasks.workunit.client.0.smithi055.stdout:5/752: dread d4/df/dae/dce/d4a/d3f/f2c [0,4194304] 0 2024-04-26T21:08:27.710 INFO:tasks.workunit.client.0.smithi055.stdout:5/753: truncate d4/df/dae/dce/d5b/f86 96062 0 2024-04-26T21:08:27.713 INFO:tasks.workunit.client.0.smithi055.stdout:4/800: link d4/d12/d61/dd1/cf6 d4/d26/d42/dbb/dde/d49/dae/c108 0 2024-04-26T21:08:27.714 INFO:tasks.workunit.client.0.smithi055.stdout:5/754: truncate d4/df/dae/dce/d93/dcb/f1f 804659 0 2024-04-26T21:08:27.721 INFO:tasks.workunit.client.0.smithi055.stdout:5/755: creat d4/df/dae/dce/d93/dcb/db4/f104 x:0 0 0 2024-04-26T21:08:27.721 INFO:tasks.workunit.client.0.smithi055.stdout:5/756: getdents d4/d101 0 2024-04-26T21:08:27.725 INFO:tasks.workunit.client.0.smithi055.stdout:5/757: link d4/df/dae/cf9 d4/df/d13/d26/d63/ddc/c105 0 2024-04-26T21:08:27.725 INFO:tasks.workunit.client.0.smithi055.stdout:5/758: dread - d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ff6 zero size 2024-04-26T21:08:27.725 INFO:tasks.workunit.client.0.smithi055.stdout:5/759: dread - d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ff6 zero size 2024-04-26T21:08:27.731 INFO:tasks.workunit.client.0.smithi055.stdout:5/760: link d4/df/dae/dce/d4a/d3f/d5c/lac d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/l106 0 2024-04-26T21:08:27.731 INFO:tasks.workunit.client.0.smithi055.stdout:5/761: stat d4/d101 0 2024-04-26T21:08:27.734 INFO:tasks.workunit.client.0.smithi055.stdout:1/946: dread d8/f12 [4194304,4194304] 0 2024-04-26T21:08:27.740 INFO:tasks.workunit.client.0.smithi055.stdout:4/801: read d4/d12/d15/f16 [2678315,2143] 0 2024-04-26T21:08:27.741 INFO:tasks.workunit.client.0.smithi055.stdout:4/802: truncate d4/d26/d42/dbb/dde/f37 1608292 0 2024-04-26T21:08:27.745 INFO:tasks.workunit.client.0.smithi055.stdout:4/803: creat d4/d12/d57/f109 x:0 0 0 2024-04-26T21:08:27.754 INFO:tasks.workunit.client.0.smithi055.stdout:4/804: symlink d4/d26/d42/d28/d53/d71/l10a 0 2024-04-26T21:08:27.754 INFO:tasks.workunit.client.0.smithi055.stdout:4/805: fdatasync d4/d12/d15/fcb 0 2024-04-26T21:08:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:27 smithi055 ceph-mon[25475]: mgrmap e28: smithi055.ybbowr(active, since 1.03535s) 2024-04-26T21:08:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:27 smithi055 ceph-mon[25475]: [26/Apr/2024:21:08:26] ENGINE Bus STARTING 2024-04-26T21:08:27.763 INFO:tasks.workunit.client.0.smithi055.stdout:9/885: sync 2024-04-26T21:08:27.763 INFO:tasks.workunit.client.0.smithi055.stdout:7/941: sync 2024-04-26T21:08:27.763 INFO:tasks.workunit.client.0.smithi055.stdout:8/748: sync 2024-04-26T21:08:27.763 INFO:tasks.workunit.client.0.smithi055.stdout:3/977: sync 2024-04-26T21:08:27.764 INFO:tasks.workunit.client.0.smithi055.stdout:8/749: readlink d3/d7c/d9a/lc9 0 2024-04-26T21:08:27.764 INFO:tasks.workunit.client.0.smithi055.stdout:6/935: sync 2024-04-26T21:08:27.767 INFO:tasks.workunit.client.0.smithi055.stdout:4/806: getdents d4/d12/d17/d3d 0 2024-04-26T21:08:27.775 INFO:tasks.workunit.client.0.smithi055.stdout:4/807: symlink d4/d26/d42/d56/l10b 0 2024-04-26T21:08:27.775 INFO:tasks.workunit.client.0.smithi055.stdout:4/808: write d4/d18/d8e/fb3 [938103,16674] 0 2024-04-26T21:08:27.786 INFO:tasks.workunit.client.0.smithi055.stdout:3/978: dread d0/d4/d16/f10c [0,4194304] 0 2024-04-26T21:08:27.786 INFO:tasks.workunit.client.0.smithi055.stdout:3/979: chown d0/de 0 1 2024-04-26T21:08:27.786 INFO:tasks.workunit.client.0.smithi055.stdout:3/980: chown d0/d4/d5/d73/d13/d1a/d46/d72/dd5/fe1 63402184 1 2024-04-26T21:08:27.786 INFO:tasks.workunit.client.0.smithi055.stdout:3/981: stat d0/d4/d16/d18/d4b/d57/d8e/db1/fe5 0 2024-04-26T21:08:27.788 INFO:tasks.workunit.client.0.smithi055.stdout:3/982: rename d0/d4/d5/d73/d47/d37/d3d/d4c/f63 to d0/d4/d5/d73/d47/d37/f146 0 2024-04-26T21:08:27.790 INFO:tasks.workunit.client.0.smithi055.stdout:3/983: rmdir d0/d4/d16/d12e 39 2024-04-26T21:08:27.798 INFO:tasks.workunit.client.0.smithi055.stdout:3/984: mkdir d0/d4/d16/d18/d4b/d147 0 2024-04-26T21:08:27.800 INFO:tasks.workunit.client.0.smithi055.stdout:3/985: creat d0/d4/d16/d18/d4b/d57/d8e/dcc/f148 x:0 0 0 2024-04-26T21:08:27.806 INFO:tasks.workunit.client.0.smithi055.stdout:3/986: unlink d0/d4/d5/f21 0 2024-04-26T21:08:27.806 INFO:tasks.workunit.client.0.smithi055.stdout:3/987: fsync d0/d4/d5/d73/d13/d1a/f24 0 2024-04-26T21:08:27.809 INFO:tasks.workunit.client.0.smithi055.stdout:3/988: creat d0/d4/f149 x:0 0 0 2024-04-26T21:08:27.809 INFO:tasks.workunit.client.0.smithi055.stdout:9/886: dread d2/d46/d9a/d105/fcb [0,4194304] 0 2024-04-26T21:08:27.810 INFO:tasks.workunit.client.0.smithi055.stdout:9/887: write d2/d46/d77/d7d/ff7 [999992,71349] 0 2024-04-26T21:08:27.810 INFO:tasks.workunit.client.0.smithi055.stdout:3/989: truncate d0/d4/d5/f36 1453497 0 2024-04-26T21:08:27.810 INFO:tasks.workunit.client.0.smithi055.stdout:9/888: symlink d2/d46/d77/d7d/l134 0 2024-04-26T21:08:27.812 INFO:tasks.workunit.client.0.smithi055.stdout:1/947: dwrite d8/d17/d6a/f99 [0,4194304] 0 2024-04-26T21:08:27.812 INFO:tasks.workunit.client.0.smithi055.stdout:3/990: getdents d0/d4/d5/db8/dfd 0 2024-04-26T21:08:27.812 INFO:tasks.workunit.client.0.smithi055.stdout:3/991: chown d0/d4/df6 1051645 1 2024-04-26T21:08:27.812 INFO:tasks.workunit.client.0.smithi055.stdout:3/992: write d0/d4/d5/f127 [455894,77547] 0 2024-04-26T21:08:27.813 INFO:tasks.workunit.client.0.smithi055.stdout:9/889: getdents d2/d11/df5 0 2024-04-26T21:08:27.814 INFO:tasks.workunit.client.0.smithi055.stdout:9/890: write d2/d46/d12d/d9b/f133 [750771,20587] 0 2024-04-26T21:08:27.814 INFO:tasks.workunit.client.0.smithi055.stdout:9/891: readlink d2/d46/d77/l74 0 2024-04-26T21:08:27.818 INFO:tasks.workunit.client.0.smithi055.stdout:1/948: symlink d8/d94/l13d 0 2024-04-26T21:08:27.819 INFO:tasks.workunit.client.0.smithi055.stdout:9/892: chown d2/d46/d9a/da7/c103 657839 1 2024-04-26T21:08:27.821 INFO:tasks.workunit.client.0.smithi055.stdout:6/936: dread d3/d17/d25/ff7 [0,4194304] 0 2024-04-26T21:08:27.823 INFO:tasks.workunit.client.0.smithi055.stdout:9/893: creat d2/f135 x:0 0 0 2024-04-26T21:08:27.824 INFO:tasks.workunit.client.0.smithi055.stdout:1/949: symlink d8/df/d11/d27/d28/d2a/l13e 0 2024-04-26T21:08:27.826 INFO:tasks.workunit.client.0.smithi055.stdout:6/937: creat d3/da1/f13f x:0 0 0 2024-04-26T21:08:27.826 INFO:tasks.workunit.client.0.smithi055.stdout:6/938: write d3/d17/d46/d109/d66/d6a/d51/d58/d62/fa4 [1028797,32004] 0 2024-04-26T21:08:27.829 INFO:tasks.workunit.client.0.smithi055.stdout:9/894: stat d2/d46/d77/d7d/ce3 0 2024-04-26T21:08:27.830 INFO:tasks.workunit.client.0.smithi055.stdout:1/950: creat d8/df/d11/f13f x:0 0 0 2024-04-26T21:08:27.833 INFO:tasks.workunit.client.0.smithi055.stdout:9/895: creat d2/d46/d77/d7d/f136 x:0 0 0 2024-04-26T21:08:27.833 INFO:tasks.workunit.client.0.smithi055.stdout:9/896: readlink d2/d46/d9a/d105/db8/l127 0 2024-04-26T21:08:27.850 INFO:tasks.workunit.client.0.smithi055.stdout:3/993: write d0/d4/d5/db8/fee [3141506,55203] 0 2024-04-26T21:08:27.851 INFO:tasks.workunit.client.0.smithi055.stdout:5/762: dwrite d4/df/dae/dce/d4a/d3f/d5c/db9/ff3 [0,4194304] 0 2024-04-26T21:08:27.860 INFO:tasks.workunit.client.0.smithi055.stdout:3/994: creat d0/d4/d5/d73/d13/d1a/f14a x:0 0 0 2024-04-26T21:08:27.864 INFO:tasks.workunit.client.0.smithi055.stdout:3/995: creat d0/d4/d5/d73/d13/f14b x:0 0 0 2024-04-26T21:08:27.876 INFO:tasks.workunit.client.0.smithi055.stdout:3/996: dread d0/d4/d5/d73/d13/f1d [0,4194304] 0 2024-04-26T21:08:27.879 INFO:tasks.workunit.client.0.smithi055.stdout:3/997: rename d0/d4/d5/d73/d13/f1d to d0/d4/d5/d73/d13/d5c/f14c 0 2024-04-26T21:08:27.880 INFO:tasks.workunit.client.0.smithi055.stdout:8/750: dwrite d3/f14 [0,4194304] 0 2024-04-26T21:08:27.881 INFO:tasks.workunit.client.0.smithi055.stdout:6/939: dwrite d3/d17/d46/d109/d66/d6a/d67/d83/d96/f119 [0,4194304] 0 2024-04-26T21:08:27.883 INFO:tasks.workunit.client.0.smithi055.stdout:3/998: symlink d0/d4/d5/d73/d47/d37/d144/l14d 0 2024-04-26T21:08:27.883 INFO:tasks.workunit.client.0.smithi055.stdout:3/999: write d0/d4/d5/d73/d13/d27/d3b/dcd/f13a [523880,78081] 0 2024-04-26T21:08:27.886 INFO:tasks.workunit.client.0.smithi055.stdout:6/940: mkdir d3/d17/d25/dc7/d140 0 2024-04-26T21:08:27.887 INFO:tasks.workunit.client.0.smithi055.stdout:6/941: creat d3/d17/d25/d5f/f141 x:0 0 0 2024-04-26T21:08:27.891 INFO:tasks.workunit.client.0.smithi055.stdout:6/942: rename d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/fc3 to d3/d17/d25/d5f/f142 0 2024-04-26T21:08:27.891 INFO:tasks.workunit.client.0.smithi055.stdout:6/943: write d3/d17/d46/dc2/dd4/df3/f105 [814367,29002] 0 2024-04-26T21:08:27.891 INFO:tasks.workunit.client.0.smithi055.stdout:6/944: chown d3/d17/d25/d5f/d90/fb0 490146 1 2024-04-26T21:08:27.892 INFO:tasks.workunit.client.0.smithi055.stdout:6/945: rmdir d3/d17 39 2024-04-26T21:08:27.924 INFO:tasks.workunit.client.0.smithi055.stdout:1/951: dwrite d8/df/d11/d27/d28/da4/daa/fc6 [0,4194304] 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:4/809: dwrite d4/d12/d17/f7e [0,4194304] 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/952: write d8/d17/d6a/fe1 [4538633,97204] 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/953: write d8/f12 [3968960,89114] 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:4/810: write d4/d26/d42/dbb/f25 [4817926,62994] 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:4/811: stat d4/d18/d8e/fb3 0 2024-04-26T21:08:27.925 INFO:tasks.workunit.client.0.smithi055.stdout:1/954: write d8/df/d11/db5/f103 [49303,96782] 0 2024-04-26T21:08:27.928 INFO:tasks.workunit.client.0.smithi055.stdout:1/955: rmdir d8/d17/d1b 39 2024-04-26T21:08:27.934 INFO:tasks.workunit.client.0.smithi055.stdout:6/946: fdatasync d3/d17/d46/d109/d66/d6a/d51/d58/d62/fa4 0 2024-04-26T21:08:27.934 INFO:tasks.workunit.client.0.smithi055.stdout:6/947: creat d3/da1/f143 x:0 0 0 2024-04-26T21:08:27.934 INFO:tasks.workunit.client.0.smithi055.stdout:6/948: write d3/d17/d46/d109/d66/f102 [311445,54530] 0 2024-04-26T21:08:27.935 INFO:tasks.workunit.client.0.smithi055.stdout:4/812: rename d4/d12/d15 to d4/d12/d61/dd1/d10c 0 2024-04-26T21:08:27.941 INFO:tasks.workunit.client.0.smithi055.stdout:4/813: symlink d4/d26/d42/d28/d53/d71/d7f/l10d 0 2024-04-26T21:08:27.941 INFO:tasks.workunit.client.0.smithi055.stdout:4/814: write d4/d12/f43 [116475,26610] 0 2024-04-26T21:08:27.951 INFO:tasks.workunit.client.0.smithi055.stdout:1/956: dread d8/d17/d1b/d41/fee [0,4194304] 0 2024-04-26T21:08:27.951 INFO:tasks.workunit.client.0.smithi055.stdout:9/897: dwrite d2/d46/d9a/fc3 [0,4194304] 0 2024-04-26T21:08:27.951 INFO:tasks.workunit.client.0.smithi055.stdout:9/898: fdatasync d2/d46/d77/ff3 0 2024-04-26T21:08:27.952 INFO:tasks.workunit.client.0.smithi055.stdout:1/957: read d8/d94/f109 [1146455,85869] 0 2024-04-26T21:08:27.957 INFO:tasks.workunit.client.0.smithi055.stdout:9/899: mknod d2/d11/df5/dfe/c137 0 2024-04-26T21:08:27.959 INFO:tasks.workunit.client.0.smithi055.stdout:1/958: creat d8/d17/d1b/d10e/d113/f140 x:0 0 0 2024-04-26T21:08:27.959 INFO:tasks.workunit.client.0.smithi055.stdout:1/959: readlink d8/d94/l13d 0 2024-04-26T21:08:27.959 INFO:tasks.workunit.client.0.smithi055.stdout:1/960: write d8/d17/d1b/f62 [4233648,109312] 0 2024-04-26T21:08:27.961 INFO:tasks.workunit.client.0.smithi055.stdout:9/900: rmdir d2/d46/d9a/d105/db8/d111/d132 0 2024-04-26T21:08:27.961 INFO:tasks.workunit.client.0.smithi055.stdout:9/901: stat d2/d46/d12d/d9b/d10f/l117 0 2024-04-26T21:08:27.961 INFO:tasks.workunit.client.0.smithi055.stdout:9/902: mkdir d2/d46/d77/d5f/d138 0 2024-04-26T21:08:27.963 INFO:tasks.workunit.client.0.smithi055.stdout:6/949: write d3/d17/d25/fc6 [402843,79204] 0 2024-04-26T21:08:27.964 INFO:tasks.workunit.client.0.smithi055.stdout:5/763: dwrite d4/df/dae/dce/d4a/f8a [0,4194304] 0 2024-04-26T21:08:27.974 INFO:tasks.workunit.client.0.smithi055.stdout:9/903: dread d2/d46/d12d/dd7/d12c/fef [0,4194304] 0 2024-04-26T21:08:27.987 INFO:tasks.workunit.client.0.smithi055.stdout:5/764: mknod d4/df/dae/dce/d4a/d3f/c107 0 2024-04-26T21:08:27.991 INFO:tasks.workunit.client.0.smithi055.stdout:9/904: creat d2/d46/d77/d7d/da0/f139 x:0 0 0 2024-04-26T21:08:27.994 INFO:tasks.workunit.client.0.smithi055.stdout:6/950: unlink d3/cb 0 2024-04-26T21:08:27.994 INFO:tasks.workunit.client.0.smithi055.stdout:6/951: fsync d3/d17/d25/d5f/d90/f69 0 2024-04-26T21:08:27.996 INFO:tasks.workunit.client.0.smithi055.stdout:5/765: mkdir d4/df/dae/dce/d4a/d92/d108 0 2024-04-26T21:08:27.997 INFO:tasks.workunit.client.0.smithi055.stdout:5/766: creat d4/df/d13/d26/f109 x:0 0 0 2024-04-26T21:08:27.997 INFO:tasks.workunit.client.0.smithi055.stdout:5/767: fdatasync d4/df/dae/dce/d5b/d83/fba 0 2024-04-26T21:08:27.998 INFO:tasks.workunit.client.0.smithi055.stdout:9/905: creat d2/d46/d12d/d126/f13a x:0 0 0 2024-04-26T21:08:27.999 INFO:tasks.workunit.client.0.smithi055.stdout:4/815: dread d4/f36 [0,4194304] 0 2024-04-26T21:08:28.000 INFO:tasks.workunit.client.0.smithi055.stdout:6/952: creat d3/d17/d19/d71/dca/dcb/d10e/ddf/d11f/f144 x:0 0 0 2024-04-26T21:08:28.000 INFO:tasks.workunit.client.0.smithi055.stdout:8/751: dwrite d3/d7c/faf [4194304,4194304] 0 2024-04-26T21:08:28.000 INFO:tasks.workunit.client.0.smithi055.stdout:8/752: write d3/d9/d1d/f25 [4950328,77190] 0 2024-04-26T21:08:28.003 INFO:tasks.workunit.client.0.smithi055.stdout:8/753: write d3/d9/d44/f58 [1482770,65454] 0 2024-04-26T21:08:28.004 INFO:tasks.workunit.client.0.smithi055.stdout:8/754: chown d3/dc0/d2e/d75/d76/d92/fbf 100395 1 2024-04-26T21:08:28.004 INFO:tasks.workunit.client.0.smithi055.stdout:8/755: creat d3/dc0/d2e/db3/ff7 x:0 0 0 2024-04-26T21:08:28.004 INFO:tasks.workunit.client.0.smithi055.stdout:8/756: chown d3/dc0/c2f 12 1 2024-04-26T21:08:28.006 INFO:tasks.workunit.client.0.smithi055.stdout:8/757: read d3/dc0/d2e/d75/dcb/ff2 [22782,126278] 0 2024-04-26T21:08:28.008 INFO:tasks.workunit.client.0.smithi055.stdout:9/906: creat d2/d46/d9a/f13b x:0 0 0 2024-04-26T21:08:28.008 INFO:tasks.workunit.client.0.smithi055.stdout:9/907: readlink d2/d11/l3e 0 2024-04-26T21:08:28.008 INFO:tasks.workunit.client.0.smithi055.stdout:5/768: readlink d4/l29 0 2024-04-26T21:08:28.008 INFO:tasks.workunit.client.0.smithi055.stdout:5/769: dread - d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fde zero size 2024-04-26T21:08:28.014 INFO:tasks.workunit.client.0.smithi055.stdout:4/816: mknod d4/d12/d57/dc6/c10e 0 2024-04-26T21:08:28.022 INFO:tasks.workunit.client.0.smithi055.stdout:8/758: mknod d3/d9/d1d/d48/d57/d61/d9b/cf8 0 2024-04-26T21:08:28.022 INFO:tasks.workunit.client.0.smithi055.stdout:8/759: dread - d3/d9/d1d/d48/d80/fed zero size 2024-04-26T21:08:28.029 INFO:tasks.workunit.client.0.smithi055.stdout:9/908: link d2/d46/d12d/d9b/c130 d2/d46/d77/d5f/c13c 0 2024-04-26T21:08:28.032 INFO:tasks.workunit.client.0.smithi055.stdout:6/953: dread d3/d17/d46/d109/d66/de1/fe5 [0,4194304] 0 2024-04-26T21:08:28.033 INFO:tasks.workunit.client.0.smithi055.stdout:9/909: mkdir d2/d46/d9a/d13d 0 2024-04-26T21:08:28.035 INFO:tasks.workunit.client.0.smithi055.stdout:6/954: creat d3/d17/d46/dc2/dde/f145 x:0 0 0 2024-04-26T21:08:28.037 INFO:tasks.workunit.client.0.smithi055.stdout:1/961: dwrite d8/df/d11/d27/d28/f11b [0,4194304] 0 2024-04-26T21:08:28.046 INFO:tasks.workunit.client.0.smithi055.stdout:1/962: rename d8/df/d11/d6c to d8/df/d11/d141 0 2024-04-26T21:08:28.047 INFO:tasks.workunit.client.0.smithi055.stdout:1/963: truncate d8/d17/d1b/d7b/fe2 6882359 0 2024-04-26T21:08:28.064 INFO:tasks.workunit.client.0.smithi055.stdout:8/760: dwrite d3/d9/d44/f98 [0,4194304] 0 2024-04-26T21:08:28.064 INFO:tasks.workunit.client.0.smithi055.stdout:8/761: write d3/dc0/d2e/db3/fef [802341,10491] 0 2024-04-26T21:08:28.064 INFO:tasks.workunit.client.0.smithi055.stdout:7/942: sync 2024-04-26T21:08:28.070 INFO:tasks.workunit.client.0.smithi055.stdout:7/943: rename d5/d6/f41 to d5/d6/d24/dcf/f120 0 2024-04-26T21:08:28.074 INFO:tasks.workunit.client.0.smithi055.stdout:7/944: mkdir d5/d6/d121 0 2024-04-26T21:08:28.177 INFO:tasks.workunit.client.0.smithi055.stdout:7/945: read d5/d6/d24/d3b/f42 [514116,105628] 0 2024-04-26T21:08:28.177 INFO:tasks.workunit.client.0.smithi055.stdout:7/946: dread - d5/d6/d24/d4d/da7/fdf zero size 2024-04-26T21:08:28.178 INFO:tasks.workunit.client.0.smithi055.stdout:7/947: truncate d5/d11/d8c/f116 580719 0 2024-04-26T21:08:28.178 INFO:tasks.workunit.client.0.smithi055.stdout:7/948: truncate d5/d6/ff 4952446 0 2024-04-26T21:08:28.178 INFO:tasks.workunit.client.0.smithi055.stdout:4/817: dwrite d4/d26/d42/d28/d53/d70/f8f [0,4194304] 0 2024-04-26T21:08:28.197 INFO:tasks.workunit.client.0.smithi055.stdout:4/818: dread d4/d26/d42/d28/d53/d70/f8f [0,4194304] 0 2024-04-26T21:08:28.197 INFO:tasks.workunit.client.0.smithi055.stdout:4/819: chown d4/d26/d42/d28/d53/d70/dc9/fec 672669 1 2024-04-26T21:08:28.198 INFO:tasks.workunit.client.0.smithi055.stdout:4/820: write d4/d26/fa3 [1809176,103545] 0 2024-04-26T21:08:28.201 INFO:tasks.workunit.client.0.smithi055.stdout:9/910: dwrite d2/d46/d77/d79/d11b/f128 [0,4194304] 0 2024-04-26T21:08:28.235 INFO:tasks.workunit.client.0.smithi055.stdout:7/949: dwrite d5/d6/d24/f91 [0,4194304] 0 2024-04-26T21:08:28.255 INFO:tasks.workunit.client.0.smithi055.stdout:9/911: dwrite d2/d46/d51/f109 [0,4194304] 0 2024-04-26T21:08:28.323 INFO:tasks.workunit.client.0.smithi055.stdout:4/821: unlink d4/d26/d42/d56/c77 0 2024-04-26T21:08:28.341 INFO:tasks.workunit.client.0.smithi055.stdout:7/950: symlink d5/d6/d24/dcf/l122 0 2024-04-26T21:08:28.346 INFO:tasks.workunit.client.0.smithi055.stdout:9/912: creat d2/d46/d77/d7d/da8/f13e x:0 0 0 2024-04-26T21:08:28.351 INFO:tasks.workunit.client.0.smithi055.stdout:4/822: dread d4/d26/d42/d28/d53/f100 [0,4194304] 0 2024-04-26T21:08:28.358 INFO:tasks.workunit.client.0.smithi055.stdout:7/951: creat d5/d6/d10f/f123 x:0 0 0 2024-04-26T21:08:28.358 INFO:tasks.workunit.client.0.smithi055.stdout:7/952: chown d5/d6/d24/d4d/da7/dab/laf 157160635 1 2024-04-26T21:08:28.363 INFO:tasks.workunit.client.0.smithi055.stdout:9/913: dread d2/d46/d77/f62 [0,4194304] 0 2024-04-26T21:08:28.363 INFO:tasks.workunit.client.0.smithi055.stdout:9/914: chown d2/d46/d77/f122 20217756 1 2024-04-26T21:08:28.363 INFO:tasks.workunit.client.0.smithi055.stdout:9/915: chown d2/f22 7144006 1 2024-04-26T21:08:28.363 INFO:tasks.workunit.client.0.smithi055.stdout:9/916: fdatasync d2/d46/d77/d79/f125 0 2024-04-26T21:08:28.366 INFO:tasks.workunit.client.0.smithi055.stdout:9/917: rename d2/d46/d77/d7d/d94/f106 to d2/d46/d77/d7d/d94/f13f 0 2024-04-26T21:08:28.368 INFO:tasks.workunit.client.0.smithi055.stdout:9/918: readlink d2/d46/d77/l85 0 2024-04-26T21:08:28.369 INFO:tasks.workunit.client.0.smithi055.stdout:9/919: write d2/d46/d77/f124 [66002,129787] 0 2024-04-26T21:08:28.370 INFO:tasks.workunit.client.0.smithi055.stdout:9/920: rmdir d2/d11 39 2024-04-26T21:08:28.379 INFO:tasks.workunit.client.0.smithi055.stdout:7/953: dread d5/f57 [0,4194304] 0 2024-04-26T21:08:28.381 INFO:tasks.workunit.client.0.smithi055.stdout:7/954: write d5/d6/d39/dbc/fcb [259640,25281] 0 2024-04-26T21:08:28.383 INFO:tasks.workunit.client.0.smithi055.stdout:7/955: symlink d5/d53/d6e/d99/d7f/l124 0 2024-04-26T21:08:28.400 INFO:tasks.workunit.client.0.smithi055.stdout:9/921: write d2/f8 [741933,47280] 0 2024-04-26T21:08:28.402 INFO:tasks.workunit.client.0.smithi055.stdout:9/922: write d2/d46/d12d/f121 [37547,125093] 0 2024-04-26T21:08:28.431 INFO:tasks.workunit.client.0.smithi055.stdout:9/923: dread d2/d46/d77/fbb [0,4194304] 0 2024-04-26T21:08:28.431 INFO:tasks.workunit.client.0.smithi055.stdout:9/924: read - d2/f135 zero size 2024-04-26T21:08:28.431 INFO:tasks.workunit.client.0.smithi055.stdout:9/925: chown d2/d46/l65 0 1 2024-04-26T21:08:28.451 INFO:tasks.workunit.client.0.smithi055.stdout:7/956: dwrite d5/d6/d24/f30 [0,4194304] 0 2024-04-26T21:08:28.453 INFO:tasks.workunit.client.0.smithi055.stdout:7/957: mkdir d5/d53/d6e/d99/d7f/d6f/ddc/d125 0 2024-04-26T21:08:28.455 INFO:tasks.workunit.client.0.smithi055.stdout:7/958: rename d5/d6/d10f/f123 to d5/d11/d8c/d114/f126 0 2024-04-26T21:08:28.458 INFO:tasks.workunit.client.0.smithi055.stdout:7/959: rmdir d5/d6/d39/dbc 39 2024-04-26T21:08:28.461 INFO:tasks.workunit.client.0.smithi055.stdout:7/960: creat d5/d6/d39/f127 x:0 0 0 2024-04-26T21:08:28.461 INFO:tasks.workunit.client.0.smithi055.stdout:7/961: chown d5/d6/l1f 103 1 2024-04-26T21:08:28.461 INFO:tasks.workunit.client.0.smithi055.stdout:7/962: write d5/d53/f8a [4633335,4849] 0 2024-04-26T21:08:28.463 INFO:tasks.workunit.client.0.smithi055.stdout:7/963: write d5/d53/d6e/d6c/fd5 [240182,17022] 0 2024-04-26T21:08:28.483 INFO:tasks.workunit.client.0.smithi055.stdout:9/926: dwrite d2/d11/fa4 [4194304,4194304] 0 2024-04-26T21:08:28.492 INFO:tasks.workunit.client.0.smithi055.stdout:9/927: creat d2/d11/df5/dfe/f140 x:0 0 0 2024-04-26T21:08:28.492 INFO:tasks.workunit.client.0.smithi055.stdout:9/928: write d2/d46/d9a/d105/f47 [275032,59856] 0 2024-04-26T21:08:28.492 INFO:tasks.workunit.client.0.smithi055.stdout:9/929: readlink d2/d46/lb4 0 2024-04-26T21:08:28.492 INFO:tasks.workunit.client.0.smithi055.stdout:9/930: readlink d2/d46/d77/d7d/da0/l114 0 2024-04-26T21:08:28.492 INFO:tasks.workunit.client.0.smithi055.stdout:9/931: readlink d2/d11/le2 0 2024-04-26T21:08:28.532 INFO:tasks.workunit.client.0.smithi055.stdout:7/964: dwrite d5/d6/d24/d4d/f73 [0,4194304] 0 2024-04-26T21:08:28.539 INFO:tasks.workunit.client.0.smithi055.stdout:7/965: mknod d5/d53/d6e/d6c/c128 0 2024-04-26T21:08:28.558 INFO:tasks.workunit.client.0.smithi055.stdout:7/966: dread d5/d6/d24/f69 [0,4194304] 0 2024-04-26T21:08:28.627 INFO:tasks.workunit.client.0.smithi055.stdout:7/967: dwrite d5/d53/f8a [0,4194304] 0 2024-04-26T21:08:28.659 INFO:tasks.workunit.client.0.smithi055.stdout:5/770: sync 2024-04-26T21:08:28.660 INFO:tasks.workunit.client.0.smithi055.stdout:1/964: sync 2024-04-26T21:08:28.660 INFO:tasks.workunit.client.0.smithi055.stdout:6/955: sync 2024-04-26T21:08:28.660 INFO:tasks.workunit.client.0.smithi055.stdout:8/762: sync 2024-04-26T21:08:28.660 INFO:tasks.workunit.client.0.smithi055.stdout:6/956: chown d3/da5 27 1 2024-04-26T21:08:28.660 INFO:tasks.workunit.client.0.smithi055.stdout:6/957: stat d3/d17/d19/d7b/d8f/lc1 0 2024-04-26T21:08:28.661 INFO:tasks.workunit.client.0.smithi055.stdout:1/965: mknod d8/d94/de7/dfa/c142 0 2024-04-26T21:08:28.662 INFO:tasks.workunit.client.0.smithi055.stdout:1/966: chown d8/df/l11f 0 1 2024-04-26T21:08:28.662 INFO:tasks.workunit.client.0.smithi055.stdout:5/771: getdents d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4 0 2024-04-26T21:08:28.663 INFO:tasks.workunit.client.0.smithi055.stdout:1/967: rename d8/df/d11/d27/d28/dd7/f66 to d8/d94/de7/dfa/f143 0 2024-04-26T21:08:28.688 INFO:tasks.workunit.client.0.smithi055.stdout:1/968: rename d8/df/f55 to d8/d17/d1b/d41/d120/f144 0 2024-04-26T21:08:28.691 INFO:tasks.workunit.client.0.smithi055.stdout:5/772: write d4/df/d13/d26/f31 [2884246,83542] 0 2024-04-26T21:08:28.692 INFO:tasks.workunit.client.0.smithi055.stdout:7/968: dwrite d5/d53/d6e/d99/d7f/f96 [0,4194304] 0 2024-04-26T21:08:28.693 INFO:tasks.workunit.client.0.smithi055.stdout:7/969: mknod d5/d6/d10f/c129 0 2024-04-26T21:08:28.694 INFO:tasks.workunit.client.0.smithi055.stdout:7/970: truncate d5/d53/d6e/d99/d58/f118 102012 0 2024-04-26T21:08:28.696 INFO:tasks.workunit.client.0.smithi055.stdout:7/971: rename d5/d53/d6e/d99/ldd to d5/d53/d6e/d65/dc5/dc7/l12a 0 2024-04-26T21:08:28.696 INFO:tasks.workunit.client.0.smithi055.stdout:7/972: stat d5/d11/de4/df9 0 2024-04-26T21:08:28.698 INFO:tasks.workunit.client.0.smithi055.stdout:7/973: symlink d5/d53/d6e/d65/d111/db1/l12b 0 2024-04-26T21:08:28.698 INFO:tasks.workunit.client.0.smithi055.stdout:7/974: chown d5/d53/d6e 274 1 2024-04-26T21:08:28.702 INFO:tasks.workunit.client.0.smithi055.stdout:4/823: sync 2024-04-26T21:08:28.706 INFO:tasks.workunit.client.0.smithi055.stdout:5/773: dread d4/df/dae/dce/d4a/d3f/d4f/d53/f62 [0,4194304] 0 2024-04-26T21:08:28.706 INFO:tasks.workunit.client.0.smithi055.stdout:4/824: unlink d4/d18/d86/fdf 0 2024-04-26T21:08:28.706 INFO:tasks.workunit.client.0.smithi055.stdout:5/774: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/f10a x:0 0 0 2024-04-26T21:08:28.707 INFO:tasks.workunit.client.0.smithi055.stdout:1/969: read d8/f35 [2743575,13953] 0 2024-04-26T21:08:28.712 INFO:tasks.workunit.client.0.smithi055.stdout:6/958: dwrite d3/d17/d19/f3d [0,4194304] 0 2024-04-26T21:08:28.715 INFO:tasks.workunit.client.0.smithi055.stdout:1/970: read d8/f31 [920744,46526] 0 2024-04-26T21:08:28.715 INFO:tasks.workunit.client.0.smithi055.stdout:1/971: fdatasync d8/d17/fae 0 2024-04-26T21:08:28.715 INFO:tasks.workunit.client.0.smithi055.stdout:6/959: symlink d3/d17/d46/d109/d66/d6a/d51/d58/d62/l146 0 2024-04-26T21:08:28.719 INFO:tasks.workunit.client.0.smithi055.stdout:1/972: mkdir d8/df/d11/d27/d28/d145 0 2024-04-26T21:08:28.720 INFO:tasks.workunit.client.0.smithi055.stdout:6/960: symlink d3/d17/d19/d71/dca/dcb/l147 0 2024-04-26T21:08:28.721 INFO:tasks.workunit.client.0.smithi055.stdout:6/961: truncate d3/d17/d46/dc2/dde/f145 626955 0 2024-04-26T21:08:28.722 INFO:tasks.workunit.client.0.smithi055.stdout:5/775: getdents d4/df/dae/dce/d4a/d3f/d4f/d53/d90 0 2024-04-26T21:08:28.726 INFO:tasks.workunit.client.0.smithi055.stdout:5/776: getdents d4/df/dae/dce/d4a/d92 0 2024-04-26T21:08:28.737 INFO:tasks.workunit.client.0.smithi055.stdout:6/962: dread d3/d17/d25/d5f/d90/fb0 [0,4194304] 0 2024-04-26T21:08:28.737 INFO:tasks.workunit.client.0.smithi055.stdout:6/963: getdents d3/d17/d19/d71/dca/dcb/dd0 0 2024-04-26T21:08:28.751 INFO:tasks.workunit.client.0.smithi055.stdout:5/777: write d4/df/dae/dce/d5b/f70 [2935033,9812] 0 2024-04-26T21:08:28.752 INFO:tasks.workunit.client.0.smithi055.stdout:5/778: write d4/df/dae/dce/d4a/d3f/f96 [114273,2543] 0 2024-04-26T21:08:28.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:28 smithi055 ceph-mon[25475]: [26/Apr/2024:21:08:26] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T21:08:28.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:28 smithi055 ceph-mon[25475]: [26/Apr/2024:21:08:26] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T21:08:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:28 smithi055 ceph-mon[25475]: [26/Apr/2024:21:08:26] ENGINE Bus STARTED 2024-04-26T21:08:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:28 smithi055 ceph-mon[25475]: pgmap v4: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:28.755 INFO:tasks.workunit.client.0.smithi055.stdout:5/779: creat d4/df/dae/dce/d4a/d3f/d5c/f10b x:0 0 0 2024-04-26T21:08:28.757 INFO:tasks.workunit.client.0.smithi055.stdout:5/780: creat d4/df/dae/dce/d4a/d3f/d2e/dcd/f10c x:0 0 0 2024-04-26T21:08:28.757 INFO:tasks.workunit.client.0.smithi055.stdout:5/781: write d4/df/dae/dce/d93/dcb/fb8 [447299,15739] 0 2024-04-26T21:08:28.758 INFO:tasks.workunit.client.0.smithi055.stdout:5/782: dread - d4/df/dae/dce/d4a/d3f/fdb zero size 2024-04-26T21:08:28.787 INFO:tasks.workunit.client.0.smithi055.stdout:6/964: dwrite d3/d17/d46/d109/d66/d6a/d51/d58/d62/fa4 [0,4194304] 0 2024-04-26T21:08:28.791 INFO:tasks.workunit.client.0.smithi055.stdout:6/965: mknod d3/d17/d19/d71/dca/dcb/d10e/ddf/d11f/c148 0 2024-04-26T21:08:28.791 INFO:tasks.workunit.client.0.smithi055.stdout:1/973: dwrite d8/df/f24 [0,4194304] 0 2024-04-26T21:08:28.792 INFO:tasks.workunit.client.0.smithi055.stdout:1/974: truncate d8/d17/d6a/fe1 2750956 0 2024-04-26T21:08:28.792 INFO:tasks.workunit.client.0.smithi055.stdout:1/975: chown d8/df/d11/d27/d28/d2a/f58 3476 1 2024-04-26T21:08:28.795 INFO:tasks.workunit.client.0.smithi055.stdout:1/976: link d8/d17/d1b/d10b/f122 d8/d17/d1b/d7b/df1/f146 0 2024-04-26T21:08:28.795 INFO:tasks.workunit.client.0.smithi055.stdout:1/977: write d8/d17/fae [242901,30932] 0 2024-04-26T21:08:28.798 INFO:tasks.workunit.client.0.smithi055.stdout:1/978: rename d8/df/d11/d141 to d8/df/d11/d27/d28/d2a/d147 0 2024-04-26T21:08:28.800 INFO:tasks.workunit.client.0.smithi055.stdout:1/979: creat d8/df/d11/d27/d28/d145/f148 x:0 0 0 2024-04-26T21:08:28.801 INFO:tasks.workunit.client.0.smithi055.stdout:1/980: fdatasync d8/df/d11/d27/d28/d2a/f93 0 2024-04-26T21:08:28.809 INFO:tasks.workunit.client.0.smithi055.stdout:1/981: truncate d8/d17/d33/f82 3108433 0 2024-04-26T21:08:28.814 INFO:tasks.workunit.client.0.smithi055.stdout:1/982: link d8/df/d11/d27/d28/d2a/da7/l13b d8/d17/l149 0 2024-04-26T21:08:28.817 INFO:tasks.workunit.client.0.smithi055.stdout:1/983: creat d8/d17/d1b/d7b/d8d/df9/d100/f14a x:0 0 0 2024-04-26T21:08:28.817 INFO:tasks.workunit.client.0.smithi055.stdout:1/984: readlink d8/df/d11/d27/d28/dd7/l10d 0 2024-04-26T21:08:28.817 INFO:tasks.workunit.client.0.smithi055.stdout:1/985: chown d8/d17/d1b/f62 381116293 1 2024-04-26T21:08:28.817 INFO:tasks.workunit.client.0.smithi055.stdout:1/986: chown d8/d17/d1b/d7b/d8d/f88 148 1 2024-04-26T21:08:28.817 INFO:tasks.workunit.client.0.smithi055.stdout:5/783: dwrite d4/df/f47 [0,4194304] 0 2024-04-26T21:08:28.822 INFO:tasks.workunit.client.0.smithi055.stdout:1/987: truncate d8/d17/d1b/d7b/d65/f7d 3750797 0 2024-04-26T21:08:28.845 INFO:tasks.workunit.client.0.smithi055.stdout:1/988: unlink d8/df/d11/d27/d28/d2a/d147/f73 0 2024-04-26T21:08:28.846 INFO:tasks.workunit.client.0.smithi055.stdout:1/989: readlink d8/df/d11/l9d 0 2024-04-26T21:08:28.846 INFO:tasks.workunit.client.0.smithi055.stdout:1/990: write d8/d17/d1b/d7b/d8d/f79 [1502164,15178] 0 2024-04-26T21:08:28.846 INFO:tasks.workunit.client.0.smithi055.stdout:6/966: dwrite f1 [0,4194304] 0 2024-04-26T21:08:28.851 INFO:tasks.workunit.client.0.smithi055.stdout:1/991: getdents d8/d17/d1b/d7b/d8d 0 2024-04-26T21:08:28.853 INFO:tasks.workunit.client.0.smithi055.stdout:5/784: dread d4/df/dae/dce/d4a/d3f/d5c/db9/ff3 [0,4194304] 0 2024-04-26T21:08:28.853 INFO:tasks.workunit.client.0.smithi055.stdout:6/967: rmdir d3/da1/de3 39 2024-04-26T21:08:28.854 INFO:tasks.workunit.client.0.smithi055.stdout:1/992: mkdir d8/df/d11/d27/d28/da4/daa/d14b 0 2024-04-26T21:08:28.854 INFO:tasks.workunit.client.0.smithi055.stdout:1/993: creat d8/d17/d6a/f14c x:0 0 0 2024-04-26T21:08:28.857 INFO:tasks.workunit.client.0.smithi055.stdout:5/785: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/d90/dbd/c10d 0 2024-04-26T21:08:28.860 INFO:tasks.workunit.client.0.smithi055.stdout:6/968: link d3/d17/d46/d109/d66/d6a/d6b/c100 d3/d17/d46/d109/d66/d6a/d67/c149 0 2024-04-26T21:08:28.866 INFO:tasks.workunit.client.0.smithi055.stdout:1/994: symlink d8/d17/d1b/d7b/df1/l14d 0 2024-04-26T21:08:28.871 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:28 smithi064 ceph-mon[33404]: [26/Apr/2024:21:08:26] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T21:08:28.871 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:28 smithi064 ceph-mon[33404]: [26/Apr/2024:21:08:26] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T21:08:28.871 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:28 smithi064 ceph-mon[33404]: [26/Apr/2024:21:08:26] ENGINE Bus STARTED 2024-04-26T21:08:28.871 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:28 smithi064 ceph-mon[33404]: pgmap v4: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:28.872 INFO:tasks.workunit.client.0.smithi055.stdout:1/995: mkdir d8/d94/d9b/d14e 0 2024-04-26T21:08:28.873 INFO:tasks.workunit.client.0.smithi055.stdout:5/786: dread d4/df/dae/dce/f3e [0,4194304] 0 2024-04-26T21:08:28.876 INFO:tasks.workunit.client.0.smithi055.stdout:5/787: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d10e 0 2024-04-26T21:08:28.877 INFO:tasks.workunit.client.0.smithi055.stdout:5/788: readlink d4/df/d13/d26/l48 0 2024-04-26T21:08:28.877 INFO:tasks.workunit.client.0.smithi055.stdout:5/789: stat d4/df/d13/ca9 0 2024-04-26T21:08:28.879 INFO:tasks.workunit.client.0.smithi055.stdout:5/790: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/f10f x:0 0 0 2024-04-26T21:08:28.879 INFO:tasks.workunit.client.0.smithi055.stdout:5/791: chown d4/df/dae/dce/f51 11985807 1 2024-04-26T21:08:28.882 INFO:tasks.workunit.client.0.smithi055.stdout:5/792: rename d4/df/dae/dce/d5b/d83/f8c to d4/df/dae/dce/d93/dc4/f110 0 2024-04-26T21:08:28.885 INFO:tasks.workunit.client.0.smithi055.stdout:5/793: rename d4/df/d13/d26/d63/ddc to d4/df/dae/dce/dc0/d111 0 2024-04-26T21:08:28.887 INFO:tasks.workunit.client.0.smithi055.stdout:1/996: write d8/df/d11/d27/d28/d2a/f93 [3964245,21091] 0 2024-04-26T21:08:28.888 INFO:tasks.workunit.client.0.smithi055.stdout:6/969: write d3/d17/d46/dc2/fc5 [558950,98715] 0 2024-04-26T21:08:28.889 INFO:tasks.workunit.client.0.smithi055.stdout:6/970: write d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f122 [9075760,5213] 0 2024-04-26T21:08:28.891 INFO:tasks.workunit.client.0.smithi055.stdout:6/971: unlink d3/d17/d46/d109/d66/d6a/d6b/c100 0 2024-04-26T21:08:28.894 INFO:tasks.workunit.client.0.smithi055.stdout:6/972: creat d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf/df5/f14a x:0 0 0 2024-04-26T21:08:28.894 INFO:tasks.workunit.client.0.smithi055.stdout:6/973: readlink d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf/lef 0 2024-04-26T21:08:28.895 INFO:tasks.workunit.client.0.smithi055.stdout:6/974: mknod d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/c14b 0 2024-04-26T21:08:28.895 INFO:tasks.workunit.client.0.smithi055.stdout:6/975: write d3/d17/d25/d5f/f134 [228739,96118] 0 2024-04-26T21:08:28.907 INFO:tasks.workunit.client.0.smithi055.stdout:1/997: dread d8/d17/d1b/d7b/d8d/f54 [0,4194304] 0 2024-04-26T21:08:28.912 INFO:tasks.workunit.client.0.smithi055.stdout:6/976: write d3/d17/d46/d109/d66/de1/fe5 [731029,29168] 0 2024-04-26T21:08:28.912 INFO:tasks.workunit.client.0.smithi055.stdout:6/977: truncate d3/d17/d19/d71/dca/ffa 671517 0 2024-04-26T21:08:28.920 INFO:tasks.workunit.client.0.smithi055.stdout:6/978: unlink d3/d17/d19/f36 0 2024-04-26T21:08:28.921 INFO:tasks.workunit.client.0.smithi055.stdout:9/932: sync 2024-04-26T21:08:28.921 INFO:tasks.workunit.client.0.smithi055.stdout:9/933: fsync d2/d46/d77/d7d/da0/f139 0 2024-04-26T21:08:28.922 INFO:tasks.workunit.client.0.smithi055.stdout:9/934: stat d2/d46/d51/c63 0 2024-04-26T21:08:28.926 INFO:tasks.workunit.client.0.smithi055.stdout:9/935: unlink d2/f5a 0 2024-04-26T21:08:28.926 INFO:tasks.workunit.client.0.smithi055.stdout:9/936: truncate d2/f41 1963989 0 2024-04-26T21:08:28.935 INFO:tasks.workunit.client.0.smithi055.stdout:6/979: dread d3/d17/d46/d109/d66/d6a/d51/f117 [0,4194304] 0 2024-04-26T21:08:28.976 INFO:tasks.workunit.client.0.smithi055.stdout:1/998: dwrite d8/d17/d33/dc5/f81 [0,4194304] 0 2024-04-26T21:08:28.977 INFO:tasks.workunit.client.0.smithi055.stdout:1/999: dread - d8/df/d11/db5/f117 zero size 2024-04-26T21:08:29.040 INFO:tasks.workunit.client.0.smithi055.stdout:9/937: symlink d2/l141 0 2024-04-26T21:08:29.040 INFO:tasks.workunit.client.0.smithi055.stdout:9/938: chown d2/d46/d51/fb2 9 1 2024-04-26T21:08:29.044 INFO:tasks.workunit.client.0.smithi055.stdout:6/980: creat d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f14c x:0 0 0 2024-04-26T21:08:29.057 INFO:tasks.workunit.client.0.smithi055.stdout:6/981: dread d3/d17/d25/ff7 [0,4194304] 0 2024-04-26T21:08:29.123 INFO:tasks.workunit.client.0.smithi055.stdout:9/939: dwrite d2/d11/df5/df9/f112 [0,4194304] 0 2024-04-26T21:08:29.126 INFO:tasks.workunit.client.0.smithi055.stdout:6/982: dwrite d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 [0,4194304] 0 2024-04-26T21:08:29.138 INFO:tasks.workunit.client.0.smithi055.stdout:6/983: symlink d3/d17/d25/d5f/d90/l14d 0 2024-04-26T21:08:29.138 INFO:tasks.workunit.client.0.smithi055.stdout:6/984: stat d3/d17/d25/d5f 0 2024-04-26T21:08:29.141 INFO:tasks.workunit.client.0.smithi055.stdout:6/985: link d3/d17/d46/fed d3/d17/d46/d109/d66/d6a/d51/d58/d6d/d86/d104/f14e 0 2024-04-26T21:08:29.156 INFO:tasks.workunit.client.0.smithi055.stdout:7/975: sync 2024-04-26T21:08:29.156 INFO:tasks.workunit.client.0.smithi055.stdout:8/763: sync 2024-04-26T21:08:29.160 INFO:tasks.workunit.client.0.smithi055.stdout:8/764: mknod d3/dc0/d2e/d75/cf9 0 2024-04-26T21:08:29.163 INFO:tasks.workunit.client.0.smithi055.stdout:8/765: mkdir d3/dc0/dfa 0 2024-04-26T21:08:29.163 INFO:tasks.workunit.client.0.smithi055.stdout:8/766: chown d3/d9/d1d/d48/d4b 465829 1 2024-04-26T21:08:29.163 INFO:tasks.workunit.client.0.smithi055.stdout:8/767: creat d3/dbc/ffb x:0 0 0 2024-04-26T21:08:29.167 INFO:tasks.workunit.client.0.smithi055.stdout:8/768: creat d3/dc0/d2e/ddc/ffc x:0 0 0 2024-04-26T21:08:29.167 INFO:tasks.workunit.client.0.smithi055.stdout:8/769: truncate d3/d7c/faf 8719439 0 2024-04-26T21:08:29.167 INFO:tasks.workunit.client.0.smithi055.stdout:8/770: chown d3/dc0/d2e/d75/cf9 5723614 1 2024-04-26T21:08:29.180 INFO:tasks.workunit.client.0.smithi055.stdout:7/976: write d5/d53/d6e/d99/d7f/f96 [3213328,97262] 0 2024-04-26T21:08:29.187 INFO:tasks.workunit.client.0.smithi055.stdout:7/977: creat d5/d53/f12c x:0 0 0 2024-04-26T21:08:29.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/978: dread d5/d53/d6e/d6c/f84 [0,4194304] 0 2024-04-26T21:08:29.198 INFO:tasks.workunit.client.0.smithi055.stdout:7/979: truncate d5/f9b 1396942 0 2024-04-26T21:08:29.204 INFO:tasks.workunit.client.0.smithi055.stdout:7/980: truncate d5/d53/d6e/d99/d58/f5f 1400549 0 2024-04-26T21:08:29.222 INFO:tasks.workunit.client.0.smithi055.stdout:7/981: write d5/d53/d6e/d65/d111/db1/fca [1137139,27130] 0 2024-04-26T21:08:29.222 INFO:tasks.workunit.client.0.smithi055.stdout:7/982: chown d5/d53/l78 3 1 2024-04-26T21:08:29.222 INFO:tasks.workunit.client.0.smithi055.stdout:7/983: dread - d5/d11/d8c/d114/f126 zero size 2024-04-26T21:08:29.223 INFO:tasks.workunit.client.0.smithi055.stdout:7/984: mkdir d5/d11/de4/d12d 0 2024-04-26T21:08:29.223 INFO:tasks.workunit.client.0.smithi055.stdout:7/985: chown d5/d6/d24/d4d/da7/dab/c106 989 1 2024-04-26T21:08:29.223 INFO:tasks.workunit.client.0.smithi055.stdout:7/986: truncate d5/d53/d6e/d6c/f84 1586273 0 2024-04-26T21:08:29.234 INFO:tasks.workunit.client.0.smithi055.stdout:6/986: dwrite d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/f121 [0,4194304] 0 2024-04-26T21:08:29.240 INFO:tasks.workunit.client.0.smithi055.stdout:9/940: dwrite d2/d46/d51/f113 [0,4194304] 0 2024-04-26T21:08:29.249 INFO:tasks.workunit.client.0.smithi055.stdout:9/941: getdents d2/d11 0 2024-04-26T21:08:29.251 INFO:tasks.workunit.client.0.smithi055.stdout:9/942: write d2/d46/d77/f122 [638883,14868] 0 2024-04-26T21:08:29.254 INFO:tasks.workunit.client.0.smithi055.stdout:9/943: symlink d2/d46/d12d/dd7/l142 0 2024-04-26T21:08:29.256 INFO:tasks.workunit.client.0.smithi055.stdout:8/771: dwrite d3/d7c/d9a/fc8 [0,4194304] 0 2024-04-26T21:08:29.266 INFO:tasks.workunit.client.0.smithi055.stdout:8/772: mknod d3/d9/d5b/cfd 0 2024-04-26T21:08:29.266 INFO:tasks.workunit.client.0.smithi055.stdout:8/773: fsync d3/d9/d1d/d48/fdd 0 2024-04-26T21:08:29.270 INFO:tasks.workunit.client.0.smithi055.stdout:8/774: symlink d3/d7c/d90/lfe 0 2024-04-26T21:08:29.275 INFO:tasks.workunit.client.0.smithi055.stdout:8/775: symlink d3/d9/lff 0 2024-04-26T21:08:29.279 INFO:tasks.workunit.client.0.smithi055.stdout:8/776: mkdir d3/d9/d1d/d48/d100 0 2024-04-26T21:08:29.279 INFO:tasks.workunit.client.0.smithi055.stdout:8/777: chown d3/d89/daa 3 1 2024-04-26T21:08:29.279 INFO:tasks.workunit.client.0.smithi055.stdout:8/778: creat d3/dc0/d2e/db3/f101 x:0 0 0 2024-04-26T21:08:29.280 INFO:tasks.workunit.client.0.smithi055.stdout:4/825: sync 2024-04-26T21:08:29.280 INFO:tasks.workunit.client.0.smithi055.stdout:5/794: sync 2024-04-26T21:08:29.281 INFO:tasks.workunit.client.0.smithi055.stdout:4/826: fdatasync d4/d12/d17/d3d/f8c 0 2024-04-26T21:08:29.283 INFO:tasks.workunit.client.0.smithi055.stdout:8/779: mkdir d3/d77/d102 0 2024-04-26T21:08:29.285 INFO:tasks.workunit.client.0.smithi055.stdout:4/827: rename d4/d12/d61/dd1 to d4/d12/d10f 0 2024-04-26T21:08:29.286 INFO:tasks.workunit.client.0.smithi055.stdout:4/828: chown d4/d26/d42/dbb/dde/d49/dae/dc0 14 1 2024-04-26T21:08:29.288 INFO:tasks.workunit.client.0.smithi055.stdout:8/780: symlink d3/d77/l103 0 2024-04-26T21:08:29.288 INFO:tasks.workunit.client.0.smithi055.stdout:8/781: write d3/dc0/d2e/db3/fef [895980,71299] 0 2024-04-26T21:08:29.291 INFO:tasks.workunit.client.0.smithi055.stdout:6/987: dwrite d3/d17/d46/d109/d66/d6a/d67/f89 [8388608,4194304] 0 2024-04-26T21:08:29.293 INFO:tasks.workunit.client.0.smithi055.stdout:4/829: unlink d4/d18/d86/da6/ld4 0 2024-04-26T21:08:29.293 INFO:tasks.workunit.client.0.smithi055.stdout:4/830: chown d4/d26/d42/d2d/f3a 74 1 2024-04-26T21:08:29.293 INFO:tasks.workunit.client.0.smithi055.stdout:4/831: write d4/d26/d42/dbb/dde/de3/dfc/fce [952036,103292] 0 2024-04-26T21:08:29.294 INFO:tasks.workunit.client.0.smithi055.stdout:8/782: symlink d3/d9/d1d/d48/d4b/l104 0 2024-04-26T21:08:29.294 INFO:tasks.workunit.client.0.smithi055.stdout:8/783: chown d3/d9/d1d/d48/d57/fdf 18 1 2024-04-26T21:08:29.299 INFO:tasks.workunit.client.0.smithi055.stdout:6/988: symlink d3/d17/d25/d5f/d90/l14f 0 2024-04-26T21:08:29.299 INFO:tasks.workunit.client.0.smithi055.stdout:7/987: dwrite d5/d53/d6e/d99/d58/f88 [0,4194304] 0 2024-04-26T21:08:29.299 INFO:tasks.workunit.client.0.smithi055.stdout:7/988: stat d5/d11/d8c 0 2024-04-26T21:08:29.300 INFO:tasks.workunit.client.0.smithi055.stdout:7/989: fsync d5/d6/d24/dcf/fac 0 2024-04-26T21:08:29.302 INFO:tasks.workunit.client.0.smithi055.stdout:6/989: symlink d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/l150 0 2024-04-26T21:08:29.307 INFO:tasks.workunit.client.0.smithi055.stdout:5/795: dread d4/df/dae/dce/d4a/d3f/f46 [0,4194304] 0 2024-04-26T21:08:29.307 INFO:tasks.workunit.client.0.smithi055.stdout:5/796: chown d4/df/dae/dce/d4a/d3f/f46 349373 1 2024-04-26T21:08:29.309 INFO:tasks.workunit.client.0.smithi055.stdout:6/990: getdents d3/d17/d19/d7b/d8f 0 2024-04-26T21:08:29.309 INFO:tasks.workunit.client.0.smithi055.stdout:6/991: fsync d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f113 0 2024-04-26T21:08:29.312 INFO:tasks.workunit.client.0.smithi055.stdout:5/797: stat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/cb2 0 2024-04-26T21:08:29.314 INFO:tasks.workunit.client.0.smithi055.stdout:8/784: dread d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:29.314 INFO:tasks.workunit.client.0.smithi055.stdout:8/785: creat d3/d9/d1d/d48/f105 x:0 0 0 2024-04-26T21:08:29.319 INFO:tasks.workunit.client.0.smithi055.stdout:6/992: link d3/d17/d46/d109/d66/d6a/d51/f85 d3/d17/d19/d71/dca/d103/f151 0 2024-04-26T21:08:29.320 INFO:tasks.workunit.client.0.smithi055.stdout:4/832: dread d4/d26/d42/dbb/dde/f8a [0,4194304] 0 2024-04-26T21:08:29.323 INFO:tasks.workunit.client.0.smithi055.stdout:5/798: creat d4/df/dae/dce/dc0/de2/f112 x:0 0 0 2024-04-26T21:08:29.323 INFO:tasks.workunit.client.0.smithi055.stdout:5/799: fdatasync d4/df/dae/dce/d93/dc4/ff7 0 2024-04-26T21:08:29.323 INFO:tasks.workunit.client.0.smithi055.stdout:5/800: read - d4/df/d13/d26/f109 zero size 2024-04-26T21:08:29.333 INFO:tasks.workunit.client.0.smithi055.stdout:4/833: creat d4/f110 x:0 0 0 2024-04-26T21:08:29.333 INFO:tasks.workunit.client.0.smithi055.stdout:4/834: readlink d4/d12/l63 0 2024-04-26T21:08:29.340 INFO:tasks.workunit.client.0.smithi055.stdout:6/993: write d3/da1/de3/fd7 [3570092,117859] 0 2024-04-26T21:08:29.340 INFO:tasks.workunit.client.0.smithi055.stdout:4/835: unlink d4/d26/d42/d28/d53/d71/d7f/l10d 0 2024-04-26T21:08:29.345 INFO:tasks.workunit.client.0.smithi055.stdout:6/994: mkdir d3/d17/d19/d71/dca/dcb/d152 0 2024-04-26T21:08:29.345 INFO:tasks.workunit.client.0.smithi055.stdout:6/995: write d3/d17/d46/d109/d66/d6a/d67/d83/d10b/f14c [771559,74166] 0 2024-04-26T21:08:29.347 INFO:tasks.workunit.client.0.smithi055.stdout:7/990: write d5/f9b [476357,69317] 0 2024-04-26T21:08:29.347 INFO:tasks.workunit.client.0.smithi055.stdout:7/991: fsync d5/d6/d24/d3b/f4e 0 2024-04-26T21:08:29.397 INFO:tasks.workunit.client.0.smithi055.stdout:9/944: dwrite d2/d46/d77/d7d/ff7 [0,4194304] 0 2024-04-26T21:08:29.438 INFO:tasks.workunit.client.0.smithi055.stdout:9/945: dwrite d2/d46/d9a/f13b [0,4194304] 0 2024-04-26T21:08:29.442 INFO:tasks.workunit.client.0.smithi055.stdout:9/946: symlink d2/dfa/l143 0 2024-04-26T21:08:29.443 INFO:tasks.workunit.client.0.smithi055.stdout:9/947: chown d2/d46/d77/d7d/da8/f13e 14545130 1 2024-04-26T21:08:29.483 INFO:tasks.workunit.client.0.smithi055.stdout:9/948: dwrite d2/d46/d77/d7d/dbf/f119 [0,4194304] 0 2024-04-26T21:08:29.484 INFO:tasks.workunit.client.0.smithi055.stdout:9/949: symlink d2/d46/d9a/d105/l144 0 2024-04-26T21:08:29.486 INFO:tasks.workunit.client.0.smithi055.stdout:9/950: creat d2/d46/d9a/d105/f145 x:0 0 0 2024-04-26T21:08:29.487 INFO:tasks.workunit.client.0.smithi055.stdout:9/951: symlink d2/d46/d12d/d126/l146 0 2024-04-26T21:08:29.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:29 smithi055 ceph-mon[25475]: mgrmap e29: smithi055.ybbowr(active, since 3s) 2024-04-26T21:08:29.509 INFO:tasks.workunit.client.0.smithi055.stdout:9/952: write d2/f41 [455467,120443] 0 2024-04-26T21:08:29.544 INFO:tasks.workunit.client.0.smithi055.stdout:5/801: dwrite d4/df/dae/dce/d5b/d83/fba [0,4194304] 0 2024-04-26T21:08:29.546 INFO:tasks.workunit.client.0.smithi055.stdout:6/996: dwrite d3/d17/d46/d109/d66/de1/fb9 [4194304,4194304] 0 2024-04-26T21:08:29.553 INFO:tasks.workunit.client.0.smithi055.stdout:4/836: dwrite d4/d26/d42/dbb/dde/de3/dfc/fce [0,4194304] 0 2024-04-26T21:08:29.553 INFO:tasks.workunit.client.0.smithi055.stdout:4/837: write d4/d12/d61/fdc [14318,64058] 0 2024-04-26T21:08:29.554 INFO:tasks.workunit.client.0.smithi055.stdout:4/838: readlink d4/d12/lba 0 2024-04-26T21:08:29.557 INFO:tasks.workunit.client.0.smithi055.stdout:9/953: dwrite d2/d46/d9a/d105/f47 [0,4194304] 0 2024-04-26T21:08:29.558 INFO:tasks.workunit.client.0.smithi055.stdout:5/802: mknod d4/d101/c113 0 2024-04-26T21:08:29.566 INFO:tasks.workunit.client.0.smithi055.stdout:6/997: fdatasync d3/d17/d46/d109/d66/d6a/d67/ffb 0 2024-04-26T21:08:29.577 INFO:tasks.workunit.client.0.smithi055.stdout:4/839: truncate d4/f9 364641 0 2024-04-26T21:08:29.583 INFO:tasks.workunit.client.0.smithi055.stdout:9/954: truncate d2/d46/d77/d7d/f83 525956 0 2024-04-26T21:08:29.584 INFO:tasks.workunit.client.0.smithi055.stdout:6/998: rmdir d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf 39 2024-04-26T21:08:29.589 INFO:tasks.workunit.client.0.smithi055.stdout:4/840: rename d4/f13 to d4/d26/d42/dbb/dde/f111 0 2024-04-26T21:08:29.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/955: symlink d2/d46/d12d/l147 0 2024-04-26T21:08:29.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/956: readlink d2/d46/d12d/d9b/la3 0 2024-04-26T21:08:29.592 INFO:tasks.workunit.client.0.smithi055.stdout:9/957: truncate d2/d46/d9a/d105/db8/dc5/f120 154270 0 2024-04-26T21:08:29.596 INFO:tasks.workunit.client.0.smithi055.stdout:6/999: rename d3/d17/d25/l91 to d3/d17/d46/d109/d66/d6a/d67/d83/d96/d9e/daf/l153 0 2024-04-26T21:08:29.597 INFO:tasks.workunit.client.0.smithi055.stdout:4/841: creat d4/d26/d42/dbb/de8/f112 x:0 0 0 2024-04-26T21:08:29.600 INFO:tasks.workunit.client.0.smithi055.stdout:9/958: dread d2/d46/d77/d7d/da8/ff8 [0,4194304] 0 2024-04-26T21:08:29.601 INFO:tasks.workunit.client.0.smithi055.stdout:9/959: chown d2/d46/f48 3 1 2024-04-26T21:08:29.618 INFO:tasks.workunit.client.0.smithi055.stdout:9/960: read d2/d46/d77/d5f/f69 [63575,11766] 0 2024-04-26T21:08:29.618 INFO:tasks.workunit.client.0.smithi055.stdout:9/961: truncate d2/d46/f48 4464526 0 2024-04-26T21:08:29.621 INFO:tasks.workunit.client.0.smithi055.stdout:4/842: dread d4/d26/d42/d2d/f3a [0,4194304] 0 2024-04-26T21:08:29.664 INFO:tasks.workunit.client.0.smithi055.stdout:4/843: dwrite d4/d26/d42/dbb/dde/f37 [0,4194304] 0 2024-04-26T21:08:29.669 INFO:tasks.workunit.client.0.smithi055.stdout:4/844: mknod d4/d26/d42/dbb/dde/d49/dae/c113 0 2024-04-26T21:08:29.719 INFO:tasks.workunit.client.0.smithi055.stdout:9/962: dwrite d2/d46/d9a/da7/f102 [0,4194304] 0 2024-04-26T21:08:29.724 INFO:tasks.workunit.client.0.smithi055.stdout:9/963: link d2/d46/d51/l84 d2/d46/d9a/da7/l148 0 2024-04-26T21:08:29.727 INFO:tasks.workunit.client.0.smithi055.stdout:9/964: mknod d2/d46/d9a/d105/db8/c149 0 2024-04-26T21:08:29.740 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:29 smithi064 ceph-mon[33404]: mgrmap e29: smithi055.ybbowr(active, since 3s) 2024-04-26T21:08:29.790 INFO:tasks.workunit.client.0.smithi055.stdout:7/992: sync 2024-04-26T21:08:29.804 INFO:tasks.workunit.client.0.smithi055.stdout:7/993: link d5/d11/f2f d5/d53/d6e/d99/d7f/d6f/dc6/f12e 0 2024-04-26T21:08:29.804 INFO:tasks.workunit.client.0.smithi055.stdout:7/994: stat d5/d53/dd1/f14 0 2024-04-26T21:08:29.805 INFO:tasks.workunit.client.0.smithi055.stdout:7/995: chown d5/f32 23713 1 2024-04-26T21:08:29.813 INFO:tasks.workunit.client.0.smithi055.stdout:7/996: mkdir d5/d12f 0 2024-04-26T21:08:29.819 INFO:tasks.workunit.client.0.smithi055.stdout:7/997: creat d5/d11/de4/d12d/f130 x:0 0 0 2024-04-26T21:08:29.819 INFO:tasks.workunit.client.0.smithi055.stdout:7/998: fdatasync d5/d6/d24/d52/f5e 0 2024-04-26T21:08:29.819 INFO:tasks.workunit.client.0.smithi055.stdout:7/999: chown d5/d6/d24/d3b/l7d 508 1 2024-04-26T21:08:29.883 INFO:tasks.workunit.client.0.smithi055.stdout:8/786: sync 2024-04-26T21:08:29.883 INFO:tasks.workunit.client.0.smithi055.stdout:5/803: sync 2024-04-26T21:08:29.884 INFO:tasks.workunit.client.0.smithi055.stdout:5/804: creat d4/df/dae/dce/d93/dc4/f114 x:0 0 0 2024-04-26T21:08:29.884 INFO:tasks.workunit.client.0.smithi055.stdout:5/805: chown d4/df/dae/dce/dc0/d111/fe3 538444 1 2024-04-26T21:08:29.884 INFO:tasks.workunit.client.0.smithi055.stdout:5/806: chown d4/df/dae/dce/d4a/d3f/d4f/d53/faa 119 1 2024-04-26T21:08:29.886 INFO:tasks.workunit.client.0.smithi055.stdout:8/787: creat d3/d89/f106 x:0 0 0 2024-04-26T21:08:29.890 INFO:tasks.workunit.client.0.smithi055.stdout:5/807: stat d4/l35 0 2024-04-26T21:08:29.895 INFO:tasks.workunit.client.0.smithi055.stdout:8/788: link d3/d89/daa/fe2 d3/d77/dd5/f107 0 2024-04-26T21:08:29.900 INFO:tasks.workunit.client.0.smithi055.stdout:5/808: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/d90/dbd/l115 0 2024-04-26T21:08:29.900 INFO:tasks.workunit.client.0.smithi055.stdout:5/809: truncate d4/df/dae/dce/d4a/f98 506479 0 2024-04-26T21:08:29.907 INFO:tasks.workunit.client.0.smithi055.stdout:8/789: rmdir d3/d9/d1d/d48/d4b 39 2024-04-26T21:08:29.910 INFO:tasks.workunit.client.0.smithi055.stdout:5/810: link d4/df/dae/dce/d93/dcb/f1f d4/df/dae/dce/d93/dcb/f116 0 2024-04-26T21:08:29.984 INFO:tasks.workunit.client.0.smithi055.stdout:8/790: dwrite d3/d9/ff3 [0,4194304] 0 2024-04-26T21:08:30.017 INFO:tasks.workunit.client.0.smithi055.stdout:8/791: write d3/d9/d1d/f53 [2634143,48726] 0 2024-04-26T21:08:30.058 INFO:tasks.workunit.client.0.smithi055.stdout:8/792: write d3/fd3 [1889493,1617] 0 2024-04-26T21:08:30.071 INFO:tasks.workunit.client.0.smithi055.stdout:8/793: dread d3/d77/fc6 [0,4194304] 0 2024-04-26T21:08:30.077 INFO:tasks.workunit.client.0.smithi055.stdout:8/794: mknod d3/d9/d5b/da4/dc5/c108 0 2024-04-26T21:08:30.081 INFO:tasks.workunit.client.0.smithi055.stdout:8/795: symlink d3/d9/d1d/d48/d80/l109 0 2024-04-26T21:08:30.081 INFO:tasks.workunit.client.0.smithi055.stdout:8/796: write d3/dc0/d2e/d75/dcb/ff2 [401043,13321] 0 2024-04-26T21:08:30.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/797: mkdir d3/d77/dd5/d10a 0 2024-04-26T21:08:30.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/798: chown d3/dc0/f72 21231224 1 2024-04-26T21:08:30.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/799: truncate d3/dc0/d2e/db3/fea 137123 0 2024-04-26T21:08:30.090 INFO:tasks.workunit.client.0.smithi055.stdout:8/800: dread - d3/dc0/d2e/db3/ff7 zero size 2024-04-26T21:08:30.095 INFO:tasks.workunit.client.0.smithi055.stdout:8/801: truncate d3/dc0/fb5 676190 0 2024-04-26T21:08:30.105 INFO:tasks.workunit.client.0.smithi055.stdout:4/845: sync 2024-04-26T21:08:30.105 INFO:tasks.workunit.client.0.smithi055.stdout:9/965: sync 2024-04-26T21:08:30.114 INFO:tasks.workunit.client.0.smithi055.stdout:4/846: mkdir d4/d12/d61/d114 0 2024-04-26T21:08:30.119 INFO:tasks.workunit.client.0.smithi055.stdout:5/811: sync 2024-04-26T21:08:30.122 INFO:tasks.workunit.client.0.smithi055.stdout:4/847: unlink d4/d26/d42/d28/d53/d71/l10a 0 2024-04-26T21:08:30.122 INFO:tasks.workunit.client.0.smithi055.stdout:4/848: fdatasync d4/d12/f5e 0 2024-04-26T21:08:30.126 INFO:tasks.workunit.client.0.smithi055.stdout:4/849: rename d4/d26/d42/l5b to d4/d26/d42/dbb/dde/d49/l115 0 2024-04-26T21:08:30.129 INFO:tasks.workunit.client.0.smithi055.stdout:4/850: link d4/d26/d42/dbb/f25 d4/d18/d8e/d9e/f116 0 2024-04-26T21:08:30.129 INFO:tasks.workunit.client.0.smithi055.stdout:4/851: truncate d4/d12/d10f/d10c/fcb 8971859 0 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:9/966: dwrite d2/d46/d77/d5f/f69 [0,4194304] 0 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:9/967: readlink d2/d46/d12d/dd7/l142 0 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:8/802: dwrite d3/d9/d1d/f85 [0,4194304] 0 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:8/803: chown d3/d7c/lf4 51 1 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:8/804: chown d3/d9/d1d/d48/d57/d61/f97 3391344 1 2024-04-26T21:08:30.207 INFO:tasks.workunit.client.0.smithi055.stdout:8/805: truncate d3/d9/fcd 425921 0 2024-04-26T21:08:30.209 INFO:tasks.workunit.client.0.smithi055.stdout:9/968: mkdir d2/d46/d77/d5f/d138/d14a 0 2024-04-26T21:08:30.210 INFO:tasks.workunit.client.0.smithi055.stdout:8/806: symlink d3/d89/daa/l10b 0 2024-04-26T21:08:30.210 INFO:tasks.workunit.client.0.smithi055.stdout:8/807: write d3/d9/f3b [556879,6131] 0 2024-04-26T21:08:30.212 INFO:tasks.workunit.client.0.smithi055.stdout:9/969: rmdir d2/d46/d77/d5f 39 2024-04-26T21:08:30.217 INFO:tasks.workunit.client.0.smithi055.stdout:8/808: mknod d3/d9/d1d/d48/c10c 0 2024-04-26T21:08:30.218 INFO:tasks.workunit.client.0.smithi055.stdout:8/809: creat d3/d9/d1d/d48/f10d x:0 0 0 2024-04-26T21:08:30.244 INFO:tasks.workunit.client.0.smithi055.stdout:4/852: dwrite d4/d26/d42/d2d/f3a [0,4194304] 0 2024-04-26T21:08:30.244 INFO:tasks.workunit.client.0.smithi055.stdout:5/812: dwrite d4/df/dae/dce/d4a/d3f/d4f/f77 [4194304,4194304] 0 2024-04-26T21:08:30.249 INFO:tasks.workunit.client.0.smithi055.stdout:5/813: mknod d4/df/d13/d26/c117 0 2024-04-26T21:08:30.252 INFO:tasks.workunit.client.0.smithi055.stdout:4/853: mknod d4/d18/d86/c117 0 2024-04-26T21:08:30.252 INFO:tasks.workunit.client.0.smithi055.stdout:4/854: truncate d4/d26/d42/dbb/dde/de3/fef 285411 0 2024-04-26T21:08:30.258 INFO:tasks.workunit.client.0.smithi055.stdout:5/814: truncate d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fa4 396060 0 2024-04-26T21:08:30.261 INFO:tasks.workunit.client.0.smithi055.stdout:8/810: dwrite d3/dc0/f86 [4194304,4194304] 0 2024-04-26T21:08:30.297 INFO:tasks.workunit.client.0.smithi055.stdout:8/811: write d3/dc0/d2e/d75/dcb/ff2 [3380232,27300] 0 2024-04-26T21:08:30.297 INFO:tasks.workunit.client.0.smithi055.stdout:8/812: write d3/d77/dd5/f107 [439336,14466] 0 2024-04-26T21:08:30.305 INFO:tasks.workunit.client.0.smithi055.stdout:5/815: dwrite d4/df/dae/dce/d5b/d83/fba [4194304,4194304] 0 2024-04-26T21:08:30.318 INFO:tasks.workunit.client.0.smithi055.stdout:4/855: dwrite d4/d26/d42/dbb/dde/d49/fbe [0,4194304] 0 2024-04-26T21:08:30.321 INFO:tasks.workunit.client.0.smithi055.stdout:4/856: symlink d4/d26/d42/d28/l118 0 2024-04-26T21:08:30.321 INFO:tasks.workunit.client.0.smithi055.stdout:4/857: creat d4/d12/d57/f119 x:0 0 0 2024-04-26T21:08:30.321 INFO:tasks.workunit.client.0.smithi055.stdout:4/858: fdatasync d4/d18/d8e/d9e/f116 0 2024-04-26T21:08:30.335 INFO:tasks.workunit.client.0.smithi055.stdout:5/816: write d4/df/d13/f97 [1626962,111088] 0 2024-04-26T21:08:30.337 INFO:tasks.workunit.client.0.smithi055.stdout:5/817: rename d4/df/dae/dce/d4a/d92/d108 to d4/df/dae/dce/dc0/de2/d118 0 2024-04-26T21:08:30.337 INFO:tasks.workunit.client.0.smithi055.stdout:5/818: fdatasync d4/df/dae/dce/f51 0 2024-04-26T21:08:30.341 INFO:tasks.workunit.client.0.smithi055.stdout:5/819: getdents d4/df/d13 0 2024-04-26T21:08:30.393 INFO:tasks.workunit.client.0.smithi055.stdout:4/859: dwrite d4/d26/d42/d2d/f41 [0,4194304] 0 2024-04-26T21:08:30.394 INFO:tasks.workunit.client.0.smithi055.stdout:4/860: write d4/d26/d42/dbb/dde/ffd [904117,45380] 0 2024-04-26T21:08:30.407 INFO:tasks.workunit.client.0.smithi055.stdout:8/813: dwrite d3/dc0/d2e/db3/fea [0,4194304] 0 2024-04-26T21:08:30.407 INFO:tasks.workunit.client.0.smithi055.stdout:8/814: dread - d3/dc0/d2e/d75/d76/fde zero size 2024-04-26T21:08:30.408 INFO:tasks.workunit.client.0.smithi055.stdout:8/815: write d3/d77/da9/fda [489004,90738] 0 2024-04-26T21:08:30.412 INFO:tasks.workunit.client.0.smithi055.stdout:5/820: dwrite d4/df/d13/d26/f31 [0,4194304] 0 2024-04-26T21:08:30.418 INFO:tasks.workunit.client.0.smithi055.stdout:5/821: link d4/df/dae/dce/d4a/d3f/d4f/d53/d90/cd5 d4/df/dae/dce/d4a/d3f/d4f/d53/d90/dbd/c119 0 2024-04-26T21:08:30.418 INFO:tasks.workunit.client.0.smithi055.stdout:5/822: chown d4/df/dae/dce/dc0 0 1 2024-04-26T21:08:30.418 INFO:tasks.workunit.client.0.smithi055.stdout:5/823: getdents d4/df/dae/dce/dc0/de2/d118 0 2024-04-26T21:08:30.420 INFO:tasks.workunit.client.0.smithi055.stdout:5/824: symlink d4/df/dae/dce/d5b/d83/dda/l11a 0 2024-04-26T21:08:30.422 INFO:tasks.workunit.client.0.smithi055.stdout:5/825: mknod d4/df/d13/d26/d63/c11b 0 2024-04-26T21:08:30.424 INFO:tasks.workunit.client.0.smithi055.stdout:5/826: mknod d4/df/dae/dce/d4a/d3f/d4f/c11c 0 2024-04-26T21:08:30.424 INFO:tasks.workunit.client.0.smithi055.stdout:5/827: readlink d4/df/dae/dce/d5b/ld0 0 2024-04-26T21:08:30.424 INFO:tasks.workunit.client.0.smithi055.stdout:5/828: chown d4/df/d13/d26/f32 96504956 1 2024-04-26T21:08:30.427 INFO:tasks.workunit.client.0.smithi055.stdout:5/829: rename d4/df/dae/dce/d93/dcb/fb8 to d4/df/d13/f11d 0 2024-04-26T21:08:30.431 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:30 smithi055 ceph-mon[25475]: pgmap v5: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:30.484 INFO:tasks.workunit.client.0.smithi055.stdout:8/816: dwrite d3/d9/d1d/d48/f10d [0,4194304] 0 2024-04-26T21:08:30.492 INFO:tasks.workunit.client.0.smithi055.stdout:8/817: creat d3/d77/dd5/d10a/f10e x:0 0 0 2024-04-26T21:08:30.506 INFO:tasks.workunit.client.0.smithi055.stdout:4/861: dwrite d4/d26/d42/dbb/dde/de3/fef [0,4194304] 0 2024-04-26T21:08:30.511 INFO:tasks.workunit.client.0.smithi055.stdout:4/862: link d4/d18/f55 d4/d26/d42/dbb/dde/d49/dae/f11a 0 2024-04-26T21:08:30.512 INFO:tasks.workunit.client.0.smithi055.stdout:4/863: write d4/d26/d42/dbb/de8/f112 [408626,113306] 0 2024-04-26T21:08:30.513 INFO:tasks.workunit.client.0.smithi055.stdout:5/830: dwrite d4/f8 [0,4194304] 0 2024-04-26T21:08:30.518 INFO:tasks.workunit.client.0.smithi055.stdout:4/864: mknod d4/d12/d17/d3d/c11b 0 2024-04-26T21:08:30.518 INFO:tasks.workunit.client.0.smithi055.stdout:4/865: fsync d4/d26/d42/d2d/f3a 0 2024-04-26T21:08:30.521 INFO:tasks.workunit.client.0.smithi055.stdout:5/831: link d4/df/dae/dce/d4a/l4b d4/df/dae/dce/d4a/d3f/d5c/db9/l11e 0 2024-04-26T21:08:30.527 INFO:tasks.workunit.client.0.smithi055.stdout:4/866: mkdir d4/d26/d42/d28/d53/dfe/dff/d11c 0 2024-04-26T21:08:30.527 INFO:tasks.workunit.client.0.smithi055.stdout:4/867: fsync d4/d26/d42/dbb/dde/f37 0 2024-04-26T21:08:30.528 INFO:tasks.workunit.client.0.smithi055.stdout:5/832: mkdir d4/df/d13/d11f 0 2024-04-26T21:08:30.528 INFO:tasks.workunit.client.0.smithi055.stdout:4/868: mkdir d4/d26/d42/d28/d53/d11d 0 2024-04-26T21:08:30.531 INFO:tasks.workunit.client.0.smithi055.stdout:4/869: mknod d4/d12/d61/c11e 0 2024-04-26T21:08:30.535 INFO:tasks.workunit.client.0.smithi055.stdout:4/870: creat d4/d12/d10f/f11f x:0 0 0 2024-04-26T21:08:30.541 INFO:tasks.workunit.client.0.smithi055.stdout:4/871: rmdir d4/d26/d42/dbb/d101 39 2024-04-26T21:08:30.551 INFO:tasks.workunit.client.0.smithi055.stdout:5/833: write d4/df/dae/dce/f3e [962429,15385] 0 2024-04-26T21:08:30.557 INFO:tasks.workunit.client.0.smithi055.stdout:4/872: dread d4/d26/d42/d28/d53/d71/d7f/f9d [0,4194304] 0 2024-04-26T21:08:30.561 INFO:tasks.workunit.client.0.smithi055.stdout:5/834: link d4/df/d13/d26/f58 d4/df/dae/dce/d93/dc4/f120 0 2024-04-26T21:08:30.561 INFO:tasks.workunit.client.0.smithi055.stdout:5/835: stat d4/df/dae/dce/d4a/d3f/d4f/d53/d87 0 2024-04-26T21:08:30.561 INFO:tasks.workunit.client.0.smithi055.stdout:4/873: read d4/d26/d42/dbb/dde/d49/dae/fed [104908,22689] 0 2024-04-26T21:08:30.588 INFO:tasks.workunit.client.0.smithi055.stdout:9/970: sync 2024-04-26T21:08:30.608 INFO:tasks.workunit.client.0.smithi055.stdout:9/971: chown d2/d46/d77/l4c 81879339 1 2024-04-26T21:08:30.611 INFO:tasks.workunit.client.0.smithi055.stdout:9/972: symlink d2/d46/d51/l14b 0 2024-04-26T21:08:30.615 INFO:tasks.workunit.client.0.smithi055.stdout:9/973: write d2/d46/d77/d79/de0/f123 [4272528,43498] 0 2024-04-26T21:08:30.630 INFO:tasks.workunit.client.0.smithi055.stdout:4/874: dwrite d4/d26/d42/dbb/dde/d49/f9a [0,4194304] 0 2024-04-26T21:08:30.631 INFO:tasks.workunit.client.0.smithi055.stdout:9/974: rename d2/d46/d9a/d105/db8/dc5/l10c to d2/d46/d77/d7d/da0/l14c 0 2024-04-26T21:08:30.634 INFO:tasks.workunit.client.0.smithi055.stdout:4/875: symlink d4/d18/d86/da6/l120 0 2024-04-26T21:08:30.636 INFO:tasks.workunit.client.0.smithi055.stdout:9/975: stat d2/d46/d9a/da7/l148 0 2024-04-26T21:08:30.636 INFO:tasks.workunit.client.0.smithi055.stdout:5/836: dwrite d4/df/d13/d26/d63/fc3 [0,4194304] 0 2024-04-26T21:08:30.639 INFO:tasks.workunit.client.0.smithi055.stdout:4/876: symlink d4/d12/d61/l121 0 2024-04-26T21:08:30.639 INFO:tasks.workunit.client.0.smithi055.stdout:4/877: write d4/d26/d42/dbb/dde/f54 [420163,112868] 0 2024-04-26T21:08:30.639 INFO:tasks.workunit.client.0.smithi055.stdout:4/878: chown d4/d18/d8e/fb3 18104 1 2024-04-26T21:08:30.644 INFO:tasks.workunit.client.0.smithi055.stdout:9/976: creat d2/d11/df5/f14d x:0 0 0 2024-04-26T21:08:30.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/818: dwrite d3/d9/d44/f67 [0,4194304] 0 2024-04-26T21:08:30.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/819: fdatasync d3/d9/d1d/d48/d57/d61/d9b/fd4 0 2024-04-26T21:08:30.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/820: fsync d3/d9/d44/f67 0 2024-04-26T21:08:30.658 INFO:tasks.workunit.client.0.smithi055.stdout:5/837: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/f121 x:0 0 0 2024-04-26T21:08:30.658 INFO:tasks.workunit.client.0.smithi055.stdout:4/879: rename d4/d26/d42/dbb/dde/de3 to d4/d26/d42/dbb/dde/d49/dae/d122 0 2024-04-26T21:08:30.658 INFO:tasks.workunit.client.0.smithi055.stdout:4/880: write d4/d26/d42/d28/d53/d71/d7f/f9d [2010695,117125] 0 2024-04-26T21:08:30.664 INFO:tasks.workunit.client.0.smithi055.stdout:8/821: unlink d3/d9/c1c 0 2024-04-26T21:08:30.664 INFO:tasks.workunit.client.0.smithi055.stdout:8/822: getdents d3/d9/d1d/db9 0 2024-04-26T21:08:30.668 INFO:tasks.workunit.client.0.smithi055.stdout:4/881: creat d4/d26/d42/d28/d53/dfe/dff/d11c/f123 x:0 0 0 2024-04-26T21:08:30.669 INFO:tasks.workunit.client.0.smithi055.stdout:4/882: fdatasync d4/d26/d42/dbb/dde/d49/dae/d122/fef 0 2024-04-26T21:08:30.669 INFO:tasks.workunit.client.0.smithi055.stdout:4/883: fdatasync d4/d26/d42/d28/d53/fe0 0 2024-04-26T21:08:30.669 INFO:tasks.workunit.client.0.smithi055.stdout:5/838: dread d4/df/d13/f11d [0,4194304] 0 2024-04-26T21:08:30.684 INFO:tasks.workunit.client.0.smithi055.stdout:5/839: dread d4/f4d [0,4194304] 0 2024-04-26T21:08:30.684 INFO:tasks.workunit.client.0.smithi055.stdout:5/840: readlink d4/df/dae/dce/d93/dcb/l100 0 2024-04-26T21:08:30.706 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:30 smithi064 ceph-mon[33404]: pgmap v5: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:30.734 INFO:tasks.workunit.client.0.smithi055.stdout:8/823: dwrite d3/d77/fe5 [0,4194304] 0 2024-04-26T21:08:30.741 INFO:tasks.workunit.client.0.smithi055.stdout:4/884: dwrite d4/d26/d42/d2d/f4f [0,4194304] 0 2024-04-26T21:08:30.758 INFO:tasks.workunit.client.0.smithi055.stdout:4/885: creat d4/d12/d61/d93/f124 x:0 0 0 2024-04-26T21:08:30.762 INFO:tasks.workunit.client.0.smithi055.stdout:4/886: symlink d4/d12/d17/l125 0 2024-04-26T21:08:30.767 INFO:tasks.workunit.client.0.smithi055.stdout:4/887: symlink d4/d26/d42/d28/d53/d71/d7f/d105/l126 0 2024-04-26T21:08:30.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/888: truncate d4/d26/d42/dbb/f9b 4151404 0 2024-04-26T21:08:30.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/889: chown d4/d26/d42/d2d/f3a 5631 1 2024-04-26T21:08:30.771 INFO:tasks.workunit.client.0.smithi055.stdout:5/841: dwrite d4/df/dae/dce/d93/dcb/f116 [0,4194304] 0 2024-04-26T21:08:30.771 INFO:tasks.workunit.client.0.smithi055.stdout:4/890: link d4/d12/d10f/d10c/l2a d4/d26/d42/dbb/dde/d49/dae/dc0/l127 0 2024-04-26T21:08:30.777 INFO:tasks.workunit.client.0.smithi055.stdout:5/842: creat d4/df/dae/f122 x:0 0 0 2024-04-26T21:08:30.785 INFO:tasks.workunit.client.0.smithi055.stdout:5/843: symlink d4/df/dae/dce/d93/dcb/l123 0 2024-04-26T21:08:30.785 INFO:tasks.workunit.client.0.smithi055.stdout:5/844: dread - d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ff6 zero size 2024-04-26T21:08:30.785 INFO:tasks.workunit.client.0.smithi055.stdout:5/845: chown d4/df/dae/dce/d4a/d3f/d5c/l7f 34347219 1 2024-04-26T21:08:30.785 INFO:tasks.workunit.client.0.smithi055.stdout:5/846: read - d4/df/d13/d26/f109 zero size 2024-04-26T21:08:30.818 INFO:tasks.workunit.client.0.smithi055.stdout:8/824: dwrite d3/dc0/f86 [0,4194304] 0 2024-04-26T21:08:30.837 INFO:tasks.workunit.client.0.smithi055.stdout:4/891: dwrite d4/d26/d42/dbb/dde/ffd [0,4194304] 0 2024-04-26T21:08:30.844 INFO:tasks.workunit.client.0.smithi055.stdout:4/892: rename d4/d12/d10f/d10c/lb0 to d4/d26/d42/d28/d53/dfe/l128 0 2024-04-26T21:08:30.844 INFO:tasks.workunit.client.0.smithi055.stdout:4/893: write d4/d26/d42/d56/f107 [1003378,77172] 0 2024-04-26T21:08:30.845 INFO:tasks.workunit.client.0.smithi055.stdout:4/894: chown d4/d18/d8e/d9e/fa0 17634 1 2024-04-26T21:08:30.850 INFO:tasks.workunit.client.0.smithi055.stdout:4/895: dread d4/d12/d17/f62 [0,4194304] 0 2024-04-26T21:08:30.856 INFO:tasks.workunit.client.0.smithi055.stdout:5/847: dwrite d4/df/dae/dce/d93/dc4/ff7 [0,4194304] 0 2024-04-26T21:08:30.869 INFO:tasks.workunit.client.0.smithi055.stdout:4/896: dread d4/d26/d42/dbb/dde/f37 [0,4194304] 0 2024-04-26T21:08:30.878 INFO:tasks.workunit.client.0.smithi055.stdout:5/848: read d4/df/dae/dce/d4a/d3f/d4f/f77 [5095803,128667] 0 2024-04-26T21:08:30.878 INFO:tasks.workunit.client.0.smithi055.stdout:5/849: creat d4/df/dae/dce/d4a/d3f/d5c/db9/f124 x:0 0 0 2024-04-26T21:08:30.906 INFO:tasks.workunit.client.0.smithi055.stdout:4/897: dread d4/d26/d42/d28/d53/d71/fb4 [4194304,4194304] 0 2024-04-26T21:08:30.908 INFO:tasks.workunit.client.0.smithi055.stdout:4/898: creat d4/d26/d42/dbb/dde/d49/f129 x:0 0 0 2024-04-26T21:08:30.908 INFO:tasks.workunit.client.0.smithi055.stdout:4/899: fsync d4/d12/d61/f95 0 2024-04-26T21:08:30.910 INFO:tasks.workunit.client.0.smithi055.stdout:4/900: mkdir d4/d26/d42/d28/db9/d12a 0 2024-04-26T21:08:30.910 INFO:tasks.workunit.client.0.smithi055.stdout:4/901: write d4/d26/d42/d28/db9/fe7 [1021804,82290] 0 2024-04-26T21:08:30.913 INFO:tasks.workunit.client.0.smithi055.stdout:4/902: link d4/d12/d17/d3d/l4e d4/d26/d42/d28/db9/l12b 0 2024-04-26T21:08:30.913 INFO:tasks.workunit.client.0.smithi055.stdout:4/903: readlink d4/d26/d42/d28/d53/d71/l91 0 2024-04-26T21:08:30.918 INFO:tasks.workunit.client.0.smithi055.stdout:5/850: dwrite d4/df/f3b [0,4194304] 0 2024-04-26T21:08:30.919 INFO:tasks.workunit.client.0.smithi055.stdout:5/851: mkdir d4/df/dae/dce/d93/d125 0 2024-04-26T21:08:30.921 INFO:tasks.workunit.client.0.smithi055.stdout:5/852: unlink d4/df/dae/dce/d4a/d3f/d5c/lac 0 2024-04-26T21:08:30.921 INFO:tasks.workunit.client.0.smithi055.stdout:5/853: creat d4/df/dae/dce/d93/dcb/f126 x:0 0 0 2024-04-26T21:08:30.956 INFO:tasks.workunit.client.0.smithi055.stdout:5/854: dread d4/df/dae/dce/d5b/f70 [0,4194304] 0 2024-04-26T21:08:30.958 INFO:tasks.workunit.client.0.smithi055.stdout:4/904: dwrite d4/d12/d10f/d10c/f79 [0,4194304] 0 2024-04-26T21:08:30.959 INFO:tasks.workunit.client.0.smithi055.stdout:5/855: mknod d4/df/d13/d11f/c127 0 2024-04-26T21:08:30.960 INFO:tasks.workunit.client.0.smithi055.stdout:5/856: fsync d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/f121 0 2024-04-26T21:08:30.961 INFO:tasks.workunit.client.0.smithi055.stdout:5/857: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/l128 0 2024-04-26T21:08:30.963 INFO:tasks.workunit.client.0.smithi055.stdout:5/858: symlink d4/df/dae/dce/dc0/l129 0 2024-04-26T21:08:30.963 INFO:tasks.workunit.client.0.smithi055.stdout:5/859: chown d4/df/dae/dce/d4a/d3f/fdb 7305 1 2024-04-26T21:08:30.964 INFO:tasks.workunit.client.0.smithi055.stdout:5/860: mknod d4/df/dae/dce/d93/dcb/c12a 0 2024-04-26T21:08:30.965 INFO:tasks.workunit.client.0.smithi055.stdout:5/861: stat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/lf2 0 2024-04-26T21:08:30.968 INFO:tasks.workunit.client.0.smithi055.stdout:5/862: mkdir d4/df/dae/dce/d4a/d3f/d2e/d82/d12b 0 2024-04-26T21:08:30.973 INFO:tasks.workunit.client.0.smithi055.stdout:4/905: dread d4/f66 [0,4194304] 0 2024-04-26T21:08:30.978 INFO:tasks.workunit.client.0.smithi055.stdout:4/906: unlink d4/d12/d61/d93/f124 0 2024-04-26T21:08:30.981 INFO:tasks.workunit.client.0.smithi055.stdout:4/907: rmdir d4/d26/d42/d28/d53/dfe/dff/d11c 39 2024-04-26T21:08:30.985 INFO:tasks.workunit.client.0.smithi055.stdout:5/863: write d4/df/dae/dce/d93/dc4/f120 [4116526,89329] 0 2024-04-26T21:08:30.986 INFO:tasks.workunit.client.0.smithi055.stdout:5/864: creat d4/df/dae/dce/d93/dcb/f12c x:0 0 0 2024-04-26T21:08:30.989 INFO:tasks.workunit.client.0.smithi055.stdout:5/865: creat d4/df/dae/f12d x:0 0 0 2024-04-26T21:08:30.989 INFO:tasks.workunit.client.0.smithi055.stdout:5/866: getdents d4/df/dae/dce/d4a/d3f/dfa 0 2024-04-26T21:08:31.012 INFO:tasks.workunit.client.0.smithi055.stdout:9/977: sync 2024-04-26T21:08:31.013 INFO:tasks.workunit.client.0.smithi055.stdout:9/978: getdents d2/d46/d77/d5f 0 2024-04-26T21:08:31.020 INFO:tasks.workunit.client.0.smithi055.stdout:9/979: write d2/d46/d9a/d105/fc1 [57590,35517] 0 2024-04-26T21:08:31.020 INFO:tasks.workunit.client.0.smithi055.stdout:9/980: write d2/d46/d77/d7d/f136 [235014,89959] 0 2024-04-26T21:08:31.052 INFO:tasks.workunit.client.0.smithi055.stdout:5/867: dwrite d4/df/dae/dce/d4a/d3f/d5c/db9/ff3 [0,4194304] 0 2024-04-26T21:08:31.055 INFO:tasks.workunit.client.0.smithi055.stdout:5/868: mknod d4/df/dae/dce/d93/dcb/db4/c12e 0 2024-04-26T21:08:31.055 INFO:tasks.workunit.client.0.smithi055.stdout:5/869: truncate d4/df/dae/dce/d4a/d3f/d2e/fbb 298691 0 2024-04-26T21:08:31.059 INFO:tasks.workunit.client.0.smithi055.stdout:4/908: dwrite d4/d12/f5e [0,4194304] 0 2024-04-26T21:08:31.062 INFO:tasks.workunit.client.0.smithi055.stdout:4/909: mkdir d4/d26/d42/d12c 0 2024-04-26T21:08:31.064 INFO:tasks.workunit.client.0.smithi055.stdout:4/910: creat d4/d26/d42/d28/d53/d70/dc9/f12d x:0 0 0 2024-04-26T21:08:31.064 INFO:tasks.workunit.client.0.smithi055.stdout:4/911: write d4/d26/d42/d28/d53/d71/d7f/fd5 [983654,48997] 0 2024-04-26T21:08:31.064 INFO:tasks.workunit.client.0.smithi055.stdout:4/912: chown d4/d26/d42/dbb 353 1 2024-04-26T21:08:31.106 INFO:tasks.workunit.client.0.smithi055.stdout:5/870: dwrite d4/df/dae/dce/d4a/f5e [0,4194304] 0 2024-04-26T21:08:31.108 INFO:tasks.workunit.client.0.smithi055.stdout:5/871: rename d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/ff6 to d4/df/d13/d26/d63/f12f 0 2024-04-26T21:08:31.185 INFO:tasks.workunit.client.0.smithi055.stdout:5/872: dwrite d4/df/dae/dce/d4a/d3f/f2c [0,4194304] 0 2024-04-26T21:08:31.187 INFO:tasks.workunit.client.0.smithi055.stdout:5/873: mknod d4/df/dae/dce/d4a/d3f/d4f/c130 0 2024-04-26T21:08:31.189 INFO:tasks.workunit.client.0.smithi055.stdout:5/874: mknod d4/df/dae/dce/d4a/d3f/d2e/dcd/c131 0 2024-04-26T21:08:31.189 INFO:tasks.workunit.client.0.smithi055.stdout:5/875: readlink d4/df/dae/dce/d5b/le8 0 2024-04-26T21:08:31.253 INFO:tasks.workunit.client.0.smithi055.stdout:5/876: dwrite d4/df/dae/dce/d93/dcb/f116 [0,4194304] 0 2024-04-26T21:08:31.255 INFO:tasks.workunit.client.0.smithi055.stdout:5/877: unlink d4/df/dae/dce/d93/dcb/l123 0 2024-04-26T21:08:31.259 INFO:tasks.workunit.client.0.smithi055.stdout:8/825: sync 2024-04-26T21:08:31.262 INFO:tasks.workunit.client.0.smithi055.stdout:8/826: link d3/d9/c22 d3/dc0/d2e/c10f 0 2024-04-26T21:08:31.262 INFO:tasks.workunit.client.0.smithi055.stdout:8/827: fdatasync d3/d9/f8e 0 2024-04-26T21:08:31.278 INFO:tasks.workunit.client.0.smithi055.stdout:8/828: dread d3/dc0/d2e/f62 [4194304,4194304] 0 2024-04-26T21:08:31.280 INFO:tasks.workunit.client.0.smithi055.stdout:8/829: mkdir d3/d9/d1d/d48/d100/d110 0 2024-04-26T21:08:31.281 INFO:tasks.workunit.client.0.smithi055.stdout:8/830: mknod d3/d9/d5b/da4/c111 0 2024-04-26T21:08:31.284 INFO:tasks.workunit.client.0.smithi055.stdout:8/831: truncate d3/d9/f24 3338570 0 2024-04-26T21:08:31.287 INFO:tasks.workunit.client.0.smithi055.stdout:9/981: sync 2024-04-26T21:08:31.287 INFO:tasks.workunit.client.0.smithi055.stdout:4/913: sync 2024-04-26T21:08:31.288 INFO:tasks.workunit.client.0.smithi055.stdout:9/982: mknod d2/d11/df5/dfe/c14e 0 2024-04-26T21:08:31.335 INFO:tasks.workunit.client.0.smithi055.stdout:5/878: dwrite d4/df/dae/dce/d5b/d83/fa7 [0,4194304] 0 2024-04-26T21:08:31.336 INFO:tasks.workunit.client.0.smithi055.stdout:4/914: dread d4/d12/d10f/d10c/f79 [0,4194304] 0 2024-04-26T21:08:31.336 INFO:tasks.workunit.client.0.smithi055.stdout:4/915: chown d4/d26/d42/d28/d53/d71/l80 1316536 1 2024-04-26T21:08:31.337 INFO:tasks.workunit.client.0.smithi055.stdout:5/879: mknod d4/df/dae/dce/dc0/de2/c132 0 2024-04-26T21:08:31.337 INFO:tasks.workunit.client.0.smithi055.stdout:4/916: mknod d4/d26/d42/d28/d53/d71/c12e 0 2024-04-26T21:08:31.338 INFO:tasks.workunit.client.0.smithi055.stdout:4/917: chown d4/d26/d42/d28/d53/d70/dc9 2 1 2024-04-26T21:08:31.338 INFO:tasks.workunit.client.0.smithi055.stdout:4/918: write d4/fc4 [4437180,17530] 0 2024-04-26T21:08:31.349 INFO:tasks.workunit.client.0.smithi055.stdout:9/983: dwrite d2/d46/d9a/d105/fc1 [0,4194304] 0 2024-04-26T21:08:31.352 INFO:tasks.workunit.client.0.smithi055.stdout:8/832: dwrite d3/d9/fbd [0,4194304] 0 2024-04-26T21:08:31.356 INFO:tasks.workunit.client.0.smithi055.stdout:9/984: unlink d2/d46/d9a/da7/c103 0 2024-04-26T21:08:31.356 INFO:tasks.workunit.client.0.smithi055.stdout:9/985: creat d2/d46/d51/f14f x:0 0 0 2024-04-26T21:08:31.362 INFO:tasks.workunit.client.0.smithi055.stdout:4/919: dread d4/d26/d42/d2d/f3a [0,4194304] 0 2024-04-26T21:08:31.362 INFO:tasks.workunit.client.0.smithi055.stdout:5/880: write d4/df/d13/d26/d63/fb6 [1191402,10718] 0 2024-04-26T21:08:31.362 INFO:tasks.workunit.client.0.smithi055.stdout:5/881: fdatasync d4/df/dae/dce/d4a/d3f/d2e/d82/ff1 0 2024-04-26T21:08:31.363 INFO:tasks.workunit.client.0.smithi055.stdout:5/882: readlink d4/df/dae/dce/d5b/d83/dda/l11a 0 2024-04-26T21:08:31.363 INFO:tasks.workunit.client.0.smithi055.stdout:5/883: readlink d4/df/l41 0 2024-04-26T21:08:31.365 INFO:tasks.workunit.client.0.smithi055.stdout:5/884: mkdir d4/d133 0 2024-04-26T21:08:31.365 INFO:tasks.workunit.client.0.smithi055.stdout:5/885: read - d4/df/dae/dce/d5b/d83/dda/ff8 zero size 2024-04-26T21:08:31.365 INFO:tasks.workunit.client.0.smithi055.stdout:5/886: chown d4/df/d13/d26/f8f 192814028 1 2024-04-26T21:08:31.367 INFO:tasks.workunit.client.0.smithi055.stdout:5/887: creat d4/df/dae/dce/d4a/d3f/f134 x:0 0 0 2024-04-26T21:08:31.368 INFO:tasks.workunit.client.0.smithi055.stdout:5/888: creat d4/df/dea/f135 x:0 0 0 2024-04-26T21:08:31.368 INFO:tasks.workunit.client.0.smithi055.stdout:5/889: fsync d4/df/d13/f81 0 2024-04-26T21:08:31.370 INFO:tasks.workunit.client.0.smithi055.stdout:8/833: write d3/dc0/f86 [2401525,76381] 0 2024-04-26T21:08:31.373 INFO:tasks.workunit.client.0.smithi055.stdout:5/890: getdents d4/df/dae/dce/d4a/d3f/d5c/db9 0 2024-04-26T21:08:31.375 INFO:tasks.workunit.client.0.smithi055.stdout:5/891: mkdir d4/df/dae/dce/d4a/d3f/d4f/d53/d136 0 2024-04-26T21:08:31.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/920: dread d4/d26/d42/dbb/dde/d49/fbe [0,4194304] 0 2024-04-26T21:08:31.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/921: write d4/d26/d42/d28/db9/fe7 [1528255,39340] 0 2024-04-26T21:08:31.391 INFO:tasks.workunit.client.0.smithi055.stdout:4/922: chown d4/d26/d42/d2d 259 1 2024-04-26T21:08:31.404 INFO:tasks.workunit.client.0.smithi055.stdout:8/834: write d3/dc0/d2e/d75/d76/f81 [139529,63884] 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:4/923: rename d4/ff to d4/d12/d10f/d10c/f12f 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:9/986: dwrite d2/f9e [0,4194304] 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:5/892: write d4/df/dae/dce/d93/dcb/f52 [1275064,112289] 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:8/835: creat d3/dc0/d2e/d75/d76/f112 x:0 0 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:5/893: dread d4/df/dae/dce/d4a/d3f/f46 [0,4194304] 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:5/894: unlink d4/df/d13/d26/d63/fc3 0 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:5/895: chown d4/f6 5 1 2024-04-26T21:08:31.440 INFO:tasks.workunit.client.0.smithi055.stdout:8/836: dread d3/d9/d44/f98 [0,4194304] 0 2024-04-26T21:08:31.445 INFO:tasks.workunit.client.0.smithi055.stdout:8/837: creat d3/d9/d1d/d48/d80/dce/f113 x:0 0 0 2024-04-26T21:08:31.445 INFO:tasks.workunit.client.0.smithi055.stdout:8/838: fdatasync d3/d89/daa/fe2 0 2024-04-26T21:08:31.458 INFO:tasks.workunit.client.0.smithi055.stdout:8/839: dread d3/d9/d1d/d48/d4b/d8b/f93 [0,4194304] 0 2024-04-26T21:08:31.461 INFO:tasks.workunit.client.0.smithi055.stdout:8/840: creat d3/d9/d1d/f114 x:0 0 0 2024-04-26T21:08:31.462 INFO:tasks.workunit.client.0.smithi055.stdout:8/841: dread - d3/d89/f94 zero size 2024-04-26T21:08:31.462 INFO:tasks.workunit.client.0.smithi055.stdout:8/842: chown d3/dc0/d2e/db3/fef 726 1 2024-04-26T21:08:31.465 INFO:tasks.workunit.client.0.smithi055.stdout:8/843: rename d3/dc0/d2e/d75/d76/ca3 to d3/d89/c115 0 2024-04-26T21:08:31.465 INFO:tasks.workunit.client.0.smithi055.stdout:8/844: write d3/dc0/d2e/db3/fea [4248140,103126] 0 2024-04-26T21:08:31.466 INFO:tasks.workunit.client.0.smithi055.stdout:8/845: creat d3/d9/d1d/f116 x:0 0 0 2024-04-26T21:08:31.468 INFO:tasks.workunit.client.0.smithi055.stdout:8/846: mknod d3/dc0/d2e/db3/c117 0 2024-04-26T21:08:31.472 INFO:tasks.workunit.client.0.smithi055.stdout:8/847: creat d3/d9/d1d/d48/d100/d110/f118 x:0 0 0 2024-04-26T21:08:31.472 INFO:tasks.workunit.client.0.smithi055.stdout:4/924: dwrite d4/d12/d17/d3d/fd2 [0,4194304] 0 2024-04-26T21:08:31.473 INFO:tasks.workunit.client.0.smithi055.stdout:8/848: rmdir d3/d9/d1d/d48/d4b 39 2024-04-26T21:08:31.473 INFO:tasks.workunit.client.0.smithi055.stdout:8/849: write d3/d9/d44/f98 [4486470,9221] 0 2024-04-26T21:08:31.477 INFO:tasks.workunit.client.0.smithi055.stdout:4/925: rmdir d4/d18/d8e/d9e 39 2024-04-26T21:08:31.479 INFO:tasks.workunit.client.0.smithi055.stdout:4/926: mknod d4/d26/d42/dbb/dde/d49/df2/c130 0 2024-04-26T21:08:31.496 INFO:tasks.workunit.client.0.smithi055.stdout:5/896: dread d4/df/f3b [0,4194304] 0 2024-04-26T21:08:31.496 INFO:tasks.workunit.client.0.smithi055.stdout:8/850: dread d3/d77/f78 [0,4194304] 0 2024-04-26T21:08:31.496 INFO:tasks.workunit.client.0.smithi055.stdout:8/851: read - d3/d9/d1d/d48/d80/fe9 zero size 2024-04-26T21:08:31.496 INFO:tasks.workunit.client.0.smithi055.stdout:4/927: dread d4/d18/d8e/d9e/fb1 [0,4194304] 0 2024-04-26T21:08:31.497 INFO:tasks.workunit.client.0.smithi055.stdout:8/852: mkdir d3/dc0/d119 0 2024-04-26T21:08:31.503 INFO:tasks.workunit.client.0.smithi055.stdout:8/853: link d3/d9/d44/fb8 d3/d9/d5b/da4/f11a 0 2024-04-26T21:08:31.506 INFO:tasks.workunit.client.0.smithi055.stdout:9/987: dwrite d2/fc8 [0,4194304] 0 2024-04-26T21:08:31.509 INFO:tasks.workunit.client.0.smithi055.stdout:8/854: mkdir d3/d9/d1d/d48/d100/d11b 0 2024-04-26T21:08:31.517 INFO:tasks.workunit.client.0.smithi055.stdout:9/988: creat d2/d46/d9a/d105/db8/d111/f150 x:0 0 0 2024-04-26T21:08:31.533 INFO:tasks.workunit.client.0.smithi055.stdout:9/989: getdents d2/d11/df5/df9 0 2024-04-26T21:08:31.535 INFO:tasks.workunit.client.0.smithi055.stdout:9/990: mkdir d2/d46/d77/d7d/d94/d151 0 2024-04-26T21:08:31.540 INFO:tasks.workunit.client.0.smithi055.stdout:9/991: mknod d2/d46/d77/d7d/da0/c152 0 2024-04-26T21:08:31.541 INFO:tasks.workunit.client.0.smithi055.stdout:9/992: creat d2/d11/df5/dfe/f153 x:0 0 0 2024-04-26T21:08:31.555 INFO:tasks.workunit.client.0.smithi055.stdout:5/897: dread d4/df/dae/dce/d5b/d83/fba [4194304,4194304] 0 2024-04-26T21:08:31.583 INFO:tasks.workunit.client.0.smithi055.stdout:8/855: dwrite d3/d9/d5b/da4/f11a [0,4194304] 0 2024-04-26T21:08:31.591 INFO:tasks.workunit.client.0.smithi055.stdout:8/856: link d3/d77/l83 d3/d9/d5b/da4/l11c 0 2024-04-26T21:08:31.591 INFO:tasks.workunit.client.0.smithi055.stdout:5/898: dread d4/df/dae/dce/d4a/f5e [0,4194304] 0 2024-04-26T21:08:31.599 INFO:tasks.workunit.client.0.smithi055.stdout:9/993: dwrite d2/d46/d77/f76 [4194304,4194304] 0 2024-04-26T21:08:31.607 INFO:tasks.workunit.client.0.smithi055.stdout:5/899: link d4/df/dae/dce/d4a/d3f/d2e/dcd/f10c d4/df/d13/d26/d63/f137 0 2024-04-26T21:08:31.608 INFO:tasks.workunit.client.0.smithi055.stdout:9/994: rename d2/d46/c91 to d2/d46/d77/d5f/c154 0 2024-04-26T21:08:31.645 INFO:tasks.workunit.client.0.smithi055.stdout:9/995: dread d2/d46/f48 [0,4194304] 0 2024-04-26T21:08:31.650 INFO:tasks.workunit.client.0.smithi055.stdout:9/996: creat d2/d46/d9a/d105/db8/f155 x:0 0 0 2024-04-26T21:08:31.656 INFO:tasks.workunit.client.0.smithi055.stdout:9/997: symlink d2/d46/d9a/d105/db8/l156 0 2024-04-26T21:08:31.666 INFO:tasks.workunit.client.0.smithi055.stdout:9/998: symlink d2/d46/d77/d79/de0/l157 0 2024-04-26T21:08:31.667 INFO:tasks.workunit.client.0.smithi055.stdout:9/999: write d2/f1e [1129115,49556] 0 2024-04-26T21:08:31.714 INFO:tasks.workunit.client.0.smithi055.stdout:5/900: dwrite d4/df/dae/dce/d93/dcb/f52 [0,4194304] 0 2024-04-26T21:08:31.714 INFO:tasks.workunit.client.0.smithi055.stdout:5/901: write d4/df/f30 [1611295,74570] 0 2024-04-26T21:08:31.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/902: write d4/df/f3b [631747,15827] 0 2024-04-26T21:08:31.728 INFO:tasks.workunit.client.0.smithi055.stdout:5/903: chown d4/df/dae/dce/d4a/d3f/c107 0 1 2024-04-26T21:08:31.730 INFO:tasks.workunit.client.0.smithi055.stdout:5/904: creat d4/df/dae/dce/d4a/d3f/d2e/f138 x:0 0 0 2024-04-26T21:08:31.742 INFO:tasks.workunit.client.0.smithi055.stdout:4/928: sync 2024-04-26T21:08:31.742 INFO:tasks.workunit.client.0.smithi055.stdout:4/929: dread - d4/d26/d42/fe4 zero size 2024-04-26T21:08:31.742 INFO:tasks.workunit.client.0.smithi055.stdout:4/930: chown d4/d12/d17/c2e 1207456 1 2024-04-26T21:08:31.742 INFO:tasks.workunit.client.0.smithi055.stdout:4/931: creat d4/f131 x:0 0 0 2024-04-26T21:08:31.749 INFO:tasks.workunit.client.0.smithi055.stdout:5/905: dread d4/df/d13/d26/d63/fb6 [0,4194304] 0 2024-04-26T21:08:31.752 INFO:tasks.workunit.client.0.smithi055.stdout:5/906: rename d4/df/dae/dce/d4a/d3f/d4f/d53/d90/lc6 to d4/df/dae/dce/d4a/d3f/d4f/d53/d87/l139 0 2024-04-26T21:08:31.769 INFO:tasks.workunit.client.0.smithi055.stdout:8/857: dwrite d3/d9/d1d/d48/d4b/fb4 [0,4194304] 0 2024-04-26T21:08:31.773 INFO:tasks.workunit.client.0.smithi055.stdout:5/907: dread d4/df/dae/dce/d4a/d3f/d2e/f54 [0,4194304] 0 2024-04-26T21:08:31.776 INFO:tasks.workunit.client.0.smithi055.stdout:5/908: read d4/df/dae/dce/d4a/d3f/d2e/d82/fed [353484,58912] 0 2024-04-26T21:08:31.776 INFO:tasks.workunit.client.0.smithi055.stdout:5/909: fsync d4/df/d13/d26/f8f 0 2024-04-26T21:08:31.786 INFO:tasks.workunit.client.0.smithi055.stdout:8/858: write d3/d9/d1d/f35 [2960991,37859] 0 2024-04-26T21:08:31.792 INFO:tasks.workunit.client.0.smithi055.stdout:8/859: mkdir d3/d77/d102/d11d 0 2024-04-26T21:08:31.792 INFO:tasks.workunit.client.0.smithi055.stdout:8/860: chown d3/d7c/d9a/lc9 0 1 2024-04-26T21:08:31.799 INFO:tasks.workunit.client.0.smithi055.stdout:5/910: read d4/df/dae/dce/d93/dc4/ff7 [3793059,103590] 0 2024-04-26T21:08:31.800 INFO:tasks.workunit.client.0.smithi055.stdout:5/911: truncate d4/df/dae/dce/d4a/d3f/d2e/fbb 693272 0 2024-04-26T21:08:31.802 INFO:tasks.workunit.client.0.smithi055.stdout:5/912: rename d4/df/dae/dce/d4a/d3f/d4f/d53/d136 to d4/df/dae/dce/d4a/d3f/dfa/d13a 0 2024-04-26T21:08:31.802 INFO:tasks.workunit.client.0.smithi055.stdout:5/913: read - d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fde zero size 2024-04-26T21:08:31.806 INFO:tasks.workunit.client.0.smithi055.stdout:5/914: creat d4/df/dae/dce/d4a/d3f/d4f/f13b x:0 0 0 2024-04-26T21:08:31.806 INFO:tasks.workunit.client.0.smithi055.stdout:5/915: dread - d4/df/dae/dce/d4a/d3f/d2e/d82/ff1 zero size 2024-04-26T21:08:31.808 INFO:tasks.workunit.client.0.smithi055.stdout:5/916: mkdir d4/df/dae/dce/d93/dcb/db4/d13c 0 2024-04-26T21:08:31.809 INFO:tasks.workunit.client.0.smithi055.stdout:5/917: mknod d4/df/dae/dce/d4a/d3f/d2e/d82/d12b/c13d 0 2024-04-26T21:08:31.812 INFO:tasks.workunit.client.0.smithi055.stdout:5/918: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/f13e x:0 0 0 2024-04-26T21:08:31.817 INFO:tasks.workunit.client.0.smithi055.stdout:5/919: write d4/df/dae/dce/d4a/fca [559121,12014] 0 2024-04-26T21:08:31.817 INFO:tasks.workunit.client.0.smithi055.stdout:5/920: fdatasync d4/df/dae/f12d 0 2024-04-26T21:08:31.817 INFO:tasks.workunit.client.0.smithi055.stdout:5/921: truncate d4/df/dae/dce/d4a/fca 1328912 0 2024-04-26T21:08:31.819 INFO:tasks.workunit.client.0.smithi055.stdout:5/922: unlink d4/df/dae/dce/d4a/d3f/f2c 0 2024-04-26T21:08:31.819 INFO:tasks.workunit.client.0.smithi055.stdout:5/923: readlink d4/l85 0 2024-04-26T21:08:31.820 INFO:tasks.workunit.client.0.smithi055.stdout:5/924: write d4/df/d13/d26/d63/fb6 [1368479,117684] 0 2024-04-26T21:08:31.820 INFO:tasks.workunit.client.0.smithi055.stdout:5/925: write d4/df/dae/dce/d4a/d92/fd1 [537165,28330] 0 2024-04-26T21:08:31.863 INFO:tasks.workunit.client.0.smithi055.stdout:8/861: dwrite d3/d9/d1d/f114 [0,4194304] 0 2024-04-26T21:08:31.866 INFO:tasks.workunit.client.0.smithi055.stdout:8/862: creat d3/d9/d5b/da4/dc5/f11e x:0 0 0 2024-04-26T21:08:31.866 INFO:tasks.workunit.client.0.smithi055.stdout:8/863: write d3/f18 [407555,12144] 0 2024-04-26T21:08:31.868 INFO:tasks.workunit.client.0.smithi055.stdout:8/864: mknod d3/dc0/d2e/d75/c11f 0 2024-04-26T21:08:31.872 INFO:tasks.workunit.client.0.smithi055.stdout:8/865: creat d3/d7c/d9a/f120 x:0 0 0 2024-04-26T21:08:31.872 INFO:tasks.workunit.client.0.smithi055.stdout:8/866: dread - d3/dc0/d2e/db3/ff7 zero size 2024-04-26T21:08:31.924 INFO:tasks.workunit.client.0.smithi055.stdout:8/867: dwrite d3/d9/d1d/d48/d80/fed [0,4194304] 0 2024-04-26T21:08:31.924 INFO:tasks.workunit.client.0.smithi055.stdout:8/868: creat d3/dc0/d2e/d75/d76/f121 x:0 0 0 2024-04-26T21:08:31.927 INFO:tasks.workunit.client.0.smithi055.stdout:8/869: link d3/c6 d3/dc0/d2e/da6/c122 0 2024-04-26T21:08:31.985 INFO:tasks.workunit.client.0.smithi055.stdout:8/870: dwrite d3/dc0/f32 [0,4194304] 0 2024-04-26T21:08:32.006 INFO:tasks.workunit.client.0.smithi055.stdout:8/871: write d3/dc0/d2e/db3/fea [3024378,110968] 0 2024-04-26T21:08:32.007 INFO:tasks.workunit.client.0.smithi055.stdout:8/872: mknod d3/d77/d102/d11d/c123 0 2024-04-26T21:08:32.010 INFO:tasks.workunit.client.0.smithi055.stdout:8/873: creat d3/d9/d1d/d48/d57/d61/f124 x:0 0 0 2024-04-26T21:08:32.010 INFO:tasks.workunit.client.0.smithi055.stdout:8/874: chown d3/f47 504 1 2024-04-26T21:08:32.010 INFO:tasks.workunit.client.0.smithi055.stdout:8/875: chown d3/dc0/c2f 14 1 2024-04-26T21:08:32.086 INFO:tasks.workunit.client.0.smithi055.stdout:8/876: dwrite d3/d77/fe5 [0,4194304] 0 2024-04-26T21:08:32.088 INFO:tasks.workunit.client.0.smithi055.stdout:8/877: unlink d3/d9/d1d/d48/f10d 0 2024-04-26T21:08:32.093 INFO:tasks.workunit.client.0.smithi055.stdout:8/878: getdents d3 0 2024-04-26T21:08:32.095 INFO:tasks.workunit.client.0.smithi055.stdout:8/879: mkdir d3/d9/d1d/d48/d100/d110/d125 0 2024-04-26T21:08:32.097 INFO:tasks.workunit.client.0.smithi055.stdout:8/880: stat d3/d9/d1d/d48/d57/d61/l88 0 2024-04-26T21:08:32.097 INFO:tasks.workunit.client.0.smithi055.stdout:8/881: dread - d3/d9/d1d/d48/d57/d61/f124 zero size 2024-04-26T21:08:32.098 INFO:tasks.workunit.client.0.smithi055.stdout:8/882: dread - d3/d7c/d9a/f120 zero size 2024-04-26T21:08:32.098 INFO:tasks.workunit.client.0.smithi055.stdout:8/883: write d3/dc0/d2e/d75/d76/fde [571441,68532] 0 2024-04-26T21:08:32.098 INFO:tasks.workunit.client.0.smithi055.stdout:8/884: write d3/d77/dd5/d10a/f10e [1622,92661] 0 2024-04-26T21:08:32.101 INFO:tasks.workunit.client.0.smithi055.stdout:8/885: unlink d3/d9/d1d/d48/d57/d61/lc4 0 2024-04-26T21:08:32.104 INFO:tasks.workunit.client.0.smithi055.stdout:8/886: link d3/d9/c19 d3/d9/d5b/c126 0 2024-04-26T21:08:32.105 INFO:tasks.workunit.client.0.smithi055.stdout:8/887: chown d3/dc0/d2e/d75/d76 55942 1 2024-04-26T21:08:32.105 INFO:tasks.workunit.client.0.smithi055.stdout:8/888: chown d3/d9/d1d/d48/d4b/l4e 74 1 2024-04-26T21:08:32.107 INFO:tasks.workunit.client.0.smithi055.stdout:8/889: mkdir d3/d9/d5b/da4/dc5/d127 0 2024-04-26T21:08:32.118 INFO:tasks.workunit.client.0.smithi055.stdout:8/890: dread d3/d9/d1d/d48/d57/d61/fa0 [0,4194304] 0 2024-04-26T21:08:32.119 INFO:tasks.workunit.client.0.smithi055.stdout:8/891: read - d3/dc0/d2e/db3/ff7 zero size 2024-04-26T21:08:32.139 INFO:tasks.workunit.client.0.smithi055.stdout:5/926: sync 2024-04-26T21:08:32.139 INFO:tasks.workunit.client.0.smithi055.stdout:4/932: sync 2024-04-26T21:08:32.139 INFO:tasks.workunit.client.0.smithi055.stdout:5/927: write d4/df/dae/dce/d93/dcb/fa5 [281893,81076] 0 2024-04-26T21:08:32.140 INFO:tasks.workunit.client.0.smithi055.stdout:8/892: write d3/d7c/faf [2999317,50865] 0 2024-04-26T21:08:32.140 INFO:tasks.workunit.client.0.smithi055.stdout:8/893: chown d3/d9/d1d/f25 445702 1 2024-04-26T21:08:32.143 INFO:tasks.workunit.client.0.smithi055.stdout:4/933: creat d4/d26/d42/d28/d53/dfe/f132 x:0 0 0 2024-04-26T21:08:32.145 INFO:tasks.workunit.client.0.smithi055.stdout:8/894: mknod d3/c128 0 2024-04-26T21:08:32.148 INFO:tasks.workunit.client.0.smithi055.stdout:4/934: symlink d4/l133 0 2024-04-26T21:08:32.149 INFO:tasks.workunit.client.0.smithi055.stdout:4/935: truncate d4/d18/d86/da6/ff8 375577 0 2024-04-26T21:08:32.149 INFO:tasks.workunit.client.0.smithi055.stdout:4/936: chown d4/d26/ccf 4082 1 2024-04-26T21:08:32.155 INFO:tasks.workunit.client.0.smithi055.stdout:8/895: getdents d3/d9/d44 0 2024-04-26T21:08:32.159 INFO:tasks.workunit.client.0.smithi055.stdout:8/896: symlink d3/dc0/d2e/d75/d76/d92/l129 0 2024-04-26T21:08:32.195 INFO:tasks.workunit.client.0.smithi055.stdout:5/928: dwrite d4/df/dae/dce/d4a/d3f/f134 [0,4194304] 0 2024-04-26T21:08:32.199 INFO:tasks.workunit.client.0.smithi055.stdout:5/929: unlink d4/df/d13/cb7 0 2024-04-26T21:08:32.199 INFO:tasks.workunit.client.0.smithi055.stdout:5/930: fdatasync d4/f9 0 2024-04-26T21:08:32.255 INFO:tasks.workunit.client.0.smithi055.stdout:8/897: dwrite d3/d9/d1d/f116 [0,4194304] 0 2024-04-26T21:08:32.255 INFO:tasks.workunit.client.0.smithi055.stdout:8/898: write d3/d9/d1d/d48/d100/d110/f118 [380118,103034] 0 2024-04-26T21:08:32.255 INFO:tasks.workunit.client.0.smithi055.stdout:8/899: creat d3/d7c/d9a/f12a x:0 0 0 2024-04-26T21:08:32.270 INFO:tasks.workunit.client.0.smithi055.stdout:8/900: dread d3/d9/d1d/f53 [0,4194304] 0 2024-04-26T21:08:32.276 INFO:tasks.workunit.client.0.smithi055.stdout:4/937: dwrite d4/d26/d42/d28/d53/d71/d7f/fd5 [0,4194304] 0 2024-04-26T21:08:32.295 INFO:tasks.workunit.client.0.smithi055.stdout:4/938: write d4/d26/d42/dbb/dde/ffd [713231,78984] 0 2024-04-26T21:08:32.296 INFO:tasks.workunit.client.0.smithi055.stdout:8/901: dread d3/d9/d1d/d48/d4b/d8b/f93 [0,4194304] 0 2024-04-26T21:08:32.377 INFO:tasks.workunit.client.0.smithi055.stdout:8/902: rename d3/dc0/f27 to d3/d7c/f12b 0 2024-04-26T21:08:32.387 INFO:tasks.workunit.client.0.smithi055.stdout:8/903: mknod d3/d9/d1d/d48/d80/c12c 0 2024-04-26T21:08:32.388 INFO:tasks.workunit.client.0.smithi055.stdout:8/904: creat d3/d9/d1d/d48/d100/d110/f12d x:0 0 0 2024-04-26T21:08:32.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:32 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:32.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:32 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:32.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:32 smithi064 ceph-mon[33404]: pgmap v6: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:32.419 INFO:tasks.workunit.client.0.smithi055.stdout:8/905: dread d3/d9/d1d/d48/d100/d110/f118 [0,4194304] 0 2024-04-26T21:08:32.425 INFO:tasks.workunit.client.0.smithi055.stdout:8/906: link d3/f41 d3/d9/d1d/db9/f12e 0 2024-04-26T21:08:32.428 INFO:tasks.workunit.client.0.smithi055.stdout:8/907: symlink d3/dc0/d119/l12f 0 2024-04-26T21:08:32.428 INFO:tasks.workunit.client.0.smithi055.stdout:8/908: fdatasync d3/d9/d1d/d48/d57/d61/d9b/fd4 0 2024-04-26T21:08:32.487 INFO:tasks.workunit.client.0.smithi055.stdout:4/939: dwrite d4/d12/d10f/d10c/f16 [0,4194304] 0 2024-04-26T21:08:32.487 INFO:tasks.workunit.client.0.smithi055.stdout:4/940: fdatasync d4/d12/d10f/d10c/f12f 0 2024-04-26T21:08:32.489 INFO:tasks.workunit.client.0.smithi055.stdout:4/941: getdents d4/d26/d42/dbb/d101 0 2024-04-26T21:08:32.497 INFO:tasks.workunit.client.0.smithi055.stdout:8/909: dwrite d3/dbc/ffb [0,4194304] 0 2024-04-26T21:08:32.497 INFO:tasks.workunit.client.0.smithi055.stdout:8/910: stat d3/d9/d1d/d48/d4b/fb4 0 2024-04-26T21:08:32.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:32 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:32.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:32 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:32.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:32 smithi055 ceph-mon[25475]: pgmap v6: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail 2024-04-26T21:08:32.530 INFO:tasks.workunit.client.0.smithi055.stdout:8/911: rmdir d3/d9/d1d 39 2024-04-26T21:08:32.533 INFO:tasks.workunit.client.0.smithi055.stdout:4/942: dwrite d4/d12/d10f/d10c/f12f [4194304,4194304] 0 2024-04-26T21:08:32.535 INFO:tasks.workunit.client.0.smithi055.stdout:8/912: mkdir d3/d89/d130 0 2024-04-26T21:08:32.542 INFO:tasks.workunit.client.0.smithi055.stdout:8/913: rmdir d3/d77/dd5/d10a 39 2024-04-26T21:08:32.542 INFO:tasks.workunit.client.0.smithi055.stdout:8/914: write d3/dc0/fae [721403,49031] 0 2024-04-26T21:08:32.549 INFO:tasks.workunit.client.0.smithi055.stdout:8/915: getdents d3/d89 0 2024-04-26T21:08:32.552 INFO:tasks.workunit.client.0.smithi055.stdout:8/916: link d3/d9/d1d/f116 d3/dbc/f131 0 2024-04-26T21:08:32.556 INFO:tasks.workunit.client.0.smithi055.stdout:5/931: sync 2024-04-26T21:08:32.556 INFO:tasks.workunit.client.0.smithi055.stdout:5/932: chown d4/df/dae/dce/d4a/d3f/d2e/f54 8121315 1 2024-04-26T21:08:32.559 INFO:tasks.workunit.client.0.smithi055.stdout:5/933: creat d4/df/dae/dce/d4a/d3f/dfa/d13a/f13f x:0 0 0 2024-04-26T21:08:32.562 INFO:tasks.workunit.client.0.smithi055.stdout:5/934: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/f140 x:0 0 0 2024-04-26T21:08:32.564 INFO:tasks.workunit.client.0.smithi055.stdout:5/935: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/l141 0 2024-04-26T21:08:32.564 INFO:tasks.workunit.client.0.smithi055.stdout:5/936: truncate d4/df/dae/dce/d4a/d3f/d4f/d53/d90/f13e 46469 0 2024-04-26T21:08:32.568 INFO:tasks.workunit.client.0.smithi055.stdout:5/937: symlink d4/df/d13/d26/l142 0 2024-04-26T21:08:32.569 INFO:tasks.workunit.client.0.smithi055.stdout:8/917: write d3/dc0/d2e/f62 [7998477,127014] 0 2024-04-26T21:08:32.569 INFO:tasks.workunit.client.0.smithi055.stdout:8/918: chown d3/dc0/d2e/d75/d76/l8d 0 1 2024-04-26T21:08:32.570 INFO:tasks.workunit.client.0.smithi055.stdout:5/938: mkdir d4/df/dae/dce/d93/dcb/db4/d13c/d143 0 2024-04-26T21:08:32.571 INFO:tasks.workunit.client.0.smithi055.stdout:5/939: mkdir d4/df/d13/d11f/d144 0 2024-04-26T21:08:32.586 INFO:tasks.workunit.client.0.smithi055.stdout:5/940: write d4/df/dae/dce/d4a/d3f/f46 [2548195,42250] 0 2024-04-26T21:08:32.588 INFO:tasks.workunit.client.0.smithi055.stdout:8/919: write d3/d77/f78 [3328059,112289] 0 2024-04-26T21:08:32.629 INFO:tasks.workunit.client.0.smithi055.stdout:4/943: dwrite d4/d26/d42/dbb/dde/f8a [0,4194304] 0 2024-04-26T21:08:32.632 INFO:tasks.workunit.client.0.smithi055.stdout:5/941: dwrite d4/df/dae/dce/d4a/d3f/d4f/d53/d90/ff4 [0,4194304] 0 2024-04-26T21:08:32.639 INFO:tasks.workunit.client.0.smithi055.stdout:8/920: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:32.642 INFO:tasks.workunit.client.0.smithi055.stdout:8/921: creat d3/d9/d1d/d48/d57/d61/d9b/f132 x:0 0 0 2024-04-26T21:08:32.649 INFO:tasks.workunit.client.0.smithi055.stdout:4/944: dread d4/f36 [0,4194304] 0 2024-04-26T21:08:32.653 INFO:tasks.workunit.client.0.smithi055.stdout:4/945: truncate d4/d12/d10f/d10c/f6f 3441293 0 2024-04-26T21:08:32.657 INFO:tasks.workunit.client.0.smithi055.stdout:4/946: unlink d4/d26/d42/dbb/d101/l104 0 2024-04-26T21:08:32.698 INFO:tasks.workunit.client.0.smithi055.stdout:5/942: dwrite d4/df/dae/dce/d4a/d3f/d4f/f9f [0,4194304] 0 2024-04-26T21:08:32.700 INFO:tasks.workunit.client.0.smithi055.stdout:5/943: rmdir d4/df/dae/dce/d5b 39 2024-04-26T21:08:32.704 INFO:tasks.workunit.client.0.smithi055.stdout:5/944: creat d4/df/f145 x:0 0 0 2024-04-26T21:08:32.705 INFO:tasks.workunit.client.0.smithi055.stdout:5/945: rmdir d4/df/dae/dce/d4a/d3f/d2e/d82 39 2024-04-26T21:08:32.740 INFO:tasks.workunit.client.0.smithi055.stdout:8/922: dwrite d3/dc0/d2e/ddc/ffc [0,4194304] 0 2024-04-26T21:08:32.740 INFO:tasks.workunit.client.0.smithi055.stdout:8/923: fdatasync d3/d9/fcd 0 2024-04-26T21:08:32.740 INFO:tasks.workunit.client.0.smithi055.stdout:8/924: write d3/d9/d5b/fee [5217617,114661] 0 2024-04-26T21:08:32.768 INFO:tasks.workunit.client.0.smithi055.stdout:4/947: dwrite d4/d26/d42/dbb/f9b [4194304,4194304] 0 2024-04-26T21:08:32.768 INFO:tasks.workunit.client.0.smithi055.stdout:4/948: write d4/d26/d42/dbb/dde/f111 [1413088,95081] 0 2024-04-26T21:08:32.782 INFO:tasks.workunit.client.0.smithi055.stdout:4/949: dread d4/d26/d42/d2d/f59 [0,4194304] 0 2024-04-26T21:08:33.082 INFO:tasks.workunit.client.0.smithi055.stdout:5/946: sync 2024-04-26T21:08:33.082 INFO:tasks.workunit.client.0.smithi055.stdout:8/925: sync 2024-04-26T21:08:33.082 INFO:tasks.workunit.client.0.smithi055.stdout:8/926: fsync d3/d9/d1d/d48/d57/fb2 0 2024-04-26T21:08:33.085 INFO:tasks.workunit.client.0.smithi055.stdout:5/947: mkdir d4/df/dea/d146 0 2024-04-26T21:08:33.088 INFO:tasks.workunit.client.0.smithi055.stdout:8/927: link d3/d9/d1d/db9/f12e d3/dc0/d2e/d75/f133 0 2024-04-26T21:08:33.192 INFO:tasks.workunit.client.0.smithi055.stdout:5/948: dwrite d4/df/dae/dce/d93/dcb/db4/fc7 [0,4194304] 0 2024-04-26T21:08:33.193 INFO:tasks.workunit.client.0.smithi055.stdout:8/928: dwrite d3/d9/d5b/fee [0,4194304] 0 2024-04-26T21:08:33.202 INFO:tasks.workunit.client.0.smithi055.stdout:8/929: dread d3/d77/dd5/d10a/f10e [0,4194304] 0 2024-04-26T21:08:33.202 INFO:tasks.workunit.client.0.smithi055.stdout:8/930: readlink d3/d9/d1d/d48/d4b/l66 0 2024-04-26T21:08:33.273 INFO:tasks.workunit.client.0.smithi055.stdout:5/949: creat d4/df/dae/dce/d93/d125/f147 x:0 0 0 2024-04-26T21:08:33.273 INFO:tasks.workunit.client.0.smithi055.stdout:5/950: chown d4/df/dae/dce/d4a/d3f/d2e/dcd/c131 173167176 1 2024-04-26T21:08:33.330 INFO:tasks.workunit.client.0.smithi055.stdout:5/951: dwrite d4/df/dae/dce/d4a/d3f/d2e/f54 [4194304,4194304] 0 2024-04-26T21:08:33.330 INFO:tasks.workunit.client.0.smithi055.stdout:5/952: chown d4/df/dae/dce/d93/dcb/f12c 285835760 1 2024-04-26T21:08:33.330 INFO:tasks.workunit.client.0.smithi055.stdout:5/953: creat d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/f148 x:0 0 0 2024-04-26T21:08:33.351 INFO:tasks.workunit.client.0.smithi055.stdout:5/954: dread d4/df/d13/d26/f58 [0,4194304] 0 2024-04-26T21:08:33.353 INFO:tasks.workunit.client.0.smithi055.stdout:5/955: mkdir d4/df/dae/dce/d93/d125/d149 0 2024-04-26T21:08:33.353 INFO:tasks.workunit.client.0.smithi055.stdout:5/956: creat d4/df/dae/dce/dc0/de2/f14a x:0 0 0 2024-04-26T21:08:33.356 INFO:tasks.workunit.client.0.smithi055.stdout:8/931: rmdir d3/d9/d1d/d48/d57/d61 39 2024-04-26T21:08:33.356 INFO:tasks.workunit.client.0.smithi055.stdout:8/932: truncate d3/d9/d44/f58 2483685 0 2024-04-26T21:08:33.357 INFO:tasks.workunit.client.0.smithi055.stdout:8/933: write d3/d77/dd5/d10a/f10e [809712,81277] 0 2024-04-26T21:08:33.358 INFO:tasks.workunit.client.0.smithi055.stdout:8/934: mkdir d3/d9/d1d/d48/d80/d134 0 2024-04-26T21:08:33.359 INFO:tasks.workunit.client.0.smithi055.stdout:8/935: symlink d3/dc0/d2e/ddc/l135 0 2024-04-26T21:08:33.370 INFO:tasks.workunit.client.0.smithi055.stdout:4/950: sync 2024-04-26T21:08:33.383 INFO:tasks.workunit.client.0.smithi055.stdout:8/936: dread d3/dbc/ffb [0,4194304] 0 2024-04-26T21:08:33.384 INFO:tasks.workunit.client.0.smithi055.stdout:8/937: write d3/d9/f24 [4423566,130719] 0 2024-04-26T21:08:33.384 INFO:tasks.workunit.client.0.smithi055.stdout:4/951: dread d4/f1d [0,4194304] 0 2024-04-26T21:08:33.386 INFO:tasks.workunit.client.0.smithi055.stdout:4/952: mkdir d4/d26/d42/d28/d53/dfe/d134 0 2024-04-26T21:08:33.403 INFO:tasks.workunit.client.0.smithi055.stdout:4/953: dread d4/d26/d42/d28/d53/d70/f8f [0,4194304] 0 2024-04-26T21:08:33.425 INFO:tasks.workunit.client.0.smithi055.stdout:4/954: write d4/d18/f89 [917350,110985] 0 2024-04-26T21:08:33.444 INFO:tasks.workunit.client.0.smithi055.stdout:8/938: dwrite d3/d9/d1d/f35 [0,4194304] 0 2024-04-26T21:08:33.453 INFO:tasks.workunit.client.0.smithi055.stdout:8/939: rmdir d3/d9/d1d/d48/d4b/d8b 39 2024-04-26T21:08:33.463 INFO:tasks.workunit.client.0.smithi055.stdout:8/940: mkdir d3/d89/daa/d136 0 2024-04-26T21:08:33.502 INFO:tasks.workunit.client.0.smithi055.stdout:4/955: dwrite d4/f4b [4194304,4194304] 0 2024-04-26T21:08:33.509 INFO:tasks.workunit.client.0.smithi055.stdout:4/956: unlink d4/d18/d8e/d9e/f116 0 2024-04-26T21:08:33.529 INFO:tasks.workunit.client.0.smithi055.stdout:4/957: dread d4/d26/d42/dbb/dde/f54 [0,4194304] 0 2024-04-26T21:08:33.535 INFO:tasks.workunit.client.0.smithi055.stdout:4/958: symlink d4/d18/l135 0 2024-04-26T21:08:33.545 INFO:tasks.workunit.client.0.smithi055.stdout:8/941: dwrite d3/d9/f24 [0,4194304] 0 2024-04-26T21:08:33.584 INFO:tasks.workunit.client.0.smithi055.stdout:4/959: dwrite d4/d26/d42/f38 [0,4194304] 0 2024-04-26T21:08:33.584 INFO:tasks.workunit.client.0.smithi055.stdout:4/960: fsync d4/d26/d42/d28/f32 0 2024-04-26T21:08:33.584 INFO:tasks.workunit.client.0.smithi055.stdout:4/961: chown d4/d12/lb2 24820121 1 2024-04-26T21:08:33.602 INFO:tasks.workunit.client.0.smithi055.stdout:8/942: dwrite d3/d9/d1d/d48/d57/d61/f97 [4194304,4194304] 0 2024-04-26T21:08:33.626 INFO:tasks.workunit.client.0.smithi055.stdout:5/957: sync 2024-04-26T21:08:33.630 INFO:tasks.workunit.client.0.smithi055.stdout:5/958: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/d90/da6/c14b 0 2024-04-26T21:08:33.673 INFO:tasks.workunit.client.0.smithi055.stdout:5/959: dread d4/df/f30 [0,4194304] 0 2024-04-26T21:08:33.681 INFO:tasks.workunit.client.0.smithi055.stdout:5/960: truncate d4/df/d13/d26/d63/f137 400164 0 2024-04-26T21:08:33.686 INFO:tasks.workunit.client.0.smithi055.stdout:8/943: dwrite d3/d9/d1d/d48/d80/fe9 [0,4194304] 0 2024-04-26T21:08:33.686 INFO:tasks.workunit.client.0.smithi055.stdout:8/944: chown d3/dbc/lb0 23676 1 2024-04-26T21:08:33.705 INFO:tasks.workunit.client.0.smithi055.stdout:8/945: mkdir d3/d77/dd5/d10a/d137 0 2024-04-26T21:08:33.705 INFO:tasks.workunit.client.0.smithi055.stdout:8/946: stat d3/d9/d1d/d48/d100 0 2024-04-26T21:08:33.707 INFO:tasks.workunit.client.0.smithi055.stdout:8/947: rmdir d3/d77/dd5 39 2024-04-26T21:08:33.712 INFO:tasks.workunit.client.0.smithi055.stdout:8/948: getdents d3/d9/d5b 0 2024-04-26T21:08:33.715 INFO:tasks.workunit.client.0.smithi055.stdout:8/949: rmdir d3/d77/da9 39 2024-04-26T21:08:33.717 INFO:tasks.workunit.client.0.smithi055.stdout:8/950: creat d3/d9/d1d/d48/d80/dce/f138 x:0 0 0 2024-04-26T21:08:33.717 INFO:tasks.workunit.client.0.smithi055.stdout:8/951: truncate d3/d77/da9/fda 1020656 0 2024-04-26T21:08:33.718 INFO:tasks.workunit.client.0.smithi055.stdout:8/952: chown d3/d9/d1d/d48/d57/fdf 2 1 2024-04-26T21:08:33.721 INFO:tasks.workunit.client.0.smithi055.stdout:8/953: link d3/d9/d1d/f85 d3/d7c/f139 0 2024-04-26T21:08:33.736 INFO:tasks.workunit.client.0.smithi055.stdout:4/962: dwrite d4/d12/d10f/d10c/f6f [0,4194304] 0 2024-04-26T21:08:33.736 INFO:tasks.workunit.client.0.smithi055.stdout:4/963: dread - d4/d26/d42/d28/d53/d71/fb7 zero size 2024-04-26T21:08:33.736 INFO:tasks.workunit.client.0.smithi055.stdout:8/954: dread d3/d9/f2d [0,4194304] 0 2024-04-26T21:08:33.736 INFO:tasks.workunit.client.0.smithi055.stdout:4/964: rmdir d4/d12/d61 39 2024-04-26T21:08:33.737 INFO:tasks.workunit.client.0.smithi055.stdout:8/955: mknod d3/dc0/d119/c13a 0 2024-04-26T21:08:33.737 INFO:tasks.workunit.client.0.smithi055.stdout:8/956: chown d3/d9/c51 1327973 1 2024-04-26T21:08:33.737 INFO:tasks.workunit.client.0.smithi055.stdout:4/965: mknod d4/d12/d61/d6b/c136 0 2024-04-26T21:08:33.741 INFO:tasks.workunit.client.0.smithi055.stdout:5/961: dwrite d4/df/f5d [4194304,4194304] 0 2024-04-26T21:08:33.741 INFO:tasks.workunit.client.0.smithi055.stdout:5/962: truncate d4/df/dae/dce/d93/dcb/fc8 477010 0 2024-04-26T21:08:33.741 INFO:tasks.workunit.client.0.smithi055.stdout:4/966: creat d4/d26/d42/dbb/f137 x:0 0 0 2024-04-26T21:08:33.751 INFO:tasks.workunit.client.0.smithi055.stdout:5/963: link f2 d4/f14c 0 2024-04-26T21:08:33.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/967: write d4/d26/d42/dbb/fdd [4337318,22585] 0 2024-04-26T21:08:33.769 INFO:tasks.workunit.client.0.smithi055.stdout:4/968: chown d4/d26/lcc 21 1 2024-04-26T21:08:33.772 INFO:tasks.workunit.client.0.smithi055.stdout:4/969: mknod d4/d26/d42/d28/db9/d12a/c138 0 2024-04-26T21:08:33.792 INFO:tasks.workunit.client.0.smithi055.stdout:8/957: dwrite d3/dc0/d2e/d75/f6c [0,4194304] 0 2024-04-26T21:08:33.799 INFO:tasks.workunit.client.0.smithi055.stdout:8/958: unlink d3/dc0/d2e/d75/d76/cd1 0 2024-04-26T21:08:33.799 INFO:tasks.workunit.client.0.smithi055.stdout:8/959: chown d3/d9/d5b/cfd 1775268 1 2024-04-26T21:08:33.802 INFO:tasks.workunit.client.0.smithi055.stdout:8/960: creat d3/dc0/d2e/d75/dcb/f13b x:0 0 0 2024-04-26T21:08:33.828 INFO:tasks.workunit.client.0.smithi055.stdout:5/964: dwrite d4/df/d13/d26/fe6 [0,4194304] 0 2024-04-26T21:08:33.828 INFO:tasks.workunit.client.0.smithi055.stdout:5/965: stat d4/df/dae/dce/d4a/d3f/d2e/f54 0 2024-04-26T21:08:33.832 INFO:tasks.workunit.client.0.smithi055.stdout:5/966: symlink d4/df/d13/d11f/l14d 0 2024-04-26T21:08:33.834 INFO:tasks.workunit.client.0.smithi055.stdout:5/967: rename d4/df/dae/dce/d4a/d3f/c6d to d4/df/dea/c14e 0 2024-04-26T21:08:33.834 INFO:tasks.workunit.client.0.smithi055.stdout:5/968: write d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/f140 [240577,12167] 0 2024-04-26T21:08:33.841 INFO:tasks.workunit.client.0.smithi055.stdout:4/970: dwrite d4/d12/d10f/d10c/f12f [0,4194304] 0 2024-04-26T21:08:33.841 INFO:tasks.workunit.client.0.smithi055.stdout:4/971: chown d4/d26/d42/d28/l118 1 1 2024-04-26T21:08:33.842 INFO:tasks.workunit.client.0.smithi055.stdout:4/972: fsync d4/d26/d42/d28/d53/d71/d7f/fd5 0 2024-04-26T21:08:33.845 INFO:tasks.workunit.client.0.smithi055.stdout:8/961: dwrite d3/d7c/f12b [0,4194304] 0 2024-04-26T21:08:33.851 INFO:tasks.workunit.client.0.smithi055.stdout:8/962: creat d3/d9/d1d/d48/d100/d110/d125/f13c x:0 0 0 2024-04-26T21:08:33.854 INFO:tasks.workunit.client.0.smithi055.stdout:8/963: creat d3/d9/d1d/d48/d4b/d8b/f13d x:0 0 0 2024-04-26T21:08:33.857 INFO:tasks.workunit.client.0.smithi055.stdout:8/964: creat d3/d9/d1d/d48/d100/d110/f13e x:0 0 0 2024-04-26T21:08:33.861 INFO:tasks.workunit.client.0.smithi055.stdout:8/965: rename d3/d9/d1d/d48/d4b/fb4 to d3/dc0/d2e/d75/dcb/f13f 0 2024-04-26T21:08:33.861 INFO:tasks.workunit.client.0.smithi055.stdout:8/966: fdatasync d3/d9/f2d 0 2024-04-26T21:08:33.902 INFO:tasks.workunit.client.0.smithi055.stdout:4/973: dwrite d4/d26/d42/dbb/dde/f37 [0,4194304] 0 2024-04-26T21:08:33.904 INFO:tasks.workunit.client.0.smithi055.stdout:4/974: creat d4/d26/d42/d28/f139 x:0 0 0 2024-04-26T21:08:33.905 INFO:tasks.workunit.client.0.smithi055.stdout:4/975: truncate d4/d12/d17/f7e 610652 0 2024-04-26T21:08:33.907 INFO:tasks.workunit.client.0.smithi055.stdout:4/976: symlink d4/d26/d42/d56/l13a 0 2024-04-26T21:08:33.908 INFO:tasks.workunit.client.0.smithi055.stdout:4/977: mkdir d4/d12/d17/d13b 0 2024-04-26T21:08:33.923 INFO:tasks.workunit.client.0.smithi055.stdout:8/967: dwrite d3/d9/fcd [0,4194304] 0 2024-04-26T21:08:33.923 INFO:tasks.workunit.client.0.smithi055.stdout:8/968: chown d3/d9/d1d/d48/d57/d61/f8c 55910 1 2024-04-26T21:08:33.923 INFO:tasks.workunit.client.0.smithi055.stdout:8/969: truncate d3/dc0/d2e/d75/dcb/f13b 563306 0 2024-04-26T21:08:33.926 INFO:tasks.workunit.client.0.smithi055.stdout:8/970: mkdir d3/dc0/d119/d140 0 2024-04-26T21:08:33.933 INFO:tasks.workunit.client.0.smithi055.stdout:8/971: dread d3/dbc/fcc [0,4194304] 0 2024-04-26T21:08:33.988 INFO:tasks.workunit.client.0.smithi055.stdout:4/978: dwrite d4/d26/d42/d28/db9/fe7 [0,4194304] 0 2024-04-26T21:08:33.996 INFO:tasks.workunit.client.0.smithi055.stdout:4/979: creat d4/d12/d17/d3d/f13c x:0 0 0 2024-04-26T21:08:33.999 INFO:tasks.workunit.client.0.smithi055.stdout:4/980: rmdir d4/d26/d42/dbb/d101 0 2024-04-26T21:08:34.012 INFO:tasks.workunit.client.0.smithi055.stdout:8/972: dwrite d3/d9/d1d/d48/d57/fb2 [0,4194304] 0 2024-04-26T21:08:34.015 INFO:tasks.workunit.client.0.smithi055.stdout:8/973: getdents d3/d9/d1d/d48/d100/d110/d125 0 2024-04-26T21:08:34.016 INFO:tasks.workunit.client.0.smithi055.stdout:8/974: write d3/f47 [4904883,116352] 0 2024-04-26T21:08:34.016 INFO:tasks.workunit.client.0.smithi055.stdout:8/975: chown d3/d7c/f12b 2842 1 2024-04-26T21:08:34.016 INFO:tasks.workunit.client.0.smithi055.stdout:8/976: fdatasync d3/d9/f24 0 2024-04-26T21:08:34.017 INFO:tasks.workunit.client.0.smithi055.stdout:8/977: write d3/d9/d1d/f53 [2154448,117922] 0 2024-04-26T21:08:34.042 INFO:tasks.workunit.client.0.smithi055.stdout:8/978: dread d3/f18 [0,4194304] 0 2024-04-26T21:08:34.042 INFO:tasks.workunit.client.0.smithi055.stdout:8/979: truncate d3/d7c/d9a/f120 432425 0 2024-04-26T21:08:34.043 INFO:tasks.workunit.client.0.smithi055.stdout:8/980: mkdir d3/d9/d1d/d48/d100/d110/d141 0 2024-04-26T21:08:34.083 INFO:tasks.workunit.client.0.smithi055.stdout:4/981: dwrite d4/f30 [4194304,4194304] 0 2024-04-26T21:08:34.091 INFO:tasks.workunit.client.0.smithi055.stdout:8/981: dwrite d3/d77/f78 [4194304,4194304] 0 2024-04-26T21:08:34.094 INFO:tasks.workunit.client.0.smithi055.stdout:8/982: mknod d3/d77/dd5/d10a/d137/c142 0 2024-04-26T21:08:34.142 INFO:tasks.workunit.client.0.smithi055.stdout:4/982: dwrite d4/d26/d42/d28/d53/dfe/dff/d11c/f123 [0,4194304] 0 2024-04-26T21:08:34.143 INFO:tasks.workunit.client.0.smithi055.stdout:4/983: fsync d4/d26/d42/d2d/f3a 0 2024-04-26T21:08:34.143 INFO:tasks.workunit.client.0.smithi055.stdout:4/984: readlink d4/d12/lb2 0 2024-04-26T21:08:34.248 INFO:tasks.workunit.client.0.smithi055.stdout:4/985: mknod d4/d26/d42/dbb/dde/d49/dae/dc0/c13d 0 2024-04-26T21:08:34.264 INFO:tasks.workunit.client.0.smithi055.stdout:4/986: creat d4/d12/d10f/d10c/f13e x:0 0 0 2024-04-26T21:08:34.265 INFO:tasks.workunit.client.0.smithi055.stdout:4/987: stat d4/d18/d8e/lbf 0 2024-04-26T21:08:34.271 INFO:tasks.workunit.client.0.smithi055.stdout:4/988: mknod d4/d12/d57/c13f 0 2024-04-26T21:08:34.301 INFO:tasks.workunit.client.0.smithi055.stdout:5/969: sync 2024-04-26T21:08:34.310 INFO:tasks.workunit.client.0.smithi055.stdout:5/970: unlink d4/df/dae/f12d 0 2024-04-26T21:08:34.310 INFO:tasks.workunit.client.0.smithi055.stdout:5/971: write d4/df/d13/f97 [5138408,2061] 0 2024-04-26T21:08:34.310 INFO:tasks.workunit.client.0.smithi055.stdout:5/972: chown d4/df/dae/dce/d4a/d3f/d2e/c8b 6493 1 2024-04-26T21:08:34.312 INFO:tasks.workunit.client.0.smithi055.stdout:5/973: symlink d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/l14f 0 2024-04-26T21:08:34.323 INFO:tasks.workunit.client.0.smithi055.stdout:8/983: sync 2024-04-26T21:08:34.324 INFO:tasks.workunit.client.0.smithi055.stdout:8/984: write d3/d9/d1d/d48/d57/d61/d9b/f132 [21192,126849] 0 2024-04-26T21:08:34.349 INFO:tasks.workunit.client.0.smithi055.stdout:8/985: dread d3/d9/d44/f58 [0,4194304] 0 2024-04-26T21:08:34.353 INFO:tasks.workunit.client.0.smithi055.stdout:8/986: creat d3/d9/d1d/d48/d80/d134/f143 x:0 0 0 2024-04-26T21:08:34.431 INFO:tasks.workunit.client.0.smithi055.stdout:4/989: dwrite d4/f11 [4194304,4194304] 0 2024-04-26T21:08:34.435 INFO:tasks.workunit.client.0.smithi055.stdout:4/990: mknod d4/d26/d42/dbb/dde/d49/dae/d122/c140 0 2024-04-26T21:08:34.437 INFO:tasks.workunit.client.0.smithi055.stdout:4/991: symlink d4/d26/d42/d12c/l141 0 2024-04-26T21:08:34.437 INFO:tasks.workunit.client.0.smithi055.stdout:4/992: chown d4/d12/lba 52514 1 2024-04-26T21:08:34.455 INFO:tasks.workunit.client.0.smithi055.stdout:8/987: dwrite d3/d9/f3b [0,4194304] 0 2024-04-26T21:08:34.455 INFO:tasks.workunit.client.0.smithi055.stdout:8/988: write d3/d9/d1d/d48/d80/dce/f113 [510593,77678] 0 2024-04-26T21:08:34.460 INFO:tasks.workunit.client.0.smithi055.stdout:8/989: mkdir d3/dc0/dfa/d144 0 2024-04-26T21:08:34.463 INFO:tasks.workunit.client.0.smithi055.stdout:5/974: dwrite d4/df/dae/dce/d4a/d3f/d4f/d53/d90/ff4 [0,4194304] 0 2024-04-26T21:08:34.497 INFO:tasks.workunit.client.0.smithi055.stdout:4/993: dwrite d4/d26/d42/dbb/dde/d49/dae/d122/dfc/fb6 [0,4194304] 0 2024-04-26T21:08:34.501 INFO:tasks.workunit.client.0.smithi055.stdout:5/975: read d4/df/d13/d26/f31 [3503538,115260] 0 2024-04-26T21:08:34.507 INFO:tasks.workunit.client.0.smithi055.stdout:5/976: rmdir d4/df/dae/dce/d4a/d3f/d4f/d53/dc9 39 2024-04-26T21:08:34.529 INFO:tasks.workunit.client.0.smithi055.stdout:4/994: truncate d4/d26/d42/dbb/dde/d49/dae/d122/dfc/fb6 1584549 0 2024-04-26T21:08:34.534 INFO:tasks.workunit.client.0.smithi055.stdout:4/995: mkdir d4/d18/d86/d142 0 2024-04-26T21:08:34.536 INFO:tasks.workunit.client.0.smithi055.stdout:4/996: rename d4/d12/d17/d3d/f8c to d4/d26/d42/dbb/f143 0 2024-04-26T21:08:34.542 INFO:tasks.workunit.client.0.smithi055.stdout:4/997: rename d4/f66 to d4/d12/d57/f144 0 2024-04-26T21:08:34.547 INFO:tasks.workunit.client.0.smithi055.stdout:4/998: rmdir d4/d12/d10f/d10c 39 2024-04-26T21:08:34.547 INFO:tasks.workunit.client.0.smithi055.stdout:4/999: write d4/d26/d42/fe4 [991712,27991] 0 2024-04-26T21:08:34.548 INFO:tasks.workunit.client.0.smithi055.stdout:8/990: dwrite d3/d9/f2d [0,4194304] 0 2024-04-26T21:08:34.548 INFO:tasks.workunit.client.0.smithi055.stdout:8/991: fsync d3/dc0/d2e/db3/fef 0 2024-04-26T21:08:34.553 INFO:tasks.workunit.client.0.smithi055.stdout:8/992: creat d3/d9/d5b/da4/dc5/d127/f145 x:0 0 0 2024-04-26T21:08:34.557 INFO:tasks.workunit.client.0.smithi055.stdout:8/993: creat d3/dbc/d8f/f146 x:0 0 0 2024-04-26T21:08:34.562 INFO:tasks.workunit.client.0.smithi055.stdout:8/994: creat d3/dc0/d2e/da6/f147 x:0 0 0 2024-04-26T21:08:34.568 INFO:tasks.workunit.client.0.smithi055.stdout:5/977: dwrite d4/df/f5d [4194304,4194304] 0 2024-04-26T21:08:34.582 INFO:tasks.workunit.client.0.smithi055.stdout:8/995: dread d3/d9/d1d/d48/d80/fed [0,4194304] 0 2024-04-26T21:08:34.597 INFO:tasks.workunit.client.0.smithi055.stdout:5/978: dread d4/df/dae/dce/d5b/f70 [0,4194304] 0 2024-04-26T21:08:34.597 INFO:tasks.workunit.client.0.smithi055.stdout:5/979: fsync d4/df/d13/d26/d63/f12f 0 2024-04-26T21:08:34.597 INFO:tasks.workunit.client.0.smithi055.stdout:5/980: write d4/df/dae/dce/d4a/d3f/d5c/f10b [795582,129349] 0 2024-04-26T21:08:34.597 INFO:tasks.workunit.client.0.smithi055.stdout:8/996: dread d3/dc0/d2e/da6/fd2 [0,4194304] 0 2024-04-26T21:08:34.602 INFO:tasks.workunit.client.0.smithi055.stdout:5/981: mkdir d4/df/dae/dce/dc0/d150 0 2024-04-26T21:08:34.602 INFO:tasks.workunit.client.0.smithi055.stdout:5/982: fdatasync d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fa4 0 2024-04-26T21:08:34.609 INFO:tasks.workunit.client.0.smithi055.stdout:5/983: mknod d4/df/dae/dce/d4a/d3f/d4f/d53/d87/d9e/dd4/dd8/c151 0 2024-04-26T21:08:34.609 INFO:tasks.workunit.client.0.smithi055.stdout:5/984: read - d4/df/dae/dce/d4a/d3f/d4f/d53/d90/fe7 zero size 2024-04-26T21:08:34.609 INFO:tasks.workunit.client.0.smithi055.stdout:5/985: fdatasync d4/df/dae/dce/d93/dcb/db4/fc7 0 2024-04-26T21:08:34.611 INFO:tasks.workunit.client.0.smithi055.stdout:5/986: creat d4/df/dae/dce/d5b/d83/dff/f152 x:0 0 0 2024-04-26T21:08:34.612 INFO:tasks.workunit.client.0.smithi055.stdout:5/987: creat d4/df/dae/dce/d5b/d83/f153 x:0 0 0 2024-04-26T21:08:34.617 INFO:tasks.workunit.client.0.smithi055.stdout:5/988: rename d4/df/dae/dce/d4a/d3f/c6e to d4/df/dae/dce/d93/dcb/db4/d13c/c154 0 2024-04-26T21:08:34.619 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:34 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:34.619 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:34 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:34.619 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:34 smithi055 ceph-mon[25475]: pgmap v7: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 47 MiB/s rd, 68 MiB/s wr, 179 op/s 2024-04-26T21:08:34.622 INFO:tasks.workunit.client.0.smithi055.stdout:5/989: mkdir d4/df/dae/dce/d4a/d3f/dfa/d155 0 2024-04-26T21:08:34.623 INFO:tasks.workunit.client.0.smithi055.stdout:5/990: mkdir d4/df/dae/dce/d5b/d83/dda/d156 0 2024-04-26T21:08:34.625 INFO:tasks.workunit.client.0.smithi055.stdout:5/991: mknod d4/df/dae/dce/d4a/d3f/d4f/c157 0 2024-04-26T21:08:34.627 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:34 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:34.627 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:34 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:34.627 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:34 smithi064 ceph-mon[33404]: pgmap v7: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 47 MiB/s rd, 68 MiB/s wr, 179 op/s 2024-04-26T21:08:34.627 INFO:tasks.workunit.client.0.smithi055.stdout:5/992: rename d4/df/dae/dce/d4a/d3f/d4f/d53/d87/la3 to d4/df/dae/dce/d4a/d3f/dfa/d155/l158 0 2024-04-26T21:08:34.648 INFO:tasks.workunit.client.0.smithi055.stdout:5/993: read d4/df/dae/dce/d5b/d83/fa7 [2981551,26238] 0 2024-04-26T21:08:34.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/994: mknod d4/df/dae/dce/d4a/d3f/d4f/c159 0 2024-04-26T21:08:34.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/995: write d4/df/dae/dce/d4a/d3f/d4f/d53/d90/f10a [627125,10337] 0 2024-04-26T21:08:34.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/996: chown d4/df/dae/dce/d93/dcb/db4/d13c/d143 205704113 1 2024-04-26T21:08:34.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/997: read - d4/df/f145 zero size 2024-04-26T21:08:34.651 INFO:tasks.workunit.client.0.smithi055.stdout:5/998: stat d4/df/f3b 0 2024-04-26T21:08:34.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/997: dwrite d3/dc0/d2e/f56 [0,4194304] 0 2024-04-26T21:08:34.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/998: write d3/dc0/d2e/d75/f133 [1171085,47523] 0 2024-04-26T21:08:34.652 INFO:tasks.workunit.client.0.smithi055.stdout:8/999: fsync d3/d9/d1d/d48/d100/d110/f118 0 2024-04-26T21:08:34.689 INFO:tasks.workunit.client.0.smithi055.stdout:5/999: dwrite d4/df/d13/d26/d63/f12f [0,4194304] 0 2024-04-26T21:08:34.695 INFO:tasks.workunit.client.0.smithi055.stderr:+ rm -rf -- ./tmp.fPUBazQAcz 2024-04-26T21:08:36.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:36 smithi055 ceph-mon[25475]: pgmap v8: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 36 MiB/s rd, 53 MiB/s wr, 139 op/s 2024-04-26T21:08:36.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:36 smithi064 ceph-mon[33404]: pgmap v8: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 36 MiB/s rd, 53 MiB/s wr, 139 op/s 2024-04-26T21:08:37.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:37 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:08:37.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:37 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:08:37.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:37 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:08:37.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:37 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:08:37.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:37 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:08:37.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:37 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:08:37.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:37 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:08:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:37 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:08:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:37 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:08:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:37 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/3081149637' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:08:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:38 smithi055 ceph-mon[25475]: pgmap v9: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 42 MiB/s rd, 63 MiB/s wr, 189 op/s 2024-04-26T21:08:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:38 smithi055 ceph-mon[25475]: mgrmap e30: smithi055.ybbowr(active, since 12s), standbys: smithi064.tchyje 2024-04-26T21:08:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:38 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:08:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:38 smithi064 ceph-mon[33404]: pgmap v9: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 42 MiB/s rd, 63 MiB/s wr, 189 op/s 2024-04-26T21:08:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:38 smithi064 ceph-mon[33404]: mgrmap e30: smithi055.ybbowr(active, since 12s), standbys: smithi064.tchyje 2024-04-26T21:08:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:38 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:08:40.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:39 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:40.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:39 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:40.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:39 smithi064 ceph-mon[33404]: pgmap v10: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 58 MiB/s wr, 173 op/s 2024-04-26T21:08:40.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:39 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:40.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:39 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:40.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:39 smithi055 ceph-mon[25475]: pgmap v10: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 58 MiB/s wr, 173 op/s 2024-04-26T21:08:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:40 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:41.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:40 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:42.437 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:42.437 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:42.437 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:42 smithi055 ceph-mon[25475]: pgmap v11: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 58 MiB/s wr, 173 op/s 2024-04-26T21:08:42.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:42 smithi064 ceph-mon[33404]: pgmap v11: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 38 MiB/s rd, 58 MiB/s wr, 173 op/s 2024-04-26T21:08:44.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:44 smithi055 ceph-mon[25475]: pgmap v12: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 39 MiB/s rd, 58 MiB/s wr, 244 op/s 2024-04-26T21:08:44.819 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:44 smithi064 ceph-mon[33404]: pgmap v12: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 39 MiB/s rd, 58 MiB/s wr, 244 op/s 2024-04-26T21:08:46.044 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T21:08:46.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-26T21:08:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:46 smithi055 ceph-mon[25475]: pgmap v13: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 140 op/s 2024-04-26T21:08:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:46 smithi064 ceph-mon[33404]: pgmap v13: 65 pgs: 65 active+clean; 2.3 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 140 op/s 2024-04-26T21:08:48.389 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:08:48.390 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:48 smithi055 ceph-mon[25475]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 204 op/s 2024-04-26T21:08:48.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:08:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:48 smithi064 ceph-mon[33404]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 204 op/s 2024-04-26T21:08:48.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.760+0000 7f7163400700 1 -- 172.21.15.55:0/536647076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 msgr2=0x7f715c1088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:48.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.760+0000 7f7163400700 1 --2- 172.21.15.55:0/536647076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c1088a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7148009910 tx=0x7f7148009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:48.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.761+0000 7f7163400700 1 -- 172.21.15.55:0/536647076 shutdown_connections 2024-04-26T21:08:48.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.761+0000 7f7163400700 1 --2- 172.21.15.55:0/536647076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c1088a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:48.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.761+0000 7f7163400700 1 --2- 172.21.15.55:0/536647076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:48.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.761+0000 7f7163400700 1 -- 172.21.15.55:0/536647076 >> 172.21.15.55:0/536647076 conn(0x7f715c06db80 msgr2=0x7f715c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:48.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.762+0000 7f7163400700 1 -- 172.21.15.55:0/536647076 shutdown_connections 2024-04-26T21:08:48.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.762+0000 7f7163400700 1 -- 172.21.15.55:0/536647076 wait complete. 2024-04-26T21:08:48.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.764+0000 7f7163400700 1 Processor -- start 2024-04-26T21:08:48.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.765+0000 7f7163400700 1 -- start start 2024-04-26T21:08:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7163400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7163400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7163400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c19f990 con 0x7f715c072ab0 2024-04-26T21:08:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7163400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c19fad0 con 0x7f715c108420 2024-04-26T21:08:48.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7160a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:48.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7160a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45412/0 (socket says 172.21.15.55:45412) 2024-04-26T21:08:48.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.766+0000 7f7160a00700 1 -- 172.21.15.55:0/172451421 learned_addr learned my addr 172.21.15.55:0/172451421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:48.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.767+0000 7f715be00700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.767+0000 7f7160a00700 1 -- 172.21.15.55:0/172451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 msgr2=0x7f715c19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.767+0000 7f7160a00700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c19f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.767+0000 7f7160a00700 1 -- 172.21.15.55:0/172451421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71480095f0 con 0x7f715c072ab0 2024-04-26T21:08:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.768+0000 7f7160a00700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f715000e920 tx=0x7f715000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.768+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715000c9d0 con 0x7f715c072ab0 2024-04-26T21:08:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.769+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7150010430 con 0x7f715c072ab0 2024-04-26T21:08:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.769+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7150018630 con 0x7f715c072ab0 2024-04-26T21:08:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.769+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c109050 con 0x7f715c072ab0 2024-04-26T21:08:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.769+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c109620 con 0x7f715c072ab0 2024-04-26T21:08:48.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.771+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c198fc0 con 0x7f715c072ab0 2024-04-26T21:08:48.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.772+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f71500105a0 con 0x7f715c072ab0 2024-04-26T21:08:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.774+0000 7f7159600700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 0x7f7144070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.774+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7150014070 con 0x7f715c072ab0 2024-04-26T21:08:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.775+0000 7f715be00700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 0x7f7144070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:48.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.776+0000 7f715be00700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 0x7f7144070f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f714800b7b0 tx=0x7f7148009f90 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:48.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:48.781+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f7150092030 con 0x7f715c072ab0 2024-04-26T21:08:49.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.261+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f715c02ce50 con 0x7f714406ea80 2024-04-26T21:08:49.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.264+0000 7f7159600700 1 -- 172.21.15.55:0/172451421 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f715c02ce50 con 0x7f714406ea80 2024-04-26T21:08:49.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.266+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 msgr2=0x7f7144070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.266+0000 7f7163400700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 0x7f7144070f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f714800b7b0 tx=0x7f7148009f90 comp rx=0 tx=0).stop 2024-04-26T21:08:49.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.266+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 msgr2=0x7f715c19ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.266+0000 7f7163400700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f715000e920 tx=0x7f715000ec30 comp rx=0 tx=0).stop 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 shutdown_connections 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f714406ea80 0x7f7144070f40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715c072ab0 0x7f715c19ee30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 --2- 172.21.15.55:0/172451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f715c108420 0x7f715c19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 >> 172.21.15.55:0/172451421 conn(0x7f715c06db80 msgr2=0x7f715c10d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:49.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 shutdown_connections 2024-04-26T21:08:49.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.267+0000 7f7163400700 1 -- 172.21.15.55:0/172451421 wait complete. 2024-04-26T21:08:49.286 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:08:49.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.473+0000 7f9f20400700 1 -- 172.21.15.55:0/26332885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 msgr2=0x7f9f180fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.473+0000 7f9f20400700 1 --2- 172.21.15.55:0/26332885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f180fff30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009910 tx=0x7f9f0c009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.473+0000 7f9f20400700 1 -- 172.21.15.55:0/26332885 shutdown_connections 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.474+0000 7f9f20400700 1 --2- 172.21.15.55:0/26332885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 0x7f9f18101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.474+0000 7f9f20400700 1 --2- 172.21.15.55:0/26332885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f180fff30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.474+0000 7f9f20400700 1 -- 172.21.15.55:0/26332885 >> 172.21.15.55:0/26332885 conn(0x7f9f180fb0b0 msgr2=0x7f9f180fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.474+0000 7f9f20400700 1 -- 172.21.15.55:0/26332885 shutdown_connections 2024-04-26T21:08:49.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.474+0000 7f9f20400700 1 -- 172.21.15.55:0/26332885 wait complete. 2024-04-26T21:08:49.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.475+0000 7f9f20400700 1 Processor -- start 2024-04-26T21:08:49.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.476+0000 7f9f20400700 1 -- start start 2024-04-26T21:08:49.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.476+0000 7f9f20400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:49.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.476+0000 7f9f20400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 0x7f9f181949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:49.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.476+0000 7f9f20400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18194fc0 con 0x7f9f18100d10 2024-04-26T21:08:49.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.476+0000 7f9f20400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18195100 con 0x7f9f180ffb10 2024-04-26T21:08:49.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:49.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:48322/0 (socket says 172.21.15.55:48322) 2024-04-26T21:08:49.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 -- 172.21.15.55:0/2693592743 learned_addr learned my addr 172.21.15.55:0/2693592743 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:49.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1d000700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 0x7f9f181949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:49.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 -- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 msgr2=0x7f9f181949a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 0x7f9f181949a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.477+0000 7f9f1da00700 1 -- 172.21.15.55:0/2693592743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0095f0 con 0x7f9f180ffb10 2024-04-26T21:08:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.478+0000 7f9f1da00700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00b800 tx=0x7f9f0c00f510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.479+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0c01d070 con 0x7f9f180ffb10 2024-04-26T21:08:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.479+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f18199ab0 con 0x7f9f180ffb10 2024-04-26T21:08:49.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.479+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f18199f60 con 0x7f9f180ffb10 2024-04-26T21:08:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.479+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f0c00fe70 con 0x7f9f180ffb10 2024-04-26T21:08:49.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.479+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0c017400 con 0x7f9f180ffb10 2024-04-26T21:08:49.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.481+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8005320 con 0x7f9f180ffb10 2024-04-26T21:08:49.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.482+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 30) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f9f0c003810 con 0x7f9f180ffb10 2024-04-26T21:08:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.483+0000 7f9f16000700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 0x7f9f00075340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.483+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f9f0c08ff80 con 0x7f9f180ffb10 2024-04-26T21:08:49.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.484+0000 7f9f1d000700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 0x7f9f00075340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:49.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.486+0000 7f9f1d000700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 0x7f9f00075340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009bf0 tx=0x7f9f04009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:49 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:08:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:49 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:08:49.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.508+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f9f0c05cb50 con 0x7f9f180ffb10 2024-04-26T21:08:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:49 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:08:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:49 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:08:49.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.890+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ef8000bf0 con 0x7f9f00072e80 2024-04-26T21:08:49.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.892+0000 7f9f16000700 1 -- 172.21.15.55:0/2693592743 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f9ef8000bf0 con 0x7f9f00072e80 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 msgr2=0x7f9f00075340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 0x7f9f00075340 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009bf0 tx=0x7f9f04009260 comp rx=0 tx=0).stop 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 msgr2=0x7f9f18194460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00b800 tx=0x7f9f0c00f510 comp rx=0 tx=0).stop 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 shutdown_connections 2024-04-26T21:08:49.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9f00072e80 0x7f9f00075340 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f180ffb10 0x7f9f18194460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 --2- 172.21.15.55:0/2693592743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f18100d10 0x7f9f181949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:49.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.894+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 >> 172.21.15.55:0/2693592743 conn(0x7f9f180fb0b0 msgr2=0x7f9f18104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:49.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.895+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 shutdown_connections 2024-04-26T21:08:49.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:49.895+0000 7f9f20400700 1 -- 172.21.15.55:0/2693592743 wait complete. 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 -- 172.21.15.55:0/1748992841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 msgr2=0x7f27e41002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 --2- 172.21.15.55:0/1748992841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41002f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009910 tx=0x7f27d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 -- 172.21.15.55:0/1748992841 shutdown_connections 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 --2- 172.21.15.55:0/1748992841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41002f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 --2- 172.21.15.55:0/1748992841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27e40ff510 0x7f27e40ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 -- 172.21.15.55:0/1748992841 >> 172.21.15.55:0/1748992841 conn(0x7f27e40fb110 msgr2=0x7f27e40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 -- 172.21.15.55:0/1748992841 shutdown_connections 2024-04-26T21:08:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.082+0000 7f27ea000700 1 -- 172.21.15.55:0/1748992841 wait complete. 2024-04-26T21:08:50.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 Processor -- start 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 -- start start 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27e40ff510 0x7f27e4104f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4101af0 con 0x7f27e40ff510 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.084+0000 7f27ea000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4101c30 con 0x7f27e40ffe70 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:48350/0 (socket says 172.21.15.55:48350) 2024-04-26T21:08:50.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 -- 172.21.15.55:0/1780162962 learned_addr learned my addr 172.21.15.55:0/1780162962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 -- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27e40ff510 msgr2=0x7f27e4104f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27e40ff510 0x7f27e4104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.085+0000 7f27e2a00700 1 -- 172.21.15.55:0/1780162962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00095f0 con 0x7f27e40ffe70 2024-04-26T21:08:50.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.086+0000 7f27e2a00700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006010 tx=0x7f27d000f720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.086+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d001d070 con 0x7f27e40ffe70 2024-04-26T21:08:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.087+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27d00052a0 con 0x7f27e40ffe70 2024-04-26T21:08:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.087+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d0017700 con 0x7f27e40ffe70 2024-04-26T21:08:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.087+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4101e60 con 0x7f27e40ffe70 2024-04-26T21:08:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.087+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4102350 con 0x7f27e40ffe70 2024-04-26T21:08:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.088+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e4192a00 con 0x7f27e40ffe70 2024-04-26T21:08:50.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.090+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 30) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f27d000fb50 con 0x7f27e40ffe70 2024-04-26T21:08:50.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.092+0000 7f27dbe00700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 0x7f27c8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.092+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f27d00903e0 con 0x7f27e40ffe70 2024-04-26T21:08:50.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.092+0000 7f27e3400700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 0x7f27c8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:50.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.093+0000 7f27e3400700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 0x7f27c8070f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005950 tx=0x7f27d40058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:50.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.095+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f27d005d030 con 0x7f27e40ffe70 2024-04-26T21:08:50.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.430+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e410bc60 con 0x7f27c806ea70 2024-04-26T21:08:50.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.443+0000 7f27dbe00700 1 -- 172.21.15.55:0/1780162962 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f27e410bc60 con 0x7f27c806ea70 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1023 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:50.445 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:50 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (10m) 11s ago 12m 13.6M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (12m) 11s ago 12m 7952k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (11m) 19s ago 11m 7796k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (12m) 11s ago 12m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (11m) 19s ago 11m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (10m) 11s ago 11m 75.4M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (4m) 11s ago 4m 225M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (4m) 11s ago 4m 14.1M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:08:50.447 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (4m) 19s ago 4m 145M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (4m) 19s ago 4m 14.1M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (70s) 11s ago 14m 478M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (2m) 19s ago 10m 77.6M - 19.0.0-3306-gbc612ffb 55dc54019ad8 a10bf33fff03 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (14m) 11s ago 14m 52.6M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (10m) 19s ago 10m 40.4M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (12m) 11s ago 12m 8363k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (11m) 19s ago 10m 7805k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (9m) 11s ago 9m 229M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (9m) 11s ago 9m 240M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (8m) 11s ago 8m 178M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (7m) 19s ago 7m 241M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (7m) 19s ago 7m 221M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (6m) 19s ago 6m 215M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:08:50.448 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (79s) 11s ago 11m 49.5M - 2.43.0 a07b618ecd1d a6982e8442fa 2024-04-26T21:08:50.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.446+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 msgr2=0x7f27c8070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.446+0000 7f27ea000700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 0x7f27c8070f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005950 tx=0x7f27d40058e0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.446+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 msgr2=0x7f27e41054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.446+0000 7f27ea000700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006010 tx=0x7f27d000f720 comp rx=0 tx=0).stop 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.448+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 shutdown_connections 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.448+0000 7f27ea000700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f27c806ea70 0x7f27c8070f30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.448+0000 7f27ea000700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27e40ff510 0x7f27e4104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.448+0000 7f27ea000700 1 --2- 172.21.15.55:0/1780162962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ffe70 0x7f27e41054c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.448+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 >> 172.21.15.55:0/1780162962 conn(0x7f27e40fb110 msgr2=0x7f27e4107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:50.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.449+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 shutdown_connections 2024-04-26T21:08:50.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.449+0000 7f27ea000700 1 -- 172.21.15.55:0/1780162962 wait complete. 2024-04-26T21:08:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.614+0000 7f2e03000700 1 -- 172.21.15.55:0/616335420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 msgr2=0x7f2dfc100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.614+0000 7f2e03000700 1 --2- 172.21.15.55:0/616335420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc100e90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009910 tx=0x7f2df0009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 -- 172.21.15.55:0/616335420 shutdown_connections 2024-04-26T21:08:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 --2- 172.21.15.55:0/616335420 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 --2- 172.21.15.55:0/616335420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc100e90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 -- 172.21.15.55:0/616335420 >> 172.21.15.55:0/616335420 conn(0x7f2dfc0fc050 msgr2=0x7f2dfc0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 -- 172.21.15.55:0/616335420 shutdown_connections 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.615+0000 7f2e03000700 1 -- 172.21.15.55:0/616335420 wait complete. 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.616+0000 7f2e03000700 1 Processor -- start 2024-04-26T21:08:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.616+0000 7f2e03000700 1 -- start start 2024-04-26T21:08:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e03000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e03000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e03000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc199210 con 0x7f2dfc100a70 2024-04-26T21:08:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e03000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc199350 con 0x7f2dfc101c70 2024-04-26T21:08:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e01c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e01c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45446/0 (socket says 172.21.15.55:45446) 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.617+0000 7f2e01c00700 1 -- 172.21.15.55:0/3932653557 learned_addr learned my addr 172.21.15.55:0/3932653557 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01200700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01c00700 1 -- 172.21.15.55:0/3932653557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 msgr2=0x7f2dfc198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01c00700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01c00700 1 -- 172.21.15.55:0/3932653557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df00095f0 con 0x7f2dfc100a70 2024-04-26T21:08:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01c00700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2df000b800 tx=0x7f2df000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e01200700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:08:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2df001d070 con 0x7f2dfc100a70 2024-04-26T21:08:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2df000fe70 con 0x7f2dfc100a70 2024-04-26T21:08:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.618+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc19dd00 con 0x7f2dfc100a70 2024-04-26T21:08:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.619+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc19e220 con 0x7f2dfc100a70 2024-04-26T21:08:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.619+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2df0017400 con 0x7f2dfc100a70 2024-04-26T21:08:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.620+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc005320 con 0x7f2dfc100a70 2024-04-26T21:08:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.621+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f2df00037f0 con 0x7f2dfc100a70 2024-04-26T21:08:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.622+0000 7f2dfa000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 0x7f2de4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.622+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2df008fff0 con 0x7f2dfc100a70 2024-04-26T21:08:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.623+0000 7f2e01200700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 0x7f2de4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.623+0000 7f2e01200700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 0x7f2de4070f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009be0 tx=0x7f2de8009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:50.628+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f2df005cc00 con 0x7f2dfc100a70 2024-04-26T21:08:50.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1023 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:50 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.003+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ddc0058a0 con 0x7f2dfc100a70 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.003+0000 7f2dfa000700 1 -- 172.21.15.55:0/3932653557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f2df005c790 con 0x7f2dfc100a70 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:51.005 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:08:51.006 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:08:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.006+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 msgr2=0x7f2de4070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.006+0000 7f2e03000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 0x7f2de4070f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009be0 tx=0x7f2de8009260 comp rx=0 tx=0).stop 2024-04-26T21:08:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.006+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 msgr2=0x7f2dfc1986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.006+0000 7f2e03000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2df000b800 tx=0x7f2df000f510 comp rx=0 tx=0).stop 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 shutdown_connections 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f2de406ea70 0x7f2de4070f30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc100a70 0x7f2dfc1986b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 --2- 172.21.15.55:0/3932653557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2dfc101c70 0x7f2dfc198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 >> 172.21.15.55:0/3932653557 conn(0x7f2dfc0fc050 msgr2=0x7f2dfc103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 shutdown_connections 2024-04-26T21:08:51.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.007+0000 7f2e03000700 1 -- 172.21.15.55:0/3932653557 wait complete. 2024-04-26T21:08:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.259+0000 7f3aaac00700 1 -- 172.21.15.55:0/2114717552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 msgr2=0x7f3aa4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.259+0000 7f3aaac00700 1 --2- 172.21.15.55:0/2114717552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 0x7f3aa4103b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009910 tx=0x7f3a94009c20 comp rx=0 tx=0).stop 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.260+0000 7f3aaac00700 1 -- 172.21.15.55:0/2114717552 shutdown_connections 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.260+0000 7f3aaac00700 1 --2- 172.21.15.55:0/2114717552 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.260+0000 7f3aaac00700 1 --2- 172.21.15.55:0/2114717552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 0x7f3aa4103b10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.260+0000 7f3aaac00700 1 -- 172.21.15.55:0/2114717552 >> 172.21.15.55:0/2114717552 conn(0x7f3aa40fb110 msgr2=0x7f3aa40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.260+0000 7f3aaac00700 1 -- 172.21.15.55:0/2114717552 shutdown_connections 2024-04-26T21:08:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.261+0000 7f3aaac00700 1 -- 172.21.15.55:0/2114717552 wait complete. 2024-04-26T21:08:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.262+0000 7f3aaac00700 1 Processor -- start 2024-04-26T21:08:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.264+0000 7f3aaac00700 1 -- start start 2024-04-26T21:08:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.264+0000 7f3aaac00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 0x7f3aa4194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.264+0000 7f3aaac00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.264+0000 7f3aaac00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4194f10 con 0x7f3aa4101720 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.264+0000 7f3aaac00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa4195050 con 0x7f3aa4104050 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.265+0000 7f3aa3400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.265+0000 7f3aa3400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:48404/0 (socket says 172.21.15.55:48404) 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.265+0000 7f3aa3400700 1 -- 172.21.15.55:0/4072428077 learned_addr learned my addr 172.21.15.55:0/4072428077 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:08:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.265+0000 7f3aa3400700 1 -- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 msgr2=0x7f3aa4194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.266+0000 7f3aa3400700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 0x7f3aa4194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.266+0000 7f3aa3400700 1 -- 172.21.15.55:0/4072428077 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940095f0 con 0x7f3aa4104050 2024-04-26T21:08:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.266+0000 7f3aa3400700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000c930 tx=0x7f3a9000ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.266+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a90007ad0 con 0x7f3aa4104050 2024-04-26T21:08:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.267+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a90007c30 con 0x7f3aa4104050 2024-04-26T21:08:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.267+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa4199ac0 con 0x7f3aa4104050 2024-04-26T21:08:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.267+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa4199fe0 con 0x7f3aa4104050 2024-04-26T21:08:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.267+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a90018610 con 0x7f3aa4104050 2024-04-26T21:08:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.271+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a840052f0 con 0x7f3aa4104050 2024-04-26T21:08:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.279+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 30) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f3a900188b0 con 0x7f3aa4104050 2024-04-26T21:08:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.281+0000 7f3aa0c00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 0x7f3a88070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:08:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.281+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f3a9008eb40 con 0x7f3aa4104050 2024-04-26T21:08:51.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.282+0000 7f3aa3e00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 0x7f3a88070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:08:51.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.284+0000 7f3aa3e00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 0x7f3a88070f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b5c0 tx=0x7f3a94005160 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:08:51.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.294+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f3a9005b850 con 0x7f3aa4104050 2024-04-26T21:08:51.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.644+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a84000bc0 con 0x7f3a8806eac0 2024-04-26T21:08:51.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:51.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.647 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.647 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.647 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:51.647 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:51 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3932653557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.646+0000 7f3aa0c00700 1 -- 172.21.15.55:0/4072428077 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f3a84000bc0 con 0x7f3a8806eac0 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:08:51.648 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:08:51.649 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-26T21:08:51.649 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:08:51.649 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:08:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.650+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 msgr2=0x7f3a88070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.650+0000 7f3aaac00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 0x7f3a88070f80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b5c0 tx=0x7f3a94005160 comp rx=0 tx=0).stop 2024-04-26T21:08:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.650+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 msgr2=0x7f3aa4194980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:08:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.650+0000 7f3aaac00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000c930 tx=0x7f3a9000ccf0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.651+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 shutdown_connections 2024-04-26T21:08:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.651+0000 7f3aaac00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f3a8806eac0 0x7f3a88070f80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.651+0000 7f3aaac00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aa4101720 0x7f3aa4194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.651+0000 7f3aaac00700 1 --2- 172.21.15.55:0/4072428077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aa4104050 0x7f3aa4194980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:08:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.651+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 >> 172.21.15.55:0/4072428077 conn(0x7f3aa40fb110 msgr2=0x7f3aa4100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:08:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.652+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 shutdown_connections 2024-04-26T21:08:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:08:51.652+0000 7f3aaac00700 1 -- 172.21.15.55:0/4072428077 wait complete. 2024-04-26T21:08:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:08:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:51 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3932653557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:08:52.605 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:52 smithi055 ceph-mon[25475]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T21:08:52.605 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:52 smithi055 ceph-mon[25475]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T21:08:52.605 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:52 smithi055 ceph-mon[25475]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1023 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-04-26T21:08:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:52 smithi064 ceph-mon[33404]: Reconfiguring prometheus.smithi055 (dependencies changed)... 2024-04-26T21:08:52.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:52 smithi064 ceph-mon[33404]: Reconfiguring daemon prometheus.smithi055 on smithi055 2024-04-26T21:08:52.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:52 smithi064 ceph-mon[33404]: pgmap v16: 65 pgs: 65 active+clean; 1.3 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 1023 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-04-26T21:08:53.596 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:53 smithi055 ceph-mon[25475]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:53 smithi064 ceph-mon[33404]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:08:54.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:54 smithi055 ceph-mon[25475]: pgmap v17: 65 pgs: 65 active+clean; 756 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 217 op/s 2024-04-26T21:08:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:54 smithi064 ceph-mon[33404]: pgmap v17: 65 pgs: 65 active+clean; 756 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 217 op/s 2024-04-26T21:08:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:56 smithi055 ceph-mon[25475]: pgmap v18: 65 pgs: 65 active+clean; 756 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-04-26T21:08:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:56.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:56 smithi064 ceph-mon[33404]: pgmap v18: 65 pgs: 65 active+clean; 756 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-04-26T21:08:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:08:58.482 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T21:08:58.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T21:08:58.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:08:58 smithi055 ceph-mon[25475]: pgmap v19: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-04-26T21:08:58.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:08:58 smithi064 ceph-mon[33404]: pgmap v19: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 181 op/s 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:00 smithi055 ceph-mon[25475]: pgmap v20: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 116 op/s 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:00 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:00 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:00 smithi064 ceph-mon[33404]: pgmap v20: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 116 op/s 2024-04-26T21:09:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:00 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:00 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:09:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:01.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:01 smithi055 ceph-mon[25475]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:09:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:01 smithi064 ceph-mon[33404]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:09:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:02 smithi055 ceph-mon[25475]: pgmap v21: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 116 op/s 2024-04-26T21:09:02.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:02 smithi064 ceph-mon[33404]: pgmap v21: 65 pgs: 65 active+clean; 548 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 116 op/s 2024-04-26T21:09:03.769 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:09:03.769 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:03 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:09:03.769 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:09:03.769 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:03.810 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:09:03.810 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:03 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:09:03.810 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:09:03.810 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:04.900 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:04 smithi064 ceph-mon[33404]: Upgrade: Updating mgr.smithi064.tchyje 2024-04-26T21:09:04.901 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:04 smithi064 ceph-mon[33404]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:09:04.901 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:04 smithi064 ceph-mon[33404]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 228 op/s 2024-04-26T21:09:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:04 smithi055 ceph-mon[25475]: Upgrade: Updating mgr.smithi064.tchyje 2024-04-26T21:09:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:04 smithi055 ceph-mon[25475]: Deploying daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:09:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:04 smithi055 ceph-mon[25475]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 228 op/s 2024-04-26T21:09:06.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:06 smithi064 ceph-mon[33404]: pgmap v23: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 147 op/s 2024-04-26T21:09:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:06 smithi055 ceph-mon[25475]: pgmap v23: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 147 op/s 2024-04-26T21:09:08.830 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:08 smithi064 ceph-mon[33404]: pgmap v24: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 190 op/s 2024-04-26T21:09:08.911 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:08 smithi055 ceph-mon[25475]: pgmap v24: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 190 op/s 2024-04-26T21:09:10.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:09 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:10.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:09 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:10.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:09 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:10.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:09 smithi064 ceph-mon[33404]: pgmap v25: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-04-26T21:09:10.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:09 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:10.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:09 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:10.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:09 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:10.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:09 smithi055 ceph-mon[25475]: pgmap v25: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-04-26T21:09:10.957 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:10 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:11.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:10 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:12.095 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:11 smithi064 ceph-mon[33404]: pgmap v26: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-04-26T21:09:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:11 smithi055 ceph-mon[25475]: pgmap v26: 65 pgs: 65 active+clean; 321 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-04-26T21:09:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:14 smithi055 ceph-mon[25475]: pgmap v27: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-26T21:09:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:14 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:14 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:14 smithi064 ceph-mon[33404]: pgmap v27: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 244 op/s 2024-04-26T21:09:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:14 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:14 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:16.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:16 smithi055 ceph-mon[25475]: pgmap v28: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 132 op/s 2024-04-26T21:09:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:16 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:16 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:16 smithi064 ceph-mon[33404]: pgmap v28: 65 pgs: 65 active+clean; 327 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 132 op/s 2024-04-26T21:09:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:16 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:16 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:18.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:18 smithi064 ceph-mon[33404]: pgmap v29: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 231 op/s 2024-04-26T21:09:18.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:18 smithi055 ceph-mon[25475]: pgmap v29: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 231 op/s 2024-04-26T21:09:19.495 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:09:19.495 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:09:19.495 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:09:19.496 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:09:19.496 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:09:19.496 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:19 smithi055 ceph-mon[25475]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:09:19.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:19 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2606709648' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:09:20.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:20 smithi064 ceph-mon[33404]: pgmap v30: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-04-26T21:09:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:20 smithi064 ceph-mon[33404]: mgrmap e31: smithi055.ybbowr(active, since 54s), standbys: smithi064.tchyje 2024-04-26T21:09:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:20 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:20.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:20 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:21.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:20 smithi055 ceph-mon[25475]: pgmap v30: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-04-26T21:09:21.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:20 smithi055 ceph-mon[25475]: mgrmap e31: smithi055.ybbowr(active, since 54s), standbys: smithi064.tchyje 2024-04-26T21:09:21.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:20 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:21.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:20 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 -- 172.21.15.55:0/2809970930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ffe70 msgr2=0x7f36fc1002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 --2- 172.21.15.55:0/2809970930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ffe70 0x7f36fc1002f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009910 tx=0x7f36e8009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 -- 172.21.15.55:0/2809970930 shutdown_connections 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 --2- 172.21.15.55:0/2809970930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ffe70 0x7f36fc1002f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 --2- 172.21.15.55:0/2809970930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ff510 0x7f36fc0ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.853+0000 7f3702c00700 1 -- 172.21.15.55:0/2809970930 >> 172.21.15.55:0/2809970930 conn(0x7f36fc0fb110 msgr2=0x7f36fc0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.854+0000 7f3702c00700 1 -- 172.21.15.55:0/2809970930 shutdown_connections 2024-04-26T21:09:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.854+0000 7f3702c00700 1 -- 172.21.15.55:0/2809970930 wait complete. 2024-04-26T21:09:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.855+0000 7f3702c00700 1 Processor -- start 2024-04-26T21:09:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f3702c00700 1 -- start start 2024-04-26T21:09:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f3702c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f3702c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 0x7f36fc198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f3702c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc199480 con 0x7f36fc0ff510 2024-04-26T21:09:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f3702c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1995c0 con 0x7f36fc0ffe70 2024-04-26T21:09:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f36fbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f36fbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38868/0 (socket says 172.21.15.55:38868) 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.856+0000 7f36fbe00700 1 -- 172.21.15.55:0/1357402742 learned_addr learned my addr 172.21.15.55:0/1357402742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fb400700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 0x7f36fc198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fbe00700 1 -- 172.21.15.55:0/1357402742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 msgr2=0x7f36fc198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fbe00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 0x7f36fc198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fbe00700 1 -- 172.21.15.55:0/1357402742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80095f0 con 0x7f36fc0ff510 2024-04-26T21:09:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fb400700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 0x7f36fc198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.857+0000 7f36fbe00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b4b0 tx=0x7f36ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.858+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec011800 con 0x7f36fc0ff510 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.858+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36ec011e20 con 0x7f36fc0ff510 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.858+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ec00f2e0 con 0x7f36fc0ff510 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.858+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc19dfd0 con 0x7f36fc0ff510 2024-04-26T21:09:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.858+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc19e510 con 0x7f36fc0ff510 2024-04-26T21:09:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.860+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc192a80 con 0x7f36fc0ff510 2024-04-26T21:09:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.861+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f36ec010380 con 0x7f36fc0ff510 2024-04-26T21:09:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.862+0000 7f36f8c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 0x7f36e0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.862+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f36ec08e880 con 0x7f36fc0ff510 2024-04-26T21:09:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.863+0000 7f36fb400700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 0x7f36e0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.864+0000 7f36fb400700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 0x7f36e0070f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36e80059d0 tx=0x7f36e8005960 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:21.870+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f36ec05b6a0 con 0x7f36fc0ff510 2024-04-26T21:09:22.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.214+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36fc02ce80 con 0x7f36e006ea80 2024-04-26T21:09:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.216+0000 7f36f8c00700 1 -- 172.21.15.55:0/1357402742 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f36fc02ce80 con 0x7f36e006ea80 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.219+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 msgr2=0x7f36e0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.219+0000 7f3702c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 0x7f36e0070f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f36e80059d0 tx=0x7f36e8005960 comp rx=0 tx=0).stop 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.219+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 msgr2=0x7f36fc198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.219+0000 7f3702c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b4b0 tx=0x7f36ec00b870 comp rx=0 tx=0).stop 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 shutdown_connections 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f36e006ea80 0x7f36e0070f40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36fc0ff510 0x7f36fc198920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 --2- 172.21.15.55:0/1357402742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36fc0ffe70 0x7f36fc198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 >> 172.21.15.55:0/1357402742 conn(0x7f36fc0fb110 msgr2=0x7f36fc107f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 shutdown_connections 2024-04-26T21:09:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.220+0000 7f3702c00700 1 -- 172.21.15.55:0/1357402742 wait complete. 2024-04-26T21:09:22.242 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 -- 172.21.15.55:0/1783203896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 msgr2=0x7f65f0103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1783203896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0103260 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009910 tx=0x7f65e0009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 -- 172.21.15.55:0/1783203896 shutdown_connections 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1783203896 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1783203896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0103260 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 -- 172.21.15.55:0/1783203896 >> 172.21.15.55:0/1783203896 conn(0x7f65f00fe3e0 msgr2=0x7f65f0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 -- 172.21.15.55:0/1783203896 shutdown_connections 2024-04-26T21:09:22.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.438+0000 7f65f6a00700 1 -- 172.21.15.55:0/1783203896 wait complete. 2024-04-26T21:09:22.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.440+0000 7f65f6a00700 1 Processor -- start 2024-04-26T21:09:22.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.440+0000 7f65f6a00700 1 -- start start 2024-04-26T21:09:22.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65f6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:22.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65f6a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65f6a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01992d0 con 0x7f65f0102e40 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65f6a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0199410 con 0x7f65f0103fa0 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65efe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65efe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38890/0 (socket says 172.21.15.55:38890) 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65efe00700 1 -- 172.21.15.55:0/1713786467 learned_addr learned my addr 172.21.15.55:0/1713786467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.441+0000 7f65ef400700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.442+0000 7f65efe00700 1 -- 172.21.15.55:0/1713786467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 msgr2=0x7f65f0198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.442+0000 7f65efe00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.442+0000 7f65efe00700 1 -- 172.21.15.55:0/1713786467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00095f0 con 0x7f65f0102e40 2024-04-26T21:09:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.442+0000 7f65ef400700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.442+0000 7f65efe00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65e000bd70 tx=0x7f65e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.443+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e001d070 con 0x7f65f0102e40 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.443+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f019ddd0 con 0x7f65f0102e40 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.443+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f019e2b0 con 0x7f65f0102e40 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.443+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65e000f460 con 0x7f65f0102e40 2024-04-26T21:09:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.443+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e0021620 con 0x7f65f0102e40 2024-04-26T21:09:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.445+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0005320 con 0x7f65f0102e40 2024-04-26T21:09:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.445+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f65e002b440 con 0x7f65f0102e40 2024-04-26T21:09:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.446+0000 7f65ecc00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 0x7f65d4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.446+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f65e008fdd0 con 0x7f65f0102e40 2024-04-26T21:09:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.447+0000 7f65ef400700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 0x7f65d4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.448+0000 7f65ef400700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 0x7f65d4070f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f65dc005fd0 tx=0x7f65dc005e30 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.454+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f65e005daf0 con 0x7f65f0102e40 2024-04-26T21:09:22.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.810+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65d0000bf0 con 0x7f65d406ea70 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: pgmap v31: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 197 op/s 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.812 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]': finished 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]': finished 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:22.813 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.812+0000 7f65ecc00700 1 -- 172.21.15.55:0/1713786467 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f65d0000bf0 con 0x7f65d406ea70 2024-04-26T21:09:22.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.814+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 msgr2=0x7f65d4070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.814+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 0x7f65d4070f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f65dc005fd0 tx=0x7f65dc005e30 comp rx=0 tx=0).stop 2024-04-26T21:09:22.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.814+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 msgr2=0x7f65f0198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:22.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.814+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65e000bd70 tx=0x7f65e000be50 comp rx=0 tx=0).stop 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 shutdown_connections 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f65d406ea70 0x7f65d4070f30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65f0102e40 0x7f65f0198800 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 --2- 172.21.15.55:0/1713786467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f65f0103fa0 0x7f65f0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 >> 172.21.15.55:0/1713786467 conn(0x7f65f00fe3e0 msgr2=0x7f65f0107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 shutdown_connections 2024-04-26T21:09:22.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:22.815+0000 7f65f6a00700 1 -- 172.21.15.55:0/1713786467 wait complete. 2024-04-26T21:09:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: pgmap v31: 65 pgs: 65 active+clean; 331 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 197 op/s 2024-04-26T21:09:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi055.ybbowr"}]': finished 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi064.tchyje"}]': finished 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:22.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 -- 172.21.15.55:0/1186416631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c0ffb90 msgr2=0x7f6e7c0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 --2- 172.21.15.55:0/1186416631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c0fffb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009910 tx=0x7f6e6c009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 -- 172.21.15.55:0/1186416631 shutdown_connections 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 --2- 172.21.15.55:0/1186416631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c100d90 0x7f6e7c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 --2- 172.21.15.55:0/1186416631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c0fffb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 -- 172.21.15.55:0/1186416631 >> 172.21.15.55:0/1186416631 conn(0x7f6e7c0fb110 msgr2=0x7f6e7c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:23.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 -- 172.21.15.55:0/1186416631 shutdown_connections 2024-04-26T21:09:23.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.004+0000 7f6e81e00700 1 -- 172.21.15.55:0/1186416631 wait complete. 2024-04-26T21:09:23.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.006+0000 7f6e81e00700 1 Processor -- start 2024-04-26T21:09:23.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.006+0000 7f6e81e00700 1 -- start start 2024-04-26T21:09:23.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.006+0000 7f6e81e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e81e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e81e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c1993b0 con 0x7f6e7c100d90 2024-04-26T21:09:23.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e81e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c1994f0 con 0x7f6e7c0ffb90 2024-04-26T21:09:23.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e7a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e7a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38902/0 (socket says 172.21.15.55:38902) 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e7a000700 1 -- 172.21.15.55:0/2080257807 learned_addr learned my addr 172.21.15.55:0/2080257807 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.007+0000 7f6e7aa00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e7a000700 1 -- 172.21.15.55:0/2080257807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c0ffb90 msgr2=0x7f6e7c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e7a000700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e7a000700 1 -- 172.21.15.55:0/2080257807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0095f0 con 0x7f6e7c100d90 2024-04-26T21:09:23.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e7a000700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c930 tx=0x7f6e6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:23.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e68007ad0 con 0x7f6e7c100d90 2024-04-26T21:09:23.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.008+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c19df60 con 0x7f6e7c100d90 2024-04-26T21:09:23.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.009+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c19e480 con 0x7f6e7c100d90 2024-04-26T21:09:23.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.009+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e6800ce80 con 0x7f6e7c100d90 2024-04-26T21:09:23.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.009+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e68018630 con 0x7f6e7c100d90 2024-04-26T21:09:23.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.010+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c0052f0 con 0x7f6e7c100d90 2024-04-26T21:09:23.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.013+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f6e68007c30 con 0x7f6e7c100d90 2024-04-26T21:09:23.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.014+0000 7f6e80a00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 0x7f6e60070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.014+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6e6808ea00 con 0x7f6e7c100d90 2024-04-26T21:09:23.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.015+0000 7f6e7aa00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 0x7f6e60070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.016+0000 7f6e7aa00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 0x7f6e60070f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c005090 tx=0x7f6e6c005180 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:23.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.022+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f6e6805b5d0 con 0x7f6e7c100d90 2024-04-26T21:09:23.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.358+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e5c000bc0 con 0x7f6e6006eac0 2024-04-26T21:09:23.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.374+0000 7f6e80a00700 1 -- 172.21.15.55:0/2080257807 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f6e5c000bc0 con 0x7f6e6006eac0 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (10m) 3s ago 12m 13.7M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (13m) 3s ago 13m 8010k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (11m) 9s ago 11m 7847k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (13m) 3s ago 13m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (11m) 9s ago 11m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:09:23.376 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (10m) 3s ago 12m 76.3M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (5m) 3s ago 5m 229M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (5m) 3s ago 5m 14.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (5m) 9s ago 5m 156M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (5m) 9s ago 5m 14.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (103s) 3s ago 14m 494M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (15s) 9s ago 11m 70.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (14m) 3s ago 15m 53.1M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (11m) 9s ago 11m 42.1M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (13m) 3s ago 13m 8066k - 1.5.0 0da6a335fe13 f3c47b99b177 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (11m) 9s ago 11m 8040k - 1.5.0 0da6a335fe13 e49bea6a07d1 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (10m) 3s ago 10m 201M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (9m) 3s ago 9m 213M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (9m) 3s ago 8m 175M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (8m) 9s ago 8m 235M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:09:23.377 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (7m) 9s ago 7m 215M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:09:23.378 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (7m) 9s ago 7m 192M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:09:23.378 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (24s) 3s ago 12m 44.6M - 2.43.0 a07b618ecd1d ce325cafb6b4 2024-04-26T21:09:23.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 msgr2=0x7f6e60070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 0x7f6e60070f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c005090 tx=0x7f6e6c005180 comp rx=0 tx=0).stop 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 msgr2=0x7f6e7c198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c930 tx=0x7f6e6800cc40 comp rx=0 tx=0).stop 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 shutdown_connections 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6e6006eac0 0x7f6e60070f80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7c0ffb90 0x7f6e7c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 --2- 172.21.15.55:0/2080257807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e7c100d90 0x7f6e7c198e20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.377+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 >> 172.21.15.55:0/2080257807 conn(0x7f6e7c0fb110 msgr2=0x7f6e7c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.378+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 shutdown_connections 2024-04-26T21:09:23.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.378+0000 7f6e81e00700 1 -- 172.21.15.55:0/2080257807 wait complete. 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 -- 172.21.15.55:0/71449784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 msgr2=0x7f7144106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 --2- 172.21.15.55:0/71449784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144106440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7130009910 tx=0x7f7130009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 -- 172.21.15.55:0/71449784 shutdown_connections 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 --2- 172.21.15.55:0/71449784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144106440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 --2- 172.21.15.55:0/71449784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 0x7f7144103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 -- 172.21.15.55:0/71449784 >> 172.21.15.55:0/71449784 conn(0x7f71440fb110 msgr2=0x7f71440fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.579+0000 7f714ba00700 1 -- 172.21.15.55:0/71449784 shutdown_connections 2024-04-26T21:09:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.580+0000 7f714ba00700 1 -- 172.21.15.55:0/71449784 wait complete. 2024-04-26T21:09:23.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.581+0000 7f714ba00700 1 Processor -- start 2024-04-26T21:09:23.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.582+0000 7f714ba00700 1 -- start start 2024-04-26T21:09:23.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.583+0000 7f714ba00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 0x7f7144198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.583+0000 7f714ba00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.583+0000 7f714ba00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71441993d0 con 0x7f7144101720 2024-04-26T21:09:23.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.583+0000 7f714ba00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144199510 con 0x7f7144104050 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.584+0000 7f713be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.584+0000 7f7149000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 0x7f7144198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.584+0000 7f713be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:40756/0 (socket says 172.21.15.55:40756) 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.584+0000 7f713be00700 1 -- 172.21.15.55:0/3181735439 learned_addr learned my addr 172.21.15.55:0/3181735439 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.585+0000 7f713be00700 1 -- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 msgr2=0x7f7144198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.585+0000 7f713be00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 0x7f7144198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.585+0000 7f713be00700 1 -- 172.21.15.55:0/3181735439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300095f0 con 0x7f7144104050 2024-04-26T21:09:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.585+0000 7f713be00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f713000b800 tx=0x7f713000b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.585+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f713001d070 con 0x7f7144104050 2024-04-26T21:09:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.586+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f713000fe00 con 0x7f7144104050 2024-04-26T21:09:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.586+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7130017400 con 0x7f7144104050 2024-04-26T21:09:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.586+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714419df10 con 0x7f7144104050 2024-04-26T21:09:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.586+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714419e3d0 con 0x7f7144104050 2024-04-26T21:09:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.588+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71440fcd00 con 0x7f7144104050 2024-04-26T21:09:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.590+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f7130003780 con 0x7f7144104050 2024-04-26T21:09:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.591+0000 7f7142000700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 0x7f7120070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:23.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.592+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7130090230 con 0x7f7144104050 2024-04-26T21:09:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.596+0000 7f7149000700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 0x7f7120070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.599+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f713005ce80 con 0x7f7144104050 2024-04-26T21:09:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:23.603+0000 7f7149000700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 0x7f7120070f80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7128009bf0 tx=0x7f7128009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all mgr 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all rgw 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all nfs 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:09:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:23 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all mgr 2024-04-26T21:09:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all rgw 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all nfs 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:09:23.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:23 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.077+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f71441097f0 con 0x7f7144104050 2024-04-26T21:09:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.079+0000 7f7142000700 1 -- 172.21.15.55:0/3181735439 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f713005ca10 con 0x7f7144104050 2024-04-26T21:09:24.080 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:09:24.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:09:24.080 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:09:24.080 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:09:24.081 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:09:24.082 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:09:24.082 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:09:24.082 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.081+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 msgr2=0x7f7120070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.081+0000 7f714ba00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 0x7f7120070f80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7128009bf0 tx=0x7f7128009260 comp rx=0 tx=0).stop 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.081+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 msgr2=0x7f7144198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.081+0000 7f714ba00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f713000b800 tx=0x7f713000b610 comp rx=0 tx=0).stop 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.081+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 shutdown_connections 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f712006eac0 0x7f7120070f80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144101720 0x7f7144198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 --2- 172.21.15.55:0/3181735439 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7144104050 0x7f7144198db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 >> 172.21.15.55:0/3181735439 conn(0x7f71440fb110 msgr2=0x7f7144101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 shutdown_connections 2024-04-26T21:09:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.082+0000 7f714ba00700 1 -- 172.21.15.55:0/3181735439 wait complete. 2024-04-26T21:09:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 -- 172.21.15.55:0/2092863960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 msgr2=0x7f1e14103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 --2- 172.21.15.55:0/2092863960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14103b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009910 tx=0x7f1e04009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 -- 172.21.15.55:0/2092863960 shutdown_connections 2024-04-26T21:09:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 --2- 172.21.15.55:0/2092863960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e14104050 0x7f1e14106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 --2- 172.21.15.55:0/2092863960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14103b10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.277+0000 7f1e19200700 1 -- 172.21.15.55:0/2092863960 >> 172.21.15.55:0/2092863960 conn(0x7f1e140fb110 msgr2=0x7f1e140fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.278+0000 7f1e19200700 1 -- 172.21.15.55:0/2092863960 shutdown_connections 2024-04-26T21:09:24.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.278+0000 7f1e19200700 1 -- 172.21.15.55:0/2092863960 wait complete. 2024-04-26T21:09:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 Processor -- start 2024-04-26T21:09:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 -- start start 2024-04-26T21:09:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:24.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e14104050 0x7f1e14198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14199390 con 0x7f1e14101720 2024-04-26T21:09:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.279+0000 7f1e19200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e141994d0 con 0x7f1e14104050 2024-04-26T21:09:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38930/0 (socket says 172.21.15.55:38930) 2024-04-26T21:09:24.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 -- 172.21.15.55:0/1977875943 learned_addr learned my addr 172.21.15.55:0/1977875943 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 -- 172.21.15.55:0/1977875943 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e14104050 msgr2=0x7f1e14198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e14104050 0x7f1e14198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.280+0000 7f1e11e00700 1 -- 172.21.15.55:0/1977875943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040095f0 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e11e00700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b650 tx=0x7f1e0400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0401d070 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e0400fe70 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e04017400 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1419ded0 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.281+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1419e370 con 0x7f1e14101720 2024-04-26T21:09:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.283+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1404ebb0 con 0x7f1e14101720 2024-04-26T21:09:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.284+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f1e04003810 con 0x7f1e14101720 2024-04-26T21:09:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.285+0000 7f1e0aa00700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 0x7f1df8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.285+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1e0408ffc0 con 0x7f1e14101720 2024-04-26T21:09:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.288+0000 7f1e11400700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 0x7f1df8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.288+0000 7f1e11400700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 0x7f1df8070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1e00005950 tx=0x7f1e000058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.296+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f1e040c4f60 con 0x7f1e14101720 2024-04-26T21:09:24.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.715+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e140fcc80 con 0x7f1df806ea70 2024-04-26T21:09:24.717 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:24 smithi055 ceph-mon[25475]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:24.717 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:24 smithi055 ceph-mon[25475]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:24.717 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:24 smithi055 ceph-mon[25475]: pgmap v32: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 311 op/s 2024-04-26T21:09:24.717 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:24 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3181735439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:24.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.717+0000 7f1e0aa00700 1 -- 172.21.15.55:0/1977875943 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f1e140fcc80 con 0x7f1df806ea70 2024-04-26T21:09:24.718 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:09:24.719 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:09:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 msgr2=0x7f1df8070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 0x7f1df8070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1e00005950 tx=0x7f1e000058e0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 msgr2=0x7f1e14198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b650 tx=0x7f1e0400f510 comp rx=0 tx=0).stop 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 shutdown_connections 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1df806ea70 0x7f1df8070f30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e14101720 0x7f1e14198830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 --2- 172.21.15.55:0/1977875943 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e14104050 0x7f1e14198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.721+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 >> 172.21.15.55:0/1977875943 conn(0x7f1e140fb110 msgr2=0x7f1e140fb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.722+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 shutdown_connections 2024-04-26T21:09:24.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:24.722+0000 7f1e19200700 1 -- 172.21.15.55:0/1977875943 wait complete. 2024-04-26T21:09:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:24 smithi064 ceph-mon[33404]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:24 smithi064 ceph-mon[33404]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:24 smithi064 ceph-mon[33404]: pgmap v32: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 311 op/s 2024-04-26T21:09:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:24 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3181735439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:25 smithi064 ceph-mon[33404]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:25 smithi064 ceph-mon[33404]: Upgrade: Updating node-exporter.smithi055 (1/2) 2024-04-26T21:09:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:25 smithi064 ceph-mon[33404]: Deploying daemon node-exporter.smithi055 on smithi055 2024-04-26T21:09:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:25 smithi064 ceph-mon[33404]: pgmap v33: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 222 op/s 2024-04-26T21:09:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:25 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:26.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:25 smithi055 ceph-mon[25475]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:26.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:25 smithi055 ceph-mon[25475]: Upgrade: Updating node-exporter.smithi055 (1/2) 2024-04-26T21:09:26.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:25 smithi055 ceph-mon[25475]: Deploying daemon node-exporter.smithi055 on smithi055 2024-04-26T21:09:26.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:25 smithi055 ceph-mon[25475]: pgmap v33: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 222 op/s 2024-04-26T21:09:26.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:25 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:28.681 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:28 smithi055 ceph-mon[25475]: pgmap v34: 65 pgs: 65 active+clean; 337 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 333 op/s 2024-04-26T21:09:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:28 smithi064 ceph-mon[33404]: pgmap v34: 65 pgs: 65 active+clean; 337 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 333 op/s 2024-04-26T21:09:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:30 smithi055 ceph-mon[25475]: pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-04-26T21:09:30.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:30 smithi064 ceph-mon[33404]: pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-04-26T21:09:32.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:32 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:32.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:32 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:32.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:32 smithi064 ceph-mon[33404]: pgmap v36: 65 pgs: 65 active+clean; 336 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 285 op/s 2024-04-26T21:09:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:32 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:32 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:32 smithi055 ceph-mon[25475]: pgmap v36: 65 pgs: 65 active+clean; 336 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 285 op/s 2024-04-26T21:09:34.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:34 smithi055 ceph-mon[25475]: pgmap v37: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 803 op/s 2024-04-26T21:09:34.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:34 smithi064 ceph-mon[33404]: pgmap v37: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 803 op/s 2024-04-26T21:09:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:35 smithi064 ceph-mon[33404]: Upgrade: Updating node-exporter.smithi064 (2/2) 2024-04-26T21:09:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:35 smithi064 ceph-mon[33404]: Deploying daemon node-exporter.smithi064 on smithi064 2024-04-26T21:09:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:35 smithi055 ceph-mon[25475]: Upgrade: Updating node-exporter.smithi064 (2/2) 2024-04-26T21:09:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:35 smithi055 ceph-mon[25475]: Deploying daemon node-exporter.smithi064 on smithi064 2024-04-26T21:09:36.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:36 smithi055 ceph-mon[25475]: pgmap v38: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 689 op/s 2024-04-26T21:09:36.760 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:36 smithi064 ceph-mon[33404]: pgmap v38: 65 pgs: 65 active+clean; 335 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 689 op/s 2024-04-26T21:09:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:38 smithi064 ceph-mon[33404]: pgmap v39: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-04-26T21:09:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:38 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:38 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:38 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:39.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:38 smithi055 ceph-mon[25475]: pgmap v39: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.11k op/s 2024-04-26T21:09:39.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:38 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:39.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:38 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:39.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:38 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:40.864 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:40 smithi055 ceph-mon[25475]: pgmap v40: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 975 KiB/s rd, 1.2 MiB/s wr, 1.00k op/s 2024-04-26T21:09:40.865 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:40 smithi064 ceph-mon[33404]: pgmap v40: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 975 KiB/s rd, 1.2 MiB/s wr, 1.00k op/s 2024-04-26T21:09:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:42.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:42 smithi064 ceph-mon[33404]: pgmap v41: 65 pgs: 65 active+clean; 325 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 975 KiB/s rd, 1.2 MiB/s wr, 1.04k op/s 2024-04-26T21:09:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:42 smithi055 ceph-mon[25475]: pgmap v41: 65 pgs: 65 active+clean; 325 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 975 KiB/s rd, 1.2 MiB/s wr, 1.04k op/s 2024-04-26T21:09:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:44 smithi064 ceph-mon[33404]: pgmap v42: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.32k op/s 2024-04-26T21:09:44.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:44 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:44.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:44 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:45.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:44 smithi055 ceph-mon[25475]: pgmap v42: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.32k op/s 2024-04-26T21:09:45.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:44 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:45.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:44 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:46.724 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:46 smithi055 ceph-mon[25475]: pgmap v43: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 798 op/s 2024-04-26T21:09:46.725 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:46 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:46.725 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:46 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:46.856 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:46 smithi064 ceph-mon[33404]: pgmap v43: 65 pgs: 65 active+clean; 316 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 798 op/s 2024-04-26T21:09:46.857 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:46 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:46.857 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:46 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:48.729 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:48 smithi064 ceph-mon[33404]: pgmap v44: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 980 op/s 2024-04-26T21:09:48.729 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:48.729 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:48 smithi055 ceph-mon[25475]: pgmap v44: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 980 op/s 2024-04-26T21:09:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:50 smithi064 ceph-mon[33404]: pgmap v45: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 554 op/s 2024-04-26T21:09:51.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:50 smithi055 ceph-mon[25475]: pgmap v45: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 554 op/s 2024-04-26T21:09:52.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:51 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:52.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:51 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:52.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:51 smithi064 ceph-mon[33404]: pgmap v46: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 567 op/s 2024-04-26T21:09:52.217 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:51 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:52.217 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:51 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:52.217 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:51 smithi055 ceph-mon[25475]: pgmap v46: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 567 op/s 2024-04-26T21:09:54.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:53 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:54.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:53 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:54.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:53 smithi055 ceph-mon[25475]: pgmap v47: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 674 op/s 2024-04-26T21:09:54.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:53 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:54.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:53 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:09:54.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:53 smithi064 ceph-mon[33404]: pgmap v47: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 674 op/s 2024-04-26T21:09:54.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 -- 172.21.15.55:0/3072968645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c102e40 msgr2=0x7fd28c103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:54.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 --2- 172.21.15.55:0/3072968645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c102e40 0x7fd28c103260 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b0a0 tx=0x7fd28400b3b0 comp rx=0 tx=0).stop 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 -- 172.21.15.55:0/3072968645 shutdown_connections 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 --2- 172.21.15.55:0/3072968645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c103fa0 0x7fd28c104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 --2- 172.21.15.55:0/3072968645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c102e40 0x7fd28c103260 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.939+0000 7fd292a00700 1 -- 172.21.15.55:0/3072968645 >> 172.21.15.55:0/3072968645 conn(0x7fd28c0fe420 msgr2=0x7fd28c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.940+0000 7fd292a00700 1 -- 172.21.15.55:0/3072968645 shutdown_connections 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.940+0000 7fd292a00700 1 -- 172.21.15.55:0/3072968645 wait complete. 2024-04-26T21:09:54.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.941+0000 7fd292a00700 1 Processor -- start 2024-04-26T21:09:54.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.941+0000 7fd292a00700 1 -- start start 2024-04-26T21:09:54.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd292a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 0x7fd28c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:54.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd292a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 0x7fd28c19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:54.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd292a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c19d820 con 0x7fd28c103fa0 2024-04-26T21:09:54.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd292a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c1a21e0 con 0x7fd28c102e40 2024-04-26T21:09:54.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd28be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 0x7fd28c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:54.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.942+0000 7fd28b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 0x7fd28c19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:54.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.943+0000 7fd28be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 0x7fd28c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:49996/0 (socket says 172.21.15.55:49996) 2024-04-26T21:09:54.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.943+0000 7fd28be00700 1 -- 172.21.15.55:0/1256991942 learned_addr learned my addr 172.21.15.55:0/1256991942 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:54.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.943+0000 7fd28b400700 1 -- 172.21.15.55:0/1256991942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 msgr2=0x7fd28c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:54.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.943+0000 7fd28b400700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 0x7fd28c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:54.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.943+0000 7fd28b400700 1 -- 172.21.15.55:0/1256991942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009d00 con 0x7fd28c103fa0 2024-04-26T21:09:54.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.944+0000 7fd28b400700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 0x7fd28c19d200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d8d0 tx=0x7fd27c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:54.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.945+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c00f860 con 0x7fd28c103fa0 2024-04-26T21:09:54.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.945+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd27c00fe80 con 0x7fd28c103fa0 2024-04-26T21:09:54.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.945+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c00e5e0 con 0x7fd28c103fa0 2024-04-26T21:09:54.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.945+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c1a23e0 con 0x7fd28c103fa0 2024-04-26T21:09:54.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.945+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c1a2980 con 0x7fd28c103fa0 2024-04-26T21:09:54.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.946+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c076ac0 con 0x7fd28c103fa0 2024-04-26T21:09:54.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.949+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7fd27c010460 con 0x7fd28c103fa0 2024-04-26T21:09:54.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.950+0000 7fd288c00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 0x7fd270070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:54.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.950+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd27c08e6f0 con 0x7fd28c103fa0 2024-04-26T21:09:54.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.950+0000 7fd28be00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 0x7fd270070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:54.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.951+0000 7fd28be00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 0x7fd270070f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd28c19e150 tx=0x7fd284006000 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:54.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:54.960+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fd27c057790 con 0x7fd28c103fa0 2024-04-26T21:09:55.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.408+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd28c02ce30 con 0x7fd27006ea70 2024-04-26T21:09:55.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.410+0000 7fd288c00700 1 -- 172.21.15.55:0/1256991942 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fd28c02ce30 con 0x7fd27006ea70 2024-04-26T21:09:55.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 msgr2=0x7fd270070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 0x7fd270070f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd28c19e150 tx=0x7fd284006000 comp rx=0 tx=0).stop 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 msgr2=0x7fd28c19d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 0x7fd28c19d200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d8d0 tx=0x7fd27c00dbe0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 shutdown_connections 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd27006ea70 0x7fd270070f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd28c102e40 0x7fd28c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 --2- 172.21.15.55:0/1256991942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd28c103fa0 0x7fd28c19d200 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.414+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 >> 172.21.15.55:0/1256991942 conn(0x7fd28c0fe420 msgr2=0x7fd28c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.415+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 shutdown_connections 2024-04-26T21:09:55.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.415+0000 7fd292a00700 1 -- 172.21.15.55:0/1256991942 wait complete. 2024-04-26T21:09:55.437 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:09:55.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 -- 172.21.15.55:0/429517638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 msgr2=0x7f83f0106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 --2- 172.21.15.55:0/429517638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f0106440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009910 tx=0x7f83dc009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 -- 172.21.15.55:0/429517638 shutdown_connections 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 --2- 172.21.15.55:0/429517638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f0106440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 --2- 172.21.15.55:0/429517638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 0x7f83f0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 -- 172.21.15.55:0/429517638 >> 172.21.15.55:0/429517638 conn(0x7f83f00fb110 msgr2=0x7f83f00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 -- 172.21.15.55:0/429517638 shutdown_connections 2024-04-26T21:09:55.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.631+0000 7f83f6600700 1 -- 172.21.15.55:0/429517638 wait complete. 2024-04-26T21:09:55.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 Processor -- start 2024-04-26T21:09:55.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 -- start start 2024-04-26T21:09:55.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 0x7f83f0101030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:55.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:55.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019a250 con 0x7f83f0104050 2024-04-26T21:09:55.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.633+0000 7f83f6600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f019a390 con 0x7f83f0101720 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83eea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83eea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41554/0 (socket says 172.21.15.55:41554) 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83eea00700 1 -- 172.21.15.55:0/1537185370 learned_addr learned my addr 172.21.15.55:0/1537185370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83ef400700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 0x7f83f0101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83eea00700 1 -- 172.21.15.55:0/1537185370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 msgr2=0x7f83f0101030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.634+0000 7f83eea00700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 0x7f83f0101030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:55.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83eea00700 1 -- 172.21.15.55:0/1537185370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0095f0 con 0x7f83f0104050 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83eea00700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005b40 tx=0x7f83dc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83dc01d070 con 0x7f83f0104050 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83dc0050d0 con 0x7f83f0104050 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83dc0226a0 con 0x7f83f0104050 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.635+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f00ffc10 con 0x7f83f0104050 2024-04-26T21:09:55.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.636+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f01000d0 con 0x7f83f0104050 2024-04-26T21:09:55.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.637+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f004ebb0 con 0x7f83f0104050 2024-04-26T21:09:55.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.639+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f83dc003680 con 0x7f83f0104050 2024-04-26T21:09:55.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.640+0000 7f83e7e00700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 0x7f83d4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:55.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.640+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f83dc090010 con 0x7f83f0104050 2024-04-26T21:09:55.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.640+0000 7f83ef400700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 0x7f83d4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:55.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.641+0000 7f83ef400700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 0x7f83d4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009bf0 tx=0x7f83e0009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:55.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:55.649+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f83dc05cc80 con 0x7f83f0104050 2024-04-26T21:09:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.013+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83f0105ee0 con 0x7f83d406ea70 2024-04-26T21:09:56.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.015+0000 7f83e7e00700 1 -- 172.21.15.55:0/1537185370 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f83f0105ee0 con 0x7f83d406ea70 2024-04-26T21:09:56.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.019+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 msgr2=0x7f83d4070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.019+0000 7f83f6600700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 0x7f83d4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009bf0 tx=0x7f83e0009260 comp rx=0 tx=0).stop 2024-04-26T21:09:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.019+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 msgr2=0x7f83f00ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.019+0000 7f83f6600700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005b40 tx=0x7f83dc00f740 comp rx=0 tx=0).stop 2024-04-26T21:09:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 shutdown_connections 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f83d406ea70 0x7f83d4070f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83f0101720 0x7f83f0101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 --2- 172.21.15.55:0/1537185370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83f0104050 0x7f83f00ff6d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 >> 172.21.15.55:0/1537185370 conn(0x7f83f00fb110 msgr2=0x7f83f00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 shutdown_connections 2024-04-26T21:09:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.020+0000 7f83f6600700 1 -- 172.21.15.55:0/1537185370 wait complete. 2024-04-26T21:09:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 -- 172.21.15.55:0/882826379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 msgr2=0x7f9034073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 --2- 172.21.15.55:0/882826379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f9034073dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9020009910 tx=0x7f9020009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 -- 172.21.15.55:0/882826379 shutdown_connections 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 --2- 172.21.15.55:0/882826379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f9034073dc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 --2- 172.21.15.55:0/882826379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 0x7f9034073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.234+0000 7f903a200700 1 -- 172.21.15.55:0/882826379 >> 172.21.15.55:0/882826379 conn(0x7f90340fc1f0 msgr2=0x7f90340fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:56.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.235+0000 7f903a200700 1 -- 172.21.15.55:0/882826379 shutdown_connections 2024-04-26T21:09:56.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.236+0000 7f903a200700 1 -- 172.21.15.55:0/882826379 wait complete. 2024-04-26T21:09:56.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 Processor -- start 2024-04-26T21:09:56.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 -- start start 2024-04-26T21:09:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 0x7f903419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903419d770 con 0x7f9034073940 2024-04-26T21:09:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.237+0000 7f903a200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903419d8b0 con 0x7f9034074f10 2024-04-26T21:09:56.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41578/0 (socket says 172.21.15.55:41578) 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 -- 172.21.15.55:0/3797916975 learned_addr learned my addr 172.21.15.55:0/3797916975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9032a00700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 0x7f903419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 -- 172.21.15.55:0/3797916975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 msgr2=0x7f903419d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 0x7f903419d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.238+0000 7f9033400700 1 -- 172.21.15.55:0/3797916975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200095f0 con 0x7f9034073940 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f9033400700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f902400d8d0 tx=0x7f902400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90240041f0 con 0x7f9034073940 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9024007620 con 0x7f9034073940 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9024003c50 con 0x7f9034073940 2024-04-26T21:09:56.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90341a2310 con 0x7f9034073940 2024-04-26T21:09:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.239+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90341a2810 con 0x7f9034073940 2024-04-26T21:09:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.240+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903404ebb0 con 0x7f9034073940 2024-04-26T21:09:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.242+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 92708+0+0 (secure 0 0 0) 0x7f9024004350 con 0x7f9034073940 2024-04-26T21:09:56.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.243+0000 7f902be00700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 0x7f9018070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.243+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f902408e7e0 con 0x7f9034073940 2024-04-26T21:09:56.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.244+0000 7f9032a00700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 0x7f9018070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.244+0000 7f9032a00700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 0x7f9018070f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9020006010 tx=0x7f902000b580 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:56.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.248+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f902405b330 con 0x7f9034073940 2024-04-26T21:09:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.513+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f9024057bd0 con 0x7f9034073940 2024-04-26T21:09:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.539+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9034103c10 con 0x7f901806ea80 2024-04-26T21:09:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.553+0000 7f902be00700 1 -- 172.21.15.55:0/3797916975 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9034103c10 con 0x7f901806ea80 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (11m) 8s ago 13m 13.7M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (13m) 8s ago 13m 8044k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (12m) 12s ago 12m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (13m) 8s ago 13m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (12m) 12s ago 12m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (11m) 8s ago 13m 76.8M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (5m) 8s ago 5m 237M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (5m) 8s ago 5m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (5m) 12s ago 5m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (5m) 12s ago 5m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:09:56.554 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (2m) 8s ago 15m 496M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (48s) 12s ago 12m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (15m) 8s ago 15m 54.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (11m) 12s ago 11m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (26s) 8s ago 13m 7075k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (19s) 12s ago 12m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (10m) 8s ago 10m 224M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (10m) 8s ago 10m 237M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (9m) 8s ago 9m 196M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (8m) 12s ago 8m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (8m) 12s ago 8m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (7m) 12s ago 7m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:09:56.555 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (57s) 8s ago 12m 51.2M - 2.43.0 a07b618ecd1d ce325cafb6b4 2024-04-26T21:09:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 msgr2=0x7f9018070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 0x7f9018070f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9020006010 tx=0x7f902000b580 comp rx=0 tx=0).stop 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 msgr2=0x7f903419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f902400d8d0 tx=0x7f902400dc90 comp rx=0 tx=0).stop 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 shutdown_connections 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f901806ea80 0x7f9018070f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9034073940 0x7f903419cc10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 --2- 172.21.15.55:0/3797916975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9034074f10 0x7f903419d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 >> 172.21.15.55:0/3797916975 conn(0x7f90340fc1f0 msgr2=0x7f90341024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.557+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 shutdown_connections 2024-04-26T21:09:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.558+0000 7f903a200700 1 -- 172.21.15.55:0/3797916975 wait complete. 2024-04-26T21:09:56.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.745+0000 7f5338400700 1 -- 172.21.15.55:0/184892500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ffe70 msgr2=0x7f53301002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.745+0000 7f5338400700 1 --2- 172.21.15.55:0/184892500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ffe70 0x7f53301002f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f531c009910 tx=0x7f531c009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:56.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:56 smithi055 ceph-mon[25475]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:56.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:56 smithi055 ceph-mon[25475]: pgmap v48: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 334 op/s 2024-04-26T21:09:56.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.746+0000 7f5338400700 1 -- 172.21.15.55:0/184892500 shutdown_connections 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.746+0000 7f5338400700 1 --2- 172.21.15.55:0/184892500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ffe70 0x7f53301002f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.746+0000 7f5338400700 1 --2- 172.21.15.55:0/184892500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ff510 0x7f53300ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.746+0000 7f5338400700 1 -- 172.21.15.55:0/184892500 >> 172.21.15.55:0/184892500 conn(0x7f53300fb110 msgr2=0x7f53300fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.747+0000 7f5338400700 1 -- 172.21.15.55:0/184892500 shutdown_connections 2024-04-26T21:09:56.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.747+0000 7f5338400700 1 -- 172.21.15.55:0/184892500 wait complete. 2024-04-26T21:09:56.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 Processor -- start 2024-04-26T21:09:56.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 -- start start 2024-04-26T21:09:56.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ffe70 0x7f5330198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301993d0 con 0x7f53300ff510 2024-04-26T21:09:56.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.748+0000 7f5338400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330199510 con 0x7f53300ffe70 2024-04-26T21:09:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.749+0000 7f5335a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.749+0000 7f5335000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ffe70 0x7f5330198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.749+0000 7f5335a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41600/0 (socket says 172.21.15.55:41600) 2024-04-26T21:09:56.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.749+0000 7f5335a00700 1 -- 172.21.15.55:0/1074414524 learned_addr learned my addr 172.21.15.55:0/1074414524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.750+0000 7f5335a00700 1 -- 172.21.15.55:0/1074414524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ffe70 msgr2=0x7f5330198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.750+0000 7f5335a00700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ffe70 0x7f5330198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:56.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.750+0000 7f5335a00700 1 -- 172.21.15.55:0/1074414524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0095f0 con 0x7f53300ff510 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.750+0000 7f5335a00700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f532400d900 tx=0x7f532400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.751+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5324004a00 con 0x7f53300ff510 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.751+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533006aaa0 con 0x7f53300ff510 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.751+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53240054e0 con 0x7f53300ff510 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.751+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5324009dd0 con 0x7f53300ff510 2024-04-26T21:09:56.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.751+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533006aff0 con 0x7f53300ff510 2024-04-26T21:09:56.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.753+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330192a00 con 0x7f53300ff510 2024-04-26T21:09:56.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.754+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f5324004b60 con 0x7f53300ff510 2024-04-26T21:09:56.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.755+0000 7f532e000700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 0x7f5318070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:56.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.755+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f532408e9c0 con 0x7f53300ff510 2024-04-26T21:09:56.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.756+0000 7f5335000700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 0x7f5318070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:56.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.757+0000 7f5335000700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 0x7f5318070e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f531c0051c0 tx=0x7f531c00b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:56.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:56.763+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f532405b850 con 0x7f53300ff510 2024-04-26T21:09:56.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:56 smithi064 ceph-mon[33404]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:56 smithi064 ceph-mon[33404]: pgmap v48: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 334 op/s 2024-04-26T21:09:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:09:57.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.296+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f533002cde0 con 0x7f53300ff510 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.297+0000 7f532e000700 1 -- 172.21.15.55:0/1074414524 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f532405b3e0 con 0x7f53300ff510 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:09:57.298 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:09:57.299 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:09:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 msgr2=0x7f5318070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 0x7f5318070e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f531c0051c0 tx=0x7f531c00b540 comp rx=0 tx=0).stop 2024-04-26T21:09:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 msgr2=0x7f5330198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f532400d900 tx=0x7f532400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 shutdown_connections 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f531806e950 0x7f5318070e10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300ff510 0x7f5330198870 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 --2- 172.21.15.55:0/1074414524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53300ffe70 0x7f5330198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 >> 172.21.15.55:0/1074414524 conn(0x7f53300fb110 msgr2=0x7f5330107f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 shutdown_connections 2024-04-26T21:09:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.300+0000 7f5338400700 1 -- 172.21.15.55:0/1074414524 wait complete. 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 -- 172.21.15.55:0/1671036629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac0ff510 msgr2=0x7f46ac101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 --2- 172.21.15.55:0/1671036629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac0ff510 0x7f46ac101940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009910 tx=0x7f46a0009c20 comp rx=0 tx=0).stop 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 -- 172.21.15.55:0/1671036629 shutdown_connections 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 --2- 172.21.15.55:0/1671036629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac101e80 0x7f46ac104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 --2- 172.21.15.55:0/1671036629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac0ff510 0x7f46ac101940 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 -- 172.21.15.55:0/1671036629 >> 172.21.15.55:0/1671036629 conn(0x7f46ac0fb110 msgr2=0x7f46ac0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 -- 172.21.15.55:0/1671036629 shutdown_connections 2024-04-26T21:09:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.504+0000 7f46b4200700 1 -- 172.21.15.55:0/1671036629 wait complete. 2024-04-26T21:09:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.505+0000 7f46b4200700 1 Processor -- start 2024-04-26T21:09:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.506+0000 7f46b4200700 1 -- start start 2024-04-26T21:09:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.506+0000 7f46b4200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac0ff510 0x7f46ac19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.506+0000 7f46b4200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.506+0000 7f46b4200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac19d7c0 con 0x7f46ac101e80 2024-04-26T21:09:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.506+0000 7f46b4200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1a2180 con 0x7f46ac0ff510 2024-04-26T21:09:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.507+0000 7f46b0e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.507+0000 7f46b0e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41618/0 (socket says 172.21.15.55:41618) 2024-04-26T21:09:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.507+0000 7f46b0e00700 1 -- 172.21.15.55:0/4126637382 learned_addr learned my addr 172.21.15.55:0/4126637382 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:09:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.507+0000 7f46b1800700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac0ff510 0x7f46ac19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46b0e00700 1 -- 172.21.15.55:0/4126637382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac0ff510 msgr2=0x7f46ac19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46b0e00700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac0ff510 0x7f46ac19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46b0e00700 1 -- 172.21.15.55:0/4126637382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00095f0 con 0x7f46ac101e80 2024-04-26T21:09:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46b0e00700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f469800d8d0 tx=0x7f469800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46980098a0 con 0x7f46ac101e80 2024-04-26T21:09:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.508+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4698010460 con 0x7f46ac101e80 2024-04-26T21:09:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.509+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1a2380 con 0x7f46ac101e80 2024-04-26T21:09:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.509+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac1a28a0 con 0x7f46ac101e80 2024-04-26T21:09:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.509+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f469800f5f0 con 0x7f46ac101e80 2024-04-26T21:09:57.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.511+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c005320 con 0x7f46ac101e80 2024-04-26T21:09:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.513+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f4698009a00 con 0x7f46ac101e80 2024-04-26T21:09:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.514+0000 7f46aa000700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 0x7f4694070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:09:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.515+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f469808e670 con 0x7f46ac101e80 2024-04-26T21:09:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.515+0000 7f46b1800700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 0x7f4694070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:09:57.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.516+0000 7f46b1800700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 0x7f4694070e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46a0005090 tx=0x7f46a0005180 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:09:57.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.526+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f4698057930 con 0x7f46ac101e80 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:57 smithi055 ceph-mon[25475]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:57 smithi055 ceph-mon[25475]: mgrmap e32: smithi055.ybbowr(active, since 91s), standbys: smithi064.tchyje 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:57 smithi055 ceph-mon[25475]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:57 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1074414524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.878+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f468c000bf0 con 0x7f469406e950 2024-04-26T21:09:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.879+0000 7f46aa000700 1 -- 172.21.15.55:0/4126637382 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f468c000bf0 con 0x7f469406e950 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:09:57.880 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:09:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.882+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 msgr2=0x7f4694070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.882+0000 7f46b4200700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 0x7f4694070e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46a0005090 tx=0x7f46a0005180 comp rx=0 tx=0).stop 2024-04-26T21:09:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.882+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 msgr2=0x7f46ac19d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:09:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.882+0000 7f46b4200700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f469800d8d0 tx=0x7f469800dbe0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 shutdown_connections 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f469406e950 0x7f4694070e10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46ac0ff510 0x7f46ac19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 --2- 172.21.15.55:0/4126637382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46ac101e80 0x7f46ac19d1a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 >> 172.21.15.55:0/4126637382 conn(0x7f46ac0fb110 msgr2=0x7f46ac0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 shutdown_connections 2024-04-26T21:09:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:09:57.883+0000 7f46b4200700 1 -- 172.21.15.55:0/4126637382 wait complete. 2024-04-26T21:09:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:57 smithi064 ceph-mon[33404]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:57 smithi064 ceph-mon[33404]: mgrmap e32: smithi055.ybbowr(active, since 91s), standbys: smithi064.tchyje 2024-04-26T21:09:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:57 smithi064 ceph-mon[33404]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:57 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1074414524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:09:58.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:58 smithi064 ceph-mon[33404]: pgmap v49: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 482 op/s 2024-04-26T21:09:59.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:58 smithi055 ceph-mon[25475]: pgmap v49: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 482 op/s 2024-04-26T21:09:59.855 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:09:59 smithi055 ceph-mon[25475]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:09:59.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:09:59 smithi064 ceph-mon[33404]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: pgmap v50: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 300 op/s 2024-04-26T21:10:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:00.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: overall HEALTH_OK 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:00.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:00 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: pgmap v50: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 300 op/s 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: overall HEALTH_OK 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:01.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:01.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:00 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:02 smithi055 ceph-mon[25475]: pgmap v51: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 323 op/s 2024-04-26T21:10:02.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:02 smithi064 ceph-mon[33404]: pgmap v51: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 323 op/s 2024-04-26T21:10:04.805 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:04 smithi055 ceph-mon[25475]: pgmap v52: 65 pgs: 65 active+clean; 273 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 558 op/s 2024-04-26T21:10:04.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:04 smithi064 ceph-mon[33404]: pgmap v52: 65 pgs: 65 active+clean; 273 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 558 op/s 2024-04-26T21:10:06.863 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:06 smithi055 ceph-mon[25475]: Upgrade: Updating prometheus.smithi055 2024-04-26T21:10:06.863 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:06 smithi055 ceph-mon[25475]: Deploying daemon prometheus.smithi055 on smithi055 2024-04-26T21:10:06.863 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:06 smithi055 ceph-mon[25475]: pgmap v53: 65 pgs: 65 active+clean; 273 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 419 op/s 2024-04-26T21:10:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:06 smithi064 ceph-mon[33404]: Upgrade: Updating prometheus.smithi055 2024-04-26T21:10:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:06 smithi064 ceph-mon[33404]: Deploying daemon prometheus.smithi055 on smithi055 2024-04-26T21:10:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:06 smithi064 ceph-mon[33404]: pgmap v53: 65 pgs: 65 active+clean; 273 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 419 op/s 2024-04-26T21:10:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:08 smithi064 ceph-mon[33404]: pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 807 op/s 2024-04-26T21:10:09.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:08 smithi055 ceph-mon[25475]: pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 807 op/s 2024-04-26T21:10:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:10 smithi064 ceph-mon[33404]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 659 op/s 2024-04-26T21:10:10.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:10 smithi055 ceph-mon[25475]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 659 op/s 2024-04-26T21:10:11.618 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:11 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:11.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:11 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:12.736 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:12 smithi055 ceph-mon[25475]: pgmap v56: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 690 op/s 2024-04-26T21:10:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:12 smithi064 ceph-mon[33404]: pgmap v56: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 690 op/s 2024-04-26T21:10:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:14 smithi064 ceph-mon[33404]: pgmap v57: 65 pgs: 65 active+clean; 260 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 952 op/s 2024-04-26T21:10:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:14 smithi055 ceph-mon[25475]: pgmap v57: 65 pgs: 65 active+clean; 260 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 952 op/s 2024-04-26T21:10:16.897 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:16 smithi064 ceph-mon[33404]: pgmap v58: 65 pgs: 65 active+clean; 260 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1022 KiB/s rd, 1.2 MiB/s wr, 704 op/s 2024-04-26T21:10:17.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:16 smithi055 ceph-mon[25475]: pgmap v58: 65 pgs: 65 active+clean; 260 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1022 KiB/s rd, 1.2 MiB/s wr, 704 op/s 2024-04-26T21:10:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:18 smithi064 ceph-mon[33404]: pgmap v59: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 977 op/s 2024-04-26T21:10:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:18 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:18 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:18.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:18 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:18 smithi055 ceph-mon[25475]: pgmap v59: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 977 op/s 2024-04-26T21:10:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:18 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:18 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:18 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:20.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:20 smithi055 ceph-mon[25475]: pgmap v60: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 589 op/s 2024-04-26T21:10:20.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:20 smithi064 ceph-mon[33404]: pgmap v60: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 589 op/s 2024-04-26T21:10:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:22 smithi064 ceph-mon[33404]: pgmap v61: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 609 op/s 2024-04-26T21:10:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:22 smithi055 ceph-mon[25475]: pgmap v61: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 609 op/s 2024-04-26T21:10:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:24 smithi055 ceph-mon[25475]: pgmap v62: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 788 op/s 2024-04-26T21:10:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:24 smithi064 ceph-mon[33404]: pgmap v62: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 788 op/s 2024-04-26T21:10:26.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:26 smithi055 ceph-mon[25475]: pgmap v63: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 502 op/s 2024-04-26T21:10:26.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:26.873 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:26 smithi064 ceph-mon[33404]: pgmap v63: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 502 op/s 2024-04-26T21:10:26.873 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:26.940 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-26T21:10:26.940 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 -- 172.21.15.55:0/385748808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c104050 msgr2=0x7f1c3c106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 --2- 172.21.15.55:0/385748808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c104050 0x7f1c3c106440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009910 tx=0x7f1c28009c20 comp rx=0 tx=0).stop 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 -- 172.21.15.55:0/385748808 shutdown_connections 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 --2- 172.21.15.55:0/385748808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c104050 0x7f1c3c106440 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 --2- 172.21.15.55:0/385748808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c101720 0x7f1c3c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 -- 172.21.15.55:0/385748808 >> 172.21.15.55:0/385748808 conn(0x7f1c3c0fb110 msgr2=0x7f1c3c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 -- 172.21.15.55:0/385748808 shutdown_connections 2024-04-26T21:10:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.086+0000 7f1c43800700 1 -- 172.21.15.55:0/385748808 wait complete. 2024-04-26T21:10:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 Processor -- start 2024-04-26T21:10:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 -- start start 2024-04-26T21:10:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c104050 0x7f1c3c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1993a0 con 0x7f1c3c101720 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.088+0000 7f1c43800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1994e0 con 0x7f1c3c104050 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36916/0 (socket says 172.21.15.55:36916) 2024-04-26T21:10:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 -- 172.21.15.55:0/1287598327 learned_addr learned my addr 172.21.15.55:0/1287598327 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:10:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c3be00700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c104050 0x7f1c3c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 -- 172.21.15.55:0/1287598327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c104050 msgr2=0x7f1c3c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c104050 0x7f1c3c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.089+0000 7f1c40e00700 1 -- 172.21.15.55:0/1287598327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280095f0 con 0x7f1c3c101720 2024-04-26T21:10:28.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.090+0000 7f1c40e00700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e920 tx=0x7f1c3000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:28.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.091+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3000c9d0 con 0x7f1c3c101720 2024-04-26T21:10:28.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.091+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c30010430 con 0x7f1c3c101720 2024-04-26T21:10:28.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.091+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c30018630 con 0x7f1c3c101720 2024-04-26T21:10:28.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.091+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c19df40 con 0x7f1c3c101720 2024-04-26T21:10:28.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.091+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c19e400 con 0x7f1c3c101720 2024-04-26T21:10:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.092+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c0fcd00 con 0x7f1c3c101720 2024-04-26T21:10:28.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.095+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f1c3003cbd0 con 0x7f1c3c101720 2024-04-26T21:10:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.096+0000 7f1c39600700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 0x7f1c24070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.096+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1c30014070 con 0x7f1c3c101720 2024-04-26T21:10:28.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.096+0000 7f1c3be00700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 0x7f1c24070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:28.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.097+0000 7f1c3be00700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 0x7f1c24070e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b6f0 tx=0x7f1c28005fb0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:28.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.101+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f1c3005b960 con 0x7f1c3c101720 2024-04-26T21:10:28.200 DEBUG:teuthology.parallel:result is None 2024-04-26T21:10:28.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.426+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3c02ceb0 con 0x7f1c2406e950 2024-04-26T21:10:28.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.428+0000 7f1c39600700 1 -- 172.21.15.55:0/1287598327 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f1c3c02ceb0 con 0x7f1c2406e950 2024-04-26T21:10:28.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.431+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 msgr2=0x7f1c24070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:28.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.431+0000 7f1c43800700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 0x7f1c24070e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b6f0 tx=0x7f1c28005fb0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.431+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 msgr2=0x7f1c3c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:28.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.431+0000 7f1c43800700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e920 tx=0x7f1c3000ec30 comp rx=0 tx=0).stop 2024-04-26T21:10:28.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 shutdown_connections 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f1c2406e950 0x7f1c24070e10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c3c101720 0x7f1c3c198840 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 --2- 172.21.15.55:0/1287598327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c3c104050 0x7f1c3c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 >> 172.21.15.55:0/1287598327 conn(0x7f1c3c0fb110 msgr2=0x7f1c3c100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 shutdown_connections 2024-04-26T21:10:28.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.432+0000 7f1c43800700 1 -- 172.21.15.55:0/1287598327 wait complete. 2024-04-26T21:10:28.454 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:10:28.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 -- 172.21.15.55:0/3402082150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 msgr2=0x7f5d580ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/3402082150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d580ff930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009910 tx=0x7f5d4c009c20 comp rx=0 tx=0).stop 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 -- 172.21.15.55:0/3402082150 shutdown_connections 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/3402082150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d580ffe70 0x7f5d581002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/3402082150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d580ff930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.623+0000 7f5d5fe00700 1 -- 172.21.15.55:0/3402082150 >> 172.21.15.55:0/3402082150 conn(0x7f5d580fb110 msgr2=0x7f5d580fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:28.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.624+0000 7f5d5fe00700 1 -- 172.21.15.55:0/3402082150 shutdown_connections 2024-04-26T21:10:28.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.624+0000 7f5d5fe00700 1 -- 172.21.15.55:0/3402082150 wait complete. 2024-04-26T21:10:28.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.625+0000 7f5d5fe00700 1 Processor -- start 2024-04-26T21:10:28.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.625+0000 7f5d5fe00700 1 -- start start 2024-04-26T21:10:28.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5fe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d580ffe70 0x7f5d58198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:28.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36944/0 (socket says 172.21.15.55:36944) 2024-04-26T21:10:28.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5d400700 1 -- 172.21.15.55:0/1665121105 learned_addr learned my addr 172.21.15.55:0/1665121105 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:10:28.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d58199400 con 0x7f5d580ff510 2024-04-26T21:10:28.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.626+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d58199540 con 0x7f5d580ffe70 2024-04-26T21:10:28.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.627+0000 7f5d5d400700 1 -- 172.21.15.55:0/1665121105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d580ffe70 msgr2=0x7f5d58198de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T21:10:28.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.627+0000 7f5d5d400700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d580ffe70 0x7f5d58198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:28.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.627+0000 7f5d5d400700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0095f0 con 0x7f5d580ff510 2024-04-26T21:10:28.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d5d400700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006010 tx=0x7f5d4c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:28.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c01d070 con 0x7f5d580ff510 2024-04-26T21:10:28.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d4c00f460 con 0x7f5d580ff510 2024-04-26T21:10:28.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c021640 con 0x7f5d580ff510 2024-04-26T21:10:28.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5819df40 con 0x7f5d580ff510 2024-04-26T21:10:28.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.628+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5819e430 con 0x7f5d580ff510 2024-04-26T21:10:28.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.630+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58192a80 con 0x7f5d580ff510 2024-04-26T21:10:28.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.631+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f5d4c00fad0 con 0x7f5d580ff510 2024-04-26T21:10:28.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.634+0000 7f5d56000700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 0x7f5d40070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:28.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.634+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5d4c08fbb0 con 0x7f5d580ff510 2024-04-26T21:10:28.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.636+0000 7f5d5ca00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 0x7f5d40070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:28.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.636+0000 7f5d5ca00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 0x7f5d40070e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097b0 tx=0x7f5d44006d20 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:28.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:28.639+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5d4c096080 con 0x7f5d580ff510 2024-04-26T21:10:28.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:28 smithi055 ceph-mon[25475]: pgmap v64: 65 pgs: 65 active+clean; 228 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 749 op/s 2024-04-26T21:10:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:28 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:28 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:28 smithi064 ceph-mon[33404]: pgmap v64: 65 pgs: 65 active+clean; 228 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 749 op/s 2024-04-26T21:10:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:28 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:28.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:28 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:29.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.001+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d5802ce50 con 0x7f5d4006e950 2024-04-26T21:10:29.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.002+0000 7f5d56000700 1 -- 172.21.15.55:0/1665121105 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f5d5802ce50 con 0x7f5d4006e950 2024-04-26T21:10:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.006+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 msgr2=0x7f5d40070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.006+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 0x7f5d40070e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097b0 tx=0x7f5d44006d20 comp rx=0 tx=0).stop 2024-04-26T21:10:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.006+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 msgr2=0x7f5d581988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.006+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006010 tx=0x7f5d4c00be20 comp rx=0 tx=0).stop 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 shutdown_connections 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5d4006e950 0x7f5d40070e10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d580ff510 0x7f5d581988a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 --2- 172.21.15.55:0/1665121105 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d580ffe70 0x7f5d58198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 >> 172.21.15.55:0/1665121105 conn(0x7f5d580fb110 msgr2=0x7f5d58107ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 shutdown_connections 2024-04-26T21:10:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.007+0000 7f5d5fe00700 1 -- 172.21.15.55:0/1665121105 wait complete. 2024-04-26T21:10:29.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 -- 172.21.15.55:0/1977371443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c100c10 msgr2=0x7f648c101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 --2- 172.21.15.55:0/1977371443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c100c10 0x7f648c101030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f647c009910 tx=0x7f647c009c20 comp rx=0 tx=0).stop 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 -- 172.21.15.55:0/1977371443 shutdown_connections 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 --2- 172.21.15.55:0/1977371443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c101e10 0x7f648c102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 --2- 172.21.15.55:0/1977371443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c100c10 0x7f648c101030 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 -- 172.21.15.55:0/1977371443 >> 172.21.15.55:0/1977371443 conn(0x7f648c0fc1f0 msgr2=0x7f648c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 -- 172.21.15.55:0/1977371443 shutdown_connections 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.194+0000 7f6492000700 1 -- 172.21.15.55:0/1977371443 wait complete. 2024-04-26T21:10:29.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 Processor -- start 2024-04-26T21:10:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 -- start start 2024-04-26T21:10:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c100c10 0x7f648c196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c197190 con 0x7f648c101e10 2024-04-26T21:10:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.196+0000 7f6492000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c1972d0 con 0x7f648c100c10 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36952/0 (socket says 172.21.15.55:36952) 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 -- 172.21.15.55:0/2430798701 learned_addr learned my addr 172.21.15.55:0/2430798701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648b400700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c100c10 0x7f648c196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 -- 172.21.15.55:0/2430798701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c100c10 msgr2=0x7f648c196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c100c10 0x7f648c196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 -- 172.21.15.55:0/2430798701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0095f0 con 0x7f648c101e10 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.197+0000 7f648aa00700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f647800c8a0 tx=0x7f647800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:29.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.198+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647800cea0 con 0x7f648c101e10 2024-04-26T21:10:29.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.198+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c19bd30 con 0x7f648c101e10 2024-04-26T21:10:29.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.198+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6478004830 con 0x7f648c101e10 2024-04-26T21:10:29.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.198+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64780055b0 con 0x7f648c101e10 2024-04-26T21:10:29.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.198+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c19c300 con 0x7f648c101e10 2024-04-26T21:10:29.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.199+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c005320 con 0x7f648c101e10 2024-04-26T21:10:29.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.201+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f647800f450 con 0x7f648c101e10 2024-04-26T21:10:29.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.202+0000 7f6483e00700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 0x7f6470070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.202+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f647808e390 con 0x7f648c101e10 2024-04-26T21:10:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.203+0000 7f648b400700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 0x7f6470070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.203+0000 7f648b400700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 0x7f6470070e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f647c006010 tx=0x7f647c00b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:29.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.206+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f647805b220 con 0x7f648c101e10 2024-04-26T21:10:29.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.517+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f646c000bf0 con 0x7f647006e950 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.542+0000 7f6483e00700 1 -- 172.21.15.55:0/2430798701 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f646c000bf0 con 0x7f647006e950 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (11m) 1s ago 13m 13.7M - 0.25.0 c8568f914cd2 c372997041fd 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (14m) 1s ago 14m 8098k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (12m) 45s ago 12m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (14m) 1s ago 14m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:10:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (12m) 45s ago 12m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (11m) 1s ago 13m 76.9M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (6m) 1s ago 6m 184M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (6m) 1s ago 6m 15.1M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (6m) 45s ago 6m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (6m) 45s ago 6m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (2m) 1s ago 15m 499M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (81s) 45s ago 12m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (15m) 1s ago 16m 56.2M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (12m) 45s ago 12m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (59s) 1s ago 14m 7780k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (52s) 45s ago 12m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (11m) 1s ago 11m 250M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (10m) 1s ago 10m 261M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (10m) 1s ago 10m 217M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:10:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (9m) 45s ago 9m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:10:29.546 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (8m) 45s ago 8m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:10:29.546 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (8m) 45s ago 8m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:10:29.546 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (13s) 1s ago 13m 43.8M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 msgr2=0x7f6470070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 0x7f6470070e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f647c006010 tx=0x7f647c00b540 comp rx=0 tx=0).stop 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 msgr2=0x7f648c196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f647800c8a0 tx=0x7f647800cc60 comp rx=0 tx=0).stop 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 shutdown_connections 2024-04-26T21:10:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f647006e950 0x7f6470070e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f648c100c10 0x7f648c196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 --2- 172.21.15.55:0/2430798701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f648c101e10 0x7f648c196b70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.545+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 >> 172.21.15.55:0/2430798701 conn(0x7f648c0fc1f0 msgr2=0x7f648c105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.546+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 shutdown_connections 2024-04-26T21:10:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.546+0000 7f6492000700 1 -- 172.21.15.55:0/2430798701 wait complete. 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 -- 172.21.15.55:0/3765582626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 msgr2=0x7fe07c073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 --2- 172.21.15.55:0/3765582626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c073d40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe068009910 tx=0x7fe068009c20 comp rx=0 tx=0).stop 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 -- 172.21.15.55:0/3765582626 shutdown_connections 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 --2- 172.21.15.55:0/3765582626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c073d40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 --2- 172.21.15.55:0/3765582626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c0732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 -- 172.21.15.55:0/3765582626 >> 172.21.15.55:0/3765582626 conn(0x7fe07c0fc1f0 msgr2=0x7fe07c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:29.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.709+0000 7fe082800700 1 -- 172.21.15.55:0/3765582626 shutdown_connections 2024-04-26T21:10:29.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.710+0000 7fe082800700 1 -- 172.21.15.55:0/3765582626 wait complete. 2024-04-26T21:10:29.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 Processor -- start 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 -- start start 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c1044b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c100ab0 con 0x7fe07c0738c0 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.711+0000 7fe082800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c100bf0 con 0x7fe07c074e90 2024-04-26T21:10:29.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36970/0 (socket says 172.21.15.55:36970) 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 -- 172.21.15.55:0/2274380097 learned_addr learned my addr 172.21.15.55:0/2274380097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07aa00700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c1044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 -- 172.21.15.55:0/2274380097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 msgr2=0x7fe07c1044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c1044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07b400700 1 -- 172.21.15.55:0/2274380097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680095f0 con 0x7fe07c0738c0 2024-04-26T21:10:29.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.712+0000 7fe07aa00700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c1044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:10:29.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.713+0000 7fe07b400700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c8a0 tx=0x7fe06c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:29.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.713+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c00cea0 con 0x7fe07c0738c0 2024-04-26T21:10:29.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.713+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe06c004830 con 0x7fe07c0738c0 2024-04-26T21:10:29.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.713+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c100ed0 con 0x7fe07c0738c0 2024-04-26T21:10:29.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.713+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c0055d0 con 0x7fe07c0738c0 2024-04-26T21:10:29.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.714+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c1014a0 con 0x7fe07c0738c0 2024-04-26T21:10:29.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.716+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c192980 con 0x7fe07c0738c0 2024-04-26T21:10:29.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.716+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fe06c0049a0 con 0x7fe07c0738c0 2024-04-26T21:10:29.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.718+0000 7fe073e00700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 0x7fe060070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:29.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.718+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe06c08e4d0 con 0x7fe07c0738c0 2024-04-26T21:10:29.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.718+0000 7fe07aa00700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 0x7fe060070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:29.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.720+0000 7fe07aa00700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 0x7fe060070e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0680051c0 tx=0x7fe06800b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:29.724+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fe06c05b360 con 0x7fe07c0738c0 2024-04-26T21:10:29.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:29 smithi064 ceph-mon[33404]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:29 smithi055 ceph-mon[25475]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.328+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe07c04ebb0 con 0x7fe07c0738c0 2024-04-26T21:10:30.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.329+0000 7fe073e00700 1 -- 172.21.15.55:0/2274380097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fe06c05aef0 con 0x7fe07c0738c0 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:10:30.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:10:30.332 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:10:30.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 msgr2=0x7fe060070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 0x7fe060070e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0680051c0 tx=0x7fe06800b540 comp rx=0 tx=0).stop 2024-04-26T21:10:30.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 msgr2=0x7fe07c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c8a0 tx=0x7fe06c00cc60 comp rx=0 tx=0).stop 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 shutdown_connections 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe06006e950 0x7fe060070e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe07c0738c0 0x7fe07c103f70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 --2- 172.21.15.55:0/2274380097 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe07c074e90 0x7fe07c1044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.333+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 >> 172.21.15.55:0/2274380097 conn(0x7fe07c0fc1f0 msgr2=0x7fe07c106e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.334+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 shutdown_connections 2024-04-26T21:10:30.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.334+0000 7fe082800700 1 -- 172.21.15.55:0/2274380097 wait complete. 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 -- 172.21.15.55:0/3255125230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 msgr2=0x7f9e2010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 --2- 172.21.15.55:0/3255125230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e2010ba40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009910 tx=0x7f9e10009c20 comp rx=0 tx=0).stop 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 -- 172.21.15.55:0/3255125230 shutdown_connections 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 --2- 172.21.15.55:0/3255125230 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 0x7f9e2010cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 --2- 172.21.15.55:0/3255125230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e2010ba40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 -- 172.21.15.55:0/3255125230 >> 172.21.15.55:0/3255125230 conn(0x7f9e2006b180 msgr2=0x7f9e2006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 -- 172.21.15.55:0/3255125230 shutdown_connections 2024-04-26T21:10:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.527+0000 7f9e25200700 1 -- 172.21.15.55:0/3255125230 wait complete. 2024-04-26T21:10:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.528+0000 7f9e25200700 1 Processor -- start 2024-04-26T21:10:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.528+0000 7f9e25200700 1 -- start start 2024-04-26T21:10:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e25200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e25200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 0x7f9e201a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e25200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201a1b90 con 0x7f9e2010b620 2024-04-26T21:10:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e25200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201a1cd0 con 0x7f9e2010c820 2024-04-26T21:10:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e1de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e1de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36984/0 (socket says 172.21.15.55:36984) 2024-04-26T21:10:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.529+0000 7f9e1de00700 1 -- 172.21.15.55:0/1954412819 learned_addr learned my addr 172.21.15.55:0/1954412819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:10:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.530+0000 7f9e1d400700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 0x7f9e201a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.530+0000 7f9e1de00700 1 -- 172.21.15.55:0/1954412819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 msgr2=0x7f9e201a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.530+0000 7f9e1de00700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 0x7f9e201a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.530+0000 7f9e1de00700 1 -- 172.21.15.55:0/1954412819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e100095f0 con 0x7f9e2010b620 2024-04-26T21:10:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.530+0000 7f9e1de00700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000bd70 tx=0x7f9e1000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.531+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1001d070 con 0x7f9e2010b620 2024-04-26T21:10:30.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.531+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e1000f460 con 0x7f9e2010b620 2024-04-26T21:10:30.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.531+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e10021620 con 0x7f9e2010b620 2024-04-26T21:10:30.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.531+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e201a66d0 con 0x7f9e2010b620 2024-04-26T21:10:30.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.531+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e201a6c40 con 0x7f9e2010b620 2024-04-26T21:10:30.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.533+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2019b1c0 con 0x7f9e2010b620 2024-04-26T21:10:30.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.533+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f9e1000fa70 con 0x7f9e2010b620 2024-04-26T21:10:30.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.534+0000 7f9e16a00700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 0x7f9e04070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:10:30.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.535+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f9e1008fb50 con 0x7f9e2010b620 2024-04-26T21:10:30.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.535+0000 7f9e1d400700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 0x7f9e04070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:10:30.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.536+0000 7f9e1d400700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 0x7f9e04070e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c005950 tx=0x7f9e0c005eb0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:10:30.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.540+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f9e1005c9e0 con 0x7f9e2010b620 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: pgmap v65: 65 pgs: 65 active+clean; 228 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 476 op/s 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:30 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2274380097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:30.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.884+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e2002cdb0 con 0x7f9e0406e950 2024-04-26T21:10:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.887+0000 7f9e16a00700 1 -- 172.21.15.55:0/1954412819 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f9e2002cdb0 con 0x7f9e0406e950 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:10:30.893 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:10:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 msgr2=0x7f9e04070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 0x7f9e04070e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c005950 tx=0x7f9e0c005eb0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 msgr2=0x7f9e201a1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:10:30.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000bd70 tx=0x7f9e1000be50 comp rx=0 tx=0).stop 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 shutdown_connections 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f9e0406e950 0x7f9e04070e10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2010b620 0x7f9e201a1030 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 --2- 172.21.15.55:0/1954412819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e2010c820 0x7f9e201a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.892+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 >> 172.21.15.55:0/1954412819 conn(0x7f9e2006b180 msgr2=0x7f9e2010fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.894+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 shutdown_connections 2024-04-26T21:10:30.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:10:30.894+0000 7f9e25200700 1 -- 172.21.15.55:0/1954412819 wait complete. 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: pgmap v65: 65 pgs: 65 active+clean; 228 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 476 op/s 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:30 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2274380097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:31.292 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T21:10:31.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T21:10:32.527 DEBUG:teuthology.parallel:result is None 2024-04-26T21:10:32.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T21:10:32.626 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T21:10:32.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T21:10:32.725 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T21:10:32.725 DEBUG:teuthology.parallel:result is None 2024-04-26T21:10:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:32 smithi055 ceph-mon[25475]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:32 smithi055 ceph-mon[25475]: pgmap v66: 65 pgs: 65 active+clean; 227 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 487 op/s 2024-04-26T21:10:32.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:32 smithi064 ceph-mon[33404]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:10:32.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:32 smithi064 ceph-mon[33404]: pgmap v66: 65 pgs: 65 active+clean; 227 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 487 op/s 2024-04-26T21:10:34.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:34 smithi064 ceph-mon[33404]: pgmap v67: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 583 op/s 2024-04-26T21:10:34.935 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:34 smithi055 ceph-mon[25475]: pgmap v67: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 583 op/s 2024-04-26T21:10:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: pgmap v68: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 373 op/s 2024-04-26T21:10:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:36 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: pgmap v68: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 373 op/s 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:36 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:37.832 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:10:37.832 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:37.832 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.833 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:37 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:10:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:37.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:37.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:37 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:10:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:38 smithi064 ceph-mon[33404]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:10:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:38 smithi064 ceph-mon[33404]: pgmap v69: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 390 op/s 2024-04-26T21:10:39.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:38 smithi055 ceph-mon[25475]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-26T21:10:39.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:38 smithi055 ceph-mon[25475]: pgmap v69: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 390 op/s 2024-04-26T21:10:40.821 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:40 smithi055 ceph-mon[25475]: Upgrade: Updating alertmanager.smithi055 2024-04-26T21:10:40.821 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:40 smithi055 ceph-mon[25475]: Deploying daemon alertmanager.smithi055 on smithi055 2024-04-26T21:10:40.821 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:40 smithi055 ceph-mon[25475]: pgmap v70: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 484 KiB/s rd, 485 KiB/s wr, 142 op/s 2024-04-26T21:10:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:40 smithi064 ceph-mon[33404]: Upgrade: Updating alertmanager.smithi055 2024-04-26T21:10:40.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:40 smithi064 ceph-mon[33404]: Deploying daemon alertmanager.smithi055 on smithi055 2024-04-26T21:10:40.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:40 smithi064 ceph-mon[33404]: pgmap v70: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 484 KiB/s rd, 485 KiB/s wr, 142 op/s 2024-04-26T21:10:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:41.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:42.613 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:42 smithi055 ceph-mon[25475]: pgmap v71: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 484 KiB/s rd, 485 KiB/s wr, 143 op/s 2024-04-26T21:10:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:42 smithi064 ceph-mon[33404]: pgmap v71: 65 pgs: 65 active+clean; 203 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 484 KiB/s rd, 485 KiB/s wr, 143 op/s 2024-04-26T21:10:44.889 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:44 smithi055 ceph-mon[25475]: pgmap v72: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 492 KiB/s rd, 492 KiB/s wr, 144 op/s 2024-04-26T21:10:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:44 smithi064 ceph-mon[33404]: pgmap v72: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 492 KiB/s rd, 492 KiB/s wr, 144 op/s 2024-04-26T21:10:46.854 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:46 smithi055 ceph-mon[25475]: pgmap v73: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s rd, 18 KiB/s wr, 28 op/s 2024-04-26T21:10:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:46 smithi064 ceph-mon[33404]: pgmap v73: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s rd, 18 KiB/s wr, 28 op/s 2024-04-26T21:10:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:48 smithi055 ceph-mon[25475]: pgmap v74: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s rd, 18 KiB/s wr, 29 op/s 2024-04-26T21:10:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:48 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:48 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:48.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:48 smithi064 ceph-mon[33404]: pgmap v74: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s rd, 18 KiB/s wr, 29 op/s 2024-04-26T21:10:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:48 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:48 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:50 smithi055 ceph-mon[25475]: pgmap v75: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:50 smithi064 ceph-mon[33404]: pgmap v75: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:52.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:52 smithi055 ceph-mon[25475]: pgmap v76: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:52.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:52 smithi064 ceph-mon[33404]: pgmap v76: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:54.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:54 smithi055 ceph-mon[25475]: pgmap v77: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.1 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:54 smithi064 ceph-mon[33404]: pgmap v77: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.1 KiB/s rd, 7.3 KiB/s wr, 12 op/s 2024-04-26T21:10:56.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:56 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:56.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:56 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:56.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:56 smithi055 ceph-mon[25475]: pgmap v78: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:10:56.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:56.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:56 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:56.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:56 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:56.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:56 smithi064 ceph-mon[33404]: pgmap v78: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-04-26T21:10:56.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:10:58.623 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:58 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:58.623 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:58 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:58.623 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:10:58 smithi055 ceph-mon[25475]: pgmap v79: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:10:58.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:58 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:58.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:58 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:10:58.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:10:58 smithi064 ceph-mon[33404]: pgmap v79: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:11:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:00 smithi055 ceph-mon[25475]: pgmap v80: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:00 smithi064 ceph-mon[33404]: pgmap v80: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:01.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 -- 172.21.15.55:0/67512436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594073940 msgr2=0x7f4594073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 --2- 172.21.15.55:0/67512436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594073940 0x7f4594073dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4580009910 tx=0x7f4580009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:01.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 -- 172.21.15.55:0/67512436 shutdown_connections 2024-04-26T21:11:01.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 --2- 172.21.15.55:0/67512436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594073940 0x7f4594073dc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 --2- 172.21.15.55:0/67512436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594074f10 0x7f4594073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.085+0000 7f459c400700 1 -- 172.21.15.55:0/67512436 >> 172.21.15.55:0/67512436 conn(0x7f45940fc1f0 msgr2=0x7f45940fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.086+0000 7f459c400700 1 -- 172.21.15.55:0/67512436 shutdown_connections 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.086+0000 7f459c400700 1 -- 172.21.15.55:0/67512436 wait complete. 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.087+0000 7f459c400700 1 Processor -- start 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.087+0000 7f459c400700 1 -- start start 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f459c400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594073940 0x7f459419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f459c400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f459c400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459419d6e0 con 0x7f4594074f10 2024-04-26T21:11:01.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f459c400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459419d820 con 0x7f4594073940 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f4599000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f4599000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59536/0 (socket says 172.21.15.55:59536) 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f4599000700 1 -- 172.21.15.55:0/333941577 learned_addr learned my addr 172.21.15.55:0/333941577 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.088+0000 7f4599a00700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594073940 0x7f459419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.089+0000 7f4599000700 1 -- 172.21.15.55:0/333941577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594073940 msgr2=0x7f459419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.089+0000 7f4599000700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594073940 0x7f459419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.089+0000 7f4599000700 1 -- 172.21.15.55:0/333941577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800095f0 con 0x7f4594074f10 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.089+0000 7f4599000700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f458000bd70 tx=0x7f458000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.089+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f458001d070 con 0x7f4594074f10 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.090+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f458000f460 con 0x7f4594074f10 2024-04-26T21:11:01.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.090+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4580021620 con 0x7f4594074f10 2024-04-26T21:11:01.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.090+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45941a2230 con 0x7f4594074f10 2024-04-26T21:11:01.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.090+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941a2770 con 0x7f4594074f10 2024-04-26T21:11:01.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.091+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459404ebb0 con 0x7f4594074f10 2024-04-26T21:11:01.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.093+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f458000fa70 con 0x7f4594074f10 2024-04-26T21:11:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.094+0000 7f4592000700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 0x7f457c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.094+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f458008ff90 con 0x7f4594074f10 2024-04-26T21:11:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.094+0000 7f4599a00700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 0x7f457c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.095+0000 7f4599a00700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 0x7f457c070e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4588005ea0 tx=0x7f4588005e30 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.100+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f458005cf20 con 0x7f4594074f10 2024-04-26T21:11:01.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.364+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4594103c10 con 0x7f457c06e950 2024-04-26T21:11:01.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.366+0000 7f4592000700 1 -- 172.21.15.55:0/333941577 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4594103c10 con 0x7f457c06e950 2024-04-26T21:11:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 msgr2=0x7f457c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 0x7f457c070e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4588005ea0 tx=0x7f4588005e30 comp rx=0 tx=0).stop 2024-04-26T21:11:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 msgr2=0x7f459419d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f458000bd70 tx=0x7f458000be50 comp rx=0 tx=0).stop 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 shutdown_connections 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f457c06e950 0x7f457c070e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4594073940 0x7f459419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 --2- 172.21.15.55:0/333941577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4594074f10 0x7f459419d150 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 >> 172.21.15.55:0/333941577 conn(0x7f45940fc1f0 msgr2=0x7f45941024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.369+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 shutdown_connections 2024-04-26T21:11:01.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.370+0000 7f459c400700 1 -- 172.21.15.55:0/333941577 wait complete. 2024-04-26T21:11:01.390 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 -- 172.21.15.55:0/2231661616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 msgr2=0x7f43ec101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 --2- 172.21.15.55:0/2231661616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec101030 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009910 tx=0x7f43e0009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 -- 172.21.15.55:0/2231661616 shutdown_connections 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 --2- 172.21.15.55:0/2231661616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 --2- 172.21.15.55:0/2231661616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec101030 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 -- 172.21.15.55:0/2231661616 >> 172.21.15.55:0/2231661616 conn(0x7f43ec0fc1f0 msgr2=0x7f43ec0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 -- 172.21.15.55:0/2231661616 shutdown_connections 2024-04-26T21:11:01.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.539+0000 7f43f4000700 1 -- 172.21.15.55:0/2231661616 wait complete. 2024-04-26T21:11:01.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 Processor -- start 2024-04-26T21:11:01.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 -- start start 2024-04-26T21:11:01.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec073810 con 0x7f43ec100c10 2024-04-26T21:11:01.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.541+0000 7f43f4000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec073950 con 0x7f43ec101e10 2024-04-26T21:11:01.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59542/0 (socket says 172.21.15.55:59542) 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 -- 172.21.15.55:0/2311358085 learned_addr learned my addr 172.21.15.55:0/2311358085 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f0c00700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 -- 172.21.15.55:0/2311358085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 msgr2=0x7f43ec0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f1600700 1 -- 172.21.15.55:0/2311358085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00095f0 con 0x7f43ec100c10 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.542+0000 7f43f0c00700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:11:01.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43f1600700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f43e000bd70 tx=0x7f43e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:01.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e001d070 con 0x7f43ec100c10 2024-04-26T21:11:01.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43e000f460 con 0x7f43ec100c10 2024-04-26T21:11:01.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e0021620 con 0x7f43ec100c10 2024-04-26T21:11:01.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec073bd0 con 0x7f43ec100c10 2024-04-26T21:11:01.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.543+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec074140 con 0x7f43ec100c10 2024-04-26T21:11:01.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.545+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec190810 con 0x7f43ec100c10 2024-04-26T21:11:01.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.546+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f43e000fa70 con 0x7f43ec100c10 2024-04-26T21:11:01.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.547+0000 7f43ea000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 0x7f43d4070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:01.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.547+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f43e008fa20 con 0x7f43ec100c10 2024-04-26T21:11:01.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.547+0000 7f43f0c00700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 0x7f43d4070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:01.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.548+0000 7f43f0c00700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 0x7f43d4070e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007900 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:01.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.552+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f43e005c810 con 0x7f43ec100c10 2024-04-26T21:11:01.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.853+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ec074140 con 0x7f43d406e950 2024-04-26T21:11:01.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.854+0000 7f43ea000700 1 -- 172.21.15.55:0/2311358085 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f43ec074140 con 0x7f43d406e950 2024-04-26T21:11:01.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 msgr2=0x7f43d4070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 0x7f43d4070e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007900 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 msgr2=0x7f43ec074be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f43e000bd70 tx=0x7f43e000be50 comp rx=0 tx=0).stop 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 shutdown_connections 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f43d406e950 0x7f43d4070e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43ec100c10 0x7f43ec074be0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 --2- 172.21.15.55:0/2311358085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec101e10 0x7f43ec0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 >> 172.21.15.55:0/2311358085 conn(0x7f43ec0fc1f0 msgr2=0x7f43ec105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 shutdown_connections 2024-04-26T21:11:01.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:01.857+0000 7f43f4000700 1 -- 172.21.15.55:0/2311358085 wait complete. 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 -- 172.21.15.55:0/3358078789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268101720 msgr2=0x7f4268103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 --2- 172.21.15.55:0/3358078789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268101720 0x7f4268103b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4258009910 tx=0x7f4258009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 -- 172.21.15.55:0/3358078789 shutdown_connections 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 --2- 172.21.15.55:0/3358078789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268104050 0x7f4268106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 --2- 172.21.15.55:0/3358078789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268101720 0x7f4268103b10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.026+0000 7f426e400700 1 -- 172.21.15.55:0/3358078789 >> 172.21.15.55:0/3358078789 conn(0x7f42680fb110 msgr2=0x7f42680fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.027+0000 7f426e400700 1 -- 172.21.15.55:0/3358078789 shutdown_connections 2024-04-26T21:11:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.027+0000 7f426e400700 1 -- 172.21.15.55:0/3358078789 wait complete. 2024-04-26T21:11:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.028+0000 7f426e400700 1 Processor -- start 2024-04-26T21:11:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.028+0000 7f426e400700 1 -- start start 2024-04-26T21:11:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f426e400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268101720 0x7f426819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f426e400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f426e400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819d780 con 0x7f4268104050 2024-04-26T21:11:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f426e400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819d8c0 con 0x7f4268101720 2024-04-26T21:11:02.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f4266a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f4266a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59550/0 (socket says 172.21.15.55:59550) 2024-04-26T21:11:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f4266a00700 1 -- 172.21.15.55:0/3785152067 learned_addr learned my addr 172.21.15.55:0/3785152067 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f4267400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268101720 0x7f426819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.029+0000 7f4266a00700 1 -- 172.21.15.55:0/3785152067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268101720 msgr2=0x7f426819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f4266a00700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268101720 0x7f426819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f4266a00700 1 -- 172.21.15.55:0/3785152067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580095f0 con 0x7f4268104050 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f4266a00700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f425400d8d0 tx=0x7f425400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4254009940 con 0x7f4268104050 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4254010460 con 0x7f4268104050 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42681a2320 con 0x7f4268104050 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f425400f5f0 con 0x7f4268104050 2024-04-26T21:11:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.030+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42681a2870 con 0x7f4268104050 2024-04-26T21:11:02.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.032+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42680fcd00 con 0x7f4268104050 2024-04-26T21:11:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.033+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f42540105d0 con 0x7f4268104050 2024-04-26T21:11:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.035+0000 7f425fe00700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 0x7f424c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.035+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f425408e850 con 0x7f4268104050 2024-04-26T21:11:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.035+0000 7f4267400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 0x7f424c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.036+0000 7f4267400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 0x7f424c070e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f42580051c0 tx=0x7f425800b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.040+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f425405b640 con 0x7f4268104050 2024-04-26T21:11:02.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.297+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f426802ceb0 con 0x7f424c06e950 2024-04-26T21:11:02.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.310+0000 7f425fe00700 1 -- 172.21.15.55:0/3785152067 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f426802ceb0 con 0x7f424c06e950 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (15s) 7s ago 14m 13.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (14m) 7s ago 14m 8136k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (13m) 78s ago 13m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (14m) 7s ago 14m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (13m) 78s ago 13m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:11:02.312 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (12m) 7s ago 14m 76.9M - 9.4.7 954c08fa6188 9a0ad16ad595 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (6m) 7s ago 6m 154M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (6m) 7s ago 6m 15.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (6m) 78s ago 6m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (6m) 78s ago 6m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (3m) 7s ago 16m 499M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (114s) 78s ago 13m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (16m) 7s ago 16m 57.0M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (13m) 78s ago 13m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (92s) 7s ago 14m 7847k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (85s) 78s ago 13m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (11m) 7s ago 11m 255M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (11m) 7s ago 11m 266M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (10m) 7s ago 10m 226M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (10m) 78s ago 10m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:11:02.313 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (9m) 78s ago 9m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:11:02.314 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (8m) 78s ago 8m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:11:02.314 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (46s) 7s ago 13m 52.3M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:11:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 msgr2=0x7f424c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 0x7f424c070e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f42580051c0 tx=0x7f425800b540 comp rx=0 tx=0).stop 2024-04-26T21:11:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 msgr2=0x7f426819d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f425400d8d0 tx=0x7f425400dc90 comp rx=0 tx=0).stop 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 shutdown_connections 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f424c06e950 0x7f424c070e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4268101720 0x7f426819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 --2- 172.21.15.55:0/3785152067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4268104050 0x7f426819d160 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.313+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 >> 172.21.15.55:0/3785152067 conn(0x7f42680fb110 msgr2=0x7f4268100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.314+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 shutdown_connections 2024-04-26T21:11:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.314+0000 7f426e400700 1 -- 172.21.15.55:0/3785152067 wait complete. 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 -- 172.21.15.55:0/2987630284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 msgr2=0x7f5e94073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2987630284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94073d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009910 tx=0x7f5e7c009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 -- 172.21.15.55:0/2987630284 shutdown_connections 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2987630284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94073d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2987630284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 0x7f5e94073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 -- 172.21.15.55:0/2987630284 >> 172.21.15.55:0/2987630284 conn(0x7f5e940fc050 msgr2=0x7f5e940fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 -- 172.21.15.55:0/2987630284 shutdown_connections 2024-04-26T21:11:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.473+0000 7f5e93e00700 1 -- 172.21.15.55:0/2987630284 wait complete. 2024-04-26T21:11:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.474+0000 7f5e93e00700 1 Processor -- start 2024-04-26T21:11:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.474+0000 7f5e93e00700 1 -- start start 2024-04-26T21:11:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e93e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e93e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 0x7f5e94198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e93e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e941991d0 con 0x7f5e940738e0 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e93e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94199310 con 0x7f5e94074eb0 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e92a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e92a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59566/0 (socket says 172.21.15.55:59566) 2024-04-26T21:11:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.475+0000 7f5e92a00700 1 -- 172.21.15.55:0/2832611118 learned_addr learned my addr 172.21.15.55:0/2832611118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e8a000700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 0x7f5e94198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e92a00700 1 -- 172.21.15.55:0/2832611118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 msgr2=0x7f5e94198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e92a00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 0x7f5e94198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e92a00700 1 -- 172.21.15.55:0/2832611118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0095f0 con 0x7f5e940738e0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e92a00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400d8d0 tx=0x7f5e8400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e84009940 con 0x7f5e940738e0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e84010460 con 0x7f5e940738e0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.476+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9419dd20 con 0x7f5e940738e0 2024-04-26T21:11:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.477+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8400f5f0 con 0x7f5e940738e0 2024-04-26T21:11:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.477+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9419e290 con 0x7f5e940738e0 2024-04-26T21:11:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.478+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e70005320 con 0x7f5e940738e0 2024-04-26T21:11:02.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.479+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f5e84010ad0 con 0x7f5e940738e0 2024-04-26T21:11:02.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.480+0000 7f5e8be00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 0x7f5e78070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.480+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5e8408e7e0 con 0x7f5e940738e0 2024-04-26T21:11:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.480+0000 7f5e8a000700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 0x7f5e78070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.481+0000 7f5e8a000700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 0x7f5e78070e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00b5c0 tx=0x7f5e7c005160 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:02.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.485+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5e8405b5d0 con 0x7f5e940738e0 2024-04-26T21:11:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:02 smithi055 ceph-mon[25475]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:02 smithi055 ceph-mon[25475]: pgmap v81: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:02.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.814+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e70005de0 con 0x7f5e940738e0 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.815+0000 7f5e8be00700 1 -- 172.21.15.55:0/2832611118 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f5e8405b160 con 0x7f5e940738e0 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:02.817 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:11:02.818 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 msgr2=0x7f5e78070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 0x7f5e78070e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00b5c0 tx=0x7f5e7c005160 comp rx=0 tx=0).stop 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 msgr2=0x7f5e94198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400d8d0 tx=0x7f5e8400dc90 comp rx=0 tx=0).stop 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 shutdown_connections 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5e7806e950 0x7f5e78070e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e940738e0 0x7f5e94198670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 --2- 172.21.15.55:0/2832611118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e94074eb0 0x7f5e94198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 >> 172.21.15.55:0/2832611118 conn(0x7f5e940fc050 msgr2=0x7f5e94106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.818+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 shutdown_connections 2024-04-26T21:11:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.819+0000 7f5e93e00700 1 -- 172.21.15.55:0/2832611118 wait complete. 2024-04-26T21:11:02.893 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:02 smithi064 ceph-mon[33404]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:02.893 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:02 smithi064 ceph-mon[33404]: pgmap v81: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:02.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 -- 172.21.15.55:0/3755141175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c107260 msgr2=0x7f6d0c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 --2- 172.21.15.55:0/3755141175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c107260 0x7f6d0c107680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009910 tx=0x7f6cfc009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:02.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 -- 172.21.15.55:0/3755141175 shutdown_connections 2024-04-26T21:11:02.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 --2- 172.21.15.55:0/3755141175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c108460 0x7f6d0c1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 --2- 172.21.15.55:0/3755141175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c107260 0x7f6d0c107680 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 -- 172.21.15.55:0/3755141175 >> 172.21.15.55:0/3755141175 conn(0x7f6d0c076400 msgr2=0x7f6d0c078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 -- 172.21.15.55:0/3755141175 shutdown_connections 2024-04-26T21:11:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.987+0000 7f6d13000700 1 -- 172.21.15.55:0/3755141175 wait complete. 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.988+0000 7f6d13000700 1 Processor -- start 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d13000700 1 -- start start 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d13000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c107260 0x7f6d0c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d13000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d13000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c19d7d0 con 0x7f6d0c108460 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d13000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c19d910 con 0x7f6d0c107260 2024-04-26T21:11:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d0b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.989+0000 7f6d0b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59582/0 (socket says 172.21.15.55:59582) 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0b400700 1 -- 172.21.15.55:0/2912947292 learned_addr learned my addr 172.21.15.55:0/2912947292 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0be00700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c107260 0x7f6d0c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0b400700 1 -- 172.21.15.55:0/2912947292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c107260 msgr2=0x7f6d0c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0b400700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c107260 0x7f6d0c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0b400700 1 -- 172.21.15.55:0/2912947292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0095f0 con 0x7f6d0c108460 2024-04-26T21:11:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.990+0000 7f6d0b400700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c8a0 tx=0x7f6cf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.991+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf800cea0 con 0x7f6d0c108460 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.991+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cf8004830 con 0x7f6d0c108460 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.991+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c1a2320 con 0x7f6d0c108460 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.991+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf80055b0 con 0x7f6d0c108460 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.991+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c1a28f0 con 0x7f6d0c108460 2024-04-26T21:11:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.992+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c196de0 con 0x7f6d0c108460 2024-04-26T21:11:02.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.993+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f6cf80049a0 con 0x7f6d0c108460 2024-04-26T21:11:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.994+0000 7f6d08c00700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 0x7f6cf0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.994+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6cf808e590 con 0x7f6d0c108460 2024-04-26T21:11:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.994+0000 7f6d0be00700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 0x7f6cf0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.995+0000 7f6d0be00700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 0x7f6cf0070e10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc006010 tx=0x7f6cfc00b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:02.999+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f6cf805b3a0 con 0x7f6d0c108460 2024-04-26T21:11:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.263+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d0c02cde0 con 0x7f6cf006e950 2024-04-26T21:11:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.266+0000 7f6d08c00700 1 -- 172.21.15.55:0/2912947292 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6d0c02cde0 con 0x7f6cf006e950 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:11:03.270 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:11:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 msgr2=0x7f6cf0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 0x7f6cf0070e10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc006010 tx=0x7f6cfc00b540 comp rx=0 tx=0).stop 2024-04-26T21:11:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 msgr2=0x7f6d0c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c8a0 tx=0x7f6cf800cc60 comp rx=0 tx=0).stop 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 shutdown_connections 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f6cf006e950 0x7f6cf0070e10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d0c107260 0x7f6d0c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 --2- 172.21.15.55:0/2912947292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c108460 0x7f6d0c19d1b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 >> 172.21.15.55:0/2912947292 conn(0x7f6d0c076400 msgr2=0x7f6d0c10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.269+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 shutdown_connections 2024-04-26T21:11:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:03.270+0000 7f6d13000700 1 -- 172.21.15.55:0/2912947292 wait complete. 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2832611118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:03 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2832611118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:03 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:11:04.702 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:04.702 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: pgmap v82: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:04.702 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:11:04.702 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.703 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:04 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:04.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: pgmap v82: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:04.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-26T21:11:04.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:04.812 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:04 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:06 smithi064 ceph-mon[33404]: pgmap v83: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:07.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:06 smithi055 ceph-mon[25475]: pgmap v83: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:07.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:07 smithi064 ceph-mon[33404]: Upgrade: Updating grafana.smithi055 2024-04-26T21:11:07.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:07 smithi064 ceph-mon[33404]: Deploying daemon grafana.smithi055 on smithi055 2024-04-26T21:11:08.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:07 smithi055 ceph-mon[25475]: Upgrade: Updating grafana.smithi055 2024-04-26T21:11:08.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:07 smithi055 ceph-mon[25475]: Deploying daemon grafana.smithi055 on smithi055 2024-04-26T21:11:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:08 smithi064 ceph-mon[33404]: pgmap v84: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:09.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:08 smithi055 ceph-mon[25475]: pgmap v84: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:10 smithi064 ceph-mon[33404]: pgmap v85: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:11.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:10 smithi055 ceph-mon[25475]: pgmap v85: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:11 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:12.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:11 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:12 smithi064 ceph-mon[33404]: pgmap v86: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:13.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:12 smithi055 ceph-mon[25475]: pgmap v86: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:14 smithi064 ceph-mon[33404]: pgmap v87: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:14 smithi055 ceph-mon[25475]: pgmap v87: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:16.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:16 smithi055 ceph-mon[25475]: pgmap v88: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:16 smithi064 ceph-mon[33404]: pgmap v88: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:18.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:18 smithi055 ceph-mon[25475]: pgmap v89: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:18.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:18 smithi064 ceph-mon[33404]: pgmap v89: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:20.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:20 smithi064 ceph-mon[33404]: pgmap v90: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:21.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:20 smithi055 ceph-mon[25475]: pgmap v90: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:22.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:22 smithi055 ceph-mon[25475]: pgmap v91: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:22.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:22.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:22 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:22.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:22 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:22 smithi064 ceph-mon[33404]: pgmap v91: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:22 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:22.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:22 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:24 smithi064 ceph-mon[33404]: pgmap v92: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:25.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:24 smithi055 ceph-mon[25475]: pgmap v92: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:25.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:25 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:26.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:25 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:26 smithi064 ceph-mon[33404]: pgmap v93: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:27.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:26 smithi055 ceph-mon[25475]: pgmap v93: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:27.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:27 smithi064 ceph-mon[33404]: pgmap v94: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:27.975 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:27 smithi055 ceph-mon[25475]: pgmap v94: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:30.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:30 smithi064 ceph-mon[33404]: pgmap v95: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:31.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:30 smithi055 ceph-mon[25475]: pgmap v95: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:31.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:31 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:31 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:32.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:31 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:32.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:31 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:32.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:32 smithi064 ceph-mon[33404]: pgmap v96: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:33.004 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:32 smithi055 ceph-mon[25475]: pgmap v96: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 -- 172.21.15.55:0/2545204360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 msgr2=0x7f760c1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 --2- 172.21.15.55:0/2545204360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c1063c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009910 tx=0x7f75f4009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 -- 172.21.15.55:0/2545204360 shutdown_connections 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 --2- 172.21.15.55:0/2545204360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c1063c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 --2- 172.21.15.55:0/2545204360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 0x7f760c103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 -- 172.21.15.55:0/2545204360 >> 172.21.15.55:0/2545204360 conn(0x7f760c0fb0b0 msgr2=0x7f760c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 -- 172.21.15.55:0/2545204360 shutdown_connections 2024-04-26T21:11:33.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.447+0000 7f7613000700 1 -- 172.21.15.55:0/2545204360 wait complete. 2024-04-26T21:11:33.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.448+0000 7f7613000700 1 Processor -- start 2024-04-26T21:11:33.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.448+0000 7f7613000700 1 -- start start 2024-04-26T21:11:33.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7613000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 0x7f760c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7613000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7613000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1992a0 con 0x7f760c103fd0 2024-04-26T21:11:33.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7613000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1993e0 con 0x7f760c1016a0 2024-04-26T21:11:33.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7603e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7603e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57028/0 (socket says 172.21.15.55:57028) 2024-04-26T21:11:33.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f7603e00700 1 -- 172.21.15.55:0/2626774897 learned_addr learned my addr 172.21.15.55:0/2626774897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.449+0000 7f760be00700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 0x7f760c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7603e00700 1 -- 172.21.15.55:0/2626774897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 msgr2=0x7f760c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7603e00700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 0x7f760c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7603e00700 1 -- 172.21.15.55:0/2626774897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40095f0 con 0x7f760c103fd0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7603e00700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f75f400bd70 tx=0x7f75f400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75f401d070 con 0x7f760c103fd0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75f400f460 con 0x7f760c103fd0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c19ddf0 con 0x7f760c103fd0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.450+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75f4021620 con 0x7f760c103fd0 2024-04-26T21:11:33.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.451+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c19e330 con 0x7f760c103fd0 2024-04-26T21:11:33.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.452+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0fcc80 con 0x7f760c103fd0 2024-04-26T21:11:33.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.453+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f75f400fa70 con 0x7f760c103fd0 2024-04-26T21:11:33.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.454+0000 7f7609600700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 0x7f75f0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.454+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f75f408fcf0 con 0x7f760c103fd0 2024-04-26T21:11:33.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.454+0000 7f760be00700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 0x7f75f0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.455+0000 7f760be00700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 0x7f75f0070e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005ea0 tx=0x7f75fc005e30 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:33.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.464+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f75f405ca60 con 0x7f760c103fd0 2024-04-26T21:11:33.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.769+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f760c02ce50 con 0x7f75f006e950 2024-04-26T21:11:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.771+0000 7f7609600700 1 -- 172.21.15.55:0/2626774897 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f760c02ce50 con 0x7f75f006e950 2024-04-26T21:11:33.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.773+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 msgr2=0x7f75f0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.773+0000 7f7613000700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 0x7f75f0070e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005ea0 tx=0x7f75fc005e30 comp rx=0 tx=0).stop 2024-04-26T21:11:33.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.773+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 msgr2=0x7f760c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.773+0000 7f7613000700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f75f400bd70 tx=0x7f75f400be50 comp rx=0 tx=0).stop 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 shutdown_connections 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f75f006e950 0x7f75f0070e10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f760c1016a0 0x7f760c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 --2- 172.21.15.55:0/2626774897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760c103fd0 0x7f760c198d10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 >> 172.21.15.55:0/2626774897 conn(0x7f760c0fb0b0 msgr2=0x7f760c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 shutdown_connections 2024-04-26T21:11:33.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.774+0000 7f7613000700 1 -- 172.21.15.55:0/2626774897 wait complete. 2024-04-26T21:11:33.798 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 -- 172.21.15.55:0/2265391060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 msgr2=0x7fda18101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 --2- 172.21.15.55:0/2265391060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda18101050 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fda08009910 tx=0x7fda08009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 -- 172.21.15.55:0/2265391060 shutdown_connections 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 --2- 172.21.15.55:0/2265391060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 0x7fda18102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 --2- 172.21.15.55:0/2265391060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda18101050 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 -- 172.21.15.55:0/2265391060 >> 172.21.15.55:0/2265391060 conn(0x7fda180fc1d0 msgr2=0x7fda180fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:33.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 -- 172.21.15.55:0/2265391060 shutdown_connections 2024-04-26T21:11:33.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.951+0000 7fda1e800700 1 -- 172.21.15.55:0/2265391060 wait complete. 2024-04-26T21:11:33.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.952+0000 7fda1e800700 1 Processor -- start 2024-04-26T21:11:33.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda1e800700 1 -- start start 2024-04-26T21:11:33.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda1e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda1e800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 0x7fda18198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda1e800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18199510 con 0x7fda18100c30 2024-04-26T21:11:33.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda1e800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18199650 con 0x7fda18101e30 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda17400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda17400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57044/0 (socket says 172.21.15.55:57044) 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.953+0000 7fda17400700 1 -- 172.21.15.55:0/500352155 learned_addr learned my addr 172.21.15.55:0/500352155 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.954+0000 7fda16a00700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 0x7fda18198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.954+0000 7fda17400700 1 -- 172.21.15.55:0/500352155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 msgr2=0x7fda18198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.954+0000 7fda17400700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 0x7fda18198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:33.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.954+0000 7fda17400700 1 -- 172.21.15.55:0/500352155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080095f0 con 0x7fda18100c30 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.954+0000 7fda17400700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda080059d0 tx=0x7fda0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.955+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0801d070 con 0x7fda18100c30 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.955+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0800f460 con 0x7fda18100c30 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.955+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda08021620 con 0x7fda18100c30 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.955+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1819e000 con 0x7fda18100c30 2024-04-26T21:11:33.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.955+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1819e520 con 0x7fda18100c30 2024-04-26T21:11:33.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.956+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda18106800 con 0x7fda18100c30 2024-04-26T21:11:33.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.957+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fda0800fa70 con 0x7fda18100c30 2024-04-26T21:11:33.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.958+0000 7fda0fe00700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 0x7fd9fc070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:33.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.959+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fda0808fbf0 con 0x7fda18100c30 2024-04-26T21:11:33.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.959+0000 7fda16a00700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 0x7fd9fc070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:33.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.960+0000 7fda16a00700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 0x7fd9fc070e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda04006fd0 tx=0x7fda04008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:33.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:33.964+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fda0805c9e0 con 0x7fda18100c30 2024-04-26T21:11:34.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:33 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:34.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:33 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:34.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:33 smithi064 ceph-mon[33404]: pgmap v97: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:34.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.220+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1802cdb0 con 0x7fd9fc06e940 2024-04-26T21:11:34.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:33 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:34.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:33 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:34.221 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:33 smithi055 ceph-mon[25475]: pgmap v97: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:34.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.222+0000 7fda0fe00700 1 -- 172.21.15.55:0/500352155 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fda1802cdb0 con 0x7fd9fc06e940 2024-04-26T21:11:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 msgr2=0x7fd9fc070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 0x7fd9fc070e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda04006fd0 tx=0x7fda04008040 comp rx=0 tx=0).stop 2024-04-26T21:11:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 msgr2=0x7fda181989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda080059d0 tx=0x7fda0800be20 comp rx=0 tx=0).stop 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 shutdown_connections 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fd9fc06e940 0x7fd9fc070e00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda18100c30 0x7fda181989b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 --2- 172.21.15.55:0/500352155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda18101e30 0x7fda18198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.224+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 >> 172.21.15.55:0/500352155 conn(0x7fda180fc1d0 msgr2=0x7fda18073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.225+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 shutdown_connections 2024-04-26T21:11:34.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.225+0000 7fda1e800700 1 -- 172.21.15.55:0/500352155 wait complete. 2024-04-26T21:11:34.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 -- 172.21.15.55:0/3457523905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8100a70 msgr2=0x7f8db8100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 --2- 172.21.15.55:0/3457523905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8100a70 0x7f8db8100e90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009910 tx=0x7f8dac009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:34.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 -- 172.21.15.55:0/3457523905 shutdown_connections 2024-04-26T21:11:34.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 --2- 172.21.15.55:0/3457523905 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8101c70 0x7f8db81020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 --2- 172.21.15.55:0/3457523905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8100a70 0x7f8db8100e90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.385+0000 7f8dbe800700 1 -- 172.21.15.55:0/3457523905 >> 172.21.15.55:0/3457523905 conn(0x7f8db80fc050 msgr2=0x7f8db80fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:34.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.386+0000 7f8dbe800700 1 -- 172.21.15.55:0/3457523905 shutdown_connections 2024-04-26T21:11:34.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.386+0000 7f8dbe800700 1 -- 172.21.15.55:0/3457523905 wait complete. 2024-04-26T21:11:34.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.386+0000 7f8dbe800700 1 Processor -- start 2024-04-26T21:11:34.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbe800700 1 -- start start 2024-04-26T21:11:34.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbe800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8100a70 0x7f8db8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:34.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbe800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:34.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbe800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81991f0 con 0x7f8db8101c70 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbe800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8199330 con 0x7f8db8100a70 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57056/0 (socket says 172.21.15.55:57056) 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.387+0000 7f8dbca00700 1 -- 172.21.15.55:0/1457070314 learned_addr learned my addr 172.21.15.55:0/1457070314 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbd400700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8100a70 0x7f8db8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbca00700 1 -- 172.21.15.55:0/1457070314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8100a70 msgr2=0x7f8db8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbca00700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8100a70 0x7f8db8198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbca00700 1 -- 172.21.15.55:0/1457070314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0095f0 con 0x7f8db8101c70 2024-04-26T21:11:34.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbca00700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c8a0 tx=0x7f8da400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da400cea0 con 0x7f8db8101c70 2024-04-26T21:11:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8da4004830 con 0x7f8db8101c70 2024-04-26T21:11:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db819dd90 con 0x7f8db8101c70 2024-04-26T21:11:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.388+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da40055b0 con 0x7f8db8101c70 2024-04-26T21:11:34.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.389+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db819e330 con 0x7f8db8101c70 2024-04-26T21:11:34.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.390+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db8106640 con 0x7f8db8101c70 2024-04-26T21:11:34.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.391+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f8da40049a0 con 0x7f8db8101c70 2024-04-26T21:11:34.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.392+0000 7f8db6000700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 0x7f8da0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:34.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.392+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8da408e210 con 0x7f8db8101c70 2024-04-26T21:11:34.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.392+0000 7f8dbd400700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 0x7f8da0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.393+0000 7f8dbd400700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 0x7f8da0070e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00b5c0 tx=0x7f8dac005160 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:34.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.397+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8da405b0a0 con 0x7f8db8101c70 2024-04-26T21:11:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.644+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8db802ce50 con 0x7f8da006e950 2024-04-26T21:11:34.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.677+0000 7f8db6000700 1 -- 172.21.15.55:0/1457070314 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f8db802ce50 con 0x7f8da006e950 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (48s) 4s ago 15m 13.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (15m) 4s ago 15m 8182k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (13m) 110s ago 13m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (15m) 4s ago 15m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:11:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (13m) 110s ago 13m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (12s) 4s ago 14m 50.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (7m) 4s ago 7m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (7m) 4s ago 7m 15.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (7m) 110s ago 7m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (7m) 110s ago 7m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (3m) 4s ago 16m 508M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (2m) 110s ago 13m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (16m) 4s ago 17m 57.8M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (13m) 110s ago 13m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (2m) 4s ago 15m 8040k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (117s) 110s ago 13m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (12m) 4s ago 12m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:11:34.679 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (11m) 4s ago 11m 267M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:11:34.680 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (11m) 4s ago 11m 227M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:11:34.680 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (10m) 110s ago 10m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:11:34.680 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (10m) 110s ago 9m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:11:34.680 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (9m) 110s ago 9m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:11:34.680 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (78s) 4s ago 14m 56.2M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 msgr2=0x7f8da0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 0x7f8da0070e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00b5c0 tx=0x7f8dac005160 comp rx=0 tx=0).stop 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 msgr2=0x7f8db8198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c8a0 tx=0x7f8da400cc60 comp rx=0 tx=0).stop 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 shutdown_connections 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f8da006e950 0x7f8da0070e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8db8100a70 0x7f8db8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 --2- 172.21.15.55:0/1457070314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8db8101c70 0x7f8db8198bd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.680+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 >> 172.21.15.55:0/1457070314 conn(0x7f8db80fc050 msgr2=0x7f8db8073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:34.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.681+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 shutdown_connections 2024-04-26T21:11:34.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.681+0000 7f8dbe800700 1 -- 172.21.15.55:0/1457070314 wait complete. 2024-04-26T21:11:34.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.843+0000 7fa9ec400700 1 -- 172.21.15.55:0/3553800036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4103fa0 msgr2=0x7fa9e4104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.843+0000 7fa9ec400700 1 --2- 172.21.15.55:0/3553800036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4103fa0 0x7fa9e4104420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009910 tx=0x7fa9d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 -- 172.21.15.55:0/3553800036 shutdown_connections 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 --2- 172.21.15.55:0/3553800036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4103fa0 0x7fa9e4104420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 --2- 172.21.15.55:0/3553800036 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9e4102e40 0x7fa9e4103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 -- 172.21.15.55:0/3553800036 >> 172.21.15.55:0/3553800036 conn(0x7fa9e40fe3e0 msgr2=0x7fa9e4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 -- 172.21.15.55:0/3553800036 shutdown_connections 2024-04-26T21:11:34.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.844+0000 7fa9ec400700 1 -- 172.21.15.55:0/3553800036 wait complete. 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 Processor -- start 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 -- start start 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9e4103fa0 0x7fa9e4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4199380 con 0x7fa9e4102e40 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.845+0000 7fa9ec400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41994c0 con 0x7fa9e4103fa0 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57068/0 (socket says 172.21.15.55:57068) 2024-04-26T21:11:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 -- 172.21.15.55:0/2043727373 learned_addr learned my addr 172.21.15.55:0/2043727373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 -- 172.21.15.55:0/2043727373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9e4103fa0 msgr2=0x7fa9e4198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9e4103fa0 0x7fa9e4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.846+0000 7fa9e9a00700 1 -- 172.21.15.55:0/2043727373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00095f0 con 0x7fa9e4102e40 2024-04-26T21:11:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:34.847+0000 7fa9e9a00700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800d8d0 tx=0x7fa9d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:35.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:34 smithi055 ceph-mon[25475]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:34 smithi064 ceph-mon[33404]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:34 smithi064 ceph-mon[33404]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.163+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d8009940 con 0x7fa9e4102e40 2024-04-26T21:11:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.163+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e419df20 con 0x7fa9e4102e40 2024-04-26T21:11:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.163+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9d8010460 con 0x7fa9e4102e40 2024-04-26T21:11:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.164+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d800f5f0 con 0x7fa9e4102e40 2024-04-26T21:11:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.164+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e419e490 con 0x7fa9e4102e40 2024-04-26T21:11:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.165+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4192940 con 0x7fa9e4102e40 2024-04-26T21:11:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.168+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fa9d80105d0 con 0x7fa9e4102e40 2024-04-26T21:11:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.169+0000 7fa9e2000700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 0x7fa9cc070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.170+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa9d808e7b0 con 0x7fa9e4102e40 2024-04-26T21:11:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.170+0000 7fa9e9000700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 0x7fa9cc070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:35.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.171+0000 7fa9e9000700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 0x7fa9cc070e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b5c0 tx=0x7fa9d0005160 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.183+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fa9d805b640 con 0x7fa9e4102e40 2024-04-26T21:11:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:35 smithi055 ceph-mon[25475]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:35.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.531+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9e402cec0 con 0x7fa9e4102e40 2024-04-26T21:11:35.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.532+0000 7fa9e2000700 1 -- 172.21.15.55:0/2043727373 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fa9d805b1d0 con 0x7fa9e4102e40 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:11:35.533 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:11:35.534 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:11:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 msgr2=0x7fa9cc070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 0x7fa9cc070e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b5c0 tx=0x7fa9d0005160 comp rx=0 tx=0).stop 2024-04-26T21:11:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 msgr2=0x7fa9e4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800d8d0 tx=0x7fa9d800dc90 comp rx=0 tx=0).stop 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 shutdown_connections 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa9cc06e940 0x7fa9cc070e00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9e4102e40 0x7fa9e4198820 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 --2- 172.21.15.55:0/2043727373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9e4103fa0 0x7fa9e4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 >> 172.21.15.55:0/2043727373 conn(0x7fa9e40fe3e0 msgr2=0x7fa9e4107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 shutdown_connections 2024-04-26T21:11:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.535+0000 7fa9ec400700 1 -- 172.21.15.55:0/2043727373 wait complete. 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 -- 172.21.15.55:0/3982753324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c0738e0 msgr2=0x7f317c073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 --2- 172.21.15.55:0/3982753324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c0738e0 0x7f317c073d60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3168009910 tx=0x7f3168009c20 comp rx=0 tx=0).stop 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 -- 172.21.15.55:0/3982753324 shutdown_connections 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 --2- 172.21.15.55:0/3982753324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c0738e0 0x7f317c073d60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 --2- 172.21.15.55:0/3982753324 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c074eb0 0x7f317c073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 -- 172.21.15.55:0/3982753324 >> 172.21.15.55:0/3982753324 conn(0x7f317c0fc1d0 msgr2=0x7f317c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 -- 172.21.15.55:0/3982753324 shutdown_connections 2024-04-26T21:11:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.698+0000 7f3183a00700 1 -- 172.21.15.55:0/3982753324 wait complete. 2024-04-26T21:11:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.699+0000 7f3183a00700 1 Processor -- start 2024-04-26T21:11:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f3183a00700 1 -- start start 2024-04-26T21:11:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f3183a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c0738e0 0x7f317c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f3183a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f3183a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1993b0 con 0x7f317c074eb0 2024-04-26T21:11:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f3183a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1994f0 con 0x7f317c0738e0 2024-04-26T21:11:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f317be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f317be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49750/0 (socket says 172.21.15.55:49750) 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.700+0000 7f317be00700 1 -- 172.21.15.55:0/2872353001 learned_addr learned my addr 172.21.15.55:0/2872353001 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f3181000700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c0738e0 0x7f317c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f317be00700 1 -- 172.21.15.55:0/2872353001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c0738e0 msgr2=0x7f317c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f317be00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c0738e0 0x7f317c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f317be00700 1 -- 172.21.15.55:0/2872353001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31680095f0 con 0x7f317c074eb0 2024-04-26T21:11:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f317be00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f316800bd70 tx=0x7f316800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.701+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f316801d070 con 0x7f317c074eb0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.702+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3168005dc0 con 0x7f317c074eb0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.702+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c19def0 con 0x7f317c074eb0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.702+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3168021410 con 0x7f317c074eb0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.702+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c19e430 con 0x7f317c074eb0 2024-04-26T21:11:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.703+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c1929c0 con 0x7f317c074eb0 2024-04-26T21:11:35.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.704+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f316800f820 con 0x7f317c074eb0 2024-04-26T21:11:35.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.705+0000 7f3179600700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 0x7f3164070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:11:35.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.705+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f316808fa70 con 0x7f317c074eb0 2024-04-26T21:11:35.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.705+0000 7f3181000700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 0x7f3164070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:11:35.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.706+0000 7f3181000700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 0x7f3164070e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3170005950 tx=0x7f31700058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:11:35.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.710+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f316805c900 con 0x7f317c074eb0 2024-04-26T21:11:35.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.969+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f317c02ce50 con 0x7f316406e950 2024-04-26T21:11:35.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.971+0000 7f3179600700 1 -- 172.21.15.55:0/2872353001 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f317c02ce50 con 0x7f316406e950 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/2 daemons upgraded", 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading grafana daemons", 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:11:35.972 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:11:35.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 msgr2=0x7f3164070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 0x7f3164070e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3170005950 tx=0x7f31700058e0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 msgr2=0x7f317c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:11:35.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f316800bd70 tx=0x7f316800be50 comp rx=0 tx=0).stop 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 shutdown_connections 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f316406e950 0x7f3164070e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f317c0738e0 0x7f317c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 --2- 172.21.15.55:0/2872353001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f317c074eb0 0x7f317c198d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 >> 172.21.15.55:0/2872353001 conn(0x7f317c0fc1d0 msgr2=0x7f317c106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 shutdown_connections 2024-04-26T21:11:35.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:11:35.974+0000 7f3183a00700 1 -- 172.21.15.55:0/2872353001 wait complete. 2024-04-26T21:11:36.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:35 smithi064 ceph-mon[33404]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:36.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:35 smithi064 ceph-mon[33404]: pgmap v98: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:36.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:35 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2043727373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:36.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:35 smithi055 ceph-mon[25475]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:36.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:35 smithi055 ceph-mon[25475]: pgmap v98: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:36.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:35 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2043727373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:36.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:36 smithi055 ceph-mon[25475]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:37.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:36 smithi064 ceph-mon[33404]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:11:37.964 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:37 smithi055 ceph-mon[25475]: pgmap v99: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:38.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:37 smithi064 ceph-mon[33404]: pgmap v99: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:40 smithi064 ceph-mon[33404]: pgmap v100: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:40.940 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:40 smithi055 ceph-mon[25475]: pgmap v100: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:41 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:41 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:42.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: pgmap v101: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:11:42.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:11:42.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:11:42.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:42.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:42 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: pgmap v101: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:11:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:11:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:11:43.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:11:43.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:11:43.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:43.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:43.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:43.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:43.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:42 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:43 smithi064 ceph-mon[33404]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:11:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:43 smithi064 ceph-mon[33404]: Upgrade: Finalizing container_image settings 2024-04-26T21:11:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:43 smithi064 ceph-mon[33404]: Upgrade: Complete! 2024-04-26T21:11:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:43 smithi055 ceph-mon[25475]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-26T21:11:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:43 smithi055 ceph-mon[25475]: Upgrade: Finalizing container_image settings 2024-04-26T21:11:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:43 smithi055 ceph-mon[25475]: Upgrade: Complete! 2024-04-26T21:11:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:44 smithi064 ceph-mon[33404]: pgmap v102: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:45.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:44 smithi055 ceph-mon[25475]: pgmap v102: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:46 smithi064 ceph-mon[33404]: pgmap v103: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:46.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:46 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:47.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:46 smithi055 ceph-mon[25475]: pgmap v103: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:47.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:46 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:11:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:48 smithi064 ceph-mon[33404]: pgmap v104: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:49.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:48 smithi055 ceph-mon[25475]: pgmap v104: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:50 smithi064 ceph-mon[33404]: pgmap v105: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:50 smithi055 ceph-mon[25475]: pgmap v105: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:52.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:52 smithi064 ceph-mon[33404]: pgmap v106: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:53.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:52 smithi055 ceph-mon[25475]: pgmap v106: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:53.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:53 smithi064 ceph-mon[33404]: pgmap v107: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:54.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:53 smithi055 ceph-mon[25475]: pgmap v107: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:56.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:56 smithi064 ceph-mon[33404]: pgmap v108: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:57.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:56 smithi055 ceph-mon[25475]: pgmap v108: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:57.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:11:58.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:11:58 smithi064 ceph-mon[33404]: pgmap v109: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:11:58 smithi055 ceph-mon[25475]: pgmap v109: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:00 smithi064 ceph-mon[33404]: pgmap v110: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:01.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:00 smithi055 ceph-mon[25475]: pgmap v110: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:02.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:02 smithi064 ceph-mon[33404]: pgmap v111: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:03.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:02 smithi055 ceph-mon[25475]: pgmap v111: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:04.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:04 smithi064 ceph-mon[33404]: pgmap v112: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:05.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:04 smithi055 ceph-mon[25475]: pgmap v112: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 -- 172.21.15.55:0/993613614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 msgr2=0x7efebc106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:06.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 --2- 172.21.15.55:0/993613614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc106220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efea4009910 tx=0x7efea4009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 -- 172.21.15.55:0/993613614 shutdown_connections 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 --2- 172.21.15.55:0/993613614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc106220 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 --2- 172.21.15.55:0/993613614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 0x7efebc1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 -- 172.21.15.55:0/993613614 >> 172.21.15.55:0/993613614 conn(0x7efebc0faef0 msgr2=0x7efebc0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.154+0000 7efec1600700 1 -- 172.21.15.55:0/993613614 shutdown_connections 2024-04-26T21:12:06.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.155+0000 7efec1600700 1 -- 172.21.15.55:0/993613614 wait complete. 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.156+0000 7efec1600700 1 Processor -- start 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.156+0000 7efec1600700 1 -- start start 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efec1600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 0x7efebc198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efec1600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efec1600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc199270 con 0x7efebc103e30 2024-04-26T21:12:06.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efec1600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc1993b0 con 0x7efebc101500 2024-04-26T21:12:06.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:06.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35092/0 (socket says 172.21.15.55:35092) 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 -- 172.21.15.55:0/2987141879 learned_addr learned my addr 172.21.15.55:0/2987141879 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efebbe00700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 0x7efebc198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 -- 172.21.15.55:0/2987141879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 msgr2=0x7efebc198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 0x7efebc198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.157+0000 7efeb3e00700 1 -- 172.21.15.55:0/2987141879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40095f0 con 0x7efebc103e30 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efeb3e00700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efea400bd70 tx=0x7efea400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea401d070 con 0x7efebc103e30 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efea400f460 con 0x7efebc103e30 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea4021620 con 0x7efebc103e30 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc19ddb0 con 0x7efebc103e30 2024-04-26T21:12:06.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.158+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc19e320 con 0x7efebc103e30 2024-04-26T21:12:06.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.160+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc04f400 con 0x7efebc103e30 2024-04-26T21:12:06.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.161+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7efea400fa70 con 0x7efebc103e30 2024-04-26T21:12:06.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.162+0000 7efeb9600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 0x7efea0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:06.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.162+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7efea408fc40 con 0x7efebc103e30 2024-04-26T21:12:06.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.162+0000 7efebbe00700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 0x7efea0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:06.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.163+0000 7efebbe00700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 0x7efea0070e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeac006fd0 tx=0x7efeac008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.168+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7efea405ca30 con 0x7efebc103e30 2024-04-26T21:12:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.422+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efebc0ffcc0 con 0x7efea006e950 2024-04-26T21:12:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.425+0000 7efeb9600700 1 -- 172.21.15.55:0/2987141879 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7efebc0ffcc0 con 0x7efea006e950 2024-04-26T21:12:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.428+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 msgr2=0x7efea0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.428+0000 7efec1600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 0x7efea0070e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efeac006fd0 tx=0x7efeac008040 comp rx=0 tx=0).stop 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.428+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 msgr2=0x7efebc198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.428+0000 7efec1600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efea400bd70 tx=0x7efea400be50 comp rx=0 tx=0).stop 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.428+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 shutdown_connections 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7efea006e950 0x7efea0070e10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efebc101500 0x7efebc198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 --2- 172.21.15.55:0/2987141879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efebc103e30 0x7efebc198c50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 >> 172.21.15.55:0/2987141879 conn(0x7efebc0faef0 msgr2=0x7efebc0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 shutdown_connections 2024-04-26T21:12:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:06.429+0000 7efec1600700 1 -- 172.21.15.55:0/2987141879 wait complete. 2024-04-26T21:12:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:06 smithi055 ceph-mon[25475]: pgmap v113: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:06 smithi064 ceph-mon[33404]: pgmap v113: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:07.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-04-26T21:12:07.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:07 smithi055 ceph-mon[25475]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:07.847 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:07.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:07 smithi064 ceph-mon[33404]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:08 smithi064 ceph-mon[33404]: pgmap v114: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:09.001 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:08 smithi055 ceph-mon[25475]: pgmap v114: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 -- 172.21.15.55:0/3944559769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10600ff8f0 msgr2=0x7f10600ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 --2- 172.21.15.55:0/3944559769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10600ff8f0 0x7f10600ffcd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f105400b0a0 tx=0x7f105400b3b0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 -- 172.21.15.55:0/3944559769 shutdown_connections 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 --2- 172.21.15.55:0/3944559769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10601002a0 0x7f106010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 --2- 172.21.15.55:0/3944559769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10600ff8f0 0x7f10600ffcd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 -- 172.21.15.55:0/3944559769 >> 172.21.15.55:0/3944559769 conn(0x7f1060076740 msgr2=0x7f10600fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 -- 172.21.15.55:0/3944559769 shutdown_connections 2024-04-26T21:12:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.223+0000 7f1068000700 1 -- 172.21.15.55:0/3944559769 wait complete. 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.224+0000 7f1068000700 1 Processor -- start 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1068000700 1 -- start start 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1068000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10600ff8f0 0x7f106019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1068000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1068000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106019f520 con 0x7f10601002a0 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1068000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1060198b00 con 0x7f10600ff8f0 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1064c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1064c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35110/0 (socket says 172.21.15.55:35110) 2024-04-26T21:12:10.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.225+0000 7f1064c00700 1 -- 172.21.15.55:0/4178586189 learned_addr learned my addr 172.21.15.55:0/4178586189 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f1065600700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10600ff8f0 0x7f106019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f1064c00700 1 -- 172.21.15.55:0/4178586189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10600ff8f0 msgr2=0x7f106019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f1064c00700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10600ff8f0 0x7f106019e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f1064c00700 1 -- 172.21.15.55:0/4178586189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009d00 con 0x7f10601002a0 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f1064c00700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f104c00d8d0 tx=0x7f104c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.226+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104c009940 con 0x7f10601002a0 2024-04-26T21:12:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.227+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f104c010460 con 0x7f10601002a0 2024-04-26T21:12:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.227+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1060198de0 con 0x7f10601002a0 2024-04-26T21:12:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.227+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104c00f5f0 con 0x7f10601002a0 2024-04-26T21:12:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.227+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1060199330 con 0x7f10601002a0 2024-04-26T21:12:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.228+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060107870 con 0x7f10601002a0 2024-04-26T21:12:10.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.229+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f104c0105d0 con 0x7f10601002a0 2024-04-26T21:12:10.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.230+0000 7f105e000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 0x7f1048070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:10.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.231+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f104c08e960 con 0x7f10601002a0 2024-04-26T21:12:10.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.231+0000 7f1065600700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 0x7f1048070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.232+0000 7f1065600700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 0x7f1048070e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10540062a0 tx=0x7f10540061f0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.235+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f104c05b6d0 con 0x7f10601002a0 2024-04-26T21:12:10.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.560+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1060068ea0 con 0x7f10601002a0 2024-04-26T21:12:10.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.561+0000 7f105e000700 1 -- 172.21.15.55:0/4178586189 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f104c05b260 con 0x7f10601002a0 2024-04-26T21:12:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 msgr2=0x7f1048070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 0x7f1048070e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10540062a0 tx=0x7f10540061f0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 msgr2=0x7f106019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:10.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f104c00d8d0 tx=0x7f104c00dc90 comp rx=0 tx=0).stop 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 shutdown_connections 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f104806e950 0x7f1048070e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10600ff8f0 0x7f106019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 --2- 172.21.15.55:0/4178586189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10601002a0 0x7f106019ef00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 >> 172.21.15.55:0/4178586189 conn(0x7f1060076740 msgr2=0x7f10600fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 shutdown_connections 2024-04-26T21:12:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:10.564+0000 7f1068000700 1 -- 172.21.15.55:0/4178586189 wait complete. 2024-04-26T21:12:10.582 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:12:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:10 smithi064 ceph-mon[33404]: pgmap v115: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:10 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/4178586189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:10.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:10 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:10.968 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:10 smithi055 ceph-mon[25475]: pgmap v115: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:10.968 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:10 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/4178586189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:10.968 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:10 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:11.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-04-26T21:12:11.799 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:12.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:12 smithi064 ceph-mon[33404]: pgmap v116: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:12.997 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:12 smithi055 ceph-mon[25475]: pgmap v116: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:14.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 -- 172.21.15.55:0/1588365610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 msgr2=0x7fbf9010d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:14.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 --2- 172.21.15.55:0/1588365610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9010d4a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009910 tx=0x7fbf80009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:14.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 -- 172.21.15.55:0/1588365610 shutdown_connections 2024-04-26T21:12:14.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 --2- 172.21.15.55:0/1588365610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf90107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 --2- 172.21.15.55:0/1588365610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9010d4a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 -- 172.21.15.55:0/1588365610 >> 172.21.15.55:0/1588365610 conn(0x7fbf90076830 msgr2=0x7fbf90078c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:14.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 -- 172.21.15.55:0/1588365610 shutdown_connections 2024-04-26T21:12:14.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.101+0000 7fbf95200700 1 -- 172.21.15.55:0/1588365610 wait complete. 2024-04-26T21:12:14.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.102+0000 7fbf95200700 1 Processor -- start 2024-04-26T21:12:14.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.103+0000 7fbf95200700 1 -- start start 2024-04-26T21:12:14.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.103+0000 7fbf95200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf9019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:14.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.103+0000 7fbf95200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:14.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.103+0000 7fbf95200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9019db80 con 0x7fbf9010d0c0 2024-04-26T21:12:14.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.103+0000 7fbf95200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9019dcc0 con 0x7fbf901070b0 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35124/0 (socket says 172.21.15.55:35124) 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 -- 172.21.15.55:0/3677614318 learned_addr learned my addr 172.21.15.55:0/3677614318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8f400700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf9019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 -- 172.21.15.55:0/3677614318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 msgr2=0x7fbf9019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf9019cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8ea00700 1 -- 172.21.15.55:0/3677614318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800095f0 con 0x7fbf9010d0c0 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.104+0000 7fbf8f400700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf9019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:12:14.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf8ea00700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c930 tx=0x7fbf7c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:14.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c007ad0 con 0x7fbf9010d0c0 2024-04-26T21:12:14.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf7c007c30 con 0x7fbf9010d0c0 2024-04-26T21:12:14.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c018610 con 0x7fbf9010d0c0 2024-04-26T21:12:14.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf901a1a50 con 0x7fbf9010d0c0 2024-04-26T21:12:14.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.105+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf901a1f50 con 0x7fbf9010d0c0 2024-04-26T21:12:14.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.106+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9010f5c0 con 0x7fbf9010d0c0 2024-04-26T21:12:14.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.108+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fbf7c00f450 con 0x7fbf9010d0c0 2024-04-26T21:12:14.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.109+0000 7fbf87e00700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 0x7fbf74070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:14.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.109+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbf7c08ea90 con 0x7fbf9010d0c0 2024-04-26T21:12:14.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.109+0000 7fbf8f400700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 0x7fbf74070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:14.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.110+0000 7fbf8f400700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 0x7fbf74070e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005b40 tx=0x7fbf8001a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:14.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.115+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fbf7c057d50 con 0x7fbf9010d0c0 2024-04-26T21:12:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.442+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf90108770 con 0x7fbf9010d0c0 2024-04-26T21:12:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.444+0000 7fbf87e00700 1 -- 172.21.15.55:0/3677614318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fbf7c05b410 con 0x7fbf9010d0c0 2024-04-26T21:12:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 msgr2=0x7fbf74070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 0x7fbf74070e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005b40 tx=0x7fbf8001a040 comp rx=0 tx=0).stop 2024-04-26T21:12:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 msgr2=0x7fbf9019d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c930 tx=0x7fbf7c00ccf0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 shutdown_connections 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fbf7406e950 0x7fbf74070e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf901070b0 0x7fbf9019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 --2- 172.21.15.55:0/3677614318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf9010d0c0 0x7fbf9019d530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.447+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 >> 172.21.15.55:0/3677614318 conn(0x7fbf90076830 msgr2=0x7fbf9010c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.448+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 shutdown_connections 2024-04-26T21:12:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:14.448+0000 7fbf95200700 1 -- 172.21.15.55:0/3677614318 wait complete. 2024-04-26T21:12:14.466 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)" 2024-04-26T21:12:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:14 smithi055 ceph-mon[25475]: pgmap v117: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:14.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:14 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3677614318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:14 smithi064 ceph-mon[33404]: pgmap v117: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:14 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3677614318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:15.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-04-26T21:12:15.723 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:16.903 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:16 smithi055 ceph-mon[25475]: pgmap v118: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:16.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:16 smithi064 ceph-mon[33404]: pgmap v118: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:18.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.012+0000 7f99bf000700 1 -- 172.21.15.55:0/3930942834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 msgr2=0x7f99b81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.012+0000 7f99bf000700 1 --2- 172.21.15.55:0/3930942834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b81011f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b0a0 tx=0x7f99a800b3b0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 -- 172.21.15.55:0/3930942834 shutdown_connections 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 --2- 172.21.15.55:0/3930942834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 0x7f99b8105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 --2- 172.21.15.55:0/3930942834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b81011f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 -- 172.21.15.55:0/3930942834 >> 172.21.15.55:0/3930942834 conn(0x7f99b80fc6e0 msgr2=0x7f99b80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 -- 172.21.15.55:0/3930942834 shutdown_connections 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.013+0000 7f99bf000700 1 -- 172.21.15.55:0/3930942834 wait complete. 2024-04-26T21:12:18.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.014+0000 7f99bf000700 1 Processor -- start 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.015+0000 7f99bf000700 1 -- start start 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.015+0000 7f99bf000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.015+0000 7f99bf000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 0x7f99b8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.015+0000 7f99bf000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b8199a20 con 0x7f99b8100e10 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.015+0000 7f99bf000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b819d6f0 con 0x7f99b81017c0 2024-04-26T21:12:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45126/0 (socket says 172.21.15.55:45126) 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 -- 172.21.15.55:0/1997828877 learned_addr learned my addr 172.21.15.55:0/1997828877 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99afe00700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 0x7f99b8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 -- 172.21.15.55:0/1997828877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 msgr2=0x7f99b8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 0x7f99b8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.016+0000 7f99b7e00700 1 -- 172.21.15.55:0/1997828877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009d00 con 0x7f99b8100e10 2024-04-26T21:12:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99b7e00700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b070 tx=0x7f99a8007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a800e040 con 0x7f99b8100e10 2024-04-26T21:12:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99a8003c10 con 0x7f99b8100e10 2024-04-26T21:12:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b819d970 con 0x7f99b8100e10 2024-04-26T21:12:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99a801d6b0 con 0x7f99b8100e10 2024-04-26T21:12:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.017+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b819de60 con 0x7f99b8100e10 2024-04-26T21:12:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.018+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b8104f90 con 0x7f99b8100e10 2024-04-26T21:12:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.019+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f99a8004040 con 0x7f99b8100e10 2024-04-26T21:12:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.021+0000 7f99b5600700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 0x7f999c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.021+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f99a808ffc0 con 0x7f99b8100e10 2024-04-26T21:12:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.022+0000 7f99afe00700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 0x7f999c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.022+0000 7f99afe00700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 0x7f999c070e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99a4005950 tx=0x7f99a40058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.029+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f99a80c4f60 con 0x7f99b8100e10 2024-04-26T21:12:18.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.356+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f99b819a110 con 0x7f99b8100e10 2024-04-26T21:12:18.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.358+0000 7f99b5600700 1 -- 172.21.15.55:0/1997828877 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f99a80172f0 con 0x7f99b8100e10 2024-04-26T21:12:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 msgr2=0x7f999c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:18.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 0x7f999c070e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99a4005950 tx=0x7f99a40058e0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 msgr2=0x7f99b8198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b070 tx=0x7f99a8007bd0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 shutdown_connections 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f999c06e950 0x7f999c070e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b8100e10 0x7f99b8198e00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 --2- 172.21.15.55:0/1997828877 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99b81017c0 0x7f99b8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.361+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 >> 172.21.15.55:0/1997828877 conn(0x7f99b80fc6e0 msgr2=0x7f99b80fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.362+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 shutdown_connections 2024-04-26T21:12:18.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:18.362+0000 7f99bf000700 1 -- 172.21.15.55:0/1997828877 wait complete. 2024-04-26T21:12:18.380 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:12:18.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:18 smithi064 ceph-mon[33404]: pgmap v119: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:18.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:18 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1997828877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:18 smithi055 ceph-mon[25475]: pgmap v119: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:18 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1997828877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:19.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-04-26T21:12:19.685 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:20.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:19 smithi055 ceph-mon[25475]: pgmap v120: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:20.116 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:19 smithi064 ceph-mon[33404]: pgmap v120: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 -- 172.21.15.55:0/3941075428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25881017d0 msgr2=0x7f2588105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 --2- 172.21.15.55:0/3941075428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25881017d0 0x7f2588105820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2574009910 tx=0x7f2574009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 -- 172.21.15.55:0/3941075428 shutdown_connections 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 --2- 172.21.15.55:0/3941075428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25881017d0 0x7f2588105820 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 --2- 172.21.15.55:0/3941075428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2588100e20 0x7f2588101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 -- 172.21.15.55:0/3941075428 >> 172.21.15.55:0/3941075428 conn(0x7f25880fc6d0 msgr2=0x7f25880feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 -- 172.21.15.55:0/3941075428 shutdown_connections 2024-04-26T21:12:22.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.028+0000 7f258fa00700 1 -- 172.21.15.55:0/3941075428 wait complete. 2024-04-26T21:12:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.029+0000 7f258fa00700 1 Processor -- start 2024-04-26T21:12:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.029+0000 7f258fa00700 1 -- start start 2024-04-26T21:12:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258fa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:22.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258fa00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 0x7f258819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258fa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258819d360 con 0x7f2588100e20 2024-04-26T21:12:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258fa00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588196940 con 0x7f25881017d0 2024-04-26T21:12:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258d000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:22.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258d000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45130/0 (socket says 172.21.15.55:45130) 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.030+0000 7f258d000700 1 -- 172.21.15.55:0/552354123 learned_addr learned my addr 172.21.15.55:0/552354123 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f2587e00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 0x7f258819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f258d000700 1 -- 172.21.15.55:0/552354123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 msgr2=0x7f258819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f258d000700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 0x7f258819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f258d000700 1 -- 172.21.15.55:0/552354123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740095f0 con 0x7f2588100e20 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f2587e00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 0x7f258819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f258d000700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c8a0 tx=0x7f257c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.031+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257c00cea0 con 0x7f2588100e20 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.032+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f257c004830 con 0x7f2588100e20 2024-04-26T21:12:22.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.032+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257c0055b0 con 0x7f2588100e20 2024-04-26T21:12:22.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.032+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2588196c20 con 0x7f2588100e20 2024-04-26T21:12:22.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.032+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2588197170 con 0x7f2588100e20 2024-04-26T21:12:22.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.033+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2588109220 con 0x7f2588100e20 2024-04-26T21:12:22.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.035+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f257c0049a0 con 0x7f2588100e20 2024-04-26T21:12:22.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.035+0000 7f2585600700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 0x7f2570070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:22.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.036+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f257c08e190 con 0x7f2588100e20 2024-04-26T21:12:22.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.036+0000 7f2587e00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 0x7f2570070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:22.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.036+0000 7f2587e00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 0x7f2570070e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2574006010 tx=0x7f257400b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:22.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.041+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f257c05b0c0 con 0x7f2588100e20 2024-04-26T21:12:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:22.295+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}) v1 -- 0x7f2588197ea0 con 0x7f257006e940 2024-04-26T21:12:22.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:22 smithi055 ceph-mon[25475]: pgmap v121: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:22.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:22 smithi064 ceph-mon[33404]: pgmap v121: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:23.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:23 smithi064 ceph-mon[33404]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:23.950 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:23 smithi055 ceph-mon[25475]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:24 smithi055 ceph-mon[25475]: pgmap v122: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:24 smithi064 ceph-mon[33404]: pgmap v122: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:25.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.373+0000 7f2585600700 1 -- 172.21.15.55:0/552354123 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5756 (secure 0 0 0) 0x7f2588197ea0 con 0x7f257006e940 2024-04-26T21:12:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 msgr2=0x7f2570070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:25.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 0x7f2570070e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2574006010 tx=0x7f257400b540 comp rx=0 tx=0).stop 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 msgr2=0x7f258819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c8a0 tx=0x7f257c00cc60 comp rx=0 tx=0).stop 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 shutdown_connections 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f257006e940 0x7f2570070e00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2588100e20 0x7f258819c800 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:25.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 --2- 172.21.15.55:0/552354123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25881017d0 0x7f258819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 >> 172.21.15.55:0/552354123 conn(0x7f25880fc6d0 msgr2=0x7f25880fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.377+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 shutdown_connections 2024-04-26T21:12:25.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:25.378+0000 7f258fa00700 1 -- 172.21.15.55:0/552354123 wait complete. 2024-04-26T21:12:25.400 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:12:26.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch ps' 2024-04-26T21:12:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:26.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:26 smithi055 ceph-mon[25475]: pgmap v123: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:26.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:26 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:26 smithi064 ceph-mon[33404]: pgmap v123: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:26 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:28 smithi055 ceph-mon[25475]: pgmap v124: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:28.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:28 smithi064 ceph-mon[33404]: pgmap v124: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 -- 172.21.15.55:0/1761076533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 msgr2=0x7f68d4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 --2- 172.21.15.55:0/1761076533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d4101200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009910 tx=0x7f68c4009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 -- 172.21.15.55:0/1761076533 shutdown_connections 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 --2- 172.21.15.55:0/1761076533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 --2- 172.21.15.55:0/1761076533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d4101200 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 -- 172.21.15.55:0/1761076533 >> 172.21.15.55:0/1761076533 conn(0x7f68d40fc6d0 msgr2=0x7f68d40feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 -- 172.21.15.55:0/1761076533 shutdown_connections 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.970+0000 7f68d8a00700 1 -- 172.21.15.55:0/1761076533 wait complete. 2024-04-26T21:12:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.971+0000 7f68d8a00700 1 Processor -- start 2024-04-26T21:12:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d8a00700 1 -- start start 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d8a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d8a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d8a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4073c60 con 0x7f68d4100e20 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d8a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4073da0 con 0x7f68d41017d0 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44266/0 (socket says 172.21.15.55:44266) 2024-04-26T21:12:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.972+0000 7f68d1e00700 1 -- 172.21.15.55:0/3899655340 learned_addr learned my addr 172.21.15.55:0/3899655340 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1400700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1e00700 1 -- 172.21.15.55:0/3899655340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 msgr2=0x7f68d4073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1e00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1e00700 1 -- 172.21.15.55:0/3899655340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40095f0 con 0x7f68d4100e20 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1400700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:12:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.973+0000 7f68d1e00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68c40092e0 tx=0x7f68c400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.974+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c401d070 con 0x7f68d4100e20 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.974+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68c40056e0 con 0x7f68d4100e20 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.974+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68c400fe80 con 0x7f68d4100e20 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.974+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d4074020 con 0x7f68d4100e20 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.974+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d41a2f80 con 0x7f68d4100e20 2024-04-26T21:12:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.975+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d41091c0 con 0x7f68d4100e20 2024-04-26T21:12:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.976+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f68c400f6f0 con 0x7f68d4100e20 2024-04-26T21:12:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.977+0000 7f68caa00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 0x7f68b8070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:28.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.977+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f68c408fd90 con 0x7f68d4100e20 2024-04-26T21:12:28.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.977+0000 7f68d1400700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 0x7f68b8070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:28.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.978+0000 7f68d1400700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 0x7f68b8070e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f68c0005fd0 tx=0x7f68c0005ee0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:28.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:28.983+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f68c4058fd0 con 0x7f68d4100e20 2024-04-26T21:12:29.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.221+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d410ddf0 con 0x7f68b806e950 2024-04-26T21:12:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.235+0000 7f68caa00700 1 -- 172.21.15.55:0/3899655340 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f68d410ddf0 con 0x7f68b806e950 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (102s) 58s ago 15m 13.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (16m) 58s ago 16m 8182k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (14m) 2m ago 14m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (16m) 58s ago 16m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:12:29.236 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (14m) 2m ago 14m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (67s) 58s ago 15m 50.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (8m) 58s ago 8m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (8m) 58s ago 8m 15.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (8m) 2m ago 8m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (8m) 2m ago 8m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (4m) 58s ago 17m 508M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (3m) 2m ago 14m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (17m) 58s ago 18m 57.8M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (14m) 2m ago 14m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:12:29.237 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (2m) 58s ago 16m 8040k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (2m) 2m ago 14m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (13m) 58s ago 13m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (12m) 58s ago 12m 267M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (12m) 58s ago 12m 227M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (11m) 2m ago 11m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (10m) 2m ago 10m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (10m) 2m ago 10m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:12:29.238 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (2m) 58s ago 15m 56.2M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:12:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 msgr2=0x7f68b8070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 0x7f68b8070e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f68c0005fd0 tx=0x7f68c0005ee0 comp rx=0 tx=0).stop 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 msgr2=0x7f68d40731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68c40092e0 tx=0x7f68c400be20 comp rx=0 tx=0).stop 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 shutdown_connections 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f68b806e950 0x7f68b8070e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68d4100e20 0x7f68d40731e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 --2- 172.21.15.55:0/3899655340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68d41017d0 0x7f68d4073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 >> 172.21.15.55:0/3899655340 conn(0x7f68d40fc6d0 msgr2=0x7f68d40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 shutdown_connections 2024-04-26T21:12:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:29.238+0000 7f68d8a00700 1 -- 172.21.15.55:0/3899655340 wait complete. 2024-04-26T21:12:30.211 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:12:30.211 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:12:30.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-04-26T21:12:30.665 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:30.864 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:30 smithi055 ceph-mon[25475]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:30.865 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:30 smithi055 ceph-mon[25475]: pgmap v125: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:30 smithi064 ceph-mon[33404]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:30 smithi064 ceph-mon[33404]: pgmap v125: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:32.858 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:32 smithi055 ceph-mon[25475]: pgmap v126: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:32.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:32 smithi064 ceph-mon[33404]: pgmap v126: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.927+0000 7febb1000700 1 -- 172.21.15.55:0/900461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075410 msgr2=0x7febac0757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.927+0000 7febb1000700 1 --2- 172.21.15.55:0/900461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075410 0x7febac0757f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00b0a0 tx=0x7feb9c00b3b0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 -- 172.21.15.55:0/900461440 shutdown_connections 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 --2- 172.21.15.55:0/900461440 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075d30 0x7febac111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 --2- 172.21.15.55:0/900461440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075410 0x7febac0757f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 -- 172.21.15.55:0/900461440 >> 172.21.15.55:0/900461440 conn(0x7febac0fe8e0 msgr2=0x7febac100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 -- 172.21.15.55:0/900461440 shutdown_connections 2024-04-26T21:12:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.928+0000 7febb1000700 1 -- 172.21.15.55:0/900461440 wait complete. 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.929+0000 7febb1000700 1 Processor -- start 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.929+0000 7febb1000700 1 -- start start 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7febb1000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075410 0x7febac19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7febb1000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7febb1000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac19dc70 con 0x7febac075d30 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7febb1000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1a1940 con 0x7febac075410 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7feba1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7feba1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44280/0 (socket says 172.21.15.55:44280) 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7feba1400700 1 -- 172.21.15.55:0/3639889622 learned_addr learned my addr 172.21.15.55:0/3639889622 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:32.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.930+0000 7feba9e00700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075410 0x7febac19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba1400700 1 -- 172.21.15.55:0/3639889622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075410 msgr2=0x7febac19d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba1400700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075410 0x7febac19d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba1400700 1 -- 172.21.15.55:0/3639889622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009d00 con 0x7febac075d30 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba1400700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c8a0 tx=0x7feb9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9400cea0 con 0x7febac075d30 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb94004830 con 0x7febac075d30 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1a1c20 con 0x7febac075d30 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.931+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb940055b0 con 0x7febac075d30 2024-04-26T21:12:32.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.932+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac1a2170 con 0x7febac075d30 2024-04-26T21:12:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.933+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac10eca0 con 0x7febac075d30 2024-04-26T21:12:32.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.934+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7feb940049a0 con 0x7febac075d30 2024-04-26T21:12:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.935+0000 7feba3400700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 0x7feb90070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:32.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.935+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7feb9408e530 con 0x7febac075d30 2024-04-26T21:12:32.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.935+0000 7feba9e00700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 0x7feb90070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:32.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.936+0000 7feba9e00700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 0x7feb90070e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009850 tx=0x7feb9c0097e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:32.941+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7feb940577f0 con 0x7febac075d30 2024-04-26T21:12:33.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.172+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7febac076b50 con 0x7febac075d30 2024-04-26T21:12:33.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.187+0000 7feba3400700 1 -- 172.21.15.55:0/3639889622 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v48)=0 v48) v1 ==== 125+0+0 (secure 0 0 0) 0x7feb94004c50 con 0x7febac075d30 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 msgr2=0x7feb90070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 0x7feb90070e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009850 tx=0x7feb9c0097e0 comp rx=0 tx=0).stop 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 msgr2=0x7febac19d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c8a0 tx=0x7feb9400cc60 comp rx=0 tx=0).stop 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 shutdown_connections 2024-04-26T21:12:33.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7feb9006e940 0x7feb90070e00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac075410 0x7febac19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 --2- 172.21.15.55:0/3639889622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febac075d30 0x7febac19d590 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.190+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 >> 172.21.15.55:0/3639889622 conn(0x7febac0fe8e0 msgr2=0x7febac0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.191+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 shutdown_connections 2024-04-26T21:12:33.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:33.191+0000 7febb1000700 1 -- 172.21.15.55:0/3639889622 wait complete. 2024-04-26T21:12:34.036 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:12:34.037 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:12:34.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-26T21:12:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:34 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3639889622' entity='client.admin' 2024-04-26T21:12:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:34 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:34 smithi055 ceph-mon[25475]: pgmap v127: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:34 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3639889622' entity='client.admin' 2024-04-26T21:12:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:34 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:34 smithi064 ceph-mon[33404]: pgmap v127: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:35 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:35 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:35 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:35.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:35 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:35.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:35 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:35.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:35 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:36.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:36 smithi055 ceph-mon[25475]: pgmap v128: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:36 smithi064 ceph-mon[33404]: pgmap v128: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 -- 172.21.15.55:0/3734340892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 msgr2=0x7f2080107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 --2- 172.21.15.55:0/3734340892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f2080107820 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2070009910 tx=0x7f2070009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 -- 172.21.15.55:0/3734340892 shutdown_connections 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 --2- 172.21.15.55:0/3734340892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 --2- 172.21.15.55:0/3734340892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f2080107820 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 -- 172.21.15.55:0/3734340892 >> 172.21.15.55:0/3734340892 conn(0x7f2080076a10 msgr2=0x7f2080078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 -- 172.21.15.55:0/3734340892 shutdown_connections 2024-04-26T21:12:36.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.939+0000 7f2085000700 1 -- 172.21.15.55:0/3734340892 wait complete. 2024-04-26T21:12:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.940+0000 7f2085000700 1 Processor -- start 2024-04-26T21:12:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.941+0000 7f2085000700 1 -- start start 2024-04-26T21:12:36.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.941+0000 7f2085000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.941+0000 7f2085000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.941+0000 7f2085000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208019dd70 con 0x7f2080107440 2024-04-26T21:12:36.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.941+0000 7f2085000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20801a19f0 con 0x7f2080107df0 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58450/0 (socket says 172.21.15.55:58450) 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 -- 172.21.15.55:0/1709531482 learned_addr learned my addr 172.21.15.55:0/1709531482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f2075400700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 -- 172.21.15.55:0/1709531482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 msgr2=0x7f208019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 -- 172.21.15.55:0/1709531482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700095f0 con 0x7f2080107440 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f2075400700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:12:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.942+0000 7f207de00700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f207000bd70 tx=0x7f207000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.943+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207001d070 con 0x7f2080107440 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.943+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20700056e0 con 0x7f2080107440 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.943+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2070017400 con 0x7f2080107440 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.943+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20801a1c70 con 0x7f2080107440 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.943+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20801a2160 con 0x7f2080107440 2024-04-26T21:12:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.944+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208010f7e0 con 0x7f2080107440 2024-04-26T21:12:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.945+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f2070003a60 con 0x7f2080107440 2024-04-26T21:12:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.946+0000 7f2077400700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 0x7f2060070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.947+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f207008fcf0 con 0x7f2080107440 2024-04-26T21:12:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.947+0000 7f2075400700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 0x7f2060070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.948+0000 7f2075400700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 0x7f2060070e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068005ee0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:36.952+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f2070058fb0 con 0x7f2080107440 2024-04-26T21:12:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.181+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f2080108920 con 0x7f2080107440 2024-04-26T21:12:37.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.182+0000 7f2077400700 1 -- 172.21.15.55:0/1709531482 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v48)=0 v48) v1 ==== 155+0+0 (secure 0 0 0) 0x7f207005c670 con 0x7f2080107440 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 msgr2=0x7f2060070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 0x7f2060070e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068005ee0 comp rx=0 tx=0).stop 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 msgr2=0x7f208019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f207000bd70 tx=0x7f207000be50 comp rx=0 tx=0).stop 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 shutdown_connections 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f206006e940 0x7f2060070e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2080107440 0x7f208019d150 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 --2- 172.21.15.55:0/1709531482 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2080107df0 0x7f208019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 >> 172.21.15.55:0/1709531482 conn(0x7f2080076a10 msgr2=0x7f2080076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.185+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 shutdown_connections 2024-04-26T21:12:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:37.186+0000 7f2085000700 1 -- 172.21.15.55:0/1709531482 wait complete. 2024-04-26T21:12:38.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-26T21:12:38.621 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:38 smithi064 ceph-mon[33404]: pgmap v129: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:38.910 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:38 smithi055 ceph-mon[25475]: pgmap v129: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:40.574 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:40 smithi055 ceph-mon[25475]: pgmap v130: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:40 smithi064 ceph-mon[33404]: pgmap v130: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:40.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 -- 172.21.15.55:0/1690969377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c106a20 msgr2=0x7f612c106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:40.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 --2- 172.21.15.55:0/1690969377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c106a20 0x7f612c106e00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f611c009910 tx=0x7f611c009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 -- 172.21.15.55:0/1690969377 shutdown_connections 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 --2- 172.21.15.55:0/1690969377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c100a20 0x7f612c100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 --2- 172.21.15.55:0/1690969377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c106a20 0x7f612c106e00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 -- 172.21.15.55:0/1690969377 >> 172.21.15.55:0/1690969377 conn(0x7f612c0fc530 msgr2=0x7f612c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 -- 172.21.15.55:0/1690969377 shutdown_connections 2024-04-26T21:12:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.939+0000 7f612be00700 1 -- 172.21.15.55:0/1690969377 wait complete. 2024-04-26T21:12:40.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.940+0000 7f612be00700 1 Processor -- start 2024-04-26T21:12:40.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612be00700 1 -- start start 2024-04-26T21:12:40.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c106a20 0x7f612c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c19f480 con 0x7f612c100a20 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612be00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c198ab0 con 0x7f612c106a20 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58466/0 (socket says 172.21.15.55:58466) 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.941+0000 7f612aa00700 1 -- 172.21.15.55:0/851236064 learned_addr learned my addr 172.21.15.55:0/851236064 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.942+0000 7f6122000700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c106a20 0x7f612c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.942+0000 7f612aa00700 1 -- 172.21.15.55:0/851236064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c106a20 msgr2=0x7f612c19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.942+0000 7f612aa00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c106a20 0x7f612c19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.942+0000 7f612aa00700 1 -- 172.21.15.55:0/851236064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0095f0 con 0x7f612c100a20 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.942+0000 7f612aa00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f611c0092e0 tx=0x7f611c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.943+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c01d070 con 0x7f612c100a20 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.943+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f611c00f460 con 0x7f612c100a20 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.943+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c017630 con 0x7f612c100a20 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.943+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c198d30 con 0x7f612c100a20 2024-04-26T21:12:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.943+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c199220 con 0x7f612c100a20 2024-04-26T21:12:40.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.944+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c104cd0 con 0x7f612c100a20 2024-04-26T21:12:40.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.945+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f611c00f5d0 con 0x7f612c100a20 2024-04-26T21:12:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.946+0000 7f6123e00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 0x7f6110070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.946+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f611c08fd90 con 0x7f612c100a20 2024-04-26T21:12:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.946+0000 7f6122000700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 0x7f6110070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:40.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.947+0000 7f6122000700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 0x7f6110070e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f612c199c20 tx=0x7f61140072f0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:40.951+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f611c05cb80 con 0x7f612c100a20 2024-04-26T21:12:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.181+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f612c199f20 con 0x7f612c100a20 2024-04-26T21:12:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.182+0000 7f6123e00700 1 -- 172.21.15.55:0/851236064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v48)=0 v48) v1 ==== 163+0+0 (secure 0 0 0) 0x7f611c05c710 con 0x7f612c100a20 2024-04-26T21:12:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 msgr2=0x7f6110070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 0x7f6110070e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f612c199c20 tx=0x7f61140072f0 comp rx=0 tx=0).stop 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 msgr2=0x7f612c19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f611c0092e0 tx=0x7f611c00be20 comp rx=0 tx=0).stop 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 shutdown_connections 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f611006e950 0x7f6110070e10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f612c100a20 0x7f612c19e920 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 --2- 172.21.15.55:0/851236064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f612c106a20 0x7f612c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 >> 172.21.15.55:0/851236064 conn(0x7f612c0fc530 msgr2=0x7f612c0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.185+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 shutdown_connections 2024-04-26T21:12:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:41.186+0000 7f612be00700 1 -- 172.21.15.55:0/851236064 wait complete. 2024-04-26T21:12:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:41 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:41.959 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:41 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:42.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-26T21:12:42.474 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:42.847 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:42 smithi055 ceph-mon[25475]: pgmap v131: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:42 smithi064 ceph-mon[33404]: pgmap v131: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 -- 172.21.15.55:0/2522057578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 msgr2=0x7f5ac8107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 --2- 172.21.15.55:0/2522057578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac8107860 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009910 tx=0x7f5ab4009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 -- 172.21.15.55:0/2522057578 shutdown_connections 2024-04-26T21:12:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 --2- 172.21.15.55:0/2522057578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac8107860 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 --2- 172.21.15.55:0/2522057578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac8103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 -- 172.21.15.55:0/2522057578 >> 172.21.15.55:0/2522057578 conn(0x7f5ac80fe710 msgr2=0x7f5ac8100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 -- 172.21.15.55:0/2522057578 shutdown_connections 2024-04-26T21:12:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.621+0000 7f5acec00700 1 -- 172.21.15.55:0/2522057578 wait complete. 2024-04-26T21:12:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.622+0000 7f5acec00700 1 Processor -- start 2024-04-26T21:12:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.622+0000 7f5acec00700 1 -- start start 2024-04-26T21:12:44.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.622+0000 7f5acec00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:44.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acec00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:44.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acec00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac819f320 con 0x7f5ac8103810 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acec00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81989e0 con 0x7f5ac8102e60 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58474/0 (socket says 172.21.15.55:58474) 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 -- 172.21.15.55:0/931960516 learned_addr learned my addr 172.21.15.55:0/931960516 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acd800700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:44.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 -- 172.21.15.55:0/931960516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 msgr2=0x7f5ac819e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac819e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acce00700 1 -- 172.21.15.55:0/931960516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40095f0 con 0x7f5ac8103810 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.623+0000 7f5acd800700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac819e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5acce00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40092e0 tx=0x7f5ab400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab401d070 con 0x7f5ac8103810 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ab400f460 con 0x7f5ac8103810 2024-04-26T21:12:44.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab4017610 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac8198c60 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.624+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac8199150 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.626+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac810b260 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.627+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f5ab400f5d0 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.627+0000 7f5ac6000700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 0x7f5ab0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.628+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5ab408fca0 con 0x7f5ac8103810 2024-04-26T21:12:44.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.628+0000 7f5acd800700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 0x7f5ab0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:44.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.629+0000 7f5acd800700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 0x7f5ab0070e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005fd0 tx=0x7f5abc005e20 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:44.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.633+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5ab4094070 con 0x7f5ac8103810 2024-04-26T21:12:44.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:44 smithi055 ceph-mon[25475]: pgmap v132: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:44.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.867+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5ac8199e50 con 0x7f5ac8103810 2024-04-26T21:12:44.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.868+0000 7f5ac6000700 1 -- 172.21.15.55:0/931960516 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v48)=0 v48) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5ab405cb30 con 0x7f5ac8103810 2024-04-26T21:12:44.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 msgr2=0x7f5ab0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:44.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 0x7f5ab0070e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005fd0 tx=0x7f5abc005e20 comp rx=0 tx=0).stop 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 msgr2=0x7f5ac819ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40092e0 tx=0x7f5ab400be20 comp rx=0 tx=0).stop 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 shutdown_connections 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f5ab006e950 0x7f5ab0070e10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ac8102e60 0x7f5ac819e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 --2- 172.21.15.55:0/931960516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ac8103810 0x7f5ac819ed90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 >> 172.21.15.55:0/931960516 conn(0x7f5ac80fe710 msgr2=0x7f5ac80feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 shutdown_connections 2024-04-26T21:12:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:44.872+0000 7f5acec00700 1 -- 172.21.15.55:0/931960516 wait complete. 2024-04-26T21:12:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:44 smithi064 ceph-mon[33404]: pgmap v132: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:45.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-26T21:12:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:46.719 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:46 smithi055 ceph-mon[25475]: pgmap v133: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:46 smithi064 ceph-mon[33404]: pgmap v133: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.627+0000 7fe902600700 1 -- 172.21.15.55:0/547010672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc100e20 msgr2=0x7fe8fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.627+0000 7fe902600700 1 --2- 172.21.15.55:0/547010672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc100e20 0x7fe8fc101200 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009910 tx=0x7fe8ec009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 -- 172.21.15.55:0/547010672 shutdown_connections 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 --2- 172.21.15.55:0/547010672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 --2- 172.21.15.55:0/547010672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc100e20 0x7fe8fc101200 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 -- 172.21.15.55:0/547010672 >> 172.21.15.55:0/547010672 conn(0x7fe8fc0fc6d0 msgr2=0x7fe8fc0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 -- 172.21.15.55:0/547010672 shutdown_connections 2024-04-26T21:12:48.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.628+0000 7fe902600700 1 -- 172.21.15.55:0/547010672 wait complete. 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.629+0000 7fe902600700 1 Processor -- start 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.629+0000 7fe902600700 1 -- start start 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe902600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc100e20 0x7fe8fc19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe902600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe902600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc19d3b0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe902600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc196990 con 0x7fe8fc100e20 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe8f3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe8f3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47538/0 (socket says 172.21.15.55:47538) 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe8f3e00700 1 -- 172.21.15.55:0/2920171475 learned_addr learned my addr 172.21.15.55:0/2920171475 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.630+0000 7fe8fb400700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc100e20 0x7fe8fc19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f3e00700 1 -- 172.21.15.55:0/2920171475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc100e20 msgr2=0x7fe8fc19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f3e00700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc100e20 0x7fe8fc19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f3e00700 1 -- 172.21.15.55:0/2920171475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0095f0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f3e00700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d900 tx=0x7fe8e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:48.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e4009900 con 0x7fe8fc1017d0 2024-04-26T21:12:48.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8e4010460 con 0x7fe8fc1017d0 2024-04-26T21:12:48.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc196c70 con 0x7fe8fc1017d0 2024-04-26T21:12:48.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.631+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e400f5f0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.632+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc1971c0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.633+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc1091c0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.634+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fe8e40105d0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.635+0000 7fe8f8c00700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 0x7fe8e0070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:48.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.636+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe8e408e6e0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.636+0000 7fe8fb400700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 0x7fe8e0070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:48.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.637+0000 7fe8fb400700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 0x7fe8e0070e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec005b40 tx=0x7fe8ec01a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:48.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.641+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fe8e405b4d0 con 0x7fe8fc1017d0 2024-04-26T21:12:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:48 smithi055 ceph-mon[25475]: pgmap v134: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.901+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8fc10ddf0 con 0x7fe8e006e940 2024-04-26T21:12:48.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:48 smithi064 ceph-mon[33404]: pgmap v134: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.916+0000 7fe8f8c00700 1 -- 172.21.15.55:0/2920171475 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fe8fc10ddf0 con 0x7fe8e006e940 2024-04-26T21:12:48.918 INFO:teuthology.orchestra.run.smithi055.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 msgr2=0x7fe8e0070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 0x7fe8e0070e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec005b40 tx=0x7fe8ec01a040 comp rx=0 tx=0).stop 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 msgr2=0x7fe8fc19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d900 tx=0x7fe8e400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 shutdown_connections 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe8e006e940 0x7fe8e0070e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8fc100e20 0x7fe8fc19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 --2- 172.21.15.55:0/2920171475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8fc1017d0 0x7fe8fc19cd90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.919+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 >> 172.21.15.55:0/2920171475 conn(0x7fe8fc0fc6d0 msgr2=0x7fe8fc0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.920+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 shutdown_connections 2024-04-26T21:12:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:48.920+0000 7fe902600700 1 -- 172.21.15.55:0/2920171475 wait complete. 2024-04-26T21:12:49.762 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-26T21:12:49.762 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:12:49.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:12:50.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:49 smithi055 ceph-mon[25475]: pgmap v135: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:50.181 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:50.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:12:50.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:49 smithi064 ceph-mon[33404]: pgmap v135: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:12:52.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:52 smithi055 ceph-mon[25475]: pgmap v136: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:52.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:52 smithi064 ceph-mon[33404]: pgmap v136: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:53.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 -- 172.21.15.55:0/1601281166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075d30 msgr2=0x7f0ac0111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/1601281166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075d30 0x7f0ac0111520 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009910 tx=0x7f0aac009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:53.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 -- 172.21.15.55:0/1601281166 shutdown_connections 2024-04-26T21:12:53.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/1601281166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075d30 0x7f0ac0111520 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/1601281166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075410 0x7f0ac00757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 -- 172.21.15.55:0/1601281166 >> 172.21.15.55:0/1601281166 conn(0x7f0ac00fe8d0 msgr2=0x7f0ac0100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:53.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 -- 172.21.15.55:0/1601281166 shutdown_connections 2024-04-26T21:12:53.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.397+0000 7f0ac4e00700 1 -- 172.21.15.55:0/1601281166 wait complete. 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.398+0000 7f0ac4e00700 1 Processor -- start 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0ac4e00700 1 -- start start 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0ac4e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0ac4e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075d30 0x7f0ac019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0ac4e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac019dc90 con 0x7f0ac0075410 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0ac4e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01a1960 con 0x7f0ac0075d30 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0abde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0abde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47568/0 (socket says 172.21.15.55:47568) 2024-04-26T21:12:53.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.399+0000 7f0abde00700 1 -- 172.21.15.55:0/56239713 learned_addr learned my addr 172.21.15.55:0/56239713 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:53.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.400+0000 7f0abd400700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075d30 0x7f0ac019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.400+0000 7f0abde00700 1 -- 172.21.15.55:0/56239713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075d30 msgr2=0x7f0ac019d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.400+0000 7f0abde00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075d30 0x7f0ac019d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.400+0000 7f0abde00700 1 -- 172.21.15.55:0/56239713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0095f0 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.400+0000 7f0abde00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000c8a0 tx=0x7f0ab000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.401+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab000cea0 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.401+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ab0004830 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.401+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab00055b0 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.401+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac01a1c40 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.401+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac01a2190 con 0x7f0ac0075410 2024-04-26T21:12:53.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.402+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac0076b50 con 0x7f0ac0075410 2024-04-26T21:12:53.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.403+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f0ab00049a0 con 0x7f0ac0075410 2024-04-26T21:12:53.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.404+0000 7f0ab6a00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 0x7f0aa4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.404+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0ab008e630 con 0x7f0ac0075410 2024-04-26T21:12:53.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.404+0000 7f0abd400700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 0x7f0aa4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.405+0000 7f0abd400700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 0x7f0aa4070e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ac019e5d0 tx=0x7f0aac005960 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:53.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.409+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f0ab0057870 con 0x7f0ac0075410 2024-04-26T21:12:53.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.668+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ac0114320 con 0x7f0aa406e940 2024-04-26T21:12:53.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.671+0000 7f0ab6a00700 1 -- 172.21.15.55:0/56239713 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f0ac0114320 con 0x7f0aa406e940 2024-04-26T21:12:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.673+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 msgr2=0x7f0aa4070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.673+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 0x7f0aa4070e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ac019e5d0 tx=0x7f0aac005960 comp rx=0 tx=0).stop 2024-04-26T21:12:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 msgr2=0x7f0ac019d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000c8a0 tx=0x7f0ab000cc60 comp rx=0 tx=0).stop 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 shutdown_connections 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f0aa406e940 0x7f0aa4070e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac0075410 0x7f0ac019d070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 --2- 172.21.15.55:0/56239713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ac0075d30 0x7f0ac019d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 >> 172.21.15.55:0/56239713 conn(0x7f0ac00fe8d0 msgr2=0x7f0ac00ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 shutdown_connections 2024-04-26T21:12:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.674+0000 7f0ac4e00700 1 -- 172.21.15.55:0/56239713 wait complete. 2024-04-26T21:12:53.693 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 -- 172.21.15.55:0/2032280350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 msgr2=0x7fc56c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 --2- 172.21.15.55:0/2032280350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c1011f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc56000b0a0 tx=0x7fc56000b3b0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 -- 172.21.15.55:0/2032280350 shutdown_connections 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 --2- 172.21.15.55:0/2032280350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 0x7fc56c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 --2- 172.21.15.55:0/2032280350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c1011f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 -- 172.21.15.55:0/2032280350 >> 172.21.15.55:0/2032280350 conn(0x7fc56c0fc6e0 msgr2=0x7fc56c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:53.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 -- 172.21.15.55:0/2032280350 shutdown_connections 2024-04-26T21:12:53.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.851+0000 7fc573a00700 1 -- 172.21.15.55:0/2032280350 wait complete. 2024-04-26T21:12:53.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 Processor -- start 2024-04-26T21:12:53.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 -- start start 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 0x7fc56c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c199990 con 0x7fc56c100e10 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.853+0000 7fc573a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c199ad0 con 0x7fc56c1017c0 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47592/0 (socket says 172.21.15.55:47592) 2024-04-26T21:12:53.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 -- 172.21.15.55:0/2119922199 learned_addr learned my addr 172.21.15.55:0/2119922199 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc56be00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 0x7fc56c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 -- 172.21.15.55:0/2119922199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 msgr2=0x7fc56c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 0x7fc56c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.854+0000 7fc571000700 1 -- 172.21.15.55:0/2119922199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009d00 con 0x7fc56c100e10 2024-04-26T21:12:53.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc571000700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc56000b070 tx=0x7fc560007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:53.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56000e040 con 0x7fc56c100e10 2024-04-26T21:12:53.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc560003de0 con 0x7fc56c100e10 2024-04-26T21:12:53.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56001d6b0 con 0x7fc56c100e10 2024-04-26T21:12:53.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c19d7b0 con 0x7fc56c100e10 2024-04-26T21:12:53.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.855+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c19dc50 con 0x7fc56c100e10 2024-04-26T21:12:53.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.857+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c1022f0 con 0x7fc56c100e10 2024-04-26T21:12:53.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.858+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fc560004040 con 0x7fc56c100e10 2024-04-26T21:12:53.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.859+0000 7fc569600700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 0x7fc554070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:53.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.859+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc560090160 con 0x7fc56c100e10 2024-04-26T21:12:53.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.859+0000 7fc56be00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 0x7fc554070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:53.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.860+0000 7fc56be00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 0x7fc554070e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc558005ea0 tx=0x7fc558005e30 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:53.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:53.865+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fc5600593a0 con 0x7fc56c100e10 2024-04-26T21:12:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.135+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc56c073860 con 0x7fc55406e950 2024-04-26T21:12:54.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.138+0000 7fc569600700 1 -- 172.21.15.55:0/2119922199 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc56c073860 con 0x7fc55406e950 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 msgr2=0x7fc554070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 0x7fc554070e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc558005ea0 tx=0x7fc558005e30 comp rx=0 tx=0).stop 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 msgr2=0x7fc56c198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc56000b070 tx=0x7fc560007bd0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 shutdown_connections 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fc55406e950 0x7fc554070e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc56c100e10 0x7fc56c198e00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 --2- 172.21.15.55:0/2119922199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc56c1017c0 0x7fc56c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.141+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 >> 172.21.15.55:0/2119922199 conn(0x7fc56c0fc6e0 msgr2=0x7fc56c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.142+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 shutdown_connections 2024-04-26T21:12:54.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.142+0000 7fc573a00700 1 -- 172.21.15.55:0/2119922199 wait complete. 2024-04-26T21:12:54.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 -- 172.21.15.55:0/2140247938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02581017c0 msgr2=0x7f0258105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 --2- 172.21.15.55:0/2140247938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02581017c0 0x7f0258105810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0244009910 tx=0x7f0244009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:54.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 -- 172.21.15.55:0/2140247938 shutdown_connections 2024-04-26T21:12:54.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 --2- 172.21.15.55:0/2140247938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02581017c0 0x7f0258105810 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 --2- 172.21.15.55:0/2140247938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0258100e10 0x7f02581011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 -- 172.21.15.55:0/2140247938 >> 172.21.15.55:0/2140247938 conn(0x7f02580fc6e0 msgr2=0x7f02580feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.305+0000 7f025d400700 1 -- 172.21.15.55:0/2140247938 shutdown_connections 2024-04-26T21:12:54.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.306+0000 7f025d400700 1 -- 172.21.15.55:0/2140247938 wait complete. 2024-04-26T21:12:54.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 Processor -- start 2024-04-26T21:12:54.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 -- start start 2024-04-26T21:12:54.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02581017c0 0x7f0258073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258073c60 con 0x7f0258100e10 2024-04-26T21:12:54.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f025d400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258073da0 con 0x7f02581017c0 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.307+0000 7f0256800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47600/0 (socket says 172.21.15.55:47600) 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 -- 172.21.15.55:0/983734257 learned_addr learned my addr 172.21.15.55:0/983734257 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 -- 172.21.15.55:0/983734257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02581017c0 msgr2=0x7f0258073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02581017c0 0x7f0258073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 -- 172.21.15.55:0/983734257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440095f0 con 0x7f0258100e10 2024-04-26T21:12:54.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.308+0000 7f0256800700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f024800d8d0 tx=0x7f024800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.309+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0248009940 con 0x7f0258100e10 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.309+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0248010460 con 0x7f0258100e10 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.309+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f024800f5f0 con 0x7f0258100e10 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.309+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02581a2d30 con 0x7f0258100e10 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.309+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02581a3090 con 0x7f0258100e10 2024-04-26T21:12:54.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.310+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0258109210 con 0x7f0258100e10 2024-04-26T21:12:54.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.311+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7f02480105d0 con 0x7f0258100e10 2024-04-26T21:12:54.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.312+0000 7f024f400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 0x7f023c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.313+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f024808e850 con 0x7f0258100e10 2024-04-26T21:12:54.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.313+0000 7f0255e00700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 0x7f023c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.314+0000 7f0255e00700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 0x7f023c070e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0244006010 tx=0x7f024400b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.318+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f0248057b10 con 0x7f0258100e10 2024-04-26T21:12:54.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.570+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f025810ddb0 con 0x7f023c06e950 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.584+0000 7f024f400700 1 -- 172.21.15.55:0/983734257 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f025810ddb0 con 0x7f023c06e950 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (2m) 84s ago 16m 13.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (16m) 84s ago 16m 8182k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (15m) 3m ago 15m 7889k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (16m) 84s ago 16m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (15m) 3m ago 15m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (92s) 84s ago 16m 50.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:12:54.586 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (8m) 84s ago 8m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (8m) 84s ago 8m 15.5M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (8m) 3m ago 8m 141M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (8m) 3m ago 8m 14.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (5m) 84s ago 18m 508M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (3m) 3m ago 14m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (18m) 84s ago 18m 57.8M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 39b2b61381b4 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (14m) 3m ago 14m 43.7M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (3m) 84s ago 16m 8040k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (3m) 3m ago 15m 3208k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (13m) 84s ago 13m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (13m) 84s ago 13m 267M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (12m) 84s ago 12m 227M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (11m) 3m ago 11m 267M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (11m) 3m ago 11m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (10m) 3m ago 10m 214M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:12:54.587 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (2m) 84s ago 15m 56.2M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 msgr2=0x7f023c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 0x7f023c070e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0244006010 tx=0x7f024400b540 comp rx=0 tx=0).stop 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 msgr2=0x7f02580731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f024800d8d0 tx=0x7f024800dc90 comp rx=0 tx=0).stop 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 shutdown_connections 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7f023c06e950 0x7f023c070e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0258100e10 0x7f02580731e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 --2- 172.21.15.55:0/983734257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02581017c0 0x7f0258073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.587+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 >> 172.21.15.55:0/983734257 conn(0x7f02580fc6e0 msgr2=0x7f02580fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.588+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 shutdown_connections 2024-04-26T21:12:54.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.588+0000 7f025d400700 1 -- 172.21.15.55:0/983734257 wait complete. 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 -- 172.21.15.55:0/3000270515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 msgr2=0x7fa0cc103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3000270515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc103410 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009910 tx=0x7fa0bc009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 -- 172.21.15.55:0/3000270515 shutdown_connections 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3000270515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 0x7fa0cc107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3000270515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc103410 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 -- 172.21.15.55:0/3000270515 >> 172.21.15.55:0/3000270515 conn(0x7fa0cc0fe880 msgr2=0x7fa0cc100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 -- 172.21.15.55:0/3000270515 shutdown_connections 2024-04-26T21:12:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.739+0000 7fa0d2200700 1 -- 172.21.15.55:0/3000270515 wait complete. 2024-04-26T21:12:54.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.740+0000 7fa0d2200700 1 Processor -- start 2024-04-26T21:12:54.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.741+0000 7fa0d2200700 1 -- start start 2024-04-26T21:12:54.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.741+0000 7fa0d2200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.741+0000 7fa0d2200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 0x7fa0cc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.741+0000 7fa0d2200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc199920 con 0x7fa0cc103030 2024-04-26T21:12:54.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.741+0000 7fa0d2200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc19c540 con 0x7fa0cc1039e0 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47620/0 (socket says 172.21.15.55:47620) 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 -- 172.21.15.55:0/3369687021 learned_addr learned my addr 172.21.15.55:0/3369687021 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0caa00700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 0x7fa0cc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 -- 172.21.15.55:0/3369687021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 msgr2=0x7fa0cc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 0x7fa0cc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.742+0000 7fa0cb400700 1 -- 172.21.15.55:0/3369687021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0095f0 con 0x7fa0cc103030 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.743+0000 7fa0cb400700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000c00 tx=0x7fa0bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.743+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc01d070 con 0x7fa0cc103030 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.743+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0bc0056e0 con 0x7fa0cc103030 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.743+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc19c7c0 con 0x7fa0cc103030 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.743+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc00fe80 con 0x7fa0cc103030 2024-04-26T21:12:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.744+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc19ccb0 con 0x7fa0cc103030 2024-04-26T21:12:54.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.745+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc10b3d0 con 0x7fa0cc103030 2024-04-26T21:12:54.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.746+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fa0bc00f6f0 con 0x7fa0cc103030 2024-04-26T21:12:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.747+0000 7fa0c3e00700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 0x7fa0b0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.747+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa0bc08fd50 con 0x7fa0cc103030 2024-04-26T21:12:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.748+0000 7fa0caa00700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 0x7fa0b0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.748+0000 7fa0caa00700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 0x7fa0b0070e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005950 tx=0x7fa0b80058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:54.752+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fa0bc058f90 con 0x7fa0cc103030 2024-04-26T21:12:54.868 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: pgmap v137: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:54.868 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:54.868 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:54.868 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:54.869 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:54.869 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:54 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:12:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: pgmap v137: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:54.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:54.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:54.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:54.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:54.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:54 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:12:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.091+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0cc199fd0 con 0x7fa0cc103030 2024-04-26T21:12:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.092+0000 7fa0c3e00700 1 -- 172.21.15.55:0/3369687021 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fa0bc05c650 con 0x7fa0cc103030 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:12:55.094 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 12, 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:12:55.095 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:12:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 msgr2=0x7fa0b0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 0x7fa0b0070e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8005950 tx=0x7fa0b80058e0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 msgr2=0x7fa0cc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc000c00 tx=0x7fa0bc00be20 comp rx=0 tx=0).stop 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 shutdown_connections 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa0b006e950 0x7fa0b0070e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0cc103030 0x7fa0cc198d50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 --2- 172.21.15.55:0/3369687021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0cc1039e0 0x7fa0cc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 >> 172.21.15.55:0/3369687021 conn(0x7fa0cc0fe880 msgr2=0x7fa0cc0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 shutdown_connections 2024-04-26T21:12:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.095+0000 7fa0d2200700 1 -- 172.21.15.55:0/3369687021 wait complete. 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 -- 172.21.15.55:0/2501605861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc81017c0 msgr2=0x7ffbc8105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 --2- 172.21.15.55:0/2501605861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc81017c0 0x7ffbc8105810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009910 tx=0x7ffbb0009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 -- 172.21.15.55:0/2501605861 shutdown_connections 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 --2- 172.21.15.55:0/2501605861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc81017c0 0x7ffbc8105810 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 --2- 172.21.15.55:0/2501605861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc8100e10 0x7ffbc81011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 -- 172.21.15.55:0/2501605861 >> 172.21.15.55:0/2501605861 conn(0x7ffbc80fc6e0 msgr2=0x7ffbc80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 -- 172.21.15.55:0/2501605861 shutdown_connections 2024-04-26T21:12:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.261+0000 7ffbce800700 1 -- 172.21.15.55:0/2501605861 wait complete. 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.262+0000 7ffbce800700 1 Processor -- start 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.262+0000 7ffbce800700 1 -- start start 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbce800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbce800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 0x7ffbc8073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbce800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8073c60 con 0x7ffbc8100e10 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbce800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8073da0 con 0x7ffbc81017c0 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbc7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbc7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34312/0 (socket says 172.21.15.55:34312) 2024-04-26T21:12:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbc7400700 1 -- 172.21.15.55:0/1252986323 learned_addr learned my addr 172.21.15.55:0/1252986323 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:55.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.263+0000 7ffbbfe00700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 0x7ffbc8073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc7400700 1 -- 172.21.15.55:0/1252986323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 msgr2=0x7ffbc8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc7400700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 0x7ffbc8073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc7400700 1 -- 172.21.15.55:0/1252986323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00095f0 con 0x7ffbc8100e10 2024-04-26T21:12:55.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbbfe00700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 0x7ffbc8073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc7400700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b4b0 tx=0x7ffbb800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb8011800 con 0x7ffbc8100e10 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbb8011e20 con 0x7ffbc8100e10 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc81a2dd0 con 0x7ffbc8100e10 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb800f2e0 con 0x7ffbc8100e10 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.264+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81a3130 con 0x7ffbc8100e10 2024-04-26T21:12:55.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.265+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc81022f0 con 0x7ffbc8100e10 2024-04-26T21:12:55.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.267+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7ffbb8010380 con 0x7ffbc8100e10 2024-04-26T21:12:55.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.268+0000 7ffbc4c00700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 0x7ffbac070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.268+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ffbb808e530 con 0x7ffbc8100e10 2024-04-26T21:12:55.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.268+0000 7ffbbfe00700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 0x7ffbac070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.269+0000 7ffbbfe00700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 0x7ffbac070e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb000b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:55.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.272+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7ffbb8057770 con 0x7ffbc8100e10 2024-04-26T21:12:55.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.546+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffbc810ded0 con 0x7ffbc8100e10 2024-04-26T21:12:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.547+0000 7ffbc4c00700 1 -- 172.21.15.55:0/1252986323 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1870 (secure 0 0 0) 0x7ffbb805ae30 con 0x7ffbc8100e10 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:12:55.549 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:12:55.550 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:12:55.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:12:55.552 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:12:55.552 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:12:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 msgr2=0x7ffbac070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 0x7ffbac070e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb000b540 comp rx=0 tx=0).stop 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 msgr2=0x7ffbc80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b4b0 tx=0x7ffbb800b870 comp rx=0 tx=0).stop 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 shutdown_connections 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7ffbac06e950 0x7ffbac070e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbc8100e10 0x7ffbc80731e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 --2- 172.21.15.55:0/1252986323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc81017c0 0x7ffbc8073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 >> 172.21.15.55:0/1252986323 conn(0x7ffbc80fc6e0 msgr2=0x7ffbc80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 shutdown_connections 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.550+0000 7ffbce800700 1 -- 172.21.15.55:0/1252986323 wait complete. 2024-04-26T21:12:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 -- 172.21.15.55:0/3834414486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 msgr2=0x7fe8ac0ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 --2- 172.21.15.55:0/3834414486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac0ffd50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009910 tx=0x7fe8a0009c20 comp rx=0 tx=0).stop 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 -- 172.21.15.55:0/3834414486 shutdown_connections 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 --2- 172.21.15.55:0/3834414486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 0x7fe8ac10cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 --2- 172.21.15.55:0/3834414486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac0ffd50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 -- 172.21.15.55:0/3834414486 >> 172.21.15.55:0/3834414486 conn(0x7fe8ac076740 msgr2=0x7fe8ac0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 -- 172.21.15.55:0/3834414486 shutdown_connections 2024-04-26T21:12:55.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.712+0000 7fe8b3800700 1 -- 172.21.15.55:0/3834414486 wait complete. 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.713+0000 7fe8b3800700 1 Processor -- start 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b3800700 1 -- start start 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b3800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b3800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 0x7fe8ac19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b3800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac19f640 con 0x7fe8ac0ff970 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b3800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac198b60 con 0x7fe8ac100320 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b0e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b0e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34326/0 (socket says 172.21.15.55:34326) 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.714+0000 7fe8b0e00700 1 -- 172.21.15.55:0/216705669 learned_addr learned my addr 172.21.15.55:0/216705669 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8abe00700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 0x7fe8ac19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8b0e00700 1 -- 172.21.15.55:0/216705669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 msgr2=0x7fe8ac19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8b0e00700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 0x7fe8ac19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8b0e00700 1 -- 172.21.15.55:0/216705669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00095f0 con 0x7fe8ac0ff970 2024-04-26T21:12:55.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8b0e00700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00092e0 tx=0x7fe8a00056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a001d070 con 0x7fe8ac0ff970 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8a000bed0 con 0x7fe8ac0ff970 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.715+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac198de0 con 0x7fe8ac0ff970 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.716+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a0021410 con 0x7fe8ac0ff970 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.716+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac199330 con 0x7fe8ac0ff970 2024-04-26T21:12:55.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.717+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac068e20 con 0x7fe8ac0ff970 2024-04-26T21:12:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.718+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fe8a000f460 con 0x7fe8ac0ff970 2024-04-26T21:12:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.719+0000 7fe8a9600700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 0x7fe894070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.719+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe8a008fb50 con 0x7fe8ac0ff970 2024-04-26T21:12:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.719+0000 7fe8abe00700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 0x7fe894070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.720+0000 7fe8abe00700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 0x7fe894070e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe898005ea0 tx=0x7fe898005e30 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.723+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fe8a0058e10 con 0x7fe8ac0ff970 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (squid) 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: Upgrade: Setting container_image for all mgr 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3369687021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:55 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1252986323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:12:55.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.977+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 --> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8ac10ff60 con 0x7fe89406e950 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: Upgrade: Target is version 19.0.0-3306-gbc612ffb (squid) 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2'] 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: Upgrade: Setting container_image for all mgr 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/3369687021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:12:55.980 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:55 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/1252986323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.979+0000 7fe8a9600700 1 -- 172.21.15.55:0/216705669 <== mgr.14638 v2:172.21.15.55:6800/2398171578 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe8ac10ff60 con 0x7fe89406e950 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:12:55.981 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "2/23 daemons upgraded", 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mon daemons", 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:12:55.982 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:12:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.982+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 msgr2=0x7fe894070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.982+0000 7fe8b3800700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 0x7fe894070e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe898005ea0 tx=0x7fe898005e30 comp rx=0 tx=0).stop 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.982+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 msgr2=0x7fe8ac19eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.982+0000 7fe8b3800700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00092e0 tx=0x7fe8a00056a0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 shutdown_connections 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fe89406e950 0x7fe894070e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8ac0ff970 0x7fe8ac19eab0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 --2- 172.21.15.55:0/216705669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8ac100320 0x7fe8ac19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 >> 172.21.15.55:0/216705669 conn(0x7fe8ac076740 msgr2=0x7fe8ac0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 shutdown_connections 2024-04-26T21:12:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:55.983+0000 7fe8b3800700 1 -- 172.21.15.55:0/216705669 wait complete. 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.157+0000 7fa08c000700 1 -- 172.21.15.55:0/3214688210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084101d60 msgr2=0x7fa084102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.157+0000 7fa08c000700 1 --2- 172.21.15.55:0/3214688210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084101d60 0x7fa084102140 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa07800b0a0 tx=0x7fa07800b3b0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 -- 172.21.15.55:0/3214688210 shutdown_connections 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 --2- 172.21.15.55:0/3214688210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084102680 0x7fa08410ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 --2- 172.21.15.55:0/3214688210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084101d60 0x7fa084102140 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 -- 172.21.15.55:0/3214688210 >> 172.21.15.55:0/3214688210 conn(0x7fa084076740 msgr2=0x7fa0840fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 -- 172.21.15.55:0/3214688210 shutdown_connections 2024-04-26T21:12:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.158+0000 7fa08c000700 1 -- 172.21.15.55:0/3214688210 wait complete. 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 Processor -- start 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 -- start start 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084101d60 0x7fa084198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084199a00 con 0x7fa084102680 2024-04-26T21:12:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.159+0000 7fa08c000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08419d6d0 con 0x7fa084101d60 2024-04-26T21:12:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34346/0 (socket says 172.21.15.55:34346) 2024-04-26T21:12:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 -- 172.21.15.55:0/2496265053 learned_addr learned my addr 172.21.15.55:0/2496265053 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 -- 172.21.15.55:0/2496265053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084101d60 msgr2=0x7fa084198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa089600700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084101d60 0x7fa084198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084101d60 0x7fa084198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.160+0000 7fa088c00700 1 -- 172.21.15.55:0/2496265053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078009d00 con 0x7fa084102680 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa088c00700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c8f0 tx=0x7fa07000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa070007ad0 con 0x7fa084102680 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa07000ce90 con 0x7fa084102680 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08419d9b0 con 0x7fa084102680 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa070018630 con 0x7fa084102680 2024-04-26T21:12:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.161+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08419df00 con 0x7fa084102680 2024-04-26T21:12:56.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.162+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa084068ea0 con 0x7fa084102680 2024-04-26T21:12:56.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.164+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 32) v1 ==== 92606+0+0 (secure 0 0 0) 0x7fa070007c30 con 0x7fa084102680 2024-04-26T21:12:56.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.165+0000 7fa082000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 0x7fa06c070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:12:56.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.165+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa07008e8a0 con 0x7fa084102680 2024-04-26T21:12:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.165+0000 7fa089600700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 0x7fa06c070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:12:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.166+0000 7fa089600700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 0x7fa06c070e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa078009480 tx=0x7fa078000f40 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:12:56.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.170+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fa070057b60 con 0x7fa084102680 2024-04-26T21:12:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.495+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa08410de10 con 0x7fa084102680 2024-04-26T21:12:56.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.495+0000 7fa082000700 1 -- 172.21.15.55:0/2496265053 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa07005b220 con 0x7fa084102680 2024-04-26T21:12:56.497 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:12:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.498+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 msgr2=0x7fa06c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.498+0000 7fa08c000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 0x7fa06c070e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa078009480 tx=0x7fa078000f40 comp rx=0 tx=0).stop 2024-04-26T21:12:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.498+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 msgr2=0x7fa084199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:12:56.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.498+0000 7fa08c000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c8f0 tx=0x7fa07000ccb0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 shutdown_connections 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:6800/2398171578,v1:172.21.15.55:6801/2398171578] conn(0x7fa06c06e950 0x7fa06c070e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa084101d60 0x7fa084198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 --2- 172.21.15.55:0/2496265053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa084102680 0x7fa084199320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 >> 172.21.15.55:0/2496265053 conn(0x7fa084076740 msgr2=0x7fa08410a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 shutdown_connections 2024-04-26T21:12:56.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:12:56.499+0000 7fa08c000700 1 -- 172.21.15.55:0/2496265053 wait complete. 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: pgmap v138: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:56 smithi055 ceph-mon[25475]: from='client.? 172.21.15.55:0/2496265053' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: pgmap v138: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='mgr.smithi055.ybbowr' 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='mgr.14638 172.21.15.55:0/2793789340' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:56.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:56 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2496265053' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:12:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:57 smithi064 ceph-mon[33404]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:57 smithi064 ceph-mon[33404]: Upgrade: Updating mon.smithi055 2024-04-26T21:12:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:57 smithi064 ceph-mon[33404]: Deploying daemon mon.smithi055 on smithi055 2024-04-26T21:12:57.982 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:57 smithi055 ceph-mon[25475]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:12:57.982 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:57 smithi055 ceph-mon[25475]: Upgrade: Updating mon.smithi055 2024-04-26T21:12:57.982 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:57 smithi055 ceph-mon[25475]: Deploying daemon mon.smithi055 on smithi055 2024-04-26T21:12:58.887 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:58 smithi055 ceph-mon[25475]: pgmap v139: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:58.887 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:58 smithi055 systemd[1]: Stopping Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:12:58.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:12:58 smithi064 ceph-mon[33404]: pgmap v139: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[25471]: 2024-04-26T21:12:59.180+0000 7fc86dc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi055 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:12:59.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[25471]: 2024-04-26T21:12:59.180+0000 7fc86dc00700 -1 mon.smithi055@0(leader) e2 *** Got Signal Terminated *** 2024-04-26T21:12:59.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 podman[108870]: 2024-04-26 21:12:59.325173091 +0000 UTC m=+0.294244418 container died 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T21:12:59.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 podman[108870]: 2024-04-26 21:12:59.764038247 +0000 UTC m=+0.733109567 container cleanup 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-7d2137f) 2024-04-26T21:12:59.941 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 bash[108870]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055 2024-04-26T21:13:00.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:12:59 smithi055 podman[108884]: 2024-04-26 21:12:59.940060012 +0000 UTC m=+0.594766579 container remove 39b2b61381b487df067f2048325d4a1060e4207a6750cdfb9eb3576e59baca9b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-7d2137f, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:13:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:00 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service: Deactivated successfully. 2024-04-26T21:13:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:00 smithi055 systemd[1]: Stopped Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:13:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:00 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service: Consumed 33.105s CPU time. 2024-04-26T21:13:01.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:00 smithi055 systemd[1]: Starting Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:13:01.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 podman[109010]: 2024-04-26 21:13:01.126102316 +0000 UTC m=+0.038852358 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:13:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 podman[109010]: 2024-04-26 21:13:01.266092495 +0000 UTC m=+0.178842550 container create 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T21:13:02.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 podman[109010]: 2024-04-26 21:13:01.570187198 +0000 UTC m=+0.482937293 container init 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T21:13:02.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 podman[109010]: 2024-04-26 21:13:01.581542425 +0000 UTC m=+0.494292450 container start 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T21:13:02.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:13:02.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T21:13:02.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: pidfile_write: ignore empty --pid-file 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: load: jerasure load: lrc 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: RocksDB version: 7.9.2 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Git sha 0 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: DB SUMMARY 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: DB Session ID: AO9LCQ87D2DDWFDEYZTB 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1497 Bytes 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi055/store.db dir, Total Num: 1, files: 000032.sst 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi055/store.db: 000030.log size: 5611790 ; 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:13:02.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.env: 0x55e83af73cc0 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.info_log: 0x55e8454f9ca0 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.statistics: (nil) 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.use_fsync: 0 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:13:02.009 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.db_log_dir: 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.wal_dir: 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:13:02.010 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.write_buffer_manager: 0x55e8454cb0e0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:13:02.011 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.unordered_write: 0 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.row_cache: None 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.wal_filter: None 2024-04-26T21:13:02.012 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.wal_compression: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:13:02.013 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:13:02.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_open_files: -1 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Compression algorithms supported: 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kZSTD supported: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:13:02.015 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi055/store.db/MANIFEST-000015 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.merge_operator: 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_filter: None 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:13:02.016 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e8454f9e60) 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_type: 0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: data_block_index_type: 0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_shortening: 1 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: checksum: 4 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: no_block_cache: 0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache: 0x55e8454fd1f0 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:13:02.017 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_options: 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: capacity : 536870912 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: num_shard_bits : 4 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: strict_capacity_limit : 0 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_cache_compressed: (nil) 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: persistent_cache: (nil) 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_size: 4096 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_size_deviation: 10 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_restart_interval: 16 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: index_block_restart_interval: 1 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: metadata_block_size: 4096 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: partition_filters: 0 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: use_delta_encoding: 1 2024-04-26T21:13:02.018 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: filter_policy: bloomfilter 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: whole_key_filtering: 1 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: verify_compression: 0 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: format_version: 5 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: enable_index_compression: 1 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: block_align: 0 2024-04-26T21:13:02.019 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: max_auto_readahead_size: 262144 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: prepopulate_block_cache: 0 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: initial_auto_readahead_size: 8192 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:13:02.020 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression: NoCompression 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.num_levels: 7 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:13:02.021 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:13:02.022 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:13:02.023 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:13:02.024 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:13:02.025 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.ttl: 2592000 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:13:02.026 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi055/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11748, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b4ab6299-c839-4768-8953-4b3c686e6918 2024-04-26T21:13:02.027 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165981640140, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165981664822, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 5056934, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11749, "largest_seqno": 15813, "table_properties": {"data_size": 5039345, "index_size": 11806, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4741, "raw_key_size": 40881, "raw_average_key_size": 21, "raw_value_size": 5001274, "raw_average_value_size": 2673, "num_data_blocks": 532, "num_entries": 1871, "num_filter_entries": 1871, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714165981, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b4ab6299-c839-4768-8953-4b3c686e6918", "db_session_id": "AO9LCQ87D2DDWFDEYZTB", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714165981664955, "job": 1, "event": "recovery_finished"} 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi055/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e84561a000 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: DB pointer 0x55e845604000 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** DB Stats ** 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:13:02.028 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** Compaction Stats [default] ** 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: L0 1/0 4.82 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 586.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: L6 1/0 5.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Sum 2/0 10.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 586.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:13:02.029 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 586.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** Compaction Stats [default] ** 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 586.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-04-26T21:13:02.030 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Cumulative compaction: 0.00 GB write, 152.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Interval compaction: 0.00 GB write, 152.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Block cache BinnedLRUCache@0x55e8454fd1f0#2 capacity: 512.00 MB usage: 17.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,5.03 KB,0.000959635%) IndexBlock(1,12.08 KB,0.00230372%) Misc(1,0.00 KB,0%) 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: starting mon.smithi055 rank 0 at public addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] at bind addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi055 fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???) e2 preinit fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).mds e13 new map 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).mds e13 print_map 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: e13 2024-04-26T21:13:02.031 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: legacy client fscid: 1 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Filesystem 'cephfs' (1) 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: fs_name cephfs 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: epoch 12 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:13:02.032 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: tableserver 0 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: root 0 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: session_timeout 60 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: session_autoclose 300 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: max_file_size 1099511627776 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: max_xattr_size 65536 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: required_client_features {} 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: last_failure 0 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: last_failure_osd_epoch 0 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: max_mds 1 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: in 0 2024-04-26T21:13:02.033 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: up {0=14466} 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: failed 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: damaged 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: stopped 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: data_pools [3] 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: metadata_pool 2 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: inline_data disabled 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: balancer 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: bal_rank_mask -1 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: standby_count_wanted 1 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: qdb_cluster leader: 0 members: 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: [mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: [mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:02.034 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: Standby daemons: 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: [mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout: [mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 ceph-mon[109028]: mon.smithi055@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 bash[109010]: 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c 2024-04-26T21:13:02.035 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:01 smithi055 systemd[1]: Started Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:13:02.648 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: pgmap v140: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: pgmap v141: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: mon.smithi055 calling monitor election 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: monmap epoch 2 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: last_changed 2024-04-26T20:58:02.103436+0000 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: created 2024-04-26T20:54:15.251095+0000 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: min_mon_release 18 (reef) 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: election_strategy: 1 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: 0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.smithi055 2024-04-26T21:13:02.649 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.smithi064 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: mgrmap e32: smithi055.ybbowr(active, since 4m), standbys: smithi064.tchyje 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: overall HEALTH_OK 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: from='mgr.14638 ' entity='' 2024-04-26T21:13:02.650 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:02 smithi064 ceph-mon[33404]: mgrmap e33: smithi055.ybbowr(active, since 4m), standbys: smithi064.tchyje 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: pgmap v140: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: pgmap v141: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: mon.smithi055 calling monitor election 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: monmap epoch 2 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: last_changed 2024-04-26T20:58:02.103436+0000 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: created 2024-04-26T20:54:15.251095+0000 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: min_mon_release 18 (reef) 2024-04-26T21:13:02.673 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: election_strategy: 1 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: 0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.smithi055 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.smithi064 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: osdmap e48: 6 total, 6 up, 6 in 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: mgrmap e32: smithi055.ybbowr(active, since 4m), standbys: smithi064.tchyje 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: overall HEALTH_OK 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: from='mgr.14638 ' entity='' 2024-04-26T21:13:02.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:02 smithi055 ceph-mon[109028]: mgrmap e33: smithi055.ybbowr(active, since 4m), standbys: smithi064.tchyje 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T21:13:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: Activating manager daemon smithi055.ybbowr 2024-04-26T21:13:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: osdmap e49: 6 total, 6 up, 6 in 2024-04-26T21:13:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:11 smithi064 ceph-mon[33404]: mgrmap e34: smithi055.ybbowr(active, starting, since 0.00942457s), standbys: smithi064.tchyje 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: Standby manager daemon smithi064.tchyje restarted 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: Standby manager daemon smithi064.tchyje started 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/crt"}]: dispatch 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi064.tchyje/key"}]: dispatch 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: from='mgr.? 172.21.15.64:0/2185863076' entity='mgr.smithi064.tchyje' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: Active manager daemon smithi055.ybbowr restarted 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: Activating manager daemon smithi055.ybbowr 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: osdmap e49: 6 total, 6 up, 6 in 2024-04-26T21:13:11.957 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:11 smithi055 ceph-mon[109028]: mgrmap e34: smithi055.ybbowr(active, starting, since 0.00942457s), standbys: smithi064.tchyje 2024-04-26T21:13:13.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:13:13.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:13:13.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:13:13.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:13:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: Manager daemon smithi055.ybbowr is now available 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:13:13.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi055.ybbowr", "id": "smithi055.ybbowr"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr metadata", "who": "smithi064.tchyje", "id": "smithi064.tchyje"}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:13:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: Manager daemon smithi055.ybbowr is now available 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/mirror_snapshot_schedule"}]: dispatch 2024-04-26T21:13:13.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:12 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi055.ybbowr/trash_purge_schedule"}]: dispatch 2024-04-26T21:13:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: [26/Apr/2024:21:13:12] ENGINE Bus STARTING 2024-04-26T21:13:14.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: mgrmap e35: smithi055.ybbowr(active, since 1.03691s), standbys: smithi064.tchyje 2024-04-26T21:13:14.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: pgmap v3: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:14.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: [26/Apr/2024:21:13:12] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T21:13:14.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: [26/Apr/2024:21:13:12] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T21:13:14.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:13 smithi055 ceph-mon[109028]: [26/Apr/2024:21:13:12] ENGINE Bus STARTED 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: [26/Apr/2024:21:13:12] ENGINE Bus STARTING 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: mgrmap e35: smithi055.ybbowr(active, since 1.03691s), standbys: smithi064.tchyje 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: pgmap v3: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: [26/Apr/2024:21:13:12] ENGINE Serving on https://172.21.15.55:7150 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: [26/Apr/2024:21:13:12] ENGINE Serving on http://172.21.15.55:8765 2024-04-26T21:13:14.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:13 smithi064 ceph-mon[33404]: [26/Apr/2024:21:13:12] ENGINE Bus STARTED 2024-04-26T21:13:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:14 smithi055 ceph-mon[109028]: pgmap v4: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:14 smithi055 ceph-mon[109028]: mgrmap e36: smithi055.ybbowr(active, since 2s), standbys: smithi064.tchyje 2024-04-26T21:13:15.105 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:14 smithi064 ceph-mon[33404]: pgmap v4: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:15.106 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:14 smithi064 ceph-mon[33404]: mgrmap e36: smithi055.ybbowr(active, since 2s), standbys: smithi064.tchyje 2024-04-26T21:13:17.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:16 smithi055 ceph-mon[109028]: pgmap v5: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:17.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:16 smithi055 ceph-mon[109028]: mgrmap e37: smithi055.ybbowr(active, since 4s), standbys: smithi064.tchyje 2024-04-26T21:13:17.113 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:16 smithi064 ceph-mon[33404]: pgmap v5: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:17.114 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:16 smithi064 ceph-mon[33404]: mgrmap e37: smithi055.ybbowr(active, since 4s), standbys: smithi064.tchyje 2024-04-26T21:13:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:17 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:18.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:17 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:18 smithi055 ceph-mon[109028]: pgmap v6: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:19.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:18 smithi064 ceph-mon[33404]: pgmap v6: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-26T21:13:20.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:20 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:20 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:20 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:20 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:20.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:21 smithi064 ceph-mon[33404]: pgmap v7: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T21:13:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:21 smithi055 ceph-mon[109028]: pgmap v7: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T21:13:23.362 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:23 smithi055 ceph-mon[109028]: pgmap v8: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:13:23.363 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:23.363 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:23.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:23 smithi064 ceph-mon[33404]: pgmap v8: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:13:23.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:23 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:23.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:23 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:25.288 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:25 smithi064 ceph-mon[33404]: pgmap v9: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T21:13:25.400 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:25 smithi055 ceph-mon[109028]: pgmap v9: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T21:13:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:26 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:26 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:26.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 -- 172.21.15.55:0/3018878636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c102680 msgr2=0x7f559c10ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 --2- 172.21.15.55:0/3018878636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c102680 0x7f559c10ab70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5588009910 tx=0x7f5588009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 -- 172.21.15.55:0/3018878636 shutdown_connections 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 --2- 172.21.15.55:0/3018878636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c102680 0x7f559c10ab70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 --2- 172.21.15.55:0/3018878636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c101d60 0x7f559c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 -- 172.21.15.55:0/3018878636 >> 172.21.15.55:0/3018878636 conn(0x7f559c076740 msgr2=0x7f559c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 -- 172.21.15.55:0/3018878636 shutdown_connections 2024-04-26T21:13:26.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.671+0000 7f55a2200700 1 -- 172.21.15.55:0/3018878636 wait complete. 2024-04-26T21:13:26.674 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:26.675 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:26.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 Processor -- start 2024-04-26T21:13:26.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 -- start start 2024-04-26T21:13:26.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:26.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c102680 0x7f559c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:26.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c072ee0 con 0x7f559c101d60 2024-04-26T21:13:26.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.673+0000 7f55a2200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06e8d0 con 0x7f559c102680 2024-04-26T21:13:26.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:26.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50518/0 (socket says 172.21.15.55:50518) 2024-04-26T21:13:26.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 -- 172.21.15.55:0/286141849 learned_addr learned my addr 172.21.15.55:0/286141849 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559aa00700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c102680 0x7f559c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 -- 172.21.15.55:0/286141849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c102680 msgr2=0x7f559c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c102680 0x7f559c06e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.674+0000 7f559b400700 1 -- 172.21.15.55:0/286141849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880095f0 con 0x7f559c101d60 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f559b400700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d8d0 tx=0x7f558c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558c009940 con 0x7f559c101d60 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f558c010460 con 0x7f559c101d60 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558c00f5f0 con 0x7f559c101d60 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c06ebb0 con 0x7f559c101d60 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.675+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1a9640 con 0x7f559c101d60 2024-04-26T21:13:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.677+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c105480 con 0x7f559c101d60 2024-04-26T21:13:26.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.679+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f558c0105d0 con 0x7f559c101d60 2024-04-26T21:13:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.680+0000 7f5593e00700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 0x7f55800712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.680+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f558c08f040 con 0x7f559c101d60 2024-04-26T21:13:26.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.680+0000 7f559aa00700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 0x7f55800712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:26.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.681+0000 7f559aa00700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 0x7f55800712b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f559c06f530 tx=0x7f558801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:26.686+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f558c057c80 con 0x7f559c101d60 2024-04-26T21:13:27.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.014+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f559c10ddc0 con 0x7f558006edf0 2024-04-26T21:13:27.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.016+0000 7f5593e00700 1 -- 172.21.15.55:0/286141849 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f559c10ddc0 con 0x7f558006edf0 2024-04-26T21:13:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 msgr2=0x7f55800712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 0x7f55800712b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f559c06f530 tx=0x7f558801a040 comp rx=0 tx=0).stop 2024-04-26T21:13:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 msgr2=0x7f559c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d8d0 tx=0x7f558c00dc90 comp rx=0 tx=0).stop 2024-04-26T21:13:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 shutdown_connections 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c101d60 0x7f559c06de50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f558006edf0 0x7f55800712b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 --2- 172.21.15.55:0/286141849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f559c102680 0x7f559c06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.018+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 >> 172.21.15.55:0/286141849 conn(0x7f559c076740 msgr2=0x7f559c103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.019+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 shutdown_connections 2024-04-26T21:13:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.019+0000 7f55a2200700 1 -- 172.21.15.55:0/286141849 wait complete. 2024-04-26T21:13:27.035 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:13:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.172+0000 7f34cfa00700 1 -- 172.21.15.55:0/3240263507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 msgr2=0x7f34c81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.172+0000 7f34cfa00700 1 --2- 172.21.15.55:0/3240263507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c81011f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00b0a0 tx=0x7f34bc00b3b0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 -- 172.21.15.55:0/3240263507 shutdown_connections 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 --2- 172.21.15.55:0/3240263507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 0x7f34c8105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 --2- 172.21.15.55:0/3240263507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c81011f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 -- 172.21.15.55:0/3240263507 >> 172.21.15.55:0/3240263507 conn(0x7f34c80fc6e0 msgr2=0x7f34c80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 -- 172.21.15.55:0/3240263507 shutdown_connections 2024-04-26T21:13:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.173+0000 7f34cfa00700 1 -- 172.21.15.55:0/3240263507 wait complete. 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.174+0000 7f34cfa00700 1 Processor -- start 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.174+0000 7f34cfa00700 1 -- start start 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.174+0000 7f34cfa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.174+0000 7f34cfa00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 0x7f34c819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.174+0000 7f34cfa00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c819f660 con 0x7f34c8100e10 2024-04-26T21:13:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cfa00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8198bd0 con 0x7f34c81017c0 2024-04-26T21:13:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50540/0 (socket says 172.21.15.55:50540) 2024-04-26T21:13:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 -- 172.21.15.55:0/3489808668 learned_addr learned my addr 172.21.15.55:0/3489808668 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34c7e00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 0x7f34c819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 -- 172.21.15.55:0/3489808668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 msgr2=0x7f34c819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 0x7f34c819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.175+0000 7f34cd000700 1 -- 172.21.15.55:0/3489808668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009d00 con 0x7f34c8100e10 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34cd000700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00b070 tx=0x7f34bc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34bc00e040 con 0x7f34c8100e10 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34bc003de0 con 0x7f34c8100e10 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34bc01d6b0 con 0x7f34c8100e10 2024-04-26T21:13:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34cfa00700 1 -- 172.21.15.55:0/3489808668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c8198e50 con 0x7f34c8100e10 2024-04-26T21:13:27.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.176+0000 7f34cfa00700 1 -- 172.21.15.55:0/3489808668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c81992f0 con 0x7f34c8100e10 2024-04-26T21:13:27.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.178+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a40052f0 con 0x7f34c8100e10 2024-04-26T21:13:27.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.179+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f34bc004040 con 0x7f34c8100e10 2024-04-26T21:13:27.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.180+0000 7f34c5600700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 0x7f34b00712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.180+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f34bc090850 con 0x7f34c8100e10 2024-04-26T21:13:27.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.180+0000 7f34c7e00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 0x7f34b00712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.181+0000 7f34c7e00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 0x7f34b00712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34c819a2f0 tx=0x7f34b4005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.185+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f34bc059470 con 0x7f34c8100e10 2024-04-26T21:13:27.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.443+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34a4000bc0 con 0x7f34b006edf0 2024-04-26T21:13:27.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.445+0000 7f34c5600700 1 -- 172.21.15.55:0/3489808668 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f34a4000bc0 con 0x7f34b006edf0 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 msgr2=0x7f34b00712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 0x7f34b00712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34c819a2f0 tx=0x7f34b4005d50 comp rx=0 tx=0).stop 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 msgr2=0x7f34c819ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00b070 tx=0x7f34bc007bd0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 shutdown_connections 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34c8100e10 0x7f34c819ead0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f34b006edf0 0x7f34b00712b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 --2- 172.21.15.55:0/3489808668 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34c81017c0 0x7f34c819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 >> 172.21.15.55:0/3489808668 conn(0x7f34c80fc6e0 msgr2=0x7f34c8074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 shutdown_connections 2024-04-26T21:13:27.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.448+0000 7f34baa00700 1 -- 172.21.15.55:0/3489808668 wait complete. 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 -- 172.21.15.55:0/3507162310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 msgr2=0x7f979c0ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 --2- 172.21.15.55:0/3507162310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c0ff900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b0a0 tx=0x7f978c00b3b0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 -- 172.21.15.55:0/3507162310 shutdown_connections 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 --2- 172.21.15.55:0/3507162310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 0x7f979c103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 --2- 172.21.15.55:0/3507162310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c0ff900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 -- 172.21.15.55:0/3507162310 >> 172.21.15.55:0/3507162310 conn(0x7f979c075f00 msgr2=0x7f979c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 -- 172.21.15.55:0/3507162310 shutdown_connections 2024-04-26T21:13:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.619+0000 7f97a2200700 1 -- 172.21.15.55:0/3507162310 wait complete. 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.620+0000 7f97a2200700 1 Processor -- start 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.620+0000 7f97a2200700 1 -- start start 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f97a2200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f97a2200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 0x7f979c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f97a2200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c19d3f0 con 0x7f979c0ff520 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f97a2200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1969d0 con 0x7f979c0ffed0 2024-04-26T21:13:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50568/0 (socket says 172.21.15.55:50568) 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 -- 172.21.15.55:0/4088265929 learned_addr learned my addr 172.21.15.55:0/4088265929 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f9792a00700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 0x7f979c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 -- 172.21.15.55:0/4088265929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 msgr2=0x7f979c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 0x7f979c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.621+0000 7f979b400700 1 -- 172.21.15.55:0/4088265929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009d00 con 0x7f979c0ff520 2024-04-26T21:13:27.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f979b400700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f978c000f80 tx=0x7f978c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c00e040 con 0x7f979c0ff520 2024-04-26T21:13:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c196c50 con 0x7f979c0ff520 2024-04-26T21:13:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f978c003c10 con 0x7f979c0ff520 2024-04-26T21:13:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c197140 con 0x7f979c0ff520 2024-04-26T21:13:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.622+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978c01d650 con 0x7f979c0ff520 2024-04-26T21:13:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.624+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c100a00 con 0x7f979c0ff520 2024-04-26T21:13:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.624+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f978c004040 con 0x7f979c0ff520 2024-04-26T21:13:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.625+0000 7f9798c00700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 0x7f97800712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.625+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f978c0908b0 con 0x7f979c0ff520 2024-04-26T21:13:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.626+0000 7f9792a00700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 0x7f97800712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:27.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.626+0000 7f9792a00700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 0x7f97800712c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9784005950 tx=0x7f97840058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:27.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.630+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f978c05cf80 con 0x7f979c0ff520 2024-04-26T21:13:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:27 smithi064 ceph-mon[33404]: pgmap v10: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T21:13:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:27 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:27 smithi055 ceph-mon[109028]: pgmap v10: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T21:13:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:27.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.878+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f979c10cd60 con 0x7f978006ee00 2024-04-26T21:13:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.894+0000 7f9798c00700 1 -- 172.21.15.55:0/4088265929 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f979c10cd60 con 0x7f978006ee00 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (2m) 8s ago 16m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (17m) 8s ago 17m 8326k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (15m) 10s ago 15m 8170k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (17m) 8s ago 17m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (15m) 10s ago 15m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (2m) 8s ago 16m 73.5M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (9m) 8s ago 9m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:13:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (9m) 8s ago 9m 16.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (9m) 10s ago 9m 99.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (9m) 10s ago 9m 16.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (5m) 8s ago 18m 478M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (4m) 10s ago 15m 448M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (26s) 8s ago 19m 30.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (15m) 10s ago 15m 54.5M 2048M 18.2.2-1258-g7d2137f0 79c5878083fb 7b4571c2880b 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (3m) 8s ago 17m 7788k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (3m) 10s ago 15m 7684k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (14m) 8s ago 14m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (13m) 8s ago 13m 268M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (13m) 8s ago 13m 228M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (12m) 10s ago 12m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (11m) 10s ago 11m 273M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:13:27.897 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (11m) 10s ago 11m 242M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:13:27.898 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (3m) 8s ago 16m 64.5M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:13:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.897+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 msgr2=0x7f97800712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.897+0000 7f97a2200700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 0x7f97800712c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9784005950 tx=0x7f97840058e0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.897+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 msgr2=0x7f979c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.897+0000 7f97a2200700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f978c000f80 tx=0x7f978c007bd0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 shutdown_connections 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f979c0ff520 0x7f979c19c890 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f978006ee00 0x7f97800712c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 --2- 172.21.15.55:0/4088265929 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f979c0ffed0 0x7f979c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 >> 172.21.15.55:0/4088265929 conn(0x7f979c075f00 msgr2=0x7f979c103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 shutdown_connections 2024-04-26T21:13:27.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:27.898+0000 7f97a2200700 1 -- 172.21.15.55:0/4088265929 wait complete. 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 -- 172.21.15.55:0/3526412888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 msgr2=0x7fca641020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 --2- 172.21.15.55:0/3526412888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca641020c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca54009910 tx=0x7fca54009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 -- 172.21.15.55:0/3526412888 shutdown_connections 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 --2- 172.21.15.55:0/3526412888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 --2- 172.21.15.55:0/3526412888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca641020c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 -- 172.21.15.55:0/3526412888 >> 172.21.15.55:0/3526412888 conn(0x7fca640fb5e0 msgr2=0x7fca640fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 -- 172.21.15.55:0/3526412888 shutdown_connections 2024-04-26T21:13:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.061+0000 7fca6ac00700 1 -- 172.21.15.55:0/3526412888 wait complete. 2024-04-26T21:13:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.062+0000 7fca6ac00700 1 Processor -- start 2024-04-26T21:13:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.062+0000 7fca6ac00700 1 -- start start 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca6ac00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca6ac00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca6ac00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6419d380 con 0x7fca64101ce0 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca6ac00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca641969b0 con 0x7fca64102690 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca63e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca63e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50584/0 (socket says 172.21.15.55:50584) 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.063+0000 7fca63e00700 1 -- 172.21.15.55:0/2449678336 learned_addr learned my addr 172.21.15.55:0/2449678336 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63400700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63e00700 1 -- 172.21.15.55:0/2449678336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 msgr2=0x7fca6419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63e00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63e00700 1 -- 172.21.15.55:0/2449678336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540095f0 con 0x7fca64101ce0 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63400700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca63e00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca54000c00 tx=0x7fca5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.064+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5401d070 con 0x7fca64101ce0 2024-04-26T21:13:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.065+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca540056e0 con 0x7fca64101ce0 2024-04-26T21:13:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.065+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca64196c30 con 0x7fca64101ce0 2024-04-26T21:13:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.065+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca5400fe80 con 0x7fca64101ce0 2024-04-26T21:13:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.065+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca64197120 con 0x7fca64101ce0 2024-04-26T21:13:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.066+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca64105500 con 0x7fca64101ce0 2024-04-26T21:13:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.067+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fca5400f6f0 con 0x7fca64101ce0 2024-04-26T21:13:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.068+0000 7fca60c00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 0x7fca480712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.068+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fca54090440 con 0x7fca64101ce0 2024-04-26T21:13:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.068+0000 7fca63400700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 0x7fca480712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.069+0000 7fca63400700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 0x7fca480712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca50005fd0 tx=0x7fca50005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.073+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fca5405cbb0 con 0x7fca64101ce0 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.408+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca64197e50 con 0x7fca64101ce0 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.408+0000 7fca60c00700 1 -- 172.21.15.55:0/2449678336 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fca5405c740 con 0x7fca64101ce0 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 1, 2024-04-26T21:13:28.410 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 11, 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 3 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:13:28.411 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 msgr2=0x7fca480712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 0x7fca480712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca50005fd0 tx=0x7fca50005ee0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 msgr2=0x7fca6419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca54000c00 tx=0x7fca5400be20 comp rx=0 tx=0).stop 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 shutdown_connections 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca64101ce0 0x7fca6419c820 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fca4806edf0 0x7fca480712b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 --2- 172.21.15.55:0/2449678336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca64102690 0x7fca6419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 >> 172.21.15.55:0/2449678336 conn(0x7fca640fb5e0 msgr2=0x7fca64103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 shutdown_connections 2024-04-26T21:13:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.412+0000 7fca6ac00700 1 -- 172.21.15.55:0/2449678336 wait complete. 2024-04-26T21:13:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.568+0000 7f9375200700 1 -- 172.21.15.55:0/349472585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 msgr2=0x7f937010ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.568+0000 7f9375200700 1 --2- 172.21.15.55:0/349472585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f937010ceb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f935c009910 tx=0x7f935c009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.568+0000 7f9375200700 1 -- 172.21.15.55:0/349472585 shutdown_connections 2024-04-26T21:13:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.568+0000 7f9375200700 1 --2- 172.21.15.55:0/349472585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f937010ceb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.568+0000 7f9375200700 1 --2- 172.21.15.55:0/349472585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f93700736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.569+0000 7f9375200700 1 -- 172.21.15.55:0/349472585 >> 172.21.15.55:0/349472585 conn(0x7f93700fc6e0 msgr2=0x7f93700feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.569+0000 7f9375200700 1 -- 172.21.15.55:0/349472585 shutdown_connections 2024-04-26T21:13:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.569+0000 7f9375200700 1 -- 172.21.15.55:0/349472585 wait complete. 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 Processor -- start 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 -- start start 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f9370198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93701998d0 con 0x7f9370073c30 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.570+0000 7f9375200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937019c540 con 0x7f9370073310 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50596/0 (socket says 172.21.15.55:50596) 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 -- 172.21.15.55:0/3454832234 learned_addr learned my addr 172.21.15.55:0/3454832234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936de00700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f9370198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 -- 172.21.15.55:0/3454832234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 msgr2=0x7f9370198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f9370198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936d400700 1 -- 172.21.15.55:0/3454832234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0095f0 con 0x7f9370073c30 2024-04-26T21:13:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.571+0000 7f936de00700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f9370198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:13:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.572+0000 7f936d400700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f935c0092e0 tx=0x7f935c00b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.572+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935c01d070 con 0x7f9370073c30 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.572+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f935c0052a0 con 0x7f9370073c30 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.573+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937019c7c0 con 0x7f9370073c30 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.573+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935c017400 con 0x7f9370073c30 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.573+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937019ccb0 con 0x7f9370073c30 2024-04-26T21:13:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.574+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93700749c0 con 0x7f9370073c30 2024-04-26T21:13:28.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.575+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f935c00f820 con 0x7f9370073c30 2024-04-26T21:13:28.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.576+0000 7f9366a00700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 0x7f93540712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:28.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.576+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f935c090320 con 0x7f9370073c30 2024-04-26T21:13:28.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.576+0000 7f936de00700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 0x7f93540712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.577+0000 7f936de00700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 0x7f93540712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9360009cb0 tx=0x7f9360009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.581+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f935c058f40 con 0x7f9370073c30 2024-04-26T21:13:28.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:28.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:28.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:28.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:28.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:28.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:28 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.857+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f937004ebb0 con 0x7f9370073c30 2024-04-26T21:13:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.858+0000 7f9366a00700 1 -- 172.21.15.55:0/3454832234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f935c05c600 con 0x7f9370073c30 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:13:28.860 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:28.861 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:28.862 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:28.863 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 msgr2=0x7f93540712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 0x7f93540712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9360009cb0 tx=0x7f9360009260 comp rx=0 tx=0).stop 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 msgr2=0x7f9370199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f935c0092e0 tx=0x7f935c00b7d0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 shutdown_connections 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f935406edf0 0x7f93540712b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9370073310 0x7f9370198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 --2- 172.21.15.55:0/3454832234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9370073c30 0x7f9370199240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 >> 172.21.15.55:0/3454832234 conn(0x7f93700fc6e0 msgr2=0x7f9370105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 shutdown_connections 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:28.861+0000 7f9375200700 1 -- 172.21.15.55:0/3454832234 wait complete. 2024-04-26T21:13:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:13:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.012+0000 7f29bf200700 1 -- 172.21.15.55:0/719911889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 msgr2=0x7f29b8111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.012+0000 7f29bf200700 1 --2- 172.21.15.55:0/719911889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b8111680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009910 tx=0x7f29a4009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 -- 172.21.15.55:0/719911889 shutdown_connections 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 --2- 172.21.15.55:0/719911889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b8111680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 --2- 172.21.15.55:0/719911889 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 0x7f29b8073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 -- 172.21.15.55:0/719911889 >> 172.21.15.55:0/719911889 conn(0x7f29b80fc6e0 msgr2=0x7f29b80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 -- 172.21.15.55:0/719911889 shutdown_connections 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.013+0000 7f29bf200700 1 -- 172.21.15.55:0/719911889 wait complete. 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 Processor -- start 2024-04-26T21:13:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 -- start start 2024-04-26T21:13:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 0x7f29b819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b819dd00 con 0x7f29b8073ba0 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.014+0000 7f29bf200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b81a19d0 con 0x7f29b8073280 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50610/0 (socket says 172.21.15.55:50610) 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 -- 172.21.15.55:0/3476496923 learned_addr learned my addr 172.21.15.55:0/3476496923 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7e00700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 0x7f29b819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 -- 172.21.15.55:0/3476496923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 msgr2=0x7f29b819d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 0x7f29b819d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 -- 172.21.15.55:0/3476496923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40095f0 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.015+0000 7f29b7400700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.016+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a401d070 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.016+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29a40056e0 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.016+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a400fe80 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.016+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b81a1cb0 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.016+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b81a2200 con 0x7f29b8073ba0 2024-04-26T21:13:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.017+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b80749c0 con 0x7f29b8073ba0 2024-04-26T21:13:29.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.018+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f29a400f6f0 con 0x7f29b8073ba0 2024-04-26T21:13:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.019+0000 7f29b4c00700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 0x7f299c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.019+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f29a40903f0 con 0x7f29b8073ba0 2024-04-26T21:13:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.020+0000 7f29b7e00700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 0x7f299c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.020+0000 7f29b7e00700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 0x7f299c0712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005950 tx=0x7f29a80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.024+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f29a4059010 con 0x7f29b8073ba0 2024-04-26T21:13:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.275+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b8114370 con 0x7f299c06edf0 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.277+0000 7f29b4c00700 1 -- 172.21.15.55:0/3476496923 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f29b8114370 con 0x7f299c06edf0 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:13:29.279 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "3/23 daemons upgraded", 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:13:29.280 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:13:29.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 msgr2=0x7f299c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 0x7f299c0712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f29a8005950 tx=0x7f29a80058e0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 msgr2=0x7f29b819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a400be20 comp rx=0 tx=0).stop 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 shutdown_connections 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f299c06edf0 0x7f299c0712b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29b8073280 0x7f29b819d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 --2- 172.21.15.55:0/3476496923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b8073ba0 0x7f29b819d620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.280+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 >> 172.21.15.55:0/3476496923 conn(0x7f29b80fc6e0 msgr2=0x7f29b8100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.281+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 shutdown_connections 2024-04-26T21:13:29.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.281+0000 7f29bf200700 1 -- 172.21.15.55:0/3476496923 wait complete. 2024-04-26T21:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 -- 172.21.15.55:0/1722759151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 msgr2=0x7fd35410ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 --2- 172.21.15.55:0/1722759151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd35410ceb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd340009910 tx=0x7fd340009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 -- 172.21.15.55:0/1722759151 shutdown_connections 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 --2- 172.21.15.55:0/1722759151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd35410ceb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 --2- 172.21.15.55:0/1722759151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 0x7fd3540736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.426+0000 7fd359800700 1 -- 172.21.15.55:0/1722759151 >> 172.21.15.55:0/1722759151 conn(0x7fd3540fc6e0 msgr2=0x7fd3540feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.427+0000 7fd359800700 1 -- 172.21.15.55:0/1722759151 shutdown_connections 2024-04-26T21:13:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.427+0000 7fd359800700 1 -- 172.21.15.55:0/1722759151 wait complete. 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 Processor -- start 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 -- start start 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 0x7fd354198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541998d0 con 0x7fd354073c30 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd359800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35419c540 con 0x7fd354073310 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd352000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd352000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50624/0 (socket says 172.21.15.55:50624) 2024-04-26T21:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.428+0000 7fd352000700 1 -- 172.21.15.55:0/1144453558 learned_addr learned my addr 172.21.15.55:0/1144453558 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.429+0000 7fd352a00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 0x7fd354198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.429+0000 7fd352000700 1 -- 172.21.15.55:0/1144453558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 msgr2=0x7fd354198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.429+0000 7fd352000700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 0x7fd354198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.429+0000 7fd352000700 1 -- 172.21.15.55:0/1144453558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400095f0 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.429+0000 7fd352000700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd34000b7d0 tx=0x7fd340005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.430+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34001d070 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.430+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3400052a0 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.430+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd340022470 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.430+0000 7fd359800700 1 -- 172.21.15.55:0/1144453558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35419c7c0 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.430+0000 7fd359800700 1 -- 172.21.15.55:0/1144453558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35419ccb0 con 0x7fd354073c30 2024-04-26T21:13:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.431+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3540749c0 con 0x7fd354073c30 2024-04-26T21:13:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.432+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fd34000f820 con 0x7fd354073c30 2024-04-26T21:13:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.433+0000 7fd34b400700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 0x7fd3380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.433+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd340090350 con 0x7fd354073c30 2024-04-26T21:13:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.433+0000 7fd352a00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 0x7fd3380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.434+0000 7fd352a00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 0x7fd3380712b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd344009bf0 tx=0x7fd344009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:29.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.438+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd340059010 con 0x7fd354073c30 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: pgmap v11: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2449678336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:13:29.592 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:29 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3454832234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:13:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: pgmap v11: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-26T21:13:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.conf 2024-04-26T21:13:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.conf 2024-04-26T21:13:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/2449678336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:13:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:29 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/3454832234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:13:29.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.775+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd35404ebb0 con 0x7fd354073c30 2024-04-26T21:13:29.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.775+0000 7fd34b400700 1 -- 172.21.15.55:0/1144453558 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd34005c6d0 con 0x7fd354073c30 2024-04-26T21:13:29.777 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:13:29.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 msgr2=0x7fd3380712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 0x7fd3380712b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd344009bf0 tx=0x7fd344009260 comp rx=0 tx=0).stop 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 msgr2=0x7fd354199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd34000b7d0 tx=0x7fd340005ee0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 shutdown_connections 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd33806edf0 0x7fd3380712b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd354073310 0x7fd354198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 --2- 172.21.15.55:0/1144453558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd354073c30 0x7fd354199240 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 >> 172.21.15.55:0/1144453558 conn(0x7fd3540fc6e0 msgr2=0x7fd354105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 shutdown_connections 2024-04-26T21:13:29.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:29.778+0000 7fd348c00700 1 -- 172.21.15.55:0/1144453558 wait complete. 2024-04-26T21:13:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:30 smithi055 ceph-mon[109028]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:13:30.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:30 smithi055 ceph-mon[109028]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:13:30.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:30 smithi055 ceph-mon[109028]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:13:30.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:30 smithi055 ceph-mon[109028]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:30.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:30 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1144453558' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:13:30.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:30 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:13:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:30 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T21:13:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:30 smithi064 ceph-mon[33404]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:13:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:30 smithi064 ceph-mon[33404]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:13:30.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:30 smithi064 ceph-mon[33404]: from='client.? 172.21.15.55:0/1144453558' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:13:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:13:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: pgmap v12: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: pgmap v12: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: Updating smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: Updating smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:31.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:31 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:32.737 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:32 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:32.737 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:32 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:13:32.737 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:32 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:13:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:32 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:32 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:13:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:32 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-26T21:13:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:33 smithi055 ceph-mon[109028]: pgmap v13: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:33.882 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:33 smithi064 ceph-mon[33404]: pgmap v13: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: pgmap v14: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: Upgrade: Updating mon.smithi064 2024-04-26T21:13:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:35.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:13:35.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:13:35.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:35.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:34 smithi064 ceph-mon[33404]: Deploying daemon mon.smithi064 on smithi064 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: pgmap v14: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: Upgrade: Updating mon.smithi064 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:35.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:34 smithi055 ceph-mon[109028]: Deploying daemon mon.smithi064 on smithi064 2024-04-26T21:13:36.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:36 smithi064 systemd[1]: Stopping Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:13:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:36 smithi055 ceph-mon[109028]: pgmap v15: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:37.397 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:36 smithi064 ceph-mon[33404]: pgmap v15: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:37.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064[33391]: 2024-04-26T21:13:37.031+0000 7fa0a6000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi064 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:13:37.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064[33391]: 2024-04-26T21:13:37.031+0000 7fa0a6000700 -1 mon.smithi064@1(peon) e2 *** Got Signal Terminated *** 2024-04-26T21:13:37.398 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 podman[84081]: 2024-04-26 21:13:37.114012819 +0000 UTC m=+0.216143511 container died 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:13:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 podman[84081]: 2024-04-26 21:13:37.540357573 +0000 UTC m=+0.642488262 container cleanup 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-7d2137f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T21:13:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 bash[84081]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064 2024-04-26T21:13:38.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:37 smithi064 podman[84096]: 2024-04-26 21:13:37.809103251 +0000 UTC m=+0.678578267 container remove 7b4571c2880b7fa3835d750779055df05a529b730bc3693baa35c11e29db7e84 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T21:13:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:38 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064.service: Deactivated successfully. 2024-04-26T21:13:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:38 smithi064 systemd[1]: Stopped Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:13:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:38 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064.service: Consumed 21.436s CPU time. 2024-04-26T21:13:39.083 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:38 smithi064 systemd[1]: Starting Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:13:39.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 podman[84221]: 2024-04-26 21:13:38.988453113 +0000 UTC m=+0.037414792 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:13:39.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 podman[84221]: 2024-04-26 21:13:39.093741399 +0000 UTC m=+0.142703136 container create fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 podman[84221]: 2024-04-26 21:13:39.422484362 +0000 UTC m=+0.471446083 container init fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 podman[84221]: 2024-04-26 21:13:39.434726175 +0000 UTC m=+0.483687886 container start fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev), process ceph-mon, pid 2 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: pidfile_write: ignore empty --pid-file 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: load: jerasure load: lrc 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: RocksDB version: 7.9.2 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Git sha 0 2024-04-26T21:13:39.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Compile date 2024-04-26 11:39:23 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: DB SUMMARY 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: DB Session ID: H5NILS26CE4YDUT4Z6SL 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: CURRENT file: CURRENT 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1884 Bytes 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi064/store.db dir, Total Num: 1, files: 000033.sst 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi064/store.db: 000031.log size: 399436 ; 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.error_if_exists: 0 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.create_if_missing: 0 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.paranoid_checks: 1 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T21:13:39.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.env: 0x55c86f9d2cc0 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.info_log: 0x55c89b41fca0 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.statistics: (nil) 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.use_fsync: 0 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_log_file_size: 0 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T21:13:39.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_fallocate: 1 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.use_direct_reads: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.db_log_dir: 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.wal_dir: 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T21:13:39.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.write_buffer_manager: 0x55c89b3f10e0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.unordered_write: 0 2024-04-26T21:13:39.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.row_cache: None 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.wal_filter: None 2024-04-26T21:13:39.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.two_write_queues: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.wal_compression: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.atomic_flush: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.log_readahead_size: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T21:13:39.914 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_background_jobs: 2 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_background_compactions: -1 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_subcompactions: 1 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T21:13:39.915 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_open_files: -1 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_background_flushes: -1 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Compression algorithms supported: 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kZSTD supported: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kXpressCompression supported: 0 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T21:13:39.916 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kZlibCompression supported: 1 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kSnappyCompression supported: 1 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kLZ4Compression supported: 1 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: kBZip2Compression supported: 0 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000010 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.merge_operator: 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_filter: None 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T21:13:39.917 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c89b41fe60) 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks: 1 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: pin_top_level_index_and_filter: 1 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_type: 0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_index_type: 0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_shortening: 1 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: checksum: 4 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: no_block_cache: 0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache: 0x55c89b4231f0 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_name: BinnedLRUCache 2024-04-26T21:13:39.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_options: 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: capacity : 536870912 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_shard_bits : 4 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: strict_capacity_limit : 0 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: high_pri_pool_ratio: 0.000 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_cache_compressed: (nil) 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: persistent_cache: (nil) 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size: 4096 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_size_deviation: 10 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_restart_interval: 16 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: index_block_restart_interval: 1 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_block_size: 4096 2024-04-26T21:13:39.919 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: partition_filters: 0 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: use_delta_encoding: 1 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: filter_policy: bloomfilter 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: whole_key_filtering: 1 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: verify_compression: 0 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: read_amp_bytes_per_bit: 0 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: format_version: 5 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_index_compression: 1 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: block_align: 0 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_auto_readahead_size: 262144 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: prepopulate_block_cache: 0 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: initial_auto_readahead_size: 8192 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T21:13:39.920 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression: NoCompression 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.num_levels: 7 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:13:39.921 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T21:13:39.922 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T21:13:39.923 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T21:13:39.924 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T21:13:39.925 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.inplace_update_support: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.bloom_locality: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.max_successive_merges: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T21:13:39.926 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.ttl: 2592000 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enable_blob_files: false 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.min_blob_size: 0 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T21:13:39.927 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi064/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 35, last_sequence is 17124, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 31 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: badd5ba4-b00d-4500-aa9c-1280bdf979b1 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166019494220, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166019497221, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 249691, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 17129, "largest_seqno": 17335, "table_properties": {"data_size": 247730, "index_size": 667, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2540, "raw_average_key_size": 25, "raw_value_size": 245384, "raw_average_value_size": 2429, "num_data_blocks": 28, "num_entries": 101, "num_filter_entries": 101, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714166019, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "badd5ba4-b00d-4500-aa9c-1280bdf979b1", "db_session_id": "H5NILS26CE4YDUT4Z6SL", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714166019497402, "job": 1, "event": "recovery_finished"} 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi064/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c89b540000 2024-04-26T21:13:39.928 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: DB pointer 0x55c89b52a000 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** DB Stats ** 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2024-04-26T21:13:39.929 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L0 1/0 243.84 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: L6 1/0 7.89 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Sum 2/0 8.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** Compaction Stats [default] ** 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T21:13:39.930 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Cumulative compaction: 0.00 GB write, 29.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Interval compaction: 0.00 GB write, 29.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache BinnedLRUCache@0x55c89b4231f0#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.31 KB,5.96046e-05%) IndexBlock(1,0.77 KB,0.000146031%) Misc(1,0.00 KB,0%) 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: starting mon.smithi064 rank 1 at public addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] at bind addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi064 fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:39.931 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???) e2 preinit fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).mds e13 new map 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).mds e13 print_map 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: e13 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: legacy client fscid: 1 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Filesystem 'cephfs' (1) 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: fs_name cephfs 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: epoch 12 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: tableserver 0 2024-04-26T21:13:39.932 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: root 0 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: session_timeout 60 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: session_autoclose 300 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_file_size 1099511627776 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_xattr_size 65536 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: required_client_features {} 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: last_failure 0 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: last_failure_osd_epoch 0 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: max_mds 1 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: in 0 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: up {0=14466} 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: failed 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: damaged 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: stopped 2024-04-26T21:13:39.933 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: data_pools [3] 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: metadata_pool 2 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: inline_data disabled 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: balancer 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: bal_rank_mask -1 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: standby_count_wanted 1 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: qdb_cluster leader: 0 members: 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: Standby daemons: 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: 2024-04-26T21:13:39.934 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout: [mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 ceph-mon[84240]: mon.smithi064@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 bash[84221]: fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b 2024-04-26T21:13:39.935 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:39 smithi064 systemd[1]: Started Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:13:41.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: pgmap v17: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:41.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:13:41.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: mon.smithi055 calling monitor election 2024-04-26T21:13:41.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: mon.smithi064 calling monitor election 2024-04-26T21:13:41.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: monmap epoch 3 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: last_changed 2024-04-26T21:13:40.331732+0000 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: created 2024-04-26T20:54:15.251095+0000 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: min_mon_release 19 (squid) 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: election_strategy: 1 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: 0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.smithi055 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.smithi064 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: osdmap e49: 6 total, 6 up, 6 in 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: mgrmap e37: smithi055.ybbowr(active, since 28s), standbys: smithi064.tchyje 2024-04-26T21:13:41.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: overall HEALTH_OK 2024-04-26T21:13:41.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:41.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:41.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: pgmap v17: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi055"}]: dispatch 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: mon.smithi055 calling monitor election 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: mon.smithi064 calling monitor election 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mon metadata", "id": "smithi064"}]: dispatch 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: mon.smithi055 is new leader, mons smithi055,smithi064 in quorum (ranks 0,1) 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: monmap epoch 3 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: fsid fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: last_changed 2024-04-26T21:13:40.331732+0000 2024-04-26T21:13:41.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: created 2024-04-26T20:54:15.251095+0000 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: min_mon_release 19 (squid) 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: election_strategy: 1 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: 0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.smithi055 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.smithi064 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: osdmap e49: 6 total, 6 up, 6 in 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: mgrmap e37: smithi055.ybbowr(active, since 28s), standbys: smithi064.tchyje 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: overall HEALTH_OK 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:41.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:42.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:43.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:43 smithi064 ceph-mon[84240]: pgmap v18: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:43.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:43 smithi055 ceph-mon[109028]: pgmap v18: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:13:45.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:45 smithi064 ceph-mon[84240]: pgmap v19: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:45.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:45 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:45.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:45 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:45 smithi055 ceph-mon[109028]: pgmap v19: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:45 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:45 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:47.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:47 smithi064 ceph-mon[84240]: pgmap v20: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:47.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:47 smithi055 ceph-mon[109028]: pgmap v20: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:49 smithi064 ceph-mon[84240]: pgmap v21: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:49 smithi055 ceph-mon[109028]: pgmap v21: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:51 smithi064 ceph-mon[84240]: pgmap v22: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:51.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:51 smithi055 ceph-mon[109028]: pgmap v22: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: pgmap v23: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:53.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:53.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:13:53.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:13:53.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: pgmap v23: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:13:53.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:54.571 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:54 smithi055 ceph-mon[109028]: Reconfiguring mon.smithi055 (monmap changed)... 2024-04-26T21:13:54.571 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:54 smithi055 ceph-mon[109028]: Reconfiguring daemon mon.smithi055 on smithi055 2024-04-26T21:13:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:54 smithi064 ceph-mon[84240]: Reconfiguring mon.smithi055 (monmap changed)... 2024-04-26T21:13:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:54 smithi064 ceph-mon[84240]: Reconfiguring daemon mon.smithi055 on smithi055 2024-04-26T21:13:55.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:55 smithi055 ceph-mon[109028]: pgmap v24: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:55 smithi064 ceph-mon[84240]: pgmap v24: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: pgmap v25: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: Reconfiguring mgr.smithi055.ybbowr (monmap changed)... 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:13:56.999 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:57.000 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:56 smithi055 ceph-mon[109028]: Reconfiguring daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: pgmap v25: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: Reconfiguring mgr.smithi055.ybbowr (monmap changed)... 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi055.ybbowr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:57.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:56 smithi064 ceph-mon[84240]: Reconfiguring daemon mgr.smithi055.ybbowr on smithi055 2024-04-26T21:13:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: pgmap v26: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: Reconfiguring ceph-exporter.smithi055 (monmap changed)... 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T21:13:59.696 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: Unable to update caps for client.ceph-exporter.smithi055 2024-04-26T21:13:59.697 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi055"}]: dispatch 2024-04-26T21:13:59.697 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:59.697 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:13:59 smithi055 ceph-mon[109028]: Reconfiguring daemon ceph-exporter.smithi055 on smithi055 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: pgmap v26: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: Reconfiguring ceph-exporter.smithi055 (monmap changed)... 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: Unable to update caps for client.ceph-exporter.smithi055 2024-04-26T21:13:59.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi055"}]: dispatch 2024-04-26T21:13:59.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:59.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:13:59 smithi064 ceph-mon[84240]: Reconfiguring daemon ceph-exporter.smithi055 on smithi055 2024-04-26T21:13:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 -- 172.21.15.55:0/3065864610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4101d60 msgr2=0x7f11d4102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 --2- 172.21.15.55:0/3065864610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4101d60 0x7f11d4102140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009910 tx=0x7f11c4009c20 comp rx=0 tx=0).stop 2024-04-26T21:13:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 -- 172.21.15.55:0/3065864610 shutdown_connections 2024-04-26T21:13:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 --2- 172.21.15.55:0/3065864610 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d4102680 0x7f11d410ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 --2- 172.21.15.55:0/3065864610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4101d60 0x7f11d4102140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 -- 172.21.15.55:0/3065864610 >> 172.21.15.55:0/3065864610 conn(0x7f11d4076740 msgr2=0x7f11d40fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:13:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 -- 172.21.15.55:0/3065864610 shutdown_connections 2024-04-26T21:13:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.960+0000 7f11d9200700 1 -- 172.21.15.55:0/3065864610 wait complete. 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.961+0000 7f11d9200700 1 Processor -- start 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d9200700 1 -- start start 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d9200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d4101d60 0x7f11d419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d9200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d9200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d419d3a0 con 0x7f11d4102680 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d9200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4196980 con 0x7f11d4101d60 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47118/0 (socket says 172.21.15.55:47118) 2024-04-26T21:13:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.962+0000 7f11d1400700 1 -- 172.21.15.55:0/3007673931 learned_addr learned my addr 172.21.15.55:0/3007673931 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:13:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.963+0000 7f11d1400700 1 -- 172.21.15.55:0/3007673931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d4101d60 msgr2=0x7f11d419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:13:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.963+0000 7f11d1400700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d4101d60 0x7f11d419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:13:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.963+0000 7f11d1400700 1 -- 172.21.15.55:0/3007673931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40095f0 con 0x7f11d4102680 2024-04-26T21:13:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.963+0000 7f11d1400700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11c000d6d0 tx=0x7f11c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.963+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c000f860 con 0x7f11d4102680 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.964+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11c000fe80 con 0x7f11d4102680 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.964+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d4196c60 con 0x7f11d4102680 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.964+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c0010ea0 con 0x7f11d4102680 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.964+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d41971b0 con 0x7f11d4102680 2024-04-26T21:13:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.965+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4105480 con 0x7f11d4102680 2024-04-26T21:13:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.966+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f11c0010460 con 0x7f11d4102680 2024-04-26T21:13:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.967+0000 7f11caa00700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 0x7f11b80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:13:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.968+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f11c008ecb0 con 0x7f11d4102680 2024-04-26T21:13:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.968+0000 7f11d1e00700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 0x7f11b80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:13:59.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.968+0000 7f11d1e00700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 0x7f11b80712b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:13:59.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:13:59.973+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f11c005b380 con 0x7f11d4102680 2024-04-26T21:14:00.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.229+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d410dde0 con 0x7f11b806edf0 2024-04-26T21:14:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.232+0000 7f11caa00700 1 -- 172.21.15.55:0/3007673931 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f11d410dde0 con 0x7f11b806edf0 2024-04-26T21:14:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 msgr2=0x7f11b80712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 0x7f11b80712b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c400b540 comp rx=0 tx=0).stop 2024-04-26T21:14:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 msgr2=0x7f11d419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11c000d6d0 tx=0x7f11c000da90 comp rx=0 tx=0).stop 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 shutdown_connections 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11b806edf0 0x7f11b80712b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11d4101d60 0x7f11d419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 --2- 172.21.15.55:0/3007673931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11d4102680 0x7f11d419cd80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 >> 172.21.15.55:0/3007673931 conn(0x7f11d4076740 msgr2=0x7f11d4103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 shutdown_connections 2024-04-26T21:14:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.235+0000 7f11d9200700 1 -- 172.21.15.55:0/3007673931 wait complete. 2024-04-26T21:14:00.254 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:14:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.403+0000 7f4cb2400700 1 -- 172.21.15.55:0/2200842657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac1039f0 msgr2=0x7f4cac107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.403+0000 7f4cb2400700 1 --2- 172.21.15.55:0/2200842657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac1039f0 0x7f4cac107a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009910 tx=0x7f4c94009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 -- 172.21.15.55:0/2200842657 shutdown_connections 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 --2- 172.21.15.55:0/2200842657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac1039f0 0x7f4cac107a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 --2- 172.21.15.55:0/2200842657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac103040 0x7f4cac103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 -- 172.21.15.55:0/2200842657 >> 172.21.15.55:0/2200842657 conn(0x7f4cac0fe8b0 msgr2=0x7f4cac100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 -- 172.21.15.55:0/2200842657 shutdown_connections 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.404+0000 7f4cb2400700 1 -- 172.21.15.55:0/2200842657 wait complete. 2024-04-26T21:14:00.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.405+0000 7f4cb2400700 1 Processor -- start 2024-04-26T21:14:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.406+0000 7f4cb2400700 1 -- start start 2024-04-26T21:14:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.406+0000 7f4cb2400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.406+0000 7f4cb2400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac1039f0 0x7f4cac199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.406+0000 7f4cb2400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac199920 con 0x7f4cac103040 2024-04-26T21:14:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.406+0000 7f4cb2400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac19c540 con 0x7f4cac1039f0 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47138/0 (socket says 172.21.15.55:47138) 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 -- 172.21.15.55:0/3599702366 learned_addr learned my addr 172.21.15.55:0/3599702366 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4ca3e00700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac1039f0 0x7f4cac199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 -- 172.21.15.55:0/3599702366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac1039f0 msgr2=0x7f4cac199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac1039f0 0x7f4cac199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.407+0000 7f4cab400700 1 -- 172.21.15.55:0/3599702366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940095f0 con 0x7f4cac103040 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4cab400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c8a0 tx=0x7f4c9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c00cea0 con 0x7f4cac103040 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c9c004830 con 0x7f4cac103040 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac19c820 con 0x7f4cac103040 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c0055b0 con 0x7f4cac103040 2024-04-26T21:14:00.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.408+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac19cd70 con 0x7f4cac103040 2024-04-26T21:14:00.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.409+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac10b440 con 0x7f4cac103040 2024-04-26T21:14:00.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.410+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4c9c0049a0 con 0x7f4cac103040 2024-04-26T21:14:00.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.411+0000 7f4ca8c00700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 0x7f4c900712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.411+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4c9c08ecc0 con 0x7f4cac103040 2024-04-26T21:14:00.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.412+0000 7f4ca3e00700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 0x7f4c900712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.412+0000 7f4ca3e00700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 0x7f4c900712b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c94006010 tx=0x7f4c9400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:00.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.417+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4c9c094020 con 0x7f4cac103040 2024-04-26T21:14:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.683+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cac10ffe0 con 0x7f4c9006edf0 2024-04-26T21:14:00.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.685+0000 7f4ca8c00700 1 -- 172.21.15.55:0/3599702366 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4cac10ffe0 con 0x7f4c9006edf0 2024-04-26T21:14:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.688+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 msgr2=0x7f4c900712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.688+0000 7f4cb2400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 0x7f4c900712b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c94006010 tx=0x7f4c9400b540 comp rx=0 tx=0).stop 2024-04-26T21:14:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.688+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 msgr2=0x7f4cac198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.688+0000 7f4cb2400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c8a0 tx=0x7f4c9c00cc60 comp rx=0 tx=0).stop 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 shutdown_connections 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cac103040 0x7f4cac198d50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4c9006edf0 0x7f4c900712b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 --2- 172.21.15.55:0/3599702366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4cac1039f0 0x7f4cac199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 >> 172.21.15.55:0/3599702366 conn(0x7f4cac0fe8b0 msgr2=0x7f4cac0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 shutdown_connections 2024-04-26T21:14:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.689+0000 7f4cb2400700 1 -- 172.21.15.55:0/3599702366 wait complete. 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 -- 172.21.15.55:0/2021355024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808103810 msgr2=0x7f8808107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 --2- 172.21.15.55:0/2021355024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808103810 0x7f8808107860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009910 tx=0x7f87f4009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 -- 172.21.15.55:0/2021355024 shutdown_connections 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 --2- 172.21.15.55:0/2021355024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808103810 0x7f8808107860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 --2- 172.21.15.55:0/2021355024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808102e60 0x7f8808103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 -- 172.21.15.55:0/2021355024 >> 172.21.15.55:0/2021355024 conn(0x7f88080fe6d0 msgr2=0x7f8808100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 -- 172.21.15.55:0/2021355024 shutdown_connections 2024-04-26T21:14:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.852+0000 7f880d800700 1 -- 172.21.15.55:0/2021355024 wait complete. 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.853+0000 7f880d800700 1 Processor -- start 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f880d800700 1 -- start start 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f880d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f880d800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808103810 0x7f880819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f880d800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880819f3d0 con 0x7f8808102e60 2024-04-26T21:14:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f880d800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808198a00 con 0x7f8808103810 2024-04-26T21:14:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f8807e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f8807e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47158/0 (socket says 172.21.15.55:47158) 2024-04-26T21:14:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.854+0000 7f8807e00700 1 -- 172.21.15.55:0/3583846296 learned_addr learned my addr 172.21.15.55:0/3583846296 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.855+0000 7f8807400700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808103810 0x7f880819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.855+0000 7f8807e00700 1 -- 172.21.15.55:0/3583846296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808103810 msgr2=0x7f880819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.855+0000 7f8807e00700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808103810 0x7f880819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.855+0000 7f8807e00700 1 -- 172.21.15.55:0/3583846296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40095f0 con 0x7f8808102e60 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.855+0000 7f8807e00700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c8a0 tx=0x7f87f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.856+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f800cea0 con 0x7f8808102e60 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.856+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87f8004830 con 0x7f8808102e60 2024-04-26T21:14:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.856+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f80055b0 con 0x7f8808102e60 2024-04-26T21:14:00.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.856+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808198ce0 con 0x7f8808102e60 2024-04-26T21:14:00.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.856+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88081991e0 con 0x7f8808102e60 2024-04-26T21:14:00.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.857+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880810b260 con 0x7f8808102e60 2024-04-26T21:14:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.859+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f87f80049a0 con 0x7f8808102e60 2024-04-26T21:14:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.860+0000 7f8804c00700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 0x7f87ec0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.860+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f87f808ed00 con 0x7f8808102e60 2024-04-26T21:14:00.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.861+0000 7f8807400700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 0x7f87ec0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:00.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.862+0000 7f8807400700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 0x7f87ec0712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8808199b70 tx=0x7f87f401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:00.866+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f87f8092030 con 0x7f8808102e60 2024-04-26T21:14:01.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.113+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8808199f10 con 0x7f87ec06edf0 2024-04-26T21:14:01.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.138+0000 7f8804c00700 1 -- 172.21.15.55:0/3583846296 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8808199f10 con 0x7f87ec06edf0 2024-04-26T21:14:01.139 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:14:01.139 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (3m) 41s ago 17m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:14:01.139 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (17m) 41s ago 17m 8326k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (16m) 16s ago 16m 8204k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (17m) 41s ago 17m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (16m) 16s ago 16m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (2m) 41s ago 17m 73.5M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (9m) 41s ago 9m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (9m) 41s ago 9m 16.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (9m) 16s ago 9m 99.1M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (9m) 16s ago 9m 16.6M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (6m) 41s ago 19m 478M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (4m) 16s ago 16m 449M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (59s) 41s ago 19m 30.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (22s) 16s ago 15m 16.7M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (4m) 41s ago 17m 7788k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (4m) 16s ago 16m 7562k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:14:01.140 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (14m) 41s ago 14m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (14m) 41s ago 14m 268M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (13m) 41s ago 13m 228M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (13m) 16s ago 13m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (12m) 16s ago 12m 273M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (11m) 16s ago 11m 243M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:14:01.141 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (3m) 41s ago 16m 64.5M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:14:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 msgr2=0x7f87ec0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 0x7f87ec0712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8808199b70 tx=0x7f87f401a040 comp rx=0 tx=0).stop 2024-04-26T21:14:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 msgr2=0x7f880819e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c8a0 tx=0x7f87f800cc60 comp rx=0 tx=0).stop 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 shutdown_connections 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8808102e60 0x7f880819e870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f87ec06edf0 0x7f87ec0712b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 --2- 172.21.15.55:0/3583846296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8808103810 0x7f880819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.141+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 >> 172.21.15.55:0/3583846296 conn(0x7f88080fe6d0 msgr2=0x7f88080feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.142+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 shutdown_connections 2024-04-26T21:14:01.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.142+0000 7f880d800700 1 -- 172.21.15.55:0/3583846296 wait complete. 2024-04-26T21:14:01.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.301+0000 7f7f4f000700 1 -- 172.21.15.55:0/2285415478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 msgr2=0x7f7f4810cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.301+0000 7f7f4f000700 1 --2- 172.21.15.55:0/2285415478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f4810cf60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009910 tx=0x7f7f30009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.301+0000 7f7f4f000700 1 -- 172.21.15.55:0/2285415478 shutdown_connections 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.301+0000 7f7f4f000700 1 --2- 172.21.15.55:0/2285415478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f4810cf60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.301+0000 7f7f4f000700 1 --2- 172.21.15.55:0/2285415478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 0x7f7f480ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.302+0000 7f7f4f000700 1 -- 172.21.15.55:0/2285415478 >> 172.21.15.55:0/2285415478 conn(0x7f7f48076740 msgr2=0x7f7f480fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.302+0000 7f7f4f000700 1 -- 172.21.15.55:0/2285415478 shutdown_connections 2024-04-26T21:14:01.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.302+0000 7f7f4f000700 1 -- 172.21.15.55:0/2285415478 wait complete. 2024-04-26T21:14:01.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.303+0000 7f7f4f000700 1 Processor -- start 2024-04-26T21:14:01.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f4f000700 1 -- start start 2024-04-26T21:14:01.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f4f000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 0x7f7f48198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f4f000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f4f000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481998f0 con 0x7f7f481002a0 2024-04-26T21:14:01.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f4f000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4819c560 con 0x7f7f480ff8f0 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.304+0000 7f7f3f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47174/0 (socket says 172.21.15.55:47174) 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 -- 172.21.15.55:0/1200149799 learned_addr learned my addr 172.21.15.55:0/1200149799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f47e00700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 0x7f7f48198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 -- 172.21.15.55:0/1200149799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 msgr2=0x7f7f48198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 0x7f7f48198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 -- 172.21.15.55:0/1200149799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300095f0 con 0x7f7f481002a0 2024-04-26T21:14:01.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.305+0000 7f7f3f400700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006010 tx=0x7f7f300056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.306+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3001d070 con 0x7f7f481002a0 2024-04-26T21:14:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.306+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f30003d50 con 0x7f7f481002a0 2024-04-26T21:14:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.306+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4819c7e0 con 0x7f7f481002a0 2024-04-26T21:14:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.306+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4819cd30 con 0x7f7f481002a0 2024-04-26T21:14:01.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.306+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f30021410 con 0x7f7f481002a0 2024-04-26T21:14:01.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.307+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f240052f0 con 0x7f7f481002a0 2024-04-26T21:14:01.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.309+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f7f3002b440 con 0x7f7f481002a0 2024-04-26T21:14:01.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.311+0000 7f7f45600700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 0x7f7f2c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.311+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7f30090080 con 0x7f7f481002a0 2024-04-26T21:14:01.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.311+0000 7f7f47e00700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 0x7f7f2c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.312+0000 7f7f47e00700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 0x7f7f2c0712c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005950 tx=0x7f7f380058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.316+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f7f30058d70 con 0x7f7f481002a0 2024-04-26T21:14:01.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.645+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f24005870 con 0x7f7f481002a0 2024-04-26T21:14:01.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.647+0000 7f7f45600700 1 -- 172.21.15.55:0/1200149799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f7f3005c430 con 0x7f7f481002a0 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:14:01.648 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:01.649 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:14:01.649 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 10, 2024-04-26T21:14:01.649 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:14:01.649 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:14:01.649 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:14:01.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.649+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 msgr2=0x7f7f2c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.649+0000 7f7f4f000700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 0x7f7f2c0712c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005950 tx=0x7f7f380058e0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 msgr2=0x7f7f48199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006010 tx=0x7f7f300056a0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 shutdown_connections 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7f2c06ee00 0x7f7f2c0712c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f480ff8f0 0x7f7f48198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 --2- 172.21.15.55:0/1200149799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f481002a0 0x7f7f48199260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 >> 172.21.15.55:0/1200149799 conn(0x7f7f48076740 msgr2=0x7f7f480fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 shutdown_connections 2024-04-26T21:14:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.650+0000 7f7f4f000700 1 -- 172.21.15.55:0/1200149799 wait complete. 2024-04-26T21:14:01.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: pgmap v27: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:01.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:01.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:01.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:01.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:01.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:01.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 -- 172.21.15.55:0/430637119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107440 msgr2=0x7f27a8107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 --2- 172.21.15.55:0/430637119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107440 0x7f27a8107820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f279c009910 tx=0x7f279c009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 -- 172.21.15.55:0/430637119 shutdown_connections 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 --2- 172.21.15.55:0/430637119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107df0 0x7f27a810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 --2- 172.21.15.55:0/430637119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107440 0x7f27a8107820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 -- 172.21.15.55:0/430637119 >> 172.21.15.55:0/430637119 conn(0x7f27a8076a10 msgr2=0x7f27a8078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 -- 172.21.15.55:0/430637119 shutdown_connections 2024-04-26T21:14:01.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.804+0000 7f27afc00700 1 -- 172.21.15.55:0/430637119 wait complete. 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 Processor -- start 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 -- start start 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107440 0x7f27a819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819dce0 con 0x7f27a8107df0 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.805+0000 7f27afc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819de20 con 0x7f27a8107440 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47198/0 (socket says 172.21.15.55:47198) 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 -- 172.21.15.55:0/3210665539 learned_addr learned my addr 172.21.15.55:0/3210665539 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27ad200700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107440 0x7f27a819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 -- 172.21.15.55:0/3210665539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107440 msgr2=0x7f27a819d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107440 0x7f27a819d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:01.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.806+0000 7f27a7e00700 1 -- 172.21.15.55:0/3210665539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0095f0 con 0x7f27a8107df0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27a7e00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f279400c960 tx=0x7f279400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2794007a70 con 0x7f27a8107df0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2794007bd0 con 0x7f27a8107df0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a81a1b60 con 0x7f27a8107df0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27940186c0 con 0x7f27a8107df0 2024-04-26T21:14:01.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.807+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a81a20b0 con 0x7f27a8107df0 2024-04-26T21:14:01.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.808+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a810f7e0 con 0x7f27a8107df0 2024-04-26T21:14:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.810+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f279400faa0 con 0x7f27a8107df0 2024-04-26T21:14:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.810+0000 7f27a5600700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 0x7f27900712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.811+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f279408f040 con 0x7f27a8107df0 2024-04-26T21:14:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.811+0000 7f27ad200700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 0x7f27900712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.812+0000 7f27ad200700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 0x7f27900712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f279c00b5c0 tx=0x7f279c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:01.816+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f279405b7b0 con 0x7f27a8107df0 2024-04-26T21:14:01.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: pgmap v27: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:01.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:02.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.095+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f27a804ebb0 con 0x7f27a8107df0 2024-04-26T21:14:02.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.097+0000 7f27a5600700 1 -- 172.21.15.55:0/3210665539 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f279405b340 con 0x7f27a8107df0 2024-04-26T21:14:02.098 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:14:02.098 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:14:02.099 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:14:02.100 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:02.101 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 msgr2=0x7f27900712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 0x7f27900712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f279c00b5c0 tx=0x7f279c01a040 comp rx=0 tx=0).stop 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 msgr2=0x7f27a819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f279400c960 tx=0x7f279400cd20 comp rx=0 tx=0).stop 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 shutdown_connections 2024-04-26T21:14:02.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f279006edf0 0x7f27900712b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a8107440 0x7f27a819d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 --2- 172.21.15.55:0/3210665539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8107df0 0x7f27a819d690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.100+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 >> 172.21.15.55:0/3210665539 conn(0x7f27a8076a10 msgr2=0x7f27a8076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.101+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 shutdown_connections 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.101+0000 7f27afc00700 1 -- 172.21.15.55:0/3210665539 wait complete. 2024-04-26T21:14:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 -- 172.21.15.55:0/3900060390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 msgr2=0x7fd02c107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 --2- 172.21.15.55:0/3900060390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c107510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd018009910 tx=0x7fd018009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 -- 172.21.15.55:0/3900060390 shutdown_connections 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 --2- 172.21.15.55:0/3900060390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c107510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 --2- 172.21.15.55:0/3900060390 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 0x7fd02c10d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 -- 172.21.15.55:0/3900060390 >> 172.21.15.55:0/3900060390 conn(0x7fd02c076830 msgr2=0x7fd02c078c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 -- 172.21.15.55:0/3900060390 shutdown_connections 2024-04-26T21:14:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.258+0000 7fd031200700 1 -- 172.21.15.55:0/3900060390 wait complete. 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.259+0000 7fd031200700 1 Processor -- start 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.259+0000 7fd031200700 1 -- start start 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.259+0000 7fd031200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd031200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 0x7fd02c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd031200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c19dc40 con 0x7fd02c1070b0 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd031200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c1a1910 con 0x7fd02c10d0c0 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47224/0 (socket says 172.21.15.55:47224) 2024-04-26T21:14:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 -- 172.21.15.55:0/422305857 learned_addr learned my addr 172.21.15.55:0/422305857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:02.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02aa00700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 0x7fd02c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 -- 172.21.15.55:0/422305857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 msgr2=0x7fd02c19d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 0x7fd02c19d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.260+0000 7fd02b400700 1 -- 172.21.15.55:0/422305857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180095f0 con 0x7fd02c1070b0 2024-04-26T21:14:02.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd02b400700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00d8d0 tx=0x7fd01c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c009940 con 0x7fd02c1070b0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd01c010460 con 0x7fd02c1070b0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c00f5f0 con 0x7fd02c1070b0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c1a1bf0 con 0x7fd02c1070b0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.261+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c1a2140 con 0x7fd02c1070b0 2024-04-26T21:14:02.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.262+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c10f5c0 con 0x7fd02c1070b0 2024-04-26T21:14:02.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.263+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fd01c0105d0 con 0x7fd02c1070b0 2024-04-26T21:14:02.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.264+0000 7fd023e00700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 0x7fd0100712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.265+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd01c08efe0 con 0x7fd02c1070b0 2024-04-26T21:14:02.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.265+0000 7fd02aa00700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 0x7fd0100712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.266+0000 7fd02aa00700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 0x7fd0100712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd018005b40 tx=0x7fd01801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:02.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.270+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd01c0c4060 con 0x7fd02c1070b0 2024-04-26T21:14:02.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.521+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd02c114210 con 0x7fd01006edf0 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.523+0000 7fd023e00700 1 -- 172.21.15.55:0/422305857 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd02c114210 con 0x7fd01006edf0 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:14:02.524 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "4/23 daemons upgraded", 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mon daemons", 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:14:02.525 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 msgr2=0x7fd0100712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 0x7fd0100712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd018005b40 tx=0x7fd01801a040 comp rx=0 tx=0).stop 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 msgr2=0x7fd02c19d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00d8d0 tx=0x7fd01c00dc90 comp rx=0 tx=0).stop 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 shutdown_connections 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd02c1070b0 0x7fd02c19d020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd01006edf0 0x7fd0100712b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 --2- 172.21.15.55:0/422305857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd02c10d0c0 0x7fd02c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 >> 172.21.15.55:0/422305857 conn(0x7fd02c076830 msgr2=0x7fd02c10c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:02.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 shutdown_connections 2024-04-26T21:14:02.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.526+0000 7fd031200700 1 -- 172.21.15.55:0/422305857 wait complete. 2024-04-26T21:14:02.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 -- 172.21.15.55:0/1833694393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 msgr2=0x7fea100736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 --2- 172.21.15.55:0/1833694393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea100736f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea0400b0a0 tx=0x7fea0400b3b0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 -- 172.21.15.55:0/1833694393 shutdown_connections 2024-04-26T21:14:02.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 --2- 172.21.15.55:0/1833694393 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea1010ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 --2- 172.21.15.55:0/1833694393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea100736f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 -- 172.21.15.55:0/1833694393 >> 172.21.15.55:0/1833694393 conn(0x7fea100fc6e0 msgr2=0x7fea100feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.687+0000 7fea18200700 1 -- 172.21.15.55:0/1833694393 shutdown_connections 2024-04-26T21:14:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.688+0000 7fea18200700 1 -- 172.21.15.55:0/1833694393 wait complete. 2024-04-26T21:14:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.688+0000 7fea18200700 1 Processor -- start 2024-04-26T21:14:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea18200700 1 -- start start 2024-04-26T21:14:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea18200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea18200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea101992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea18200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10199930 con 0x7fea10073310 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea18200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1019c550 con 0x7fea10073c30 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea15800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea15800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47244/0 (socket says 172.21.15.55:47244) 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.689+0000 7fea15800700 1 -- 172.21.15.55:0/2927395845 learned_addr learned my addr 172.21.15.55:0/2927395845 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea14e00700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea101992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea15800700 1 -- 172.21.15.55:0/2927395845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 msgr2=0x7fea101992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea15800700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea101992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea15800700 1 -- 172.21.15.55:0/2927395845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009d00 con 0x7fea10073310 2024-04-26T21:14:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea14e00700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea101992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea15800700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea04015040 tx=0x7fea04003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.690+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0400e040 con 0x7fea10073310 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.691+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea04004040 con 0x7fea10073310 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.691+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0401d6b0 con 0x7fea10073310 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.691+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1019c7d0 con 0x7fea10073310 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.691+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1019ccc0 con 0x7fea10073310 2024-04-26T21:14:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.692+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea100749c0 con 0x7fea10073310 2024-04-26T21:14:02.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.693+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fea040041b0 con 0x7fea10073310 2024-04-26T21:14:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.694+0000 7fea0e000700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 0x7fe9f80712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.694+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fea04090750 con 0x7fea10073310 2024-04-26T21:14:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.695+0000 7fea14e00700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 0x7fe9f80712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:02.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.696+0000 7fea14e00700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 0x7fe9f80712c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005fd0 tx=0x7fe9fc005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:02.699+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fea04059370 con 0x7fea10073310 2024-04-26T21:14:02.738 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:02.738 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: Reconfiguring crash.smithi055 (monmap changed)... 2024-04-26T21:14:02.739 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: Reconfiguring daemon crash.smithi055 on smithi055 2024-04-26T21:14:02.739 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:02.739 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1200149799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:02.739 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:02 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3210665539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: Reconfiguring crash.smithi055 (monmap changed)... 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: Reconfiguring daemon crash.smithi055 on smithi055 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1200149799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:02.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:02 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3210665539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:14:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.025+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fea10107780 con 0x7fea10073310 2024-04-26T21:14:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.026+0000 7fea0e000700 1 -- 172.21.15.55:0/2927395845 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fea0405ca30 con 0x7fea10073310 2024-04-26T21:14:03.027 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 msgr2=0x7fe9f80712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 0x7fe9f80712c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005fd0 tx=0x7fe9fc005ee0 comp rx=0 tx=0).stop 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 msgr2=0x7fea10198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea04015040 tx=0x7fea04003ce0 comp rx=0 tx=0).stop 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 shutdown_connections 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea10073310 0x7fea10198d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe9f806ee00 0x7fe9f80712c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 --2- 172.21.15.55:0/2927395845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea10073c30 0x7fea101992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 >> 172.21.15.55:0/2927395845 conn(0x7fea100fc6e0 msgr2=0x7fea10105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.029+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 shutdown_connections 2024-04-26T21:14:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:03.030+0000 7fea18200700 1 -- 172.21.15.55:0/2927395845 wait complete. 2024-04-26T21:14:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: pgmap v28: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2927395845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:14:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:14:03.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:03 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: pgmap v28: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2927395845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:14:03.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:03 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:04.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:04 smithi055 ceph-mon[109028]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:04.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:04 smithi055 ceph-mon[109028]: Reconfiguring osd.0 (monmap changed)... 2024-04-26T21:14:04.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:04 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.0 on smithi055 2024-04-26T21:14:04.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:04 smithi064 ceph-mon[84240]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:04 smithi064 ceph-mon[84240]: Reconfiguring osd.0 (monmap changed)... 2024-04-26T21:14:04.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:04 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.0 on smithi055 2024-04-26T21:14:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:05 smithi055 ceph-mon[109028]: pgmap v29: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:05.808 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:05 smithi064 ceph-mon[84240]: pgmap v29: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:06.710 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:06.711 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:06.711 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:14:06.711 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:06.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:14:06.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:07.716 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:07 smithi055 ceph-mon[109028]: Reconfiguring osd.1 (monmap changed)... 2024-04-26T21:14:07.716 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:07 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.1 on smithi055 2024-04-26T21:14:07.716 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:07 smithi055 ceph-mon[109028]: pgmap v30: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:07.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:07 smithi064 ceph-mon[84240]: Reconfiguring osd.1 (monmap changed)... 2024-04-26T21:14:07.886 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:07 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.1 on smithi055 2024-04-26T21:14:07.890 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:07 smithi064 ceph-mon[84240]: pgmap v30: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:09.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: pgmap v31: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: Reconfiguring osd.2 (monmap changed)... 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:09.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:09 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.2 on smithi055 2024-04-26T21:14:09.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: pgmap v31: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: Reconfiguring osd.2 (monmap changed)... 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:09 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.2 on smithi055 2024-04-26T21:14:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:11 smithi064 ceph-mon[84240]: pgmap v32: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:11.483 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:11 smithi055 ceph-mon[109028]: pgmap v32: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:11.483 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:11.483 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:11.483 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:11.483 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:12 smithi055 ceph-mon[109028]: Reconfiguring mds.cephfs.smithi055.coveew (monmap changed)... 2024-04-26T21:14:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:12 smithi055 ceph-mon[109028]: Reconfiguring daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:14:12.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:12.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:12 smithi064 ceph-mon[84240]: Reconfiguring mds.cephfs.smithi055.coveew (monmap changed)... 2024-04-26T21:14:12.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:12 smithi064 ceph-mon[84240]: Reconfiguring daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:14:12.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:13.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:13 smithi064 ceph-mon[84240]: pgmap v33: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:13.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:13.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:13.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:13.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:13 smithi055 ceph-mon[109028]: pgmap v33: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:14.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:14 smithi064 ceph-mon[84240]: Reconfiguring mds.cephfs.smithi055.nwfjlb (monmap changed)... 2024-04-26T21:14:14.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:14 smithi064 ceph-mon[84240]: Reconfiguring daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:14:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:14 smithi055 ceph-mon[109028]: Reconfiguring mds.cephfs.smithi055.nwfjlb (monmap changed)... 2024-04-26T21:14:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:14 smithi055 ceph-mon[109028]: Reconfiguring daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:14:15.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:15 smithi055 ceph-mon[109028]: pgmap v34: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:15.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:15 smithi064 ceph-mon[84240]: pgmap v34: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: Reconfiguring ceph-exporter.smithi064 (monmap changed)... 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: Unable to update caps for client.ceph-exporter.smithi064 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi064"}]: dispatch 2024-04-26T21:14:16.336 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:16.337 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:16 smithi064 ceph-mon[84240]: Reconfiguring daemon ceph-exporter.smithi064 on smithi064 2024-04-26T21:14:16.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: Reconfiguring ceph-exporter.smithi064 (monmap changed)... 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: Unable to update caps for client.ceph-exporter.smithi064 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi064"}]: dispatch 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:16.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:16 smithi055 ceph-mon[109028]: Reconfiguring daemon ceph-exporter.smithi064 on smithi064 2024-04-26T21:14:17.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:17 smithi064 ceph-mon[84240]: pgmap v35: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:17.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:17 smithi055 ceph-mon[109028]: pgmap v35: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: pgmap v36: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: Reconfiguring crash.smithi064 (monmap changed)... 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:19.056 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:18 smithi064 ceph-mon[84240]: Reconfiguring daemon crash.smithi064 on smithi064 2024-04-26T21:14:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: pgmap v36: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: Reconfiguring crash.smithi064 (monmap changed)... 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:19.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:18 smithi055 ceph-mon[109028]: Reconfiguring daemon crash.smithi064 on smithi064 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: pgmap v37: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: Reconfiguring mgr.smithi064.tchyje (monmap changed)... 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:21.369 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:21 smithi064 ceph-mon[84240]: Reconfiguring daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:14:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: pgmap v37: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: Reconfiguring mgr.smithi064.tchyje (monmap changed)... 2024-04-26T21:14:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi064.tchyje", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T21:14:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T21:14:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:21 smithi055 ceph-mon[109028]: Reconfiguring daemon mgr.smithi064.tchyje on smithi064 2024-04-26T21:14:23.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: pgmap v38: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:23.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:23.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:23.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:14:23.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:14:23.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: pgmap v38: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T21:14:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:23.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:23 smithi064 ceph-mon[84240]: Reconfiguring mon.smithi064 (monmap changed)... 2024-04-26T21:14:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:23 smithi064 ceph-mon[84240]: Reconfiguring daemon mon.smithi064 on smithi064 2024-04-26T21:14:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:23 smithi055 ceph-mon[109028]: Reconfiguring mon.smithi064 (monmap changed)... 2024-04-26T21:14:24.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:23 smithi055 ceph-mon[109028]: Reconfiguring daemon mon.smithi064 on smithi064 2024-04-26T21:14:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:24 smithi064 ceph-mon[84240]: pgmap v39: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:25.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:24 smithi055 ceph-mon[109028]: pgmap v39: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:26.371 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: Reconfiguring osd.3 (monmap changed)... 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:26 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.3 on smithi064 2024-04-26T21:14:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: Reconfiguring osd.3 (monmap changed)... 2024-04-26T21:14:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:14:26.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:26.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:26 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.3 on smithi064 2024-04-26T21:14:27.362 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:27 smithi064 ceph-mon[84240]: pgmap v40: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:27.363 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:27 smithi055 ceph-mon[109028]: pgmap v40: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:28.982 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: Reconfiguring osd.4 (monmap changed)... 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.4 on smithi064 2024-04-26T21:14:28.983 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:28 smithi064 ceph-mon[84240]: pgmap v41: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:29.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:29.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:29.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: Reconfiguring osd.4 (monmap changed)... 2024-04-26T21:14:29.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:14:29.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.4 on smithi064 2024-04-26T21:14:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:28 smithi055 ceph-mon[109028]: pgmap v41: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:31.489 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: pgmap v42: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: Reconfiguring osd.5 (monmap changed)... 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:31.490 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:31 smithi064 ceph-mon[84240]: Reconfiguring daemon osd.5 on smithi064 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: pgmap v42: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: Reconfiguring osd.5 (monmap changed)... 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:14:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:31.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:31 smithi055 ceph-mon[109028]: Reconfiguring daemon osd.5 on smithi064 2024-04-26T21:14:33.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.204+0000 7f9d23000700 1 -- 172.21.15.55:0/1302354738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 msgr2=0x7f9d1c107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.204+0000 7f9d23000700 1 --2- 172.21.15.55:0/1302354738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c107a30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009910 tx=0x7f9d08009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.204+0000 7f9d23000700 1 -- 172.21.15.55:0/1302354738 shutdown_connections 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.205+0000 7f9d23000700 1 --2- 172.21.15.55:0/1302354738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c107a30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.205+0000 7f9d23000700 1 --2- 172.21.15.55:0/1302354738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 0x7f9d1c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.205+0000 7f9d23000700 1 -- 172.21.15.55:0/1302354738 >> 172.21.15.55:0/1302354738 conn(0x7f9d1c0fe8c0 msgr2=0x7f9d1c100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.205+0000 7f9d23000700 1 -- 172.21.15.55:0/1302354738 shutdown_connections 2024-04-26T21:14:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.205+0000 7f9d23000700 1 -- 172.21.15.55:0/1302354738 wait complete. 2024-04-26T21:14:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.206+0000 7f9d23000700 1 Processor -- start 2024-04-26T21:14:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.206+0000 7f9d23000700 1 -- start start 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d23000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 0x7f9d1c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d23000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d23000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c19f5b0 con 0x7f9d1c1039e0 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d23000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c198b90 con 0x7f9d1c103030 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d1b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d1b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35982/0 (socket says 172.21.15.55:35982) 2024-04-26T21:14:33.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d1b400700 1 -- 172.21.15.55:0/2425541611 learned_addr learned my addr 172.21.15.55:0/2425541611 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:33.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.207+0000 7f9d1be00700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 0x7f9d1c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d1b400700 1 -- 172.21.15.55:0/2425541611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 msgr2=0x7f9d1c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d1b400700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 0x7f9d1c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d1b400700 1 -- 172.21.15.55:0/2425541611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080095f0 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d1b400700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d080092e0 tx=0x7f9d0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0801d070 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d08005700 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d08017400 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.208+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c198e10 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.209+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c1992b0 con 0x7f9d1c1039e0 2024-04-26T21:14:33.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.210+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c10b430 con 0x7f9d1c1039e0 2024-04-26T21:14:33.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.211+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f9d08003a60 con 0x7f9d1c1039e0 2024-04-26T21:14:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.212+0000 7f9d18c00700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 0x7f9d000712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.213+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9d08090430 con 0x7f9d1c1039e0 2024-04-26T21:14:33.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.213+0000 7f9d1be00700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 0x7f9d000712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.214+0000 7f9d1be00700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 0x7f9d000712c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009d10 tx=0x7f9d0c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:33.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.218+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9d0805cb00 con 0x7f9d1c1039e0 2024-04-26T21:14:33.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.472+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d1c10ffd0 con 0x7f9d0006ee00 2024-04-26T21:14:33.474 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:33 smithi055 ceph-mon[109028]: pgmap v43: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:33.474 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:33 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:33.474 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:33 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:33.474 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:33 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:33.474 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:33 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:33.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.475+0000 7f9d18c00700 1 -- 172.21.15.55:0/2425541611 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9d1c10ffd0 con 0x7f9d0006ee00 2024-04-26T21:14:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.477+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 msgr2=0x7f9d000712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.477+0000 7f9d23000700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 0x7f9d000712c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009d10 tx=0x7f9d0c009040 comp rx=0 tx=0).stop 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.477+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 msgr2=0x7f9d1c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.477+0000 7f9d23000700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d080092e0 tx=0x7f9d0800be20 comp rx=0 tx=0).stop 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 shutdown_connections 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9d0006ee00 0x7f9d000712c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d1c103030 0x7f9d1c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 --2- 172.21.15.55:0/2425541611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d1c1039e0 0x7f9d1c19ef90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 >> 172.21.15.55:0/2425541611 conn(0x7f9d1c0fe8c0 msgr2=0x7f9d1c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 shutdown_connections 2024-04-26T21:14:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.478+0000 7f9d23000700 1 -- 172.21.15.55:0/2425541611 wait complete. 2024-04-26T21:14:33.496 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:14:33.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:33 smithi064 ceph-mon[84240]: pgmap v43: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:33.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:33 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:33.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:33 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:33.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:33 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:33.519 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:33 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:33.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 -- 172.21.15.55:0/4195225908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8102730 msgr2=0x7f64e810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 --2- 172.21.15.55:0/4195225908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8102730 0x7f64e810ac20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009910 tx=0x7f64d4009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 -- 172.21.15.55:0/4195225908 shutdown_connections 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 --2- 172.21.15.55:0/4195225908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8102730 0x7f64e810ac20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 --2- 172.21.15.55:0/4195225908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8101e10 0x7f64e81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.644+0000 7f64f0200700 1 -- 172.21.15.55:0/4195225908 >> 172.21.15.55:0/4195225908 conn(0x7f64e80fb6a0 msgr2=0x7f64e80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.645+0000 7f64f0200700 1 -- 172.21.15.55:0/4195225908 shutdown_connections 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.645+0000 7f64f0200700 1 -- 172.21.15.55:0/4195225908 wait complete. 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 Processor -- start 2024-04-26T21:14:33.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 -- start start 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8102730 0x7f64e819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e819d3f0 con 0x7f64e8101e10 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.646+0000 7f64f0200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e81969d0 con 0x7f64e8102730 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35996/0 (socket says 172.21.15.55:35996) 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 -- 172.21.15.55:0/1778174361 learned_addr learned my addr 172.21.15.55:0/1778174361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ece00700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8102730 0x7f64e819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 -- 172.21.15.55:0/1778174361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8102730 msgr2=0x7f64e819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8102730 0x7f64e819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.647+0000 7f64ed800700 1 -- 172.21.15.55:0/1778174361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40095f0 con 0x7f64e8101e10 2024-04-26T21:14:33.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64ed800700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00e920 tx=0x7f64dc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:33.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc00c9d0 con 0x7f64e8101e10 2024-04-26T21:14:33.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64dc010430 con 0x7f64e8101e10 2024-04-26T21:14:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc018630 con 0x7f64e8101e10 2024-04-26T21:14:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e8196cb0 con 0x7f64e8101e10 2024-04-26T21:14:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.648+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e8197180 con 0x7f64e8101e10 2024-04-26T21:14:33.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.649+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e8105530 con 0x7f64e8101e10 2024-04-26T21:14:33.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.650+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f64dc0105a0 con 0x7f64e8101e10 2024-04-26T21:14:33.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.652+0000 7f64e6000700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 0x7f64d00712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:33.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.652+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f64dc014070 con 0x7f64e8101e10 2024-04-26T21:14:33.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.652+0000 7f64ece00700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 0x7f64d00712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:33.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.653+0000 7f64ece00700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 0x7f64d00712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d4005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:33.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.657+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f64dc054060 con 0x7f64e8101e10 2024-04-26T21:14:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.915+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64e8197f00 con 0x7f64d006edf0 2024-04-26T21:14:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.918+0000 7f64e6000700 1 -- 172.21.15.55:0/1778174361 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f64e8197f00 con 0x7f64d006edf0 2024-04-26T21:14:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 msgr2=0x7f64d00712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 0x7f64d00712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d4005a90 comp rx=0 tx=0).stop 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 msgr2=0x7f64e819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00e920 tx=0x7f64dc00ec30 comp rx=0 tx=0).stop 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 shutdown_connections 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64e8101e10 0x7f64e819c890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f64d006edf0 0x7f64d00712b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 --2- 172.21.15.55:0/1778174361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e8102730 0x7f64e819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.920+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 >> 172.21.15.55:0/1778174361 conn(0x7f64e80fb6a0 msgr2=0x7f64e81030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.921+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 shutdown_connections 2024-04-26T21:14:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:33.921+0000 7f64f0200700 1 -- 172.21.15.55:0/1778174361 wait complete. 2024-04-26T21:14:34.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 -- 172.21.15.55:0/1901238396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c106a20 msgr2=0x7f8a4c106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 --2- 172.21.15.55:0/1901238396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c106a20 0x7f8a4c106e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009910 tx=0x7f8a3c009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:34.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 -- 172.21.15.55:0/1901238396 shutdown_connections 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 --2- 172.21.15.55:0/1901238396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c100a20 0x7f8a4c100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 --2- 172.21.15.55:0/1901238396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c106a20 0x7f8a4c106e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.078+0000 7f8a50e00700 1 -- 172.21.15.55:0/1901238396 >> 172.21.15.55:0/1901238396 conn(0x7f8a4c0fc530 msgr2=0x7f8a4c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.079+0000 7f8a50e00700 1 -- 172.21.15.55:0/1901238396 shutdown_connections 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.079+0000 7f8a50e00700 1 -- 172.21.15.55:0/1901238396 wait complete. 2024-04-26T21:14:34.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 Processor -- start 2024-04-26T21:14:34.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 -- start start 2024-04-26T21:14:34.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 0x7f8a4c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c19f3b0 con 0x7f8a4c100a20 2024-04-26T21:14:34.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.080+0000 7f8a50e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c198990 con 0x7f8a4c106a20 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36010/0 (socket says 172.21.15.55:36010) 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 -- 172.21.15.55:0/3247708682 learned_addr learned my addr 172.21.15.55:0/3247708682 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4aa00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 0x7f8a4c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 -- 172.21.15.55:0/3247708682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 msgr2=0x7f8a4c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 0x7f8a4c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 -- 172.21.15.55:0/3247708682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0095f0 con 0x7f8a4c100a20 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4aa00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 0x7f8a4c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:14:34.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.081+0000 7f8a4b400700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.082+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c01d070 con 0x7f8a4c100a20 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.082+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a3c00f460 con 0x7f8a4c100a20 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.082+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c198c10 con 0x7f8a4c100a20 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.082+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c017630 con 0x7f8a4c100a20 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.082+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c199100 con 0x7f8a4c100a20 2024-04-26T21:14:34.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.083+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c104cd0 con 0x7f8a4c100a20 2024-04-26T21:14:34.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.084+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f8a3c00f5d0 con 0x7f8a4c100a20 2024-04-26T21:14:34.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.085+0000 7f8a43e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 0x7f8a300712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.085+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8a3c090550 con 0x7f8a4c100a20 2024-04-26T21:14:34.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.085+0000 7f8a4aa00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 0x7f8a300712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.086+0000 7f8a4aa00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 0x7f8a300712c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005fd0 tx=0x7f8a38005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.090+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8a3c05cce0 con 0x7f8a4c100a20 2024-04-26T21:14:34.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.329+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4c199ec0 con 0x7f8a3006ee00 2024-04-26T21:14:34.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.341+0000 7f8a43e00700 1 -- 172.21.15.55:0/3247708682 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8a4c199ec0 con 0x7f8a3006ee00 2024-04-26T21:14:34.343 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:14:34.343 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (3m) 74s ago 18m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (18m) 74s ago 18m 8326k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (16m) 49s ago 16m 8204k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (18m) 74s ago 18m 6656k - 18.2.2-1258-g7d2137f0 79c5878083fb 363a49b809b7 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (16m) 49s ago 16m 6669k - 18.2.2-1258-g7d2137f0 79c5878083fb 1976530a705e 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (3m) 74s ago 17m 73.5M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (10m) 74s ago 10m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (10m) 74s ago 10m 16.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (10m) 49s ago 10m 99.1M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (10m) 49s ago 10m 16.6M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (6m) 74s ago 19m 478M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (5m) 49s ago 16m 449M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (93s) 74s ago 20m 30.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (55s) 49s ago 16m 16.7M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (5m) 74s ago 18m 7788k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:14:34.344 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (4m) 49s ago 16m 7562k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (15m) 74s ago 15m 256M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (14m) 74s ago 14m 268M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (14m) 74s ago 14m 228M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (13m) 49s ago 13m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (13m) 49s ago 12m 273M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (12m) 49s ago 12m 243M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:14:34.345 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (4m) 74s ago 17m 64.5M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 msgr2=0x7f8a300712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 0x7f8a300712c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005fd0 tx=0x7f8a38005dc0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 msgr2=0x7f8a4c19e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c00be20 comp rx=0 tx=0).stop 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 shutdown_connections 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c100a20 0x7f8a4c19e850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a3006ee00 0x7f8a300712c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 --2- 172.21.15.55:0/3247708682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a4c106a20 0x7f8a4c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 >> 172.21.15.55:0/3247708682 conn(0x7f8a4c0fc530 msgr2=0x7f8a4c073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 shutdown_connections 2024-04-26T21:14:34.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.344+0000 7f8a50e00700 1 -- 172.21.15.55:0/3247708682 wait complete. 2024-04-26T21:14:34.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:34 smithi064 ceph-mon[84240]: Reconfiguring mds.cephfs.smithi064.ukvnjs (monmap changed)... 2024-04-26T21:14:34.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:34 smithi064 ceph-mon[84240]: Reconfiguring daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:14:34.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:34 smithi064 ceph-mon[84240]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:34 smithi055 ceph-mon[109028]: Reconfiguring mds.cephfs.smithi064.ukvnjs (monmap changed)... 2024-04-26T21:14:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:34 smithi055 ceph-mon[109028]: Reconfiguring daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:14:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:34 smithi055 ceph-mon[109028]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 -- 172.21.15.55:0/1127162515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073ba0 msgr2=0x7f6004111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 --2- 172.21.15.55:0/1127162515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073ba0 0x7f6004111690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0009910 tx=0x7f5ff0009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 -- 172.21.15.55:0/1127162515 shutdown_connections 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 --2- 172.21.15.55:0/1127162515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073ba0 0x7f6004111690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 --2- 172.21.15.55:0/1127162515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073280 0x7f6004073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 -- 172.21.15.55:0/1127162515 >> 172.21.15.55:0/1127162515 conn(0x7f60040fc6d0 msgr2=0x7f60040feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 -- 172.21.15.55:0/1127162515 shutdown_connections 2024-04-26T21:14:34.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.505+0000 7f600a000700 1 -- 172.21.15.55:0/1127162515 wait complete. 2024-04-26T21:14:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.506+0000 7f600a000700 1 Processor -- start 2024-04-26T21:14:34.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f600a000700 1 -- start start 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f600a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f600a000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073ba0 0x7f600419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f600a000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600419dcd0 con 0x7f6004073280 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f600a000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60041a19a0 con 0x7f6004073ba0 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.507+0000 7f6003400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36030/0 (socket says 172.21.15.55:36030) 2024-04-26T21:14:34.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 -- 172.21.15.55:0/3868752629 learned_addr learned my addr 172.21.15.55:0/3868752629 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6002a00700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073ba0 0x7f600419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 -- 172.21.15.55:0/3868752629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073ba0 msgr2=0x7f600419d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073ba0 0x7f600419d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 -- 172.21.15.55:0/3868752629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00095f0 con 0x7f6004073280 2024-04-26T21:14:34.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.508+0000 7f6003400700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c8a0 tx=0x7f5ff400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.509+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff400cea0 con 0x7f6004073280 2024-04-26T21:14:34.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.509+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff4004830 con 0x7f6004073280 2024-04-26T21:14:34.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.509+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60041a1c80 con 0x7f6004073280 2024-04-26T21:14:34.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.509+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ff40055b0 con 0x7f6004073280 2024-04-26T21:14:34.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.509+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60041a21d0 con 0x7f6004073280 2024-04-26T21:14:34.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.510+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600410ee10 con 0x7f6004073280 2024-04-26T21:14:34.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.511+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f5ff40049a0 con 0x7f6004073280 2024-04-26T21:14:34.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.512+0000 7f5ffbe00700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 0x7f5fe80712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.512+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5ff408ed20 con 0x7f6004073280 2024-04-26T21:14:34.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.513+0000 7f6002a00700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 0x7f5fe80712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.513+0000 7f6002a00700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 0x7f5fe80712c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00059d0 tx=0x7f5ff001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.517+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5ff4057960 con 0x7f6004073280 2024-04-26T21:14:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.839+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f600419e3c0 con 0x7f6004073280 2024-04-26T21:14:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.840+0000 7f5ffbe00700 1 -- 172.21.15.55:0/3868752629 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f5ff4004c50 con 0x7f6004073280 2024-04-26T21:14:34.842 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:14:34.843 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:14:34.843 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:14:34.843 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:34.843 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:14:34.843 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:14:34.844 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:14:34.845 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:14:34.845 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 10, 2024-04-26T21:14:34.845 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:14:34.845 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:14:34.845 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 msgr2=0x7f5fe80712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 0x7f5fe80712c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00059d0 tx=0x7f5ff001a040 comp rx=0 tx=0).stop 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 msgr2=0x7f600419d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c8a0 tx=0x7f5ff400cc60 comp rx=0 tx=0).stop 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 shutdown_connections 2024-04-26T21:14:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004073280 0x7f600419d0b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5fe806ee00 0x7f5fe80712c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 --2- 172.21.15.55:0/3868752629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6004073ba0 0x7f600419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 >> 172.21.15.55:0/3868752629 conn(0x7f60040fc6d0 msgr2=0x7f6004104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 shutdown_connections 2024-04-26T21:14:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.843+0000 7f600a000700 1 -- 172.21.15.55:0/3868752629 wait complete. 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 -- 172.21.15.55:0/1777841322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b0068ee0 msgr2=0x7f96b010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 --2- 172.21.15.55:0/1777841322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b0068ee0 0x7f96b010d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9698009910 tx=0x7f9698009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 -- 172.21.15.55:0/1777841322 shutdown_connections 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 --2- 172.21.15.55:0/1777841322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b0068ee0 0x7f96b010d0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 --2- 172.21.15.55:0/1777841322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b00685c0 0x7f96b00689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 -- 172.21.15.55:0/1777841322 >> 172.21.15.55:0/1777841322 conn(0x7f96b0075460 msgr2=0x7f96b0075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 -- 172.21.15.55:0/1777841322 shutdown_connections 2024-04-26T21:14:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.993+0000 7f96b5200700 1 -- 172.21.15.55:0/1777841322 wait complete. 2024-04-26T21:14:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.994+0000 7f96b5200700 1 Processor -- start 2024-04-26T21:14:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96b5200700 1 -- start start 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96b5200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96b5200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b0068ee0 0x7f96b019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96b5200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b019f340 con 0x7f96b00685c0 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96b5200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0198920 con 0x7f96b0068ee0 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96af400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96af400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53452/0 (socket says 172.21.15.55:53452) 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.995+0000 7f96af400700 1 -- 172.21.15.55:0/880990500 learned_addr learned my addr 172.21.15.55:0/880990500 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96a7e00700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b0068ee0 0x7f96b019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96af400700 1 -- 172.21.15.55:0/880990500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b0068ee0 msgr2=0x7f96b019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96af400700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b0068ee0 0x7f96b019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96af400700 1 -- 172.21.15.55:0/880990500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980095f0 con 0x7f96b00685c0 2024-04-26T21:14:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96af400700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c8a0 tx=0x7f96a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.996+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a000cea0 con 0x7f96b00685c0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.997+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a0004830 con 0x7f96b00685c0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.997+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b0198c00 con 0x7f96b00685c0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.997+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a00055b0 con 0x7f96b00685c0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.997+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b01991d0 con 0x7f96b00685c0 2024-04-26T21:14:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.998+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b00fff40 con 0x7f96b00685c0 2024-04-26T21:14:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:34.999+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f96a00049a0 con 0x7f96b00685c0 2024-04-26T21:14:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.000+0000 7f96acc00700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 0x7f96940712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.000+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f96a008ed20 con 0x7f96b00685c0 2024-04-26T21:14:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.001+0000 7f96a7e00700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 0x7f96940712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.001+0000 7f96a7e00700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 0x7f96940712b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96b0199ae0 tx=0x7f9698005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.005+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f96a005b490 con 0x7f96b00685c0 2024-04-26T21:14:35.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.276+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f96b010fdf0 con 0x7f96b00685c0 2024-04-26T21:14:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.278+0000 7f96acc00700 1 -- 172.21.15.55:0/880990500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f96a001d780 con 0x7f96b00685c0 2024-04-26T21:14:35.280 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:14:35.280 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:14:35.281 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:14:35.282 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:14:35.283 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:35.284 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:14:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 msgr2=0x7f96940712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 0x7f96940712b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96b0199ae0 tx=0x7f9698005a90 comp rx=0 tx=0).stop 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 msgr2=0x7f96b019e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c8a0 tx=0x7f96a000cc60 comp rx=0 tx=0).stop 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 shutdown_connections 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b00685c0 0x7f96b019e7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969406edf0 0x7f96940712b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 --2- 172.21.15.55:0/880990500 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b0068ee0 0x7f96b019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.281+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 >> 172.21.15.55:0/880990500 conn(0x7f96b0075460 msgr2=0x7f96b01097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.282+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 shutdown_connections 2024-04-26T21:14:35.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.282+0000 7f96b5200700 1 -- 172.21.15.55:0/880990500 wait complete. 2024-04-26T21:14:35.286 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:14:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:35 smithi064 ceph-mon[84240]: pgmap v44: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:35 smithi064 ceph-mon[84240]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:35.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:35 smithi064 ceph-mon[84240]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:35.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:35 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3868752629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 -- 172.21.15.55:0/3843678891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 msgr2=0x7f1640107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 --2- 172.21.15.55:0/3843678891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f1640107a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f162c009910 tx=0x7f162c009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 -- 172.21.15.55:0/3843678891 shutdown_connections 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 --2- 172.21.15.55:0/3843678891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f1640107a30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 --2- 172.21.15.55:0/3843678891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 0x7f1640103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 -- 172.21.15.55:0/3843678891 >> 172.21.15.55:0/3843678891 conn(0x7f16400fe880 msgr2=0x7f1640100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 -- 172.21.15.55:0/3843678891 shutdown_connections 2024-04-26T21:14:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.447+0000 7f1646600700 1 -- 172.21.15.55:0/3843678891 wait complete. 2024-04-26T21:14:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.448+0000 7f1646600700 1 Processor -- start 2024-04-26T21:14:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f1646600700 1 -- start start 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f1646600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 0x7f164019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f1646600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f1646600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164019f530 con 0x7f16401039e0 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f1646600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640198b10 con 0x7f1640103030 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f163ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f163ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53482/0 (socket says 172.21.15.55:53482) 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f163ea00700 1 -- 172.21.15.55:0/1248733903 learned_addr learned my addr 172.21.15.55:0/1248733903 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:35.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.449+0000 7f163f400700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 0x7f164019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.450+0000 7f163ea00700 1 -- 172.21.15.55:0/1248733903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 msgr2=0x7f164019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.450+0000 7f163ea00700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 0x7f164019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.450+0000 7f163ea00700 1 -- 172.21.15.55:0/1248733903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0095f0 con 0x7f16401039e0 2024-04-26T21:14:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.450+0000 7f163ea00700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f162c005b40 tx=0x7f162c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.450+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f162c01d070 con 0x7f16401039e0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.451+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f162c005700 con 0x7f16401039e0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.451+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1640198d90 con 0x7f16401039e0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.451+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1640199280 con 0x7f16401039e0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.451+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f162c00fd60 con 0x7f16401039e0 2024-04-26T21:14:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.452+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164010b380 con 0x7f16401039e0 2024-04-26T21:14:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.453+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f162c00f560 con 0x7f16401039e0 2024-04-26T21:14:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.454+0000 7f1637e00700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 0x7f16240712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.454+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f162c090410 con 0x7f16401039e0 2024-04-26T21:14:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.454+0000 7f163f400700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 0x7f16240712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.455+0000 7f163f400700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 0x7f16240712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1630005950 tx=0x7f163000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.459+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f162c05cb60 con 0x7f16401039e0 2024-04-26T21:14:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:35 smithi055 ceph-mon[109028]: pgmap v44: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:35 smithi055 ceph-mon[109028]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:35 smithi055 ceph-mon[109028]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:35 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3868752629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:35.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.712+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f164019a040 con 0x7f162406edf0 2024-04-26T21:14:35.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.715+0000 7f1637e00700 1 -- 172.21.15.55:0/1248733903 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f164019a040 con 0x7f162406edf0 2024-04-26T21:14:35.716 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:14:35.716 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:14:35.716 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "4/23 daemons upgraded", 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mon daemons", 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:14:35.717 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 msgr2=0x7f16240712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 0x7f16240712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1630005950 tx=0x7f163000b410 comp rx=0 tx=0).stop 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 msgr2=0x7f164019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f162c005b40 tx=0x7f162c00bd70 comp rx=0 tx=0).stop 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 shutdown_connections 2024-04-26T21:14:35.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f162406edf0 0x7f16240712b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1640103030 0x7f164019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 --2- 172.21.15.55:0/1248733903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16401039e0 0x7f164019ef10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.717+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 >> 172.21.15.55:0/1248733903 conn(0x7f16400fe880 msgr2=0x7f16400ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.718+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 shutdown_connections 2024-04-26T21:14:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.718+0000 7f1646600700 1 -- 172.21.15.55:0/1248733903 wait complete. 2024-04-26T21:14:35.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.879+0000 7f0e24e00700 1 -- 172.21.15.55:0/4130669381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e201017c0 msgr2=0x7f0e20105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.879+0000 7f0e24e00700 1 --2- 172.21.15.55:0/4130669381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e201017c0 0x7f0e20105810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009910 tx=0x7f0e0c009c20 comp rx=0 tx=0).stop 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 -- 172.21.15.55:0/4130669381 shutdown_connections 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 --2- 172.21.15.55:0/4130669381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e201017c0 0x7f0e20105810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 --2- 172.21.15.55:0/4130669381 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e20100e10 0x7f0e201011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 -- 172.21.15.55:0/4130669381 >> 172.21.15.55:0/4130669381 conn(0x7f0e200fc6e0 msgr2=0x7f0e200feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 -- 172.21.15.55:0/4130669381 shutdown_connections 2024-04-26T21:14:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.880+0000 7f0e24e00700 1 -- 172.21.15.55:0/4130669381 wait complete. 2024-04-26T21:14:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.881+0000 7f0e24e00700 1 Processor -- start 2024-04-26T21:14:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e24e00700 1 -- start start 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e24e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e24e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e201017c0 0x7f0e2019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e24e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2019d380 con 0x7f0e20100e10 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e24e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e201969b0 con 0x7f0e201017c0 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e1de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e1de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53508/0 (socket says 172.21.15.55:53508) 2024-04-26T21:14:35.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.882+0000 7f0e1de00700 1 -- 172.21.15.55:0/381357945 learned_addr learned my addr 172.21.15.55:0/381357945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.883+0000 7f0e1de00700 1 -- 172.21.15.55:0/381357945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e201017c0 msgr2=0x7f0e2019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.883+0000 7f0e1de00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e201017c0 0x7f0e2019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.883+0000 7f0e1de00700 1 -- 172.21.15.55:0/381357945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0095f0 con 0x7f0e20100e10 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.883+0000 7f0e1de00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d8d0 tx=0x7f0e1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.884+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e10009940 con 0x7f0e20100e10 2024-04-26T21:14:35.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.884+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e10010460 con 0x7f0e20100e10 2024-04-26T21:14:35.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.884+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e20196c90 con 0x7f0e20100e10 2024-04-26T21:14:35.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.884+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e1000f5f0 con 0x7f0e20100e10 2024-04-26T21:14:35.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.884+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e201971e0 con 0x7f0e20100e10 2024-04-26T21:14:35.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.886+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20109210 con 0x7f0e20100e10 2024-04-26T21:14:35.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.886+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f0e100105d0 con 0x7f0e20100e10 2024-04-26T21:14:35.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.887+0000 7f0e16a00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 0x7f0e040712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:14:35.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.888+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0e1008efe0 con 0x7f0e20100e10 2024-04-26T21:14:35.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.888+0000 7f0e1d400700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 0x7f0e040712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:14:35.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.889+0000 7f0e1d400700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 0x7f0e040712b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c006010 tx=0x7f0e0c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:14:35.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:35.892+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0e100c4060 con 0x7f0e20100e10 2024-04-26T21:14:36.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.222+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0e20197e20 con 0x7f0e20100e10 2024-04-26T21:14:36.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.223+0000 7f0e16a00700 1 -- 172.21.15.55:0/381357945 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0e1005b730 con 0x7f0e20100e10 2024-04-26T21:14:36.224 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 msgr2=0x7f0e040712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 0x7f0e040712b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c006010 tx=0x7f0e0c00b540 comp rx=0 tx=0).stop 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 msgr2=0x7f0e2019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d8d0 tx=0x7f0e1000dc90 comp rx=0 tx=0).stop 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 shutdown_connections 2024-04-26T21:14:36.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e20100e10 0x7f0e2019c820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:36.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0e0406edf0 0x7f0e040712b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:36.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 --2- 172.21.15.55:0/381357945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e201017c0 0x7f0e2019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:14:36.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.225+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 >> 172.21.15.55:0/381357945 conn(0x7f0e200fc6e0 msgr2=0x7f0e200fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:14:36.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.226+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 shutdown_connections 2024-04-26T21:14:36.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:14:36.226+0000 7f0e24e00700 1 -- 172.21.15.55:0/381357945 wait complete. 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/880990500' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: Reconfiguring mds.cephfs.smithi064.xrdyeb (monmap changed)... 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: Reconfiguring daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:14:36.334 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:36 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/381357945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/880990500' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: Reconfiguring mds.cephfs.smithi064.xrdyeb (monmap changed)... 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: Reconfiguring daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:14:36.486 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:36 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/381357945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:14:37.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:37 smithi064 ceph-mon[84240]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:37.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:37 smithi064 ceph-mon[84240]: pgmap v45: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:37.620 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:37 smithi055 ceph-mon[109028]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:14:37.620 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:37 smithi055 ceph-mon[109028]: pgmap v45: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: pgmap v46: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all mon 2024-04-26T21:14:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:38.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi055"}]: dispatch 2024-04-26T21:14:38.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi055"}]': finished 2024-04-26T21:14:38.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]: dispatch 2024-04-26T21:14:38.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]': finished 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: pgmap v46: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:39.160 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all mon 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi055"}]: dispatch 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi055"}]': finished 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]: dispatch 2024-04-26T21:14:39.161 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi064"}]': finished 2024-04-26T21:14:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:40 smithi064 ceph-mon[84240]: pgmap v47: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:40 smithi055 ceph-mon[109028]: pgmap v47: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi055", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:42.136 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:41 smithi055 ceph-mon[109028]: Upgrade: Updating crash.smithi055 (1/2) 2024-04-26T21:14:42.137 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:41 smithi055 ceph-mon[109028]: Deploying daemon crash.smithi055 on smithi055 2024-04-26T21:14:42.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:41 smithi064 ceph-mon[84240]: Upgrade: Updating crash.smithi055 (1/2) 2024-04-26T21:14:42.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:41 smithi064 ceph-mon[84240]: Deploying daemon crash.smithi055 on smithi055 2024-04-26T21:14:43.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:42 smithi064 ceph-mon[84240]: pgmap v48: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:43.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:42 smithi055 ceph-mon[109028]: pgmap v48: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:45.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:44 smithi064 ceph-mon[84240]: pgmap v49: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:45.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:44 smithi064 ceph-mon[84240]: mgrmap e38: smithi055.ybbowr(active, since 92s), standbys: smithi064.tchyje 2024-04-26T21:14:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:44 smithi055 ceph-mon[109028]: pgmap v49: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:44 smithi055 ceph-mon[109028]: mgrmap e38: smithi055.ybbowr(active, since 92s), standbys: smithi064.tchyje 2024-04-26T21:14:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:47 smithi055 ceph-mon[109028]: pgmap v50: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:47.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:47.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:47.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:47 smithi064 ceph-mon[84240]: pgmap v50: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:47.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:47.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:49 smithi064 ceph-mon[84240]: pgmap v51: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:49 smithi055 ceph-mon[109028]: pgmap v51: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi064", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-26T21:14:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:50.566 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:50 smithi064 ceph-mon[84240]: Upgrade: Updating crash.smithi064 (2/2) 2024-04-26T21:14:50.566 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:50 smithi064 ceph-mon[84240]: Deploying daemon crash.smithi064 on smithi064 2024-04-26T21:14:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:50 smithi055 ceph-mon[109028]: Upgrade: Updating crash.smithi064 (2/2) 2024-04-26T21:14:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:50 smithi055 ceph-mon[109028]: Deploying daemon crash.smithi064 on smithi064 2024-04-26T21:14:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:51 smithi064 ceph-mon[84240]: pgmap v52: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:51.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:51 smithi055 ceph-mon[109028]: pgmap v52: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:53.545 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:53 smithi064 ceph-mon[84240]: pgmap v53: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:53 smithi055 ceph-mon[109028]: pgmap v53: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:14:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:55 smithi064 ceph-mon[84240]: pgmap v54: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:55 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:55.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:55 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:55.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:55 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:55 smithi055 ceph-mon[109028]: pgmap v54: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:14:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:55 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:55 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:14:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:55 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:57.563 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:57 smithi055 ceph-mon[109028]: pgmap v55: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:57.563 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:57 smithi064 ceph-mon[84240]: pgmap v55: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:57.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:14:59.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:14:59 smithi064 ceph-mon[84240]: pgmap v56: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:14:59.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:14:59 smithi055 ceph-mon[109028]: pgmap v56: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:00 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:00 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:00.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:00 smithi064 ceph-mon[84240]: pgmap v57: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:01.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:00 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:01.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:00 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:01.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:00 smithi055 ceph-mon[109028]: pgmap v57: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:03.022 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:02 smithi064 ceph-mon[84240]: pgmap v58: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:03.022 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.022 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.022 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.022 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:02 smithi055 ceph-mon[109028]: pgmap v58: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:04.800 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:04 smithi064 ceph-mon[84240]: pgmap v59: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:04 smithi055 ceph-mon[109028]: pgmap v59: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:06.074 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:05 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:06.074 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:05 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:05 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:06.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:05 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:06.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.419+0000 7f524e200700 1 -- 172.21.15.55:0/3872204088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 msgr2=0x7f5248102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.419+0000 7f524e200700 1 --2- 172.21.15.55:0/3872204088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f5248102140 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5238009910 tx=0x7f5238009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:06.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 -- 172.21.15.55:0/3872204088 shutdown_connections 2024-04-26T21:15:06.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 --2- 172.21.15.55:0/3872204088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 0x7f524810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 --2- 172.21.15.55:0/3872204088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f5248102140 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 -- 172.21.15.55:0/3872204088 >> 172.21.15.55:0/3872204088 conn(0x7f5248076740 msgr2=0x7f52480fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:06.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 -- 172.21.15.55:0/3872204088 shutdown_connections 2024-04-26T21:15:06.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.420+0000 7f524e200700 1 -- 172.21.15.55:0/3872204088 wait complete. 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.421+0000 7f524e200700 1 Processor -- start 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f524e200700 1 -- start start 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f524e200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f524e200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 0x7f524819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f524e200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524819d3a0 con 0x7f5248101d60 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f524e200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248196980 con 0x7f5248102680 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.422+0000 7f5247400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f5247400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42756/0 (socket says 172.21.15.55:42756) 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f5247400700 1 -- 172.21.15.55:0/2114268224 learned_addr learned my addr 172.21.15.55:0/2114268224 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f523ea00700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 0x7f524819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f5247400700 1 -- 172.21.15.55:0/2114268224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 msgr2=0x7f524819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f5247400700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 0x7f524819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.423+0000 7f5247400700 1 -- 172.21.15.55:0/2114268224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380095f0 con 0x7f5248101d60 2024-04-26T21:15:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f5247400700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52380092e0 tx=0x7f523800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523801d070 con 0x7f5248101d60 2024-04-26T21:15:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52380052a0 con 0x7f5248101d60 2024-04-26T21:15:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5238017400 con 0x7f5248101d60 2024-04-26T21:15:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5248196c00 con 0x7f5248101d60 2024-04-26T21:15:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.424+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52481970f0 con 0x7f5248101d60 2024-04-26T21:15:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.426+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248105480 con 0x7f5248101d60 2024-04-26T21:15:06.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.426+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5238003710 con 0x7f5248101d60 2024-04-26T21:15:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.428+0000 7f5244c00700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 0x7f522c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.428+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f523808ffc0 con 0x7f5248101d60 2024-04-26T21:15:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.429+0000 7f523ea00700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 0x7f522c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.430+0000 7f523ea00700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 0x7f522c071190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5248197b40 tx=0x7f523000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:06.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.433+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f52380c5060 con 0x7f5248101d60 2024-04-26T21:15:06.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.706+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5248197eb0 con 0x7f522c06ecd0 2024-04-26T21:15:06.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.708+0000 7f5244c00700 1 -- 172.21.15.55:0/2114268224 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f5248197eb0 con 0x7f522c06ecd0 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 msgr2=0x7f522c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 0x7f522c071190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5248197b40 tx=0x7f523000b040 comp rx=0 tx=0).stop 2024-04-26T21:15:06.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 msgr2=0x7f524819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52380092e0 tx=0x7f523800b610 comp rx=0 tx=0).stop 2024-04-26T21:15:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 shutdown_connections 2024-04-26T21:15:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5248101d60 0x7f524819c840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f522c06ecd0 0x7f522c071190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 --2- 172.21.15.55:0/2114268224 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5248102680 0x7f524819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 >> 172.21.15.55:0/2114268224 conn(0x7f5248076740 msgr2=0x7f5248103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 shutdown_connections 2024-04-26T21:15:06.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.711+0000 7f524e200700 1 -- 172.21.15.55:0/2114268224 wait complete. 2024-04-26T21:15:06.730 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:15:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 -- 172.21.15.55:0/2372168465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 msgr2=0x7ff350102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 --2- 172.21.15.55:0/2372168465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350102140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff340009910 tx=0x7ff340009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:06.886 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:06 smithi055 ceph-mon[109028]: pgmap v60: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 -- 172.21.15.55:0/2372168465 shutdown_connections 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 --2- 172.21.15.55:0/2372168465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 0x7ff35010ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 --2- 172.21.15.55:0/2372168465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350102140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 -- 172.21.15.55:0/2372168465 >> 172.21.15.55:0/2372168465 conn(0x7ff350076740 msgr2=0x7ff3500fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.884+0000 7ff357000700 1 -- 172.21.15.55:0/2372168465 shutdown_connections 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.885+0000 7ff357000700 1 -- 172.21.15.55:0/2372168465 wait complete. 2024-04-26T21:15:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.886+0000 7ff357000700 1 Processor -- start 2024-04-26T21:15:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.886+0000 7ff357000700 1 -- start start 2024-04-26T21:15:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff357000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff357000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 0x7ff3501992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff357000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350199980 con 0x7ff350101d60 2024-04-26T21:15:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff357000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35019d650 con 0x7ff350102680 2024-04-26T21:15:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff34fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff34fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42786/0 (socket says 172.21.15.55:42786) 2024-04-26T21:15:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.887+0000 7ff34fe00700 1 -- 172.21.15.55:0/3739132343 learned_addr learned my addr 172.21.15.55:0/3739132343 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:06.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.888+0000 7ff34f400700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 0x7ff3501992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.888+0000 7ff34fe00700 1 -- 172.21.15.55:0/3739132343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 msgr2=0x7ff3501992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.888+0000 7ff34fe00700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 0x7ff3501992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.888+0000 7ff34fe00700 1 -- 172.21.15.55:0/3739132343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400095f0 con 0x7ff350101d60 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.888+0000 7ff34fe00700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff340006010 tx=0x7ff34000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.889+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34001d070 con 0x7ff350101d60 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.889+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3400056e0 con 0x7ff350101d60 2024-04-26T21:15:06.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.889+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34000fdf0 con 0x7ff350101d60 2024-04-26T21:15:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.889+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35019d8d0 con 0x7ff350101d60 2024-04-26T21:15:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.889+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35019ddc0 con 0x7ff350101d60 2024-04-26T21:15:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.890+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3501096d0 con 0x7ff350101d60 2024-04-26T21:15:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.892+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff34000f5f0 con 0x7ff350101d60 2024-04-26T21:15:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.893+0000 7ff34cc00700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 0x7ff334071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.894+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff340090120 con 0x7ff350101d60 2024-04-26T21:15:06.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.894+0000 7ff34f400700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 0x7ff334071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:06.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.895+0000 7ff34f400700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 0x7ff334071180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff35019a2c0 tx=0x7ff33c00b360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:06.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:06.903+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff340058f80 con 0x7ff350101d60 2024-04-26T21:15:07.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:06 smithi064 ceph-mon[84240]: pgmap v60: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.175+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff35019a150 con 0x7ff33406ecc0 2024-04-26T21:15:07.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.177+0000 7ff34cc00700 1 -- 172.21.15.55:0/3739132343 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7ff35019a150 con 0x7ff33406ecc0 2024-04-26T21:15:07.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.179+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 msgr2=0x7ff334071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.179+0000 7ff357000700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 0x7ff334071180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff35019a2c0 tx=0x7ff33c00b360 comp rx=0 tx=0).stop 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.179+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 msgr2=0x7ff350198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.179+0000 7ff357000700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff340006010 tx=0x7ff34000bd70 comp rx=0 tx=0).stop 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 shutdown_connections 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff350101d60 0x7ff350198d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff33406ecc0 0x7ff334071180 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 --2- 172.21.15.55:0/3739132343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff350102680 0x7ff3501992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 >> 172.21.15.55:0/3739132343 conn(0x7ff350076740 msgr2=0x7ff35010a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 shutdown_connections 2024-04-26T21:15:07.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.180+0000 7ff357000700 1 -- 172.21.15.55:0/3739132343 wait complete. 2024-04-26T21:15:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 -- 172.21.15.55:0/76563316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 msgr2=0x7fc40010ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 --2- 172.21.15.55:0/76563316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc40010ceb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009910 tx=0x7fc3ec009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 -- 172.21.15.55:0/76563316 shutdown_connections 2024-04-26T21:15:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 --2- 172.21.15.55:0/76563316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc40010ceb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 --2- 172.21.15.55:0/76563316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 0x7fc4000736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 -- 172.21.15.55:0/76563316 >> 172.21.15.55:0/76563316 conn(0x7fc4000fc6e0 msgr2=0x7fc4000feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.347+0000 7fc407a00700 1 -- 172.21.15.55:0/76563316 shutdown_connections 2024-04-26T21:15:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.348+0000 7fc407a00700 1 -- 172.21.15.55:0/76563316 wait complete. 2024-04-26T21:15:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 Processor -- start 2024-04-26T21:15:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 -- start start 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 0x7fc400198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4001998d0 con 0x7fc400073c30 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.349+0000 7fc407a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40019c540 con 0x7fc400073310 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42798/0 (socket says 172.21.15.55:42798) 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 -- 172.21.15.55:0/3266039620 learned_addr learned my addr 172.21.15.55:0/3266039620 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc405000700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 0x7fc400198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 -- 172.21.15.55:0/3266039620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 msgr2=0x7fc400198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 0x7fc400198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.350+0000 7fc3ffe00700 1 -- 172.21.15.55:0/3266039620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0095f0 con 0x7fc400073c30 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc3ffe00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0092e0 tx=0x7fc3ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec01d070 con 0x7fc400073c30 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3ec0056e0 con 0x7fc400073c30 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40019c7c0 con 0x7fc400073c30 2024-04-26T21:15:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec00fe80 con 0x7fc400073c30 2024-04-26T21:15:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.351+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40019ccb0 con 0x7fc400073c30 2024-04-26T21:15:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.353+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4000749c0 con 0x7fc400073c30 2024-04-26T21:15:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.354+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc3ec00f6f0 con 0x7fc400073c30 2024-04-26T21:15:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.355+0000 7fc3fd600700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 0x7fc3e8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.355+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc3ec090110 con 0x7fc400073c30 2024-04-26T21:15:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.355+0000 7fc405000700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 0x7fc3e8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.356+0000 7fc405000700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 0x7fc3e8071190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4005950 tx=0x7fc3f40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.359+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc3ec058ff0 con 0x7fc400073c30 2024-04-26T21:15:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.603+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4001077f0 con 0x7fc3e806ecd0 2024-04-26T21:15:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.624+0000 7fc3fd600700 1 -- 172.21.15.55:0/3266039620 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc3f400b8f0 con 0x7fc3e806ecd0 2024-04-26T21:15:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:15:07.626 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (4m) 5s ago 18m 13.9M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (18m) 5s ago 18m 8468k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (17m) 7s ago 17m 8300k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (21s) 5s ago 18m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (13s) 7s ago 17m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (3m) 5s ago 18m 73.9M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (11m) 5s ago 11m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (10m) 5s ago 10m 17.6M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (11m) 7s ago 11m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (10m) 7s ago 10m 17.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (7m) 5s ago 20m 498M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:15:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (5m) 7s ago 17m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (2m) 5s ago 20m 47.5M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (88s) 7s ago 17m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (5m) 5s ago 18m 7926k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (5m) 7s ago 17m 7499k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (16m) 5s ago 16m 258M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb efe3bb997438 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (15m) 5s ago 15m 269M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (14m) 5s ago 14m 229M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (14m) 7s ago 14m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (13m) 7s ago 13m 274M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (12m) 7s ago 12m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:15:07.628 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (4m) 5s ago 17m 67.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:15:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 msgr2=0x7fc3e8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 0x7fc3e8071190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4005950 tx=0x7fc3f40058e0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 msgr2=0x7fc400199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0092e0 tx=0x7fc3ec00be20 comp rx=0 tx=0).stop 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 shutdown_connections 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3e806ecd0 0x7fc3e8071190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc400073310 0x7fc400198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 --2- 172.21.15.55:0/3266039620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc400073c30 0x7fc400199240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 >> 172.21.15.55:0/3266039620 conn(0x7fc4000fc6e0 msgr2=0x7fc400105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 shutdown_connections 2024-04-26T21:15:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.628+0000 7fc407a00700 1 -- 172.21.15.55:0/3266039620 wait complete. 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 -- 172.21.15.55:0/2992416742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 msgr2=0x7fdf54068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 --2- 172.21.15.55:0/2992416742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf54068a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009910 tx=0x7fdf40009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 -- 172.21.15.55:0/2992416742 shutdown_connections 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 --2- 172.21.15.55:0/2992416742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf54068a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 --2- 172.21.15.55:0/2992416742 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 0x7fdf54106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 -- 172.21.15.55:0/2992416742 >> 172.21.15.55:0/2992416742 conn(0x7fdf54075460 msgr2=0x7fdf54075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 -- 172.21.15.55:0/2992416742 shutdown_connections 2024-04-26T21:15:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.786+0000 7fdf59400700 1 -- 172.21.15.55:0/2992416742 wait complete. 2024-04-26T21:15:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.787+0000 7fdf59400700 1 Processor -- start 2024-04-26T21:15:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.787+0000 7fdf59400700 1 -- start start 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf59400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf59400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 0x7fdf54100090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf59400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf54101ad0 con 0x7fdf540685c0 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf59400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541005d0 con 0x7fdf54106b20 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf53e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf53e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42810/0 (socket says 172.21.15.55:42810) 2024-04-26T21:15:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf53e00700 1 -- 172.21.15.55:0/887893771 learned_addr learned my addr 172.21.15.55:0/887893771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.788+0000 7fdf53400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 0x7fdf54100090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf53e00700 1 -- 172.21.15.55:0/887893771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 msgr2=0x7fdf54100090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf53e00700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 0x7fdf54100090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf53e00700 1 -- 172.21.15.55:0/887893771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400095f0 con 0x7fdf540685c0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf53e00700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c930 tx=0x7fdf4400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf44007ad0 con 0x7fdf540685c0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf541008b0 con 0x7fdf540685c0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf44007c30 con 0x7fdf540685c0 2024-04-26T21:15:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.789+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf44018610 con 0x7fdf540685c0 2024-04-26T21:15:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.790+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf541a2dd0 con 0x7fdf540685c0 2024-04-26T21:15:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.791+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf54103d50 con 0x7fdf540685c0 2024-04-26T21:15:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.792+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdf4400f450 con 0x7fdf540685c0 2024-04-26T21:15:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.793+0000 7fdf50c00700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 0x7fdf38071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.793+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdf4408efa0 con 0x7fdf540685c0 2024-04-26T21:15:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.793+0000 7fdf53400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 0x7fdf38071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.794+0000 7fdf53400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 0x7fdf38071180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf40005f50 tx=0x7fdf4001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:07.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:07.798+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdf44057de0 con 0x7fdf540685c0 2024-04-26T21:15:07.874 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:07 smithi055 ceph-mon[109028]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:07.874 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:07 smithi055 ceph-mon[109028]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:08.044 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:07 smithi064 ceph-mon[84240]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:08.044 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:07 smithi064 ceph-mon[84240]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:08.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.120+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdf54100fe0 con 0x7fdf540685c0 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.121+0000 7fdf50c00700 1 -- 172.21.15.55:0/887893771 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fdf4405b4a0 con 0x7fdf540685c0 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:15:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 10, 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:15:08.124 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 msgr2=0x7fdf38071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 0x7fdf38071180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf40005f50 tx=0x7fdf4001a040 comp rx=0 tx=0).stop 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 msgr2=0x7fdf540ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c930 tx=0x7fdf4400ccf0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 shutdown_connections 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf540685c0 0x7fdf540ffb50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf3806ecc0 0x7fdf38071180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 --2- 172.21.15.55:0/887893771 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf54106b20 0x7fdf54100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.125+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 >> 172.21.15.55:0/887893771 conn(0x7fdf54075460 msgr2=0x7fdf540fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.126+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 shutdown_connections 2024-04-26T21:15:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.126+0000 7fdf59400700 1 -- 172.21.15.55:0/887893771 wait complete. 2024-04-26T21:15:08.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 -- 172.21.15.55:0/3459162259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8458103030 msgr2=0x7f8458103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 --2- 172.21.15.55:0/3459162259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8458103030 0x7f8458103410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f844c009910 tx=0x7f844c009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 -- 172.21.15.55:0/3459162259 shutdown_connections 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 --2- 172.21.15.55:0/3459162259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84581039e0 0x7f8458107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 --2- 172.21.15.55:0/3459162259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8458103030 0x7f8458103410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.275+0000 7f845fc00700 1 -- 172.21.15.55:0/3459162259 >> 172.21.15.55:0/3459162259 conn(0x7f84580fe880 msgr2=0x7f8458100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.276+0000 7f845fc00700 1 -- 172.21.15.55:0/3459162259 shutdown_connections 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.276+0000 7f845fc00700 1 -- 172.21.15.55:0/3459162259 wait complete. 2024-04-26T21:15:08.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.277+0000 7f845fc00700 1 Processor -- start 2024-04-26T21:15:08.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.277+0000 7f845fc00700 1 -- start start 2024-04-26T21:15:08.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f845fc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8458103030 0x7f8458198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f845fc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f845fc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458199a40 con 0x7f84581039e0 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f845fc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845819d710 con 0x7f8458103030 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f8457e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f8457e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42836/0 (socket says 172.21.15.55:42836) 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.278+0000 7f8457e00700 1 -- 172.21.15.55:0/2559266649 learned_addr learned my addr 172.21.15.55:0/2559266649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.279+0000 7f8457e00700 1 -- 172.21.15.55:0/2559266649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8458103030 msgr2=0x7f8458198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.279+0000 7f8457e00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8458103030 0x7f8458198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.279+0000 7f8457e00700 1 -- 172.21.15.55:0/2559266649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0095f0 con 0x7f84581039e0 2024-04-26T21:15:08.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.279+0000 7f8457e00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f844800b480 tx=0x7f844800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:08.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.280+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84480118c0 con 0x7f84581039e0 2024-04-26T21:15:08.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.280+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8448010380 con 0x7f84581039e0 2024-04-26T21:15:08.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.280+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800f4f0 con 0x7f84581039e0 2024-04-26T21:15:08.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.280+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845819d9f0 con 0x7f84581039e0 2024-04-26T21:15:08.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.280+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845819df40 con 0x7f84581039e0 2024-04-26T21:15:08.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.281+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845810b3d0 con 0x7f84581039e0 2024-04-26T21:15:08.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.282+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f84480104f0 con 0x7f84581039e0 2024-04-26T21:15:08.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.284+0000 7f8455600700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 0x7f8440071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.284+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f844808e9b0 con 0x7f84581039e0 2024-04-26T21:15:08.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.284+0000 7f845d200700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 0x7f8440071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:08.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.285+0000 7f845d200700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 0x7f8440071180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b5c0 tx=0x7f844c005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:08.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.288+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f84480577f0 con 0x7f84581039e0 2024-04-26T21:15:08.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.563+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8458104510 con 0x7f84581039e0 2024-04-26T21:15:08.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.564+0000 7f8455600700 1 -- 172.21.15.55:0/2559266649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f8448015780 con 0x7f84581039e0 2024-04-26T21:15:08.566 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:15:08.566 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:15:08.567 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:15:08.568 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:08.569 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 msgr2=0x7f8440071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 0x7f8440071180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b5c0 tx=0x7f844c005e20 comp rx=0 tx=0).stop 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 msgr2=0x7f8458199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f844800b480 tx=0x7f844800b840 comp rx=0 tx=0).stop 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 shutdown_connections 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f844006ecc0 0x7f8440071180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8458103030 0x7f8458198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 --2- 172.21.15.55:0/2559266649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84581039e0 0x7f8458199360 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 >> 172.21.15.55:0/2559266649 conn(0x7f84580fe880 msgr2=0x7f84580fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:08.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.568+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 shutdown_connections 2024-04-26T21:15:08.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.569+0000 7f845fc00700 1 -- 172.21.15.55:0/2559266649 wait complete. 2024-04-26T21:15:08.571 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:15:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 -- 172.21.15.55:0/2801354909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 msgr2=0x7f52f810ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 --2- 172.21.15.55:0/2801354909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f810ab70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009910 tx=0x7f52e4009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 -- 172.21.15.55:0/2801354909 shutdown_connections 2024-04-26T21:15:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 --2- 172.21.15.55:0/2801354909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f810ab70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 --2- 172.21.15.55:0/2801354909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f8102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 -- 172.21.15.55:0/2801354909 >> 172.21.15.55:0/2801354909 conn(0x7f52f8076740 msgr2=0x7f52f80fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.730+0000 7f52fda00700 1 -- 172.21.15.55:0/2801354909 shutdown_connections 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.731+0000 7f52fda00700 1 -- 172.21.15.55:0/2801354909 wait complete. 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.731+0000 7f52fda00700 1 Processor -- start 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52fda00700 1 -- start start 2024-04-26T21:15:08.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52fda00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52fda00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52fda00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f819d380 con 0x7f52f8102680 2024-04-26T21:15:08.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52fda00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f8196960 con 0x7f52f8101d60 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52f6000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52f6000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42846/0 (socket says 172.21.15.55:42846) 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.732+0000 7f52f6000700 1 -- 172.21.15.55:0/1183856906 learned_addr learned my addr 172.21.15.55:0/1183856906 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6a00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6000700 1 -- 172.21.15.55:0/1183856906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 msgr2=0x7f52f819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6000700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6000700 1 -- 172.21.15.55:0/1183856906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40095f0 con 0x7f52f8102680 2024-04-26T21:15:08.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6a00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52f6000700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005b40 tx=0x7f52e400bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.733+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e401d070 con 0x7f52f8102680 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.734+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52e4003d50 con 0x7f52f8102680 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.734+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e400fe90 con 0x7f52f8102680 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.734+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8196be0 con 0x7f52f8102680 2024-04-26T21:15:08.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.734+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f81970d0 con 0x7f52f8102680 2024-04-26T21:15:08.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.735+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f8105480 con 0x7f52f8102680 2024-04-26T21:15:08.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.736+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f52e4003890 con 0x7f52f8102680 2024-04-26T21:15:08.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.737+0000 7f52ef400700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 0x7f52dc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:08.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.737+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f52e4090280 con 0x7f52f8102680 2024-04-26T21:15:08.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.737+0000 7f52f6a00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 0x7f52dc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:08.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.738+0000 7f52f6a00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 0x7f52dc071190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52e8005fd0 tx=0x7f52e8005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:08.742+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f52e405cb70 con 0x7f52f8102680 2024-04-26T21:15:09.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.003+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52f8197e90 con 0x7f52dc06ecd0 2024-04-26T21:15:09.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:09.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: pgmap v61: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:09.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/887893771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:09.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:09.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:09.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:08 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2559266649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:15:09.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.005+0000 7f52ef400700 1 -- 172.21.15.55:0/1183856906 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f52f8197e90 con 0x7f52dc06ecd0 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "6/23 daemons upgraded", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading crash daemons", 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:15:09.007 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:15:09.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.007+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 msgr2=0x7f52dc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.007+0000 7f52fda00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 0x7f52dc071190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52e8005fd0 tx=0x7f52e8005dc0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.007+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 msgr2=0x7f52f819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.007+0000 7f52fda00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005b40 tx=0x7f52e400bc10 comp rx=0 tx=0).stop 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 shutdown_connections 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52dc06ecd0 0x7f52dc071190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52f8101d60 0x7f52f819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 --2- 172.21.15.55:0/1183856906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52f8102680 0x7f52f819cd60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 >> 172.21.15.55:0/1183856906 conn(0x7f52f8076740 msgr2=0x7f52f8103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 shutdown_connections 2024-04-26T21:15:09.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.008+0000 7f52fda00700 1 -- 172.21.15.55:0/1183856906 wait complete. 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: pgmap v61: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/887893771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:09.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:08 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2559266649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 -- 172.21.15.55:0/1454553155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 msgr2=0x7f45a81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 --2- 172.21.15.55:0/1454553155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a81011f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4598009910 tx=0x7f4598009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 -- 172.21.15.55:0/1454553155 shutdown_connections 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 --2- 172.21.15.55:0/1454553155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a8105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 --2- 172.21.15.55:0/1454553155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a81011f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 -- 172.21.15.55:0/1454553155 >> 172.21.15.55:0/1454553155 conn(0x7f45a80fc6e0 msgr2=0x7f45a80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 -- 172.21.15.55:0/1454553155 shutdown_connections 2024-04-26T21:15:09.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.181+0000 7f45ace00700 1 -- 172.21.15.55:0/1454553155 wait complete. 2024-04-26T21:15:09.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.182+0000 7f45ace00700 1 Processor -- start 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.182+0000 7f45ace00700 1 -- start start 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45ace00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45ace00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45ace00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8197700 con 0x7f45a8100e10 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45ace00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8197870 con 0x7f45a81017c0 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45a5e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45a5e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42872/0 (socket says 172.21.15.55:42872) 2024-04-26T21:15:09.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45a5e00700 1 -- 172.21.15.55:0/3769054124 learned_addr learned my addr 172.21.15.55:0/3769054124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.183+0000 7f45a5400700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45a5e00700 1 -- 172.21.15.55:0/3769054124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 msgr2=0x7f45a81970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45a5e00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a81970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45a5e00700 1 -- 172.21.15.55:0/3769054124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980095f0 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45a5400700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45a5e00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45980092e0 tx=0x7f459800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459801d070 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f459800f460 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4598017630 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.184+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a819b4b0 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.185+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a819b9a0 con 0x7f45a8100e10 2024-04-26T21:15:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.186+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a81091b0 con 0x7f45a8100e10 2024-04-26T21:15:09.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.187+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f459800f5d0 con 0x7f45a8100e10 2024-04-26T21:15:09.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.188+0000 7f459ea00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 0x7f458c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:09.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.188+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4598090200 con 0x7f45a8100e10 2024-04-26T21:15:09.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.189+0000 7f45a5400700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 0x7f458c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:09.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.189+0000 7f45a5400700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 0x7f458c071190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f4594005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.194+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f45980590e0 con 0x7f45a8100e10 2024-04-26T21:15:09.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.513+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f45a8197dc0 con 0x7f45a8100e10 2024-04-26T21:15:09.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.513+0000 7f459ea00700 1 -- 172.21.15.55:0/3769054124 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f459805c7a0 con 0x7f45a8100e10 2024-04-26T21:15:09.515 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:15:09.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 msgr2=0x7f458c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 0x7f458c071190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4594005fd0 tx=0x7f4594005e30 comp rx=0 tx=0).stop 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 msgr2=0x7f45a8196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45980092e0 tx=0x7f459800be20 comp rx=0 tx=0).stop 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 shutdown_connections 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45a8100e10 0x7f45a8196b70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f458c06ecd0 0x7f458c071190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 --2- 172.21.15.55:0/3769054124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45a81017c0 0x7f45a81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:09.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.516+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 >> 172.21.15.55:0/3769054124 conn(0x7f45a80fc6e0 msgr2=0x7f45a80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:09.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.517+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 shutdown_connections 2024-04-26T21:15:09.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:09.517+0000 7f45ace00700 1 -- 172.21.15.55:0/3769054124 wait complete. 2024-04-26T21:15:10.064 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:09 smithi055 ceph-mon[109028]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:10.065 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:09 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3769054124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:15:10.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:09 smithi064 ceph-mon[84240]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:10.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:09 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3769054124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:15:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: pgmap v62: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:11.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi055"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi055"}]': finished 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]: dispatch 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]': finished 2024-04-26T21:15:11.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: pgmap v62: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:11.915 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi055"}]: dispatch 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi055"}]': finished 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]: dispatch 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi064"}]': finished 2024-04-26T21:15:11.916 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:15:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:12 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all crash 2024-04-26T21:15:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:12 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:15:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:12 smithi055 ceph-mon[109028]: Upgrade: osd.0 is safe to restart 2024-04-26T21:15:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:12 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all crash 2024-04-26T21:15:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:12 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-26T21:15:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:12 smithi064 ceph-mon[84240]: Upgrade: osd.0 is safe to restart 2024-04-26T21:15:12.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:13.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: pgmap v63: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:13.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: Upgrade: Updating osd.0 2024-04-26T21:15:13.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:13.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:15:13.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:13.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:13 smithi064 ceph-mon[84240]: Deploying daemon osd.0 on smithi055 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: pgmap v63: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: Upgrade: Updating osd.0 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:14.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:13 smithi055 ceph-mon[109028]: Deploying daemon osd.0 on smithi055 2024-04-26T21:15:14.684 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:14 smithi055 ceph-mon[109028]: pgmap v64: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:14.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:14 smithi064 ceph-mon[84240]: pgmap v64: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:16 smithi064 ceph-mon[84240]: pgmap v65: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:17.245 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:16 smithi055 ceph-mon[109028]: pgmap v65: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:18.814 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:18 smithi055 systemd[1]: Stopping Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:15:19.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:18 smithi064 ceph-mon[84240]: pgmap v66: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:18 smithi055 ceph-mon[109028]: pgmap v66: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:19.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:18 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[43835]: 2024-04-26T21:15:18.991+0000 7f6736800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:15:19.256 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:18 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[43835]: 2024-04-26T21:15:18.991+0000 7f6736800700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-26T21:15:19.256 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:18 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[43835]: 2024-04-26T21:15:18.991+0000 7f6736800700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:15:19.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:19 smithi064 ceph-mon[84240]: osd.0 marked itself down and dead 2024-04-26T21:15:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:19 smithi055 ceph-mon[109028]: osd.0 marked itself down and dead 2024-04-26T21:15:20.820 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:20 smithi055 podman[120550]: 2024-04-26 21:15:20.527644146 +0000 UTC m=+1.696147436 container died efe3bb997438e115728585905f82ba534cb7d97c78bc1afa3c40c6a07930bfa1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T21:15:21.086 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:20 smithi055 ceph-mon[109028]: pgmap v67: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:21.086 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:20 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:15:21.086 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:20 smithi055 ceph-mon[109028]: osdmap e50: 6 total, 5 up, 6 in 2024-04-26T21:15:21.086 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:21 smithi055 podman[120550]: 2024-04-26 21:15:21.057747975 +0000 UTC m=+2.226251255 container cleanup efe3bb997438e115728585905f82ba534cb7d97c78bc1afa3c40c6a07930bfa1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, RELEASE=reef-7d2137f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T21:15:21.086 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:21 smithi055 bash[120550]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0 2024-04-26T21:15:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:20 smithi064 ceph-mon[84240]: pgmap v67: 65 pgs: 65 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:20 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:15:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:20 smithi064 ceph-mon[84240]: osdmap e50: 6 total, 5 up, 6 in 2024-04-26T21:15:21.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:21 smithi055 podman[120570]: 2024-04-26 21:15:21.29284782 +0000 UTC m=+0.752086992 container remove efe3bb997438e115728585905f82ba534cb7d97c78bc1afa3c40c6a07930bfa1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, RELEASE=reef-7d2137f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T21:15:22.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:21 smithi064 ceph-mon[84240]: osdmap e51: 6 total, 5 up, 6 in 2024-04-26T21:15:22.193 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:21 smithi055 ceph-mon[109028]: osdmap e51: 6 total, 5 up, 6 in 2024-04-26T21:15:22.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:22 smithi055 podman[120663]: 2024-04-26 21:15:22.097834611 +0000 UTC m=+0.035162572 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:22.506 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:22 smithi055 podman[120663]: 2024-04-26 21:15:22.218975656 +0000 UTC m=+0.156303642 container create 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T21:15:22.847 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:22 smithi055 podman[120663]: 2024-04-26 21:15:22.543649726 +0000 UTC m=+0.480977715 container init 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:15:22.847 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:22 smithi055 podman[120663]: 2024-04-26 21:15:22.556473224 +0000 UTC m=+0.493801173 container start 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T21:15:22.847 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:22 smithi055 podman[120663]: 2024-04-26 21:15:22.651058895 +0000 UTC m=+0.588386948 container attach 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T21:15:23.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:22 smithi064 ceph-mon[84240]: pgmap v70: 65 pgs: 9 stale+active+clean, 56 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:15:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:22 smithi055 ceph-mon[109028]: pgmap v70: 65 pgs: 9 stale+active+clean, 56 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:15:23.256 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:23 smithi055 podman[120663]: 2024-04-26 21:15:23.0245054 +0000 UTC m=+0.961833380 container died 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T21:15:24.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:23 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:24.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:23 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:24.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:23 smithi055 podman[120689]: 2024-04-26 21:15:23.801603362 +0000 UTC m=+0.757381498 container remove 75848721c6f0d7577acd56b59fe476661c88a5af8fb5eace7b6b11a7e6674170 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T21:15:24.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:23 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-26T21:15:24.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:23 smithi055 systemd[1]: Stopped Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:15:24.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:23 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service: Consumed 1min 48.891s CPU time. 2024-04-26T21:15:24.640 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:24 smithi055 systemd[1]: Starting Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:15:24.904 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:24 smithi055 podman[120790]: 2024-04-26 21:15:24.546157488 +0000 UTC m=+0.035973581 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:24.905 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:24 smithi055 podman[120790]: 2024-04-26 21:15:24.686146113 +0000 UTC m=+0.175962215 container create 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T21:15:25.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:24 smithi064 ceph-mon[84240]: pgmap v71: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:24 smithi055 ceph-mon[109028]: pgmap v71: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:25.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:24 smithi055 podman[120790]: 2024-04-26 21:15:24.949124448 +0000 UTC m=+0.438940593 container init 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:15:25.256 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:24 smithi055 podman[120790]: 2024-04-26 21:15:24.961663427 +0000 UTC m=+0.451479502 container start 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:15:25.256 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 podman[120790]: 2024-04-26 21:15:25.089495103 +0000 UTC m=+0.579311255 container attach 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 bash[120790]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-26T21:15:26.257 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate[120805]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-26T21:15:26.258 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:25 smithi055 podman[120790]: 2024-04-26 21:15:25.963858221 +0000 UTC m=+1.453674330 container died 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T21:15:27.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:26 smithi055 ceph-mon[109028]: pgmap v72: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:27.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:27.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:27.006 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:26 smithi055 podman[120940]: 2024-04-26 21:15:26.676675281 +0000 UTC m=+0.691630751 container remove 90fbdcc55465e25c64ee4a0411c76267254a0bbd027b2b914673d29c74354011 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T21:15:27.350 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 podman[121000]: 2024-04-26 21:15:26.951641722 +0000 UTC m=+0.033850594 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:27.350 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 podman[121000]: 2024-04-26 21:15:27.052841772 +0000 UTC m=+0.135050683 container create e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T21:15:27.350 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 podman[121000]: 2024-04-26 21:15:27.348583704 +0000 UTC m=+0.430792631 container init e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T21:15:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:26 smithi064 ceph-mon[84240]: pgmap v72: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:27.636 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 podman[121000]: 2024-04-26 21:15:27.360457821 +0000 UTC m=+0.442666759 container start e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T21:15:27.636 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 ceph-osd[121018]: -- 172.21.15.55:0/213343485 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ddb905680 con 0x561ddb8cec00 2024-04-26T21:15:27.636 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 bash[121000]: e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd 2024-04-26T21:15:27.636 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 systemd[1]: Started Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:15:28.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:27 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:15:27.924+0000 7fe6bafaf7c0 -1 Falling back to public interface 2024-04-26T21:15:28.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:28.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:28.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:28.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:28 smithi064 ceph-mon[84240]: pgmap v73: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:29.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:28 smithi055 ceph-mon[109028]: pgmap v73: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:31.098 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:30 smithi055 ceph-mon[109028]: pgmap v74: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:31.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:30 smithi064 ceph-mon[84240]: pgmap v74: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 928 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:33.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:32 smithi055 ceph-mon[109028]: pgmap v75: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 843 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:33.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:32 smithi064 ceph-mon[84240]: pgmap v75: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 843 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:34.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:34 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:15:34.366+0000 7fe6bafaf7c0 -1 osd.0 49 log_to_monitors true 2024-04-26T21:15:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:34 smithi064 ceph-mon[84240]: pgmap v76: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:34 smithi064 ceph-mon[84240]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:15:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:34 smithi055 ceph-mon[109028]: pgmap v76: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:35.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:34 smithi055 ceph-mon[109028]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T21:15:35.255 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:15:34 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:15:34.859+0000 7fe6a5400700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:35 smithi064 ceph-mon[84240]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:35 smithi064 ceph-mon[84240]: osdmap e52: 6 total, 5 up, 6 in 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:35 smithi064 ceph-mon[84240]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:35 smithi055 ceph-mon[109028]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T21:15:36.158 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:35 smithi055 ceph-mon[109028]: osdmap e52: 6 total, 5 up, 6 in 2024-04-26T21:15:36.159 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:35 smithi055 ceph-mon[109028]: from='osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:15:36.159 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:36.159 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: pgmap v78: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476] boot 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: osdmap e53: 6 total, 6 up, 6 in 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:15:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:36 smithi055 ceph-mon[109028]: osdmap e54: 6 total, 6 up, 6 in 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: pgmap v78: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: osd.0 [v2:172.21.15.55:6802/307437476,v1:172.21.15.55:6803/307437476] boot 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: osdmap e53: 6 total, 6 up, 6 in 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T21:15:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:36 smithi064 ceph-mon[84240]: osdmap e54: 6 total, 6 up, 6 in 2024-04-26T21:15:38.655 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:38.655 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:38 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:38.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:38 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 -- 172.21.15.55:0/3864126276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc408101d60 msgr2=0x7fc408102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 --2- 172.21.15.55:0/3864126276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc408101d60 0x7fc408102140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009910 tx=0x7fc3fc009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:39.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 -- 172.21.15.55:0/3864126276 shutdown_connections 2024-04-26T21:15:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 --2- 172.21.15.55:0/3864126276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 0x7fc40810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 --2- 172.21.15.55:0/3864126276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc408101d60 0x7fc408102140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.695+0000 7fc40f400700 1 -- 172.21.15.55:0/3864126276 >> 172.21.15.55:0/3864126276 conn(0x7fc408076740 msgr2=0x7fc4080fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:39.698 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:39 smithi055 ceph-mon[109028]: pgmap v81: 65 pgs: 3 active+undersized+degraded, 10 active+undersized, 52 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 7/222 objects degraded (3.153%) 2024-04-26T21:15:39.698 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:39 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:39.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.696+0000 7fc40f400700 1 -- 172.21.15.55:0/3864126276 shutdown_connections 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.696+0000 7fc40f400700 1 -- 172.21.15.55:0/3864126276 wait complete. 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.697+0000 7fc40f400700 1 Processor -- start 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.697+0000 7fc40f400700 1 -- start start 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.697+0000 7fc40f400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 0x7fc408198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc40f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc40f400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408199ac0 con 0x7fc4081994a0 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc40f400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408199c30 con 0x7fc408102680 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52240/0 (socket says 172.21.15.55:52240) 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 -- 172.21.15.55:0/1004196322 learned_addr learned my addr 172.21.15.55:0/1004196322 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:39.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc40ca00700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 0x7fc408198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 -- 172.21.15.55:0/1004196322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 msgr2=0x7fc408198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 0x7fc408198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.698+0000 7fc407e00700 1 -- 172.21.15.55:0/1004196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0095f0 con 0x7fc4081994a0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc407e00700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400d6d0 tx=0x7fc3f400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f400f860 con 0x7fc4081994a0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3f400fe80 con 0x7fc4081994a0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f4010ea0 con 0x7fc4081994a0 2024-04-26T21:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40819de50 con 0x7fc4081994a0 2024-04-26T21:15:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.699+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40819e3a0 con 0x7fc4081994a0 2024-04-26T21:15:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.701+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40810a6d0 con 0x7fc4081994a0 2024-04-26T21:15:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.702+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc3f4010460 con 0x7fc4081994a0 2024-04-26T21:15:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.702+0000 7fc405600700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 0x7fc3f0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.703+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc3f408e960 con 0x7fc4081994a0 2024-04-26T21:15:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.703+0000 7fc40ca00700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 0x7fc3f0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.704+0000 7fc40ca00700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 0x7fc3f0071190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009fd0 tx=0x7fc3fc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:39.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.708+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc3f40577a0 con 0x7fc4081994a0 2024-04-26T21:15:39.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:39 smithi064 ceph-mon[84240]: pgmap v81: 65 pgs: 3 active+undersized+degraded, 10 active+undersized, 52 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 7/222 objects degraded (3.153%) 2024-04-26T21:15:39.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:39 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 7/222 objects degraded (3.153%), 3 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:39.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.972+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc40804ec20 con 0x7fc3f006ecd0 2024-04-26T21:15:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.975+0000 7fc405600700 1 -- 172.21.15.55:0/1004196322 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc40804ec20 con 0x7fc3f006ecd0 2024-04-26T21:15:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.977+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 msgr2=0x7fc3f0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.977+0000 7fc40f400700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 0x7fc3f0071190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009fd0 tx=0x7fc3fc01a040 comp rx=0 tx=0).stop 2024-04-26T21:15:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.977+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 msgr2=0x7fc40819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:39.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.977+0000 7fc40f400700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400d6d0 tx=0x7fc3f400da90 comp rx=0 tx=0).stop 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 shutdown_connections 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc3f006ecd0 0x7fc3f0071190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc408102680 0x7fc408198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 --2- 172.21.15.55:0/1004196322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4081994a0 0x7fc40819d850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 >> 172.21.15.55:0/1004196322 conn(0x7fc408076740 msgr2=0x7fc4081010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 shutdown_connections 2024-04-26T21:15:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:39.978+0000 7fc40f400700 1 -- 172.21.15.55:0/1004196322 wait complete. 2024-04-26T21:15:39.996 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:15:40.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 -- 172.21.15.55:0/2340415543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc1039f0 msgr2=0x7f4bfc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 --2- 172.21.15.55:0/2340415543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009910 tx=0x7f4be4009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 -- 172.21.15.55:0/2340415543 shutdown_connections 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 --2- 172.21.15.55:0/2340415543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 --2- 172.21.15.55:0/2340415543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc103040 0x7f4bfc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.142+0000 7f4c03400700 1 -- 172.21.15.55:0/2340415543 >> 172.21.15.55:0/2340415543 conn(0x7f4bfc0fe8b0 msgr2=0x7f4bfc100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.143+0000 7f4c03400700 1 -- 172.21.15.55:0/2340415543 shutdown_connections 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.143+0000 7f4c03400700 1 -- 172.21.15.55:0/2340415543 wait complete. 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.144+0000 7f4c03400700 1 Processor -- start 2024-04-26T21:15:40.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.144+0000 7f4c03400700 1 -- start start 2024-04-26T21:15:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4c03400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 0x7f4bfc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4c03400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4c03400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc199920 con 0x7f4bfc103040 2024-04-26T21:15:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4c03400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc19c540 con 0x7f4bfc1039f0 2024-04-26T21:15:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4bfbe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4bfbe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:50182/0 (socket says 172.21.15.55:50182) 2024-04-26T21:15:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4c00a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 0x7f4bfc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.145+0000 7f4bfbe00700 1 -- 172.21.15.55:0/1097882302 learned_addr learned my addr 172.21.15.55:0/1097882302 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.146+0000 7f4c00a00700 1 -- 172.21.15.55:0/1097882302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 msgr2=0x7f4bfc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.146+0000 7f4c00a00700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.146+0000 7f4c00a00700 1 -- 172.21.15.55:0/1097882302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40095f0 con 0x7f4bfc103040 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4c00a00700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 0x7f4bfc198d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00d8d0 tx=0x7f4bec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec009900 con 0x7f4bfc103040 2024-04-26T21:15:40.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bec010460 con 0x7f4bfc103040 2024-04-26T21:15:40.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc19c820 con 0x7f4bfc103040 2024-04-26T21:15:40.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec00b5d0 con 0x7f4bfc103040 2024-04-26T21:15:40.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.147+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc19cd70 con 0x7f4bfc103040 2024-04-26T21:15:40.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.149+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc10b440 con 0x7f4bfc103040 2024-04-26T21:15:40.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.150+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4bec0105d0 con 0x7f4bfc103040 2024-04-26T21:15:40.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.151+0000 7f4bf9600700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 0x7f4bdc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.151+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4bec08eb20 con 0x7f4bfc103040 2024-04-26T21:15:40.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.151+0000 7f4bfbe00700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 0x7f4bdc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.152+0000 7f4bfbe00700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 0x7f4bdc071190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4be400b5c0 tx=0x7f4be401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.156+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4bec057960 con 0x7f4bfc103040 2024-04-26T21:15:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.422+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bfc19a040 con 0x7f4bdc06ecd0 2024-04-26T21:15:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.424+0000 7f4bf9600700 1 -- 172.21.15.55:0/1097882302 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4bfc19a040 con 0x7f4bdc06ecd0 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 msgr2=0x7f4bdc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 0x7f4bdc071190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4be400b5c0 tx=0x7f4be401a040 comp rx=0 tx=0).stop 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 msgr2=0x7f4bfc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 0x7f4bfc198d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00d8d0 tx=0x7f4bec00dc90 comp rx=0 tx=0).stop 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 shutdown_connections 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4bfc103040 0x7f4bfc198d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4bdc06ecd0 0x7f4bdc071190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 --2- 172.21.15.55:0/1097882302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4bfc1039f0 0x7f4bfc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 >> 172.21.15.55:0/1097882302 conn(0x7f4bfc0fe8b0 msgr2=0x7f4bfc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.427+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 shutdown_connections 2024-04-26T21:15:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.428+0000 7f4c03400700 1 -- 172.21.15.55:0/1097882302 wait complete. 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 -- 172.21.15.55:0/2298994906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 msgr2=0x7ff49c104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/2298994906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c104950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff484009910 tx=0x7ff484009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 -- 172.21.15.55:0/2298994906 shutdown_connections 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/2298994906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c104950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/2298994906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 0x7ff49c0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 -- 172.21.15.55:0/2298994906 >> 172.21.15.55:0/2298994906 conn(0x7ff49c0fb5e0 msgr2=0x7ff49c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 -- 172.21.15.55:0/2298994906 shutdown_connections 2024-04-26T21:15:40.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.601+0000 7ff4a1c00700 1 -- 172.21.15.55:0/2298994906 wait complete. 2024-04-26T21:15:40.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.602+0000 7ff4a1c00700 1 Processor -- start 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.602+0000 7ff4a1c00700 1 -- start start 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff4a1c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 0x7ff49c19d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff4a1c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff4a1c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c19dd50 con 0x7ff49c100480 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff4a1c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1a1a20 con 0x7ff49c0ffad0 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff492000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff492000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52292/0 (socket says 172.21.15.55:52292) 2024-04-26T21:15:40.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff492000700 1 -- 172.21.15.55:0/1076024208 learned_addr learned my addr 172.21.15.55:0/1076024208 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.603+0000 7ff49aa00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 0x7ff49c19d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff492000700 1 -- 172.21.15.55:0/1076024208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 msgr2=0x7ff49c19d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff492000700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 0x7ff49c19d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff492000700 1 -- 172.21.15.55:0/1076024208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840095f0 con 0x7ff49c100480 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff492000700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff484000c00 tx=0x7ff48400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48401d070 con 0x7ff49c100480 2024-04-26T21:15:40.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff484005700 con 0x7ff49c100480 2024-04-26T21:15:40.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c1a1ca0 con 0x7ff49c100480 2024-04-26T21:15:40.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.604+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48400fe50 con 0x7ff49c100480 2024-04-26T21:15:40.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.605+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c1a2190 con 0x7ff49c100480 2024-04-26T21:15:40.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.606+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c069730 con 0x7ff49c100480 2024-04-26T21:15:40.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.607+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff48400f640 con 0x7ff49c100480 2024-04-26T21:15:40.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.608+0000 7ff493e00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 0x7ff480071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:40.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.608+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff4840901b0 con 0x7ff49c100480 2024-04-26T21:15:40.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.608+0000 7ff49aa00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 0x7ff480071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:40.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.609+0000 7ff49aa00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 0x7ff480071190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d10 tx=0x7ff48c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.613+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff484059010 con 0x7ff49c100480 2024-04-26T21:15:40.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.851+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff49c114430 con 0x7ff48006ecd0 2024-04-26T21:15:40.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.869+0000 7ff493e00700 1 -- 172.21.15.55:0/1076024208 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff49c114430 con 0x7ff48006ecd0 2024-04-26T21:15:40.870 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (4m) 5s ago 19m 14.1M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (19m) 5s ago 19m 8514k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (18m) 41s ago 18m 8300k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (55s) 5s ago 19m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (46s) 41s ago 17m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (4m) 5s ago 18m 74.0M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (11m) 5s ago 11m 153M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (11m) 5s ago 11m 17.8M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (11m) 41s ago 11m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (11m) 41s ago 11m 17.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (8m) 5s ago 21m 503M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:15:40.871 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (6m) 41s ago 17m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (2m) 5s ago 21m 48.9M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (2m) 41s ago 17m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (6m) 5s ago 19m 7926k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (6m) 41s ago 17m 7499k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (13s) 5s ago 16m 11.5M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (15m) 5s ago 15m 270M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 111dfbe53fe4 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (15m) 5s ago 15m 229M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (14m) 41s ago 14m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (14m) 41s ago 14m 274M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (13m) 41s ago 13m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:15:40.872 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (5m) 5s ago 18m 67.9M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:15:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 msgr2=0x7ff480071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 0x7ff480071190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d10 tx=0x7ff48c009040 comp rx=0 tx=0).stop 2024-04-26T21:15:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 msgr2=0x7ff49c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:40.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff484000c00 tx=0x7ff48400be20 comp rx=0 tx=0).stop 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 shutdown_connections 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff48006ecd0 0x7ff480071190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff49c0ffad0 0x7ff49c19d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 --2- 172.21.15.55:0/1076024208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff49c100480 0x7ff49c19d670 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 >> 172.21.15.55:0/1076024208 conn(0x7ff49c0fb5e0 msgr2=0x7ff49c10e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 shutdown_connections 2024-04-26T21:15:40.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:40.872+0000 7ff4a1c00700 1 -- 172.21.15.55:0/1076024208 wait complete. 2024-04-26T21:15:41.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.022+0000 7f4a0a800700 1 -- 172.21.15.55:0/3505046580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04101d60 msgr2=0x7f4a04102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.022+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3505046580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04101d60 0x7f4a04102140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009910 tx=0x7f49f4009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 -- 172.21.15.55:0/3505046580 shutdown_connections 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3505046580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a04102680 0x7f4a0410ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3505046580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04101d60 0x7f4a04102140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 -- 172.21.15.55:0/3505046580 >> 172.21.15.55:0/3505046580 conn(0x7f4a04076740 msgr2=0x7f4a040fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 -- 172.21.15.55:0/3505046580 shutdown_connections 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.023+0000 7f4a0a800700 1 -- 172.21.15.55:0/3505046580 wait complete. 2024-04-26T21:15:41.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 Processor -- start 2024-04-26T21:15:41.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 -- start start 2024-04-26T21:15:41.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a04101d60 0x7f4a04198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a041998e0 con 0x7f4a04102680 2024-04-26T21:15:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.024+0000 7f4a0a800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0419c550 con 0x7f4a04101d60 2024-04-26T21:15:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52318/0 (socket says 172.21.15.55:52318) 2024-04-26T21:15:41.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 -- 172.21.15.55:0/3985444849 learned_addr learned my addr 172.21.15.55:0/3985444849 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 -- 172.21.15.55:0/3985444849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a04101d60 msgr2=0x7f4a04198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a04101d60 0x7f4a04198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.025+0000 7f4a02a00700 1 -- 172.21.15.55:0/3985444849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40095f0 con 0x7f4a04102680 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f4a02a00700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c8f0 tx=0x7f49f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f0007ad0 con 0x7f4a04102680 2024-04-26T21:15:41.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49f000ce90 con 0x7f4a04102680 2024-04-26T21:15:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f0018630 con 0x7f4a04102680 2024-04-26T21:15:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0419c830 con 0x7f4a04102680 2024-04-26T21:15:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.026+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0419cd80 con 0x7f4a04102680 2024-04-26T21:15:41.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.027+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a04068ea0 con 0x7f4a04102680 2024-04-26T21:15:41.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.030+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f49f0007c30 con 0x7f4a04102680 2024-04-26T21:15:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.031+0000 7f49fbe00700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 0x7f49e8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.031+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f49f008edb0 con 0x7f4a04102680 2024-04-26T21:15:41.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.032+0000 7f4a03400700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 0x7f49e8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:41.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.033+0000 7f4a03400700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 0x7f49e8071190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006010 tx=0x7f49f400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.036+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f49f0057bf0 con 0x7f4a04102680 2024-04-26T21:15:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.356+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a0410de80 con 0x7f4a04102680 2024-04-26T21:15:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.357+0000 7f49fbe00700 1 -- 172.21.15.55:0/3985444849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f49f005b2b0 con 0x7f4a04102680 2024-04-26T21:15:41.359 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:15:41.359 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:15:41.359 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:15:41.359 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 5, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 9, 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 5 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:15:41.360 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.360+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 msgr2=0x7f49e8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.360+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 0x7f49e8071190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006010 tx=0x7f49f400b540 comp rx=0 tx=0).stop 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.360+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 msgr2=0x7f4a04199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.360+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c8f0 tx=0x7f49f000ccb0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 shutdown_connections 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f49e806ecd0 0x7f49e8071190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a04101d60 0x7f4a04198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 --2- 172.21.15.55:0/3985444849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a04102680 0x7f4a04199250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 >> 172.21.15.55:0/3985444849 conn(0x7f4a04076740 msgr2=0x7f4a0410a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 shutdown_connections 2024-04-26T21:15:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.361+0000 7f4a0a800700 1 -- 172.21.15.55:0/3985444849 wait complete. 2024-04-26T21:15:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 -- 172.21.15.55:0/3930374463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac30106b20 msgr2=0x7fac30106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 --2- 172.21.15.55:0/3930374463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac30106b20 0x7fac30106f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac20009910 tx=0x7fac20009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 -- 172.21.15.55:0/3930374463 shutdown_connections 2024-04-26T21:15:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 --2- 172.21.15.55:0/3930374463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac300685c0 0x7fac30068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 --2- 172.21.15.55:0/3930374463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac30106b20 0x7fac30106f00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 -- 172.21.15.55:0/3930374463 >> 172.21.15.55:0/3930374463 conn(0x7fac30075460 msgr2=0x7fac30075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.513+0000 7fac2fe00700 1 -- 172.21.15.55:0/3930374463 shutdown_connections 2024-04-26T21:15:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.514+0000 7fac2fe00700 1 -- 172.21.15.55:0/3930374463 wait complete. 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.514+0000 7fac2fe00700 1 Processor -- start 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2fe00700 1 -- start start 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2fe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac30106b20 0x7fac3019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2fe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3019f310 con 0x7fac300685c0 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2fe00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30198940 con 0x7fac30106b20 2024-04-26T21:15:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52340/0 (socket says 172.21.15.55:52340) 2024-04-26T21:15:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.515+0000 7fac2ea00700 1 -- 172.21.15.55:0/2947551343 learned_addr learned my addr 172.21.15.55:0/2947551343 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.516+0000 7fac2ea00700 1 -- 172.21.15.55:0/2947551343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac30106b20 msgr2=0x7fac3019ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.516+0000 7fac2ea00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac30106b20 0x7fac3019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.516+0000 7fac2ea00700 1 -- 172.21.15.55:0/2947551343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200095f0 con 0x7fac300685c0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.516+0000 7fac2ea00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac20006010 tx=0x7fac2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.516+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2001d070 con 0x7fac300685c0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.517+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac2000f460 con 0x7fac300685c0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.517+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac20017630 con 0x7fac300685c0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.517+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac30198bc0 con 0x7fac300685c0 2024-04-26T21:15:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.517+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30199130 con 0x7fac300685c0 2024-04-26T21:15:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.518+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac30105d60 con 0x7fac300685c0 2024-04-26T21:15:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.519+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fac2000f5d0 con 0x7fac300685c0 2024-04-26T21:15:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.520+0000 7fac34a00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 0x7fac14071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.521+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fac200901f0 con 0x7fac300685c0 2024-04-26T21:15:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.521+0000 7fac2e000700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 0x7fac14071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.522+0000 7fac2e000700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 0x7fac14071190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac30199ab0 tx=0x7fac1c005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:41.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.525+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fac2005ccc0 con 0x7fac300685c0 2024-04-26T21:15:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:41 smithi055 ceph-mon[109028]: pgmap v82: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-04-26T21:15:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:41 smithi055 ceph-mon[109028]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:41 smithi055 ceph-mon[109028]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:41 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3985444849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:41.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.887+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac3010dbf0 con 0x7fac300685c0 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.888+0000 7fac34a00700 1 -- 172.21.15.55:0/2947551343 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7fac2005c850 con 0x7fac300685c0 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:15:41.890 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:15:41.891 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:15:41.892 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:41.893 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:15:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 msgr2=0x7fac14071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 0x7fac14071190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac30199ab0 tx=0x7fac1c005c80 comp rx=0 tx=0).stop 2024-04-26T21:15:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 msgr2=0x7fac3019e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac20006010 tx=0x7fac2000be20 comp rx=0 tx=0).stop 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 shutdown_connections 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac300685c0 0x7fac3019e7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fac1406ecd0 0x7fac14071190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 --2- 172.21.15.55:0/2947551343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac30106b20 0x7fac3019ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.892+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 >> 172.21.15.55:0/2947551343 conn(0x7fac30075460 msgr2=0x7fac300fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.893+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 shutdown_connections 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:41.893+0000 7fac2fe00700 1 -- 172.21.15.55:0/2947551343 wait complete. 2024-04-26T21:15:41.895 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:15:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:41 smithi064 ceph-mon[84240]: pgmap v82: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-04-26T21:15:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:41 smithi064 ceph-mon[84240]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:41 smithi064 ceph-mon[84240]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:41 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3985444849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.089+0000 7f0bc6800700 1 -- 172.21.15.55:0/1932029343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107440 msgr2=0x7f0bc0107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.089+0000 7f0bc6800700 1 --2- 172.21.15.55:0/1932029343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107440 0x7f0bc0107820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009910 tx=0x7f0bb0009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 -- 172.21.15.55:0/1932029343 shutdown_connections 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 --2- 172.21.15.55:0/1932029343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107df0 0x7f0bc010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 --2- 172.21.15.55:0/1932029343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107440 0x7f0bc0107820 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 -- 172.21.15.55:0/1932029343 >> 172.21.15.55:0/1932029343 conn(0x7f0bc0076a10 msgr2=0x7f0bc0078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 -- 172.21.15.55:0/1932029343 shutdown_connections 2024-04-26T21:15:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.090+0000 7f0bc6800700 1 -- 172.21.15.55:0/1932029343 wait complete. 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 Processor -- start 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 -- start start 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 0x7f0bc019d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc019dd50 con 0x7f0bc0107df0 2024-04-26T21:15:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.091+0000 7f0bc6800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01a19d0 con 0x7f0bc0107440 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52356/0 (socket says 172.21.15.55:52356) 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 -- 172.21.15.55:0/4071875571 learned_addr learned my addr 172.21.15.55:0/4071875571 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbf400700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 0x7f0bc019d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 -- 172.21.15.55:0/4071875571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 msgr2=0x7f0bc019d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 0x7f0bc019d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbea00700 1 -- 172.21.15.55:0/4071875571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00095f0 con 0x7f0bc0107df0 2024-04-26T21:15:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.092+0000 7f0bbf400700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 0x7f0bc019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.093+0000 7f0bbea00700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c8f0 tx=0x7f0bac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.094+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac007a50 con 0x7f0bc0107df0 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.094+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bac007bb0 con 0x7f0bc0107df0 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.094+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac018630 con 0x7f0bc0107df0 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.094+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01a1cb0 con 0x7f0bc0107df0 2024-04-26T21:15:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.094+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc01a2200 con 0x7f0bc0107df0 2024-04-26T21:15:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.095+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc010f7e0 con 0x7f0bc0107df0 2024-04-26T21:15:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.097+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0bac007d20 con 0x7f0bc0107df0 2024-04-26T21:15:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.098+0000 7f0bb7e00700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 0x7f0ba4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.098+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0bac08ed70 con 0x7f0bc0107df0 2024-04-26T21:15:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.098+0000 7f0bbf400700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 0x7f0ba4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.099+0000 7f0bbf400700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 0x7f0ba4071190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005b40 tx=0x7f0bb001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:42.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.107+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0bac057bb0 con 0x7f0bc0107df0 2024-04-26T21:15:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.351+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc0114400 con 0x7f0ba406ecd0 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.354+0000 7f0bb7e00700 1 -- 172.21.15.55:0/4071875571 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0bc0114400 con 0x7f0ba406ecd0 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:15:42.356 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "7/23 daemons upgraded", 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:15:42.357 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:15:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 msgr2=0x7f0ba4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 0x7f0ba4071190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005b40 tx=0x7f0bb001a040 comp rx=0 tx=0).stop 2024-04-26T21:15:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 msgr2=0x7f0bc019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c8f0 tx=0x7f0bac00ccb0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 shutdown_connections 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ba406ecd0 0x7f0ba4071190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bc0107440 0x7f0bc019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 --2- 172.21.15.55:0/4071875571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc0107df0 0x7f0bc019d670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 >> 172.21.15.55:0/4071875571 conn(0x7f0bc0076a10 msgr2=0x7f0bc0076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.357+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 shutdown_connections 2024-04-26T21:15:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.358+0000 7f0bc6800700 1 -- 172.21.15.55:0/4071875571 wait complete. 2024-04-26T21:15:42.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 -- 172.21.15.55:0/313814809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d281070b0 msgr2=0x7f2d28107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 --2- 172.21.15.55:0/313814809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d281070b0 0x7f2d28107510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009910 tx=0x7f2d18009c20 comp rx=0 tx=0).stop 2024-04-26T21:15:42.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 -- 172.21.15.55:0/313814809 shutdown_connections 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 --2- 172.21.15.55:0/313814809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d281070b0 0x7f2d28107510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 --2- 172.21.15.55:0/313814809 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d2810d0c0 0x7f2d2810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.522+0000 7f2d2f200700 1 -- 172.21.15.55:0/313814809 >> 172.21.15.55:0/313814809 conn(0x7f2d28076830 msgr2=0x7f2d28078c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.523+0000 7f2d2f200700 1 -- 172.21.15.55:0/313814809 shutdown_connections 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.523+0000 7f2d2f200700 1 -- 172.21.15.55:0/313814809 wait complete. 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 Processor -- start 2024-04-26T21:15:42.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 -- start start 2024-04-26T21:15:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d281070b0 0x7f2d2819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2819dc40 con 0x7f2d2810d0c0 2024-04-26T21:15:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.524+0000 7f2d2f200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281a1910 con 0x7f2d281070b0 2024-04-26T21:15:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52372/0 (socket says 172.21.15.55:52372) 2024-04-26T21:15:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 -- 172.21.15.55:0/184664714 learned_addr learned my addr 172.21.15.55:0/184664714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:15:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2de00700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d281070b0 0x7f2d2819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 -- 172.21.15.55:0/184664714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d281070b0 msgr2=0x7f2d2819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d281070b0 0x7f2d2819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.525+0000 7f2d2d400700 1 -- 172.21.15.55:0/184664714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180095f0 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d2d400700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d180092e0 tx=0x7f2d1800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d1801d070 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d1800f460 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d281a1b90 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d18017630 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.526+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281a2080 con 0x7f2d2810d0c0 2024-04-26T21:15:42.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.527+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2810f5c0 con 0x7f2d2810d0c0 2024-04-26T21:15:42.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.529+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2d1800f5d0 con 0x7f2d2810d0c0 2024-04-26T21:15:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.530+0000 7f2d22a00700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 0x7f2d10071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:15:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.530+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2d18090360 con 0x7f2d2810d0c0 2024-04-26T21:15:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.531+0000 7f2d2de00700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 0x7f2d10071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:15:42.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.532+0000 7f2d2de00700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 0x7f2d10071190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005fd0 tx=0x7f2d1c00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:15:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.536+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2d18059120 con 0x7f2d2810d0c0 2024-04-26T21:15:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:42 smithi055 ceph-mon[109028]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:42 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2947551343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:15:42.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.860+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2d28114210 con 0x7f2d2810d0c0 2024-04-26T21:15:42.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.860+0000 7f2d22a00700 1 -- 172.21.15.55:0/184664714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2d1805c7e0 con 0x7f2d2810d0c0 2024-04-26T21:15:42.862 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 msgr2=0x7f2d10071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 0x7f2d10071190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005fd0 tx=0x7f2d1c00a560 comp rx=0 tx=0).stop 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 msgr2=0x7f2d2819d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d180092e0 tx=0x7f2d1800be20 comp rx=0 tx=0).stop 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 shutdown_connections 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2d1006ecd0 0x7f2d10071190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d281070b0 0x7f2d2819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 --2- 172.21.15.55:0/184664714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2810d0c0 0x7f2d2819d560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:15:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 >> 172.21.15.55:0/184664714 conn(0x7f2d28076830 msgr2=0x7f2d2810c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:15:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.863+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 shutdown_connections 2024-04-26T21:15:42.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:15:42.864+0000 7f2d2f200700 1 -- 172.21.15.55:0/184664714 wait complete. 2024-04-26T21:15:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:42 smithi064 ceph-mon[84240]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:42.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:42 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2947551343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:15:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: pgmap v83: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 592 B/s rd, 1 op/s 2024-04-26T21:15:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-04-26T21:15:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/184664714' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:43.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: pgmap v83: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 592 B/s rd, 1 op/s 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 2 pgs degraded) 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/184664714' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:44.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:44.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:44.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:44.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:44.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:44.007 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:44.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:44.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:15:44.008 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:15:44.694 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:44 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:15:44.694 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:44 smithi055 ceph-mon[109028]: Upgrade: osd.1 is safe to restart 2024-04-26T21:15:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:44 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-26T21:15:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:44 smithi064 ceph-mon[84240]: Upgrade: osd.1 is safe to restart 2024-04-26T21:15:45.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:45 smithi064 ceph-mon[84240]: pgmap v84: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:45 smithi055 ceph-mon[109028]: pgmap v84: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: pgmap v85: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 929 B/s rd, 1 op/s 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: Upgrade: Updating osd.1 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: Deploying daemon osd.1 on smithi055 2024-04-26T21:15:47.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:46 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:47.177 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: pgmap v85: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 929 B/s rd, 1 op/s 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: Upgrade: Updating osd.1 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: Deploying daemon osd.1 on smithi055 2024-04-26T21:15:47.178 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:46 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:49.014 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:48 smithi055 ceph-mon[109028]: pgmap v86: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:15:49.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:48 smithi064 ceph-mon[84240]: pgmap v86: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:15:51.194 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:51 smithi055 ceph-mon[109028]: pgmap v87: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:51.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:51 smithi064 ceph-mon[84240]: pgmap v87: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:51.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:51 smithi055 systemd[1]: Stopping Ceph osd.1 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:15:52.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:51 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[51687]: 2024-04-26T21:15:51.698+0000 7f1e35000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:15:52.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:51 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[51687]: 2024-04-26T21:15:51.698+0000 7f1e35000700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-26T21:15:52.006 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:51 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[51687]: 2024-04-26T21:15:51.698+0000 7f1e35000700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:15:52.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:52 smithi064 ceph-mon[84240]: osd.1 marked itself down and dead 2024-04-26T21:15:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:52 smithi055 ceph-mon[109028]: osd.1 marked itself down and dead 2024-04-26T21:15:52.866 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:52 smithi055 podman[125943]: 2024-04-26 21:15:52.534526777 +0000 UTC m=+0.972508844 container died 111dfbe53fe41f06b11bbc4eb294730dbc9c1bfd18f0a03b3413d46542da661e (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=reef-7d2137f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T21:15:53.202 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:53 smithi055 podman[125943]: 2024-04-26 21:15:53.0315481 +0000 UTC m=+1.469530184 container cleanup 111dfbe53fe41f06b11bbc4eb294730dbc9c1bfd18f0a03b3413d46542da661e (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=reef-7d2137f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:15:53.203 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:53 smithi055 bash[125943]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1 2024-04-26T21:15:53.203 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:53 smithi055 ceph-mon[109028]: pgmap v88: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:53.203 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:53 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:15:53.203 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:53 smithi055 ceph-mon[109028]: osdmap e55: 6 total, 5 up, 6 in 2024-04-26T21:15:53.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:53 smithi064 ceph-mon[84240]: pgmap v88: 65 pgs: 65 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:15:53.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:53 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:15:53.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:53 smithi064 ceph-mon[84240]: osdmap e55: 6 total, 5 up, 6 in 2024-04-26T21:15:53.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:53 smithi055 podman[125961]: 2024-04-26 21:15:53.267836722 +0000 UTC m=+0.720939426 container remove 111dfbe53fe41f06b11bbc4eb294730dbc9c1bfd18f0a03b3413d46542da661e (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T21:15:54.291 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:54 smithi055 ceph-mon[109028]: osdmap e56: 6 total, 5 up, 6 in 2024-04-26T21:15:54.291 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:54 smithi055 podman[126050]: 2024-04-26 21:15:53.913360556 +0000 UTC m=+0.037157968 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:54.291 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:54 smithi055 podman[126050]: 2024-04-26 21:15:54.060685304 +0000 UTC m=+0.184482750 container create 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:15:54.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:54 smithi064 ceph-mon[84240]: osdmap e56: 6 total, 5 up, 6 in 2024-04-26T21:15:54.848 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:54 smithi055 podman[126050]: 2024-04-26 21:15:54.568192768 +0000 UTC m=+0.691990261 container init 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:15:54.848 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:54 smithi055 podman[126050]: 2024-04-26 21:15:54.580604752 +0000 UTC m=+0.704402198 container start 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T21:15:54.848 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:54 smithi055 podman[126050]: 2024-04-26 21:15:54.65565971 +0000 UTC m=+0.779457130 container attach 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:15:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:55 smithi055 ceph-mon[109028]: pgmap v91: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:55.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:55 smithi055 ceph-mon[109028]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-04-26T21:15:55.256 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:55 smithi055 podman[126050]: 2024-04-26 21:15:55.085845153 +0000 UTC m=+1.209642603 container died 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:15:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:55 smithi064 ceph-mon[84240]: pgmap v91: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:55 smithi064 ceph-mon[84240]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-04-26T21:15:56.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:56 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:56.498 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:56 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 2/222 objects degraded (0.901%), 2 pgs degraded (PG_DEGRADED) 2024-04-26T21:15:56.498 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 podman[126076]: 2024-04-26 21:15:56.037089344 +0000 UTC m=+0.929348080 container remove 2ca9effc6fb67965c010a9cf1170f7fe448c1f2314b4a1875ab91c24648e6648 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T21:15:56.498 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-26T21:15:56.498 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 systemd[1]: Stopped Ceph osd.1 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:15:56.498 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.1.service: Consumed 1min 53.330s CPU time. 2024-04-26T21:15:56.754 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 systemd[1]: Starting Ceph osd.1 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:15:57.193 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:57 smithi055 ceph-mon[109028]: pgmap v92: 65 pgs: 2 active+undersized+degraded, 29 peering, 3 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-04-26T21:15:57.193 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:57.193 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:57.193 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 podman[126176]: 2024-04-26 21:15:56.762462519 +0000 UTC m=+0.035015278 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:57.193 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:56 smithi055 podman[126176]: 2024-04-26 21:15:56.870356724 +0000 UTC m=+0.142909515 container create 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:15:57.193 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:57 smithi055 podman[126176]: 2024-04-26 21:15:57.191655182 +0000 UTC m=+0.464207986 container init 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:15:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:57 smithi064 ceph-mon[84240]: pgmap v92: 65 pgs: 2 active+undersized+degraded, 29 peering, 3 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/222 objects degraded (0.901%) 2024-04-26T21:15:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:15:57.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:15:57.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:57 smithi055 podman[126176]: 2024-04-26 21:15:57.205893996 +0000 UTC m=+0.478446764 container start 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-26T21:15:57.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:57 smithi055 podman[126176]: 2024-04-26 21:15:57.298399316 +0000 UTC m=+0.570952166 container attach 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T21:15:58.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-mon[109028]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-04-26T21:15:58.506 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:58.506 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:58.506 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:58.506 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 bash[126176]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-26T21:15:58.507 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:15:58.508 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate[126190]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-26T21:15:58.508 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:58 smithi055 podman[126176]: 2024-04-26 21:15:58.273931492 +0000 UTC m=+1.546484259 container died 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T21:15:58.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:58 smithi064 ceph-mon[84240]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-04-26T21:15:59.481 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:15:59 smithi055 ceph-mon[109028]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:15:59.482 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 podman[126330]: 2024-04-26 21:15:59.12421698 +0000 UTC m=+0.827090112 container remove 13eceed3231415ba91ae951ca976bad8c9fa84dfddfd5987457b18f321b0b0f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T21:15:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:15:59 smithi064 ceph-mon[84240]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:15:59.737 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 podman[126396]: 2024-04-26 21:15:59.387252451 +0000 UTC m=+0.035665502 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:15:59.738 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 podman[126396]: 2024-04-26 21:15:59.513797627 +0000 UTC m=+0.162210708 container create 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:16:00.255 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 podman[126396]: 2024-04-26 21:15:59.825534184 +0000 UTC m=+0.473947299 container init 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:16:00.255 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 podman[126396]: 2024-04-26 21:15:59.837607431 +0000 UTC m=+0.486020483 container start 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-26T21:16:00.255 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 ceph-osd[126415]: -- 172.21.15.55:0/2096138163 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b399931680 con 0x55b3998fac00 2024-04-26T21:16:00.255 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 bash[126396]: 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e 2024-04-26T21:16:00.255 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:15:59 smithi055 systemd[1]: Started Ceph osd.1 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:16:00.755 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:16:00 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:16:00.426+0000 7f82430777c0 -1 Falling back to public interface 2024-04-26T21:16:01.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:01 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:01.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:01 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:02.385 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:02 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:02.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:02 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:03.373 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:03 smithi055 ceph-mon[109028]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:03 smithi064 ceph-mon[84240]: pgmap v95: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:05.388 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:05 smithi055 ceph-mon[109028]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 952 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:05 smithi064 ceph-mon[84240]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 952 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:07.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:07 smithi055 ceph-mon[109028]: pgmap v97: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:07.407 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:07 smithi055 ceph-mon[109028]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:16:07.407 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:16:07 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:16:07.028+0000 7f82430777c0 -1 osd.1 54 log_to_monitors true 2024-04-26T21:16:07.407 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:16:07 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:16:07.139+0000 7f822d400700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:07.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:07 smithi064 ceph-mon[84240]: pgmap v97: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:07.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:07 smithi064 ceph-mon[84240]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T21:16:08.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:08 smithi064 ceph-mon[84240]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:16:08.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:08 smithi064 ceph-mon[84240]: osdmap e57: 6 total, 5 up, 6 in 2024-04-26T21:16:08.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:08 smithi064 ceph-mon[84240]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:16:08.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:08 smithi055 ceph-mon[109028]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T21:16:08.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:08 smithi055 ceph-mon[109028]: osdmap e57: 6 total, 5 up, 6 in 2024-04-26T21:16:08.503 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:08 smithi055 ceph-mon[109028]: from='osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: pgmap v99: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230] boot 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: osdmap e58: 6 total, 6 up, 6 in 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:09.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: pgmap v99: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:16:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: osd.1 [v2:172.21.15.55:6810/3666316230,v1:172.21.15.55:6811/3666316230] boot 2024-04-26T21:16:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: osdmap e58: 6 total, 6 up, 6 in 2024-04-26T21:16:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T21:16:09.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:09.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:10.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:10 smithi064 ceph-mon[84240]: osdmap e59: 6 total, 6 up, 6 in 2024-04-26T21:16:10.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:10 smithi055 ceph-mon[109028]: osdmap e59: 6 total, 6 up, 6 in 2024-04-26T21:16:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:11 smithi064 ceph-mon[84240]: pgmap v102: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:11 smithi055 ceph-mon[109028]: pgmap v102: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 -- 172.21.15.55:0/1830278470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 msgr2=0x7fb6a0073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/1830278470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a0073660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb690009910 tx=0x7fb690009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:13.048 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:12 smithi055 ceph-mon[109028]: pgmap v103: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:13.048 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:13.048 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 -- 172.21.15.55:0/1830278470 shutdown_connections 2024-04-26T21:16:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/1830278470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a0111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/1830278470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a0073660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 -- 172.21.15.55:0/1830278470 >> 172.21.15.55:0/1830278470 conn(0x7fb6a00fc6e0 msgr2=0x7fb6a00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 -- 172.21.15.55:0/1830278470 shutdown_connections 2024-04-26T21:16:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.045+0000 7fb6a4e00700 1 -- 172.21.15.55:0/1830278470 wait complete. 2024-04-26T21:16:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 Processor -- start 2024-04-26T21:16:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 -- start start 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a019dcc0 con 0x7fb6a0073280 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.047+0000 7fb6a4e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a01a1990 con 0x7fb6a0073ba0 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56510/0 (socket says 172.21.15.55:56510) 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 -- 172.21.15.55:0/3788518696 learned_addr learned my addr 172.21.15.55:0/3788518696 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 -- 172.21.15.55:0/3788518696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 msgr2=0x7fb6a019d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb697e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a019d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 -- 172.21.15.55:0/3788518696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900095f0 con 0x7fb6a0073280 2024-04-26T21:16:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb697e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.048+0000 7fb69de00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb690005f10 tx=0x7fb69000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.049+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69001d070 con 0x7fb6a0073280 2024-04-26T21:16:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.049+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6900052a0 con 0x7fb6a0073280 2024-04-26T21:16:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.049+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a01a1c10 con 0x7fb6a0073280 2024-04-26T21:16:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.049+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb690022470 con 0x7fb6a0073280 2024-04-26T21:16:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.049+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a01a2160 con 0x7fb6a0073280 2024-04-26T21:16:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.050+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a00749c0 con 0x7fb6a0073280 2024-04-26T21:16:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.051+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb690003780 con 0x7fb6a0073280 2024-04-26T21:16:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.052+0000 7fb696a00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 0x7fb684071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.052+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb6900902d0 con 0x7fb6a0073280 2024-04-26T21:16:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.053+0000 7fb697e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 0x7fb684071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.053+0000 7fb697e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 0x7fb684071180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6a019e600 tx=0x7fb688009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.058+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb690059140 con 0x7fb6a0073280 2024-04-26T21:16:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:12 smithi064 ceph-mon[84240]: pgmap v103: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:13.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.315+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6a0114460 con 0x7fb68406ecc0 2024-04-26T21:16:13.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.317+0000 7fb696a00700 1 -- 172.21.15.55:0/3788518696 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb6a0114460 con 0x7fb68406ecc0 2024-04-26T21:16:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.319+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 msgr2=0x7fb684071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.319+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 0x7fb684071180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6a019e600 tx=0x7fb688009260 comp rx=0 tx=0).stop 2024-04-26T21:16:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.319+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 msgr2=0x7fb6a019d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.319+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb690005f10 tx=0x7fb69000b650 comp rx=0 tx=0).stop 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 shutdown_connections 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6a0073280 0x7fb6a019d0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb68406ecc0 0x7fb684071180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 --2- 172.21.15.55:0/3788518696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a0073ba0 0x7fb6a019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 >> 172.21.15.55:0/3788518696 conn(0x7fb6a00fc6e0 msgr2=0x7fb6a0100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 shutdown_connections 2024-04-26T21:16:13.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.320+0000 7fb6a4e00700 1 -- 172.21.15.55:0/3788518696 wait complete. 2024-04-26T21:16:13.338 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 -- 172.21.15.55:0/1131294792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 msgr2=0x7fa51c0fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 --2- 172.21.15.55:0/1131294792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c0fff20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa504009910 tx=0x7fa504009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 -- 172.21.15.55:0/1131294792 shutdown_connections 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 --2- 172.21.15.55:0/1131294792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c0fff20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 --2- 172.21.15.55:0/1131294792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 0x7fa51c105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.484+0000 7fa522000700 1 -- 172.21.15.55:0/1131294792 >> 172.21.15.55:0/1131294792 conn(0x7fa51c076740 msgr2=0x7fa51c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.485+0000 7fa522000700 1 -- 172.21.15.55:0/1131294792 shutdown_connections 2024-04-26T21:16:13.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.485+0000 7fa522000700 1 -- 172.21.15.55:0/1131294792 wait complete. 2024-04-26T21:16:13.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 Processor -- start 2024-04-26T21:16:13.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 -- start start 2024-04-26T21:16:13.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 0x7fa51c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c19f5a0 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.486+0000 7fa522000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c198b80 con 0x7fa51c105aa0 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56518/0 (socket says 172.21.15.55:56518) 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 -- 172.21.15.55:0/2112810188 learned_addr learned my addr 172.21.15.55:0/2112810188 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa512a00700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 0x7fa51c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 -- 172.21.15.55:0/2112810188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 msgr2=0x7fa51c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 0x7fa51c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.487+0000 7fa51b400700 1 -- 172.21.15.55:0/2112810188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040095f0 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa51b400700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0060b0 tx=0x7fa50c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c00dda0 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa50c00f040 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c014790 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c198e60 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.488+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c199360 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.490+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c1011e0 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.491+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa50c014980 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.492+0000 7fa518c00700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 0x7fa500071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.492+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa50c08e850 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.493+0000 7fa512a00700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 0x7fa500071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.493+0000 7fa512a00700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 0x7fa500071180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5040059d0 tx=0x7fa50401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.498+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa50c05b290 con 0x7fa51c0ffaa0 2024-04-26T21:16:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.786+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa51c10cca0 con 0x7fa50006ecc0 2024-04-26T21:16:13.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.789+0000 7fa518c00700 1 -- 172.21.15.55:0/2112810188 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa51c10cca0 con 0x7fa50006ecc0 2024-04-26T21:16:13.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 msgr2=0x7fa500071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 0x7fa500071180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5040059d0 tx=0x7fa50401a040 comp rx=0 tx=0).stop 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 msgr2=0x7fa51c19ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0060b0 tx=0x7fa50c00d3b0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 shutdown_connections 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa51c0ffaa0 0x7fa51c19ea40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa50006ecc0 0x7fa500071180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 --2- 172.21.15.55:0/2112810188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa51c105aa0 0x7fa51c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 >> 172.21.15.55:0/2112810188 conn(0x7fa51c076740 msgr2=0x7fa51c1030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 shutdown_connections 2024-04-26T21:16:13.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.792+0000 7fa522000700 1 -- 172.21.15.55:0/2112810188 wait complete. 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 -- 172.21.15.55:0/3571725119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075410 msgr2=0x7fe3240757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 --2- 172.21.15.55:0/3571725119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075410 0x7fe3240757f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe314009910 tx=0x7fe314009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 -- 172.21.15.55:0/3571725119 shutdown_connections 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 --2- 172.21.15.55:0/3571725119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075d30 0x7fe324111520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 --2- 172.21.15.55:0/3571725119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075410 0x7fe3240757f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 -- 172.21.15.55:0/3571725119 >> 172.21.15.55:0/3571725119 conn(0x7fe3240fe8b0 msgr2=0x7fe324100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 -- 172.21.15.55:0/3571725119 shutdown_connections 2024-04-26T21:16:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.965+0000 7fe329200700 1 -- 172.21.15.55:0/3571725119 wait complete. 2024-04-26T21:16:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.966+0000 7fe329200700 1 Processor -- start 2024-04-26T21:16:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.966+0000 7fe329200700 1 -- start start 2024-04-26T21:16:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe329200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 0x7fe32419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe329200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe329200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32419dc90 con 0x7fe324075d30 2024-04-26T21:16:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe329200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241a1960 con 0x7fe324075410 2024-04-26T21:16:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe321400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe321400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56534/0 (socket says 172.21.15.55:56534) 2024-04-26T21:16:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe321400700 1 -- 172.21.15.55:0/1718967163 learned_addr learned my addr 172.21.15.55:0/1718967163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.967+0000 7fe321e00700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 0x7fe32419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe321400700 1 -- 172.21.15.55:0/1718967163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 msgr2=0x7fe32419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe321400700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 0x7fe32419d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe321400700 1 -- 172.21.15.55:0/1718967163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140095f0 con 0x7fe324075d30 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe321e00700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 0x7fe32419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe321400700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d900 tx=0x7fe31000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe310004a00 con 0x7fe324075d30 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3100054e0 con 0x7fe324075d30 2024-04-26T21:16:13.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3241a1c40 con 0x7fe324075d30 2024-04-26T21:16:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe310009d60 con 0x7fe324075d30 2024-04-26T21:16:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.968+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3241a2190 con 0x7fe324075d30 2024-04-26T21:16:13.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.970+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32410ec90 con 0x7fe324075d30 2024-04-26T21:16:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.971+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe310005020 con 0x7fe324075d30 2024-04-26T21:16:13.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.972+0000 7fe31aa00700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 0x7fe308071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:13.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.973+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe31008efe0 con 0x7fe324075d30 2024-04-26T21:16:13.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.973+0000 7fe321e00700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 0x7fe308071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:13.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.974+0000 7fe321e00700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 0x7fe308071190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe314006010 tx=0x7fe31400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:13.978+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe310057de0 con 0x7fe324075d30 2024-04-26T21:16:14.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:13 smithi064 ceph-mon[84240]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.223+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe324114340 con 0x7fe30806ecd0 2024-04-26T21:16:14.225 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:13 smithi055 ceph-mon[109028]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.236+0000 7fe31aa00700 1 -- 172.21.15.55:0/1718967163 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe324114340 con 0x7fe30806ecd0 2024-04-26T21:16:14.238 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:16:14.238 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (5m) 5s ago 19m 14.2M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:16:14.238 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (20m) 5s ago 20m 8736k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (18m) 74s ago 18m 8300k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (88s) 5s ago 20m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (80s) 74s ago 18m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (4m) 5s ago 19m 74.4M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (12m) 5s ago 12m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (12m) 5s ago 12m 18.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (12m) 74s ago 12m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:16:14.239 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (11m) 74s ago 11m 17.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (8m) 5s ago 21m 504M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (7m) 74s ago 18m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (3m) 5s ago 21m 49.3M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (2m) 74s ago 18m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (6m) 5s ago 19m 7936k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (6m) 74s ago 18m 7499k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (47s) 5s ago 17m 94.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (14s) 5s ago 16m 11.3M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (15m) 5s ago 15m 227M 1218M 18.2.2-1258-g7d2137f0 79c5878083fb 5509826358df 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (15m) 74s ago 15m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (14m) 74s ago 14m 274M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (14m) 74s ago 14m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (5m) 5s ago 19m 68.4M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 msgr2=0x7fe308071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 0x7fe308071190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe314006010 tx=0x7fe31400b540 comp rx=0 tx=0).stop 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 msgr2=0x7fe32419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d900 tx=0x7fe31000dcc0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 shutdown_connections 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe30806ecd0 0x7fe308071190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe324075410 0x7fe32419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 --2- 172.21.15.55:0/1718967163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe324075d30 0x7fe32419d5b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.239+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 >> 172.21.15.55:0/1718967163 conn(0x7fe3240fe8b0 msgr2=0x7fe3240ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.240+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 shutdown_connections 2024-04-26T21:16:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.240+0000 7fe329200700 1 -- 172.21.15.55:0/1718967163 wait complete. 2024-04-26T21:16:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 -- 172.21.15.55:0/752118288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 msgr2=0x7fc70410aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 --2- 172.21.15.55:0/752118288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc70410aba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009910 tx=0x7fc6f0009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 -- 172.21.15.55:0/752118288 shutdown_connections 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 --2- 172.21.15.55:0/752118288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc70410aba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 --2- 172.21.15.55:0/752118288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc704102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 -- 172.21.15.55:0/752118288 >> 172.21.15.55:0/752118288 conn(0x7fc7040fb5e0 msgr2=0x7fc7040fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 -- 172.21.15.55:0/752118288 shutdown_connections 2024-04-26T21:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.401+0000 7fc709c00700 1 -- 172.21.15.55:0/752118288 wait complete. 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.402+0000 7fc709c00700 1 Processor -- start 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc709c00700 1 -- start start 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc709c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc7040ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc709c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc709c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704100470 con 0x7fc7041026b0 2024-04-26T21:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc709c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041005b0 con 0x7fc704101d90 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc702000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc702000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56554/0 (socket says 172.21.15.55:56554) 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.403+0000 7fc702000700 1 -- 172.21.15.55:0/3767850867 learned_addr learned my addr 172.21.15.55:0/3767850867 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702a00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc7040ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702000700 1 -- 172.21.15.55:0/3767850867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 msgr2=0x7fc7040ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702000700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc7040ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702000700 1 -- 172.21.15.55:0/3767850867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00095f0 con 0x7fc7041026b0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702a00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc7040ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.404+0000 7fc702000700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0005b40 tx=0x7fc6f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.405+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f001d070 con 0x7fc7041026b0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.405+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6f0005700 con 0x7fc7041026b0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.405+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f000fe50 con 0x7fc7041026b0 2024-04-26T21:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.405+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc704100830 con 0x7fc7041026b0 2024-04-26T21:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.405+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7041a2f50 con 0x7fc7041026b0 2024-04-26T21:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.406+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7040699f0 con 0x7fc7041026b0 2024-04-26T21:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.407+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc6f000f460 con 0x7fc7041026b0 2024-04-26T21:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.408+0000 7fc6fb400700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 0x7fc6e8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.408+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc6f00901b0 con 0x7fc7041026b0 2024-04-26T21:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.409+0000 7fc702a00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 0x7fc6e8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.409+0000 7fc702a00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 0x7fc6e8071190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005950 tx=0x7fc6f40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.413+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc6f0058ff0 con 0x7fc7041026b0 2024-04-26T21:16:14.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.744+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc70404ebb0 con 0x7fc7041026b0 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.745+0000 7fc6fb400700 1 -- 172.21.15.55:0/3767850867 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7fc6f005c6b0 con 0x7fc7041026b0 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:14.747 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4, 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 8, 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:16:14.748 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 msgr2=0x7fc6e8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 0x7fc6e8071190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005950 tx=0x7fc6f40058e0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 msgr2=0x7fc7040fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0005b40 tx=0x7fc6f000be20 comp rx=0 tx=0).stop 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 shutdown_connections 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc6e806ecd0 0x7fc6e8071190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc704101d90 0x7fc7040ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 --2- 172.21.15.55:0/3767850867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7041026b0 0x7fc7040fff30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 >> 172.21.15.55:0/3767850867 conn(0x7fc7040fb5e0 msgr2=0x7fc704103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 shutdown_connections 2024-04-26T21:16:14.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.748+0000 7fc709c00700 1 -- 172.21.15.55:0/3767850867 wait complete. 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 -- 172.21.15.55:0/56602998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 msgr2=0x7f0a5410ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 --2- 172.21.15.55:0/56602998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5410ab80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009910 tx=0x7f0a40009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 -- 172.21.15.55:0/56602998 shutdown_connections 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 --2- 172.21.15.55:0/56602998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5410ab80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 --2- 172.21.15.55:0/56602998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 0x7f0a541020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 -- 172.21.15.55:0/56602998 >> 172.21.15.55:0/56602998 conn(0x7f0a540fb5e0 msgr2=0x7f0a540fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 -- 172.21.15.55:0/56602998 shutdown_connections 2024-04-26T21:16:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.910+0000 7f0a59200700 1 -- 172.21.15.55:0/56602998 wait complete. 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.911+0000 7f0a59200700 1 Processor -- start 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a59200700 1 -- start start 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a59200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 0x7f0a5419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a59200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a59200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5419f5a0 con 0x7f0a54102690 2024-04-26T21:16:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a59200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54198b80 con 0x7f0a54101ce0 2024-04-26T21:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a51400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a51400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59264/0 (socket says 172.21.15.55:59264) 2024-04-26T21:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.912+0000 7f0a51400700 1 -- 172.21.15.55:0/1638461762 learned_addr learned my addr 172.21.15.55:0/1638461762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:14.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a51e00700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 0x7f0a5419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a51400700 1 -- 172.21.15.55:0/1638461762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 msgr2=0x7f0a5419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a51400700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 0x7f0a5419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a51400700 1 -- 172.21.15.55:0/1638461762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400095f0 con 0x7f0a54102690 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a51400700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005b40 tx=0x7f0a4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.913+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4001d070 con 0x7f0a54102690 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.914+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a40005700 con 0x7f0a54102690 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.914+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a54198e00 con 0x7f0a54102690 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.914+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4000fe50 con 0x7f0a54102690 2024-04-26T21:16:14.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.914+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a541992f0 con 0x7f0a54102690 2024-04-26T21:16:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.915+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a340052f0 con 0x7f0a54102690 2024-04-26T21:16:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.916+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0a4000f460 con 0x7f0a54102690 2024-04-26T21:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.917+0000 7f0a4aa00700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 0x7f0a38071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.917+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0a400900f0 con 0x7f0a54102690 2024-04-26T21:16:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.917+0000 7f0a51e00700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 0x7f0a38071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:14.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.918+0000 7f0a51e00700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 0x7f0a38071190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a44005950 tx=0x7f0a440058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:14.923+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0a4005ca60 con 0x7f0a54102690 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: pgmap v104: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded) 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:15.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:14 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3767850867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: pgmap v104: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T21:16:15.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:15.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded) 2024-04-26T21:16:15.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:16:15.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:15.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:14 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3767850867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.201+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a34005db0 con 0x7f0a54102690 2024-04-26T21:16:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.202+0000 7f0a4aa00700 1 -- 172.21.15.55:0/1638461762 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f0a4005c5f0 con 0x7f0a54102690 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:15.205 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:16:15.206 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:16:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:16:15.208 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:15.209 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:15.210 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:15.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 msgr2=0x7f0a38071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 0x7f0a38071190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a44005950 tx=0x7f0a440058e0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 msgr2=0x7f0a5419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005b40 tx=0x7f0a4000be20 comp rx=0 tx=0).stop 2024-04-26T21:16:15.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 shutdown_connections 2024-04-26T21:16:15.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0a3806ecd0 0x7f0a38071190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a54101ce0 0x7f0a5419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 --2- 172.21.15.55:0/1638461762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a54102690 0x7f0a5419ef80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 >> 172.21.15.55:0/1638461762 conn(0x7f0a540fb5e0 msgr2=0x7f0a5410a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:15.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 shutdown_connections 2024-04-26T21:16:15.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.205+0000 7f0a59200700 1 -- 172.21.15.55:0/1638461762 wait complete. 2024-04-26T21:16:15.213 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:16:15.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.384+0000 7f593d200700 1 -- 172.21.15.55:0/2306761391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5938100e10 msgr2=0x7f59381011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.384+0000 7f593d200700 1 --2- 172.21.15.55:0/2306761391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5938100e10 0x7f59381011f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5928009910 tx=0x7f5928009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 -- 172.21.15.55:0/2306761391 shutdown_connections 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 --2- 172.21.15.55:0/2306761391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59381017c0 0x7f5938105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 --2- 172.21.15.55:0/2306761391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5938100e10 0x7f59381011f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 -- 172.21.15.55:0/2306761391 >> 172.21.15.55:0/2306761391 conn(0x7f59380fc6e0 msgr2=0x7f59380feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 -- 172.21.15.55:0/2306761391 shutdown_connections 2024-04-26T21:16:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.385+0000 7f593d200700 1 -- 172.21.15.55:0/2306761391 wait complete. 2024-04-26T21:16:15.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.386+0000 7f593d200700 1 Processor -- start 2024-04-26T21:16:15.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.386+0000 7f593d200700 1 -- start start 2024-04-26T21:16:15.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f593d200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5938100e10 0x7f5938073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f593d200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f593d200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938075170 con 0x7f59381017c0 2024-04-26T21:16:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f593d200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938073c80 con 0x7f5938100e10 2024-04-26T21:16:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f5935400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f5935400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59278/0 (socket says 172.21.15.55:59278) 2024-04-26T21:16:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f5935400700 1 -- 172.21.15.55:0/1063312592 learned_addr learned my addr 172.21.15.55:0/1063312592 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.387+0000 7f5935e00700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5938100e10 0x7f5938073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f5935400700 1 -- 172.21.15.55:0/1063312592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5938100e10 msgr2=0x7f5938073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f5935400700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5938100e10 0x7f5938073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f5935400700 1 -- 172.21.15.55:0/1063312592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280095f0 con 0x7f59381017c0 2024-04-26T21:16:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f5935400700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f592400d900 tx=0x7f592400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5924009900 con 0x7f59381017c0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5924010460 con 0x7f59381017c0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5938073f60 con 0x7f59381017c0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592400f5f0 con 0x7f59381017c0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.388+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59381a2fa0 con 0x7f59381017c0 2024-04-26T21:16:15.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.390+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381091b0 con 0x7f59381017c0 2024-04-26T21:16:15.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.391+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f59240105d0 con 0x7f59381017c0 2024-04-26T21:16:15.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.392+0000 7f592ea00700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 0x7f591c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.392+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f592408eb20 con 0x7f59381017c0 2024-04-26T21:16:15.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.392+0000 7f5935e00700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 0x7f591c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.393+0000 7f5935e00700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 0x7f591c071180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59280059d0 tx=0x7f592801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.397+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5924057a00 con 0x7f59381017c0 2024-04-26T21:16:15.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.636+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f593810dde0 con 0x7f591c06ecc0 2024-04-26T21:16:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.638+0000 7f592ea00700 1 -- 172.21.15.55:0/1063312592 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f593810dde0 con 0x7f591c06ecc0 2024-04-26T21:16:15.639 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:16:15.639 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:16:15.639 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "8/23 daemons upgraded", 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:16:15.640 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 msgr2=0x7f591c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 0x7f591c071180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59280059d0 tx=0x7f592801a040 comp rx=0 tx=0).stop 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 msgr2=0x7f5938073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f592400d900 tx=0x7f592400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 shutdown_connections 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591c06ecc0 0x7f591c071180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5938100e10 0x7f5938073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 --2- 172.21.15.55:0/1063312592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59381017c0 0x7f5938073740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 >> 172.21.15.55:0/1063312592 conn(0x7f59380fc6e0 msgr2=0x7f59380fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 shutdown_connections 2024-04-26T21:16:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.641+0000 7f593d200700 1 -- 172.21.15.55:0/1063312592 wait complete. 2024-04-26T21:16:15.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 -- 172.21.15.55:0/3128776925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 msgr2=0x7fb508106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 --2- 172.21.15.55:0/3128776925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb508106fe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009910 tx=0x7fb4f8009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 -- 172.21.15.55:0/3128776925 shutdown_connections 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 --2- 172.21.15.55:0/3128776925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 0x7fb508100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 --2- 172.21.15.55:0/3128776925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb508106fe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.784+0000 7fb50da00700 1 -- 172.21.15.55:0/3128776925 >> 172.21.15.55:0/3128776925 conn(0x7fb5080fc640 msgr2=0x7fb5080fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.785+0000 7fb50da00700 1 -- 172.21.15.55:0/3128776925 shutdown_connections 2024-04-26T21:16:15.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.785+0000 7fb50da00700 1 -- 172.21.15.55:0/3128776925 wait complete. 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 Processor -- start 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 -- start start 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 0x7fb50819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50819f450 con 0x7fb508106c00 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.786+0000 7fb50da00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508198a30 con 0x7fb508100b50 2024-04-26T21:16:15.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59296/0 (socket says 172.21.15.55:59296) 2024-04-26T21:16:15.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 -- 172.21.15.55:0/2104103768 learned_addr learned my addr 172.21.15.55:0/2104103768 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506a00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 0x7fb50819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 -- 172.21.15.55:0/2104103768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 msgr2=0x7fb50819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 0x7fb50819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.787+0000 7fb506000700 1 -- 172.21.15.55:0/2104103768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80095f0 con 0x7fb508106c00 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb506000700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d8d0 tx=0x7fb4f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f4009940 con 0x7fb508106c00 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4f4010460 con 0x7fb508106c00 2024-04-26T21:16:15.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508198d10 con 0x7fb508106c00 2024-04-26T21:16:15.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f400f5f0 con 0x7fb508106c00 2024-04-26T21:16:15.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.788+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5081992e0 con 0x7fb508106c00 2024-04-26T21:16:15.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.790+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508105ea0 con 0x7fb508106c00 2024-04-26T21:16:15.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.792+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb4f40105d0 con 0x7fb508106c00 2024-04-26T21:16:15.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.793+0000 7fb4ff400700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 0x7fb4ec071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:15.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.793+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb4f408ecc0 con 0x7fb508106c00 2024-04-26T21:16:15.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.793+0000 7fb506a00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 0x7fb4ec071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:15.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.794+0000 7fb506a00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 0x7fb4ec071190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b5c0 tx=0x7fb4f801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:15.798+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb4f405b6d0 con 0x7fb508106c00 2024-04-26T21:16:16.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.117+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb508102200 con 0x7fb508106c00 2024-04-26T21:16:16.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.118+0000 7fb4ff400700 1 -- 172.21.15.55:0/2104103768 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb4f405b260 con 0x7fb508106c00 2024-04-26T21:16:16.120 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:16:16.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.122+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 msgr2=0x7fb4ec071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.122+0000 7fb50da00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 0x7fb4ec071190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b5c0 tx=0x7fb4f801a040 comp rx=0 tx=0).stop 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.122+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 msgr2=0x7fb50819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.122+0000 7fb50da00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d8d0 tx=0x7fb4f400dc90 comp rx=0 tx=0).stop 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 shutdown_connections 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb4ec06ecd0 0x7fb4ec071190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb508100b50 0x7fb50819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 --2- 172.21.15.55:0/2104103768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb508106c00 0x7fb50819ee30 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400d8d0 tx=0x7fb4f400dc90 comp rx=0 tx=0).stop 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 >> 172.21.15.55:0/2104103768 conn(0x7fb5080fc640 msgr2=0x7fb5080fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 shutdown_connections 2024-04-26T21:16:16.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:16.123+0000 7fb50da00700 1 -- 172.21.15.55:0/2104103768 wait complete. 2024-04-26T21:16:16.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:15 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1638461762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:16:16.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:15 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1638461762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:16:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:16 smithi064 ceph-mon[84240]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:17.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:16 smithi064 ceph-mon[84240]: pgmap v105: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:16:17.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:16 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2104103768' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:16:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:16 smithi055 ceph-mon[109028]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:16 smithi055 ceph-mon[109028]: pgmap v105: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:16:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:16 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2104103768' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:16:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:18.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:16:18.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:17 smithi055 ceph-mon[109028]: Upgrade: osd.2 is safe to restart 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:18.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:16:18.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-26T21:16:18.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:17 smithi064 ceph-mon[84240]: Upgrade: osd.2 is safe to restart 2024-04-26T21:16:19.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:19 smithi055 ceph-mon[109028]: pgmap v106: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:19.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:19 smithi064 ceph-mon[84240]: pgmap v106: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:21.043 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: pgmap v107: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 962 B/s rd, 1 op/s 2024-04-26T21:16:21.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: Upgrade: Updating osd.2 2024-04-26T21:16:21.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:21.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:16:21.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:21.044 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:20 smithi055 ceph-mon[109028]: Deploying daemon osd.2 on smithi055 2024-04-26T21:16:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: pgmap v107: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 962 B/s rd, 1 op/s 2024-04-26T21:16:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: Upgrade: Updating osd.2 2024-04-26T21:16:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T21:16:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:20 smithi064 ceph-mon[84240]: Deploying daemon osd.2 on smithi055 2024-04-26T21:16:23.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:22 smithi064 ceph-mon[84240]: pgmap v108: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:16:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:22 smithi055 ceph-mon[109028]: pgmap v108: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:16:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:24.964 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:24 smithi055 ceph-mon[109028]: pgmap v109: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:25.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:24 smithi064 ceph-mon[84240]: pgmap v109: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:25.506 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:25 smithi055 systemd[1]: Stopping Ceph osd.2 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:16:25.883 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[59504]: 2024-04-26T21:16:25.566+0000 7f83f1e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:16:25.883 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[59504]: 2024-04-26T21:16:25.566+0000 7f83f1e00700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-26T21:16:25.883 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:25 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[59504]: 2024-04-26T21:16:25.566+0000 7f83f1e00700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:16:26.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:25 smithi064 ceph-mon[84240]: osd.2 marked itself down and dead 2024-04-26T21:16:26.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:25 smithi055 ceph-mon[109028]: osd.2 marked itself down and dead 2024-04-26T21:16:26.859 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:26 smithi055 podman[131719]: 2024-04-26 21:16:26.527228427 +0000 UTC m=+1.148162797 container died 5509826358dfafffb45eae1fa9fc4168ff493134d9535869daa657b5c25a77ff (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=reef-7d2137f) 2024-04-26T21:16:27.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:26 smithi064 ceph-mon[84240]: pgmap v110: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:27.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:26 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:16:27.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:26 smithi064 ceph-mon[84240]: osdmap e60: 6 total, 5 up, 6 in 2024-04-26T21:16:27.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:27.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:27.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:27 smithi055 podman[131719]: 2024-04-26 21:16:27.026660733 +0000 UTC m=+1.647595110 container cleanup 5509826358dfafffb45eae1fa9fc4168ff493134d9535869daa657b5c25a77ff (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=reef-7d2137f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:16:27.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:27 smithi055 bash[131719]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2 2024-04-26T21:16:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:26 smithi055 ceph-mon[109028]: pgmap v110: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:26 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:16:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:26 smithi055 ceph-mon[109028]: osdmap e60: 6 total, 5 up, 6 in 2024-04-26T21:16:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:27.755 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:27 smithi055 podman[131739]: 2024-04-26 21:16:27.344787397 +0000 UTC m=+0.802884561 container remove 5509826358dfafffb45eae1fa9fc4168ff493134d9535869daa657b5c25a77ff (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=reef-7d2137f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T21:16:28.177 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:27 smithi055 ceph-mon[109028]: osdmap e61: 6 total, 5 up, 6 in 2024-04-26T21:16:28.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:27 smithi064 ceph-mon[84240]: osdmap e61: 6 total, 5 up, 6 in 2024-04-26T21:16:28.495 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.08173183 +0000 UTC m=+0.037324498 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:16:28.495 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.187599839 +0000 UTC m=+0.143192526 container create c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T21:16:28.495 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.493802066 +0000 UTC m=+0.449394788 container init c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:16:28.755 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.505602654 +0000 UTC m=+0.461195345 container start c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:16:28.755 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.590082657 +0000 UTC m=+0.545675376 container attach c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:16:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:28 smithi055 ceph-mon[109028]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-26T21:16:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:28 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 8 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:29.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:28 smithi055 podman[131824]: 2024-04-26 21:16:28.975741988 +0000 UTC m=+0.931334694 container died c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:16:29.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:28 smithi064 ceph-mon[84240]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-26T21:16:29.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:28 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 8 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:30.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:29 smithi055 podman[131849]: 2024-04-26 21:16:29.735183733 +0000 UTC m=+0.738646370 container remove c57b150b579dfed782c4ee0419a4542251ce7702c462c50db5729caaa2f9795f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T21:16:30.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:29 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-26T21:16:30.006 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:29 smithi055 systemd[1]: Stopped Ceph osd.2 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:16:30.006 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:29 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.2.service: Consumed 1min 39.682s CPU time. 2024-04-26T21:16:30.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:30 smithi055 systemd[1]: Starting Ceph osd.2 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:16:30.933 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:30 smithi055 podman[131952]: 2024-04-26 21:16:30.474150601 +0000 UTC m=+0.037965576 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:16:30.933 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:30 smithi055 podman[131952]: 2024-04-26 21:16:30.644627756 +0000 UTC m=+0.208442750 container create 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-04-26T21:16:31.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:30 smithi055 ceph-mon[109028]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-26T21:16:31.256 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:30 smithi055 podman[131952]: 2024-04-26 21:16:30.957345139 +0000 UTC m=+0.521160171 container init 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T21:16:31.256 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:30 smithi055 podman[131952]: 2024-04-26 21:16:30.968990711 +0000 UTC m=+0.532805706 container start 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:16:31.256 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 podman[131952]: 2024-04-26 21:16:31.08075757 +0000 UTC m=+0.644572564 container attach 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T21:16:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:30 smithi064 ceph-mon[84240]: pgmap v114: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 22/222 objects degraded (9.910%) 2024-04-26T21:16:32.256 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 bash[131952]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:16:32.257 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:16:32.258 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:16:32.258 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-26T21:16:32.258 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:16:32.258 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:31 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate[131967]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-26T21:16:32.258 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:32 smithi055 podman[131952]: 2024-04-26 21:16:32.043433476 +0000 UTC m=+1.607248477 container died 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-26T21:16:33.240 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:32 smithi055 ceph-mon[109028]: pgmap v115: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:33.240 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:32 smithi055 podman[132096]: 2024-04-26 21:16:32.884652583 +0000 UTC m=+0.816426272 container remove 4f8b34be5779db5b991c9582e9cce9f04cf8ce3404be0d23269d7f199a69c01f (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:16:33.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:32 smithi064 ceph-mon[84240]: pgmap v115: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:33.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 podman[132159]: 2024-04-26 21:16:33.148628565 +0000 UTC m=+0.037170398 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:16:33.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 podman[132159]: 2024-04-26 21:16:33.302360242 +0000 UTC m=+0.190902082 container create 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T21:16:34.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 podman[132159]: 2024-04-26 21:16:33.614689172 +0000 UTC m=+0.503231006 container init 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T21:16:34.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 podman[132159]: 2024-04-26 21:16:33.627362918 +0000 UTC m=+0.515904715 container start 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:16:34.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 ceph-osd[132178]: -- 172.21.15.55:0/2943426490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fcb03d680 con 0x563fcb007000 2024-04-26T21:16:34.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 bash[132159]: 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 2024-04-26T21:16:34.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:33 smithi055 systemd[1]: Started Ceph osd.2 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:16:34.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:34 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:16:34.208+0000 7f5e4908b7c0 -1 Falling back to public interface 2024-04-26T21:16:35.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:34 smithi064 ceph-mon[84240]: pgmap v116: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:34 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:34 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:35.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:34 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:35.232 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:34 smithi055 ceph-mon[109028]: pgmap v116: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:35.232 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:35.232 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:35.232 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:36 smithi064 ceph-mon[84240]: pgmap v117: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:37.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:36 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:36 smithi055 ceph-mon[109028]: pgmap v117: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:37.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:36 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:39.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:38 smithi064 ceph-mon[84240]: pgmap v118: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 282 B/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:38 smithi055 ceph-mon[109028]: pgmap v118: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 282 B/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:40.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:39 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:16:39.958+0000 7f5e4908b7c0 -1 osd.2 59 log_to_monitors true 2024-04-26T21:16:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:40 smithi064 ceph-mon[84240]: pgmap v119: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:41.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:40 smithi064 ceph-mon[84240]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:16:41.255 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:16:40 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:16:40.920+0000 7f5e38400700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:16:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:40 smithi055 ceph-mon[109028]: pgmap v119: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:41.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:40 smithi055 ceph-mon[109028]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T21:16:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:16:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: osdmap e62: 6 total, 5 up, 6 in 2024-04-26T21:16:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:16:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: osdmap e62: 6 total, 5 up, 6 in 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:42.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: pgmap v121: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962] boot 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: osdmap e63: 6 total, 6 up, 6 in 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:16:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:42 smithi055 ceph-mon[109028]: osdmap e64: 6 total, 6 up, 6 in 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: pgmap v121: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: osd.2 [v2:172.21.15.55:6818/2146980962,v1:172.21.15.55:6819/2146980962] boot 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: osdmap e63: 6 total, 6 up, 6 in 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T21:16:43.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:42 smithi064 ceph-mon[84240]: osdmap e64: 6 total, 6 up, 6 in 2024-04-26T21:16:44.645 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:44 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:44.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:44 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:44.646 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:44 smithi055 ceph-mon[109028]: pgmap v124: 65 pgs: 13 peering, 6 active+undersized+degraded, 8 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 19/222 objects degraded (8.559%) 2024-04-26T21:16:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:44 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:44.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:44 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:44.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:44 smithi064 ceph-mon[84240]: pgmap v124: 65 pgs: 13 peering, 6 active+undersized+degraded, 8 active+undersized, 38 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 19/222 objects degraded (8.559%) 2024-04-26T21:16:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:45 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 19/222 objects degraded (8.559%), 6 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:45 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 19/222 objects degraded (8.559%), 6 pgs degraded (PG_DEGRADED) 2024-04-26T21:16:46.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.313+0000 7efdb2e00700 1 -- 172.21.15.55:0/3289557432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107440 msgr2=0x7efdac107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.313+0000 7efdb2e00700 1 --2- 172.21.15.55:0/3289557432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107440 0x7efdac107820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009910 tx=0x7efd9c009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 -- 172.21.15.55:0/3289557432 shutdown_connections 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 --2- 172.21.15.55:0/3289557432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107df0 0x7efdac10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 --2- 172.21.15.55:0/3289557432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107440 0x7efdac107820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 -- 172.21.15.55:0/3289557432 >> 172.21.15.55:0/3289557432 conn(0x7efdac076a10 msgr2=0x7efdac078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 -- 172.21.15.55:0/3289557432 shutdown_connections 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.314+0000 7efdb2e00700 1 -- 172.21.15.55:0/3289557432 wait complete. 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.315+0000 7efdb2e00700 1 Processor -- start 2024-04-26T21:16:46.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.315+0000 7efdb2e00700 1 -- start start 2024-04-26T21:16:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdb2e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107440 0x7efdac19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdb2e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdb2e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac19dce0 con 0x7efdac107df0 2024-04-26T21:16:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdb2e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac19de20 con 0x7efdac107440 2024-04-26T21:16:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41112/0 (socket says 172.21.15.55:41112) 2024-04-26T21:16:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdab400700 1 -- 172.21.15.55:0/4286782917 learned_addr learned my addr 172.21.15.55:0/4286782917 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdabe00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107440 0x7efdac19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdab400700 1 -- 172.21.15.55:0/4286782917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107440 msgr2=0x7efdac19d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.316+0000 7efdab400700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107440 0x7efdac19d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efdab400700 1 -- 172.21.15.55:0/4286782917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0095f0 con 0x7efdac107df0 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efdab400700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c960 tx=0x7efd9800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd98007a70 con 0x7efdac107df0 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd98007bd0 con 0x7efdac107df0 2024-04-26T21:16:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac1a1b60 con 0x7efdac107df0 2024-04-26T21:16:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd980186c0 con 0x7efdac107df0 2024-04-26T21:16:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.317+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac1a20b0 con 0x7efdac107df0 2024-04-26T21:16:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.319+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac10f7e0 con 0x7efdac107df0 2024-04-26T21:16:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.320+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efd9800faa0 con 0x7efdac107df0 2024-04-26T21:16:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.321+0000 7efda8c00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 0x7efd90071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.321+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efd9808ee60 con 0x7efdac107df0 2024-04-26T21:16:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.322+0000 7efdabe00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 0x7efd90071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.322+0000 7efdabe00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 0x7efd90071190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00b5c0 tx=0x7efd9c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.326+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7efd9805b750 con 0x7efdac107df0 2024-04-26T21:16:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.596+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdac114400 con 0x7efd9006ecd0 2024-04-26T21:16:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.598+0000 7efda8c00700 1 -- 172.21.15.55:0/4286782917 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efdac114400 con 0x7efd9006ecd0 2024-04-26T21:16:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.601+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 msgr2=0x7efd90071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.601+0000 7efdb2e00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 0x7efd90071190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00b5c0 tx=0x7efd9c01a040 comp rx=0 tx=0).stop 2024-04-26T21:16:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.601+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 msgr2=0x7efdac19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.601+0000 7efdb2e00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c960 tx=0x7efd9800cd20 comp rx=0 tx=0).stop 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 shutdown_connections 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd9006ecd0 0x7efd90071190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdac107440 0x7efdac19d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 --2- 172.21.15.55:0/4286782917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdac107df0 0x7efdac19d690 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 >> 172.21.15.55:0/4286782917 conn(0x7efdac076a10 msgr2=0x7efdac076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 shutdown_connections 2024-04-26T21:16:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.602+0000 7efdb2e00700 1 -- 172.21.15.55:0/4286782917 wait complete. 2024-04-26T21:16:46.619 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 -- 172.21.15.55:0/814314165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad01017c0 msgr2=0x7fdad0105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 --2- 172.21.15.55:0/814314165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad01017c0 0x7fdad0105810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009910 tx=0x7fdabc009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 -- 172.21.15.55:0/814314165 shutdown_connections 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 --2- 172.21.15.55:0/814314165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad01017c0 0x7fdad0105810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 --2- 172.21.15.55:0/814314165 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad0100e10 0x7fdad01011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 -- 172.21.15.55:0/814314165 >> 172.21.15.55:0/814314165 conn(0x7fdad00fc6e0 msgr2=0x7fdad00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 -- 172.21.15.55:0/814314165 shutdown_connections 2024-04-26T21:16:46.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.762+0000 7fdad4a00700 1 -- 172.21.15.55:0/814314165 wait complete. 2024-04-26T21:16:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.763+0000 7fdad4a00700 1 Processor -- start 2024-04-26T21:16:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdad4a00700 1 -- start start 2024-04-26T21:16:46.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdad4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdad4a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad01017c0 0x7fdad019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdad4a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019d380 con 0x7fdad0100e10 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdad4a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad01969b0 con 0x7fdad01017c0 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdacde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdacde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41126/0 (socket says 172.21.15.55:41126) 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.764+0000 7fdacde00700 1 -- 172.21.15.55:0/3128349451 learned_addr learned my addr 172.21.15.55:0/3128349451 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdacd400700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad01017c0 0x7fdad019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdacde00700 1 -- 172.21.15.55:0/3128349451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad01017c0 msgr2=0x7fdad019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdacde00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad01017c0 0x7fdad019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdacde00700 1 -- 172.21.15.55:0/3128349451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0095f0 con 0x7fdad0100e10 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdacde00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdac000d8d0 tx=0x7fdac000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.765+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac0009940 con 0x7fdad0100e10 2024-04-26T21:16:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.766+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdac0010460 con 0x7fdad0100e10 2024-04-26T21:16:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.766+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad0196c90 con 0x7fdad0100e10 2024-04-26T21:16:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.766+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad01971e0 con 0x7fdad0100e10 2024-04-26T21:16:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.766+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac000f5f0 con 0x7fdad0100e10 2024-04-26T21:16:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.767+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad0109210 con 0x7fdad0100e10 2024-04-26T21:16:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.768+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdac00105d0 con 0x7fdad0100e10 2024-04-26T21:16:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.769+0000 7fdac6a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 0x7fdab4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.769+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdac008ee60 con 0x7fdad0100e10 2024-04-26T21:16:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.769+0000 7fdacd400700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 0x7fdab4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.770+0000 7fdacd400700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 0x7fdab4071190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdad0197b20 tx=0x7fdabc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:46.774+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdac005b750 con 0x7fdad0100e10 2024-04-26T21:16:46.855 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:46 smithi055 ceph-mon[109028]: pgmap v125: 65 pgs: 13 peering, 5 active+undersized+degraded, 4 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/222 objects degraded (7.207%) 2024-04-26T21:16:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:46 smithi064 ceph-mon[84240]: pgmap v125: 65 pgs: 13 peering, 5 active+undersized+degraded, 4 active+undersized, 43 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/222 objects degraded (7.207%) 2024-04-26T21:16:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.017+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdad0197e90 con 0x7fdab406ecd0 2024-04-26T21:16:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.020+0000 7fdac6a00700 1 -- 172.21.15.55:0/3128349451 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdad0197e90 con 0x7fdab406ecd0 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 msgr2=0x7fdab4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 0x7fdab4071190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdad0197b20 tx=0x7fdabc01a040 comp rx=0 tx=0).stop 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 msgr2=0x7fdad019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdac000d8d0 tx=0x7fdac000dc90 comp rx=0 tx=0).stop 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 shutdown_connections 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad0100e10 0x7fdad019c820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdab406ecd0 0x7fdab4071190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 --2- 172.21.15.55:0/3128349451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdad01017c0 0x7fdad019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 >> 172.21.15.55:0/3128349451 conn(0x7fdad00fc6e0 msgr2=0x7fdad00fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 shutdown_connections 2024-04-26T21:16:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.023+0000 7fdad4a00700 1 -- 172.21.15.55:0/3128349451 wait complete. 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 -- 172.21.15.55:0/175603003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 msgr2=0x7f297c10aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 --2- 172.21.15.55:0/175603003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c10aa70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2968009910 tx=0x7f2968009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 -- 172.21.15.55:0/175603003 shutdown_connections 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 --2- 172.21.15.55:0/175603003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c10aa70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 --2- 172.21.15.55:0/175603003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 0x7f297c102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 -- 172.21.15.55:0/175603003 >> 172.21.15.55:0/175603003 conn(0x7f297c0fb3f0 msgr2=0x7f297c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.174+0000 7f297be00700 1 -- 172.21.15.55:0/175603003 shutdown_connections 2024-04-26T21:16:47.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.175+0000 7f297be00700 1 -- 172.21.15.55:0/175603003 wait complete. 2024-04-26T21:16:47.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 Processor -- start 2024-04-26T21:16:47.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 -- start start 2024-04-26T21:16:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 0x7f297c0ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c100340 con 0x7f297c102580 2024-04-26T21:16:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.176+0000 7f297be00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c100480 con 0x7f297c101c60 2024-04-26T21:16:47.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41144/0 (socket says 172.21.15.55:41144) 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 -- 172.21.15.55:0/2323053055 learned_addr learned my addr 172.21.15.55:0/2323053055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297aa00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 0x7f297c0ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 -- 172.21.15.55:0/2323053055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 msgr2=0x7f297c0ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 0x7f297c0ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.177+0000 7f297a000700 1 -- 172.21.15.55:0/2323053055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680095f0 con 0x7f297c102580 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f297a000700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29680092e0 tx=0x7f296800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f296801d070 con 0x7f297c102580 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2968005700 con 0x7f297c102580 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c100700 con 0x7f297c102580 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f296800fdb0 con 0x7f297c102580 2024-04-26T21:16:47.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.178+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c1a2de0 con 0x7f297c102580 2024-04-26T21:16:47.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.179+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c108210 con 0x7f297c102580 2024-04-26T21:16:47.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.181+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f296800f5f0 con 0x7f297c102580 2024-04-26T21:16:47.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.182+0000 7f2973400700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 0x7f2960071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.182+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2968090110 con 0x7f297c102580 2024-04-26T21:16:47.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.182+0000 7f297aa00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 0x7f2960071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.183+0000 7f297aa00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 0x7f2960071180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f296c005950 tx=0x7f296c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.187+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2968058ed0 con 0x7f297c102580 2024-04-26T21:16:47.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.421+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f297c10dc20 con 0x7f296006ecc0 2024-04-26T21:16:47.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.437+0000 7f2973400700 1 -- 172.21.15.55:0/2323053055 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f297c10dc20 con 0x7f296006ecc0 2024-04-26T21:16:47.438 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (6m) 6s ago 20m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (20m) 6s ago 20m 8954k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (19m) 107s ago 19m 8300k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (2m) 6s ago 20m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (113s) 107s ago 19m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (5m) 6s ago 19m 73.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (12m) 6s ago 12m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (12m) 6s ago 12m 18.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (12m) 107s ago 12m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (12m) 107s ago 12m 17.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (9m) 6s ago 22m 506M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (7m) 107s ago 18m 450M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (3m) 6s ago 22m 50.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:16:47.439 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (3m) 107s ago 18m 33.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (7m) 6s ago 20m 7708k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (7m) 107s ago 18m 7499k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (80s) 6s ago 17m 96.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (48s) 6s ago 17m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (14s) 6s ago 16m 12.6M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (15m) 107s ago 15m 298M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 2282f11f4237 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (15m) 107s ago 15m 274M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (14m) 107s ago 14m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:16:47.440 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (6m) 6s ago 19m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:16:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 msgr2=0x7f2960071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 0x7f2960071180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f296c005950 tx=0x7f296c00b410 comp rx=0 tx=0).stop 2024-04-26T21:16:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 msgr2=0x7f297c0ffe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29680092e0 tx=0x7f296800bd70 comp rx=0 tx=0).stop 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 shutdown_connections 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f296006ecc0 0x7f2960071180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f297c101c60 0x7f297c0ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.440+0000 7f297be00700 1 --2- 172.21.15.55:0/2323053055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f297c102580 0x7f297c0ffe00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.441+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 >> 172.21.15.55:0/2323053055 conn(0x7f297c0fb3f0 msgr2=0x7f297c105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.441+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 shutdown_connections 2024-04-26T21:16:47.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.441+0000 7f297be00700 1 -- 172.21.15.55:0/2323053055 wait complete. 2024-04-26T21:16:47.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.591+0000 7f6bc9e00700 1 -- 172.21.15.55:0/364806866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 msgr2=0x7f6bc410ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.591+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/364806866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc410ab70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009910 tx=0x7f6bb0009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 -- 172.21.15.55:0/364806866 shutdown_connections 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/364806866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc410ab70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/364806866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 0x7f6bc4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 -- 172.21.15.55:0/364806866 >> 172.21.15.55:0/364806866 conn(0x7f6bc4076740 msgr2=0x7f6bc40fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 -- 172.21.15.55:0/364806866 shutdown_connections 2024-04-26T21:16:47.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.592+0000 7f6bc9e00700 1 -- 172.21.15.55:0/364806866 wait complete. 2024-04-26T21:16:47.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 Processor -- start 2024-04-26T21:16:47.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 -- start start 2024-04-26T21:16:47.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 0x7f6bc4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4199a20 con 0x7f6bc4102680 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.593+0000 7f6bc9e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc419d6f0 con 0x7f6bc4101d60 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41164/0 (socket says 172.21.15.55:41164) 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 -- 172.21.15.55:0/2076266848 learned_addr learned my addr 172.21.15.55:0/2076266848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:47.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2a00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 0x7f6bc4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 -- 172.21.15.55:0/2076266848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 msgr2=0x7f6bc4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 0x7f6bc4198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.594+0000 7f6bc2000700 1 -- 172.21.15.55:0/2076266848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00095f0 con 0x7f6bc4102680 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc2000700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005b40 tx=0x7f6bb000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb001d070 con 0x7f6bc4102680 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb0003d50 con 0x7f6bc4102680 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc419d970 con 0x7f6bc4102680 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb000fe90 con 0x7f6bc4102680 2024-04-26T21:16:47.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.595+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc419de60 con 0x7f6bc4102680 2024-04-26T21:16:47.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.596+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc410a6d0 con 0x7f6bc4102680 2024-04-26T21:16:47.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.598+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6bb0003890 con 0x7f6bc4102680 2024-04-26T21:16:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.598+0000 7f6bc8a00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 0x7f6ba8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.599+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6bb0090280 con 0x7f6bc4102680 2024-04-26T21:16:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.599+0000 7f6bc2a00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 0x7f6ba8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.600+0000 7f6bc2a00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 0x7f6ba8071190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4006fd0 tx=0x7f6bb4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.604+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6bb0059040 con 0x7f6bc4102680 2024-04-26T21:16:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:47 smithi055 ceph-mon[109028]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:47 smithi055 ceph-mon[109028]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:47 smithi055 ceph-mon[109028]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:47 smithi064 ceph-mon[84240]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:47 smithi064 ceph-mon[84240]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:47 smithi064 ceph-mon[84240]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:47.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.944+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6bc419a110 con 0x7f6bc4102680 2024-04-26T21:16:47.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.945+0000 7f6bc8a00700 1 -- 172.21.15.55:0/2076266848 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f6bb005c700 con 0x7f6bc4102680 2024-04-26T21:16:47.945 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:16:47.945 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:16:47.945 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 3, 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 3 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:16:47.946 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 7, 2024-04-26T21:16:47.947 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 7 2024-04-26T21:16:47.947 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:16:47.947 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:16:47.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 msgr2=0x7f6ba8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 0x7f6ba8071190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4006fd0 tx=0x7f6bb4008040 comp rx=0 tx=0).stop 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 msgr2=0x7f6bc4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005b40 tx=0x7f6bb000bc10 comp rx=0 tx=0).stop 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 shutdown_connections 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6ba806ecd0 0x7f6ba8071190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bc4101d60 0x7f6bc4198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 --2- 172.21.15.55:0/2076266848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bc4102680 0x7f6bc4199340 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 >> 172.21.15.55:0/2076266848 conn(0x7f6bc4076740 msgr2=0x7f6bc4101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 shutdown_connections 2024-04-26T21:16:47.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:47.947+0000 7f6bc9e00700 1 -- 172.21.15.55:0/2076266848 wait complete. 2024-04-26T21:16:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 -- 172.21.15.55:0/3478583776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c102680 msgr2=0x7f232c10ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 --2- 172.21.15.55:0/3478583776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c102680 0x7f232c10ab70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2318009910 tx=0x7f2318009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 -- 172.21.15.55:0/3478583776 shutdown_connections 2024-04-26T21:16:48.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 --2- 172.21.15.55:0/3478583776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c102680 0x7f232c10ab70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 --2- 172.21.15.55:0/3478583776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c101d60 0x7f232c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 -- 172.21.15.55:0/3478583776 >> 172.21.15.55:0/3478583776 conn(0x7f232c076740 msgr2=0x7f232c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 -- 172.21.15.55:0/3478583776 shutdown_connections 2024-04-26T21:16:48.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.100+0000 7f2331800700 1 -- 172.21.15.55:0/3478583776 wait complete. 2024-04-26T21:16:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.101+0000 7f2331800700 1 Processor -- start 2024-04-26T21:16:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.101+0000 7f2331800700 1 -- start start 2024-04-26T21:16:48.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f2331800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f2331800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c102680 0x7f232c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f2331800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1999c0 con 0x7f232c101d60 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f2331800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19d690 con 0x7f232c102680 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f232aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f232aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41178/0 (socket says 172.21.15.55:41178) 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.102+0000 7f232aa00700 1 -- 172.21.15.55:0/3373104384 learned_addr learned my addr 172.21.15.55:0/3373104384 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f232a000700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c102680 0x7f232c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f232aa00700 1 -- 172.21.15.55:0/3373104384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c102680 msgr2=0x7f232c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f232aa00700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c102680 0x7f232c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f232aa00700 1 -- 172.21.15.55:0/3373104384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180095f0 con 0x7f232c101d60 2024-04-26T21:16:48.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f232aa00700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c8a0 tx=0x7f231c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c00cea0 con 0x7f232c101d60 2024-04-26T21:16:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f231c004830 con 0x7f232c101d60 2024-04-26T21:16:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.103+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c0055b0 con 0x7f232c101d60 2024-04-26T21:16:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.104+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c19d970 con 0x7f232c101d60 2024-04-26T21:16:48.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.104+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c19dec0 con 0x7f232c101d60 2024-04-26T21:16:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.105+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c1096d0 con 0x7f232c101d60 2024-04-26T21:16:48.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.106+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f231c0049a0 con 0x7f232c101d60 2024-04-26T21:16:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.107+0000 7f2323400700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 0x7f2310071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.107+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f231c08e6a0 con 0x7f232c101d60 2024-04-26T21:16:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.107+0000 7f232a000700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 0x7f2310071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.108+0000 7f232a000700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 0x7f2310071190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f232c19a300 tx=0x7f231801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.112+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f231c057620 con 0x7f232c101d60 2024-04-26T21:16:48.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.385+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f232c19a0e0 con 0x7f232c101d60 2024-04-26T21:16:48.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.385+0000 7f2323400700 1 -- 172.21.15.55:0/3373104384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f231c01d780 con 0x7f232c101d60 2024-04-26T21:16:48.386 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:16:48.386 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:16:48.386 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:16:48.387 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:16:48.388 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:48.389 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:48.390 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:16:48.390 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:16:48.390 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:48.390 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 msgr2=0x7f2310071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 0x7f2310071190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f232c19a300 tx=0x7f231801a040 comp rx=0 tx=0).stop 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 msgr2=0x7f232c198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c8a0 tx=0x7f231c00cc60 comp rx=0 tx=0).stop 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 shutdown_connections 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f232c101d60 0x7f232c198da0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f231006ecd0 0x7f2310071190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 --2- 172.21.15.55:0/3373104384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f232c102680 0x7f232c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 >> 172.21.15.55:0/3373104384 conn(0x7f232c076740 msgr2=0x7f232c10a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 shutdown_connections 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.389+0000 7f2331800700 1 -- 172.21.15.55:0/3373104384 wait complete. 2024-04-26T21:16:48.391 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:16:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 -- 172.21.15.55:0/984830148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073b20 msgr2=0x7f05f010cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 --2- 172.21.15.55:0/984830148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073b20 0x7f05f010cf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009910 tx=0x7f05dc009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 -- 172.21.15.55:0/984830148 shutdown_connections 2024-04-26T21:16:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 --2- 172.21.15.55:0/984830148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073b20 0x7f05f010cf30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 --2- 172.21.15.55:0/984830148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073200 0x7f05f00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.556+0000 7f05f5200700 1 -- 172.21.15.55:0/984830148 >> 172.21.15.55:0/984830148 conn(0x7f05f00fc6e0 msgr2=0x7f05f00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.557+0000 7f05f5200700 1 -- 172.21.15.55:0/984830148 shutdown_connections 2024-04-26T21:16:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.557+0000 7f05f5200700 1 -- 172.21.15.55:0/984830148 wait complete. 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 Processor -- start 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 -- start start 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073b20 0x7f05f0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01999e0 con 0x7f05f0073200 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05f5200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f019d6b0 con 0x7f05f0073b20 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05ede00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05ede00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41194/0 (socket says 172.21.15.55:41194) 2024-04-26T21:16:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.558+0000 7f05ede00700 1 -- 172.21.15.55:0/2291038374 learned_addr learned my addr 172.21.15.55:0/2291038374 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05ed400700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073b20 0x7f05f0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05ede00700 1 -- 172.21.15.55:0/2291038374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073b20 msgr2=0x7f05f0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05ede00700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073b20 0x7f05f0199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05ede00700 1 -- 172.21.15.55:0/2291038374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0095f0 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05ede00700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4b0 tx=0x7f05e000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.559+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e0011800 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.560+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05e0011e20 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.560+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e000f2e0 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.560+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f019d990 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.560+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f019dee0 con 0x7f05f0073200 2024-04-26T21:16:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.561+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f0074940 con 0x7f05f0073200 2024-04-26T21:16:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.562+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f05e0010380 con 0x7f05f0073200 2024-04-26T21:16:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.563+0000 7f05e6a00700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 0x7f05d4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.564+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f05e008e950 con 0x7f05f0073200 2024-04-26T21:16:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.564+0000 7f05ed400700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 0x7f05d4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.564+0000 7f05ed400700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 0x7f05d4071190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006010 tx=0x7f05dc00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.568+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f05e00577b0 con 0x7f05f0073200 2024-04-26T21:16:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:48 smithi055 ceph-mon[109028]: pgmap v126: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T21:16:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:48 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2076266848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:48.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:48 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3373104384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:16:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.819+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05f0107840 con 0x7f05d406ecd0 2024-04-26T21:16:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.822+0000 7f05e6a00700 1 -- 172.21.15.55:0/2291038374 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f05f0107840 con 0x7f05d406ecd0 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:16:48.823 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "9/23 daemons upgraded", 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:16:48.824 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:16:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 msgr2=0x7f05d4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 0x7f05d4071190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006010 tx=0x7f05dc00b540 comp rx=0 tx=0).stop 2024-04-26T21:16:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 msgr2=0x7f05f0198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4b0 tx=0x7f05e000b870 comp rx=0 tx=0).stop 2024-04-26T21:16:48.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 shutdown_connections 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f0073200 0x7f05f0198dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f05d406ecd0 0x7f05d4071190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 --2- 172.21.15.55:0/2291038374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05f0073b20 0x7f05f0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.826+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 >> 172.21.15.55:0/2291038374 conn(0x7f05f00fc6e0 msgr2=0x7f05f0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.827+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 shutdown_connections 2024-04-26T21:16:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.827+0000 7f05f5200700 1 -- 172.21.15.55:0/2291038374 wait complete. 2024-04-26T21:16:48.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:48 smithi064 ceph-mon[84240]: pgmap v126: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T21:16:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:48 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2076266848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:48.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:48 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3373104384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 -- 172.21.15.55:0/3933732015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073ba0 msgr2=0x7ffa3c1116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 --2- 172.21.15.55:0/3933732015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c1116d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009910 tx=0x7ffa28009c20 comp rx=0 tx=0).stop 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 -- 172.21.15.55:0/3933732015 shutdown_connections 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 --2- 172.21.15.55:0/3933732015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c1116d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 --2- 172.21.15.55:0/3933732015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073280 0x7ffa3c073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 -- 172.21.15.55:0/3933732015 >> 172.21.15.55:0/3933732015 conn(0x7ffa3c0fc6d0 msgr2=0x7ffa3c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 -- 172.21.15.55:0/3933732015 shutdown_connections 2024-04-26T21:16:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.978+0000 7ffa41c00700 1 -- 172.21.15.55:0/3933732015 wait complete. 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 Processor -- start 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 -- start start 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c19e050 con 0x7ffa3c073280 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.979+0000 7ffa41c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c1a1d20 con 0x7ffa3c073ba0 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41218/0 (socket says 172.21.15.55:41218) 2024-04-26T21:16:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 -- 172.21.15.55:0/2864217110 learned_addr learned my addr 172.21.15.55:0/2864217110 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:16:48.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3a000700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 -- 172.21.15.55:0/2864217110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073ba0 msgr2=0x7ffa3c19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:48.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c19d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:48.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.980+0000 7ffa3aa00700 1 -- 172.21.15.55:0/2864217110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280095f0 con 0x7ffa3c073280 2024-04-26T21:16:48.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa3aa00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0060b0 tx=0x7ffa2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c00dda0 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa2c00f040 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c014790 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c1a2000 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.981+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c1a2550 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.982+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c0749c0 con 0x7ffa3c073280 2024-04-26T21:16:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.983+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffa2c0148f0 con 0x7ffa3c073280 2024-04-26T21:16:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.984+0000 7ffa33400700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 0x7ffa20071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:16:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.984+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffa2c08e780 con 0x7ffa3c073280 2024-04-26T21:16:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.985+0000 7ffa3a000700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 0x7ffa20071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:16:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.985+0000 7ffa3a000700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 0x7ffa20071190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006010 tx=0x7ffa2800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:16:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:48.989+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffa2c057710 con 0x7ffa3c073280 2024-04-26T21:16:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.308+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffa3c06a5e0 con 0x7ffa3c073280 2024-04-26T21:16:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.308+0000 7ffa33400700 1 -- 172.21.15.55:0/2864217110 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ffa2c05add0 con 0x7ffa3c073280 2024-04-26T21:16:49.309 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 msgr2=0x7ffa20071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 0x7ffa20071190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006010 tx=0x7ffa2800b540 comp rx=0 tx=0).stop 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 msgr2=0x7ffa3c19d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0060b0 tx=0x7ffa2c00d3b0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 shutdown_connections 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa3c073280 0x7ffa3c19d430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa2006ecd0 0x7ffa20071190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 --2- 172.21.15.55:0/2864217110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa3c073ba0 0x7ffa3c19d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 >> 172.21.15.55:0/2864217110 conn(0x7ffa3c0fc6d0 msgr2=0x7ffa3c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:16:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.311+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 shutdown_connections 2024-04-26T21:16:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:16:49.312+0000 7ffa41c00700 1 -- 172.21.15.55:0/2864217110 wait complete. 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 5 pgs degraded) 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:49 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2864217110' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 5 pgs degraded) 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:49 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2864217110' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: Upgrade: osd.3 is safe to restart 2024-04-26T21:16:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:50 smithi064 ceph-mon[84240]: pgmap v127: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:16:51.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:16:51.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-26T21:16:51.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: Upgrade: osd.3 is safe to restart 2024-04-26T21:16:51.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:50 smithi055 ceph-mon[109028]: pgmap v127: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: pgmap v128: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: Upgrade: Updating osd.3 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:53.403 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:53 smithi064 ceph-mon[84240]: Deploying daemon osd.3 on smithi064 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: pgmap v128: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: Upgrade: Updating osd.3 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:53 smithi055 ceph-mon[109028]: Deploying daemon osd.3 on smithi064 2024-04-26T21:16:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:55 smithi064 ceph-mon[84240]: pgmap v129: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 941 B/s rd, 1 op/s 2024-04-26T21:16:55.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:55 smithi055 ceph-mon[109028]: pgmap v129: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 941 B/s rd, 1 op/s 2024-04-26T21:16:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-mon[84240]: pgmap v130: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:16:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:57.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:57.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:57.407 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:57 smithi064 systemd[1]: Stopping Ceph osd.3 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:16:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:57 smithi055 ceph-mon[109028]: pgmap v130: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:16:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:16:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:16:58.152 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[39356]: 2024-04-26T21:16:57.802+0000 7f600a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:16:58.152 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[39356]: 2024-04-26T21:16:57.802+0000 7f600a000700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-26T21:16:58.152 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:57 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[39356]: 2024-04-26T21:16:57.802+0000 7f600a000700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:16:58.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:58 smithi064 ceph-mon[84240]: osd.3 marked itself down and dead 2024-04-26T21:16:58.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:58 smithi055 ceph-mon[109028]: osd.3 marked itself down and dead 2024-04-26T21:16:58.954 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:58 smithi064 podman[93566]: 2024-04-26 21:16:58.669038425 +0000 UTC m=+1.007787878 container died 2282f11f423705a1502387a5515a979ac17d3597d22aab1a1b24ae0733ce2904 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-7d2137f, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T21:16:59.384 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:59 smithi064 ceph-mon[84240]: pgmap v131: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:59.384 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:59 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:16:59.384 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:16:59 smithi064 ceph-mon[84240]: osdmap e65: 6 total, 5 up, 6 in 2024-04-26T21:16:59.384 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:59 smithi064 podman[93566]: 2024-04-26 21:16:59.046484887 +0000 UTC m=+1.385234381 container cleanup 2282f11f423705a1502387a5515a979ac17d3597d22aab1a1b24ae0733ce2904 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=reef-7d2137f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T21:16:59.384 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:59 smithi064 bash[93566]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3 2024-04-26T21:16:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:59 smithi055 ceph-mon[109028]: pgmap v131: 65 pgs: 65 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:59 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:16:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:16:59 smithi055 ceph-mon[109028]: osdmap e65: 6 total, 5 up, 6 in 2024-04-26T21:16:59.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:59 smithi064 podman[93585]: 2024-04-26 21:16:59.381086539 +0000 UTC m=+0.701229470 container remove 2282f11f423705a1502387a5515a979ac17d3597d22aab1a1b24ae0733ce2904 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-7d2137f, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-26T21:17:00.303 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:00 smithi064 ceph-mon[84240]: osdmap e66: 6 total, 5 up, 6 in 2024-04-26T21:17:00.303 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:59 smithi064 podman[93677]: 2024-04-26 21:16:59.88798224 +0000 UTC m=+0.035441107 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:00.303 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:16:59 smithi064 podman[93677]: 2024-04-26 21:16:59.998610157 +0000 UTC m=+0.146131331 container create dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T21:17:00.303 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:00 smithi064 podman[93677]: 2024-04-26 21:17:00.302150331 +0000 UTC m=+0.449609237 container init dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:17:00.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:00 smithi055 ceph-mon[109028]: osdmap e66: 6 total, 5 up, 6 in 2024-04-26T21:17:00.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:00 smithi064 podman[93677]: 2024-04-26 21:17:00.314232951 +0000 UTC m=+0.461691883 container start dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:17:00.657 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:00 smithi064 podman[93677]: 2024-04-26 21:17:00.392727024 +0000 UTC m=+0.540185967 container attach dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:17:01.156 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:00 smithi064 podman[93677]: 2024-04-26 21:17:00.779222891 +0000 UTC m=+0.926681797 container died dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T21:17:01.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:01 smithi055 ceph-mon[109028]: pgmap v134: 65 pgs: 16 stale+active+clean, 49 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:01.581 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:01 smithi064 ceph-mon[84240]: pgmap v134: 65 pgs: 16 stale+active+clean, 49 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:01.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:01 smithi064 podman[93702]: 2024-04-26 21:17:01.579501655 +0000 UTC m=+0.781259410 container remove dd32b5d562b47208886d7b64602c5f5d937c0d512081cff55b13311ac317a355 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T21:17:01.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:01 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-26T21:17:01.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:01 smithi064 systemd[1]: Stopped Ceph osd.3 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:17:01.908 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:01 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.3.service: Consumed 2min 24.751s CPU time. 2024-04-26T21:17:02.233 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:01 smithi064 systemd[1]: Starting Ceph osd.3 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:17:02.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:02 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 12/222 objects degraded (5.405%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:02.591 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:02 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 12/222 objects degraded (5.405%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:02.591 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:02 smithi064 podman[93804]: 2024-04-26 21:17:02.254658395 +0000 UTC m=+0.038274959 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:02.591 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:02 smithi064 podman[93804]: 2024-04-26 21:17:02.372340917 +0000 UTC m=+0.155957511 container create 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T21:17:02.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:02 smithi064 podman[93804]: 2024-04-26 21:17:02.693223528 +0000 UTC m=+0.476840123 container init 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:17:02.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:02 smithi064 podman[93804]: 2024-04-26 21:17:02.705261078 +0000 UTC m=+0.488877666 container start 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux ) 2024-04-26T21:17:02.907 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:02 smithi064 podman[93804]: 2024-04-26 21:17:02.811726149 +0000 UTC m=+0.595342787 container attach 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T21:17:03.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:03 smithi055 ceph-mon[109028]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12/222 objects degraded (5.405%) 2024-04-26T21:17:03.643 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-mon[84240]: pgmap v135: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 12/222 objects degraded (5.405%) 2024-04-26T21:17:03.908 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:03.908 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:03.908 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:03.908 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 bash[93804]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:17:03.909 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate[93818]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-26T21:17:03.910 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:03 smithi064 podman[93948]: 2024-04-26 21:17:03.749781615 +0000 UTC m=+0.038511982 container died 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T21:17:04.825 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:04 smithi064 podman[93948]: 2024-04-26 21:17:04.445433505 +0000 UTC m=+0.734163926 container remove 686649afafae2dcc7d5b80c4c84c2857d9d25343df47b79f3ca5e0608cb57edd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:17:05.151 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:04 smithi064 podman[94010]: 2024-04-26 21:17:04.730408173 +0000 UTC m=+0.038046029 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:05.151 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:04 smithi064 podman[94010]: 2024-04-26 21:17:04.863008328 +0000 UTC m=+0.170646220 container create 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T21:17:05.151 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 podman[94010]: 2024-04-26 21:17:05.149599806 +0000 UTC m=+0.457237704 container init 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T21:17:05.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:05 smithi064 ceph-mon[84240]: pgmap v136: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:05.407 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 podman[94010]: 2024-04-26 21:17:05.161943594 +0000 UTC m=+0.469581454 container start 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T21:17:05.407 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 ceph-osd[94029]: -- 172.21.15.64:0/2093567944 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4701ed680 con 0x55e4701b7000 2024-04-26T21:17:05.407 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 bash[94010]: 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 2024-04-26T21:17:05.407 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 systemd[1]: Started Ceph osd.3 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:17:05.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:05 smithi055 ceph-mon[109028]: pgmap v136: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:06.044 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:05 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:17:05.750+0000 7f9c4d74d7c0 -1 Falling back to public interface 2024-04-26T21:17:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:06 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:06.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:06.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:06.811 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:06 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:07.738 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:07 smithi064 ceph-mon[84240]: pgmap v137: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:07.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:07 smithi055 ceph-mon[109028]: pgmap v137: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:09.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:09 smithi055 ceph-mon[109028]: pgmap v138: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:09.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:09 smithi064 ceph-mon[84240]: pgmap v138: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:11 smithi064 ceph-mon[84240]: pgmap v139: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:11 smithi055 ceph-mon[109028]: pgmap v139: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:12.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:12 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:12.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:12.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:12 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:12.906 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:12 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:17:12.628+0000 7f9c4d74d7c0 -1 osd.3 64 log_to_monitors true 2024-04-26T21:17:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:13 smithi055 ceph-mon[109028]: pgmap v140: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:13.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:13 smithi055 ceph-mon[109028]: from='osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:17:13.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:13 smithi055 ceph-mon[109028]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:17:13.572 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:13 smithi064 ceph-mon[84240]: pgmap v140: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-04-26T21:17:13.573 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:13.573 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:13.573 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:13 smithi064 ceph-mon[84240]: from='osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:17:13.573 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:13 smithi064 ceph-mon[84240]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T21:17:14.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:14 smithi064 ceph-mon[84240]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:17:14.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:14 smithi064 ceph-mon[84240]: osdmap e67: 6 total, 5 up, 6 in 2024-04-26T21:17:14.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:14 smithi064 ceph-mon[84240]: from='osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:14.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:14 smithi064 ceph-mon[84240]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:14 smithi055 ceph-mon[109028]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T21:17:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:14 smithi055 ceph-mon[109028]: osdmap e67: 6 total, 5 up, 6 in 2024-04-26T21:17:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:14 smithi055 ceph-mon[109028]: from='osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:14.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:14 smithi055 ceph-mon[109028]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:14.638 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:17:14 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:17:14.353+0000 7f9c37a00700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:17:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:15 smithi064 ceph-mon[84240]: pgmap v142: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-04-26T21:17:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:15 smithi064 ceph-mon[84240]: from='osd.3 ' entity='osd.3' 2024-04-26T21:17:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:15 smithi055 ceph-mon[109028]: pgmap v142: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-04-26T21:17:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:15 smithi055 ceph-mon[109028]: from='osd.3 ' entity='osd.3' 2024-04-26T21:17:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:16 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:17:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:16 smithi064 ceph-mon[84240]: osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812] boot 2024-04-26T21:17:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:16 smithi064 ceph-mon[84240]: osdmap e68: 6 total, 6 up, 6 in 2024-04-26T21:17:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:17:16.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:16 smithi064 ceph-mon[84240]: osdmap e69: 6 total, 6 up, 6 in 2024-04-26T21:17:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:16 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:17:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:16 smithi055 ceph-mon[109028]: osd.3 [v2:172.21.15.64:6800/2708520812,v1:172.21.15.64:6801/2708520812] boot 2024-04-26T21:17:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:16 smithi055 ceph-mon[109028]: osdmap e68: 6 total, 6 up, 6 in 2024-04-26T21:17:16.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T21:17:16.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:16 smithi055 ceph-mon[109028]: osdmap e69: 6 total, 6 up, 6 in 2024-04-26T21:17:17.681 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:17 smithi064 ceph-mon[84240]: pgmap v144: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-04-26T21:17:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:17 smithi055 ceph-mon[109028]: pgmap v144: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: pgmap v146: 65 pgs: 3 peering, 9 active+undersized+degraded, 11 active+undersized, 42 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:19.226 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-26T21:17:19.227 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:18 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 25/222 objects degraded (11.261%), 9 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: pgmap v146: 65 pgs: 3 peering, 9 active+undersized+degraded, 11 active+undersized, 42 active+clean; 198 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:19.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-26T21:17:19.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:18 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 25/222 objects degraded (11.261%), 9 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 -- 172.21.15.55:0/1976699428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 msgr2=0x7ffab810ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 --2- 172.21.15.55:0/1976699428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab810ab70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b0a0 tx=0x7ffaa000b3b0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 -- 172.21.15.55:0/1976699428 shutdown_connections 2024-04-26T21:17:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 --2- 172.21.15.55:0/1976699428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab810ab70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 --2- 172.21.15.55:0/1976699428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 0x7ffab8102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.488+0000 7ffabec00700 1 -- 172.21.15.55:0/1976699428 >> 172.21.15.55:0/1976699428 conn(0x7ffab8076740 msgr2=0x7ffab80fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.489+0000 7ffabec00700 1 -- 172.21.15.55:0/1976699428 shutdown_connections 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.489+0000 7ffabec00700 1 -- 172.21.15.55:0/1976699428 wait complete. 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 Processor -- start 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 -- start start 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 0x7ffab819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab819d350 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.490+0000 7ffabec00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8196940 con 0x7ffab8101d60 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53040/0 (socket says 172.21.15.55:53040) 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 -- 172.21.15.55:0/4101397253 learned_addr learned my addr 172.21.15.55:0/4101397253 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffab7e00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 0x7ffab819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 -- 172.21.15.55:0/4101397253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 msgr2=0x7ffab819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 0x7ffab819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.491+0000 7ffaaf400700 1 -- 172.21.15.55:0/4101397253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009d00 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffaaf400700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0015040 tx=0x7ffaa000cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa000e040 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaa0004040 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab8196bc0 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa001d670 con 0x7ffab8102680 2024-04-26T21:17:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.492+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab81970b0 con 0x7ffab8102680 2024-04-26T21:17:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.494+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8105480 con 0x7ffab8102680 2024-04-26T21:17:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.495+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffaa00046d0 con 0x7ffab8102680 2024-04-26T21:17:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.496+0000 7ffab5600700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 0x7ffa9c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.496+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffaa0090350 con 0x7ffab8102680 2024-04-26T21:17:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.496+0000 7ffab7e00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 0x7ffa9c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.497+0000 7ffab7e00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 0x7ffa9c071180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab80fefb0 tx=0x7ffaa8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.502+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffaa005cce0 con 0x7ffab8102680 2024-04-26T21:17:19.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.754+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab8197f30 con 0x7ffa9c06ecc0 2024-04-26T21:17:19.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.759+0000 7ffab5600700 1 -- 172.21.15.55:0/4101397253 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffab8197f30 con 0x7ffa9c06ecc0 2024-04-26T21:17:19.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 msgr2=0x7ffa9c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 0x7ffa9c071180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab80fefb0 tx=0x7ffaa8009260 comp rx=0 tx=0).stop 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 msgr2=0x7ffab819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0015040 tx=0x7ffaa000cfa0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 shutdown_connections 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffa9c06ecc0 0x7ffa9c071180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab8101d60 0x7ffab819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 --2- 172.21.15.55:0/4101397253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffab8102680 0x7ffab819cc70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.762+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 >> 172.21.15.55:0/4101397253 conn(0x7ffab8076740 msgr2=0x7ffab8103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.763+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 shutdown_connections 2024-04-26T21:17:19.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.763+0000 7ffabec00700 1 -- 172.21.15.55:0/4101397253 wait complete. 2024-04-26T21:17:19.781 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 -- 172.21.15.55:0/3951255012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 msgr2=0x7f839c073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 --2- 172.21.15.55:0/3951255012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c073690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f838c009910 tx=0x7f838c009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 -- 172.21.15.55:0/3951255012 shutdown_connections 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 --2- 172.21.15.55:0/3951255012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 0x7f839c10cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 --2- 172.21.15.55:0/3951255012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c073690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 -- 172.21.15.55:0/3951255012 >> 172.21.15.55:0/3951255012 conn(0x7f839c0fc6d0 msgr2=0x7f839c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 -- 172.21.15.55:0/3951255012 shutdown_connections 2024-04-26T21:17:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.925+0000 7f83a0c00700 1 -- 172.21.15.55:0/3951255012 wait complete. 2024-04-26T21:17:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.926+0000 7f83a0c00700 1 Processor -- start 2024-04-26T21:17:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f83a0c00700 1 -- start start 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f83a0c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f83a0c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 0x7f839c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f83a0c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c199aa0 con 0x7f839c0732b0 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f83a0c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c19d770 con 0x7f839c073bd0 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f8399e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f8399e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53050/0 (socket says 172.21.15.55:53050) 2024-04-26T21:17:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.927+0000 7f8399e00700 1 -- 172.21.15.55:0/178069452 learned_addr learned my addr 172.21.15.55:0/178069452 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.928+0000 7f8399400700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 0x7f839c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.928+0000 7f8399e00700 1 -- 172.21.15.55:0/178069452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 msgr2=0x7f839c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.928+0000 7f8399e00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 0x7f839c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.928+0000 7f8399e00700 1 -- 172.21.15.55:0/178069452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0095f0 con 0x7f839c0732b0 2024-04-26T21:17:19.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.928+0000 7f8399e00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f838c0092e0 tx=0x7f838c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.929+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838c01d070 con 0x7f839c0732b0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.929+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f838c00f460 con 0x7f839c0732b0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.929+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c19d9f0 con 0x7f839c0732b0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.929+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838c017630 con 0x7f839c0732b0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.929+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c19dee0 con 0x7f839c0732b0 2024-04-26T21:17:19.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.930+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c074960 con 0x7f839c0732b0 2024-04-26T21:17:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.931+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f838c00f5d0 con 0x7f839c0732b0 2024-04-26T21:17:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.932+0000 7f8392a00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 0x7f8380071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:19.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.932+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f838c0902a0 con 0x7f839c0732b0 2024-04-26T21:17:19.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.933+0000 7f8399400700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 0x7f8380071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:19.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.933+0000 7f8399400700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 0x7f8380071190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:19.937+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f838c0590e0 con 0x7f839c0732b0 2024-04-26T21:17:20.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.188+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f839c110050 con 0x7f838006ecd0 2024-04-26T21:17:20.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.189+0000 7f8392a00700 1 -- 172.21.15.55:0/178069452 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f839c110050 con 0x7f838006ecd0 2024-04-26T21:17:20.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 msgr2=0x7f8380071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 0x7f8380071190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388008040 comp rx=0 tx=0).stop 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 msgr2=0x7f839c198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f838c0092e0 tx=0x7f838c00be20 comp rx=0 tx=0).stop 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 shutdown_connections 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839c0732b0 0x7f839c198e80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f838006ecd0 0x7f8380071190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 --2- 172.21.15.55:0/178069452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c073bd0 0x7f839c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.192+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 >> 172.21.15.55:0/178069452 conn(0x7f839c0fc6d0 msgr2=0x7f839c105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.193+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 shutdown_connections 2024-04-26T21:17:20.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.193+0000 7f83a0c00700 1 -- 172.21.15.55:0/178069452 wait complete. 2024-04-26T21:17:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 -- 172.21.15.55:0/2702821627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae500ff8f0 msgr2=0x7fae500ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 --2- 172.21.15.55:0/2702821627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae500ff8f0 0x7fae500ffcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae40009910 tx=0x7fae40009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 -- 172.21.15.55:0/2702821627 shutdown_connections 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 --2- 172.21.15.55:0/2702821627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae501002a0 0x7fae5010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 --2- 172.21.15.55:0/2702821627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae500ff8f0 0x7fae500ffcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.355+0000 7fae57a00700 1 -- 172.21.15.55:0/2702821627 >> 172.21.15.55:0/2702821627 conn(0x7fae50076740 msgr2=0x7fae500fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.356+0000 7fae57a00700 1 -- 172.21.15.55:0/2702821627 shutdown_connections 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.356+0000 7fae57a00700 1 -- 172.21.15.55:0/2702821627 wait complete. 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.357+0000 7fae57a00700 1 Processor -- start 2024-04-26T21:17:20.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.357+0000 7fae57a00700 1 -- start start 2024-04-26T21:17:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.357+0000 7fae57a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae500ff8f0 0x7fae5019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae57a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae57a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5019f520 con 0x7fae501002a0 2024-04-26T21:17:20.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae57a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50198b00 con 0x7fae500ff8f0 2024-04-26T21:17:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53060/0 (socket says 172.21.15.55:53060) 2024-04-26T21:17:20.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 -- 172.21.15.55:0/3480936131 learned_addr learned my addr 172.21.15.55:0/3480936131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 -- 172.21.15.55:0/3480936131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae500ff8f0 msgr2=0x7fae5019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae500ff8f0 0x7fae5019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.358+0000 7fae47e00700 1 -- 172.21.15.55:0/3480936131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400095f0 con 0x7fae501002a0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae47e00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c8a0 tx=0x7fae3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae3800cea0 con 0x7fae501002a0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae38004830 con 0x7fae501002a0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae380055b0 con 0x7fae501002a0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50198de0 con 0x7fae501002a0 2024-04-26T21:17:20.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.359+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae50199330 con 0x7fae501002a0 2024-04-26T21:17:20.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.360+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50107870 con 0x7fae501002a0 2024-04-26T21:17:20.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.361+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fae380049a0 con 0x7fae501002a0 2024-04-26T21:17:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.363+0000 7fae4e000700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 0x7fae34071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.363+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fae3808ea40 con 0x7fae501002a0 2024-04-26T21:17:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.363+0000 7fae55000700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 0x7fae34071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.364+0000 7fae55000700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 0x7fae34071180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae40009fd0 tx=0x7fae4000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.368+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fae3805b3b0 con 0x7fae501002a0 2024-04-26T21:17:20.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.638+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae5010ff60 con 0x7fae3406ecc0 2024-04-26T21:17:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.671+0000 7fae4e000700 1 -- 172.21.15.55:0/3480936131 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fae5010ff60 con 0x7fae3406ecc0 2024-04-26T21:17:20.673 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:17:20.673 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (6m) 39s ago 20m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (21m) 39s ago 21m 8954k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (19m) 10s ago 19m 8472k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (2m) 39s ago 21m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (2m) 10s ago 19m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (5m) 39s ago 20m 73.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (13m) 39s ago 13m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (13m) 39s ago 13m 18.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (13m) 10s ago 13m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (13m) 10s ago 13m 18.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (9m) 39s ago 22m 506M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (8m) 10s ago 19m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:17:20.674 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (4m) 39s ago 23m 50.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (3m) 10s ago 19m 36.3M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (7m) 39s ago 21m 7708k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (7m) 10s ago 19m 7654k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (113s) 39s ago 18m 96.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (81s) 39s ago 17m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (47s) 39s ago 16m 12.6M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (15s) 10s ago 16m 11.1M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (15m) 10s ago 15m 273M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb 724dd870b1c2 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (15m) 10s ago 15m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:17:20.675 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (7m) 39s ago 20m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:17:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.674+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 msgr2=0x7fae34071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.674+0000 7fae57a00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 0x7fae34071180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae40009fd0 tx=0x7fae4000b540 comp rx=0 tx=0).stop 2024-04-26T21:17:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.674+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 msgr2=0x7fae5019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.674+0000 7fae57a00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c8a0 tx=0x7fae3800cc60 comp rx=0 tx=0).stop 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 shutdown_connections 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fae3406ecc0 0x7fae34071180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fae500ff8f0 0x7fae5019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 --2- 172.21.15.55:0/3480936131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae501002a0 0x7fae5019ef00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 >> 172.21.15.55:0/3480936131 conn(0x7fae50076740 msgr2=0x7fae500fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 shutdown_connections 2024-04-26T21:17:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.675+0000 7fae57a00700 1 -- 172.21.15.55:0/3480936131 wait complete. 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 -- 172.21.15.55:0/1871082037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107df0 msgr2=0x7f474810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 --2- 172.21.15.55:0/1871082037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107df0 0x7f474810be40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4734009910 tx=0x7f4734009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 -- 172.21.15.55:0/1871082037 shutdown_connections 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 --2- 172.21.15.55:0/1871082037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107df0 0x7f474810be40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 --2- 172.21.15.55:0/1871082037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107440 0x7f4748107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 -- 172.21.15.55:0/1871082037 >> 172.21.15.55:0/1871082037 conn(0x7f4748076a10 msgr2=0x7f4748078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 -- 172.21.15.55:0/1871082037 shutdown_connections 2024-04-26T21:17:20.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.831+0000 7f474e800700 1 -- 172.21.15.55:0/1871082037 wait complete. 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.832+0000 7f474e800700 1 Processor -- start 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.832+0000 7f474e800700 1 -- start start 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f474e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f474e800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107df0 0x7f474819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f474e800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474819dd70 con 0x7f4748107440 2024-04-26T21:17:20.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f474e800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47481a19f0 con 0x7f4748107df0 2024-04-26T21:17:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f4747400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f4747400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53070/0 (socket says 172.21.15.55:53070) 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f4747400700 1 -- 172.21.15.55:0/2429849460 learned_addr learned my addr 172.21.15.55:0/2429849460 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.833+0000 7f4746a00700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107df0 0x7f474819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f4747400700 1 -- 172.21.15.55:0/2429849460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107df0 msgr2=0x7f474819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f4747400700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107df0 0x7f474819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f4747400700 1 -- 172.21.15.55:0/2429849460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340095f0 con 0x7f4748107440 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f4747400700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f473800d8d0 tx=0x7f473800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4738009940 con 0x7f4748107440 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4738010460 con 0x7f4748107440 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47481a1cd0 con 0x7f4748107440 2024-04-26T21:17:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473800f5f0 con 0x7f4748107440 2024-04-26T21:17:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.834+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47481a2220 con 0x7f4748107440 2024-04-26T21:17:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.836+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474810f840 con 0x7f4748107440 2024-04-26T21:17:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.837+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f47380105d0 con 0x7f4748107440 2024-04-26T21:17:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.838+0000 7f473fe00700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 0x7f472c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.838+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f473808ecc0 con 0x7f4748107440 2024-04-26T21:17:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.838+0000 7f4746a00700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 0x7f472c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.839+0000 7f4746a00700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 0x7f472c071180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f474819e660 tx=0x7f473401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:20.842+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4738057ba0 con 0x7f4748107440 2024-04-26T21:17:21.175 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:20 smithi055 ceph-mon[109028]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:21.175 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:20 smithi055 ceph-mon[109028]: pgmap v147: 65 pgs: 3 peering, 1 active+undersized+degraded, 3 active+undersized, 58 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 623 B/s rd, 1 op/s; 3/222 objects degraded (1.351%) 2024-04-26T21:17:21.176 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:20 smithi055 ceph-mon[109028]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.173+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f474819e410 con 0x7f4748107440 2024-04-26T21:17:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.174+0000 7f473fe00700 1 -- 172.21.15.55:0/2429849460 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f473805b260 con 0x7f4748107440 2024-04-26T21:17:21.176 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:17:21.176 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:17:21.176 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 6, 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 8 2024-04-26T21:17:21.177 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:17:21.178 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:17:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.177+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 msgr2=0x7f472c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.177+0000 7f474e800700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 0x7f472c071180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f474819e660 tx=0x7f473401a040 comp rx=0 tx=0).stop 2024-04-26T21:17:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.177+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 msgr2=0x7f474819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.177+0000 7f474e800700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f473800d8d0 tx=0x7f473800dc90 comp rx=0 tx=0).stop 2024-04-26T21:17:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 shutdown_connections 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4748107440 0x7f474819d150 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f472c06ecc0 0x7f472c071180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 --2- 172.21.15.55:0/2429849460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4748107df0 0x7f474819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 >> 172.21.15.55:0/2429849460 conn(0x7f4748076a10 msgr2=0x7f4748076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 shutdown_connections 2024-04-26T21:17:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.178+0000 7f474e800700 1 -- 172.21.15.55:0/2429849460 wait complete. 2024-04-26T21:17:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 -- 172.21.15.55:0/3211578624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d88103040 msgr2=0x7f1d88103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 --2- 172.21.15.55:0/3211578624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d88103040 0x7f1d88103420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b0a0 tx=0x7f1d7800b3b0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 -- 172.21.15.55:0/3211578624 shutdown_connections 2024-04-26T21:17:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 --2- 172.21.15.55:0/3211578624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d881039f0 0x7f1d88107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 --2- 172.21.15.55:0/3211578624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d88103040 0x7f1d88103420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 -- 172.21.15.55:0/3211578624 >> 172.21.15.55:0/3211578624 conn(0x7f1d880fe8b0 msgr2=0x7f1d88100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.343+0000 7f1d8f200700 1 -- 172.21.15.55:0/3211578624 shutdown_connections 2024-04-26T21:17:21.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.344+0000 7f1d8f200700 1 -- 172.21.15.55:0/3211578624 wait complete. 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 Processor -- start 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 -- start start 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 0x7f1d88198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881999e0 con 0x7f1d881039f0 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d8f200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8819d6b0 con 0x7f1d88103040 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d7f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.345+0000 7f1d7f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53092/0 (socket says 172.21.15.55:53092) 2024-04-26T21:17:21.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d7f400700 1 -- 172.21.15.55:0/1433646329 learned_addr learned my addr 172.21.15.55:0/1433646329 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:21.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d87e00700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 0x7f1d88198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d7f400700 1 -- 172.21.15.55:0/1433646329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 msgr2=0x7f1d88198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d7f400700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 0x7f1d88198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d7f400700 1 -- 172.21.15.55:0/1433646329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009d00 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d87e00700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 0x7f1d88198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d7f400700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000d900 tx=0x7f1d7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.346+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d70009900 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.347+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d70010460 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.347+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7000f5f0 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.347+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8819d990 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.347+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8819dee0 con 0x7f1d881039f0 2024-04-26T21:17:21.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.348+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8810b3e0 con 0x7f1d881039f0 2024-04-26T21:17:21.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.349+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1d700105d0 con 0x7f1d881039f0 2024-04-26T21:17:21.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.350+0000 7f1d85600700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 0x7f1d6c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.350+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1d7008ec10 con 0x7f1d881039f0 2024-04-26T21:17:21.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.350+0000 7f1d87e00700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 0x7f1d6c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.351+0000 7f1d87e00700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 0x7f1d6c071180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009480 tx=0x7f1d780097c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.355+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1d70057a70 con 0x7f1d881039f0 2024-04-26T21:17:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:20 smithi064 ceph-mon[84240]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:20 smithi064 ceph-mon[84240]: pgmap v147: 65 pgs: 3 peering, 1 active+undersized+degraded, 3 active+undersized, 58 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 623 B/s rd, 1 op/s; 3/222 objects degraded (1.351%) 2024-04-26T21:17:21.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:20 smithi064 ceph-mon[84240]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.636+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d8819a0d0 con 0x7f1d881039f0 2024-04-26T21:17:21.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.637+0000 7f1d85600700 1 -- 172.21.15.55:0/1433646329 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f1d7005b130 con 0x7f1d881039f0 2024-04-26T21:17:21.639 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:17:21.639 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:17:21.640 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:17:21.641 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:21.642 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 msgr2=0x7f1d6c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 0x7f1d6c071180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009480 tx=0x7f1d780097c0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 msgr2=0x7f1d88199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000d900 tx=0x7f1d7000dcc0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 shutdown_connections 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1d6c06ecc0 0x7f1d6c071180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1d88103040 0x7f1d88198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 --2- 172.21.15.55:0/1433646329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d881039f0 0x7f1d88199300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.640+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 >> 172.21.15.55:0/1433646329 conn(0x7f1d880fe8b0 msgr2=0x7f1d880fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.641+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 shutdown_connections 2024-04-26T21:17:21.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.641+0000 7f1d8f200700 1 -- 172.21.15.55:0/1433646329 wait complete. 2024-04-26T21:17:21.644 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:17:21.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 -- 172.21.15.55:0/3762327593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 msgr2=0x7f087410ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 --2- 172.21.15.55:0/3762327593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f087410ab70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0860009910 tx=0x7f0860009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:21.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 -- 172.21.15.55:0/3762327593 shutdown_connections 2024-04-26T21:17:21.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 --2- 172.21.15.55:0/3762327593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f087410ab70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 --2- 172.21.15.55:0/3762327593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 0x7f0874102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.802+0000 7f087ba00700 1 -- 172.21.15.55:0/3762327593 >> 172.21.15.55:0/3762327593 conn(0x7f0874076740 msgr2=0x7f08740fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.803+0000 7f087ba00700 1 -- 172.21.15.55:0/3762327593 shutdown_connections 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.803+0000 7f087ba00700 1 -- 172.21.15.55:0/3762327593 wait complete. 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 Processor -- start 2024-04-26T21:17:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 -- start start 2024-04-26T21:17:21.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 0x7f0874198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874199850 con 0x7f0874102680 2024-04-26T21:17:21.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.804+0000 7f087ba00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08741999c0 con 0x7f0874101d60 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53100/0 (socket says 172.21.15.55:53100) 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 -- 172.21.15.55:0/2243615702 learned_addr learned my addr 172.21.15.55:0/2243615702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0879000700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 0x7f0874198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 -- 172.21.15.55:0/2243615702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 msgr2=0x7f0874198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 0x7f0874198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:21.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.805+0000 7f0873e00700 1 -- 172.21.15.55:0/2243615702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600095f0 con 0x7f0874102680 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f0873e00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08600092e0 tx=0x7f086000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086001d070 con 0x7f0874102680 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087419c640 con 0x7f0874102680 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0860003d50 con 0x7f0874102680 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087419cb30 con 0x7f0874102680 2024-04-26T21:17:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.806+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0860022420 con 0x7f0874102680 2024-04-26T21:17:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.808+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0874068ea0 con 0x7f0874102680 2024-04-26T21:17:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.809+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0860003890 con 0x7f0874102680 2024-04-26T21:17:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.809+0000 7f0871600700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 0x7f085c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.810+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0860090330 con 0x7f0874102680 2024-04-26T21:17:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.810+0000 7f0879000700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 0x7f085c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.811+0000 7f0879000700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 0x7f085c071190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0868005ea0 tx=0x7f0868005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:21.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:21.815+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0860059190 con 0x7f0874102680 2024-04-26T21:17:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.066+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f087410de30 con 0x7f085c06ecd0 2024-04-26T21:17:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.068+0000 7f0871600700 1 -- 172.21.15.55:0/2243615702 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f087410de30 con 0x7f085c06ecd0 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:17:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:17:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "10/23 daemons upgraded", 2024-04-26T21:17:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:17:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:17:22.071 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:17:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 msgr2=0x7f085c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 0x7f085c071190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0868005ea0 tx=0x7f0868005e30 comp rx=0 tx=0).stop 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 msgr2=0x7f0874199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08600092e0 tx=0x7f086000be20 comp rx=0 tx=0).stop 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 shutdown_connections 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f085c06ecd0 0x7f085c071190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0874101d60 0x7f0874198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 --2- 172.21.15.55:0/2243615702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0874102680 0x7f0874199250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 >> 172.21.15.55:0/2243615702 conn(0x7f0874076740 msgr2=0x7f087410a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 shutdown_connections 2024-04-26T21:17:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.071+0000 7f087ba00700 1 -- 172.21.15.55:0/2243615702 wait complete. 2024-04-26T21:17:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 -- 172.21.15.55:0/518785967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 msgr2=0x7fbea0068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 --2- 172.21.15.55:0/518785967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea0068f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009910 tx=0x7fbe8c009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 -- 172.21.15.55:0/518785967 shutdown_connections 2024-04-26T21:17:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 --2- 172.21.15.55:0/518785967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea0068f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 --2- 172.21.15.55:0/518785967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 0x7fbea00685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 -- 172.21.15.55:0/518785967 >> 172.21.15.55:0/518785967 conn(0x7fbea0075460 msgr2=0x7fbea0075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:21 smithi055 ceph-mon[109028]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:22.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:21 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2429849460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:22.220 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:21 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1433646329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:17:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 -- 172.21.15.55:0/518785967 shutdown_connections 2024-04-26T21:17:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.218+0000 7fbea5e00700 1 -- 172.21.15.55:0/518785967 wait complete. 2024-04-26T21:17:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.219+0000 7fbea5e00700 1 Processor -- start 2024-04-26T21:17:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.219+0000 7fbea5e00700 1 -- start start 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea5e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea5e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 0x7fbea019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea5e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea019daf0 con 0x7fbea0068b00 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea5e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea01a1770 con 0x7fbea0105970 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53120/0 (socket says 172.21.15.55:53120) 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbea4a00700 1 -- 172.21.15.55:0/2505731959 learned_addr learned my addr 172.21.15.55:0/2505731959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.220+0000 7fbe9fe00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 0x7fbea019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea4a00700 1 -- 172.21.15.55:0/2505731959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 msgr2=0x7fbea019d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea4a00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 0x7fbea019d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea4a00700 1 -- 172.21.15.55:0/2505731959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0095f0 con 0x7fbea0068b00 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea4a00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c8a0 tx=0x7fbe9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9400cea0 con 0x7fbea0068b00 2024-04-26T21:17:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe94004830 con 0x7fbea0068b00 2024-04-26T21:17:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea01a1a50 con 0x7fbea0068b00 2024-04-26T21:17:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe940055b0 con 0x7fbea0068b00 2024-04-26T21:17:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.221+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01a2020 con 0x7fbea0068b00 2024-04-26T21:17:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.223+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0110050 con 0x7fbea0068b00 2024-04-26T21:17:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.224+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbe940049a0 con 0x7fbea0068b00 2024-04-26T21:17:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.224+0000 7fbe9d600700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 0x7fbe88071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.225+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbe9408e9a0 con 0x7fbea0068b00 2024-04-26T21:17:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.225+0000 7fbe9fe00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 0x7fbe88071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.225+0000 7fbe9fe00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 0x7fbe88071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005f50 tx=0x7fbe8c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:22.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.229+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fbe94057880 con 0x7fbea0068b00 2024-04-26T21:17:22.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:21 smithi064 ceph-mon[84240]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:21 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2429849460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:22.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:21 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1433646329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:17:22.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.537+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbea00fff40 con 0x7fbea0068b00 2024-04-26T21:17:22.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.538+0000 7fbe9d600700 1 -- 172.21.15.55:0/2505731959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbe9401d090 con 0x7fbea0068b00 2024-04-26T21:17:22.539 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:17:22.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 msgr2=0x7fbe88071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 0x7fbe88071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c005f50 tx=0x7fbe8c01a040 comp rx=0 tx=0).stop 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 msgr2=0x7fbea019ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c8a0 tx=0x7fbe9400cc60 comp rx=0 tx=0).stop 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 shutdown_connections 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbea0068b00 0x7fbea019ced0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbe8806ecc0 0x7fbe88071180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 --2- 172.21.15.55:0/2505731959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbea0105970 0x7fbea019d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 >> 172.21.15.55:0/2505731959 conn(0x7fbea0075460 msgr2=0x7fbea0101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 shutdown_connections 2024-04-26T21:17:22.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:22.541+0000 7fbea5e00700 1 -- 172.21.15.55:0/2505731959 wait complete. 2024-04-26T21:17:23.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:22 smithi064 ceph-mon[84240]: pgmap v148: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-26T21:17:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:22 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded) 2024-04-26T21:17:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:22 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:17:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:22 smithi064 ceph-mon[84240]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:23.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:22 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2505731959' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:17:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:22 smithi055 ceph-mon[109028]: pgmap v148: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-26T21:17:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:22 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded) 2024-04-26T21:17:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:22 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:17:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:22 smithi055 ceph-mon[109028]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:22 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2505731959' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:17:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:24 smithi055 ceph-mon[109028]: pgmap v149: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:25.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:24 smithi064 ceph-mon[84240]: pgmap v149: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:27.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:26 smithi055 ceph-mon[109028]: pgmap v150: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-26T21:17:27.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:27.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:26 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:26 smithi064 ceph-mon[84240]: pgmap v150: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-04-26T21:17:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:26 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:29.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:28 smithi055 ceph-mon[109028]: pgmap v151: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 805 B/s rd, 1 op/s 2024-04-26T21:17:29.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:28 smithi064 ceph-mon[84240]: pgmap v151: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 805 B/s rd, 1 op/s 2024-04-26T21:17:31.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:30 smithi055 ceph-mon[109028]: pgmap v152: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:30 smithi064 ceph-mon[84240]: pgmap v152: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:33.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:32 smithi055 ceph-mon[109028]: pgmap v153: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:17:33.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:32 smithi064 ceph-mon[84240]: pgmap v153: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:17:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:34 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:34 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:34.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:34 smithi055 ceph-mon[109028]: Upgrade: osd.4 is safe to restart 2024-04-26T21:17:34.301 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:34 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:34.301 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:34 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-26T21:17:34.301 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:34 smithi064 ceph-mon[84240]: Upgrade: osd.4 is safe to restart 2024-04-26T21:17:35.318 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:35 smithi064 ceph-mon[84240]: pgmap v154: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:35 smithi055 ceph-mon[109028]: pgmap v154: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: Upgrade: Updating osd.4 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: Deploying daemon osd.4 on smithi064 2024-04-26T21:17:36.848 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:36 smithi064 ceph-mon[84240]: pgmap v155: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: Upgrade: Updating osd.4 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: Deploying daemon osd.4 on smithi064 2024-04-26T21:17:37.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:36 smithi055 ceph-mon[109028]: pgmap v155: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:38.918 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:38 smithi064 ceph-mon[84240]: pgmap v156: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:39.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:38 smithi055 ceph-mon[109028]: pgmap v156: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:40.875 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:40 smithi064 systemd[1]: Stopping Ceph osd.4 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:17:41.142 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:40 smithi055 ceph-mon[109028]: pgmap v157: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:41.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:40 smithi064 ceph-mon[84240]: pgmap v157: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:41.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[46119]: 2024-04-26T21:17:40.872+0000 7f90e0e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:17:41.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[46119]: 2024-04-26T21:17:40.872+0000 7f90e0e00700 -1 osd.4 69 *** Got signal Terminated *** 2024-04-26T21:17:41.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[46119]: 2024-04-26T21:17:40.872+0000 7f90e0e00700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:17:42.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:41 smithi064 ceph-mon[84240]: osd.4 marked itself down and dead 2024-04-26T21:17:42.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:41 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:41 smithi055 ceph-mon[109028]: osd.4 marked itself down and dead 2024-04-26T21:17:42.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:41 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:42.896 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:42 smithi064 podman[98878]: 2024-04-26 21:17:42.574413563 +0000 UTC m=+1.838562274 container died 724dd870b1c21e31a8ba02cd6247d758730f799125343de94839246030d79ef7 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, io.buildah.version=1.33.5, ceph=True, RELEASE=reef-7d2137f, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T21:17:43.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:42 smithi064 ceph-mon[84240]: pgmap v158: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:43.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:42 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:17:43.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:42 smithi064 ceph-mon[84240]: osdmap e70: 6 total, 5 up, 6 in 2024-04-26T21:17:43.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:43 smithi064 podman[98878]: 2024-04-26 21:17:43.031461477 +0000 UTC m=+2.295610154 container cleanup 724dd870b1c21e31a8ba02cd6247d758730f799125343de94839246030d79ef7 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, RELEASE=reef-7d2137f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T21:17:43.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:43 smithi064 bash[98878]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4 2024-04-26T21:17:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:42 smithi055 ceph-mon[109028]: pgmap v158: 65 pgs: 65 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:42 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:17:43.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:42 smithi055 ceph-mon[109028]: osdmap e70: 6 total, 5 up, 6 in 2024-04-26T21:17:43.656 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:43 smithi064 podman[98897]: 2024-04-26 21:17:43.20750301 +0000 UTC m=+0.619162648 container remove 724dd870b1c21e31a8ba02cd6247d758730f799125343de94839246030d79ef7 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=reef-7d2137f) 2024-04-26T21:17:44.217 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:43 smithi064 ceph-mon[84240]: osdmap e71: 6 total, 5 up, 6 in 2024-04-26T21:17:44.217 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:43.982367272 +0000 UTC m=+0.047642281 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:44.217 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:44.083363121 +0000 UTC m=+0.148638117 container create 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T21:17:44.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:43 smithi055 ceph-mon[109028]: osdmap e71: 6 total, 5 up, 6 in 2024-04-26T21:17:44.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:44.356434077 +0000 UTC m=+0.421709089 container init 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T21:17:44.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:44.368379588 +0000 UTC m=+0.433654606 container start 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-26T21:17:44.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:44.444370685 +0000 UTC m=+0.509645733 container attach 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:17:45.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:44 smithi064 podman[98987]: 2024-04-26 21:17:44.840434679 +0000 UTC m=+0.905709717 container died 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T21:17:45.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:44 smithi064 ceph-mon[84240]: pgmap v161: 65 pgs: 5 active+undersized+degraded, 13 peering, 3 stale+active+clean, 6 active+undersized, 38 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 17/222 objects degraded (7.658%) 2024-04-26T21:17:45.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:44 smithi064 ceph-mon[84240]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-26T21:17:45.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:44 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 17/222 objects degraded (7.658%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:44 smithi055 ceph-mon[109028]: pgmap v161: 65 pgs: 5 active+undersized+degraded, 13 peering, 3 stale+active+clean, 6 active+undersized, 38 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 17/222 objects degraded (7.658%) 2024-04-26T21:17:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:44 smithi055 ceph-mon[109028]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-26T21:17:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:44 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 17/222 objects degraded (7.658%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:45.907 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:45 smithi064 podman[99013]: 2024-04-26 21:17:45.587748315 +0000 UTC m=+0.728422341 container remove 65b717a9b033d806c501d2fdd1000004515527744bdb1d9055298d9ccb2e9473 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-26T21:17:45.907 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:45 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-26T21:17:45.907 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:45 smithi064 systemd[1]: Stopped Ceph osd.4 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:17:45.907 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:45 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.4.service: Consumed 2min 1.709s CPU time. 2024-04-26T21:17:46.376 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 systemd[1]: Starting Ceph osd.4 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:17:46.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 podman[99113]: 2024-04-26 21:17:46.28194256 +0000 UTC m=+0.038648215 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:46.684 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 podman[99113]: 2024-04-26 21:17:46.415375274 +0000 UTC m=+0.172080949 container create f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T21:17:46.938 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 podman[99113]: 2024-04-26 21:17:46.672607709 +0000 UTC m=+0.429313400 container init f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-04-26T21:17:46.938 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 podman[99113]: 2024-04-26 21:17:46.686967765 +0000 UTC m=+0.443673413 container start f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T21:17:46.938 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:46 smithi064 podman[99113]: 2024-04-26 21:17:46.767837553 +0000 UTC m=+0.524543258 container attach f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:17:47.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:46 smithi055 ceph-mon[109028]: pgmap v162: 65 pgs: 8 active+undersized+degraded, 13 peering, 1 stale+active+clean, 11 active+undersized, 32 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-26T21:17:47.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:46 smithi064 ceph-mon[84240]: pgmap v162: 65 pgs: 8 active+undersized+degraded, 13 peering, 1 stale+active+clean, 11 active+undersized, 32 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 25/222 objects degraded (11.261%) 2024-04-26T21:17:47.993 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 bash[99113]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-26T21:17:47.994 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-26T21:17:47.995 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-26T21:17:47.995 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-26T21:17:47.995 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:17:47.995 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate[99127]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-26T21:17:47.995 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:47 smithi064 podman[99113]: 2024-04-26 21:17:47.743249329 +0000 UTC m=+1.499954991 container died f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-26T21:17:48.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:47 smithi055 ceph-mon[109028]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-26T21:17:48.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:47 smithi064 ceph-mon[84240]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-26T21:17:48.892 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:48 smithi064 podman[99253]: 2024-04-26 21:17:48.521711318 +0000 UTC m=+0.758515425 container remove f474846069dbd12ca19b24bb2e96eec551c56c11a9ee0d96ac3827220c7b751e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-activate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:17:49.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:48 smithi064 ceph-mon[84240]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:49.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:48 smithi064 podman[99316]: 2024-04-26 21:17:48.801603466 +0000 UTC m=+0.043217645 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:17:49.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:48 smithi064 podman[99316]: 2024-04-26 21:17:48.914036988 +0000 UTC m=+0.155651154 container create 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T21:17:49.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:48 smithi055 ceph-mon[109028]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:49.656 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 podman[99316]: 2024-04-26 21:17:49.167374693 +0000 UTC m=+0.408988883 container init 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T21:17:49.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 podman[99316]: 2024-04-26 21:17:49.178739156 +0000 UTC m=+0.420353324 container start 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:17:49.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 ceph-osd[99335]: -- 172.21.15.64:0/3386022735 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563411353680 con 0x56341131d000 2024-04-26T21:17:49.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 bash[99316]: 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d 2024-04-26T21:17:49.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 systemd[1]: Started Ceph osd.4 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:17:50.156 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:49 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:17:49.773+0000 7f84236067c0 -1 Falling back to public interface 2024-04-26T21:17:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:51.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:51 smithi055 ceph-mon[109028]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:51.768 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:51 smithi064 ceph-mon[84240]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:52.720 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:52 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 -- 172.21.15.55:0/1563236974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac105970 msgr2=0x7f64ac0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 --2- 172.21.15.55:0/1563236974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac105970 0x7f64ac0685c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f649c009910 tx=0x7f649c009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 -- 172.21.15.55:0/1563236974 shutdown_connections 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 --2- 172.21.15.55:0/1563236974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac068b00 0x7f64ac068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 --2- 172.21.15.55:0/1563236974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac105970 0x7f64ac0685c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.718+0000 7f64b1400700 1 -- 172.21.15.55:0/1563236974 >> 172.21.15.55:0/1563236974 conn(0x7f64ac075460 msgr2=0x7f64ac075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.719+0000 7f64b1400700 1 -- 172.21.15.55:0/1563236974 shutdown_connections 2024-04-26T21:17:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.719+0000 7f64b1400700 1 -- 172.21.15.55:0/1563236974 wait complete. 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 Processor -- start 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 -- start start 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 0x7f64ac19d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac19daf0 con 0x7f64ac068b00 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.720+0000 7f64b1400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1a1770 con 0x7f64ac105970 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48994/0 (socket says 172.21.15.55:48994) 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 -- 172.21.15.55:0/1826232040 learned_addr learned my addr 172.21.15.55:0/1826232040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:52.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64ab400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 0x7f64ac19d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 -- 172.21.15.55:0/1826232040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 msgr2=0x7f64ac19d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 0x7f64ac19d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64abe00700 1 -- 172.21.15.55:0/1826232040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0095f0 con 0x7f64ac068b00 2024-04-26T21:17:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.721+0000 7f64ab400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 0x7f64ac19d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:17:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64abe00700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f649c0092e0 tx=0x7f649c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f649c01d070 con 0x7f64ac068b00 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f649c0052a0 con 0x7f64ac068b00 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f649c017400 con 0x7f64ac068b00 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac1a19f0 con 0x7f64ac068b00 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.722+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac1a1f60 con 0x7f64ac068b00 2024-04-26T21:17:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.723+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac110050 con 0x7f64ac068b00 2024-04-26T21:17:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.724+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f649c00f820 con 0x7f64ac068b00 2024-04-26T21:17:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.725+0000 7f64a8c00700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 0x7f6490071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.725+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f649c090080 con 0x7f64ac068b00 2024-04-26T21:17:52.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.726+0000 7f64ab400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 0x7f6490071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:52.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.726+0000 7f64ab400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 0x7f6490071190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64ac19e3e0 tx=0x7f6498009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.731+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f649c058ec0 con 0x7f64ac068b00 2024-04-26T21:17:52.847 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:52 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-04-26T21:17:52.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.984+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64ac19e190 con 0x7f649006ecd0 2024-04-26T21:17:52.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.987+0000 7f64a8c00700 1 -- 172.21.15.55:0/1826232040 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f64ac19e190 con 0x7f649006ecd0 2024-04-26T21:17:52.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 msgr2=0x7f6490071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 0x7f6490071190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64ac19e3e0 tx=0x7f6498009260 comp rx=0 tx=0).stop 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 msgr2=0x7f64ac19ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f649c0092e0 tx=0x7f649c00b6c0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 shutdown_connections 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64ac068b00 0x7f64ac19ced0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f649006ecd0 0x7f6490071190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 --2- 172.21.15.55:0/1826232040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64ac105970 0x7f64ac19d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 >> 172.21.15.55:0/1826232040 conn(0x7f64ac075460 msgr2=0x7f64ac101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 shutdown_connections 2024-04-26T21:17:52.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:52.990+0000 7f64b1400700 1 -- 172.21.15.55:0/1826232040 wait complete. 2024-04-26T21:17:53.009 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 -- 172.21.15.55:0/1952614725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe558103040 msgr2=0x7fe558103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 --2- 172.21.15.55:0/1952614725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe558103040 0x7fe558103420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe548009910 tx=0x7fe548009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 -- 172.21.15.55:0/1952614725 shutdown_connections 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 --2- 172.21.15.55:0/1952614725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5581039f0 0x7fe558107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 --2- 172.21.15.55:0/1952614725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe558103040 0x7fe558103420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 -- 172.21.15.55:0/1952614725 >> 172.21.15.55:0/1952614725 conn(0x7fe5580fe8b0 msgr2=0x7fe558100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 -- 172.21.15.55:0/1952614725 shutdown_connections 2024-04-26T21:17:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.158+0000 7fe55ca00700 1 -- 172.21.15.55:0/1952614725 wait complete. 2024-04-26T21:17:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.159+0000 7fe55ca00700 1 Processor -- start 2024-04-26T21:17:53.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe55ca00700 1 -- start start 2024-04-26T21:17:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe55ca00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe558103040 0x7fe558198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe55ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe55ca00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581998a0 con 0x7fe5581039f0 2024-04-26T21:17:53.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe55ca00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558199a10 con 0x7fe558103040 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.160+0000 7fe555400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49006/0 (socket says 172.21.15.55:49006) 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 -- 172.21.15.55:0/2302771130 learned_addr learned my addr 172.21.15.55:0/2302771130 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555e00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe558103040 0x7fe558198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 -- 172.21.15.55:0/2302771130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe558103040 msgr2=0x7fe558198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe558103040 0x7fe558198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 -- 172.21.15.55:0/2302771130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480095f0 con 0x7fe5581039f0 2024-04-26T21:17:53.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.161+0000 7fe555400700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c960 tx=0x7fe54400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.162+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe544007a70 con 0x7fe5581039f0 2024-04-26T21:17:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.162+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe544007bd0 con 0x7fe5581039f0 2024-04-26T21:17:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.162+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe544018630 con 0x7fe5581039f0 2024-04-26T21:17:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.162+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55819c6a0 con 0x7fe5581039f0 2024-04-26T21:17:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.162+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55819cbf0 con 0x7fe5581039f0 2024-04-26T21:17:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.163+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55810b3e0 con 0x7fe5581039f0 2024-04-26T21:17:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.165+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe54400f450 con 0x7fe5581039f0 2024-04-26T21:17:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.166+0000 7fe54ea00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 0x7fe53c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.166+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe54408ed40 con 0x7fe5581039f0 2024-04-26T21:17:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.166+0000 7fe555e00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 0x7fe53c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.167+0000 7fe555e00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 0x7fe53c071190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe548006010 tx=0x7fe54801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.171+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe544057c30 con 0x7fe5581039f0 2024-04-26T21:17:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.428+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe558110010 con 0x7fe53c06ecd0 2024-04-26T21:17:53.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.431+0000 7fe54ea00700 1 -- 172.21.15.55:0/2302771130 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe558110010 con 0x7fe53c06ecd0 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 msgr2=0x7fe53c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 0x7fe53c071190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe548006010 tx=0x7fe54801a040 comp rx=0 tx=0).stop 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 msgr2=0x7fe5581992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c960 tx=0x7fe54400cc70 comp rx=0 tx=0).stop 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 shutdown_connections 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe53c06ecd0 0x7fe53c071190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe558103040 0x7fe558198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 --2- 172.21.15.55:0/2302771130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5581039f0 0x7fe5581992a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 >> 172.21.15.55:0/2302771130 conn(0x7fe5580fe8b0 msgr2=0x7fe5580ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 shutdown_connections 2024-04-26T21:17:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.434+0000 7fe55ca00700 1 -- 172.21.15.55:0/2302771130 wait complete. 2024-04-26T21:17:53.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 -- 172.21.15.55:0/3112636611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 msgr2=0x7f8a74102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 --2- 172.21.15.55:0/3112636611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a74102140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b0a0 tx=0x7f8a6800b3b0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 -- 172.21.15.55:0/3112636611 shutdown_connections 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 --2- 172.21.15.55:0/3112636611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 0x7f8a7410ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 --2- 172.21.15.55:0/3112636611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a74102140 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 -- 172.21.15.55:0/3112636611 >> 172.21.15.55:0/3112636611 conn(0x7f8a74076740 msgr2=0x7f8a740fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 -- 172.21.15.55:0/3112636611 shutdown_connections 2024-04-26T21:17:53.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.602+0000 7f8a7c000700 1 -- 172.21.15.55:0/3112636611 wait complete. 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.603+0000 7f8a7c000700 1 Processor -- start 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.603+0000 7f8a7c000700 1 -- start start 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a7c000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a7c000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 0x7f8a7419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a7c000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7419d3a0 con 0x7f8a74101d60 2024-04-26T21:17:53.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a7c000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74196980 con 0x7f8a74102680 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49020/0 (socket says 172.21.15.55:49020) 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 -- 172.21.15.55:0/2140249799 learned_addr learned my addr 172.21.15.55:0/2140249799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a78c00700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 0x7f8a7419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 -- 172.21.15.55:0/2140249799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 msgr2=0x7f8a7419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 0x7f8a7419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.604+0000 7f8a79600700 1 -- 172.21.15.55:0/2140249799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009d00 con 0x7f8a74101d60 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a79600700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b070 tx=0x7f8a6800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6800e040 con 0x7f8a74101d60 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a68004040 con 0x7f8a74101d60 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6801d6b0 con 0x7f8a74101d60 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a74196c00 con 0x7f8a74101d60 2024-04-26T21:17:53.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.605+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a741970f0 con 0x7f8a74101d60 2024-04-26T21:17:53.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.606+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a741054f0 con 0x7f8a74101d60 2024-04-26T21:17:53.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.608+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8a680046d0 con 0x7f8a74101d60 2024-04-26T21:17:53.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.608+0000 7f8a72000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 0x7f8a5c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:53.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.609+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8a68090d10 con 0x7f8a74101d60 2024-04-26T21:17:53.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.609+0000 7f8a78c00700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 0x7f8a5c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:53.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.610+0000 7f8a78c00700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 0x7f8a5c071190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a74197b40 tx=0x7f8a60009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:53.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.612+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8a6805d7c0 con 0x7f8a74101d60 2024-04-26T21:17:53.742 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:53 smithi064 ceph-mon[84240]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 826 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:53 smithi055 ceph-mon[109028]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 826 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:53.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.857+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a74197eb0 con 0x7f8a5c06ecd0 2024-04-26T21:17:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.869+0000 7f8a72000700 1 -- 172.21.15.55:0/2140249799 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f8a74197eb0 con 0x7f8a5c06ecd0 2024-04-26T21:17:53.871 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:17:53.871 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (7m) 72s ago 21m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (21m) 72s ago 21m 8954k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (20m) 43s ago 20m 8472k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (3m) 72s ago 21m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (2m) 43s ago 20m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (6m) 72s ago 21m 73.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (13m) 72s ago 13m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (13m) 72s ago 13m 18.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (13m) 43s ago 13m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (13m) 43s ago 13m 18.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (10m) 72s ago 23m 506M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (8m) 43s ago 19m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (4m) 72s ago 23m 50.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:17:53.872 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (4m) 43s ago 19m 36.3M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (8m) 72s ago 21m 7708k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (8m) 43s ago 20m 7654k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (2m) 72s ago 18m 96.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (114s) 72s ago 18m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (80s) 72s ago 17m 12.6M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (49s) 43s ago 16m 11.1M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 starting - - - 2240M 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (15m) 43s ago 15m 244M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (7m) 72s ago 20m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:17:53.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 msgr2=0x7f8a5c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 0x7f8a5c071190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a74197b40 tx=0x7f8a60009260 comp rx=0 tx=0).stop 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 msgr2=0x7f8a7419c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b070 tx=0x7f8a6800cf10 comp rx=0 tx=0).stop 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 shutdown_connections 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a74101d60 0x7f8a7419c840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f8a5c06ecd0 0x7f8a5c071190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 --2- 172.21.15.55:0/2140249799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a74102680 0x7f8a7419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.872+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 >> 172.21.15.55:0/2140249799 conn(0x7f8a74076740 msgr2=0x7f8a74103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.873+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 shutdown_connections 2024-04-26T21:17:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:53.873+0000 7f8a7c000700 1 -- 172.21.15.55:0/2140249799 wait complete. 2024-04-26T21:17:54.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 -- 172.21.15.55:0/3795279095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82441026d0 msgr2=0x7f824410abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 --2- 172.21.15.55:0/3795279095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82441026d0 0x7f824410abc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8230009910 tx=0x7f8230009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:54.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 -- 172.21.15.55:0/3795279095 shutdown_connections 2024-04-26T21:17:54.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 --2- 172.21.15.55:0/3795279095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82441026d0 0x7f824410abc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 --2- 172.21.15.55:0/3795279095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 0x7f8244102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 -- 172.21.15.55:0/3795279095 >> 172.21.15.55:0/3795279095 conn(0x7f82440fb5e0 msgr2=0x7f82440fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.029+0000 7f8249a00700 1 -- 172.21.15.55:0/3795279095 shutdown_connections 2024-04-26T21:17:54.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.030+0000 7f8249a00700 1 -- 172.21.15.55:0/3795279095 wait complete. 2024-04-26T21:17:54.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 Processor -- start 2024-04-26T21:17:54.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 -- start start 2024-04-26T21:17:54.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 0x7f82440ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244101960 con 0x7f82440fff50 2024-04-26T21:17:54.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.031+0000 7f8249a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82441a2f60 con 0x7f8244101db0 2024-04-26T21:17:54.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49034/0 (socket says 172.21.15.55:49034) 2024-04-26T21:17:54.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 -- 172.21.15.55:0/272799029 learned_addr learned my addr 172.21.15.55:0/272799029 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:54.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 0x7f82440ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 -- 172.21.15.55:0/272799029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 msgr2=0x7f82440ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 0x7f82440ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 -- 172.21.15.55:0/272799029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82300095f0 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.032+0000 7f8242000700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8230009910 tx=0x7f823000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.033+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823001d070 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.033+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8230003d10 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.033+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823000fdc0 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.033+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82441a3100 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.033+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82441a35c0 con 0x7f82440fff50 2024-04-26T21:17:54.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.034+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824410a8e0 con 0x7f82440fff50 2024-04-26T21:17:54.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.035+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f823000f660 con 0x7f82440fff50 2024-04-26T21:17:54.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.036+0000 7f823b400700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 0x7f8228071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.036+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f823008ffe0 con 0x7f82440fff50 2024-04-26T21:17:54.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.037+0000 7f8242a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 0x7f8228071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.037+0000 7f8242a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 0x7f8228071180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82340060b0 tx=0x7f8234008640 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:54.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.041+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f82300c5060 con 0x7f82440fff50 2024-04-26T21:17:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.361+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8244100ef0 con 0x7f82440fff50 2024-04-26T21:17:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.362+0000 7f823b400700 1 -- 172.21.15.55:0/272799029 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f8230058e20 con 0x7f82440fff50 2024-04-26T21:17:54.364 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:17:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:17:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 1, 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:17:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 5, 2024-04-26T21:17:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 8 2024-04-26T21:17:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:17:54.366 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 msgr2=0x7f8228071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 0x7f8228071180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82340060b0 tx=0x7f8234008640 comp rx=0 tx=0).stop 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 msgr2=0x7f82441003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8230009910 tx=0x7f823000bbf0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 shutdown_connections 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f822806ecc0 0x7f8228071180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8244101db0 0x7f82440ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 --2- 172.21.15.55:0/272799029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82440fff50 0x7f82441003d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 >> 172.21.15.55:0/272799029 conn(0x7f82440fb5e0 msgr2=0x7f82441030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 shutdown_connections 2024-04-26T21:17:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.366+0000 7f8249a00700 1 -- 172.21.15.55:0/272799029 wait complete. 2024-04-26T21:17:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 -- 172.21.15.55:0/3806930046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 msgr2=0x7f3c38073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/3806930046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c38073690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009910 tx=0x7f3c28009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 -- 172.21.15.55:0/3806930046 shutdown_connections 2024-04-26T21:17:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/3806930046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 0x7f3c3810cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/3806930046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c38073690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.533+0000 7f3c3dc00700 1 -- 172.21.15.55:0/3806930046 >> 172.21.15.55:0/3806930046 conn(0x7f3c380fc6d0 msgr2=0x7f3c380feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.534+0000 7f3c3dc00700 1 -- 172.21.15.55:0/3806930046 shutdown_connections 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.534+0000 7f3c3dc00700 1 -- 172.21.15.55:0/3806930046 wait complete. 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 Processor -- start 2024-04-26T21:17:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 -- start start 2024-04-26T21:17:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 0x7f3c3819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3819f5d0 con 0x7f3c380732b0 2024-04-26T21:17:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.535+0000 7f3c3dc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38198b50 con 0x7f3c38073bd0 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49044/0 (socket says 172.21.15.55:49044) 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 -- 172.21.15.55:0/1390931250 learned_addr learned my addr 172.21.15.55:0/1390931250 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36000700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 0x7f3c3819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 -- 172.21.15.55:0/1390931250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 msgr2=0x7f3c3819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 0x7f3c3819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 -- 172.21.15.55:0/1390931250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280095f0 con 0x7f3c380732b0 2024-04-26T21:17:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.536+0000 7f3c36a00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c280092e0 tx=0x7f3c2800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.537+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2801d070 con 0x7f3c380732b0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.537+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c280056e0 con 0x7f3c380732b0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.537+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c38198dd0 con 0x7f3c380732b0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.537+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2800fe80 con 0x7f3c380732b0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.537+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381992c0 con 0x7f3c380732b0 2024-04-26T21:17:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.538+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c381077c0 con 0x7f3c380732b0 2024-04-26T21:17:54.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.539+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3c2800f6f0 con 0x7f3c380732b0 2024-04-26T21:17:54.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.540+0000 7f3c2f400700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 0x7f3c1c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.540+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3c280901e0 con 0x7f3c380732b0 2024-04-26T21:17:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.540+0000 7f3c36000700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 0x7f3c1c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.541+0000 7f3c36000700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 0x7f3c1c071190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c24005950 tx=0x7f3c240058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:54.545 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:54 smithi055 ceph-mon[109028]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:54.545 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:54 smithi055 ceph-mon[109028]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:54.545 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:54 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/272799029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.545+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3c2805cb70 con 0x7f3c380732b0 2024-04-26T21:17:54.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.828+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c38074960 con 0x7f3c380732b0 2024-04-26T21:17:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.829+0000 7f3c2f400700 1 -- 172.21.15.55:0/1390931250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f3c2805c700 con 0x7f3c380732b0 2024-04-26T21:17:54.832 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:17:54.832 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:17:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:17:54.834 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:54.835 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 msgr2=0x7f3c1c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 0x7f3c1c071190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c24005950 tx=0x7f3c240058e0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 msgr2=0x7f3c3819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c280092e0 tx=0x7f3c2800be20 comp rx=0 tx=0).stop 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 shutdown_connections 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c380732b0 0x7f3c3819e9b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c1c06ecd0 0x7f3c1c071190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.832+0000 7f3c3dc00700 1 --2- 172.21.15.55:0/1390931250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c38073bd0 0x7f3c3819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.833+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 >> 172.21.15.55:0/1390931250 conn(0x7f3c380fc6d0 msgr2=0x7f3c38105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.833+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 shutdown_connections 2024-04-26T21:17:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.833+0000 7f3c3dc00700 1 -- 172.21.15.55:0/1390931250 wait complete. 2024-04-26T21:17:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:17:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:54 smithi064 ceph-mon[84240]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:54 smithi064 ceph-mon[84240]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:54 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/272799029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 -- 172.21.15.55:0/2019175720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2840ffaa0 msgr2=0x7ff2840fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 --2- 172.21.15.55:0/2019175720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fff20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff270009910 tx=0x7ff270009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 -- 172.21.15.55:0/2019175720 shutdown_connections 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 --2- 172.21.15.55:0/2019175720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fff20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 --2- 172.21.15.55:0/2019175720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff284105aa0 0x7ff284105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.995+0000 7ff28a000700 1 -- 172.21.15.55:0/2019175720 >> 172.21.15.55:0/2019175720 conn(0x7ff284076740 msgr2=0x7ff2840fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.996+0000 7ff28a000700 1 -- 172.21.15.55:0/2019175720 shutdown_connections 2024-04-26T21:17:54.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.996+0000 7ff28a000700 1 -- 172.21.15.55:0/2019175720 wait complete. 2024-04-26T21:17:54.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.997+0000 7ff28a000700 1 Processor -- start 2024-04-26T21:17:54.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.998+0000 7ff28a000700 1 -- start start 2024-04-26T21:17:54.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.998+0000 7ff28a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:54.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.998+0000 7ff28a000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.998+0000 7ff28a000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840fc6a0 con 0x7ff2840ffaa0 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.998+0000 7ff28a000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840fc810 con 0x7ff284105aa0 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff283400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:44102/0 (socket says 172.21.15.55:44102) 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff283400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59166/0 (socket says 172.21.15.55:59166) 2024-04-26T21:17:55.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 -- 172.21.15.55:0/435121346 learned_addr learned my addr 172.21.15.55:0/435121346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 -- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 msgr2=0x7ff2840fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 -- 172.21.15.55:0/435121346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700095f0 con 0x7ff284105aa0 2024-04-26T21:17:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:54.999+0000 7ff282a00700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff2700092e0 tx=0x7ff27000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.000+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27001d070 con 0x7ff284105aa0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.000+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2840fca90 con 0x7ff284105aa0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.000+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2700056e0 con 0x7ff284105aa0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.000+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27000fe10 con 0x7ff284105aa0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.000+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841a2f70 con 0x7ff284105aa0 2024-04-26T21:17:55.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.001+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2841011e0 con 0x7ff284105aa0 2024-04-26T21:17:55.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.002+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff27000f680 con 0x7ff284105aa0 2024-04-26T21:17:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.003+0000 7ff27be00700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 0x7ff268071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.003+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff27008fff0 con 0x7ff284105aa0 2024-04-26T21:17:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.003+0000 7ff283400700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 0x7ff268071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.004+0000 7ff283400700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 0x7ff268071190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff274005950 tx=0x7ff27400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.011+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff270058df0 con 0x7ff284105aa0 2024-04-26T21:17:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.256+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2840fca90 con 0x7ff26806ecd0 2024-04-26T21:17:55.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.258+0000 7ff27be00700 1 -- 172.21.15.55:0/435121346 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff2840fca90 con 0x7ff26806ecd0 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "11/23 daemons upgraded", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:17:55.260 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:17:55.261 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 msgr2=0x7ff268071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 0x7ff268071190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff274005950 tx=0x7ff27400b410 comp rx=0 tx=0).stop 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 msgr2=0x7ff2840fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff2700092e0 tx=0x7ff27000bd70 comp rx=0 tx=0).stop 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 shutdown_connections 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2840ffaa0 0x7ff2840fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff26806ecd0 0x7ff268071190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 --2- 172.21.15.55:0/435121346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff284105aa0 0x7ff2840fc160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 >> 172.21.15.55:0/435121346 conn(0x7ff284076740 msgr2=0x7ff2840fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:55.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 shutdown_connections 2024-04-26T21:17:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.261+0000 7ff28a000700 1 -- 172.21.15.55:0/435121346 wait complete. 2024-04-26T21:17:55.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.424+0000 7fef83800700 1 -- 172.21.15.55:0/3134310037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c1026c0 msgr2=0x7fef7c10abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.424+0000 7fef83800700 1 --2- 172.21.15.55:0/3134310037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c1026c0 0x7fef7c10abb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef64009910 tx=0x7fef64009c20 comp rx=0 tx=0).stop 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 -- 172.21.15.55:0/3134310037 shutdown_connections 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 --2- 172.21.15.55:0/3134310037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c1026c0 0x7fef7c10abb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 --2- 172.21.15.55:0/3134310037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c101da0 0x7fef7c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 -- 172.21.15.55:0/3134310037 >> 172.21.15.55:0/3134310037 conn(0x7fef7c0fb610 msgr2=0x7fef7c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 -- 172.21.15.55:0/3134310037 shutdown_connections 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.425+0000 7fef83800700 1 -- 172.21.15.55:0/3134310037 wait complete. 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 Processor -- start 2024-04-26T21:17:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 -- start start 2024-04-26T21:17:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c1026c0 0x7fef7c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c19d3c0 con 0x7fef7c101da0 2024-04-26T21:17:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.426+0000 7fef83800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1969a0 con 0x7fef7c1026c0 2024-04-26T21:17:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59186/0 (socket says 172.21.15.55:59186) 2024-04-26T21:17:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 -- 172.21.15.55:0/3747969463 learned_addr learned my addr 172.21.15.55:0/3747969463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:17:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef73e00700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c1026c0 0x7fef7c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 -- 172.21.15.55:0/3747969463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c1026c0 msgr2=0x7fef7c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c1026c0 0x7fef7c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.427+0000 7fef80e00700 1 -- 172.21.15.55:0/3747969463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640095f0 con 0x7fef7c101da0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef80e00700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d8d0 tx=0x7fef6c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c0098a0 con 0x7fef7c101da0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef6c010460 con 0x7fef7c101da0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c00f5f0 con 0x7fef7c101da0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c196c80 con 0x7fef7c101da0 2024-04-26T21:17:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.428+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1971d0 con 0x7fef7c101da0 2024-04-26T21:17:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.429+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c1054c0 con 0x7fef7c101da0 2024-04-26T21:17:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.430+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fef6c009a00 con 0x7fef7c101da0 2024-04-26T21:17:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.431+0000 7fef7a000700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 0x7fef60071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:17:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.432+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fef6c08eb80 con 0x7fef7c101da0 2024-04-26T21:17:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.432+0000 7fef73e00700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 0x7fef60071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:17:55.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.432+0000 7fef73e00700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 0x7fef60071180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef7c197b60 tx=0x7fef6401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:17:55.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.436+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fef6c05b590 con 0x7fef7c101da0 2024-04-26T21:17:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:55 smithi055 ceph-mon[109028]: pgmap v166: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:55 smithi055 ceph-mon[109028]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:55 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1390931250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:17:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:55 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:55 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.765+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fef7c197e60 con 0x7fef7c101da0 2024-04-26T21:17:55.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.765+0000 7fef7a000700 1 -- 172.21.15.55:0/3747969463 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1050 (secure 0 0 0) 0x7fef6c016430 con 0x7fef7c101da0 2024-04-26T21:17:55.767 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: osd.4 (root=default,host=smithi064) is down 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-04-26T21:17:55.768 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-26T21:17:55.769 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-04-26T21:17:55.769 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-26T21:17:55.769 INFO:teuthology.orchestra.run.smithi055.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-26T21:17:55.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.768+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 msgr2=0x7fef60071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.768+0000 7fef83800700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 0x7fef60071180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fef7c197b60 tx=0x7fef6401a040 comp rx=0 tx=0).stop 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 msgr2=0x7fef7c19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d8d0 tx=0x7fef6c00dbe0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 shutdown_connections 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef7c101da0 0x7fef7c19c860 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fef6006ecc0 0x7fef60071180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 --2- 172.21.15.55:0/3747969463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef7c1026c0 0x7fef7c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 >> 172.21.15.55:0/3747969463 conn(0x7fef7c0fb610 msgr2=0x7fef7c103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 shutdown_connections 2024-04-26T21:17:55.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:17:55.769+0000 7fef83800700 1 -- 172.21.15.55:0/3747969463 wait complete. 2024-04-26T21:17:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:55 smithi064 ceph-mon[84240]: pgmap v166: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:55 smithi064 ceph-mon[84240]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:55 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1390931250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:17:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:55 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:55.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:55 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-mon[84240]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3747969463' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:17:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-mon[84240]: from='osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:17:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-mon[84240]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:17:56.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:17:56.352+0000 7f84236067c0 -1 osd.4 69 log_to_monitors true 2024-04-26T21:17:56.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:17:56 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:17:56.522+0000 7f8412a00700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:17:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:56 smithi055 ceph-mon[109028]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:17:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:56 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3747969463' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:17:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:56 smithi055 ceph-mon[109028]: from='osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:17:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:56 smithi055 ceph-mon[109028]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T21:17:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: pgmap v167: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:17:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: osdmap e72: 6 total, 5 up, 6 in 2024-04-26T21:17:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:57.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: pgmap v167: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 198 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: osdmap e72: 6 total, 5 up, 6 in 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:17:58.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:58.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:17:58.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:58.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:17:58.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:58 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:17:58.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:58 smithi064 ceph-mon[84240]: osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307] boot 2024-04-26T21:17:58.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:58 smithi064 ceph-mon[84240]: osdmap e73: 6 total, 6 up, 6 in 2024-04-26T21:17:58.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:58 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:17:58.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:58 smithi064 ceph-mon[84240]: osdmap e74: 6 total, 6 up, 6 in 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:58 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:58 smithi055 ceph-mon[109028]: osd.4 [v2:172.21.15.64:6808/3376099307,v1:172.21.15.64:6809/3376099307] boot 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:58 smithi055 ceph-mon[109028]: osdmap e73: 6 total, 6 up, 6 in 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:58 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:58 smithi055 ceph-mon[109028]: osdmap e74: 6 total, 6 up, 6 in 2024-04-26T21:17:59.755 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:59 smithi064 ceph-mon[84240]: pgmap v170: 65 pgs: 4 peering, 13 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:17:59.756 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:17:59 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:00.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:59 smithi055 ceph-mon[109028]: pgmap v170: 65 pgs: 4 peering, 13 active+undersized+degraded, 17 active+undersized, 31 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:00.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:17:59 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 13 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:01.850 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:01 smithi055 ceph-mon[109028]: pgmap v172: 65 pgs: 14 peering, 8 active+undersized+degraded, 12 active+undersized, 31 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 15/222 objects degraded (6.757%) 2024-04-26T21:18:01.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:01 smithi064 ceph-mon[84240]: pgmap v172: 65 pgs: 14 peering, 8 active+undersized+degraded, 12 active+undersized, 31 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 15/222 objects degraded (6.757%) 2024-04-26T21:18:02.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:02 smithi064 ceph-mon[84240]: pgmap v173: 65 pgs: 14 peering, 4 active+undersized+degraded, 3 active+undersized, 44 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 6/222 objects degraded (2.703%) 2024-04-26T21:18:03.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:02 smithi055 ceph-mon[109028]: pgmap v173: 65 pgs: 14 peering, 4 active+undersized+degraded, 3 active+undersized, 44 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 6/222 objects degraded (2.703%) 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.507 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:04 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:04.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:04 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:05.560 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:05 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:05.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:05 smithi064 ceph-mon[84240]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-04-26T21:18:05.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:05 smithi064 ceph-mon[84240]: pgmap v174: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:18:05.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:05 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 4 pgs degraded) 2024-04-26T21:18:05.561 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:05 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:18:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:05 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:05 smithi055 ceph-mon[109028]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-04-26T21:18:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:05 smithi055 ceph-mon[109028]: pgmap v174: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:18:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:05 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 4 pgs degraded) 2024-04-26T21:18:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:05 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:18:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:07 smithi055 ceph-mon[109028]: pgmap v175: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 984 B/s rd, 1 op/s 2024-04-26T21:18:07.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:07 smithi064 ceph-mon[84240]: pgmap v175: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 984 B/s rd, 1 op/s 2024-04-26T21:18:09.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:09 smithi064 ceph-mon[84240]: pgmap v176: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-26T21:18:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:09 smithi055 ceph-mon[109028]: pgmap v176: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-26T21:18:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:11 smithi064 ceph-mon[84240]: pgmap v177: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 904 B/s rd, 1 op/s 2024-04-26T21:18:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:11 smithi055 ceph-mon[109028]: pgmap v177: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 904 B/s rd, 1 op/s 2024-04-26T21:18:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:12 smithi064 ceph-mon[84240]: pgmap v178: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:13.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:12 smithi055 ceph-mon[109028]: pgmap v178: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:13.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:13.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:13.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:14 smithi064 ceph-mon[84240]: pgmap v179: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:15.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:14 smithi055 ceph-mon[109028]: pgmap v179: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:16 smithi064 ceph-mon[84240]: pgmap v180: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:17.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:16 smithi055 ceph-mon[109028]: pgmap v180: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:19.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:18 smithi064 ceph-mon[84240]: pgmap v181: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:18 smithi055 ceph-mon[109028]: pgmap v181: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:19.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:20.170 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:19 smithi064 ceph-mon[84240]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:20.170 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:19 smithi064 ceph-mon[84240]: Upgrade: osd.5 is safe to restart 2024-04-26T21:18:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:19 smithi055 ceph-mon[109028]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-26T21:18:20.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:19 smithi055 ceph-mon[109028]: Upgrade: osd.5 is safe to restart 2024-04-26T21:18:21.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:20 smithi055 ceph-mon[109028]: pgmap v182: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:20 smithi064 ceph-mon[84240]: pgmap v182: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:22.317 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:22 smithi064 ceph-mon[84240]: Upgrade: Updating osd.5 2024-04-26T21:18:22.317 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:22.317 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:18:22.317 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:22 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:22.317 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:22 smithi064 ceph-mon[84240]: Deploying daemon osd.5 on smithi064 2024-04-26T21:18:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:22 smithi055 ceph-mon[109028]: Upgrade: Updating osd.5 2024-04-26T21:18:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T21:18:22.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:22 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:22.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:22 smithi055 ceph-mon[109028]: Deploying daemon osd.5 on smithi064 2024-04-26T21:18:23.255 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:23 smithi064 ceph-mon[84240]: pgmap v183: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:23.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:23 smithi055 ceph-mon[109028]: pgmap v183: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:25.347 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:25 smithi064 ceph-mon[84240]: pgmap v184: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:25.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:25 smithi055 ceph-mon[109028]: pgmap v184: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 -- 172.21.15.55:0/825429491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 msgr2=0x7fe540107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 --2- 172.21.15.55:0/825429491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe540107820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe530009910 tx=0x7fe530009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 -- 172.21.15.55:0/825429491 shutdown_connections 2024-04-26T21:18:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 --2- 172.21.15.55:0/825429491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 0x7fe54010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 --2- 172.21.15.55:0/825429491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe540107820 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 -- 172.21.15.55:0/825429491 >> 172.21.15.55:0/825429491 conn(0x7fe540076a10 msgr2=0x7fe540078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 -- 172.21.15.55:0/825429491 shutdown_connections 2024-04-26T21:18:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.947+0000 7fe547000700 1 -- 172.21.15.55:0/825429491 wait complete. 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 Processor -- start 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 -- start start 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 0x7fe54019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54019dd70 con 0x7fe540107440 2024-04-26T21:18:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.949+0000 7fe547000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5401a19f0 con 0x7fe540107df0 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44270/0 (socket says 172.21.15.55:44270) 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 -- 172.21.15.55:0/4214877647 learned_addr learned my addr 172.21.15.55:0/4214877647 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53f400700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 0x7fe54019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 -- 172.21.15.55:0/4214877647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 msgr2=0x7fe54019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 0x7fe54019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.950+0000 7fe53fe00700 1 -- 172.21.15.55:0/4214877647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300095f0 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe53fe00700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe530006010 tx=0x7fe53000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53001d070 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe53000f460 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5401a1c70 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe530017630 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.951+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5401a2160 con 0x7fe540107440 2024-04-26T21:18:25.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.952+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54010f7e0 con 0x7fe540107440 2024-04-26T21:18:25.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.953+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe53000f5d0 con 0x7fe540107440 2024-04-26T21:18:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.954+0000 7fe53cc00700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 0x7fe524071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.955+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe5300902d0 con 0x7fe540107440 2024-04-26T21:18:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.955+0000 7fe53f400700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 0x7fe524071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.956+0000 7fe53f400700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 0x7fe524071190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:25.960+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fe5300591f0 con 0x7fe540107440 2024-04-26T21:18:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.212+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe540114400 con 0x7fe52406ecd0 2024-04-26T21:18:26.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.215+0000 7fe53cc00700 1 -- 172.21.15.55:0/4214877647 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe540114400 con 0x7fe52406ecd0 2024-04-26T21:18:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 msgr2=0x7fe524071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 0x7fe524071190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00a560 comp rx=0 tx=0).stop 2024-04-26T21:18:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 msgr2=0x7fe54019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe530006010 tx=0x7fe53000be20 comp rx=0 tx=0).stop 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 shutdown_connections 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe540107440 0x7fe54019d150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fe52406ecd0 0x7fe524071190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 --2- 172.21.15.55:0/4214877647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe540107df0 0x7fe54019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 >> 172.21.15.55:0/4214877647 conn(0x7fe540076a10 msgr2=0x7fe540076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 shutdown_connections 2024-04-26T21:18:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.218+0000 7fe547000700 1 -- 172.21.15.55:0/4214877647 wait complete. 2024-04-26T21:18:26.234 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 -- 172.21.15.55:0/133738027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 msgr2=0x7f35dc101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 --2- 172.21.15.55:0/133738027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc101fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009910 tx=0x7f35d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 -- 172.21.15.55:0/133738027 shutdown_connections 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 --2- 172.21.15.55:0/133738027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 0x7f35dc10a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 --2- 172.21.15.55:0/133738027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc101fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 -- 172.21.15.55:0/133738027 >> 172.21.15.55:0/133738027 conn(0x7f35dc0fb3f0 msgr2=0x7f35dc0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 -- 172.21.15.55:0/133738027 shutdown_connections 2024-04-26T21:18:26.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.377+0000 7f35e2400700 1 -- 172.21.15.55:0/133738027 wait complete. 2024-04-26T21:18:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 Processor -- start 2024-04-26T21:18:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 -- start start 2024-04-26T21:18:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 0x7f35dc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc19d2e0 con 0x7f35dc101bc0 2024-04-26T21:18:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e2400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1968c0 con 0x7f35dc1024e0 2024-04-26T21:18:26.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.379+0000 7f35e1000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44288/0 (socket says 172.21.15.55:44288) 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 -- 172.21.15.55:0/3012035961 learned_addr learned my addr 172.21.15.55:0/3012035961 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 -- 172.21.15.55:0/3012035961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 msgr2=0x7f35dc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35dbe00700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 0x7f35dc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 0x7f35dc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 -- 172.21.15.55:0/3012035961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00095f0 con 0x7f35dc101bc0 2024-04-26T21:18:26.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.380+0000 7f35e1000700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f35d0006010 tx=0x7f35d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.381+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d001d070 con 0x7f35dc101bc0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.381+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35d000f460 con 0x7f35dc101bc0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.381+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc196b40 con 0x7f35dc101bc0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.381+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d0017630 con 0x7f35dc101bc0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.381+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc197030 con 0x7f35dc101bc0 2024-04-26T21:18:26.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.382+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc1053b0 con 0x7f35dc101bc0 2024-04-26T21:18:26.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.383+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f35d000f5d0 con 0x7f35dc101bc0 2024-04-26T21:18:26.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.384+0000 7f35d9600700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 0x7f35c4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.384+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f35d0090280 con 0x7f35dc101bc0 2024-04-26T21:18:26.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.384+0000 7f35dbe00700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 0x7f35c4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.385+0000 7f35dbe00700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 0x7f35c4071180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006fd0 tx=0x7f35c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.389+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f35d005ccd0 con 0x7f35dc101bc0 2024-04-26T21:18:26.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.636+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35dc197df0 con 0x7f35c406ecc0 2024-04-26T21:18:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.639+0000 7f35d9600700 1 -- 172.21.15.55:0/3012035961 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f35dc197df0 con 0x7f35c406ecc0 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 msgr2=0x7f35c4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 0x7f35c4071180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006fd0 tx=0x7f35c8008040 comp rx=0 tx=0).stop 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 msgr2=0x7f35dc19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f35d0006010 tx=0x7f35d000be20 comp rx=0 tx=0).stop 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 shutdown_connections 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35dc101bc0 0x7f35dc19c780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f35c406ecc0 0x7f35c4071180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 --2- 172.21.15.55:0/3012035961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35dc1024e0 0x7f35dc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.642+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 >> 172.21.15.55:0/3012035961 conn(0x7f35dc0fb3f0 msgr2=0x7f35dc102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.643+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 shutdown_connections 2024-04-26T21:18:26.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.643+0000 7f35e2400700 1 -- 172.21.15.55:0/3012035961 wait complete. 2024-04-26T21:18:26.652 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:26 smithi064 systemd[1]: Stopping Ceph osd.5 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:18:26.652 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[52868]: 2024-04-26T21:18:26.648+0000 7f8b27800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:18:26.652 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[52868]: 2024-04-26T21:18:26.648+0000 7f8b27800700 -1 osd.5 74 *** Got signal Terminated *** 2024-04-26T21:18:26.652 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[52868]: 2024-04-26T21:18:26.648+0000 7f8b27800700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 -- 172.21.15.55:0/4279410391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 msgr2=0x7f36b8103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 --2- 172.21.15.55:0/4279410391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b8103410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009910 tx=0x7f36a8009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 -- 172.21.15.55:0/4279410391 shutdown_connections 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 --2- 172.21.15.55:0/4279410391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 0x7f36b8107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 --2- 172.21.15.55:0/4279410391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b8103410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 -- 172.21.15.55:0/4279410391 >> 172.21.15.55:0/4279410391 conn(0x7f36b80fe8c0 msgr2=0x7f36b8100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 -- 172.21.15.55:0/4279410391 shutdown_connections 2024-04-26T21:18:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.803+0000 7f36bf000700 1 -- 172.21.15.55:0/4279410391 wait complete. 2024-04-26T21:18:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.804+0000 7f36bf000700 1 Processor -- start 2024-04-26T21:18:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36bf000700 1 -- start start 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36bf000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36bf000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 0x7f36b819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36bf000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b819f5a0 con 0x7f36b8103030 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36bf000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8198b80 con 0x7f36b81039e0 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36b7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44304/0 (socket says 172.21.15.55:44304) 2024-04-26T21:18:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.805+0000 7f36b7e00700 1 -- 172.21.15.55:0/491911746 learned_addr learned my addr 172.21.15.55:0/491911746 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36af400700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 0x7f36b819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b7e00700 1 -- 172.21.15.55:0/491911746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 msgr2=0x7f36b819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b7e00700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 0x7f36b819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b7e00700 1 -- 172.21.15.55:0/491911746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80095f0 con 0x7f36b8103030 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b7e00700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f36a80092e0 tx=0x7f36a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a801d070 con 0x7f36b8103030 2024-04-26T21:18:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.806+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36a800f460 con 0x7f36b8103030 2024-04-26T21:18:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.807+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a8017630 con 0x7f36b8103030 2024-04-26T21:18:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.807+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b8198e00 con 0x7f36b8103030 2024-04-26T21:18:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.807+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b81992f0 con 0x7f36b8103030 2024-04-26T21:18:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.808+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b810b3d0 con 0x7f36b8103030 2024-04-26T21:18:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.809+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f36a800f5d0 con 0x7f36b8103030 2024-04-26T21:18:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.810+0000 7f36b5600700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 0x7f369c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.810+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f36a80902c0 con 0x7f36b8103030 2024-04-26T21:18:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.811+0000 7f36af400700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 0x7f369c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.811+0000 7f36af400700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 0x7f369c071190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36b819a220 tx=0x7f36a0005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:26.816+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f36a805cc50 con 0x7f36b8103030 2024-04-26T21:18:27.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.055+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b8110000 con 0x7f369c06ecd0 2024-04-26T21:18:27.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.088+0000 7f36b5600700 1 -- 172.21.15.55:0/491911746 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f36b8110000 con 0x7f369c06ecd0 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (7m) 105s ago 21m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (22m) 105s ago 22m 8954k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (20m) 32s ago 20m 8707k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (3m) 105s ago 22m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (3m) 32s ago 20m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:18:27.089 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (7m) 105s ago 21m 73.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (14m) 105s ago 14m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (14m) 105s ago 14m 18.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (14m) 32s ago 14m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (14m) 32s ago 14m 18.4M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (10m) 105s ago 23m 506M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (9m) 32s ago 20m 452M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (5m) 105s ago 24m 50.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (4m) 32s ago 20m 35.7M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (8m) 105s ago 22m 7708k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (8m) 32s ago 20m 7721k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (3m) 105s ago 19m 96.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (2m) 105s ago 18m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (113s) 105s ago 18m 12.6M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:18:27.090 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (82s) 32s ago 17m 113M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (38s) 32s ago 16m 11.2M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (16m) 32s ago 16m 243M 2240M 18.2.2-1258-g7d2137f0 79c5878083fb b80b00f8317e 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (8m) 105s ago 21m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 msgr2=0x7f369c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 0x7f369c071190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36b819a220 tx=0x7f36a0005cf0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 msgr2=0x7f36b819ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f36a80092e0 tx=0x7f36a800be20 comp rx=0 tx=0).stop 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 shutdown_connections 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b8103030 0x7f36b819ea40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f369c06ecd0 0x7f369c071190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 --2- 172.21.15.55:0/491911746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36b81039e0 0x7f36b819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 >> 172.21.15.55:0/491911746 conn(0x7f36b80fe8c0 msgr2=0x7f36b80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.091+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 shutdown_connections 2024-04-26T21:18:27.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.092+0000 7f36bf000700 1 -- 172.21.15.55:0/491911746 wait complete. 2024-04-26T21:18:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 -- 172.21.15.55:0/1449174036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 msgr2=0x7f5f7810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1449174036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7810be40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009910 tx=0x7f5f64009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 -- 172.21.15.55:0/1449174036 shutdown_connections 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1449174036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7810be40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1449174036 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 0x7f5f78107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 -- 172.21.15.55:0/1449174036 >> 172.21.15.55:0/1449174036 conn(0x7f5f78076a10 msgr2=0x7f5f78078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 -- 172.21.15.55:0/1449174036 shutdown_connections 2024-04-26T21:18:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.252+0000 7f5f7d600700 1 -- 172.21.15.55:0/1449174036 wait complete. 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.253+0000 7f5f7d600700 1 Processor -- start 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.253+0000 7f5f7d600700 1 -- start start 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.253+0000 7f5f7d600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 0x7f5f7819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.253+0000 7f5f7d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f7d600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7819dca0 con 0x7f5f78107df0 2024-04-26T21:18:27.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f7d600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7819dde0 con 0x7f5f78107440 2024-04-26T21:18:27.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44334/0 (socket says 172.21.15.55:44334) 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 -- 172.21.15.55:0/1787572825 learned_addr learned my addr 172.21.15.55:0/1787572825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76a00700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 0x7f5f7819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 -- 172.21.15.55:0/1787572825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 msgr2=0x7f5f7819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 0x7f5f7819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.254+0000 7f5f76000700 1 -- 172.21.15.55:0/1787572825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640095f0 con 0x7f5f78107df0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f76000700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f64005b40 tx=0x7f5f6400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6401d070 con 0x7f5f78107df0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f781a1b10 con 0x7f5f78107df0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f6400f460 con 0x7f5f78107df0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f64017630 con 0x7f5f78107df0 2024-04-26T21:18:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.255+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f781a2000 con 0x7f5f78107df0 2024-04-26T21:18:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.256+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7810f840 con 0x7f5f78107df0 2024-04-26T21:18:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.257+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5f6400f5d0 con 0x7f5f78107df0 2024-04-26T21:18:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.258+0000 7f5f6f400700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 0x7f5f5c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.258+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5f640901d0 con 0x7f5f78107df0 2024-04-26T21:18:27.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.259+0000 7f5f76a00700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 0x7f5f5c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.259+0000 7f5f76a00700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 0x7f5f5c071190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005ea0 tx=0x7f5f68005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.263+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5f640590b0 con 0x7f5f78107df0 2024-04-26T21:18:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:27 smithi064 ceph-mon[84240]: pgmap v185: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:27 smithi064 ceph-mon[84240]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:27 smithi064 ceph-mon[84240]: osd.5 marked itself down and dead 2024-04-26T21:18:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:27 smithi055 ceph-mon[109028]: pgmap v185: 65 pgs: 65 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:27 smithi055 ceph-mon[109028]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:27 smithi055 ceph-mon[109028]: osd.5 marked itself down and dead 2024-04-26T21:18:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:27.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.582+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f78108920 con 0x7f5f78107df0 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.583+0000 7f5f6f400700 1 -- 172.21.15.55:0/1787572825 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f5f6405c770 con 0x7f5f78107df0 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:18:27.584 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 5 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 4, 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 9 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:18:27.585 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:18:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 msgr2=0x7f5f5c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 0x7f5f5c071190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005ea0 tx=0x7f5f68005e30 comp rx=0 tx=0).stop 2024-04-26T21:18:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 msgr2=0x7f5f7819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f64005b40 tx=0x7f5f6400be20 comp rx=0 tx=0).stop 2024-04-26T21:18:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 shutdown_connections 2024-04-26T21:18:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5f5c06ecd0 0x7f5f5c071190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5f78107440 0x7f5f7819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 --2- 172.21.15.55:0/1787572825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f78107df0 0x7f5f7819d650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 >> 172.21.15.55:0/1787572825 conn(0x7f5f78076a10 msgr2=0x7f5f78076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 shutdown_connections 2024-04-26T21:18:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.586+0000 7f5f7d600700 1 -- 172.21.15.55:0/1787572825 wait complete. 2024-04-26T21:18:27.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 -- 172.21.15.55:0/2051599475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55841002a0 msgr2=0x7f558410cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 --2- 172.21.15.55:0/2051599475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55841002a0 0x7f558410cf60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5570009910 tx=0x7f5570009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:27.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 -- 172.21.15.55:0/2051599475 shutdown_connections 2024-04-26T21:18:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 --2- 172.21.15.55:0/2051599475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55841002a0 0x7f558410cf60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 --2- 172.21.15.55:0/2051599475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55840ff8f0 0x7f55840ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.750+0000 7f558bc00700 1 -- 172.21.15.55:0/2051599475 >> 172.21.15.55:0/2051599475 conn(0x7f5584076740 msgr2=0x7f55840fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.751+0000 7f558bc00700 1 -- 172.21.15.55:0/2051599475 shutdown_connections 2024-04-26T21:18:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.751+0000 7f558bc00700 1 -- 172.21.15.55:0/2051599475 wait complete. 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 Processor -- start 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 -- start start 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 0x7f5584199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841998f0 con 0x7f55840ff8f0 2024-04-26T21:18:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.752+0000 7f558bc00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558419c560 con 0x7f55841002a0 2024-04-26T21:18:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44364/0 (socket says 172.21.15.55:44364) 2024-04-26T21:18:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 -- 172.21.15.55:0/2267141554 learned_addr learned my addr 172.21.15.55:0/2267141554 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5583e00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 0x7f5584199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 -- 172.21.15.55:0/2267141554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 msgr2=0x7f5584199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 0x7f5584199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5589200700 1 -- 172.21.15.55:0/2267141554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700095f0 con 0x7f55840ff8f0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.753+0000 7f5583e00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 0x7f5584199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f5589200700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f557800c8a0 tx=0x7f557800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f557800cea0 con 0x7f55840ff8f0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5578004830 con 0x7f55840ff8f0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55780055b0 con 0x7f55840ff8f0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558419c840 con 0x7f55840ff8f0 2024-04-26T21:18:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.754+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558419cd90 con 0x7f55840ff8f0 2024-04-26T21:18:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.755+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584068ea0 con 0x7f55840ff8f0 2024-04-26T21:18:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.756+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f55780049a0 con 0x7f55840ff8f0 2024-04-26T21:18:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.758+0000 7f5581600700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 0x7f556c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.758+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f557808ea40 con 0x7f55840ff8f0 2024-04-26T21:18:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.758+0000 7f5583e00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 0x7f556c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.759+0000 7f5583e00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 0x7f556c071180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f557000b5c0 tx=0x7f557000b7f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:27.763+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5578057880 con 0x7f55840ff8f0 2024-04-26T21:18:27.983 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:27 smithi064 podman[104286]: 2024-04-26 21:18:27.658311487 +0000 UTC m=+1.159987278 container died b80b00f8317ee92116c6f4b6e81fd365c3bf6764bbf78e21a95eaeac4234ec16 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, RELEASE=reef-7d2137f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:18:28.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.058+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5584107830 con 0x7f55840ff8f0 2024-04-26T21:18:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.059+0000 7f5581600700 1 -- 172.21.15.55:0/2267141554 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f557801d070 con 0x7f55840ff8f0 2024-04-26T21:18:28.059 INFO:teuthology.orchestra.run.smithi055.stdout:e13 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 12 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:04:19.278071+0000 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:18:28.060 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14466} 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:18:28.061 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:14466} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.55:6826/2158832788,v1:172.21.15.55:6827/2158832788] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{0:24277} state up:standby-replay seq 4 join_fscid=1 addr [v2:172.21.15.64:6824/1419129911,v1:172.21.15.64:6825/1419129911] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:18:28.062 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:18:28.063 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:14480} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:18:28.063 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 msgr2=0x7f556c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 0x7f556c071180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f557000b5c0 tx=0x7f557000b7f0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 msgr2=0x7f5584198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f557800c8a0 tx=0x7f557800cc60 comp rx=0 tx=0).stop 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 shutdown_connections 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55840ff8f0 0x7f5584198d20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f556c06ecc0 0x7f556c071180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 --2- 172.21.15.55:0/2267141554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55841002a0 0x7f5584199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 >> 172.21.15.55:0/2267141554 conn(0x7f5584076740 msgr2=0x7f55840fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 shutdown_connections 2024-04-26T21:18:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.062+0000 7f558bc00700 1 -- 172.21.15.55:0/2267141554 wait complete. 2024-04-26T21:18:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:18:28.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.247+0000 7f9884400700 1 -- 172.21.15.55:0/2764407582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 msgr2=0x7f987c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.247+0000 7f9884400700 1 --2- 172.21.15.55:0/2764407582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c1011f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9870009910 tx=0x7f9870009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 -- 172.21.15.55:0/2764407582 shutdown_connections 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 --2- 172.21.15.55:0/2764407582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 0x7f987c105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 --2- 172.21.15.55:0/2764407582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c1011f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 -- 172.21.15.55:0/2764407582 >> 172.21.15.55:0/2764407582 conn(0x7f987c0fc6e0 msgr2=0x7f987c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 -- 172.21.15.55:0/2764407582 shutdown_connections 2024-04-26T21:18:28.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.248+0000 7f9884400700 1 -- 172.21.15.55:0/2764407582 wait complete. 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.249+0000 7f9884400700 1 Processor -- start 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.249+0000 7f9884400700 1 -- start start 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.249+0000 7f9884400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9884400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 0x7f987c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9884400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c1999e0 con 0x7f987c100e10 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9884400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c19d660 con 0x7f987c1017c0 2024-04-26T21:18:28.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44372/0 (socket says 172.21.15.55:44372) 2024-04-26T21:18:28.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 -- 172.21.15.55:0/304665238 learned_addr learned my addr 172.21.15.55:0/304665238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881000700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 0x7f987c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 -- 172.21.15.55:0/304665238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 msgr2=0x7f987c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 0x7f987c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.250+0000 7f9881a00700 1 -- 172.21.15.55:0/304665238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700095f0 con 0x7f987c100e10 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f9881a00700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f987000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987001d070 con 0x7f987c100e10 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98700056e0 con 0x7f987c100e10 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c19d8e0 con 0x7f987c100e10 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c19ddd0 con 0x7f987c100e10 2024-04-26T21:18:28.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.251+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9870017400 con 0x7f987c100e10 2024-04-26T21:18:28.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.252+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c104f90 con 0x7f987c100e10 2024-04-26T21:18:28.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.253+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f987000f6f0 con 0x7f987c100e10 2024-04-26T21:18:28.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.254+0000 7f987a000700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 0x7f9864071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.254+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9870090240 con 0x7f987c100e10 2024-04-26T21:18:28.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.255+0000 7f9881000700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 0x7f9864071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.255+0000 7f9881000700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 0x7f9864071180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9868005950 tx=0x7f98680058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.260+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9870059000 con 0x7f987c100e10 2024-04-26T21:18:28.360 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:28 smithi064 podman[104286]: 2024-04-26 21:18:28.091058312 +0000 UTC m=+1.592734079 container cleanup b80b00f8317ee92116c6f4b6e81fd365c3bf6764bbf78e21a95eaeac4234ec16 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=reef-7d2137f, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T21:18:28.360 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:28 smithi064 bash[104286]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5 2024-04-26T21:18:28.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:28.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:28.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:18:28.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-26T21:18:28.360 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: osdmap e75: 6 total, 5 up, 6 in 2024-04-26T21:18:28.361 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1787572825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:28.361 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:28 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2267141554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: osdmap e75: 6 total, 5 up, 6 in 2024-04-26T21:18:28.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1787572825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:28.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:28 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2267141554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:18:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.516+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f987c10dde0 con 0x7f986406ecc0 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.519+0000 7f987a000700 1 -- 172.21.15.55:0/304665238 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f987c10dde0 con 0x7f986406ecc0 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:18:28.519 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "11/23 daemons upgraded", 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading osd daemons", 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:18:28.520 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.522+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 msgr2=0x7f9864071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.522+0000 7f9884400700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 0x7f9864071180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9868005950 tx=0x7f98680058e0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.522+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 msgr2=0x7f987c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.522+0000 7f9884400700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f987000be20 comp rx=0 tx=0).stop 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 shutdown_connections 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f987c100e10 0x7f987c198dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f986406ecc0 0x7f9864071180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 --2- 172.21.15.55:0/304665238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f987c1017c0 0x7f987c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 >> 172.21.15.55:0/304665238 conn(0x7f987c0fc6e0 msgr2=0x7f987c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 shutdown_connections 2024-04-26T21:18:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.523+0000 7f9884400700 1 -- 172.21.15.55:0/304665238 wait complete. 2024-04-26T21:18:28.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:28 smithi064 podman[104303]: 2024-04-26 21:18:28.358898316 +0000 UTC m=+0.681628817 container remove b80b00f8317ee92116c6f4b6e81fd365c3bf6764bbf78e21a95eaeac4234ec16 (image=quay.ceph.io/ceph-ci/ceph@sha256:e17a04b46e161074720f31632c109326d7f42d2ea9837ffbd4759ea4b16a0c69, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=reef-7d2137f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:18:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 -- 172.21.15.55:0/1765060190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 msgr2=0x7fad40103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 --2- 172.21.15.55:0/1765060190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40103420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad30009910 tx=0x7fad30009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 -- 172.21.15.55:0/1765060190 shutdown_connections 2024-04-26T21:18:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 --2- 172.21.15.55:0/1765060190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 0x7fad40107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 --2- 172.21.15.55:0/1765060190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40103420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 -- 172.21.15.55:0/1765060190 >> 172.21.15.55:0/1765060190 conn(0x7fad400fe8b0 msgr2=0x7fad40100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 -- 172.21.15.55:0/1765060190 shutdown_connections 2024-04-26T21:18:28.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.689+0000 7fad46600700 1 -- 172.21.15.55:0/1765060190 wait complete. 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.690+0000 7fad46600700 1 Processor -- start 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.690+0000 7fad46600700 1 -- start start 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad46600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad46600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 0x7fad401992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad46600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40199930 con 0x7fad40103040 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad46600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4019c550 con 0x7fad401039f0 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44400/0 (socket says 172.21.15.55:44400) 2024-04-26T21:18:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 -- 172.21.15.55:0/1579919574 learned_addr learned my addr 172.21.15.55:0/1579919574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad36a00700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 0x7fad401992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 -- 172.21.15.55:0/1579919574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 msgr2=0x7fad401992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 0x7fad401992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.691+0000 7fad3f400700 1 -- 172.21.15.55:0/1579919574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300095f0 con 0x7fad40103040 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad3f400700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad30006010 tx=0x7fad3000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3001d070 con 0x7fad40103040 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad300056e0 con 0x7fad40103040 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4019c7d0 con 0x7fad40103040 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3000fdf0 con 0x7fad40103040 2024-04-26T21:18:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.692+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4019ccc0 con 0x7fad40103040 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.694+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4010b3e0 con 0x7fad40103040 2024-04-26T21:18:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.695+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fad3000f5f0 con 0x7fad40103040 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.696+0000 7fad3cc00700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 0x7fad24071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.696+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad30090120 con 0x7fad40103040 2024-04-26T21:18:28.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.696+0000 7fad36a00700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 0x7fad24071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:28.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.697+0000 7fad36a00700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 0x7fad24071180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fad28009550 tx=0x7fad280091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:28.701+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fad30058f80 con 0x7fad40103040 2024-04-26T21:18:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.021+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fad40199fe0 con 0x7fad40103040 2024-04-26T21:18:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.022+0000 7fad3cc00700 1 -- 172.21.15.55:0/1579919574 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+337 (secure 0 0 0) 0x7fad3005c640 con 0x7fad40103040 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi055.stdout: osd.5 (root=default,host=smithi064) is down 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-26T21:18:29.023 INFO:teuthology.orchestra.run.smithi055.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-26T21:18:29.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 msgr2=0x7fad24071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 0x7fad24071180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fad28009550 tx=0x7fad280091b0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 msgr2=0x7fad40198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad30006010 tx=0x7fad3000bd70 comp rx=0 tx=0).stop 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 shutdown_connections 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad40103040 0x7fad40198d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fad2406ecc0 0x7fad24071180 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 --2- 172.21.15.55:0/1579919574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad401039f0 0x7fad401992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 >> 172.21.15.55:0/1579919574 conn(0x7fad400fe8b0 msgr2=0x7fad400ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 shutdown_connections 2024-04-26T21:18:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:29.025+0000 7fad46600700 1 -- 172.21.15.55:0/1579919574 wait complete. 2024-04-26T21:18:29.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:29 smithi064 ceph-mon[84240]: pgmap v187: 65 pgs: 13 stale+active+clean, 52 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:18:29.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:29 smithi064 ceph-mon[84240]: osdmap e76: 6 total, 5 up, 6 in 2024-04-26T21:18:29.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:29 smithi064 ceph-mon[84240]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:29.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:29 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1579919574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:18:29.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.06450582 +0000 UTC m=+0.036601572 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:18:29.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.176452676 +0000 UTC m=+0.148548459 container create 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-26T21:18:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:29 smithi055 ceph-mon[109028]: pgmap v187: 65 pgs: 13 stale+active+clean, 52 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:18:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:29 smithi055 ceph-mon[109028]: osdmap e76: 6 total, 5 up, 6 in 2024-04-26T21:18:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:29 smithi055 ceph-mon[109028]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:18:29.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:29 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1579919574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:18:29.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.489526355 +0000 UTC m=+0.461622194 container init 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T21:18:29.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.502090255 +0000 UTC m=+0.474186050 container start 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T21:18:29.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.629137373 +0000 UTC m=+0.601233202 container attach 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:18:30.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:30 smithi064 ceph-mon[84240]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:30.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:29 smithi064 podman[104393]: 2024-04-26 21:18:29.998940071 +0000 UTC m=+0.971035866 container died 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T21:18:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:30 smithi055 ceph-mon[109028]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 5 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:31.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:30 smithi064 podman[104418]: 2024-04-26 21:18:30.874561244 +0000 UTC m=+0.856362840 container remove 662e03f83b4984ffed6b3c67a36e4de78d5fddbfa53c2d40a184dc0ec665ebfb (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T21:18:31.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:30 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-26T21:18:31.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:30 smithi064 systemd[1]: Stopped Ceph osd.5 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:18:31.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:30 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.5.service: Consumed 2min 6.479s CPU time. 2024-04-26T21:18:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:31 smithi055 ceph-mon[109028]: pgmap v189: 65 pgs: 5 active+undersized+degraded, 10 stale+active+clean, 5 active+undersized, 45 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 0 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:31.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:31 smithi064 ceph-mon[84240]: pgmap v189: 65 pgs: 5 active+undersized+degraded, 10 stale+active+clean, 5 active+undersized, 45 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 0 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:31.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:31 smithi064 systemd[1]: Starting Ceph osd.5 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:18:31.958 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:31 smithi064 podman[104524]: 2024-04-26 21:18:31.613072477 +0000 UTC m=+0.036081600 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:18:31.958 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:31 smithi064 podman[104524]: 2024-04-26 21:18:31.750549059 +0000 UTC m=+0.173558154 container create cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:18:32.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:32 smithi064 podman[104524]: 2024-04-26 21:18:32.088080753 +0000 UTC m=+0.511089928 container init cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-26T21:18:32.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:32 smithi064 podman[104524]: 2024-04-26 21:18:32.101309074 +0000 UTC m=+0.524318179 container start cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T21:18:32.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:32 smithi064 podman[104524]: 2024-04-26 21:18:32.177970813 +0000 UTC m=+0.600979985 container attach cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T21:18:33.405 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-mon[84240]: pgmap v190: 65 pgs: 10 active+undersized+degraded, 1 stale+active+clean, 15 active+undersized, 39 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-04-26T21:18:33.405 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:18:33.405 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:18:33.405 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:18:33.405 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 bash[104524]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:18:33.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate[104539]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-26T21:18:33.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:33 smithi064 podman[104524]: 2024-04-26 21:18:33.190168037 +0000 UTC m=+1.613177162 container died cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T21:18:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:33 smithi055 ceph-mon[109028]: pgmap v190: 65 pgs: 10 active+undersized+degraded, 1 stale+active+clean, 15 active+undersized, 39 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-04-26T21:18:34.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 podman[104680]: 2024-04-26 21:18:34.032130856 +0000 UTC m=+0.819611340 container remove cc7d6802979b5b05007cb023dddc17b1e6ff51c5ff8ec480fa5d7b272259449c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=) 2024-04-26T21:18:34.771 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 podman[104744]: 2024-04-26 21:18:34.327495933 +0000 UTC m=+0.039500370 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:18:34.771 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 podman[104744]: 2024-04-26 21:18:34.4413118 +0000 UTC m=+0.153316263 container create 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T21:18:34.771 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 podman[104744]: 2024-04-26 21:18:34.769975086 +0000 UTC m=+0.481979556 container init 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T21:18:35.156 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 podman[104744]: 2024-04-26 21:18:34.781217357 +0000 UTC m=+0.493221853 container start 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T21:18:35.156 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 ceph-osd[104763]: -- 172.21.15.64:0/2362000771 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556fb24df680 con 0x556fb24a9000 2024-04-26T21:18:35.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 bash[104744]: 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c 2024-04-26T21:18:35.157 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:34 smithi064 systemd[1]: Started Ceph osd.5 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:18:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:35 smithi055 ceph-mon[109028]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:35.531 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:35 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:18:35.363+0000 7f77f74897c0 -1 Falling back to public interface 2024-04-26T21:18:35.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:35 smithi064 ceph-mon[84240]: pgmap v191: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:35.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:35.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:35.531 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:37.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:37 smithi055 ceph-mon[109028]: pgmap v192: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 589 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:37.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:37 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:37 smithi064 ceph-mon[84240]: pgmap v192: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 589 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:37 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:39.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:39 smithi055 ceph-mon[109028]: pgmap v193: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:39 smithi064 ceph-mon[84240]: pgmap v193: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:41.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:41.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:41.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:18:41.141+0000 7f77f74897c0 -1 osd.5 74 log_to_monitors true 2024-04-26T21:18:41.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:18:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:18:41.586+0000 7f77e6800700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:18:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:41 smithi064 ceph-mon[84240]: pgmap v194: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 876 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:41 smithi064 ceph-mon[84240]: from='osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:18:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:41 smithi064 ceph-mon[84240]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:18:42.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:41 smithi055 ceph-mon[109028]: pgmap v194: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 876 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:42.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:41 smithi055 ceph-mon[109028]: from='osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:18:42.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:41 smithi055 ceph-mon[109028]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T21:18:42.882 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:18:42.882 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:18:42.882 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: osdmap e77: 6 total, 5 up, 6 in 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: pgmap v196: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:42.883 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T21:18:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:18:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: osdmap e77: 6 total, 5 up, 6 in 2024-04-26T21:18:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-04-26T21:18:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: pgmap v196: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-04-26T21:18:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:43 smithi064 ceph-mon[84240]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:18:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:43 smithi064 ceph-mon[84240]: osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695] boot 2024-04-26T21:18:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:43 smithi064 ceph-mon[84240]: osdmap e78: 6 total, 6 up, 6 in 2024-04-26T21:18:43.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:43 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:18:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:43 smithi055 ceph-mon[109028]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-26T21:18:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:43 smithi055 ceph-mon[109028]: osd.5 [v2:172.21.15.64:6816/2282216695,v1:172.21.15.64:6817/2282216695] boot 2024-04-26T21:18:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:43 smithi055 ceph-mon[109028]: osdmap e78: 6 total, 6 up, 6 in 2024-04-26T21:18:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:43 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T21:18:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:44 smithi064 ceph-mon[84240]: osdmap e79: 6 total, 6 up, 6 in 2024-04-26T21:18:44.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:44 smithi064 ceph-mon[84240]: pgmap v199: 65 pgs: 7 peering, 8 active+undersized+degraded, 13 active+undersized, 37 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:45.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:44 smithi055 ceph-mon[109028]: osdmap e79: 6 total, 6 up, 6 in 2024-04-26T21:18:45.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:44 smithi055 ceph-mon[109028]: pgmap v199: 65 pgs: 7 peering, 8 active+undersized+degraded, 13 active+undersized, 37 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:45.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:45 smithi064 ceph-mon[84240]: Health check update: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:46.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:45 smithi055 ceph-mon[109028]: Health check update: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-04-26T21:18:46.833 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:46 smithi064 ceph-mon[84240]: pgmap v200: 65 pgs: 7 peering, 8 active+undersized+degraded, 12 active+undersized, 38 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:47.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:46 smithi055 ceph-mon[109028]: pgmap v200: 65 pgs: 7 peering, 8 active+undersized+degraded, 12 active+undersized, 38 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 18/222 objects degraded (8.108%) 2024-04-26T21:18:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-26T21:18:48.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-26T21:18:48.659 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-26T21:18:48.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all osd 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: Upgrade: Setting require_osd_release to 19 squid 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: pgmap v201: 65 pgs: 7 peering, 58 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 489 B/s rd, 0 op/s 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded) 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: osdmap e80: 6 total, 6 up, 6 in 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:49.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:49 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-26T21:18:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all osd 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: Upgrade: Setting require_osd_release to 19 squid 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: pgmap v201: 65 pgs: 7 peering, 58 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 489 B/s rd, 0 op/s 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded) 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: osdmap e80: 6 total, 6 up, 6 in 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:49.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:49 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: osdmap e81: 6 total, 6 up, 6 in 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2 up:standby 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:50.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:50.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: osdmap e81: 6 total, 6 up, 6 in 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 2 up:standby 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:50.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:18:51.489 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:51 smithi055 ceph-mon[109028]: pgmap v204: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 817 B/s rd, 1 op/s 2024-04-26T21:18:51.489 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:51 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6824/3118315402,v1:172.21.15.64:6825/3118315402] up:boot 2024-04-26T21:18:51.489 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:51 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:18:51.489 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:18:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:51 smithi064 ceph-mon[84240]: pgmap v204: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 817 B/s rd, 1 op/s 2024-04-26T21:18:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:51 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6824/3118315402,v1:172.21.15.64:6825/3118315402] up:boot 2024-04-26T21:18:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:51 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:18:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:18:53.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:53 smithi055 ceph-mon[109028]: pgmap v205: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:18:53.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:53.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:18:53.591 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:53 smithi064 ceph-mon[84240]: pgmap v205: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-26T21:18:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.coveew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:18:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:54.604 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:54 smithi055 ceph-mon[109028]: Upgrade: Updating mds.cephfs.smithi055.coveew 2024-04-26T21:18:54.604 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:54 smithi055 ceph-mon[109028]: Deploying daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:18:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:54 smithi064 ceph-mon[84240]: Upgrade: Updating mds.cephfs.smithi055.coveew 2024-04-26T21:18:54.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:54 smithi064 ceph-mon[84240]: Deploying daemon mds.cephfs.smithi055.coveew on smithi055 2024-04-26T21:18:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:55 smithi064 ceph-mon[84240]: pgmap v206: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:18:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:55 smithi055 ceph-mon[109028]: pgmap v206: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:18:56.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[109024]: 2024-04-26T21:18:56.002+0000 7effc5e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: osdmap e82: 6 total, 6 up, 6 in 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: Standby daemon mds.cephfs.smithi055.nwfjlb assigned to filesystem cephfs as rank 0 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:18:56.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:56 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:replay} 2 up:standby 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: osdmap e82: 6 total, 6 up, 6 in 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: Standby daemon mds.cephfs.smithi055.nwfjlb assigned to filesystem cephfs as rank 0 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:18:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:18:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:56 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:replay} 2 up:standby 2024-04-26T21:18:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:57 smithi064 ceph-mon[84240]: pgmap v207: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:18:57.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:57.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:57.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:57 smithi055 ceph-mon[109028]: pgmap v207: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:18:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:18:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:18:58.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:58 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:18:58.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:58 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:18:59.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 -- 172.21.15.55:0/790395852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 msgr2=0x7ffbd80736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 --2- 172.21.15.55:0/790395852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd80736f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009910 tx=0x7ffbcc009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:59.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 -- 172.21.15.55:0/790395852 shutdown_connections 2024-04-26T21:18:59.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 --2- 172.21.15.55:0/790395852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 0x7ffbd810ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 --2- 172.21.15.55:0/790395852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd80736f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 -- 172.21.15.55:0/790395852 >> 172.21.15.55:0/790395852 conn(0x7ffbd80fc6e0 msgr2=0x7ffbd80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 -- 172.21.15.55:0/790395852 shutdown_connections 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.193+0000 7ffbdf600700 1 -- 172.21.15.55:0/790395852 wait complete. 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.194+0000 7ffbdf600700 1 Processor -- start 2024-04-26T21:18:59.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdf600700 1 -- start start 2024-04-26T21:18:59.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdf600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdf600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 0x7ffbd81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdf600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8199930 con 0x7ffbd8073310 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdf600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd819c550 con 0x7ffbd8073c30 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.195+0000 7ffbdcc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55530/0 (socket says 172.21.15.55:55530) 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 -- 172.21.15.55:0/1934597486 learned_addr learned my addr 172.21.15.55:0/1934597486 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbd7e00700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 0x7ffbd81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 -- 172.21.15.55:0/1934597486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 msgr2=0x7ffbd81992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 0x7ffbd81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 -- 172.21.15.55:0/1934597486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0095f0 con 0x7ffbd8073310 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.196+0000 7ffbdcc00700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0092e0 tx=0x7ffbcc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.197+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc01d070 con 0x7ffbd8073310 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.197+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbcc00f460 con 0x7ffbd8073310 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.197+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbcc017630 con 0x7ffbd8073310 2024-04-26T21:18:59.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.197+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd819c7d0 con 0x7ffbd8073310 2024-04-26T21:18:59.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.197+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd819ccc0 con 0x7ffbd8073310 2024-04-26T21:18:59.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.198+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd80749c0 con 0x7ffbd8073310 2024-04-26T21:18:59.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.199+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffbcc00f5d0 con 0x7ffbd8073310 2024-04-26T21:18:59.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.201+0000 7ffbd5600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 0x7ffbc0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.201+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffbcc090270 con 0x7ffbd8073310 2024-04-26T21:18:59.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.201+0000 7ffbd7e00700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 0x7ffbc0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:59.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.202+0000 7ffbd7e00700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 0x7ffbc0071190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffbd819a230 tx=0x7ffbc4005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:59.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.206+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffbcc059100 con 0x7ffbd8073310 2024-04-26T21:18:59.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.461+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbd8107810 con 0x7ffbc006ecd0 2024-04-26T21:18:59.464 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:18:59 smithi055 ceph-mon[109028]: pgmap v209: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 1 op/s 2024-04-26T21:18:59.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.464+0000 7ffbd5600700 1 -- 172.21.15.55:0/1934597486 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffbd8107810 con 0x7ffbc006ecd0 2024-04-26T21:18:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.466+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 msgr2=0x7ffbc0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.466+0000 7ffbdf600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 0x7ffbc0071190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffbd819a230 tx=0x7ffbc4005cf0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.466+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 msgr2=0x7ffbd8198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.466+0000 7ffbdf600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0092e0 tx=0x7ffbcc00be20 comp rx=0 tx=0).stop 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 shutdown_connections 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbd8073310 0x7ffbd8198d60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffbc006ecd0 0x7ffbc0071190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 --2- 172.21.15.55:0/1934597486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbd8073c30 0x7ffbd81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 >> 172.21.15.55:0/1934597486 conn(0x7ffbd80fc6e0 msgr2=0x7ffbd8105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 shutdown_connections 2024-04-26T21:18:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.467+0000 7ffbdf600700 1 -- 172.21.15.55:0/1934597486 wait complete. 2024-04-26T21:18:59.484 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 -- 172.21.15.55:0/4172017630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 msgr2=0x7f5b400ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 --2- 172.21.15.55:0/4172017630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b400ffcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009910 tx=0x7f5b30009c20 comp rx=0 tx=0).stop 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 -- 172.21.15.55:0/4172017630 shutdown_connections 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 --2- 172.21.15.55:0/4172017630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b401002a0 0x7f5b4010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 --2- 172.21.15.55:0/4172017630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b400ffcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 -- 172.21.15.55:0/4172017630 >> 172.21.15.55:0/4172017630 conn(0x7f5b40076740 msgr2=0x7f5b400fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 -- 172.21.15.55:0/4172017630 shutdown_connections 2024-04-26T21:18:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.620+0000 7f5b47000700 1 -- 172.21.15.55:0/4172017630 wait complete. 2024-04-26T21:18:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.621+0000 7f5b47000700 1 Processor -- start 2024-04-26T21:18:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b47000700 1 -- start start 2024-04-26T21:18:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b47000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b47000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b401002a0 0x7f5b40102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b47000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b40105ca0 con 0x7f5b400ff8f0 2024-04-26T21:18:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b47000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b40102650 con 0x7f5b401002a0 2024-04-26T21:18:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b3fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.622+0000 7f5b3fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55546/0 (socket says 172.21.15.55:55546) 2024-04-26T21:18:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.623+0000 7f5b3fe00700 1 -- 172.21.15.55:0/2231013507 learned_addr learned my addr 172.21.15.55:0/2231013507 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:18:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.623+0000 7f5b3fe00700 1 -- 172.21.15.55:0/2231013507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b401002a0 msgr2=0x7f5b40102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.623+0000 7f5b3fe00700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b401002a0 0x7f5b40102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.623+0000 7f5b3fe00700 1 -- 172.21.15.55:0/2231013507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300095f0 con 0x7f5b400ff8f0 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.623+0000 7f5b3fe00700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006010 tx=0x7f5b300056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.624+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3001d070 con 0x7f5b400ff8f0 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.624+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b3000bea0 con 0x7f5b400ff8f0 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.624+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3000fd70 con 0x7f5b400ff8f0 2024-04-26T21:18:59.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.624+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b401028d0 con 0x7f5b400ff8f0 2024-04-26T21:18:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.624+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b401a7430 con 0x7f5b400ff8f0 2024-04-26T21:18:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.625+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b40107870 con 0x7f5b400ff8f0 2024-04-26T21:18:59.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.627+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5b3000f560 con 0x7f5b400ff8f0 2024-04-26T21:18:59.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.628+0000 7f5b3cc00700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 0x7f5b24071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:59.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.628+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5b3008fff0 con 0x7f5b400ff8f0 2024-04-26T21:18:59.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.628+0000 7f5b3f400700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 0x7f5b24071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.629+0000 7f5b3f400700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 0x7f5b24071190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005950 tx=0x7f5b2c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.633+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5b300c5060 con 0x7f5b400ff8f0 2024-04-26T21:18:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:18:59 smithi064 ceph-mon[84240]: pgmap v209: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 1 op/s 2024-04-26T21:18:59.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.906+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b401030b0 con 0x7f5b2406ecd0 2024-04-26T21:18:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.907+0000 7f5b3cc00700 1 -- 172.21.15.55:0/2231013507 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5b401030b0 con 0x7f5b2406ecd0 2024-04-26T21:18:59.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 msgr2=0x7f5b24071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 0x7f5b24071190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005950 tx=0x7f5b2c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 msgr2=0x7f5b40101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006010 tx=0x7f5b300056a0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 shutdown_connections 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b400ff8f0 0x7f5b40101bd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5b2406ecd0 0x7f5b24071190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 --2- 172.21.15.55:0/2231013507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b401002a0 0x7f5b40102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 >> 172.21.15.55:0/2231013507 conn(0x7f5b40076740 msgr2=0x7f5b400fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:18:59.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 shutdown_connections 2024-04-26T21:18:59.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:18:59.910+0000 7f5b47000700 1 -- 172.21.15.55:0/2231013507 wait complete. 2024-04-26T21:19:00.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.066+0000 7f4f95000700 1 -- 172.21.15.55:0/3670639505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f90106b20 msgr2=0x7f4f90106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.066+0000 7f4f95000700 1 --2- 172.21.15.55:0/3670639505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f90106b20 0x7f4f90106f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009910 tx=0x7f4f80009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:00.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 -- 172.21.15.55:0/3670639505 shutdown_connections 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 --2- 172.21.15.55:0/3670639505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900685c0 0x7f4f90068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 --2- 172.21.15.55:0/3670639505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f90106b20 0x7f4f90106f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 -- 172.21.15.55:0/3670639505 >> 172.21.15.55:0/3670639505 conn(0x7f4f90075460 msgr2=0x7f4f90075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 -- 172.21.15.55:0/3670639505 shutdown_connections 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.067+0000 7f4f95000700 1 -- 172.21.15.55:0/3670639505 wait complete. 2024-04-26T21:19:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.068+0000 7f4f95000700 1 Processor -- start 2024-04-26T21:19:00.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f95000700 1 -- start start 2024-04-26T21:19:00.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f95000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f95000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f90106b20 0x7f4f9019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f95000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9019d280 con 0x7f4f900685c0 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f95000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901967f0 con 0x7f4f90106b20 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f8f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.069+0000 7f4f8f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55566/0 (socket says 172.21.15.55:55566) 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8f400700 1 -- 172.21.15.55:0/3186336085 learned_addr learned my addr 172.21.15.55:0/3186336085 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8ea00700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f90106b20 0x7f4f9019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8f400700 1 -- 172.21.15.55:0/3186336085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f90106b20 msgr2=0x7f4f9019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8f400700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f90106b20 0x7f4f9019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8f400700 1 -- 172.21.15.55:0/3186336085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800095f0 con 0x7f4f900685c0 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.070+0000 7f4f8f400700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006010 tx=0x7f4f8000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.071+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8001d070 con 0x7f4f900685c0 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.071+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f8000f460 con 0x7f4f900685c0 2024-04-26T21:19:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.071+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f90196a70 con 0x7f4f900685c0 2024-04-26T21:19:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.071+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f80017630 con 0x7f4f900685c0 2024-04-26T21:19:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.071+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f90196fe0 con 0x7f4f900685c0 2024-04-26T21:19:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.072+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90108fe0 con 0x7f4f900685c0 2024-04-26T21:19:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.073+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4f8000f5d0 con 0x7f4f900685c0 2024-04-26T21:19:00.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.075+0000 7f4f87e00700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 0x7f4f740711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.075+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4f80090210 con 0x7f4f900685c0 2024-04-26T21:19:00.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.075+0000 7f4f8ea00700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 0x7f4f740711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.076+0000 7f4f8ea00700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 0x7f4f740711e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c006fd0 tx=0x7f4f7c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:00.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.079+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4f8005cc70 con 0x7f4f900685c0 2024-04-26T21:19:00.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.317+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f90197d20 con 0x7f4f7406ed20 2024-04-26T21:19:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.340+0000 7f4f87e00700 1 -- 172.21.15.55:0/3186336085 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4f90197d20 con 0x7f4f7406ed20 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (8m) 2m ago 22m 14.4M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (22m) 2m ago 22m 8954k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (21m) 20s ago 21m 9038k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (4m) 2m ago 22m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (4m) 20s ago 21m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:19:00.343 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (7m) 2m ago 22m 73.6M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (14m) 2m ago 14m 152M - 18.2.2-1258-g7d2137f0 79c5878083fb 9d4b4a54b9b9 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (14m) 2m ago 14m 18.3M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (14m) 20s ago 14m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (14m) 20s ago 14m 18.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (11m) 2m ago 24m 506M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (9m) 20s ago 21m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (5m) 2m ago 24m 50.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (5m) 20s ago 20m 38.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:19:00.344 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (9m) 2m ago 22m 7708k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (9m) 20s ago 21m 7964k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (3m) 2m ago 19m 96.4M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (3m) 2m ago 19m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (2m) 2m ago 18m 12.6M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (115s) 20s ago 18m 115M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (71s) 20s ago 17m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (25s) 20s ago 16m 11.2M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:19:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (8m) 2m ago 21m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:19:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.343+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 msgr2=0x7f4f740711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.343+0000 7f4f95000700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 0x7f4f740711e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c006fd0 tx=0x7f4f7c008040 comp rx=0 tx=0).stop 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.343+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 msgr2=0x7f4f9019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.343+0000 7f4f95000700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f80006010 tx=0x7f4f8000be20 comp rx=0 tx=0).stop 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 shutdown_connections 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f900685c0 0x7f4f9019c6b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f7406ed20 0x7f4f740711e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 --2- 172.21.15.55:0/3186336085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f90106b20 0x7f4f9019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 >> 172.21.15.55:0/3186336085 conn(0x7f4f90075460 msgr2=0x7f4f900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 shutdown_connections 2024-04-26T21:19:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.344+0000 7f4f95000700 1 -- 172.21.15.55:0/3186336085 wait complete. 2024-04-26T21:19:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 -- 172.21.15.55:0/1068647769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073280 msgr2=0x7f1254073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 --2- 172.21.15.55:0/1068647769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073280 0x7f1254073660 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1244009910 tx=0x7f1244009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 -- 172.21.15.55:0/1068647769 shutdown_connections 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 --2- 172.21.15.55:0/1068647769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073ba0 0x7f1254111500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 --2- 172.21.15.55:0/1068647769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073280 0x7f1254073660 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 -- 172.21.15.55:0/1068647769 >> 172.21.15.55:0/1068647769 conn(0x7f12540fc520 msgr2=0x7f12540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 -- 172.21.15.55:0/1068647769 shutdown_connections 2024-04-26T21:19:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.501+0000 7f1253200700 1 -- 172.21.15.55:0/1068647769 wait complete. 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.502+0000 7f1253200700 1 Processor -- start 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.502+0000 7f1253200700 1 -- start start 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1253200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073280 0x7f125419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1253200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1253200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125419dc00 con 0x7f1254073ba0 2024-04-26T21:19:00.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1253200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541a18d0 con 0x7f1254073280 2024-04-26T21:19:00.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1251400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1251400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55592/0 (socket says 172.21.15.55:55592) 2024-04-26T21:19:00.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.503+0000 7f1251400700 1 -- 172.21.15.55:0/2737218119 learned_addr learned my addr 172.21.15.55:0/2737218119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:00.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.504+0000 7f1251e00700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073280 0x7f125419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.504+0000 7f1251400700 1 -- 172.21.15.55:0/2737218119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073280 msgr2=0x7f125419cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.504+0000 7f1251400700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073280 0x7f125419cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.504+0000 7f1251400700 1 -- 172.21.15.55:0/2737218119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12440095f0 con 0x7f1254073ba0 2024-04-26T21:19:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.504+0000 7f1251400700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f124000b4b0 tx=0x7f124000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.505+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1240011800 con 0x7f1254073ba0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.505+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1240011e20 con 0x7f1254073ba0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.505+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12541a1bb0 con 0x7f1254073ba0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.505+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124000f2e0 con 0x7f1254073ba0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.505+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12541a2100 con 0x7f1254073ba0 2024-04-26T21:19:00.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.506+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540749c0 con 0x7f1254073ba0 2024-04-26T21:19:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.509+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1240010380 con 0x7f1254073ba0 2024-04-26T21:19:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.510+0000 7f124aa00700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 0x7f1238071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.510+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f124008e990 con 0x7f1254073ba0 2024-04-26T21:19:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.510+0000 7f1251e00700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 0x7f1238071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:00.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.511+0000 7f1251e00700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 0x7f1238071190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f124400b5c0 tx=0x7f124401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.519+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1240057870 con 0x7f1254073ba0 2024-04-26T21:19:00.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:00 smithi064 ceph-mon[84240]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:00.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:00 smithi055 ceph-mon[109028]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:00.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.834+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f125404f400 con 0x7f1254073ba0 2024-04-26T21:19:00.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.835+0000 7f124aa00700 1 -- 172.21.15.55:0/2737218119 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7f124005af30 con 0x7f1254073ba0 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 3 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:00.837 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:19:00.838 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 3, 2024-04-26T21:19:00.838 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 10 2024-04-26T21:19:00.838 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:19:00.838 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:19:00.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 msgr2=0x7f1238071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 0x7f1238071190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f124400b5c0 tx=0x7f124401a040 comp rx=0 tx=0).stop 2024-04-26T21:19:00.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 msgr2=0x7f125419d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f124000b4b0 tx=0x7f124000b870 comp rx=0 tx=0).stop 2024-04-26T21:19:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 shutdown_connections 2024-04-26T21:19:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f123806ecd0 0x7f1238071190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1254073280 0x7f125419cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 --2- 172.21.15.55:0/2737218119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254073ba0 0x7f125419d520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 >> 172.21.15.55:0/2737218119 conn(0x7f12540fc520 msgr2=0x7f1254100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.838+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 shutdown_connections 2024-04-26T21:19:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:00.839+0000 7f1253200700 1 -- 172.21.15.55:0/2737218119 wait complete. 2024-04-26T21:19:01.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 -- 172.21.15.55:0/2854471351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184100a30 msgr2=0x7f2184100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 --2- 172.21.15.55:0/2854471351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184100a30 0x7f2184100eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2170009910 tx=0x7f2170009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 -- 172.21.15.55:0/2854471351 shutdown_connections 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 --2- 172.21.15.55:0/2854471351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184100a30 0x7f2184100eb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 --2- 172.21.15.55:0/2854471351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184106a30 0x7f2184106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.009+0000 7f2188c00700 1 -- 172.21.15.55:0/2854471351 >> 172.21.15.55:0/2854471351 conn(0x7f21840fc520 msgr2=0x7f21840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.010+0000 7f2188c00700 1 -- 172.21.15.55:0/2854471351 shutdown_connections 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.010+0000 7f2188c00700 1 -- 172.21.15.55:0/2854471351 wait complete. 2024-04-26T21:19:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.011+0000 7f2188c00700 1 Processor -- start 2024-04-26T21:19:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.011+0000 7f2188c00700 1 -- start start 2024-04-26T21:19:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2188c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184100a30 0x7f218419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2188c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2188c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184198980 con 0x7f2184106a30 2024-04-26T21:19:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2188c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184198af0 con 0x7f2184100a30 2024-04-26T21:19:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2182a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2182a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55618/0 (socket says 172.21.15.55:55618) 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.012+0000 7f2182a00700 1 -- 172.21.15.55:0/3344036283 learned_addr learned my addr 172.21.15.55:0/3344036283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.013+0000 7f2183400700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184100a30 0x7f218419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.013+0000 7f2182a00700 1 -- 172.21.15.55:0/3344036283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184100a30 msgr2=0x7f218419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.013+0000 7f2182a00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184100a30 0x7f218419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.013+0000 7f2182a00700 1 -- 172.21.15.55:0/3344036283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700095f0 con 0x7f2184106a30 2024-04-26T21:19:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.013+0000 7f2182a00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2170006010 tx=0x7f217000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.014+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f217001d070 con 0x7f2184106a30 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.014+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2184198d70 con 0x7f2184106a30 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.014+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f217000f460 con 0x7f2184106a30 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.014+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2170017630 con 0x7f2184106a30 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.014+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2184199260 con 0x7f2184106a30 2024-04-26T21:19:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.015+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184104ce0 con 0x7f2184106a30 2024-04-26T21:19:01.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.018+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f217000f5d0 con 0x7f2184106a30 2024-04-26T21:19:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.018+0000 7f217be00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 0x7f2168071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.019+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2170090320 con 0x7f2184106a30 2024-04-26T21:19:01.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.019+0000 7f2183400700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 0x7f2168071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.020+0000 7f2183400700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 0x7f2168071190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2174005fd0 tx=0x7f217400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.028+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f21700591d0 con 0x7f2184106a30 2024-04-26T21:19:01.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.307+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2184199e60 con 0x7f2184106a30 2024-04-26T21:19:01.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.308+0000 7f217be00700 1 -- 172.21.15.55:0/3344036283 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1700 (secure 0 0 0) 0x7f217005c890 con 0x7f2184106a30 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:e17 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:19:01.310 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 17 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:18:56.016922+0000 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 82 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:19:01.311 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=14480} 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{0:14480} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:01.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:01.313 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:19:01.313 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:01.313 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:24291} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:19:01.313 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{-1:44279} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6824/3118315402,v1:172.21.15.64:6825/3118315402] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:19:01.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 msgr2=0x7f2168071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 0x7f2168071190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2174005fd0 tx=0x7f217400a560 comp rx=0 tx=0).stop 2024-04-26T21:19:01.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 msgr2=0x7f218419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2170006010 tx=0x7f217000be20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 shutdown_connections 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f216806ecd0 0x7f2168071190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2184100a30 0x7f218419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 --2- 172.21.15.55:0/3344036283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2184106a30 0x7f218419ee10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 >> 172.21.15.55:0/3344036283 conn(0x7f21840fc520 msgr2=0x7f2184073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 shutdown_connections 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.313+0000 7f2188c00700 1 -- 172.21.15.55:0/3344036283 wait complete. 2024-04-26T21:19:01.315 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-26T21:19:01.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 -- 172.21.15.55:0/2340372281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 msgr2=0x7f77e4103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 --2- 172.21.15.55:0/2340372281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e4103410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009910 tx=0x7f77d8009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 -- 172.21.15.55:0/2340372281 shutdown_connections 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 --2- 172.21.15.55:0/2340372281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41039e0 0x7f77e4107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 --2- 172.21.15.55:0/2340372281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e4103410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 -- 172.21.15.55:0/2340372281 >> 172.21.15.55:0/2340372281 conn(0x7f77e40fe880 msgr2=0x7f77e4100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 -- 172.21.15.55:0/2340372281 shutdown_connections 2024-04-26T21:19:01.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.471+0000 7f77eb800700 1 -- 172.21.15.55:0/2340372281 wait complete. 2024-04-26T21:19:01.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 Processor -- start 2024-04-26T21:19:01.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 -- start start 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41039e0 0x7f77e419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4198b60 con 0x7f77e4103030 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.473+0000 7f77eb800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4198cd0 con 0x7f77e41039e0 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55646/0 (socket says 172.21.15.55:55646) 2024-04-26T21:19:01.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 -- 172.21.15.55:0/141917119 learned_addr learned my addr 172.21.15.55:0/141917119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 -- 172.21.15.55:0/141917119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41039e0 msgr2=0x7f77e419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41039e0 0x7f77e419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.474+0000 7f77e8e00700 1 -- 172.21.15.55:0/141917119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80095f0 con 0x7f77e4103030 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77e8e00700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77d80092e0 tx=0x7f77d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d801d070 con 0x7f77e4103030 2024-04-26T21:19:01.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77d800f460 con 0x7f77e4103030 2024-04-26T21:19:01.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d8017630 con 0x7f77e4103030 2024-04-26T21:19:01.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e4198f50 con 0x7f77e4103030 2024-04-26T21:19:01.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.475+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e4199440 con 0x7f77e4103030 2024-04-26T21:19:01.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.477+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e410b3d0 con 0x7f77e4103030 2024-04-26T21:19:01.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.478+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f77d800f5d0 con 0x7f77e4103030 2024-04-26T21:19:01.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.479+0000 7f77e1600700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 0x7f77cc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.479+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f77d80902b0 con 0x7f77e4103030 2024-04-26T21:19:01.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.479+0000 7f77e3e00700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 0x7f77cc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.480+0000 7f77e3e00700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 0x7f77cc071190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77e419a2d0 tx=0x7f77d0005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.483+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f77d80590e0 con 0x7f77e4103030 2024-04-26T21:19:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:01 smithi064 ceph-mon[84240]: pgmap v210: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-04-26T21:19:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:01 smithi064 ceph-mon[84240]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:01 smithi064 ceph-mon[84240]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:01 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2737218119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:01 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3344036283' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:19:01.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.741+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77e4199fd0 con 0x7f77cc06ecd0 2024-04-26T21:19:01.743 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:01 smithi055 ceph-mon[109028]: pgmap v210: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-04-26T21:19:01.743 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:01 smithi055 ceph-mon[109028]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:01.743 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:01 smithi055 ceph-mon[109028]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:01.743 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:01 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2737218119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:01.744 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:01 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3344036283' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:19:01.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.743+0000 7f77e1600700 1 -- 172.21.15.55:0/141917119 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f77e4199fd0 con 0x7f77cc06ecd0 2024-04-26T21:19:01.744 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:19:01.744 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:19:01.744 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "osd", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "12/23 daemons upgraded", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:19:01.745 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:19:01.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 msgr2=0x7f77cc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 0x7f77cc071190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77e419a2d0 tx=0x7f77d0005c80 comp rx=0 tx=0).stop 2024-04-26T21:19:01.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 msgr2=0x7f77e419eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77d80092e0 tx=0x7f77d800be20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 shutdown_connections 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e4103030 0x7f77e419eab0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77d80092e0 tx=0x7f77d800be20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f77cc06ecd0 0x7f77cc071190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 --2- 172.21.15.55:0/141917119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77e41039e0 0x7f77e419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.745+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 >> 172.21.15.55:0/141917119 conn(0x7f77e40fe880 msgr2=0x7f77e40ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.746+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 shutdown_connections 2024-04-26T21:19:01.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.746+0000 7f77eb800700 1 -- 172.21.15.55:0/141917119 wait complete. 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 -- 172.21.15.55:0/4228851457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 msgr2=0x7f7678106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 --2- 172.21.15.55:0/4228851457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f7678106e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7668009910 tx=0x7f7668009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 -- 172.21.15.55:0/4228851457 shutdown_connections 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 --2- 172.21.15.55:0/4228851457 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 0x7f7678100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 --2- 172.21.15.55:0/4228851457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f7678106e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 -- 172.21.15.55:0/4228851457 >> 172.21.15.55:0/4228851457 conn(0x7f76780fc520 msgr2=0x7f76780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 -- 172.21.15.55:0/4228851457 shutdown_connections 2024-04-26T21:19:01.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.895+0000 7f767ca00700 1 -- 172.21.15.55:0/4228851457 wait complete. 2024-04-26T21:19:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.896+0000 7f767ca00700 1 Processor -- start 2024-04-26T21:19:01.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.896+0000 7f767ca00700 1 -- start start 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f767ca00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 0x7f767819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f767ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f767ca00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767819f3c0 con 0x7f7678106a30 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f767ca00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781989a0 con 0x7f7678100a30 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f7676a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f7676a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55652/0 (socket says 172.21.15.55:55652) 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.897+0000 7f7676a00700 1 -- 172.21.15.55:0/2893392495 learned_addr learned my addr 172.21.15.55:0/2893392495 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:01.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f7677400700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 0x7f767819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f7676a00700 1 -- 172.21.15.55:0/2893392495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 msgr2=0x7f767819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f7676a00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 0x7f767819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f7676a00700 1 -- 172.21.15.55:0/2893392495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680095f0 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f7676a00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f766400c8a0 tx=0x7f766400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.898+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766400cea0 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.899+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7664004830 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.899+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76640055b0 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.899+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7678198c80 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.899+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76781991d0 con 0x7f7678106a30 2024-04-26T21:19:01.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.900+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7678104ce0 con 0x7f7678106a30 2024-04-26T21:19:01.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.903+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f76640049a0 con 0x7f7678106a30 2024-04-26T21:19:01.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.903+0000 7f766fe00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 0x7f765c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:01.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.904+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f766408e6f0 con 0x7f7678106a30 2024-04-26T21:19:01.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.904+0000 7f7677400700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 0x7f765c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:01.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.905+0000 7f7677400700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 0x7f765c071190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f766800b5c0 tx=0x7f766801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:01.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:01.909+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f766405b090 con 0x7f7678106a30 2024-04-26T21:19:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.216+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7678102170 con 0x7f7678106a30 2024-04-26T21:19:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.217+0000 7f766fe00700 1 -- 172.21.15.55:0/2893392495 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f7664004c50 con 0x7f7678106a30 2024-04-26T21:19:02.219 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-26T21:19:02.219 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T21:19:02.219 INFO:teuthology.orchestra.run.smithi055.stdout: fs cephfs is degraded 2024-04-26T21:19:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 msgr2=0x7f765c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 0x7f765c071190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f766800b5c0 tx=0x7f766801a040 comp rx=0 tx=0).stop 2024-04-26T21:19:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 msgr2=0x7f767819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f766400c8a0 tx=0x7f766400cc60 comp rx=0 tx=0).stop 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 shutdown_connections 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f765c06ecd0 0x7f765c071190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7678100a30 0x7f767819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 --2- 172.21.15.55:0/2893392495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7678106a30 0x7f767819eda0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 >> 172.21.15.55:0/2893392495 conn(0x7f76780fc520 msgr2=0x7f76780fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 shutdown_connections 2024-04-26T21:19:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:02.220+0000 7f767ca00700 1 -- 172.21.15.55:0/2893392495 wait complete. 2024-04-26T21:19:02.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:02 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2893392495' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:19:02.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:02 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2893392495' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:19:03.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:03 smithi064 ceph-mon[84240]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:03.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:03 smithi064 ceph-mon[84240]: pgmap v211: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-26T21:19:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:03 smithi055 ceph-mon[109028]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:03.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:03 smithi055 ceph-mon[109028]: pgmap v211: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-26T21:19:05.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:05 smithi064 ceph-mon[84240]: pgmap v212: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:19:05.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:05 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:reconnect 2024-04-26T21:19:05.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:05 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:reconnect} 2 up:standby 2024-04-26T21:19:05.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:05 smithi064 ceph-mon[84240]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00899983 2024-04-26T21:19:05.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:05 smithi064 ceph-mon[84240]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.00999981 2024-04-26T21:19:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:05 smithi055 ceph-mon[109028]: pgmap v212: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:19:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:05 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:reconnect 2024-04-26T21:19:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:05 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:reconnect} 2 up:standby 2024-04-26T21:19:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:05 smithi055 ceph-mon[109028]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00899983 2024-04-26T21:19:05.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:05 smithi055 ceph-mon[109028]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.00999981 2024-04-26T21:19:06.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:06 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:rejoin 2024-04-26T21:19:06.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:06 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:rejoin} 2 up:standby 2024-04-26T21:19:06.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:06 smithi064 ceph-mon[84240]: daemon mds.cephfs.smithi055.nwfjlb is now active in filesystem cephfs as rank 0 2024-04-26T21:19:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:06 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:rejoin 2024-04-26T21:19:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:06 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.nwfjlb=up:rejoin} 2 up:standby 2024-04-26T21:19:06.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:06 smithi055 ceph-mon[109028]: daemon mds.cephfs.smithi055.nwfjlb is now active in filesystem cephfs as rank 0 2024-04-26T21:19:07.747 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:07 smithi055 ceph-mon[109028]: pgmap v213: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-26T21:19:07.747 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:07 smithi055 ceph-mon[109028]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:19:07.747 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:07 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:19:07.747 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:07 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:active 2024-04-26T21:19:07.747 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:07 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.nwfjlb=up:active} 2 up:standby 2024-04-26T21:19:07.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:07 smithi064 ceph-mon[84240]: pgmap v213: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-26T21:19:07.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:07 smithi064 ceph-mon[84240]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:19:07.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:07 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:19:07.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:07 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6828/1757258712,v1:172.21.15.55:6829/1757258712] up:active 2024-04-26T21:19:07.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:07 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.nwfjlb=up:active} 2 up:standby 2024-04-26T21:19:09.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:09 smithi055 ceph-mon[109028]: pgmap v214: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 173 B/s wr, 6 op/s 2024-04-26T21:19:09.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:09 smithi064 ceph-mon[84240]: pgmap v214: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 173 B/s wr, 6 op/s 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: pgmap v215: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:boot 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.nwfjlb=up:active} 3 up:standby 2024-04-26T21:19:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:11 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:19:11.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: pgmap v215: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:boot 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.nwfjlb=up:active} 3 up:standby 2024-04-26T21:19:11.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:11 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:19:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:12 smithi055 ceph-mon[109028]: pgmap v216: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.8 KiB/s wr, 8 op/s 2024-04-26T21:19:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:13.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:13.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:12 smithi064 ceph-mon[84240]: pgmap v216: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.8 KiB/s wr, 8 op/s 2024-04-26T21:19:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:13.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:15.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:14 smithi064 ceph-mon[84240]: pgmap v217: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-04-26T21:19:15.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:14 smithi055 ceph-mon[109028]: pgmap v217: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.8 KiB/s wr, 7 op/s 2024-04-26T21:19:17.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:16 smithi055 ceph-mon[109028]: pgmap v218: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-26T21:19:17.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:16 smithi064 ceph-mon[84240]: pgmap v218: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-26T21:19:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:18 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:19.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:18 smithi055 ceph-mon[109028]: pgmap v219: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-26T21:19:19.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:19.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:18 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:19.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:18 smithi064 ceph-mon[84240]: pgmap v219: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-26T21:19:21.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:20 smithi064 ceph-mon[84240]: pgmap v220: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-04-26T21:19:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:20 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:21.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:20 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:21.206 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:20 smithi055 ceph-mon[109028]: pgmap v220: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-04-26T21:19:21.206 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:21.206 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:20 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:23.125 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:22 smithi055 ceph-mon[109028]: pgmap v221: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:19:23.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:22 smithi064 ceph-mon[84240]: pgmap v221: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T21:19:25.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:24 smithi055 ceph-mon[109028]: pgmap v222: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-26T21:19:25.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:24 smithi064 ceph-mon[84240]: pgmap v222: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: pgmap v223: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:27.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: pgmap v223: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:27.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:29 smithi055 ceph-mon[109028]: pgmap v224: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:19:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:29 smithi064 ceph-mon[84240]: pgmap v224: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi055.nwfjlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:19:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:30 smithi055 ceph-mon[109028]: Upgrade: Updating mds.cephfs.smithi055.nwfjlb 2024-04-26T21:19:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:30 smithi055 ceph-mon[109028]: Deploying daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:19:30.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:30 smithi064 ceph-mon[84240]: Upgrade: Updating mds.cephfs.smithi055.nwfjlb 2024-04-26T21:19:30.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:30 smithi064 ceph-mon[84240]: Deploying daemon mds.cephfs.smithi055.nwfjlb on smithi055 2024-04-26T21:19:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:31 smithi055 ceph-mon[109028]: pgmap v225: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:31 smithi064 ceph-mon[84240]: pgmap v225: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:32.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 -- 172.21.15.55:0/159690766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e010d0c0 msgr2=0x7f00e010d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 --2- 172.21.15.55:0/159690766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e010d0c0 0x7f00e010d4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009910 tx=0x7f00d0009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 -- 172.21.15.55:0/159690766 shutdown_connections 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 --2- 172.21.15.55:0/159690766 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e01070b0 0x7f00e0107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 --2- 172.21.15.55:0/159690766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e010d0c0 0x7f00e010d4a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 -- 172.21.15.55:0/159690766 >> 172.21.15.55:0/159690766 conn(0x7f00e0076830 msgr2=0x7f00e0078c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.401+0000 7f00e5200700 1 -- 172.21.15.55:0/159690766 shutdown_connections 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.402+0000 7f00e5200700 1 -- 172.21.15.55:0/159690766 wait complete. 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 Processor -- start 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 -- start start 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e010d0c0 0x7f00e019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e019dc10 con 0x7f00e01070b0 2024-04-26T21:19:32.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.403+0000 7f00e5200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01a18e0 con 0x7f00e010d0c0 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58436/0 (socket says 172.21.15.55:58436) 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 -- 172.21.15.55:0/1872890225 learned_addr learned my addr 172.21.15.55:0/1872890225 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00d7e00700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e010d0c0 0x7f00e019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 -- 172.21.15.55:0/1872890225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e010d0c0 msgr2=0x7f00e019d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e010d0c0 0x7f00e019d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 -- 172.21.15.55:0/1872890225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00095f0 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.404+0000 7f00df400700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00d00092e0 tx=0x7f00d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.405+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d001d070 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.405+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00d00056e0 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.405+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e01a1b60 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.405+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d000fe10 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.405+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e01a2050 con 0x7f00e01070b0 2024-04-26T21:19:32.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.406+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e010f5e0 con 0x7f00e01070b0 2024-04-26T21:19:32.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.407+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00d0003a60 con 0x7f00e01070b0 2024-04-26T21:19:32.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.408+0000 7f00dcc00700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 0x7f00c4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.408+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f00d0090280 con 0x7f00e01070b0 2024-04-26T21:19:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.409+0000 7f00d7e00700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 0x7f00c4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.410+0000 7f00d7e00700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 0x7f00c4071190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00e019e550 tx=0x7f00c800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:32.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.414+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f00d0058f90 con 0x7f00e01070b0 2024-04-26T21:19:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:32 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[109024]: 2024-04-26T21:19:32.203+0000 7effc5e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:19:32.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:32 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:19:32.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:32 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:19:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:32 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:19:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:32 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:19:32.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.681+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00e019e370 con 0x7f00c406ecd0 2024-04-26T21:19:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.683+0000 7f00dcc00700 1 -- 172.21.15.55:0/1872890225 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f00e019e370 con 0x7f00c406ecd0 2024-04-26T21:19:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.686+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 msgr2=0x7f00c4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.686+0000 7f00e5200700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 0x7f00c4071190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00e019e550 tx=0x7f00c800b410 comp rx=0 tx=0).stop 2024-04-26T21:19:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 msgr2=0x7f00e019cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00d00092e0 tx=0x7f00d000bd70 comp rx=0 tx=0).stop 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 shutdown_connections 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00e01070b0 0x7f00e019cff0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f00c406ecd0 0x7f00c4071190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 --2- 172.21.15.55:0/1872890225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00e010d0c0 0x7f00e019d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 >> 172.21.15.55:0/1872890225 conn(0x7f00e0076830 msgr2=0x7f00e010c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 shutdown_connections 2024-04-26T21:19:32.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.687+0000 7f00e5200700 1 -- 172.21.15.55:0/1872890225 wait complete. 2024-04-26T21:19:32.706 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:19:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.856+0000 7f3a22200700 1 -- 172.21.15.55:0/3223926126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 msgr2=0x7f3a1c107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.856+0000 7f3a22200700 1 --2- 172.21.15.55:0/3223926126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c107820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009910 tx=0x7f3a0c009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 -- 172.21.15.55:0/3223926126 shutdown_connections 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 --2- 172.21.15.55:0/3223926126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 0x7f3a1c10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 --2- 172.21.15.55:0/3223926126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c107820 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 -- 172.21.15.55:0/3223926126 >> 172.21.15.55:0/3223926126 conn(0x7f3a1c076a10 msgr2=0x7f3a1c078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 -- 172.21.15.55:0/3223926126 shutdown_connections 2024-04-26T21:19:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.857+0000 7f3a22200700 1 -- 172.21.15.55:0/3223926126 wait complete. 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.858+0000 7f3a22200700 1 Processor -- start 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.858+0000 7f3a22200700 1 -- start start 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a22200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a22200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 0x7f3a1c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a22200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c19dd70 con 0x7f3a1c107440 2024-04-26T21:19:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a22200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1a19f0 con 0x7f3a1c107df0 2024-04-26T21:19:32.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58466/0 (socket says 172.21.15.55:58466) 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 -- 172.21.15.55:0/2366422674 learned_addr learned my addr 172.21.15.55:0/2366422674 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1aa00700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 0x7f3a1c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 -- 172.21.15.55:0/2366422674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 msgr2=0x7f3a1c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 0x7f3a1c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.859+0000 7f3a1b400700 1 -- 172.21.15.55:0/2366422674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0095f0 con 0x7f3a1c107440 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a1b400700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0092e0 tx=0x7f3a0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c01d070 con 0x7f3a1c107440 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a0c0056e0 con 0x7f3a1c107440 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c00fe10 con 0x7f3a1c107440 2024-04-26T21:19:32.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c1a1c70 con 0x7f3a1c107440 2024-04-26T21:19:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.860+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1a2160 con 0x7f3a1c107440 2024-04-26T21:19:32.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.862+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c10f7e0 con 0x7f3a1c107440 2024-04-26T21:19:32.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.863+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3a0c00f680 con 0x7f3a1c107440 2024-04-26T21:19:32.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.864+0000 7f3a13e00700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 0x7f3a00071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:32.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.864+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3a0c0901b0 con 0x7f3a1c107440 2024-04-26T21:19:32.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.864+0000 7f3a1aa00700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 0x7f3a00071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:32.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.865+0000 7f3a1aa00700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 0x7f3a00071190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c19e660 tx=0x7f3a0800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:32.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:32.869+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3a0c058fe0 con 0x7f3a1c107440 2024-04-26T21:19:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.122+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a1c114400 con 0x7f3a0006ecd0 2024-04-26T21:19:33.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.124+0000 7f3a13e00700 1 -- 172.21.15.55:0/2366422674 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3a1c114400 con 0x7f3a0006ecd0 2024-04-26T21:19:33.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 msgr2=0x7f3a00071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 0x7f3a00071190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c19e660 tx=0x7f3a0800b410 comp rx=0 tx=0).stop 2024-04-26T21:19:33.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 msgr2=0x7f3a1c19d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0092e0 tx=0x7f3a0c00bd70 comp rx=0 tx=0).stop 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 shutdown_connections 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a1c107440 0x7f3a1c19d150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a0006ecd0 0x7f3a00071190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 --2- 172.21.15.55:0/2366422674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a1c107df0 0x7f3a1c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.127+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 >> 172.21.15.55:0/2366422674 conn(0x7f3a1c076a10 msgr2=0x7f3a1c076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.128+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 shutdown_connections 2024-04-26T21:19:33.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.128+0000 7f3a22200700 1 -- 172.21.15.55:0/2366422674 wait complete. 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 -- 172.21.15.55:0/4261321840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 msgr2=0x7f1cac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 --2- 172.21.15.55:0/4261321840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac101200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009910 tx=0x7f1c9c009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 -- 172.21.15.55:0/4261321840 shutdown_connections 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 --2- 172.21.15.55:0/4261321840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 0x7f1cac105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 --2- 172.21.15.55:0/4261321840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac101200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 -- 172.21.15.55:0/4261321840 >> 172.21.15.55:0/4261321840 conn(0x7f1cac0fc6d0 msgr2=0x7f1cac0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 -- 172.21.15.55:0/4261321840 shutdown_connections 2024-04-26T21:19:33.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.295+0000 7f1cb2200700 1 -- 172.21.15.55:0/4261321840 wait complete. 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.296+0000 7f1cb2200700 1 Processor -- start 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.296+0000 7f1cb2200700 1 -- start start 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cb2200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cb2200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 0x7f1cac19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cb2200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac19d3f0 con 0x7f1cac100e20 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cb2200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac1969d0 con 0x7f1cac1017d0 2024-04-26T21:19:33.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58482/0 (socket says 172.21.15.55:58482) 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 -- 172.21.15.55:0/3866000299 learned_addr learned my addr 172.21.15.55:0/3866000299 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1caaa00700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 0x7f1cac19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 -- 172.21.15.55:0/3866000299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 msgr2=0x7f1cac19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 0x7f1cac19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.297+0000 7f1cab400700 1 -- 172.21.15.55:0/3866000299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0095f0 con 0x7f1cac100e20 2024-04-26T21:19:33.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1cab400700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00bd70 tx=0x7f1c9c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9c01d070 con 0x7f1cac100e20 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c9c0056e0 con 0x7f1cac100e20 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9c017400 con 0x7f1cac100e20 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac196c50 con 0x7f1cac100e20 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.298+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac197140 con 0x7f1cac100e20 2024-04-26T21:19:33.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.299+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac1091c0 con 0x7f1cac100e20 2024-04-26T21:19:33.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.301+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1c9c003a60 con 0x7f1cac100e20 2024-04-26T21:19:33.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.301+0000 7f1ca3e00700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 0x7f1c90071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.302+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1c9c0902b0 con 0x7f1cac100e20 2024-04-26T21:19:33.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.302+0000 7f1caaa00700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 0x7f1c90071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.303+0000 7f1caaa00700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 0x7f1c90071180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005950 tx=0x7f1c980058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:33.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.306+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1c9c05cb70 con 0x7f1cac100e20 2024-04-26T21:19:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: pgmap v226: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: osdmap e83: 6 total, 6 up, 6 in 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: Standby daemon mds.cephfs.smithi064.xrdyeb assigned to filesystem cephfs as rank 0 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:replay} 2 up:standby 2024-04-26T21:19:33.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:33 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:19:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.554+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cac10ddf0 con 0x7f1c9006ecc0 2024-04-26T21:19:33.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.590+0000 7f1ca3e00700 1 -- 172.21.15.55:0/3866000299 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1cac10ddf0 con 0x7f1c9006ecc0 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (8m) 15s ago 23m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (23m) 15s ago 23m 9403k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (21m) 54s ago 21m 9038k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (4m) 15s ago 23m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (4m) 54s ago 21m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (8m) 15s ago 22m 73.7M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (26s) 15s ago 15m 11.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (15m) 15s ago 15m 86.2M - 18.2.2-1258-g7d2137f0 79c5878083fb 36e3f4c81124 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (15m) 54s ago 15m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (15m) 54s ago 15m 18.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (11m) 15s ago 24m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:19:33.593 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (10m) 54s ago 21m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (6m) 15s ago 25m 56.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (5m) 54s ago 21m 38.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (10m) 15s ago 23m 7931k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (9m) 54s ago 21m 7964k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (4m) 15s ago 20m 103M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (3m) 15s ago 19m 114M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (3m) 15s ago 19m 97.5M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (2m) 54s ago 18m 115M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (104s) 54s ago 17m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (59s) 54s ago 17m 11.2M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:19:33.594 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (9m) 15s ago 22m 69.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:19:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.593+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 msgr2=0x7f1c90071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.593+0000 7f1cb2200700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 0x7f1c90071180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c98005950 tx=0x7f1c980058e0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.593+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 msgr2=0x7f1cac19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.593+0000 7f1cb2200700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00bd70 tx=0x7f1c9c00be50 comp rx=0 tx=0).stop 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 shutdown_connections 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cac100e20 0x7f1cac19c890 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f1c9006ecc0 0x7f1c90071180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 --2- 172.21.15.55:0/3866000299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cac1017d0 0x7f1cac19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 >> 172.21.15.55:0/3866000299 conn(0x7f1cac0fc6d0 msgr2=0x7f1cac0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 shutdown_connections 2024-04-26T21:19:33.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.594+0000 7f1cb2200700 1 -- 172.21.15.55:0/3866000299 wait complete. 2024-04-26T21:19:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: pgmap v226: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:19:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: osdmap e83: 6 total, 6 up, 6 in 2024-04-26T21:19:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: Standby daemon mds.cephfs.smithi064.xrdyeb assigned to filesystem cephfs as rank 0 2024-04-26T21:19:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:19:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:19:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:replay} 2 up:standby 2024-04-26T21:19:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:33 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 -- 172.21.15.55:0/2030740187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 msgr2=0x7f3c5010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 --2- 172.21.15.55:0/2030740187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5010be40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009910 tx=0x7f3c3c009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 -- 172.21.15.55:0/2030740187 shutdown_connections 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 --2- 172.21.15.55:0/2030740187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5010be40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 --2- 172.21.15.55:0/2030740187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 0x7f3c50107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 -- 172.21.15.55:0/2030740187 >> 172.21.15.55:0/2030740187 conn(0x7f3c50076a10 msgr2=0x7f3c50078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:33.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 -- 172.21.15.55:0/2030740187 shutdown_connections 2024-04-26T21:19:33.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.758+0000 7f3c54e00700 1 -- 172.21.15.55:0/2030740187 wait complete. 2024-04-26T21:19:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.759+0000 7f3c54e00700 1 Processor -- start 2024-04-26T21:19:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.759+0000 7f3c54e00700 1 -- start start 2024-04-26T21:19:33.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c54e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 0x7f3c5019d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c54e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c54e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5019dd30 con 0x7f3c50107df0 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c54e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501a1a00 con 0x7f3c50107440 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c4d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c4d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58494/0 (socket says 172.21.15.55:58494) 2024-04-26T21:19:33.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c4d400700 1 -- 172.21.15.55:0/3437028818 learned_addr learned my addr 172.21.15.55:0/3437028818 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.760+0000 7f3c4de00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 0x7f3c5019d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c4d400700 1 -- 172.21.15.55:0/3437028818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 msgr2=0x7f3c5019d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c4d400700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 0x7f3c5019d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c4d400700 1 -- 172.21.15.55:0/3437028818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0095f0 con 0x7f3c50107df0 2024-04-26T21:19:33.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c4d400700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c005b40 tx=0x7f3c3c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3c01d070 con 0x7f3c50107df0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c3c005700 con 0x7f3c50107df0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c501a1c80 con 0x7f3c50107df0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3c00fe50 con 0x7f3c50107df0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.761+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c501a2170 con 0x7f3c50107df0 2024-04-26T21:19:33.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.763+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5010f840 con 0x7f3c50107df0 2024-04-26T21:19:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.764+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3c3c00f460 con 0x7f3c50107df0 2024-04-26T21:19:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.764+0000 7f3c46a00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 0x7f3c34071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.765+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3c3c090220 con 0x7f3c50107df0 2024-04-26T21:19:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.765+0000 7f3c4de00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 0x7f3c34071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:33.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.766+0000 7f3c4de00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 0x7f3c34071190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c40005950 tx=0x7f3c400058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:33.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:33.770+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3c3c059050 con 0x7f3c50107df0 2024-04-26T21:19:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.108+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c5019e420 con 0x7f3c50107df0 2024-04-26T21:19:34.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.109+0000 7f3c46a00700 1 -- 172.21.15.55:0/3437028818 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f3c3c05c710 con 0x7f3c50107df0 2024-04-26T21:19:34.111 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:19:34.111 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:19:34.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2, 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 1 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 2, 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 11 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:19:34.113 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:19:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 msgr2=0x7f3c34071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 0x7f3c34071190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c40005950 tx=0x7f3c400058e0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 msgr2=0x7f3c5019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c005b40 tx=0x7f3c3c00be20 comp rx=0 tx=0).stop 2024-04-26T21:19:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 shutdown_connections 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3c3406ecd0 0x7f3c34071190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c50107440 0x7f3c5019d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 --2- 172.21.15.55:0/3437028818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c50107df0 0x7f3c5019d650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.112+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 >> 172.21.15.55:0/3437028818 conn(0x7f3c50076a10 msgr2=0x7f3c50076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.113+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 shutdown_connections 2024-04-26T21:19:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.113+0000 7f3c54e00700 1 -- 172.21.15.55:0/3437028818 wait complete. 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 -- 172.21.15.55:0/1587898297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 msgr2=0x7fa1fc10cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 --2- 172.21.15.55:0/1587898297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc10cf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400b0a0 tx=0x7fa1e400b3b0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 -- 172.21.15.55:0/1587898297 shutdown_connections 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 --2- 172.21.15.55:0/1587898297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc10cf30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 --2- 172.21.15.55:0/1587898297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 0x7fa1fc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 -- 172.21.15.55:0/1587898297 >> 172.21.15.55:0/1587898297 conn(0x7fa1fc0fc6e0 msgr2=0x7fa1fc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:34.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 -- 172.21.15.55:0/1587898297 shutdown_connections 2024-04-26T21:19:34.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.279+0000 7fa201800700 1 -- 172.21.15.55:0/1587898297 wait complete. 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.280+0000 7fa201800700 1 Processor -- start 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa201800700 1 -- start start 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa201800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 0x7fa1fc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa201800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa201800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc19f5c0 con 0x7fa1fc073b20 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa201800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc198b40 con 0x7fa1fc073200 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa1f2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa1f2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58510/0 (socket says 172.21.15.55:58510) 2024-04-26T21:19:34.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.281+0000 7fa1f2000700 1 -- 172.21.15.55:0/3734807038 learned_addr learned my addr 172.21.15.55:0/3734807038 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:34.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.282+0000 7fa1faa00700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 0x7fa1fc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.282+0000 7fa1f2000700 1 -- 172.21.15.55:0/3734807038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 msgr2=0x7fa1fc19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.282+0000 7fa1f2000700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 0x7fa1fc19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.282+0000 7fa1f2000700 1 -- 172.21.15.55:0/3734807038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4009d00 con 0x7fa1fc073b20 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.282+0000 7fa1f2000700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400b070 tx=0x7fa1e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.283+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e400e040 con 0x7fa1fc073b20 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.283+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1e4004040 con 0x7fa1fc073b20 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.283+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc198dc0 con 0x7fa1fc073b20 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.283+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e401d6b0 con 0x7fa1fc073b20 2024-04-26T21:19:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.283+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc1992b0 con 0x7fa1fc073b20 2024-04-26T21:19:34.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.284+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc107760 con 0x7fa1fc073b20 2024-04-26T21:19:34.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.285+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa1e40046b0 con 0x7fa1fc073b20 2024-04-26T21:19:34.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.286+0000 7fa1f3e00700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 0x7fa1e0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.286+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa1e4090550 con 0x7fa1fc073b20 2024-04-26T21:19:34.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.286+0000 7fa1faa00700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 0x7fa1e0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.287+0000 7fa1faa00700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 0x7fa1e0071190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005950 tx=0x7fa1ec0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:34.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.291+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa1e405cd90 con 0x7fa1fc073b20 2024-04-26T21:19:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:34 smithi055 ceph-mon[109028]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:34 smithi055 ceph-mon[109028]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:34 smithi055 ceph-mon[109028]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:34 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3437028818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:34.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.566+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1fc199fe0 con 0x7fa1fc073b20 2024-04-26T21:19:34.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.567+0000 7fa1f3e00700 1 -- 172.21.15.55:0/3734807038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1699 (secure 0 0 0) 0x7fa1e405c920 con 0x7fa1fc073b20 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:e23 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 23 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:19:34.570 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:19:32.212767+0000 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 83 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:19:34.571 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=24291} 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 0 members: 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{0:24291} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:34.572 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:19:34.573 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:19:34.573 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:19:34.573 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{-1:44279} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6824/3118315402,v1:172.21.15.64:6825/3118315402] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 msgr2=0x7fa1e0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 0x7fa1e0071190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005950 tx=0x7fa1ec0058e0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 msgr2=0x7fa1fc19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400b070 tx=0x7fa1e4003ce0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 shutdown_connections 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa1e006ecd0 0x7fa1e0071190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1fc073200 0x7fa1fc19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 --2- 172.21.15.55:0/3734807038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1fc073b20 0x7fa1fc19eee0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.570+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 >> 172.21.15.55:0/3734807038 conn(0x7fa1fc0fc6e0 msgr2=0x7fa1fc105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:34.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.571+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 shutdown_connections 2024-04-26T21:19:34.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.571+0000 7fa201800700 1 -- 172.21.15.55:0/3734807038 wait complete. 2024-04-26T21:19:34.575 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-04-26T21:19:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:34 smithi064 ceph-mon[84240]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:34 smithi064 ceph-mon[84240]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:34 smithi064 ceph-mon[84240]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:34.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:34 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3437028818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 -- 172.21.15.55:0/907566827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98102680 msgr2=0x7fba9810ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 --2- 172.21.15.55:0/907566827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98102680 0x7fba9810ab70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba84009910 tx=0x7fba84009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 -- 172.21.15.55:0/907566827 shutdown_connections 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 --2- 172.21.15.55:0/907566827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98102680 0x7fba9810ab70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 --2- 172.21.15.55:0/907566827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba98101d60 0x7fba98102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.735+0000 7fba9d600700 1 -- 172.21.15.55:0/907566827 >> 172.21.15.55:0/907566827 conn(0x7fba98076740 msgr2=0x7fba980fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.736+0000 7fba9d600700 1 -- 172.21.15.55:0/907566827 shutdown_connections 2024-04-26T21:19:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.736+0000 7fba9d600700 1 -- 172.21.15.55:0/907566827 wait complete. 2024-04-26T21:19:34.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.737+0000 7fba9d600700 1 Processor -- start 2024-04-26T21:19:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.737+0000 7fba9d600700 1 -- start start 2024-04-26T21:19:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba9d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba9d600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba981994e0 0x7fba9819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba9d600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98199b00 con 0x7fba98101d60 2024-04-26T21:19:34.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba9d600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98199c70 con 0x7fba981994e0 2024-04-26T21:19:34.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba96a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba96a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58530/0 (socket says 172.21.15.55:58530) 2024-04-26T21:19:34.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba96a00700 1 -- 172.21.15.55:0/1945598274 learned_addr learned my addr 172.21.15.55:0/1945598274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:34.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.738+0000 7fba96000700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba981994e0 0x7fba9819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.739+0000 7fba96a00700 1 -- 172.21.15.55:0/1945598274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba981994e0 msgr2=0x7fba9819d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:34.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.739+0000 7fba96a00700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba981994e0 0x7fba9819d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:34.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.739+0000 7fba96a00700 1 -- 172.21.15.55:0/1945598274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840095f0 con 0x7fba98101d60 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.739+0000 7fba96a00700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba8800d8d0 tx=0x7fba8800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.740+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba880098a0 con 0x7fba98101d60 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.740+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9819de90 con 0x7fba98101d60 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.740+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9819e3e0 con 0x7fba98101d60 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.740+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba88010460 con 0x7fba98101d60 2024-04-26T21:19:34.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.740+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8800f5f0 con 0x7fba98101d60 2024-04-26T21:19:34.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.742+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780052f0 con 0x7fba98101d60 2024-04-26T21:19:34.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.743+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fba88010ad0 con 0x7fba98101d60 2024-04-26T21:19:34.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.744+0000 7fba8f400700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 0x7fba7c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:34.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.744+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fba8808e8d0 con 0x7fba98101d60 2024-04-26T21:19:34.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.745+0000 7fba96000700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 0x7fba7c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:34.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.745+0000 7fba96000700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 0x7fba7c071190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba84000c00 tx=0x7fba8401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:34.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:34.749+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fba88057700 con 0x7fba98101d60 2024-04-26T21:19:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.020+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba78000bc0 con 0x7fba7c06ecd0 2024-04-26T21:19:35.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.022+0000 7fba8f400700 1 -- 172.21.15.55:0/1945598274 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fba78000bc0 con 0x7fba7c06ecd0 2024-04-26T21:19:35.024 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:19:35.024 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:19:35.024 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:19:35.024 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "osd", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "13/23 daemons upgraded", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:19:35.025 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:19:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.024+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 msgr2=0x7fba7c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 0x7fba7c071190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba84000c00 tx=0x7fba8401a040 comp rx=0 tx=0).stop 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 msgr2=0x7fba98198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba8800d8d0 tx=0x7fba8800dbe0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 shutdown_connections 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba98101d60 0x7fba98198fa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fba7c06ecd0 0x7fba7c071190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 --2- 172.21.15.55:0/1945598274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba981994e0 0x7fba9819d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 >> 172.21.15.55:0/1945598274 conn(0x7fba98076740 msgr2=0x7fba98101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 shutdown_connections 2024-04-26T21:19:35.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.025+0000 7fba9d600700 1 -- 172.21.15.55:0/1945598274 wait complete. 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.190+0000 7f7d58a00700 1 -- 172.21.15.55:0/1759967057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 msgr2=0x7f7d5410cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.190+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1759967057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d5410cf20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009910 tx=0x7f7d40009c20 comp rx=0 tx=0).stop 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 -- 172.21.15.55:0/1759967057 shutdown_connections 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1759967057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d5410cf20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1759967057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 0x7f7d54073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 -- 172.21.15.55:0/1759967057 >> 172.21.15.55:0/1759967057 conn(0x7f7d540fc6d0 msgr2=0x7f7d540feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 -- 172.21.15.55:0/1759967057 shutdown_connections 2024-04-26T21:19:35.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.191+0000 7f7d58a00700 1 -- 172.21.15.55:0/1759967057 wait complete. 2024-04-26T21:19:35.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 Processor -- start 2024-04-26T21:19:35.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 -- start start 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 0x7f7d54198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541999b0 con 0x7f7d54073bd0 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.192+0000 7f7d58a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5419d680 con 0x7f7d540732b0 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55692/0 (socket says 172.21.15.55:55692) 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 -- 172.21.15.55:0/1242651945 learned_addr learned my addr 172.21.15.55:0/1242651945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51e00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 0x7f7d54198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 -- 172.21.15.55:0/1242651945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 msgr2=0x7f7d54198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 0x7f7d54198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.193+0000 7f7d51400700 1 -- 172.21.15.55:0/1242651945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400095f0 con 0x7f7d54073bd0 2024-04-26T21:19:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d51400700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d40000c00 tx=0x7f7d4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4001d070 con 0x7f7d54073bd0 2024-04-26T21:19:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d400056e0 con 0x7f7d54073bd0 2024-04-26T21:19:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5419d900 con 0x7f7d54073bd0 2024-04-26T21:19:35.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4000fe80 con 0x7f7d54073bd0 2024-04-26T21:19:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.194+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5419ddf0 con 0x7f7d54073bd0 2024-04-26T21:19:35.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.195+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54074960 con 0x7f7d54073bd0 2024-04-26T21:19:35.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.197+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7d4000f6f0 con 0x7f7d54073bd0 2024-04-26T21:19:35.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.197+0000 7f7d4aa00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 0x7f7d38071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:19:35.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.198+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7d40090310 con 0x7f7d54073bd0 2024-04-26T21:19:35.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.198+0000 7f7d51e00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 0x7f7d38071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:19:35.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.199+0000 7f7d51e00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 0x7f7d38071190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d44005950 tx=0x7f7d440058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:19:35.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.203+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f7d40059020 con 0x7f7d54073bd0 2024-04-26T21:19:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:35 smithi055 ceph-mon[109028]: pgmap v228: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2024-04-26T21:19:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:35 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3734807038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:19:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.541+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7d5410ffe0 con 0x7f7d54073bd0 2024-04-26T21:19:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.542+0000 7f7d4aa00700 1 -- 172.21.15.55:0/1242651945 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f7d4005c6e0 con 0x7f7d54073bd0 2024-04-26T21:19:35.544 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-26T21:19:35.544 INFO:teuthology.orchestra.run.smithi055.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T21:19:35.544 INFO:teuthology.orchestra.run.smithi055.stdout: fs cephfs is degraded 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 msgr2=0x7f7d38071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 0x7f7d38071190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d44005950 tx=0x7f7d440058e0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 msgr2=0x7f7d541992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d40000c00 tx=0x7f7d4000be20 comp rx=0 tx=0).stop 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 shutdown_connections 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7d3806ecd0 0x7f7d38071190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d540732b0 0x7f7d54198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 --2- 172.21.15.55:0/1242651945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d54073bd0 0x7f7d541992d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:19:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 >> 172.21.15.55:0/1242651945 conn(0x7f7d540fc6d0 msgr2=0x7f7d54105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:19:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 shutdown_connections 2024-04-26T21:19:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:19:35.545+0000 7f7d58a00700 1 -- 172.21.15.55:0/1242651945 wait complete. 2024-04-26T21:19:35.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:35 smithi064 ceph-mon[84240]: pgmap v228: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 1 op/s 2024-04-26T21:19:35.557 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:35 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3734807038' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:19:36.626 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:36 smithi055 ceph-mon[109028]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:36.626 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:36 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1242651945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:19:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:36 smithi064 ceph-mon[84240]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:19:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:36 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1242651945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:19:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:37 smithi064 ceph-mon[84240]: pgmap v229: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-04-26T21:19:37.661 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:37 smithi055 ceph-mon[109028]: pgmap v229: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-04-26T21:19:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:39 smithi064 ceph-mon[84240]: pgmap v230: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-26T21:19:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:39 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:39.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:39 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:39.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:39 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:39.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:39 smithi055 ceph-mon[109028]: pgmap v230: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-26T21:19:39.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:39 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:39.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:39 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:39.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:39 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:40.558 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:40 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] up:boot 2024-04-26T21:19:40.558 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:40 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:replay} 3 up:standby 2024-04-26T21:19:40.558 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:19:40.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:40 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] up:boot 2024-04-26T21:19:40.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:40 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:replay} 3 up:standby 2024-04-26T21:19:40.746 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:19:41.551 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:41 smithi064 ceph-mon[84240]: pgmap v231: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:19:41.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:41 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:reconnect 2024-04-26T21:19:41.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:41 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:reconnect} 3 up:standby 2024-04-26T21:19:41.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:41 smithi064 ceph-mon[84240]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00899983 2024-04-26T21:19:41.552 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:41 smithi064 ceph-mon[84240]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.00899983 2024-04-26T21:19:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:41 smithi055 ceph-mon[109028]: pgmap v231: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-26T21:19:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:41 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:reconnect 2024-04-26T21:19:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:41 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:reconnect} 3 up:standby 2024-04-26T21:19:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:41 smithi055 ceph-mon[109028]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00899983 2024-04-26T21:19:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:41 smithi055 ceph-mon[109028]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.00899983 2024-04-26T21:19:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:42 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:rejoin 2024-04-26T21:19:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:42 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:rejoin} 3 up:standby 2024-04-26T21:19:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:42 smithi064 ceph-mon[84240]: daemon mds.cephfs.smithi064.xrdyeb is now active in filesystem cephfs as rank 0 2024-04-26T21:19:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:42.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:42 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:rejoin 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:42 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi064.xrdyeb=up:rejoin} 3 up:standby 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:42 smithi055 ceph-mon[109028]: daemon mds.cephfs.smithi064.xrdyeb is now active in filesystem cephfs as rank 0 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:43.497 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:43 smithi055 ceph-mon[109028]: pgmap v232: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-26T21:19:43.497 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:43 smithi055 ceph-mon[109028]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:19:43.497 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:43 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:19:43.498 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:43 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:active 2024-04-26T21:19:43.498 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:43 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 3 up:standby 2024-04-26T21:19:43.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:43 smithi064 ceph-mon[84240]: pgmap v232: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-26T21:19:43.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:43 smithi064 ceph-mon[84240]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:19:43.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:43 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:19:43.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:43 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] up:active 2024-04-26T21:19:43.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:43 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 3 up:standby 2024-04-26T21:19:45.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:45 smithi064 ceph-mon[84240]: pgmap v233: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 6 op/s 2024-04-26T21:19:45.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:45 smithi055 ceph-mon[109028]: pgmap v233: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 175 B/s wr, 6 op/s 2024-04-26T21:19:47.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:47 smithi064 ceph-mon[84240]: pgmap v234: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:19:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:47.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:47 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:47 smithi055 ceph-mon[109028]: pgmap v234: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:19:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:47.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:47 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:49.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:49 smithi064 ceph-mon[84240]: pgmap v235: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:19:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:49 smithi055 ceph-mon[109028]: pgmap v235: 65 pgs: 65 active+clean; 198 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T21:19:50.716 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:50.716 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:50.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:51.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:51 smithi055 ceph-mon[109028]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-26T21:19:51.891 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:51 smithi064 ceph-mon[84240]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-26T21:19:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:53 smithi055 ceph-mon[109028]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:19:53.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:53 smithi064 ceph-mon[84240]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:19:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:55 smithi055 ceph-mon[109028]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:19:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:55 smithi064 ceph-mon[84240]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:19:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:56.846 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:19:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:57 smithi055 ceph-mon[109028]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:19:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:57.896 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:57 smithi064 ceph-mon[84240]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:19:57.896 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:57.896 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: Upgrade: Updating mds.cephfs.smithi064.ukvnjs 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:59.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:19:59 smithi064 ceph-mon[84240]: Deploying daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:19:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-26T21:19:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: Upgrade: Updating mds.cephfs.smithi064.ukvnjs 2024-04-26T21:19:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:19:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.ukvnjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:19:59.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:59.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:19:59 smithi055 ceph-mon[109028]: Deploying daemon mds.cephfs.smithi064.ukvnjs on smithi064 2024-04-26T21:20:00.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:00 smithi055 ceph-mon[109028]: overall HEALTH_OK 2024-04-26T21:20:00.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:00 smithi064 ceph-mon[84240]: overall HEALTH_OK 2024-04-26T21:20:01.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:01 smithi055 ceph-mon[109028]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:20:01.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:01 smithi064 ceph-mon[84240]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-04-26T21:20:03.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:03 smithi055 ceph-mon[109028]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:03.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:03 smithi055 ceph-mon[109028]: osdmap e84: 6 total, 6 up, 6 in 2024-04-26T21:20:03.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:03 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 2 up:standby 2024-04-26T21:20:03.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:03 smithi064 ceph-mon[84240]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:03.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:03 smithi064 ceph-mon[84240]: osdmap e84: 6 total, 6 up, 6 in 2024-04-26T21:20:03.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:03 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 2 up:standby 2024-04-26T21:20:05.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:05 smithi055 ceph-mon[109028]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:05.632 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:05 smithi064 ceph-mon[84240]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 -- 172.21.15.55:0/1916164346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107df0 msgr2=0x7f972810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 --2- 172.21.15.55:0/1916164346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107df0 0x7f972810be40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9714009910 tx=0x7f9714009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 -- 172.21.15.55:0/1916164346 shutdown_connections 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 --2- 172.21.15.55:0/1916164346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107df0 0x7f972810be40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 --2- 172.21.15.55:0/1916164346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107440 0x7f9728107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 -- 172.21.15.55:0/1916164346 >> 172.21.15.55:0/1916164346 conn(0x7f9728076a10 msgr2=0x7f9728078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 -- 172.21.15.55:0/1916164346 shutdown_connections 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.728+0000 7f972da00700 1 -- 172.21.15.55:0/1916164346 wait complete. 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.730+0000 7f972da00700 1 Processor -- start 2024-04-26T21:20:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.730+0000 7f972da00700 1 -- start start 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f972da00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f972da00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 0x7f972819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f972da00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972819dd30 con 0x7f9728107440 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f972da00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97281a1a00 con 0x7f9728107df0 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33526/0 (socket says 172.21.15.55:33526) 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 -- 172.21.15.55:0/3182381596 learned_addr learned my addr 172.21.15.55:0/3182381596 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726000700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 0x7f972819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 -- 172.21.15.55:0/3182381596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 msgr2=0x7f972819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 0x7f972819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726a00700 1 -- 172.21.15.55:0/3182381596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97140095f0 con 0x7f9728107440 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.731+0000 7f9726000700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 0x7f972819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:05.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f9726a00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f971800d8d0 tx=0x7f971800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9718009940 con 0x7f9728107440 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97281a1ce0 con 0x7f9728107440 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9718010460 con 0x7f9728107440 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f971800f5f0 con 0x7f9728107440 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.732+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97281a2230 con 0x7f9728107440 2024-04-26T21:20:05.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.734+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972810f840 con 0x7f9728107440 2024-04-26T21:20:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.735+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f97180105d0 con 0x7f9728107440 2024-04-26T21:20:05.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.736+0000 7f971f400700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 0x7f970c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.736+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f971808ee10 con 0x7f9728107440 2024-04-26T21:20:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.737+0000 7f9726000700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 0x7f970c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:05.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.737+0000 7f9726000700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 0x7f970c071180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9714005f50 tx=0x7f9714005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:05.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.742+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9718057ba0 con 0x7f9728107440 2024-04-26T21:20:05.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.993+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97281143e0 con 0x7f970c06ecc0 2024-04-26T21:20:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:05.996+0000 7f971f400700 1 -- 172.21.15.55:0/3182381596 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f97281143e0 con 0x7f970c06ecc0 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 msgr2=0x7f970c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 0x7f970c071180 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9714005f50 tx=0x7f9714005dc0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 msgr2=0x7f972819d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f971800d8d0 tx=0x7f971800dc90 comp rx=0 tx=0).stop 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 shutdown_connections 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9728107440 0x7f972819d110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f970c06ecc0 0x7f970c071180 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 --2- 172.21.15.55:0/3182381596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9728107df0 0x7f972819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 >> 172.21.15.55:0/3182381596 conn(0x7f9728076a10 msgr2=0x7f9728076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 shutdown_connections 2024-04-26T21:20:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.000+0000 7f972da00700 1 -- 172.21.15.55:0/3182381596 wait complete. 2024-04-26T21:20:06.018 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 -- 172.21.15.55:0/3559435966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 msgr2=0x7f7ef8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 --2- 172.21.15.55:0/3559435966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8107a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009910 tx=0x7f7ee4009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 -- 172.21.15.55:0/3559435966 shutdown_connections 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 --2- 172.21.15.55:0/3559435966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8107a40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 --2- 172.21.15.55:0/3559435966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 0x7f7ef8103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 -- 172.21.15.55:0/3559435966 >> 172.21.15.55:0/3559435966 conn(0x7f7ef80fe8b0 msgr2=0x7f7ef8100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:06.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 -- 172.21.15.55:0/3559435966 shutdown_connections 2024-04-26T21:20:06.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.168+0000 7f7efd200700 1 -- 172.21.15.55:0/3559435966 wait complete. 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.169+0000 7f7efd200700 1 Processor -- start 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.169+0000 7f7efd200700 1 -- start start 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7efd200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 0x7f7ef8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7efd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7efd200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8199890 con 0x7f7ef81039f0 2024-04-26T21:20:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7efd200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8199a00 con 0x7f7ef8103040 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7ef5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7ef5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33556/0 (socket says 172.21.15.55:33556) 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.170+0000 7f7ef5400700 1 -- 172.21.15.55:0/1931872107 learned_addr learned my addr 172.21.15.55:0/1931872107 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.171+0000 7f7ef5e00700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 0x7f7ef8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.171+0000 7f7ef5400700 1 -- 172.21.15.55:0/1931872107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 msgr2=0x7f7ef8198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.171+0000 7f7ef5400700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 0x7f7ef8198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.171+0000 7f7ef5400700 1 -- 172.21.15.55:0/1931872107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40095f0 con 0x7f7ef81039f0 2024-04-26T21:20:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.171+0000 7f7ef5400700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005b40 tx=0x7f7ee400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.172+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee401d070 con 0x7f7ef81039f0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.172+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef819c630 con 0x7f7ef81039f0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.172+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee400f460 con 0x7f7ef81039f0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.172+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee4017630 con 0x7f7ef81039f0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.172+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef819cb20 con 0x7f7ef81039f0 2024-04-26T21:20:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.173+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef810b440 con 0x7f7ef81039f0 2024-04-26T21:20:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.174+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7ee400f5d0 con 0x7f7ef81039f0 2024-04-26T21:20:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.175+0000 7f7eeea00700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 0x7f7edc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.176+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7ee4090410 con 0x7f7ef81039f0 2024-04-26T21:20:06.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.176+0000 7f7ef5e00700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 0x7f7edc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.176+0000 7f7ef5e00700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 0x7f7edc071190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005ea0 tx=0x7f7ee8005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:06.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.181+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f7ee4059120 con 0x7f7ef81039f0 2024-04-26T21:20:06.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.432+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ef819a040 con 0x7f7edc06ecd0 2024-04-26T21:20:06.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.434+0000 7f7eeea00700 1 -- 172.21.15.55:0/1931872107 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7ef819a040 con 0x7f7edc06ecd0 2024-04-26T21:20:06.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 msgr2=0x7f7edc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 0x7f7edc071190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005ea0 tx=0x7f7ee8005e30 comp rx=0 tx=0).stop 2024-04-26T21:20:06.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 msgr2=0x7f7ef8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4005b40 tx=0x7f7ee400be20 comp rx=0 tx=0).stop 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 shutdown_connections 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7edc06ecd0 0x7f7edc071190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ef8103040 0x7f7ef8198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 --2- 172.21.15.55:0/1931872107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef81039f0 0x7f7ef8199290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 >> 172.21.15.55:0/1931872107 conn(0x7f7ef80fe8b0 msgr2=0x7f7ef80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 shutdown_connections 2024-04-26T21:20:06.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.437+0000 7f7efd200700 1 -- 172.21.15.55:0/1931872107 wait complete. 2024-04-26T21:20:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 -- 172.21.15.55:0/1003688753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 msgr2=0x7fa358107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 --2- 172.21.15.55:0/1003688753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa358107510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa340009910 tx=0x7fa340009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 -- 172.21.15.55:0/1003688753 shutdown_connections 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 --2- 172.21.15.55:0/1003688753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa358107510 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 --2- 172.21.15.55:0/1003688753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 -- 172.21.15.55:0/1003688753 >> 172.21.15.55:0/1003688753 conn(0x7fa358076830 msgr2=0x7fa358078c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 -- 172.21.15.55:0/1003688753 shutdown_connections 2024-04-26T21:20:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.591+0000 7fa357e00700 1 -- 172.21.15.55:0/1003688753 wait complete. 2024-04-26T21:20:06.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.592+0000 7fa357e00700 1 Processor -- start 2024-04-26T21:20:06.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.593+0000 7fa357e00700 1 -- start start 2024-04-26T21:20:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.593+0000 7fa357e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.593+0000 7fa357e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35819d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.593+0000 7fa357e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35819dc40 con 0x7fa3581070b0 2024-04-26T21:20:06.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.593+0000 7fa357e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581a1910 con 0x7fa35810d0c0 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33572/0 (socket says 172.21.15.55:33572) 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 -- 172.21.15.55:0/33547166 learned_addr learned my addr 172.21.15.55:0/33547166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa34fe00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35819d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 -- 172.21.15.55:0/33547166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 msgr2=0x7fa35819d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35819d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 -- 172.21.15.55:0/33547166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400095f0 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa34fe00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35819d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.594+0000 7fa356a00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa34800e920 tx=0x7fa34800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.595+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa348009790 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.595+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa34800cba0 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.595+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa348018650 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.595+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3581a1bf0 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.595+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3581a2140 con 0x7fa3581070b0 2024-04-26T21:20:06.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.596+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35810f5c0 con 0x7fa3581070b0 2024-04-26T21:20:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.597+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa34800cd10 con 0x7fa3581070b0 2024-04-26T21:20:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.598+0000 7fa34f400700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 0x7fa33c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.598+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa348014070 con 0x7fa3581070b0 2024-04-26T21:20:06.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.598+0000 7fa34fe00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 0x7fa33c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:06.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.599+0000 7fa34fe00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 0x7fa33c071190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa34000b760 tx=0x7fa340005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:06.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.603+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fa348054060 con 0x7fa3581070b0 2024-04-26T21:20:06.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.842+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa35819e3d0 con 0x7fa33c06ecd0 2024-04-26T21:20:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.874+0000 7fa34f400700 1 -- 172.21.15.55:0/33547166 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa35819e3d0 con 0x7fa33c06ecd0 2024-04-26T21:20:06.875 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (9m) 19s ago 23m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (23m) 19s ago 23m 9445k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (22m) 87s ago 22m 9038k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (5m) 19s ago 23m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (5m) 87s ago 22m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (8m) 19s ago 23m 73.8M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (60s) 19s ago 16m 11.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (28s) 19s ago 15m 11.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 963e3ca49805 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (16m) 87s ago 15m 99.0M - 18.2.2-1258-g7d2137f0 79c5878083fb 1cc8596de66d 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (15m) 87s ago 15m 18.7M - 18.2.2-1258-g7d2137f0 79c5878083fb 70382eb9f5c1 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (12m) 19s ago 25m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (10m) 87s ago 22m 453M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:20:06.876 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (7m) 19s ago 25m 57.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (6m) 87s ago 22m 38.4M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (10m) 19s ago 23m 7776k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (10m) 87s ago 22m 7964k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (4m) 19s ago 21m 105M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (4m) 19s ago 20m 115M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (3m) 19s ago 19m 99.8M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (3m) 87s ago 19m 115M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (2m) 87s ago 18m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (92s) 87s ago 17m 11.2M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:20:06.877 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (9m) 19s ago 22m 70.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:20:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.878+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 msgr2=0x7fa33c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.878+0000 7fa357e00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 0x7fa33c071190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa34000b760 tx=0x7fa340005fb0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.878+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 msgr2=0x7fa35819d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.878+0000 7fa357e00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa34800e920 tx=0x7fa34800ece0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 shutdown_connections 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3581070b0 0x7fa35819d020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fa33c06ecd0 0x7fa33c071190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 --2- 172.21.15.55:0/33547166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa35810d0c0 0x7fa35819d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 >> 172.21.15.55:0/33547166 conn(0x7fa358076830 msgr2=0x7fa35810c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 shutdown_connections 2024-04-26T21:20:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:06.879+0000 7fa357e00700 1 -- 172.21.15.55:0/33547166 wait complete. 2024-04-26T21:20:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 -- 172.21.15.55:0/2724747825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150101d60 msgr2=0x7ff150102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 --2- 172.21.15.55:0/2724747825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150101d60 0x7ff150102140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff144009910 tx=0x7ff144009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 -- 172.21.15.55:0/2724747825 shutdown_connections 2024-04-26T21:20:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 --2- 172.21.15.55:0/2724747825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150102680 0x7ff15010ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 --2- 172.21.15.55:0/2724747825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150101d60 0x7ff150102140 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 -- 172.21.15.55:0/2724747825 >> 172.21.15.55:0/2724747825 conn(0x7ff150076740 msgr2=0x7ff1500fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:07.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.032+0000 7ff158200700 1 -- 172.21.15.55:0/2724747825 shutdown_connections 2024-04-26T21:20:07.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.033+0000 7ff158200700 1 -- 172.21.15.55:0/2724747825 wait complete. 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 Processor -- start 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 -- start start 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150101d60 0x7ff150198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150199a20 con 0x7ff150102680 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff158200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15019d6f0 con 0x7ff150101d60 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff154e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff154e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33602/0 (socket says 172.21.15.55:33602) 2024-04-26T21:20:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.034+0000 7ff154e00700 1 -- 172.21.15.55:0/1402924858 learned_addr learned my addr 172.21.15.55:0/1402924858 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff155800700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150101d60 0x7ff150198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff154e00700 1 -- 172.21.15.55:0/1402924858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150101d60 msgr2=0x7ff150198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff154e00700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150101d60 0x7ff150198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff154e00700 1 -- 172.21.15.55:0/1402924858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440095f0 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff154e00700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00b3d0 tx=0x7ff13c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c011800 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff13c011e20 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15019d9d0 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.035+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c010ea0 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.036+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15019df20 con 0x7ff150102680 2024-04-26T21:20:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.037+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15010a6d0 con 0x7ff150102680 2024-04-26T21:20:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.038+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff13c010380 con 0x7ff150102680 2024-04-26T21:20:07.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.039+0000 7ff14e000700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 0x7ff138071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.039+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff13c08e930 con 0x7ff150102680 2024-04-26T21:20:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.039+0000 7ff155800700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 0x7ff138071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.040+0000 7ff155800700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 0x7ff138071190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b5c0 tx=0x7ff14401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:07.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.044+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff13c0576c0 con 0x7ff150102680 2024-04-26T21:20:07.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.364+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff150068ea0 con 0x7ff150102680 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.365+0000 7ff14e000700 1 -- 172.21.15.55:0/1402924858 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7ff13c05ad80 con 0x7ff150102680 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:20:07.366 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 1, 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 18.2.2-1258-g7d2137f0 (7d2137f0a666c92a9411c1af5c33e4968be54da6) reef (stable)": 1, 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 12 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:20:07.367 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:20:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 msgr2=0x7ff138071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 0x7ff138071190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b5c0 tx=0x7ff14401a040 comp rx=0 tx=0).stop 2024-04-26T21:20:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 msgr2=0x7ff150199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00b3d0 tx=0x7ff13c00b790 comp rx=0 tx=0).stop 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 shutdown_connections 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff13806ecd0 0x7ff138071190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff150101d60 0x7ff150198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 --2- 172.21.15.55:0/1402924858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150102680 0x7ff150199340 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 >> 172.21.15.55:0/1402924858 conn(0x7ff150076740 msgr2=0x7ff150101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 shutdown_connections 2024-04-26T21:20:07.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.368+0000 7ff158200700 1 -- 172.21.15.55:0/1402924858 wait complete. 2024-04-26T21:20:07.375 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:07 smithi064 ceph-mon[84240]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:07.375 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:07 smithi064 ceph-mon[84240]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:07.375 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:07 smithi064 ceph-mon[84240]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:07 smithi055 ceph-mon[109028]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:07 smithi055 ceph-mon[109028]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:07 smithi055 ceph-mon[109028]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.531+0000 7f93d4e00700 1 -- 172.21.15.55:0/3154731168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d01017d0 msgr2=0x7f93d0105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.531+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3154731168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d01017d0 0x7f93d0105820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009910 tx=0x7f93bc009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 -- 172.21.15.55:0/3154731168 shutdown_connections 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3154731168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d01017d0 0x7f93d0105820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3154731168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d0100e20 0x7f93d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 -- 172.21.15.55:0/3154731168 >> 172.21.15.55:0/3154731168 conn(0x7f93d00fc6d0 msgr2=0x7f93d00feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 -- 172.21.15.55:0/3154731168 shutdown_connections 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.532+0000 7f93d4e00700 1 -- 172.21.15.55:0/3154731168 wait complete. 2024-04-26T21:20:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.533+0000 7f93d4e00700 1 Processor -- start 2024-04-26T21:20:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.533+0000 7f93d4e00700 1 -- start start 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93d4e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93d4e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d01017d0 0x7f93d01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93d4e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0199aa0 con 0x7f93d0100e20 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93d4e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d019d720 con 0x7f93d01017d0 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33606/0 (socket says 172.21.15.55:33606) 2024-04-26T21:20:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 -- 172.21.15.55:0/3463745556 learned_addr learned my addr 172.21.15.55:0/3463745556 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 -- 172.21.15.55:0/3463745556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d01017d0 msgr2=0x7f93d01993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cd400700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d01017d0 0x7f93d01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d01017d0 0x7f93d01993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.534+0000 7f93cde00700 1 -- 172.21.15.55:0/3463745556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0095f0 con 0x7f93d0100e20 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93cde00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93c000b4b0 tx=0x7f93c000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c0011800 con 0x7f93d0100e20 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c0011e20 con 0x7f93d0100e20 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c000f2e0 con 0x7f93d0100e20 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d019da00 con 0x7f93d0100e20 2024-04-26T21:20:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.535+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d019df50 con 0x7f93d0100e20 2024-04-26T21:20:07.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.536+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0102300 con 0x7f93d0100e20 2024-04-26T21:20:07.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.537+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f93c0010380 con 0x7f93d0100e20 2024-04-26T21:20:07.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.538+0000 7f93c6a00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 0x7f93b4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.538+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f93c008ea30 con 0x7f93d0100e20 2024-04-26T21:20:07.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.539+0000 7f93cd400700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 0x7f93b4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.539+0000 7f93cd400700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 0x7f93b4071190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.543+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f93c0057870 con 0x7f93d0100e20 2024-04-26T21:20:07.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.826+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93d010de40 con 0x7f93d0100e20 2024-04-26T21:20:07.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.827+0000 7f93c6a00700 1 -- 172.21.15.55:0/3463745556 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1711 (secure 0 0 0) 0x7f93c005af30 con 0x7f93d0100e20 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:e28 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 27 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:20:07.828 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:19:42.298233+0000 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 83 2024-04-26T21:20:07.829 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=24291} 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:20:07.830 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 24291 members: 24291 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{0:24291} state up:active seq 234 join_fscid=1 addr [v2:172.21.15.64:6826/258074733,v1:172.21.15.64:6827/258074733] compat {c=[1],r=[1],i=[7ff]}] 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:07.831 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:07.832 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:34494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 msgr2=0x7f93b4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 0x7f93b4071190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc00b540 comp rx=0 tx=0).stop 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 msgr2=0x7f93d0198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93c000b4b0 tx=0x7f93c000b870 comp rx=0 tx=0).stop 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 shutdown_connections 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93d0100e20 0x7f93d0198e80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f93b406ecd0 0x7f93b4071190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 --2- 172.21.15.55:0/3463745556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93d01017d0 0x7f93d01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 >> 172.21.15.55:0/3463745556 conn(0x7f93d00fc6d0 msgr2=0x7f93d00744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 shutdown_connections 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.830+0000 7f93d4e00700 1 -- 172.21.15.55:0/3463745556 wait complete. 2024-04-26T21:20:07.833 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 28 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.988+0000 7fb7f4c00700 1 -- 172.21.15.55:0/3525430373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f0073bd0 msgr2=0x7fb7f010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.988+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/3525430373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f0073bd0 0x7fb7f010cd80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009910 tx=0x7fb7dc009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.988+0000 7fb7f4c00700 1 -- 172.21.15.55:0/3525430373 shutdown_connections 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.988+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/3525430373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f0073bd0 0x7fb7f010cd80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.988+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/3525430373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f00732b0 0x7fb7f0073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.989+0000 7fb7f4c00700 1 -- 172.21.15.55:0/3525430373 >> 172.21.15.55:0/3525430373 conn(0x7fb7f00fc530 msgr2=0x7fb7f00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.989+0000 7fb7f4c00700 1 -- 172.21.15.55:0/3525430373 shutdown_connections 2024-04-26T21:20:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.989+0000 7fb7f4c00700 1 -- 172.21.15.55:0/3525430373 wait complete. 2024-04-26T21:20:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.990+0000 7fb7f4c00700 1 Processor -- start 2024-04-26T21:20:07.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.990+0000 7fb7f4c00700 1 -- start start 2024-04-26T21:20:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7f4c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7f4c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f0073bd0 0x7fb7f019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7f4c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f019f350 con 0x7fb7f00732b0 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7f4c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01989c0 con 0x7fb7f0073bd0 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7ef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7ef400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33634/0 (socket says 172.21.15.55:33634) 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7ef400700 1 -- 172.21.15.55:0/2402940671 learned_addr learned my addr 172.21.15.55:0/2402940671 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:07.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.991+0000 7fb7eea00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f0073bd0 0x7fb7f019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7ef400700 1 -- 172.21.15.55:0/2402940671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f0073bd0 msgr2=0x7fb7f019edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7ef400700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f0073bd0 0x7fb7f019edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7ef400700 1 -- 172.21.15.55:0/2402940671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0095f0 con 0x7fb7f00732b0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7ef400700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c930 tx=0x7fb7e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e0007ad0 con 0x7fb7f00732b0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7e000ce80 con 0x7fb7f00732b0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e0018630 con 0x7fb7f00732b0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0198ca0 con 0x7fb7f00732b0 2024-04-26T21:20:07.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.992+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f01991c0 con 0x7fb7f00732b0 2024-04-26T21:20:07.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.993+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0107690 con 0x7fb7f00732b0 2024-04-26T21:20:07.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.995+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb7e0007c30 con 0x7fb7f00732b0 2024-04-26T21:20:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.995+0000 7fb7e7e00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 0x7fb7d4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.996+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb7e008ee70 con 0x7fb7f00732b0 2024-04-26T21:20:07.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.996+0000 7fb7eea00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 0x7fb7d4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:07.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:07.996+0000 7fb7eea00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 0x7fb7d4071190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc006010 tx=0x7fb7dc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:08.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.001+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb7e005b730 con 0x7fb7f00732b0 2024-04-26T21:20:08.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.254+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7f0199ef0 con 0x7fb7d406ecd0 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.257+0000 7fb7e7e00700 1 -- 172.21.15.55:0/2402940671 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb7f0199ef0 con 0x7fb7d406ecd0 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:20:08.258 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr", 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "osd", 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "mon" 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "14/23 daemons upgraded", 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:20:08.259 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:20:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.260+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 msgr2=0x7fb7d4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.260+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 0x7fb7d4071190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc006010 tx=0x7fb7dc01a040 comp rx=0 tx=0).stop 2024-04-26T21:20:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.260+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 msgr2=0x7fb7f019e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.260+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c930 tx=0x7fb7e000cc40 comp rx=0 tx=0).stop 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 shutdown_connections 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00732b0 0x7fb7f019e880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb7d406ecd0 0x7fb7d4071190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 --2- 172.21.15.55:0/2402940671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7f0073bd0 0x7fb7f019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 >> 172.21.15.55:0/2402940671 conn(0x7fb7f00fc530 msgr2=0x7fb7f0105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 shutdown_connections 2024-04-26T21:20:08.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.261+0000 7fb7f4c00700 1 -- 172.21.15.55:0/2402940671 wait complete. 2024-04-26T21:20:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 -- 172.21.15.55:0/4173084174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 msgr2=0x7fcd2410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 --2- 172.21.15.55:0/4173084174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2410be60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009910 tx=0x7fcd10009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 -- 172.21.15.55:0/4173084174 shutdown_connections 2024-04-26T21:20:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 --2- 172.21.15.55:0/4173084174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2410be60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 --2- 172.21.15.55:0/4173084174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 0x7fcd24107840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 -- 172.21.15.55:0/4173084174 >> 172.21.15.55:0/4173084174 conn(0x7fcd24076a10 msgr2=0x7fcd24078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.420+0000 7fcd2c000700 1 -- 172.21.15.55:0/4173084174 shutdown_connections 2024-04-26T21:20:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.421+0000 7fcd2c000700 1 -- 172.21.15.55:0/4173084174 wait complete. 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 Processor -- start 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 -- start start 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 0x7fcd2419d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2419e160 con 0x7fcd24107e10 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd2c000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241a1e30 con 0x7fcd24107460 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.422+0000 7fcd28c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33638/0 (socket says 172.21.15.55:33638) 2024-04-26T21:20:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 -- 172.21.15.55:0/1091317421 learned_addr learned my addr 172.21.15.55:0/1091317421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd29600700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 0x7fcd2419d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 -- 172.21.15.55:0/1091317421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 msgr2=0x7fcd2419d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 0x7fcd2419d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 -- 172.21.15.55:0/1091317421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100095f0 con 0x7fcd24107e10 2024-04-26T21:20:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.423+0000 7fcd28c00700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005b40 tx=0x7fcd1000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.424+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1001d070 con 0x7fcd24107e10 2024-04-26T21:20:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.424+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd1000f460 con 0x7fcd24107e10 2024-04-26T21:20:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.424+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd241a20b0 con 0x7fcd24107e10 2024-04-26T21:20:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.424+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd10017630 con 0x7fcd24107e10 2024-04-26T21:20:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.424+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd241a25a0 con 0x7fcd24107e10 2024-04-26T21:20:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.425+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2410f7b0 con 0x7fcd24107e10 2024-04-26T21:20:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.427+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcd1000f5d0 con 0x7fcd24107e10 2024-04-26T21:20:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.428+0000 7fcd22000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 0x7fcd0c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.428+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcd10090330 con 0x7fcd24107e10 2024-04-26T21:20:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.428+0000 7fcd29600700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 0x7fcd0c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.429+0000 7fcd29600700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 0x7fcd0c071190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd18006fd0 tx=0x7fcd18008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.433+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fcd100590c0 con 0x7fcd24107e10 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1402924858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3463745556' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:08.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:08.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:08.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1402924858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:08.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3463745556' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:20:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:08.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:08.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.750+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcd2419e850 con 0x7fcd24107e10 2024-04-26T21:20:08.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.751+0000 7fcd22000700 1 -- 172.21.15.55:0/1091317421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcd1005c780 con 0x7fcd24107e10 2024-04-26T21:20:08.752 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:20:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 msgr2=0x7fcd0c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 0x7fcd0c071190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcd18006fd0 tx=0x7fcd18008040 comp rx=0 tx=0).stop 2024-04-26T21:20:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 msgr2=0x7fcd2419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:08.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd10005b40 tx=0x7fcd1000be20 comp rx=0 tx=0).stop 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 shutdown_connections 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd0c06ecd0 0x7fcd0c071190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd24107460 0x7fcd2419d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 --2- 172.21.15.55:0/1091317421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd24107e10 0x7fcd2419da80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 >> 172.21.15.55:0/1091317421 conn(0x7fcd24076a10 msgr2=0x7fcd24078050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 shutdown_connections 2024-04-26T21:20:08.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:08.754+0000 7fcd2c000700 1 -- 172.21.15.55:0/1091317421 wait complete. 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6824/3858142462,v1:172.21.15.64:6825/3858142462] up:boot 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 3 up:standby 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:09.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:09 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1091317421' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6824/3858142462,v1:172.21.15.64:6825/3858142462] up:boot 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi064.xrdyeb=up:active} 3 up:standby 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:09.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:09 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1091317421' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:20:11.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:11 smithi064 ceph-mon[84240]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:11.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:11 smithi055 ceph-mon[109028]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:13 smithi064 ceph-mon[84240]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:13.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:13 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:13 smithi055 ceph-mon[109028]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:13.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:13 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:15.764 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:15 smithi064 ceph-mon[84240]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:15.764 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:15 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:15.765 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:15 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:15.866 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:15 smithi055 ceph-mon[109028]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:15.867 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:15 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:15.867 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:15 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:17.733 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:17 smithi064 ceph-mon[84240]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:17 smithi055 ceph-mon[109028]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:19.776 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:19 smithi064 ceph-mon[84240]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:20.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:19 smithi055 ceph-mon[109028]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:21 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.643 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:21.644 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:21 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:23 smithi064 ceph-mon[84240]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:20:23.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:23 smithi055 ceph-mon[109028]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi064.xrdyeb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:24.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:24 smithi064 ceph-mon[84240]: Upgrade: Updating mds.cephfs.smithi064.xrdyeb 2024-04-26T21:20:24.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:24 smithi064 ceph-mon[84240]: Deploying daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:20:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:24 smithi055 ceph-mon[109028]: Upgrade: Updating mds.cephfs.smithi064.xrdyeb 2024-04-26T21:20:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:24 smithi055 ceph-mon[109028]: Deploying daemon mds.cephfs.smithi064.xrdyeb on smithi064 2024-04-26T21:20:25.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:25 smithi064 ceph-mon[84240]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:25.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:25 smithi055 ceph-mon[109028]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[109024]: 2024-04-26T21:20:26.259+0000 7effc5e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:20:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:20:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:20:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: osdmap e85: 6 total, 6 up, 6 in 2024-04-26T21:20:26.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: Standby daemon mds.cephfs.smithi055.coveew assigned to filesystem cephfs as rank 0 2024-04-26T21:20:26.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:20:26.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:20:26.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:26 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:replay} 2 up:standby 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: osdmap e85: 6 total, 6 up, 6 in 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: Standby daemon mds.cephfs.smithi055.coveew assigned to filesystem cephfs as rank 0 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-26T21:20:26.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-26T21:20:26.658 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:26 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:replay} 2 up:standby 2024-04-26T21:20:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:27 smithi064 ceph-mon[84240]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:27.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:27 smithi055 ceph-mon[109028]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-04-26T21:20:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:28.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:29.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:29 smithi064 ceph-mon[84240]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 1 op/s 2024-04-26T21:20:29.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:29 smithi055 ceph-mon[109028]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 1 op/s 2024-04-26T21:20:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:31 smithi064 ceph-mon[84240]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-04-26T21:20:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:31 smithi055 ceph-mon[109028]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-04-26T21:20:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:33 smithi064 ceph-mon[84240]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-26T21:20:33.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:33 smithi055 ceph-mon[109028]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-26T21:20:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:35 smithi064 ceph-mon[84240]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:20:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:35.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:35.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:35 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:35 smithi055 ceph-mon[109028]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:20:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:35 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:reconnect 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.64:6826/1442123081,v1:172.21.15.64:6827/1442123081] up:boot 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:reconnect} 3 up:standby 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00999981 2024-04-26T21:20:36.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:36 smithi064 ceph-mon[84240]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.0109998 2024-04-26T21:20:36.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:reconnect 2024-04-26T21:20:36.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.64:6826/1442123081,v1:172.21.15.64:6827/1442123081] up:boot 2024-04-26T21:20:36.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:reconnect} 3 up:standby 2024-04-26T21:20:36.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:36.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: reconnect by client.24327 v1:172.21.15.55:0/4142426881 after 0.00999981 2024-04-26T21:20:36.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:36 smithi055 ceph-mon[109028]: reconnect by client.24331 v1:192.168.0.1:0/813456795 after 0.0109998 2024-04-26T21:20:37.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:37 smithi064 ceph-mon[84240]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-26T21:20:37.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:37 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:rejoin 2024-04-26T21:20:37.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:37 smithi064 ceph-mon[84240]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:rejoin} 3 up:standby 2024-04-26T21:20:37.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:37 smithi064 ceph-mon[84240]: daemon mds.cephfs.smithi055.coveew is now active in filesystem cephfs as rank 0 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:37 smithi055 ceph-mon[109028]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:37 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:rejoin 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:37 smithi055 ceph-mon[109028]: fsmap cephfs:1/1 {0=cephfs.smithi055.coveew=up:rejoin} 3 up:standby 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:37 smithi055 ceph-mon[109028]: daemon mds.cephfs.smithi055.coveew is now active in filesystem cephfs as rank 0 2024-04-26T21:20:38.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:38 smithi064 ceph-mon[84240]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:20:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:38 smithi064 ceph-mon[84240]: Cluster is now healthy 2024-04-26T21:20:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:38 smithi064 ceph-mon[84240]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:active 2024-04-26T21:20:38.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:38 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:38 smithi055 ceph-mon[109028]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T21:20:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:38 smithi055 ceph-mon[109028]: Cluster is now healthy 2024-04-26T21:20:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:38 smithi055 ceph-mon[109028]: mds.? [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] up:active 2024-04-26T21:20:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:38 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 -- 172.21.15.55:0/1550748953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe481002a0 msgr2=0x7efe4810cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 --2- 172.21.15.55:0/1550748953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe481002a0 0x7efe4810cf60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe30009910 tx=0x7efe30009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:38.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 -- 172.21.15.55:0/1550748953 shutdown_connections 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 --2- 172.21.15.55:0/1550748953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe481002a0 0x7efe4810cf60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 --2- 172.21.15.55:0/1550748953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe480ff8f0 0x7efe480ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 -- 172.21.15.55:0/1550748953 >> 172.21.15.55:0/1550748953 conn(0x7efe48076740 msgr2=0x7efe480fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.933+0000 7efe4f400700 1 -- 172.21.15.55:0/1550748953 shutdown_connections 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.934+0000 7efe4f400700 1 -- 172.21.15.55:0/1550748953 wait complete. 2024-04-26T21:20:38.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 Processor -- start 2024-04-26T21:20:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 -- start start 2024-04-26T21:20:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe481002a0 0x7efe48199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe481998f0 con 0x7efe480ff8f0 2024-04-26T21:20:38.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.935+0000 7efe4f400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4819c560 con 0x7efe481002a0 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45452/0 (socket says 172.21.15.55:45452) 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 -- 172.21.15.55:0/1544303202 learned_addr learned my addr 172.21.15.55:0/1544303202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe3fe00700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe481002a0 0x7efe48199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 -- 172.21.15.55:0/1544303202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe481002a0 msgr2=0x7efe48199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe481002a0 0x7efe48199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.936+0000 7efe4ca00700 1 -- 172.21.15.55:0/1544303202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300095f0 con 0x7efe480ff8f0 2024-04-26T21:20:38.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe4ca00700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e920 tx=0x7efe3800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3800c9d0 con 0x7efe480ff8f0 2024-04-26T21:20:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe38010430 con 0x7efe480ff8f0 2024-04-26T21:20:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4819c840 con 0x7efe480ff8f0 2024-04-26T21:20:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe38018630 con 0x7efe480ff8f0 2024-04-26T21:20:38.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.937+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4819cd60 con 0x7efe480ff8f0 2024-04-26T21:20:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.938+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe48068ea0 con 0x7efe480ff8f0 2024-04-26T21:20:38.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.939+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efe380105a0 con 0x7efe480ff8f0 2024-04-26T21:20:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.941+0000 7efe46000700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 0x7efe2c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.941+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe38014070 con 0x7efe480ff8f0 2024-04-26T21:20:38.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.941+0000 7efe3fe00700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 0x7efe2c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:38.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.942+0000 7efe3fe00700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 0x7efe2c071190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe4819a2e0 tx=0x7efe30005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:38.946+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7efe38054060 con 0x7efe480ff8f0 2024-04-26T21:20:39.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.197+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe4810ff70 con 0x7efe2c06ecd0 2024-04-26T21:20:39.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.201+0000 7efe46000700 1 -- 172.21.15.55:0/1544303202 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efe4810ff70 con 0x7efe2c06ecd0 2024-04-26T21:20:39.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 msgr2=0x7efe2c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 0x7efe2c071190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe4819a2e0 tx=0x7efe30005a90 comp rx=0 tx=0).stop 2024-04-26T21:20:39.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 msgr2=0x7efe48198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e920 tx=0x7efe3800ec30 comp rx=0 tx=0).stop 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 shutdown_connections 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe480ff8f0 0x7efe48198d20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efe2c06ecd0 0x7efe2c071190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 --2- 172.21.15.55:0/1544303202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe481002a0 0x7efe48199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 >> 172.21.15.55:0/1544303202 conn(0x7efe48076740 msgr2=0x7efe480fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 shutdown_connections 2024-04-26T21:20:39.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.204+0000 7efe4f400700 1 -- 172.21.15.55:0/1544303202 wait complete. 2024-04-26T21:20:39.223 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 -- 172.21.15.55:0/2164589768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 msgr2=0x7f5028107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 --2- 172.21.15.55:0/2164589768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f5028107820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5018009910 tx=0x7f5018009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 -- 172.21.15.55:0/2164589768 shutdown_connections 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 --2- 172.21.15.55:0/2164589768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 0x7f502810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 --2- 172.21.15.55:0/2164589768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f5028107820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 -- 172.21.15.55:0/2164589768 >> 172.21.15.55:0/2164589768 conn(0x7f5028076a10 msgr2=0x7f5028078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 -- 172.21.15.55:0/2164589768 shutdown_connections 2024-04-26T21:20:39.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.364+0000 7f502e000700 1 -- 172.21.15.55:0/2164589768 wait complete. 2024-04-26T21:20:39.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.365+0000 7f502e000700 1 Processor -- start 2024-04-26T21:20:39.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f502e000700 1 -- start start 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f502e000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f502e000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 0x7f502819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f502e000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502819dd70 con 0x7f5028107440 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f502e000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281a19f0 con 0x7f5028107df0 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f5027400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f5027400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45460/0 (socket says 172.21.15.55:45460) 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.366+0000 7f5027400700 1 -- 172.21.15.55:0/3250557968 learned_addr learned my addr 172.21.15.55:0/3250557968 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:39.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f5026a00700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 0x7f502819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f5027400700 1 -- 172.21.15.55:0/3250557968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 msgr2=0x7f502819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f5027400700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 0x7f502819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f5027400700 1 -- 172.21.15.55:0/3250557968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180095f0 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f5027400700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5018000c00 tx=0x7f501800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f501801d070 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50180056e0 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.367+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50281a1c70 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.368+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f501800fe80 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.368+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50281a2160 con 0x7f5028107440 2024-04-26T21:20:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.369+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502810f7e0 con 0x7f5028107440 2024-04-26T21:20:39.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.370+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f501800f6f0 con 0x7f5028107440 2024-04-26T21:20:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.371+0000 7f501fe00700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 0x7f500c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.371+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f50180902c0 con 0x7f5028107440 2024-04-26T21:20:39.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.371+0000 7f5026a00700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 0x7f500c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.372+0000 7f5026a00700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 0x7f500c071190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5014005950 tx=0x7f50140058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.376+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5018059020 con 0x7f5028107440 2024-04-26T21:20:39.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:39 smithi055 ceph-mon[109028]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:20:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.636+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f502819e4f0 con 0x7f500c06ecd0 2024-04-26T21:20:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.638+0000 7f501fe00700 1 -- 172.21.15.55:0/3250557968 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f502819e4f0 con 0x7f500c06ecd0 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 msgr2=0x7f500c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 0x7f500c071190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5014005950 tx=0x7f50140058e0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 msgr2=0x7f502819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5018000c00 tx=0x7f501800be20 comp rx=0 tx=0).stop 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 shutdown_connections 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5028107440 0x7f502819d150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f500c06ecd0 0x7f500c071190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 --2- 172.21.15.55:0/3250557968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5028107df0 0x7f502819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.641+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 >> 172.21.15.55:0/3250557968 conn(0x7f5028076a10 msgr2=0x7f5028076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.642+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 shutdown_connections 2024-04-26T21:20:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.642+0000 7f502e000700 1 -- 172.21.15.55:0/3250557968 wait complete. 2024-04-26T21:20:39.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:39 smithi064 ceph-mon[84240]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-26T21:20:39.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.798+0000 7fb8fa200700 1 -- 172.21.15.55:0/548315989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4102680 msgr2=0x7fb8f410ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.798+0000 7fb8fa200700 1 --2- 172.21.15.55:0/548315989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4102680 0x7fb8f410ab70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009910 tx=0x7fb8dc009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 -- 172.21.15.55:0/548315989 shutdown_connections 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 --2- 172.21.15.55:0/548315989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4102680 0x7fb8f410ab70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 --2- 172.21.15.55:0/548315989 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4101d60 0x7fb8f4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 -- 172.21.15.55:0/548315989 >> 172.21.15.55:0/548315989 conn(0x7fb8f4076740 msgr2=0x7fb8f40fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 -- 172.21.15.55:0/548315989 shutdown_connections 2024-04-26T21:20:39.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.799+0000 7fb8fa200700 1 -- 172.21.15.55:0/548315989 wait complete. 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.800+0000 7fb8fa200700 1 Processor -- start 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.800+0000 7fb8fa200700 1 -- start start 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8fa200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8fa200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4102680 0x7fb8f419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8fa200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f419d380 con 0x7fb8f4101d60 2024-04-26T21:20:39.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8fa200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4196960 con 0x7fb8f4102680 2024-04-26T21:20:39.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8f3400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8f3400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45482/0 (socket says 172.21.15.55:45482) 2024-04-26T21:20:39.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8f3400700 1 -- 172.21.15.55:0/2671031661 learned_addr learned my addr 172.21.15.55:0/2671031661 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.801+0000 7fb8eaa00700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4102680 0x7fb8f419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f3400700 1 -- 172.21.15.55:0/2671031661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4102680 msgr2=0x7fb8f419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f3400700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4102680 0x7fb8f419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f3400700 1 -- 172.21.15.55:0/2671031661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0095f0 con 0x7fb8f4101d60 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f3400700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ada0 tx=0x7fb8e400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e400f070 con 0x7fb8f4101d60 2024-04-26T21:20:39.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8e400ae90 con 0x7fb8f4101d60 2024-04-26T21:20:39.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4005690 con 0x7fb8f4101d60 2024-04-26T21:20:39.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.802+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4196c40 con 0x7fb8f4101d60 2024-04-26T21:20:39.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.803+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4197140 con 0x7fb8f4101d60 2024-04-26T21:20:39.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.804+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4105480 con 0x7fb8f4101d60 2024-04-26T21:20:39.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.805+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb8e4005900 con 0x7fb8f4101d60 2024-04-26T21:20:39.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.806+0000 7fb8f0c00700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 0x7fb8d8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:39.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.806+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb8e408e8d0 con 0x7fb8f4101d60 2024-04-26T21:20:39.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.807+0000 7fb8eaa00700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 0x7fb8d8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:39.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.807+0000 7fb8eaa00700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 0x7fb8d8071180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4197b20 tx=0x7fb8dc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:39.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:39.811+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb8e405b0c0 con 0x7fb8f4101d60 2024-04-26T21:20:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.057+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f410ddc0 con 0x7fb8d806ecc0 2024-04-26T21:20:40.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.074+0000 7fb8f0c00700 1 -- 172.21.15.55:0/2671031661 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb8f410ddc0 con 0x7fb8d806ecc0 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (9m) 52s ago 24m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (24m) 52s ago 24m 9445k - 18.2.2-1258-g7d2137f0 79c5878083fb 16d7069ddceb 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (23m) 0s ago 22m 9457k - 18.2.2-1258-g7d2137f0 79c5878083fb ce05eb53f9d3 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (5m) 52s ago 24m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (5m) 0s ago 22m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (9m) 52s ago 23m 73.8M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (93s) 52s ago 16m 11.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (61s) 52s ago 16m 11.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 963e3ca49805 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (32s) 0s ago 16m 12.1M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4b20b67f6dc0 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (5s) 0s ago 16m 11.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 245da4d6a7fb 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (13m) 52s ago 26m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:20:40.076 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (11m) 0s ago 22m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (7m) 52s ago 26m 57.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (7m) 0s ago 22m 42.0M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (11m) 52s ago 24m 7776k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (11m) 0s ago 22m 7922k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (5m) 52s ago 21m 105M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (4m) 52s ago 20m 115M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (4m) 52s ago 20m 99.8M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (3m) 0s ago 19m 129M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (2m) 0s ago 19m 105M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (2m) 0s ago 18m 99.9M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:20:40.077 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (10m) 52s ago 23m 70.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 msgr2=0x7fb8d8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 0x7fb8d8071180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4197b20 tx=0x7fb8dc01a040 comp rx=0 tx=0).stop 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 msgr2=0x7fb8f419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ada0 tx=0x7fb8e400c330 comp rx=0 tx=0).stop 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 shutdown_connections 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4101d60 0x7fb8f419c820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb8d806ecc0 0x7fb8d8071180 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 --2- 172.21.15.55:0/2671031661 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8f4102680 0x7fb8f419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 >> 172.21.15.55:0/2671031661 conn(0x7fb8f4076740 msgr2=0x7fb8f4103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 shutdown_connections 2024-04-26T21:20:40.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.078+0000 7fb8fa200700 1 -- 172.21.15.55:0/2671031661 wait complete. 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 -- 172.21.15.55:0/2140577735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb358100e10 msgr2=0x7fb3581011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 --2- 172.21.15.55:0/2140577735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb358100e10 0x7fb3581011f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009910 tx=0x7fb34c009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 -- 172.21.15.55:0/2140577735 shutdown_connections 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 --2- 172.21.15.55:0/2140577735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3581017c0 0x7fb358105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 --2- 172.21.15.55:0/2140577735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb358100e10 0x7fb3581011f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 -- 172.21.15.55:0/2140577735 >> 172.21.15.55:0/2140577735 conn(0x7fb3580fc6e0 msgr2=0x7fb3580feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 -- 172.21.15.55:0/2140577735 shutdown_connections 2024-04-26T21:20:40.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.243+0000 7fb360800700 1 -- 172.21.15.55:0/2140577735 wait complete. 2024-04-26T21:20:40.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.244+0000 7fb360800700 1 Processor -- start 2024-04-26T21:20:40.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.244+0000 7fb360800700 1 -- start start 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb360800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb358100e10 0x7fb358073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb360800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb360800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580751e0 con 0x7fb3581017c0 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb360800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358073c80 con 0x7fb358100e10 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb35d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb35d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45506/0 (socket says 172.21.15.55:45506) 2024-04-26T21:20:40.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb35d400700 1 -- 172.21.15.55:0/1774961619 learned_addr learned my addr 172.21.15.55:0/1774961619 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.245+0000 7fb35de00700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb358100e10 0x7fb358073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.246+0000 7fb35d400700 1 -- 172.21.15.55:0/1774961619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb358100e10 msgr2=0x7fb358073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.246+0000 7fb35d400700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb358100e10 0x7fb358073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.246+0000 7fb35d400700 1 -- 172.21.15.55:0/1774961619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0095f0 con 0x7fb3581017c0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.246+0000 7fb35d400700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb34800d900 tx=0x7fb34800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.246+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb348009900 con 0x7fb3581017c0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.247+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb348010460 con 0x7fb3581017c0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.247+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34800f5f0 con 0x7fb3581017c0 2024-04-26T21:20:40.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.247+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358073f60 con 0x7fb3581017c0 2024-04-26T21:20:40.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.247+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3581a3000 con 0x7fb3581017c0 2024-04-26T21:20:40.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.248+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3581091b0 con 0x7fb3581017c0 2024-04-26T21:20:40.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.250+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb3480105d0 con 0x7fb3581017c0 2024-04-26T21:20:40.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.250+0000 7fb352a00700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 0x7fb340071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.251+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb34808ecc0 con 0x7fb3581017c0 2024-04-26T21:20:40.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.251+0000 7fb35de00700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 0x7fb340071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.252+0000 7fb35de00700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 0x7fb340071190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00b5c0 tx=0x7fb34c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:40.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.256+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb348094020 con 0x7fb3581017c0 2024-04-26T21:20:40.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.587+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3581022f0 con 0x7fb3581017c0 2024-04-26T21:20:40.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.591+0000 7fb352a00700 1 -- 172.21.15.55:0/1774961619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb348057a00 con 0x7fb3581017c0 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:20:40.593 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:20:40.594 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:20:40.594 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:20:40.594 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:20:40.594 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:20:40.594 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 msgr2=0x7fb340071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 0x7fb340071190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00b5c0 tx=0x7fb34c01a040 comp rx=0 tx=0).stop 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 msgr2=0x7fb358073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb34800d900 tx=0x7fb34800dcc0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 shutdown_connections 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb34006ecd0 0x7fb340071190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb358100e10 0x7fb358073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 --2- 172.21.15.55:0/1774961619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3581017c0 0x7fb358073740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 >> 172.21.15.55:0/1774961619 conn(0x7fb3580fc6e0 msgr2=0x7fb3580fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:40.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 shutdown_connections 2024-04-26T21:20:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.594+0000 7fb360800700 1 -- 172.21.15.55:0/1774961619 wait complete. 2024-04-26T21:20:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.752+0000 7f875e000700 1 -- 172.21.15.55:0/3403394955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758102680 msgr2=0x7f875810ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.752+0000 7f875e000700 1 --2- 172.21.15.55:0/3403394955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758102680 0x7f875810ab70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f874000b0a0 tx=0x7f874000b3b0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:40 smithi055 ceph-mon[109028]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:40.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:40.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:40 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 -- 172.21.15.55:0/3403394955 shutdown_connections 2024-04-26T21:20:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 --2- 172.21.15.55:0/3403394955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758102680 0x7f875810ab70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 --2- 172.21.15.55:0/3403394955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758101d60 0x7f8758102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 -- 172.21.15.55:0/3403394955 >> 172.21.15.55:0/3403394955 conn(0x7f8758076740 msgr2=0x7f87580fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 -- 172.21.15.55:0/3403394955 shutdown_connections 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.753+0000 7f875e000700 1 -- 172.21.15.55:0/3403394955 wait complete. 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.754+0000 7f875e000700 1 Processor -- start 2024-04-26T21:20:40.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.754+0000 7f875e000700 1 -- start start 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f875e000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f875e000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758102680 0x7f87580fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f875e000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758100440 con 0x7f8758101d60 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f875e000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758100580 con 0x7f8758102680 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45534/0 (socket says 172.21.15.55:45534) 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 -- 172.21.15.55:0/3188762040 learned_addr learned my addr 172.21.15.55:0/3188762040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f874ea00700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758102680 0x7f87580fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 -- 172.21.15.55:0/3188762040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758102680 msgr2=0x7f87580fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758102680 0x7f87580fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:40.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.755+0000 7f8757400700 1 -- 172.21.15.55:0/3188762040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009d00 con 0x7f8758101d60 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f8757400700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f874800d8d0 tx=0x7f874800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8748009940 con 0x7f8758101d60 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8748010460 con 0x7f8758101d60 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87581a2ce0 con 0x7f8758101d60 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874800f5f0 con 0x7f8758101d60 2024-04-26T21:20:40.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.756+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87581a3040 con 0x7f8758101d60 2024-04-26T21:20:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.758+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8758068ea0 con 0x7f8758101d60 2024-04-26T21:20:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.759+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f87480105d0 con 0x7f8758101d60 2024-04-26T21:20:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.760+0000 7f8754c00700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 0x7f873c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.760+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f874808eec0 con 0x7f8758101d60 2024-04-26T21:20:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.760+0000 7f874ea00700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 0x7f873c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.761+0000 7f874ea00700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 0x7f873c071180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8740015040 tx=0x7f874000b7b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:40.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:40.765+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8748057c20 con 0x7f8758101d60 2024-04-26T21:20:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:40 smithi064 ceph-mon[84240]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:40.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:40 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:41.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.041+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f875810ddc0 con 0x7f8758101d60 2024-04-26T21:20:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.042+0000 7f8754c00700 1 -- 172.21.15.55:0/3188762040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1934 (secure 0 0 0) 0x7f874805b2e0 con 0x7f8758101d60 2024-04-26T21:20:41.044 INFO:teuthology.orchestra.run.smithi055.stdout:e34 2024-04-26T21:20:41.044 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 34 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:20:41.045 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:20:37.377536+0000 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:20:41.046 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 85 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=34462} 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:20:41.047 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 34462 members: 34462 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:34462} state up:active seq 25 join_fscid=1 addr [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:41.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{-1:34494} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6824/3858142462,v1:172.21.15.64:6825/3858142462] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:41.049 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6826/1442123081,v1:172.21.15.64:6827/1442123081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 msgr2=0x7f873c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 0x7f873c071180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8740015040 tx=0x7f874000b7b0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 msgr2=0x7f87580ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f874800d8d0 tx=0x7f874800dc90 comp rx=0 tx=0).stop 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 shutdown_connections 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8758101d60 0x7f87580ff9c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f873c06ecc0 0x7f873c071180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 --2- 172.21.15.55:0/3188762040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8758102680 0x7f87580fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.047+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 >> 172.21.15.55:0/3188762040 conn(0x7f8758076740 msgr2=0x7f8758103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.048+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 shutdown_connections 2024-04-26T21:20:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.048+0000 7f875e000700 1 -- 172.21.15.55:0/3188762040 wait complete. 2024-04-26T21:20:41.052 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 34 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 -- 172.21.15.55:0/3371074208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073ba0 msgr2=0x7f5310111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 --2- 172.21.15.55:0/3371074208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073ba0 0x7f5310111680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009910 tx=0x7f52fc009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 -- 172.21.15.55:0/3371074208 shutdown_connections 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 --2- 172.21.15.55:0/3371074208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073ba0 0x7f5310111680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 --2- 172.21.15.55:0/3371074208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073280 0x7f5310073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 -- 172.21.15.55:0/3371074208 >> 172.21.15.55:0/3371074208 conn(0x7f53100fc6e0 msgr2=0x7f53100feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 -- 172.21.15.55:0/3371074208 shutdown_connections 2024-04-26T21:20:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.213+0000 7f5314c00700 1 -- 172.21.15.55:0/3371074208 wait complete. 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.214+0000 7f5314c00700 1 Processor -- start 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.214+0000 7f5314c00700 1 -- start start 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f5314c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f5314c00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073ba0 0x7f531019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f5314c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531019dd00 con 0x7f5310073280 2024-04-26T21:20:41.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f5314c00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53101a19d0 con 0x7f5310073ba0 2024-04-26T21:20:41.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f530de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f530de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45554/0 (socket says 172.21.15.55:45554) 2024-04-26T21:20:41.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f530de00700 1 -- 172.21.15.55:0/1075313669 learned_addr learned my addr 172.21.15.55:0/1075313669 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.215+0000 7f530d400700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073ba0 0x7f531019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f530de00700 1 -- 172.21.15.55:0/1075313669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073ba0 msgr2=0x7f531019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f530de00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073ba0 0x7f531019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f530de00700 1 -- 172.21.15.55:0/1075313669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0095f0 con 0x7f5310073280 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f530de00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f530000d8d0 tx=0x7f530000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5300009940 con 0x7f5310073280 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5300010460 con 0x7f5310073280 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53101a1cb0 con 0x7f5310073280 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.216+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530000f5f0 con 0x7f5310073280 2024-04-26T21:20:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.217+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53101a2200 con 0x7f5310073280 2024-04-26T21:20:41.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.218+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53100749c0 con 0x7f5310073280 2024-04-26T21:20:41.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.219+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f53000105d0 con 0x7f5310073280 2024-04-26T21:20:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.220+0000 7f5306a00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 0x7f52f4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.220+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f530008ef70 con 0x7f5310073280 2024-04-26T21:20:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.220+0000 7f530d400700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 0x7f52f4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.221+0000 7f530d400700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 0x7f52f4071190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005b40 tx=0x7f52fc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:41.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.225+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5300057c30 con 0x7f5310073280 2024-04-26T21:20:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.479+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53101143e0 con 0x7f52f406ecd0 2024-04-26T21:20:41.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.481+0000 7f5306a00700 1 -- 172.21.15.55:0/1075313669 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f53101143e0 con 0x7f52f406ecd0 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mon", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mds", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "osd", 2024-04-26T21:20:41.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:20:41.484 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:20:41.484 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "16/23 daemons upgraded", 2024-04-26T21:20:41.484 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading mds daemons", 2024-04-26T21:20:41.484 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:20:41.484 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:20:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 msgr2=0x7f52f4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 0x7f52f4071190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005b40 tx=0x7f52fc01a040 comp rx=0 tx=0).stop 2024-04-26T21:20:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 msgr2=0x7f531019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f530000d8d0 tx=0x7f530000dc90 comp rx=0 tx=0).stop 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 shutdown_connections 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5310073280 0x7f531019d0e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f52f406ecd0 0x7f52f4071190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 --2- 172.21.15.55:0/1075313669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5310073ba0 0x7f531019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 >> 172.21.15.55:0/1075313669 conn(0x7f53100fc6e0 msgr2=0x7f5310100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.484+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 shutdown_connections 2024-04-26T21:20:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.485+0000 7f5314c00700 1 -- 172.21.15.55:0/1075313669 wait complete. 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 -- 172.21.15.55:0/3718510357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16281017c0 msgr2=0x7f1628105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 --2- 172.21.15.55:0/3718510357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16281017c0 0x7f1628105810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1614009910 tx=0x7f1614009c20 comp rx=0 tx=0).stop 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 -- 172.21.15.55:0/3718510357 shutdown_connections 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 --2- 172.21.15.55:0/3718510357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16281017c0 0x7f1628105810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 --2- 172.21.15.55:0/3718510357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1628100e10 0x7f16281011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 -- 172.21.15.55:0/3718510357 >> 172.21.15.55:0/3718510357 conn(0x7f16280fc6e0 msgr2=0x7f16280feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 -- 172.21.15.55:0/3718510357 shutdown_connections 2024-04-26T21:20:41.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.650+0000 7f162ea00700 1 -- 172.21.15.55:0/3718510357 wait complete. 2024-04-26T21:20:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.651+0000 7f162ea00700 1 Processor -- start 2024-04-26T21:20:41.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.651+0000 7f162ea00700 1 -- start start 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f162ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f162ea00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 0x7f1628073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f162ea00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628073c60 con 0x7f1628100e10 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f162ea00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628073da0 con 0x7f16281017c0 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f1627e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f1627e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45570/0 (socket says 172.21.15.55:45570) 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f1627e00700 1 -- 172.21.15.55:0/2308318331 learned_addr learned my addr 172.21.15.55:0/2308318331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:20:41.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.652+0000 7f1627400700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 0x7f1628073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1627e00700 1 -- 172.21.15.55:0/2308318331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 msgr2=0x7f1628073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1627e00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 0x7f1628073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1627e00700 1 -- 172.21.15.55:0/2308318331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140095f0 con 0x7f1628100e10 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1627400700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 0x7f1628073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1627e00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f161800d8d0 tx=0x7f161800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1618009940 con 0x7f1628100e10 2024-04-26T21:20:41.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1618010460 con 0x7f1628100e10 2024-04-26T21:20:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f161800f5f0 con 0x7f1628100e10 2024-04-26T21:20:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.653+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16281a2d30 con 0x7f1628100e10 2024-04-26T21:20:41.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.654+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16281a3090 con 0x7f1628100e10 2024-04-26T21:20:41.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.655+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628109210 con 0x7f1628100e10 2024-04-26T21:20:41.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.657+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f16180105d0 con 0x7f1628100e10 2024-04-26T21:20:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.658+0000 7f1624c00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 0x7f160c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:20:41.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.658+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f161808eed0 con 0x7f1628100e10 2024-04-26T21:20:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.658+0000 7f1627400700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 0x7f160c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:20:41.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.659+0000 7f1627400700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 0x7f160c071190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16280748c0 tx=0x7f161401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:20:41.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.666+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f1618057c30 con 0x7f1628100e10 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:41 smithi055 ceph-mon[109028]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:41 smithi055 ceph-mon[109028]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:41 smithi055 ceph-mon[109028]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:41 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1774961619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:41 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3188762040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:20:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:41 smithi064 ceph-mon[84240]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:41 smithi064 ceph-mon[84240]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:41 smithi064 ceph-mon[84240]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:41 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1774961619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:41.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:41 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3188762040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:20:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.995+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16281022f0 con 0x7f1628100e10 2024-04-26T21:20:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.996+0000 7f1624c00700 1 -- 172.21.15.55:0/2308318331 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f161805b2f0 con 0x7f1628100e10 2024-04-26T21:20:41.997 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:20:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.998+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 msgr2=0x7f160c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.998+0000 7f162ea00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 0x7f160c071190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16280748c0 tx=0x7f161401a040 comp rx=0 tx=0).stop 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.998+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 msgr2=0x7f16280731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.998+0000 7f162ea00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f161800d8d0 tx=0x7f161800dc90 comp rx=0 tx=0).stop 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 shutdown_connections 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1628100e10 0x7f16280731e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f160c06ecd0 0x7f160c071190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 --2- 172.21.15.55:0/2308318331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f16281017c0 0x7f1628073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 >> 172.21.15.55:0/2308318331 conn(0x7f16280fc6e0 msgr2=0x7f16280fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 shutdown_connections 2024-04-26T21:20:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:20:41.999+0000 7f162ea00700 1 -- 172.21.15.55:0/2308318331 wait complete. 2024-04-26T21:20:42.888 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:42.888 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:42.888 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:42.888 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:42.888 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:42.889 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:20:42.889 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:42 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2308318331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:20:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:20:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-26T21:20:43.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:42 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2308318331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:20:45.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:44 smithi064 ceph-mon[84240]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-26T21:20:45.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:44 smithi055 ceph-mon[109028]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-04-26T21:20:47.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:46 smithi055 ceph-mon[109028]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:47.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:46 smithi064 ceph-mon[84240]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:49.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:49.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all mds 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.coveew"}]': finished 2024-04-26T21:20:49.158 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.nwfjlb"}]': finished 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.ukvnjs"}]': finished 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.xrdyeb"}]': finished 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: Upgrade: Setting filesystem cephfs Joinable 2024-04-26T21:20:49.159 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:48 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.256 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all mds 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.coveew"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.coveew"}]': finished 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.nwfjlb"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi055.nwfjlb"}]': finished 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.ukvnjs"}]: dispatch 2024-04-26T21:20:49.257 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.ukvnjs"}]': finished 2024-04-26T21:20:49.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.xrdyeb"}]: dispatch 2024-04-26T21:20:49.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi064.xrdyeb"}]': finished 2024-04-26T21:20:49.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: Upgrade: Setting filesystem cephfs Joinable 2024-04-26T21:20:49.258 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:48 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-26T21:20:50.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-26T21:20:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:50 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:50 smithi064 ceph-mon[84240]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-26T21:20:50.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:50 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-26T21:20:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-26T21:20:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:50 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:50 smithi055 ceph-mon[109028]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-26T21:20:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:50 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-26T21:20:51.631 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:51.631 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-26T21:20:51.631 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all rgw 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.632 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:51 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 3 up:standby 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all rgw 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all rbd-mirror 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:51.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:51 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:20:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:53 smithi064 ceph-mon[84240]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:20:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:20:53.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:53 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:53 smithi055 ceph-mon[109028]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:20:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:20:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi055", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:20:53.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:53 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:54.666 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:54 smithi055 ceph-mon[109028]: Upgrade: Updating ceph-exporter.smithi055 (1/2) 2024-04-26T21:20:54.666 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:54 smithi055 ceph-mon[109028]: Deploying daemon ceph-exporter.smithi055 on smithi055 2024-04-26T21:20:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:54 smithi064 ceph-mon[84240]: Upgrade: Updating ceph-exporter.smithi055 (1/2) 2024-04-26T21:20:54.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:54 smithi064 ceph-mon[84240]: Deploying daemon ceph-exporter.smithi055 on smithi055 2024-04-26T21:20:55.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:55 smithi055 ceph-mon[109028]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:20:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:55 smithi064 ceph-mon[84240]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-26T21:20:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:57 smithi055 ceph-mon[109028]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 2 op/s 2024-04-26T21:20:57.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:57 smithi064 ceph-mon[84240]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 2 op/s 2024-04-26T21:20:57.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:20:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:20:59 smithi064 ceph-mon[84240]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:20:59.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:20:59 smithi055 ceph-mon[109028]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:21:00.737 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:00 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:00.738 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:00 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:00 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:00.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:00 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:01.760 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:01 smithi064 ceph-mon[84240]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-26T21:21:02.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:01 smithi055 ceph-mon[109028]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: Upgrade: Updating ceph-exporter.smithi064 (2/2) 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:03.104 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:02 smithi064 ceph-mon[84240]: Deploying daemon ceph-exporter.smithi064 on smithi064 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: Upgrade: Updating ceph-exporter.smithi064 (2/2) 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi064", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:02 smithi055 ceph-mon[109028]: Deploying daemon ceph-exporter.smithi064 on smithi064 2024-04-26T21:21:05.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:04 smithi055 ceph-mon[109028]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:21:05.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:04 smithi064 ceph-mon[84240]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-26T21:21:07.067 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:06 smithi064 ceph-mon[84240]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-04-26T21:21:07.181 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:06 smithi055 ceph-mon[109028]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-04-26T21:21:08.887 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:08.888 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:08.888 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:08 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:08.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:08 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:09.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:09 smithi064 ceph-mon[84240]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 2 op/s 2024-04-26T21:21:10.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:09 smithi055 ceph-mon[109028]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 2 op/s 2024-04-26T21:21:10.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:10 smithi055 ceph-mon[109028]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 2 op/s 2024-04-26T21:21:10.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:10 smithi064 ceph-mon[84240]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 2 op/s 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 -- 172.21.15.55:0/1600260951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde81017c0 msgr2=0x7fcde8105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 --2- 172.21.15.55:0/1600260951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde81017c0 0x7fcde8105810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009910 tx=0x7fcdd4009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 -- 172.21.15.55:0/1600260951 shutdown_connections 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 --2- 172.21.15.55:0/1600260951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde81017c0 0x7fcde8105810 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 --2- 172.21.15.55:0/1600260951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde8100e10 0x7fcde81011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 -- 172.21.15.55:0/1600260951 >> 172.21.15.55:0/1600260951 conn(0x7fcde80fc6e0 msgr2=0x7fcde80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 -- 172.21.15.55:0/1600260951 shutdown_connections 2024-04-26T21:21:12.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.175+0000 7fcdef800700 1 -- 172.21.15.55:0/1600260951 wait complete. 2024-04-26T21:21:12.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.176+0000 7fcdef800700 1 Processor -- start 2024-04-26T21:21:12.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.176+0000 7fcdef800700 1 -- start start 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdef800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdef800700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde81017c0 0x7fcde819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdef800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819f5a0 con 0x7fcde8100e10 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdef800700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8198b80 con 0x7fcde81017c0 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdece00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdece00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36216/0 (socket says 172.21.15.55:36216) 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcdece00700 1 -- 172.21.15.55:0/1976612795 learned_addr learned my addr 172.21.15.55:0/1976612795 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:12.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.177+0000 7fcde7e00700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde81017c0 0x7fcde819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.178+0000 7fcdece00700 1 -- 172.21.15.55:0/1976612795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde81017c0 msgr2=0x7fcde819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.178+0000 7fcdece00700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde81017c0 0x7fcde819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.178+0000 7fcdece00700 1 -- 172.21.15.55:0/1976612795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40095f0 con 0x7fcde8100e10 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.178+0000 7fcdece00700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0060b0 tx=0x7fcddc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.179+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcddc00dda0 con 0x7fcde8100e10 2024-04-26T21:21:12.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.179+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde8198e60 con 0x7fcde8100e10 2024-04-26T21:21:12.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.179+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcddc00f040 con 0x7fcde8100e10 2024-04-26T21:21:12.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.179+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcddc0146f0 con 0x7fcde8100e10 2024-04-26T21:21:12.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.179+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde81993b0 con 0x7fcde8100e10 2024-04-26T21:21:12.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.180+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde8104f90 con 0x7fcde8100e10 2024-04-26T21:21:12.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.181+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcddc015400 con 0x7fcde8100e10 2024-04-26T21:21:12.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.182+0000 7fcde5600700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 0x7fcdd0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.182+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcddc08e910 con 0x7fcde8100e10 2024-04-26T21:21:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.182+0000 7fcde7e00700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 0x7fcdd0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.183+0000 7fcde7e00700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 0x7fcdd0071180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcde819a220 tx=0x7fcdd401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.188+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fcddc05b1b0 con 0x7fcde8100e10 2024-04-26T21:21:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.490+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde810ddb0 con 0x7fcdd006ecc0 2024-04-26T21:21:12.492 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:12.492 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:12.492 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.492+0000 7fcde5600700 1 -- 172.21.15.55:0/1976612795 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fcde810ddb0 con 0x7fcdd006ecc0 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 msgr2=0x7fcdd0071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 0x7fcdd0071180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcde819a220 tx=0x7fcdd401a040 comp rx=0 tx=0).stop 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 msgr2=0x7fcde819ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0060b0 tx=0x7fcddc00d3b0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 shutdown_connections 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde8100e10 0x7fcde819ea40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcdd006ecc0 0x7fcdd0071180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 --2- 172.21.15.55:0/1976612795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcde81017c0 0x7fcde819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.495+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 >> 172.21.15.55:0/1976612795 conn(0x7fcde80fc6e0 msgr2=0x7fcde80fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.496+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 shutdown_connections 2024-04-26T21:21:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.496+0000 7fcdef800700 1 -- 172.21.15.55:0/1976612795 wait complete. 2024-04-26T21:21:12.513 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:21:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:12.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 -- 172.21.15.55:0/671282726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc103810 msgr2=0x7fadfc107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 --2- 172.21.15.55:0/671282726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc103810 0x7fadfc107860 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fade4009910 tx=0x7fade4009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 -- 172.21.15.55:0/671282726 shutdown_connections 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 --2- 172.21.15.55:0/671282726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc103810 0x7fadfc107860 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 --2- 172.21.15.55:0/671282726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc102e60 0x7fadfc103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 -- 172.21.15.55:0/671282726 >> 172.21.15.55:0/671282726 conn(0x7fadfc0fe710 msgr2=0x7fadfc100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 -- 172.21.15.55:0/671282726 shutdown_connections 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.662+0000 7fadfbe00700 1 -- 172.21.15.55:0/671282726 wait complete. 2024-04-26T21:21:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.663+0000 7fadfbe00700 1 Processor -- start 2024-04-26T21:21:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.663+0000 7fadfbe00700 1 -- start start 2024-04-26T21:21:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfbe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc103810 0x7fadfc19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfbe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19f380 con 0x7fadfc102e60 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfbe00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc198960 con 0x7fadfc103810 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36234/0 (socket says 172.21.15.55:36234) 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfaa00700 1 -- 172.21.15.55:0/3243591107 learned_addr learned my addr 172.21.15.55:0/3243591107 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:12.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.664+0000 7fadfa000700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc103810 0x7fadfc19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.665+0000 7fadfaa00700 1 -- 172.21.15.55:0/3243591107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc103810 msgr2=0x7fadfc19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.665+0000 7fadfaa00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc103810 0x7fadfc19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.665+0000 7fadfaa00700 1 -- 172.21.15.55:0/3243591107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40095f0 con 0x7fadfc102e60 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.665+0000 7fadfaa00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d8d0 tx=0x7fadec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.665+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec0098a0 con 0x7fadfc102e60 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.666+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadec010460 con 0x7fadfc102e60 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.666+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec00f5f0 con 0x7fadfc102e60 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.666+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc198c40 con 0x7fadfc102e60 2024-04-26T21:21:12.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.666+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc199160 con 0x7fadfc102e60 2024-04-26T21:21:12.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.667+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc10b260 con 0x7fadfc102e60 2024-04-26T21:21:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.668+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fadec009a00 con 0x7fadfc102e60 2024-04-26T21:21:12.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.669+0000 7fadf3400700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 0x7fade0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:12.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.669+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fadec08ec80 con 0x7fadfc102e60 2024-04-26T21:21:12.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.670+0000 7fadfa000700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 0x7fade0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:12.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.670+0000 7fadfa000700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 0x7fade0071190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fade4009fd0 tx=0x7fade401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:12.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.674+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fadec05b590 con 0x7fadfc102e60 2024-04-26T21:21:12.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.951+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadfc199e90 con 0x7fade006ecd0 2024-04-26T21:21:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.954+0000 7fadf3400700 1 -- 172.21.15.55:0/3243591107 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fadfc199e90 con 0x7fade006ecd0 2024-04-26T21:21:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 msgr2=0x7fade0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 0x7fade0071190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fade4009fd0 tx=0x7fade401a040 comp rx=0 tx=0).stop 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 msgr2=0x7fadfc19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d8d0 tx=0x7fadec00dbe0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 shutdown_connections 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadfc102e60 0x7fadfc19e820 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fade006ecd0 0x7fade0071190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 --2- 172.21.15.55:0/3243591107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadfc103810 0x7fadfc19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 >> 172.21.15.55:0/3243591107 conn(0x7fadfc0fe710 msgr2=0x7fadfc0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 shutdown_connections 2024-04-26T21:21:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:12.957+0000 7fadfbe00700 1 -- 172.21.15.55:0/3243591107 wait complete. 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 -- 172.21.15.55:0/3417646141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc140ff8f0 msgr2=0x7fdc140ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 --2- 172.21.15.55:0/3417646141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc140ff8f0 0x7fdc140ffcd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009910 tx=0x7fdc04009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 -- 172.21.15.55:0/3417646141 shutdown_connections 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 --2- 172.21.15.55:0/3417646141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc141002a0 0x7fdc1410cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 --2- 172.21.15.55:0/3417646141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc140ff8f0 0x7fdc140ffcd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 -- 172.21.15.55:0/3417646141 >> 172.21.15.55:0/3417646141 conn(0x7fdc14076740 msgr2=0x7fdc140fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:13.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 -- 172.21.15.55:0/3417646141 shutdown_connections 2024-04-26T21:21:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.119+0000 7fdc1a400700 1 -- 172.21.15.55:0/3417646141 wait complete. 2024-04-26T21:21:13.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.120+0000 7fdc1a400700 1 Processor -- start 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc1a400700 1 -- start start 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc1a400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc140ff8f0 0x7fdc1419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc1a400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc1a400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1419f520 con 0x7fdc141002a0 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc1a400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14198b00 con 0x7fdc140ff8f0 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc0aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc0aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36252/0 (socket says 172.21.15.55:36252) 2024-04-26T21:21:13.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.121+0000 7fdc0aa00700 1 -- 172.21.15.55:0/4215217787 learned_addr learned my addr 172.21.15.55:0/4215217787 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.122+0000 7fdc13400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc140ff8f0 0x7fdc1419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.122+0000 7fdc0aa00700 1 -- 172.21.15.55:0/4215217787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc140ff8f0 msgr2=0x7fdc1419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.122+0000 7fdc0aa00700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc140ff8f0 0x7fdc1419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.122+0000 7fdc0aa00700 1 -- 172.21.15.55:0/4215217787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040095f0 con 0x7fdc141002a0 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.122+0000 7fdc0aa00700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00d8d0 tx=0x7fdbfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.123+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc009940 con 0x7fdc141002a0 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.123+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbfc010460 con 0x7fdc141002a0 2024-04-26T21:21:13.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.123+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc14198de0 con 0x7fdc141002a0 2024-04-26T21:21:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.123+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc00f5f0 con 0x7fdc141002a0 2024-04-26T21:21:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.123+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14199330 con 0x7fdc141002a0 2024-04-26T21:21:13.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.124+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc14107870 con 0x7fdc141002a0 2024-04-26T21:21:13.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.125+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdbfc0105d0 con 0x7fdc141002a0 2024-04-26T21:21:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.127+0000 7fdc10c00700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 0x7fdbf8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.127+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdbfc08ee60 con 0x7fdc141002a0 2024-04-26T21:21:13.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.127+0000 7fdc13400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 0x7fdbf8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.128+0000 7fdc13400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 0x7fdbf8071190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005b40 tx=0x7fdc04005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:13.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.132+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdbfc05b6d0 con 0x7fdc141002a0 2024-04-26T21:21:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.410+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc1410ff60 con 0x7fdbf806ecd0 2024-04-26T21:21:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.441+0000 7fdc10c00700 1 -- 172.21.15.55:0/4215217787 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fdc1410ff60 con 0x7fdbf806ecd0 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (10m) 86s ago 24m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 starting - - - - 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (6s) 2s ago 23m 7004k - 19.0.0-3306-gbc612ffb 55dc54019ad8 e6da83d3feb9 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (6m) 86s ago 24m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:21:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (6m) 2s ago 23m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (9m) 86s ago 24m 73.8M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (2m) 86s ago 17m 11.9M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (94s) 86s ago 17m 11.5M - 19.0.0-3306-gbc612ffb 55dc54019ad8 963e3ca49805 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (66s) 2s ago 17m 12.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4b20b67f6dc0 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (38s) 2s ago 16m 12.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 245da4d6a7fb 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (13m) 86s ago 26m 510M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (12m) 2s ago 23m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (8m) 86s ago 26m 57.2M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (7m) 2s ago 23m 42.6M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (11m) 86s ago 24m 7776k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (11m) 2s ago 23m 8024k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (5m) 86s ago 22m 105M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (5m) 86s ago 21m 115M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:21:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (4m) 86s ago 20m 99.8M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (4m) 2s ago 20m 132M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (3m) 2s ago 19m 106M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (2m) 2s ago 19m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (10m) 86s ago 24m 70.1M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 msgr2=0x7fdbf8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 0x7fdbf8071190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc04005b40 tx=0x7fdc04005a90 comp rx=0 tx=0).stop 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 msgr2=0x7fdc1419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00d8d0 tx=0x7fdbfc00dc90 comp rx=0 tx=0).stop 2024-04-26T21:21:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 shutdown_connections 2024-04-26T21:21:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdbf806ecd0 0x7fdbf8071190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc140ff8f0 0x7fdc1419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 --2- 172.21.15.55:0/4215217787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc141002a0 0x7fdc1419ef00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 >> 172.21.15.55:0/4215217787 conn(0x7fdc14076740 msgr2=0x7fdc140fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:13.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 shutdown_connections 2024-04-26T21:21:13.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.445+0000 7fdc1a400700 1 -- 172.21.15.55:0/4215217787 wait complete. 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 -- 172.21.15.55:0/2552298961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28101d60 msgr2=0x7f4f28102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 --2- 172.21.15.55:0/2552298961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28101d60 0x7f4f28102140 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009910 tx=0x7f4f1c009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 -- 172.21.15.55:0/2552298961 shutdown_connections 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 --2- 172.21.15.55:0/2552298961 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28102680 0x7f4f2810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 --2- 172.21.15.55:0/2552298961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28101d60 0x7f4f28102140 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 -- 172.21.15.55:0/2552298961 >> 172.21.15.55:0/2552298961 conn(0x7f4f28076740 msgr2=0x7f4f280fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 -- 172.21.15.55:0/2552298961 shutdown_connections 2024-04-26T21:21:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.614+0000 7f4f2f600700 1 -- 172.21.15.55:0/2552298961 wait complete. 2024-04-26T21:21:13.617 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:13 smithi055 ceph-mon[109028]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 1 op/s 2024-04-26T21:21:13.617 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:13 smithi055 ceph-mon[109028]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.615+0000 7f4f2f600700 1 Processor -- start 2024-04-26T21:21:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.616+0000 7f4f2f600700 1 -- start start 2024-04-26T21:21:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.616+0000 7f4f2f600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.616+0000 7f4f2f600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28102680 0x7f4f2819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.616+0000 7f4f2f600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28198b60 con 0x7f4f28102680 2024-04-26T21:21:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.616+0000 7f4f2f600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28198cd0 con 0x7f4f28101d60 2024-04-26T21:21:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f27e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28102680 0x7f4f2819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:35234/0 (socket says 172.21.15.55:35234) 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 -- 172.21.15.55:0/1068668565 learned_addr learned my addr 172.21.15.55:0/1068668565 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 -- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28102680 msgr2=0x7f4f2819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28102680 0x7f4f2819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.617+0000 7f4f2cc00700 1 -- 172.21.15.55:0/1068668565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c0095f0 con 0x7f4f28101d60 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f2cc00700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005f50 tx=0x7f4f1c00b5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c01d070 con 0x7f4f28101d60 2024-04-26T21:21:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f1c0052a0 con 0x7f4f28101d60 2024-04-26T21:21:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f28198f50 con 0x7f4f28101d60 2024-04-26T21:21:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c017400 con 0x7f4f28101d60 2024-04-26T21:21:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.618+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f28199440 con 0x7f4f28101d60 2024-04-26T21:21:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.620+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f28068ea0 con 0x7f4f28101d60 2024-04-26T21:21:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.621+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4f1c00f6f0 con 0x7f4f28101d60 2024-04-26T21:21:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.622+0000 7f4f25600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 0x7f4f10071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.622+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4f1c090250 con 0x7f4f28101d60 2024-04-26T21:21:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.623+0000 7f4f27e00700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 0x7f4f10071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.623+0000 7f4f27e00700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 0x7f4f10071190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f2819a2d0 tx=0x7f4f14009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.631+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4f1c058f90 con 0x7f4f28101d60 2024-04-26T21:21:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:13 smithi064 ceph-mon[84240]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 1 op/s 2024-04-26T21:21:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:13 smithi064 ceph-mon[84240]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:13.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.975+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f2810dde0 con 0x7f4f28101d60 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.976+0000 7f4f25600700 1 -- 172.21.15.55:0/1068668565 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4f1c05c650 con 0x7f4f28101d60 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:21:13.977 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:21:13.978 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:21:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 msgr2=0x7f4f10071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 0x7f4f10071190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f2819a2d0 tx=0x7f4f14009260 comp rx=0 tx=0).stop 2024-04-26T21:21:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 msgr2=0x7f4f2819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005f50 tx=0x7f4f1c00b5a0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 shutdown_connections 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4f1006ecd0 0x7f4f10071190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f28101d60 0x7f4f2819eab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 --2- 172.21.15.55:0/1068668565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f28102680 0x7f4f2819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.979+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 >> 172.21.15.55:0/1068668565 conn(0x7f4f28076740 msgr2=0x7f4f2810a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.980+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 shutdown_connections 2024-04-26T21:21:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:13.980+0000 7f4f2f600700 1 -- 172.21.15.55:0/1068668565 wait complete. 2024-04-26T21:21:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.167+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1444182154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec102680 msgr2=0x7f3cec10ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.167+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1444182154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec102680 0x7f3cec10ab70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009910 tx=0x7f3cd8009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1444182154 shutdown_connections 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1444182154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec102680 0x7f3cec10ab70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1444182154 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec101d60 0x7f3cec102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1444182154 >> 172.21.15.55:0/1444182154 conn(0x7f3cec076740 msgr2=0x7f3cec0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1444182154 shutdown_connections 2024-04-26T21:21:14.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.168+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1444182154 wait complete. 2024-04-26T21:21:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.169+0000 7f3cf3e00700 1 Processor -- start 2024-04-26T21:21:14.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.170+0000 7f3cf3e00700 1 -- start start 2024-04-26T21:21:14.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.170+0000 7f3cf3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.170+0000 7f3cf3e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 0x7f3cec1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.170+0000 7f3cf3e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1999c0 con 0x7f3cec101d60 2024-04-26T21:21:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.170+0000 7f3cf3e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec19d690 con 0x7f3cec102680 2024-04-26T21:21:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36294/0 (socket says 172.21.15.55:36294) 2024-04-26T21:21:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 -- 172.21.15.55:0/1387481285 learned_addr learned my addr 172.21.15.55:0/1387481285 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:14.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf0a00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 0x7f3cec1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 -- 172.21.15.55:0/1387481285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 msgr2=0x7f3cec1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 0x7f3cec1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf1400700 1 -- 172.21.15.55:0/1387481285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80095f0 con 0x7f3cec101d60 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.171+0000 7f3cf0a00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 0x7f3cec1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cf1400700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000d8d0 tx=0x7f3ce000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce0009940 con 0x7f3cec101d60 2024-04-26T21:21:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ce0010460 con 0x7f3cec101d60 2024-04-26T21:21:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec19d970 con 0x7f3cec101d60 2024-04-26T21:21:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec19dec0 con 0x7f3cec101d60 2024-04-26T21:21:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.172+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce000f5f0 con 0x7f3cec101d60 2024-04-26T21:21:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.174+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc0052f0 con 0x7f3cec101d60 2024-04-26T21:21:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.175+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3ce0009aa0 con 0x7f3cec101d60 2024-04-26T21:21:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.176+0000 7f3cea000700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 0x7f3cd4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.176+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3ce008ed60 con 0x7f3cec101d60 2024-04-26T21:21:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.176+0000 7f3cf0a00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 0x7f3cd4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.177+0000 7f3cf0a00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 0x7f3cd4071190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cec19a300 tx=0x7f3cd801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.181+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3ce0057b40 con 0x7f3cec101d60 2024-04-26T21:21:14.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.478+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ccc005db0 con 0x7f3cec101d60 2024-04-26T21:21:14.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.479+0000 7f3cea000700 1 -- 172.21.15.55:0/1387481285 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1961 (secure 0 0 0) 0x7f3ce00167c0 con 0x7f3cec101d60 2024-04-26T21:21:14.481 INFO:teuthology.orchestra.run.smithi055.stdout:e37 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 37 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:20:50.399767+0000 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:21:14.482 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 85 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=34462} 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:21:14.483 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 34462 members: 34462 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:34462} state up:active seq 25 join_fscid=1 addr [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{0:34494} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6824/3858142462,v1:172.21.15.64:6825/3858142462] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:21:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6826/1442123081,v1:172.21.15.64:6827/1442123081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.482+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 msgr2=0x7f3cd4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.482+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 0x7f3cd4071190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cec19a300 tx=0x7f3cd801a040 comp rx=0 tx=0).stop 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.482+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 msgr2=0x7f3cec198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.482+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000d8d0 tx=0x7f3ce000dc90 comp rx=0 tx=0).stop 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 shutdown_connections 2024-04-26T21:21:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cec101d60 0x7f3cec198da0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3cd406ecd0 0x7f3cd4071190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 --2- 172.21.15.55:0/1387481285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cec102680 0x7f3cec1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 >> 172.21.15.55:0/1387481285 conn(0x7f3cec076740 msgr2=0x7f3cec10a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 shutdown_connections 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.483+0000 7f3cf3e00700 1 -- 172.21.15.55:0/1387481285 wait complete. 2024-04-26T21:21:14.486 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 37 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1068668565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.637 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:14 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 -- 172.21.15.55:0/1852323582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58105970 msgr2=0x7f2e580685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 --2- 172.21.15.55:0/1852323582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58105970 0x7f2e580685c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009910 tx=0x7f2e48009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:14.656 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.656 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.656 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.657 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:14.657 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1068668565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:14.657 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.657 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:14 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 -- 172.21.15.55:0/1852323582 shutdown_connections 2024-04-26T21:21:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 --2- 172.21.15.55:0/1852323582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58068b00 0x7f2e58068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 --2- 172.21.15.55:0/1852323582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58105970 0x7f2e580685c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.654+0000 7f2e57e00700 1 -- 172.21.15.55:0/1852323582 >> 172.21.15.55:0/1852323582 conn(0x7f2e58075460 msgr2=0x7f2e58075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.655+0000 7f2e57e00700 1 -- 172.21.15.55:0/1852323582 shutdown_connections 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.655+0000 7f2e57e00700 1 -- 172.21.15.55:0/1852323582 wait complete. 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.656+0000 7f2e57e00700 1 Processor -- start 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.656+0000 7f2e57e00700 1 -- start start 2024-04-26T21:21:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e57e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e57e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58105970 0x7f2e5819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e57e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5819daf0 con 0x7f2e58068b00 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e57e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581a1770 con 0x7f2e58105970 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e56a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e56a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36300/0 (socket says 172.21.15.55:36300) 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.657+0000 7f2e56a00700 1 -- 172.21.15.55:0/3732250401 learned_addr learned my addr 172.21.15.55:0/3732250401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.658+0000 7f2e56000700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58105970 0x7f2e5819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.658+0000 7f2e56a00700 1 -- 172.21.15.55:0/3732250401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58105970 msgr2=0x7f2e5819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.658+0000 7f2e56a00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58105970 0x7f2e5819d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.658+0000 7f2e56a00700 1 -- 172.21.15.55:0/3732250401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480095f0 con 0x7f2e58068b00 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e56a00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e48005b40 tx=0x7f2e4800b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4801d070 con 0x7f2e58068b00 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e581a19f0 con 0x7f2e58068b00 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e480052a0 con 0x7f2e58068b00 2024-04-26T21:21:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e48003e70 con 0x7f2e58068b00 2024-04-26T21:21:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.659+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e581a1f60 con 0x7f2e58068b00 2024-04-26T21:21:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.661+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58110050 con 0x7f2e58068b00 2024-04-26T21:21:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.662+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2e4800f6f0 con 0x7f2e58068b00 2024-04-26T21:21:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.664+0000 7f2e4f400700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 0x7f2e3c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.664+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2e48090180 con 0x7f2e58068b00 2024-04-26T21:21:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.664+0000 7f2e56000700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 0x7f2e3c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.665+0000 7f2e56000700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 0x7f2e3c071190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2e5819e3e0 tx=0x7f2e44009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:14.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.673+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2e48058ec0 con 0x7f2e58068b00 2024-04-26T21:21:14.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.963+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e581141e0 con 0x7f2e3c06ecd0 2024-04-26T21:21:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.967+0000 7f2e4f400700 1 -- 172.21.15.55:0/3732250401 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f2e581141e0 con 0x7f2e3c06ecd0 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": true, 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [ 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph-exporter", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "mon", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "mds", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "osd", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr" 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": "18/23 daemons upgraded", 2024-04-26T21:21:14.969 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-04-26T21:21:14.970 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:21:14.970 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:21:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 msgr2=0x7f2e3c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 0x7f2e3c071190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2e5819e3e0 tx=0x7f2e44009260 comp rx=0 tx=0).stop 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 msgr2=0x7f2e5819ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e48005b40 tx=0x7f2e4800b5a0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 shutdown_connections 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e58068b00 0x7f2e5819ced0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2e3c06ecd0 0x7f2e3c071190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 --2- 172.21.15.55:0/3732250401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e58105970 0x7f2e5819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 >> 172.21.15.55:0/3732250401 conn(0x7f2e58075460 msgr2=0x7f2e58101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.970+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 shutdown_connections 2024-04-26T21:21:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:14.971+0000 7f2e57e00700 1 -- 172.21.15.55:0/3732250401 wait complete. 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 -- 172.21.15.55:0/3170944176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c0ffaa0 msgr2=0x7f407c0fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 --2- 172.21.15.55:0/3170944176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c0ffaa0 0x7f407c0fff20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4068009910 tx=0x7f4068009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 -- 172.21.15.55:0/3170944176 shutdown_connections 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 --2- 172.21.15.55:0/3170944176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c0ffaa0 0x7f407c0fff20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 --2- 172.21.15.55:0/3170944176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c105aa0 0x7f407c105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 -- 172.21.15.55:0/3170944176 >> 172.21.15.55:0/3170944176 conn(0x7f407c076740 msgr2=0x7f407c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 -- 172.21.15.55:0/3170944176 shutdown_connections 2024-04-26T21:21:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.133+0000 7f4082a00700 1 -- 172.21.15.55:0/3170944176 wait complete. 2024-04-26T21:21:15.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.134+0000 7f4082a00700 1 Processor -- start 2024-04-26T21:21:15.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.135+0000 7f4082a00700 1 -- start start 2024-04-26T21:21:15.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.135+0000 7f4082a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 0x7f407c19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:15.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.135+0000 7f4082a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:15.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.135+0000 7f4082a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c19f530 con 0x7f407c105aa0 2024-04-26T21:21:15.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.135+0000 7f4082a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c198b10 con 0x7f407c0ffaa0 2024-04-26T21:21:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42022/0 (socket says 172.21.15.55:42022) 2024-04-26T21:21:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 -- 172.21.15.55:0/3225795707 learned_addr learned my addr 172.21.15.55:0/3225795707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407be00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 0x7f407c19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 -- 172.21.15.55:0/3225795707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 msgr2=0x7f407c19e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 0x7f407c19e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407b400700 1 -- 172.21.15.55:0/3225795707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680095f0 con 0x7f407c105aa0 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.136+0000 7f407be00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 0x7f407c19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:21:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f407b400700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4068006010 tx=0x7f406800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:15.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406801d070 con 0x7f407c105aa0 2024-04-26T21:21:15.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f406800f460 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4068017630 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c198d90 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.137+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c1991e0 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.138+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c1080c0 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.140+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f406800f5d0 con 0x7f407c105aa0 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.142+0000 7f4078c00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 0x7f4060071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.142+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f40680903f0 con 0x7f407c105aa0 2024-04-26T21:21:15.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.143+0000 7f407be00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 0x7f4060071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:15.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.143+0000 7f407be00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 0x7f4060071180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f406c005950 tx=0x7f406c005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:15.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.147+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f406805cd20 con 0x7f407c105aa0 2024-04-26T21:21:15.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.480+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f407c1011e0 con 0x7f407c105aa0 2024-04-26T21:21:15.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.481+0000 7f4078c00700 1 -- 172.21.15.55:0/3225795707 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f406805c8b0 con 0x7f407c105aa0 2024-04-26T21:21:15.483 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:21:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 msgr2=0x7f4060071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 0x7f4060071180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f406c005950 tx=0x7f406c005f50 comp rx=0 tx=0).stop 2024-04-26T21:21:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 msgr2=0x7f407c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4068006010 tx=0x7f406800be20 comp rx=0 tx=0).stop 2024-04-26T21:21:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 shutdown_connections 2024-04-26T21:21:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f406006ecc0 0x7f4060071180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f407c0ffaa0 0x7f407c19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 --2- 172.21.15.55:0/3225795707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f407c105aa0 0x7f407c19ef10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.484+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 >> 172.21.15.55:0/3225795707 conn(0x7f407c076740 msgr2=0x7f407c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.485+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 shutdown_connections 2024-04-26T21:21:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:15.485+0000 7f4082a00700 1 -- 172.21.15.55:0/3225795707 wait complete. 2024-04-26T21:21:15.564 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:15 smithi064 ceph-mon[84240]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:15.564 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:15 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1387481285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:15.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:15 smithi055 ceph-mon[109028]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:15.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:15 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1387481285' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:21:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:16 smithi064 ceph-mon[84240]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:16.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:16 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3225795707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:21:16.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:16.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:16 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:16 smithi055 ceph-mon[109028]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:16 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3225795707' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:21:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:16.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:16 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:17.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:17 smithi055 ceph-mon[109028]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:17.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:17 smithi064 ceph-mon[84240]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:19.491 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:19 smithi055 ceph-mon[109028]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:19.491 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:19 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:19.492 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:19 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:19.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:19 smithi064 ceph-mon[84240]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:19.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:19 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:19.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:19 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:21.738 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:21 smithi055 ceph-mon[109028]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:21.758 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:21 smithi064 ceph-mon[84240]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:23.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:23.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:23 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:23.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:23.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:23.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:23 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:24 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:24 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:24 smithi055 ceph-mon[109028]: Upgrade: Setting filesystem cephfs Joinable 2024-04-26T21:21:24.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:24 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-26T21:21:24.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:24 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:24 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:24 smithi064 ceph-mon[84240]: Upgrade: Setting filesystem cephfs Joinable 2024-04-26T21:21:24.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:24 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-26T21:21:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-26T21:21:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:21:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all ceph-exporter 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi055"}]: dispatch 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi055"}]': finished 2024-04-26T21:21:25.757 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi064"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi064"}]': finished 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all nfs 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.758 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.759 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.759 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.759 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: Upgrade: Finalizing container_image settings 2024-04-26T21:21:25.759 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:21:25.759 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.760 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.761 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:25.762 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:25.763 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-26T21:21:25.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: fsmap cephfs:1 {0=cephfs.smithi055.coveew=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all ceph-exporter 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi055"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi055"}]': finished 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi064"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi064"}]': finished 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all iscsi 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.908 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all nfs 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: Upgrade: Setting container_image for all nvmeof 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.909 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: Upgrade: Finalizing container_image settings 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-26T21:21:25.910 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-26T21:21:25.911 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.912 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:25.913 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:26.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:26 smithi055 ceph-mon[109028]: Upgrade: Complete! 2024-04-26T21:21:26.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:26 smithi064 ceph-mon[84240]: Upgrade: Complete! 2024-04-26T21:21:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:27 smithi055 ceph-mon[109028]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:27.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:27.865 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:27 smithi064 ceph-mon[84240]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:27.866 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:27.866 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:21:29.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:29 smithi055 ceph-mon[109028]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:29.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:29 smithi064 ceph-mon[84240]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:31.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:31 smithi055 ceph-mon[109028]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:31.878 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:31 smithi064 ceph-mon[84240]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:33.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:33 smithi064 ceph-mon[84240]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:34.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:33 smithi055 ceph-mon[109028]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:35 smithi055 ceph-mon[109028]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:35.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:35 smithi064 ceph-mon[84240]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:37.887 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:37 smithi055 ceph-mon[109028]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:37.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:37 smithi064 ceph-mon[84240]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:39.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:39 smithi064 ceph-mon[84240]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:40.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:39 smithi055 ceph-mon[109028]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:41.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:41 smithi064 ceph-mon[84240]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:42.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:41 smithi055 ceph-mon[109028]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:43.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:43.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:43 smithi064 ceph-mon[84240]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:44.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:43 smithi055 ceph-mon[109028]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 -- 172.21.15.55:0/915660936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 msgr2=0x7f32b0103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 --2- 172.21.15.55:0/915660936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0103420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009910 tx=0x7f32a0009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 -- 172.21.15.55:0/915660936 shutdown_connections 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 --2- 172.21.15.55:0/915660936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b01039f0 0x7f32b0107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 --2- 172.21.15.55:0/915660936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0103420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 -- 172.21.15.55:0/915660936 >> 172.21.15.55:0/915660936 conn(0x7f32b00fe8b0 msgr2=0x7f32b0100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 -- 172.21.15.55:0/915660936 shutdown_connections 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.667+0000 7f32b7000700 1 -- 172.21.15.55:0/915660936 wait complete. 2024-04-26T21:21:45.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.668+0000 7f32b7000700 1 Processor -- start 2024-04-26T21:21:45.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32b7000700 1 -- start start 2024-04-26T21:21:45.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32b7000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:45.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32b7000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b01039f0 0x7f32b01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32b7000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0199930 con 0x7f32b0103040 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32b7000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b019c550 con 0x7f32b01039f0 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.669+0000 7f32afe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59946/0 (socket says 172.21.15.55:59946) 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 -- 172.21.15.55:0/2124314862 learned_addr learned my addr 172.21.15.55:0/2124314862 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 -- 172.21.15.55:0/2124314862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b01039f0 msgr2=0x7f32b01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b01039f0 0x7f32b01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 -- 172.21.15.55:0/2124314862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00095f0 con 0x7f32b0103040 2024-04-26T21:21:45.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.670+0000 7f32afe00700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000c00 tx=0x7f32a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.671+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a001d070 con 0x7f32b0103040 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.671+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32a00056e0 con 0x7f32b0103040 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.671+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b019c7d0 con 0x7f32b0103040 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.671+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a000fe80 con 0x7f32b0103040 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.671+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b019ccc0 con 0x7f32b0103040 2024-04-26T21:21:45.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.672+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b010b3e0 con 0x7f32b0103040 2024-04-26T21:21:45.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.673+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f32a000f6f0 con 0x7f32b0103040 2024-04-26T21:21:45.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.675+0000 7f32acc00700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 0x7f3294071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:45.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.675+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f32a0090360 con 0x7f32b0103040 2024-04-26T21:21:45.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.675+0000 7f32af400700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 0x7f3294071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:45.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.676+0000 7f32af400700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 0x7f3294071190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f329c005950 tx=0x7f329c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:45.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.680+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f32a0059020 con 0x7f32b0103040 2024-04-26T21:21:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:45 smithi064 ceph-mon[84240]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:45.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.934+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b0199fe0 con 0x7f329406ecd0 2024-04-26T21:21:45.936 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:45 smithi055 ceph-mon[109028]: pgmap v295: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:45.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.936+0000 7f32acc00700 1 -- 172.21.15.55:0/2124314862 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f32b0199fe0 con 0x7f329406ecd0 2024-04-26T21:21:45.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 msgr2=0x7f3294071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:45.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 0x7f3294071190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f329c005950 tx=0x7f329c0058e0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 msgr2=0x7f32b0198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000c00 tx=0x7f32a000be20 comp rx=0 tx=0).stop 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 shutdown_connections 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32b0103040 0x7f32b0198d60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.939+0000 7f32b7000700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f329406ecd0 0x7f3294071190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.940+0000 7f32b7000700 1 --2- 172.21.15.55:0/2124314862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32b01039f0 0x7f32b01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.940+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 >> 172.21.15.55:0/2124314862 conn(0x7f32b00fe8b0 msgr2=0x7f32b00ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.940+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 shutdown_connections 2024-04-26T21:21:45.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:45.940+0000 7f32b7000700 1 -- 172.21.15.55:0/2124314862 wait complete. 2024-04-26T21:21:46.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch ps' 2024-04-26T21:21:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:21:47.724 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:47 smithi055 ceph-mon[109028]: pgmap v296: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:47.724 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:47 smithi055 ceph-mon[109028]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:47 smithi064 ceph-mon[84240]: pgmap v296: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:47 smithi064 ceph-mon[84240]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:49.845 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:49 smithi055 ceph-mon[109028]: pgmap v297: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:49.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 -- 172.21.15.55:0/3479666634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 msgr2=0x7f01941020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 --2- 172.21.15.55:0/3479666634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f01941020c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0184009910 tx=0x7f0184009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:49.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 -- 172.21.15.55:0/3479666634 shutdown_connections 2024-04-26T21:21:49.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 --2- 172.21.15.55:0/3479666634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 0x7f019410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 --2- 172.21.15.55:0/3479666634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f01941020c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 -- 172.21.15.55:0/3479666634 >> 172.21.15.55:0/3479666634 conn(0x7f01940fb5e0 msgr2=0x7f01940fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 -- 172.21.15.55:0/3479666634 shutdown_connections 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.901+0000 7f0199200700 1 -- 172.21.15.55:0/3479666634 wait complete. 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 Processor -- start 2024-04-26T21:21:49.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 -- start start 2024-04-26T21:21:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 0x7f019419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019419d490 con 0x7f0194101ce0 2024-04-26T21:21:49.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.903+0000 7f0199200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194196a70 con 0x7f0194102690 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59964/0 (socket says 172.21.15.55:59964) 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 -- 172.21.15.55:0/2249731574 learned_addr learned my addr 172.21.15.55:0/2249731574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191400700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 0x7f019419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 -- 172.21.15.55:0/2249731574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 msgr2=0x7f019419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 0x7f019419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.904+0000 7f0191e00700 1 -- 172.21.15.55:0/2249731574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01840095f0 con 0x7f0194101ce0 2024-04-26T21:21:49.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.905+0000 7f0191e00700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0184006010 tx=0x7f018400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:49 smithi064 ceph-mon[84240]: pgmap v297: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.905+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f018401d070 con 0x7f0194101ce0 2024-04-26T21:21:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.905+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f018400f460 con 0x7f0194101ce0 2024-04-26T21:21:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.905+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0184017630 con 0x7f0194101ce0 2024-04-26T21:21:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.906+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194196cf0 con 0x7f0194101ce0 2024-04-26T21:21:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.906+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194197160 con 0x7f0194101ce0 2024-04-26T21:21:49.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.907+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0194105560 con 0x7f0194101ce0 2024-04-26T21:21:49.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.909+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f018400f5d0 con 0x7f0194101ce0 2024-04-26T21:21:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.910+0000 7f018aa00700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 0x7f0178071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.910+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0184090760 con 0x7f0194101ce0 2024-04-26T21:21:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.910+0000 7f0191400700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 0x7f0178071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.911+0000 7f0191400700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 0x7f0178071190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0180006fd0 tx=0x7f0180008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:49.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:49.920+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f018405d130 con 0x7f0194101ce0 2024-04-26T21:21:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.164+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f019410de50 con 0x7f017806ecd0 2024-04-26T21:21:50.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.179+0000 7f018aa00700 1 -- 172.21.15.55:0/2249731574 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f019410de50 con 0x7f017806ecd0 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (11m) 35s ago 25m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (51s) 35s ago 25m 7902k - 19.0.0-3306-gbc612ffb 55dc54019ad8 ff06bd537c47 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (43s) 38s ago 24m 7004k - 19.0.0-3306-gbc612ffb 55dc54019ad8 e6da83d3feb9 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (7m) 35s ago 25m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (6m) 38s ago 24m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (10m) 35s ago 24m 73.1M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (2m) 35s ago 17m 84.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (2m) 35s ago 17m 84.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 963e3ca49805 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (102s) 38s ago 17m 12.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4b20b67f6dc0 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (75s) 38s ago 17m 12.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 245da4d6a7fb 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (14m) 35s ago 27m 512M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:21:50.181 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (12m) 38s ago 23m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (8m) 35s ago 27m 59.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (8m) 38s ago 23m 42.6M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (12m) 35s ago 25m 8061k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (12m) 38s ago 23m 8024k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (6m) 35s ago 22m 105M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (5m) 35s ago 22m 118M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (5m) 35s ago 21m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (4m) 38s ago 20m 132M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (4m) 38s ago 20m 106M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (3m) 38s ago 19m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:21:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (11m) 35s ago 24m 72.2M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:21:50.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 msgr2=0x7f0178071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 0x7f0178071190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0180006fd0 tx=0x7f0180008040 comp rx=0 tx=0).stop 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 msgr2=0x7f019419c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0184006010 tx=0x7f018400be20 comp rx=0 tx=0).stop 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 shutdown_connections 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0194101ce0 0x7f019419c930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f017806ecd0 0x7f0178071190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 --2- 172.21.15.55:0/2249731574 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0194102690 0x7f019419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 >> 172.21.15.55:0/2249731574 conn(0x7f01940fb5e0 msgr2=0x7f0194103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 shutdown_connections 2024-04-26T21:21:50.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:50.182+0000 7f0199200700 1 -- 172.21.15.55:0/2249731574 wait complete. 2024-04-26T21:21:51.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch upgrade status' 2024-04-26T21:21:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:21:51.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:51 smithi064 ceph-mon[84240]: pgmap v298: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:51.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:51 smithi064 ceph-mon[84240]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:51.946 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:51 smithi055 ceph-mon[109028]: pgmap v298: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:51.947 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:51 smithi055 ceph-mon[109028]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:53.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:52 smithi055 ceph-mon[109028]: pgmap v299: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:53.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:52 smithi064 ceph-mon[84240]: pgmap v299: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:53.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 -- 172.21.15.55:0/2796525419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 msgr2=0x7f327c103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 --2- 172.21.15.55:0/2796525419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c103420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f327000b0a0 tx=0x7f327000b3b0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 -- 172.21.15.55:0/2796525419 shutdown_connections 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 --2- 172.21.15.55:0/2796525419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 0x7f327c107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 --2- 172.21.15.55:0/2796525419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c103420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 -- 172.21.15.55:0/2796525419 >> 172.21.15.55:0/2796525419 conn(0x7f327c0fe8b0 msgr2=0x7f327c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.701+0000 7f3284400700 1 -- 172.21.15.55:0/2796525419 shutdown_connections 2024-04-26T21:21:53.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.702+0000 7f3284400700 1 -- 172.21.15.55:0/2796525419 wait complete. 2024-04-26T21:21:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.702+0000 7f3284400700 1 Processor -- start 2024-04-26T21:21:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3284400700 1 -- start start 2024-04-26T21:21:53.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3284400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3284400700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 0x7f327c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3284400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c199a00 con 0x7f327c103040 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3284400700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c19d6d0 con 0x7f327c1039f0 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.703+0000 7f3281a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59972/0 (socket says 172.21.15.55:59972) 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 -- 172.21.15.55:0/1490444006 learned_addr learned my addr 172.21.15.55:0/1490444006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281000700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 0x7f327c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 -- 172.21.15.55:0/1490444006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 msgr2=0x7f327c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:53.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 0x7f327c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 -- 172.21.15.55:0/1490444006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009d00 con 0x7f327c103040 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.704+0000 7f3281a00700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f327000b070 tx=0x7f3270007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.705+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327000e040 con 0x7f327c103040 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.705+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3270003c10 con 0x7f327c103040 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.705+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c19d950 con 0x7f327c103040 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.705+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327001d6b0 con 0x7f327c103040 2024-04-26T21:21:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.705+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c19de40 con 0x7f327c103040 2024-04-26T21:21:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.706+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c10b3e0 con 0x7f327c103040 2024-04-26T21:21:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.707+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3270004600 con 0x7f327c103040 2024-04-26T21:21:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.708+0000 7f327a000700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 0x7f3264071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.708+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3270090560 con 0x7f327c103040 2024-04-26T21:21:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.709+0000 7f3281000700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 0x7f3264071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.709+0000 7f3281000700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 0x7f3264071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3268005950 tx=0x7f32680058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.713+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3270059340 con 0x7f327c103040 2024-04-26T21:21:53.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.970+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f327c110010 con 0x7f326406ecd0 2024-04-26T21:21:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.972+0000 7f327a000700 1 -- 172.21.15.55:0/1490444006 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f327c110010 con 0x7f326406ecd0 2024-04-26T21:21:53.972 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "target_image": null, 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "in_progress": false, 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "which": "", 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "services_complete": [], 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": null, 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "is_paused": false 2024-04-26T21:21:53.973 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:21:53.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.974+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 msgr2=0x7f3264071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.974+0000 7f3284400700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 0x7f3264071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3268005950 tx=0x7f32680058e0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 msgr2=0x7f327c198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f327000b070 tx=0x7f3270007bd0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 shutdown_connections 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f327c103040 0x7f327c198de0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f326406ecd0 0x7f3264071190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 --2- 172.21.15.55:0/1490444006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f327c1039f0 0x7f327c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 >> 172.21.15.55:0/1490444006 conn(0x7f327c0fe8b0 msgr2=0x7f327c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 shutdown_connections 2024-04-26T21:21:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:53.975+0000 7f3284400700 1 -- 172.21.15.55:0/1490444006 wait complete. 2024-04-26T21:21:54.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph health detail' 2024-04-26T21:21:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:54 smithi055 ceph-mon[109028]: pgmap v300: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:55.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:54 smithi055 ceph-mon[109028]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:55.295 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:21:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:54 smithi064 ceph-mon[84240]: pgmap v300: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:55.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:54 smithi064 ceph-mon[84240]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:21:57.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:56 smithi055 ceph-mon[109028]: pgmap v301: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:57.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:56 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:56 smithi064 ceph-mon[84240]: pgmap v301: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:57.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:56 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 -- 172.21.15.55:0/3231904214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 msgr2=0x7f516410cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 --2- 172.21.15.55:0/3231904214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f516410cf60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5150009910 tx=0x7f5150009c20 comp rx=0 tx=0).stop 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 -- 172.21.15.55:0/3231904214 shutdown_connections 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 --2- 172.21.15.55:0/3231904214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f516410cf60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 --2- 172.21.15.55:0/3231904214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 0x7f51640ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 -- 172.21.15.55:0/3231904214 >> 172.21.15.55:0/3231904214 conn(0x7f5164076740 msgr2=0x7f51640fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 -- 172.21.15.55:0/3231904214 shutdown_connections 2024-04-26T21:21:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.849+0000 7f516c200700 1 -- 172.21.15.55:0/3231904214 wait complete. 2024-04-26T21:21:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 Processor -- start 2024-04-26T21:21:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 -- start start 2024-04-26T21:21:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 0x7f5164198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51641998f0 con 0x7f51641002a0 2024-04-26T21:21:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.851+0000 7f516c200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516419c560 con 0x7f51640ff8f0 2024-04-26T21:21:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54360/0 (socket says 172.21.15.55:54360) 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 -- 172.21.15.55:0/3460234117 learned_addr learned my addr 172.21.15.55:0/3460234117 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5169800700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 0x7f5164198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 -- 172.21.15.55:0/3460234117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 msgr2=0x7f5164198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 0x7f5164198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 -- 172.21.15.55:0/3460234117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500095f0 con 0x7f51641002a0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.852+0000 7f5168e00700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5150005b40 tx=0x7f51500056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.853+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515001d070 con 0x7f51641002a0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.853+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f515000f460 con 0x7f51641002a0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.853+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5150021640 con 0x7f51641002a0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.853+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516419c7e0 con 0x7f51641002a0 2024-04-26T21:21:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.853+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516419cd30 con 0x7f51641002a0 2024-04-26T21:21:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.854+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5164068ea0 con 0x7f51641002a0 2024-04-26T21:21:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.855+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f515000f5d0 con 0x7f51641002a0 2024-04-26T21:21:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.856+0000 7f5162000700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 0x7f514c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:21:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.856+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5150090010 con 0x7f51641002a0 2024-04-26T21:21:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.857+0000 7f5169800700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 0x7f514c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:21:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.857+0000 7f5169800700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 0x7f514c071180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5158005950 tx=0x7f51580058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:21:57.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:57.862+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f51500c5060 con 0x7f51641002a0 2024-04-26T21:21:58.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.186+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5164107790 con 0x7f51641002a0 2024-04-26T21:21:58.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.187+0000 7f5162000700 1 -- 172.21.15.55:0/3460234117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5150058d50 con 0x7f51641002a0 2024-04-26T21:21:58.188 INFO:teuthology.orchestra.run.smithi055.stdout:HEALTH_OK 2024-04-26T21:21:58.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 msgr2=0x7f514c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 0x7f514c071180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5158005950 tx=0x7f51580058e0 comp rx=0 tx=0).stop 2024-04-26T21:21:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 msgr2=0x7f5164199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:21:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5150005b40 tx=0x7f51500056a0 comp rx=0 tx=0).stop 2024-04-26T21:21:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 shutdown_connections 2024-04-26T21:21:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f514c06ecc0 0x7f514c071180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:58.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f51640ff8f0 0x7f5164198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:58.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.190+0000 7f516c200700 1 --2- 172.21.15.55:0/3460234117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51641002a0 0x7f5164199260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:21:58.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.191+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 >> 172.21.15.55:0/3460234117 conn(0x7f5164076740 msgr2=0x7f51640fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:21:58.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.191+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 shutdown_connections 2024-04-26T21:21:58.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:21:58.191+0000 7f516c200700 1 -- 172.21.15.55:0/3460234117 wait complete. 2024-04-26T21:21:58.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions' 2024-04-26T21:21:59.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:58 smithi064 ceph-mon[84240]: pgmap v302: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:59.157 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:21:58 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3460234117' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:21:59.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:58 smithi055 ceph-mon[109028]: pgmap v302: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:21:59.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:21:58 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3460234117' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-26T21:21:59.433 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:22:01.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:01 smithi055 ceph-mon[109028]: pgmap v303: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:01.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:01 smithi064 ceph-mon[84240]: pgmap v303: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 -- 172.21.15.55:0/3293324857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8103040 msgr2=0x7ffad8103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 --2- 172.21.15.55:0/3293324857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8103040 0x7ffad8103420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009910 tx=0x7ffac8009c20 comp rx=0 tx=0).stop 2024-04-26T21:22:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 -- 172.21.15.55:0/3293324857 shutdown_connections 2024-04-26T21:22:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 --2- 172.21.15.55:0/3293324857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad81039f0 0x7ffad8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 --2- 172.21.15.55:0/3293324857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad8103040 0x7ffad8103420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 -- 172.21.15.55:0/3293324857 >> 172.21.15.55:0/3293324857 conn(0x7ffad80fe8b0 msgr2=0x7ffad8100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.780+0000 7ffadf000700 1 -- 172.21.15.55:0/3293324857 shutdown_connections 2024-04-26T21:22:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.781+0000 7ffadf000700 1 -- 172.21.15.55:0/3293324857 wait complete. 2024-04-26T21:22:01.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 Processor -- start 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 -- start start 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 0x7ffad80753f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80794c0 con 0x7ffad81039f0 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.782+0000 7ffadf000700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8075e70 con 0x7ffad8103040 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54370/0 (socket says 172.21.15.55:54370) 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 -- 172.21.15.55:0/2480743228 learned_addr learned my addr 172.21.15.55:0/2480743228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7e00700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 0x7ffad80753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 -- 172.21.15.55:0/2480743228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 msgr2=0x7ffad80753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 0x7ffad80753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 -- 172.21.15.55:0/2480743228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80095f0 con 0x7ffad81039f0 2024-04-26T21:22:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7e00700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 0x7ffad80753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:22:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.783+0000 7ffad7400700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b480 tx=0x7ffac400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.784+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac40118c0 con 0x7ffad81039f0 2024-04-26T21:22:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.784+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffac4010380 con 0x7ffad81039f0 2024-04-26T21:22:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.784+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac400f4f0 con 0x7ffad81039f0 2024-04-26T21:22:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.784+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad8076150 con 0x7ffad81039f0 2024-04-26T21:22:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.784+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad81a75b0 con 0x7ffad81039f0 2024-04-26T21:22:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.785+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad8104520 con 0x7ffad81039f0 2024-04-26T21:22:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.787+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffac40104f0 con 0x7ffad81039f0 2024-04-26T21:22:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.787+0000 7ffad4c00700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 0x7ffabc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:22:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.788+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffac408eac0 con 0x7ffad81039f0 2024-04-26T21:22:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.788+0000 7ffad7e00700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 0x7ffabc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:22:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.789+0000 7ffad7e00700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 0x7ffabc071190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:22:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:01.793+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ffac4057800 con 0x7ffad81039f0 2024-04-26T21:22:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.119+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffad804ebb0 con 0x7ffad81039f0 2024-04-26T21:22:02.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.121+0000 7ffad4c00700 1 -- 172.21.15.55:0/2480743228 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ffac405aec0 con 0x7ffad81039f0 2024-04-26T21:22:02.121 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:22:02.121 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:22:02.122 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:22:02.122 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:22:02.122 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:22:02.122 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:22:02.122 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:22:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 msgr2=0x7ffabc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 0x7ffabc071190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac800b540 comp rx=0 tx=0).stop 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 msgr2=0x7ffad8075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:22:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b480 tx=0x7ffac400b840 comp rx=0 tx=0).stop 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 shutdown_connections 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ffabc06ecd0 0x7ffabc071190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffad8103040 0x7ffad80753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 --2- 172.21.15.55:0/2480743228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffad81039f0 0x7ffad8075930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 >> 172.21.15.55:0/2480743228 conn(0x7ffad80fe8b0 msgr2=0x7ffad8106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 shutdown_connections 2024-04-26T21:22:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:22:02.124+0000 7ffadf000700 1 -- 172.21.15.55:0/2480743228 wait complete. 2024-04-26T21:22:03.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-26T21:22:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:03 smithi055 ceph-mon[109028]: pgmap v304: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:03.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:03 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2480743228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:22:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:03 smithi064 ceph-mon[84240]: pgmap v304: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:03.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:03 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2480743228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:22:03.475 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:22:05.230 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:05 smithi055 ceph-mon[109028]: pgmap v305: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:05.308 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:05 smithi064 ceph-mon[84240]: pgmap v305: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:05.733 INFO:teuthology.orchestra.run.smithi055.stdout:wait for servicemap items w/ changing names to refresh 2024-04-26T21:22:06.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'sleep 60' 2024-04-26T21:22:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:22:07.400 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:07 smithi055 ceph-mon[109028]: pgmap v306: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:07.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:07 smithi064 ceph-mon[84240]: pgmap v306: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:09.327 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:09 smithi055 ceph-mon[109028]: pgmap v307: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:09.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:09 smithi064 ceph-mon[84240]: pgmap v307: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:11.388 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:11 smithi055 ceph-mon[109028]: pgmap v308: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:11.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:11 smithi064 ceph-mon[84240]: pgmap v308: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:12.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:12.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:13.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:13 smithi064 ceph-mon[84240]: pgmap v309: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:13.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:13 smithi055 ceph-mon[109028]: pgmap v309: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:15.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:15 smithi064 ceph-mon[84240]: pgmap v310: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:15 smithi055 ceph-mon[109028]: pgmap v310: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:17.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:17 smithi064 ceph-mon[84240]: pgmap v311: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:17.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:17 smithi055 ceph-mon[109028]: pgmap v311: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:19.374 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:19 smithi064 ceph-mon[84240]: pgmap v312: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:19 smithi055 ceph-mon[109028]: pgmap v312: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:21.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:21 smithi064 ceph-mon[84240]: pgmap v313: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:21.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:21 smithi055 ceph-mon[109028]: pgmap v313: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:23.156 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:22 smithi064 ceph-mon[84240]: pgmap v314: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:23.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:22 smithi055 ceph-mon[109028]: pgmap v314: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:25.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:24 smithi055 ceph-mon[109028]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:25.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:24 smithi064 ceph-mon[84240]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:26.254 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:25 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:26.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:25 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:27.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:27 smithi055 ceph-mon[109028]: pgmap v316: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:27.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:27.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:27 smithi064 ceph-mon[84240]: pgmap v316: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:27.407 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:22:28.409 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:28.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:28.410 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:22:29.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:29 smithi064 ceph-mon[84240]: pgmap v317: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:29.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:29 smithi055 ceph-mon[109028]: pgmap v317: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:31.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:31 smithi064 ceph-mon[84240]: pgmap v318: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:31.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:31 smithi055 ceph-mon[109028]: pgmap v318: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:33.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:33 smithi064 ceph-mon[84240]: pgmap v319: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:33.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:33 smithi055 ceph-mon[109028]: pgmap v319: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:35.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:35 smithi064 ceph-mon[84240]: pgmap v320: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:35.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:35 smithi055 ceph-mon[109028]: pgmap v320: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:37.408 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:37 smithi064 ceph-mon[84240]: pgmap v321: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:37.436 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:37 smithi055 ceph-mon[109028]: pgmap v321: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:39.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:39 smithi064 ceph-mon[84240]: pgmap v322: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:39.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:39 smithi055 ceph-mon[109028]: pgmap v322: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:22:41.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:41 smithi064 ceph-mon[84240]: pgmap v323: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:41.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:41 smithi055 ceph-mon[109028]: pgmap v323: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:42.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:42.463 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:43.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:43 smithi064 ceph-mon[84240]: pgmap v324: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:43.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:43 smithi055 ceph-mon[109028]: pgmap v324: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:45.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:45 smithi064 ceph-mon[84240]: pgmap v325: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:45.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:45 smithi055 ceph-mon[109028]: pgmap v325: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:47.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:47 smithi064 ceph-mon[84240]: pgmap v326: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:47.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:47 smithi055 ceph-mon[109028]: pgmap v326: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:49.406 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:49 smithi064 ceph-mon[84240]: pgmap v327: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:49.506 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:49 smithi055 ceph-mon[109028]: pgmap v327: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:51.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:51 smithi055 ceph-mon[109028]: pgmap v328: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:51.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:51 smithi064 ceph-mon[84240]: pgmap v328: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:53.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:53 smithi055 ceph-mon[109028]: pgmap v329: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:53.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:53 smithi064 ceph-mon[84240]: pgmap v329: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:55.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:55 smithi055 ceph-mon[109028]: pgmap v330: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:55.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:55 smithi064 ceph-mon[84240]: pgmap v330: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:57 smithi055 ceph-mon[109028]: pgmap v331: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:57.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:57 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:57 smithi064 ceph-mon[84240]: pgmap v331: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:57.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:57 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:22:59.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:22:59 smithi055 ceph-mon[109028]: pgmap v332: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:59.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:22:59 smithi064 ceph-mon[84240]: pgmap v332: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:01.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:01 smithi055 ceph-mon[109028]: pgmap v333: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:01.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:01 smithi064 ceph-mon[84240]: pgmap v333: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:03.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:03 smithi055 ceph-mon[109028]: pgmap v334: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:03.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:03 smithi064 ceph-mon[84240]: pgmap v334: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:05.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:05 smithi055 ceph-mon[109028]: pgmap v335: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:05.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:05 smithi064 ceph-mon[84240]: pgmap v335: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:07.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:07 smithi055 ceph-mon[109028]: pgmap v336: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:07.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:07 smithi064 ceph-mon[84240]: pgmap v336: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:09.504 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:09 smithi055 ceph-mon[109028]: pgmap v337: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:09.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:09 smithi064 ceph-mon[84240]: pgmap v337: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:10.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph orch ps' 2024-04-26T21:23:10.770 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:23:11.478 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:11 smithi055 ceph-mon[109028]: pgmap v338: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:11.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:11 smithi064 ceph-mon[84240]: pgmap v338: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:12.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:12 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:12.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:12 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:13.380 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:13 smithi055 ceph-mon[109028]: pgmap v339: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:13.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.393+0000 7fb021600700 1 -- 172.21.15.55:0/2491216579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 msgr2=0x7fb01c107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.393+0000 7fb021600700 1 --2- 172.21.15.55:0/2491216579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c107820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009910 tx=0x7fb00c009c20 comp rx=0 tx=0).stop 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 -- 172.21.15.55:0/2491216579 shutdown_connections 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 --2- 172.21.15.55:0/2491216579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb01c107df0 0x7fb01c10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 --2- 172.21.15.55:0/2491216579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c107820 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 -- 172.21.15.55:0/2491216579 >> 172.21.15.55:0/2491216579 conn(0x7fb01c076a10 msgr2=0x7fb01c078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 -- 172.21.15.55:0/2491216579 shutdown_connections 2024-04-26T21:23:13.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.394+0000 7fb021600700 1 -- 172.21.15.55:0/2491216579 wait complete. 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.395+0000 7fb021600700 1 Processor -- start 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.395+0000 7fb021600700 1 -- start start 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb021600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb021600700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb01c107df0 0x7fb01c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb021600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c19dd70 con 0x7fb01c107440 2024-04-26T21:23:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb021600700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c1a19f0 con 0x7fb01c107df0 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46542/0 (socket says 172.21.15.55:46542) 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 -- 172.21.15.55:0/1119364906 learned_addr learned my addr 172.21.15.55:0/1119364906 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 -- 172.21.15.55:0/1119364906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb01c107df0 msgr2=0x7fb01c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb01c107df0 0x7fb01c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.396+0000 7fb01aa00700 1 -- 172.21.15.55:0/1119364906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0095f0 con 0x7fb01c107440 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb01aa00700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bd70 tx=0x7fb00c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:13.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c01d070 con 0x7fb01c107440 2024-04-26T21:23:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c0056e0 con 0x7fb01c107440 2024-04-26T21:23:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c017400 con 0x7fb01c107440 2024-04-26T21:23:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c1a1c70 con 0x7fb01c107440 2024-04-26T21:23:13.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.397+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c1a2160 con 0x7fb01c107440 2024-04-26T21:23:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.398+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c10f7e0 con 0x7fb01c107440 2024-04-26T21:23:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.400+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb00c003a60 con 0x7fb01c107440 2024-04-26T21:23:13.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.401+0000 7fb013400700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 0x7fb000071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:13.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.401+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb00c090300 con 0x7fb01c107440 2024-04-26T21:23:13.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.401+0000 7fb013e00700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 0x7fb000071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:13.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.402+0000 7fb013e00700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 0x7fb000071180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb004005950 tx=0x7fb0040058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.406+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb00c059040 con 0x7fb01c107440 2024-04-26T21:23:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.650+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 --> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb01c114400 con 0x7fb00006ecc0 2024-04-26T21:23:13.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:13 smithi064 ceph-mon[84240]: pgmap v339: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:13.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.698+0000 7fb013400700 1 -- 172.21.15.55:0/1119364906 <== mgr.34104 v2:172.21.15.55:6800/3120849084 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb01c114400 con 0x7fb00006ecc0 2024-04-26T21:23:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T21:23:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:alertmanager.smithi055 smithi055 *:9093,9094 running (12m) 119s ago 26m 14.5M - 0.25.0 c8568f914cd2 d33355994853 2024-04-26T21:23:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi055 smithi055 running (2m) 119s ago 27m 7902k - 19.0.0-3306-gbc612ffb 55dc54019ad8 ff06bd537c47 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-exporter.smithi064 smithi064 running (2m) 2m ago 25m 7004k - 19.0.0-3306-gbc612ffb 55dc54019ad8 e6da83d3feb9 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi055 smithi055 running (8m) 119s ago 27m 6660k - 19.0.0-3306-gbc612ffb 55dc54019ad8 66a83a8c7154 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:crash.smithi064 smithi064 running (8m) 2m ago 25m 6656k - 19.0.0-3306-gbc612ffb 55dc54019ad8 00fc2c340a9f 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:grafana.smithi055 smithi055 *:3000 running (11m) 119s ago 26m 73.1M - 9.4.12 2bacad6d85d8 f4603281b7c1 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.coveew smithi055 running (4m) 119s ago 19m 84.7M - 19.0.0-3306-gbc612ffb 55dc54019ad8 679e2111998b 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi055.nwfjlb smithi055 running (3m) 119s ago 19m 84.2M - 19.0.0-3306-gbc612ffb 55dc54019ad8 963e3ca49805 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.ukvnjs smithi064 running (3m) 2m ago 19m 12.3M - 19.0.0-3306-gbc612ffb 55dc54019ad8 4b20b67f6dc0 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mds.cephfs.smithi064.xrdyeb smithi064 running (2m) 2m ago 18m 12.0M - 19.0.0-3306-gbc612ffb 55dc54019ad8 245da4d6a7fb 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi055.ybbowr smithi055 *:8443,9283,8765 running (15m) 119s ago 28m 512M - 19.0.0-3306-gbc612ffb 55dc54019ad8 d74d8ed998b0 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.smithi064.tchyje smithi064 *:8443,9283,8765 running (14m) 2m ago 25m 454M - 19.0.0-3306-gbc612ffb 55dc54019ad8 622ae5d0bb97 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi055 smithi055 running (10m) 119s ago 28m 59.8M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 56a4908b348c 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:mon.smithi064 smithi064 running (9m) 2m ago 25m 42.6M 2048M 19.0.0-3306-gbc612ffb 55dc54019ad8 fe7ea8a31170 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi055 smithi055 *:9100 running (13m) 119s ago 26m 8061k - 1.5.0 0da6a335fe13 1ef93aaab3bc 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:node-exporter.smithi064 smithi064 *:9100 running (13m) 2m ago 25m 8024k - 1.5.0 0da6a335fe13 d8cc4db7a0a5 2024-04-26T21:23:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (7m) 119s ago 24m 105M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 e7b4650b60b7 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi055 running (7m) 119s ago 23m 118M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 4a3c3f9692bc 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi055 running (6m) 119s ago 22m 101M 1218M 19.0.0-3306-gbc612ffb 55dc54019ad8 352ba789497d 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi064 running (6m) 2m ago 22m 132M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 0f1294804613 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi064 running (5m) 2m ago 21m 106M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 822dbca881c4 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi064 running (4m) 2m ago 21m 100M 2240M 19.0.0-3306-gbc612ffb 55dc54019ad8 6091c379a579 2024-04-26T21:23:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:prometheus.smithi055 smithi055 *:9095 running (12m) 119s ago 26m 72.2M - 2.43.0 a07b618ecd1d 24b271fd4fa1 2024-04-26T21:23:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.701+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 msgr2=0x7fb000071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 0x7fb000071180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb004005950 tx=0x7fb0040058e0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 msgr2=0x7fb01c19d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:13.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00bd70 tx=0x7fb00c00be50 comp rx=0 tx=0).stop 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 shutdown_connections 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb01c107440 0x7fb01c19d150 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb00006ecc0 0x7fb000071180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 --2- 172.21.15.55:0/1119364906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb01c107df0 0x7fb01c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 >> 172.21.15.55:0/1119364906 conn(0x7fb01c076a10 msgr2=0x7fb01c076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 shutdown_connections 2024-04-26T21:23:13.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:13.702+0000 7fb021600700 1 -- 172.21.15.55:0/1119364906 wait complete. 2024-04-26T21:23:14.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions' 2024-04-26T21:23:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:23:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:15 smithi055 ceph-mon[109028]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:15.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:15 smithi055 ceph-mon[109028]: pgmap v340: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:15.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:15 smithi064 ceph-mon[84240]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T21:23:15.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:15 smithi064 ceph-mon[84240]: pgmap v340: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:17.397 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:17 smithi055 ceph-mon[109028]: pgmap v341: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 -- 172.21.15.55:0/974552826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 msgr2=0x7fc7781011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 --2- 172.21.15.55:0/974552826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc7781011f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009910 tx=0x7fc76c009c20 comp rx=0 tx=0).stop 2024-04-26T21:23:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 -- 172.21.15.55:0/974552826 shutdown_connections 2024-04-26T21:23:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 --2- 172.21.15.55:0/974552826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7781017c0 0x7fc778105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 --2- 172.21.15.55:0/974552826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc7781011f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 -- 172.21.15.55:0/974552826 >> 172.21.15.55:0/974552826 conn(0x7fc7780fc6e0 msgr2=0x7fc7780feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.415+0000 7fc77fe00700 1 -- 172.21.15.55:0/974552826 shutdown_connections 2024-04-26T21:23:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.416+0000 7fc77fe00700 1 -- 172.21.15.55:0/974552826 wait complete. 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 Processor -- start 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 -- start start 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7781017c0 0x7fc7781970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778197790 con 0x7fc778100e10 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.417+0000 7fc77fe00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77819b3a0 con 0x7fc7781017c0 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43340/0 (socket says 172.21.15.55:43340) 2024-04-26T21:23:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 -- 172.21.15.55:0/3236978649 learned_addr learned my addr 172.21.15.55:0/3236978649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 -- 172.21.15.55:0/3236978649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7781017c0 msgr2=0x7fc7781970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7781017c0 0x7fc7781970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 -- 172.21.15.55:0/3236978649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0095f0 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.418+0000 7fc77d400700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0092e0 tx=0x7fc76c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.419+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76c01d070 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.419+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc76c00f460 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.419+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76c017630 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.419+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77819b620 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.419+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77819bb10 con 0x7fc778100e10 2024-04-26T21:23:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.420+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7781091b0 con 0x7fc778100e10 2024-04-26T21:23:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.421+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc76c00f5d0 con 0x7fc778100e10 2024-04-26T21:23:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.422+0000 7fc776000700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 0x7fc760071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.422+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc76c0903a0 con 0x7fc778100e10 2024-04-26T21:23:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.423+0000 7fc77ca00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 0x7fc760071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.423+0000 7fc77ca00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 0x7fc760071190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc778102900 tx=0x7fc764005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:17.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.427+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fc76c0590e0 con 0x7fc778100e10 2024-04-26T21:23:17.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:17 smithi064 ceph-mon[84240]: pgmap v341: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.773+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc778197dc0 con 0x7fc778100e10 2024-04-26T21:23:17.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.775+0000 7fc776000700 1 -- 172.21.15.55:0/3236978649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fc76c05c7a0 con 0x7fc778100e10 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": { 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": { 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 2 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": { 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 6 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 4 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-26T21:23:17.777 INFO:teuthology.orchestra.run.smithi055.stdout: "overall": { 2024-04-26T21:23:17.778 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)": 14 2024-04-26T21:23:17.778 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-26T21:23:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-26T21:23:17.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 msgr2=0x7fc760071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 0x7fc760071190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc778102900 tx=0x7fc764005c80 comp rx=0 tx=0).stop 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 msgr2=0x7fc778196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0092e0 tx=0x7fc76c00be20 comp rx=0 tx=0).stop 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 shutdown_connections 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc778100e10 0x7fc778196b70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fc76006ecd0 0x7fc760071190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 --2- 172.21.15.55:0/3236978649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7781017c0 0x7fc7781970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 >> 172.21.15.55:0/3236978649 conn(0x7fc7780fc6e0 msgr2=0x7fc7780fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:17.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.778+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 shutdown_connections 2024-04-26T21:23:17.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:17.779+0000 7fc77fe00700 1 -- 172.21.15.55:0/3236978649 wait complete. 2024-04-26T21:23:18.481 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:18 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3236978649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:18.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:18 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3236978649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:18.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-26T21:23:19.401 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:23:19.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:19 smithi055 ceph-mon[109028]: pgmap v342: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:19.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:19 smithi064 ceph-mon[84240]: pgmap v342: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:21.337 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:21 smithi055 ceph-mon[109028]: pgmap v343: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:21.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 -- 172.21.15.55:0/1441661564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e8103040 msgr2=0x7f17e8103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:21.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 --2- 172.21.15.55:0/1441661564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e8103040 0x7f17e8103420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009910 tx=0x7f17d8009c20 comp rx=0 tx=0).stop 2024-04-26T21:23:21.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 -- 172.21.15.55:0/1441661564 shutdown_connections 2024-04-26T21:23:21.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 --2- 172.21.15.55:0/1441661564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e81039f0 0x7f17e8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 --2- 172.21.15.55:0/1441661564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e8103040 0x7f17e8103420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 -- 172.21.15.55:0/1441661564 >> 172.21.15.55:0/1441661564 conn(0x7f17e80fe8b0 msgr2=0x7f17e8100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:21.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.629+0000 7f17ed200700 1 -- 172.21.15.55:0/1441661564 shutdown_connections 2024-04-26T21:23:21.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.630+0000 7f17ed200700 1 -- 172.21.15.55:0/1441661564 wait complete. 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 Processor -- start 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 -- start start 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e8103040 0x7f17e819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8198bb0 con 0x7f17e81039f0 2024-04-26T21:23:21.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.631+0000 7f17ed200700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8198d20 con 0x7f17e8103040 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43360/0 (socket says 172.21.15.55:43360) 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 -- 172.21.15.55:0/13662927 learned_addr learned my addr 172.21.15.55:0/13662927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5e00700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e8103040 0x7f17e819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 -- 172.21.15.55:0/13662927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e8103040 msgr2=0x7f17e819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e8103040 0x7f17e819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 -- 172.21.15.55:0/13662927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80095f0 con 0x7f17e81039f0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.632+0000 7f17e5400700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e970 tx=0x7f17d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.633+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d4009750 con 0x7f17e81039f0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.633+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17d4004cf0 con 0x7f17e81039f0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.633+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e8199000 con 0x7f17e81039f0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.633+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d4005660 con 0x7f17e81039f0 2024-04-26T21:23:21.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.633+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8199550 con 0x7f17e81039f0 2024-04-26T21:23:21.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.634+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e810b3e0 con 0x7f17e81039f0 2024-04-26T21:23:21.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.636+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f17d4004750 con 0x7f17e81039f0 2024-04-26T21:23:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.637+0000 7f17dea00700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 0x7f17cc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:21.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.637+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f17d4014070 con 0x7f17e81039f0 2024-04-26T21:23:21.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.638+0000 7f17e5e00700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 0x7f17cc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:21.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.638+0000 7f17e5e00700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 0x7f17cc071180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b760 tx=0x7f17d8005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:21.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.642+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f17d4058010 con 0x7f17e81039f0 2024-04-26T21:23:21.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:21 smithi064 ceph-mon[84240]: pgmap v343: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:21.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.968+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f17e8199fd0 con 0x7f17e81039f0 2024-04-26T21:23:21.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.969+0000 7f17dea00700 1 -- 172.21.15.55:0/13662927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f17d405b6d0 con 0x7f17e81039f0 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 msgr2=0x7f17cc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 0x7f17cc071180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b760 tx=0x7f17d8005a90 comp rx=0 tx=0).stop 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 msgr2=0x7f17e819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e970 tx=0x7f17d400ed30 comp rx=0 tx=0).stop 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 shutdown_connections 2024-04-26T21:23:21.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f17cc06ecc0 0x7f17cc071180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17e8103040 0x7f17e819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 --2- 172.21.15.55:0/13662927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17e81039f0 0x7f17e819ef80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:21.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.971+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 >> 172.21.15.55:0/13662927 conn(0x7f17e80fe8b0 msgr2=0x7f17e80ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:21.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.972+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 shutdown_connections 2024-04-26T21:23:21.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:21.972+0000 7f17ed200700 1 -- 172.21.15.55:0/13662927 wait complete. 2024-04-26T21:23:21.990 INFO:teuthology.orchestra.run.smithi055.stdout:true 2024-04-26T21:23:22.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:22 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/13662927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:22.741 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:22 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/13662927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:22.783 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -e sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-26T21:23:23.213 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:23:23.597 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:23 smithi055 ceph-mon[109028]: pgmap v344: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:23.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:23 smithi064 ceph-mon[84240]: pgmap v344: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:25.495 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:25 smithi055 ceph-mon[109028]: pgmap v345: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:25.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:25 smithi064 ceph-mon[84240]: pgmap v345: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.672+0000 7efd71a00700 1 -- 172.21.15.55:0/799290558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c103030 msgr2=0x7efd6c103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.672+0000 7efd71a00700 1 --2- 172.21.15.55:0/799290558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c103030 0x7efd6c103410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009910 tx=0x7efd5c009c20 comp rx=0 tx=0).stop 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 -- 172.21.15.55:0/799290558 shutdown_connections 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 --2- 172.21.15.55:0/799290558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c1039e0 0x7efd6c107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 --2- 172.21.15.55:0/799290558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c103030 0x7efd6c103410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 -- 172.21.15.55:0/799290558 >> 172.21.15.55:0/799290558 conn(0x7efd6c0fe8c0 msgr2=0x7efd6c100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 -- 172.21.15.55:0/799290558 shutdown_connections 2024-04-26T21:23:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.673+0000 7efd71a00700 1 -- 172.21.15.55:0/799290558 wait complete. 2024-04-26T21:23:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 Processor -- start 2024-04-26T21:23:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 -- start start 2024-04-26T21:23:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c103030 0x7efd6c19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c19f5a0 con 0x7efd6c1039e0 2024-04-26T21:23:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.674+0000 7efd71a00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c198b80 con 0x7efd6c103030 2024-04-26T21:23:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:25.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56138/0 (socket says 172.21.15.55:56138) 2024-04-26T21:23:25.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 -- 172.21.15.55:0/726326058 learned_addr learned my addr 172.21.15.55:0/726326058 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:25.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6aa00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c103030 0x7efd6c19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 -- 172.21.15.55:0/726326058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c103030 msgr2=0x7efd6c19ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c103030 0x7efd6c19ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.675+0000 7efd6a000700 1 -- 172.21.15.55:0/726326058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0095f0 con 0x7efd6c1039e0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd6a000700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c8f0 tx=0x7efd5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd58007a50 con 0x7efd6c1039e0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd58007bb0 con 0x7efd6c1039e0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd58018630 con 0x7efd6c1039e0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c198e60 con 0x7efd6c1039e0 2024-04-26T21:23:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.676+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c1993b0 con 0x7efd6c1039e0 2024-04-26T21:23:25.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.677+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c10b3d0 con 0x7efd6c1039e0 2024-04-26T21:23:25.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.679+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efd58007d20 con 0x7efd6c1039e0 2024-04-26T21:23:25.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.680+0000 7efd63400700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 0x7efd50071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.680+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efd5808ee50 con 0x7efd6c1039e0 2024-04-26T21:23:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.681+0000 7efd6aa00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 0x7efd50071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.681+0000 7efd6aa00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 0x7efd50071190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b5c0 tx=0x7efd5c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:25.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:25.686+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7efd5805b6c0 con 0x7efd6c1039e0 2024-04-26T21:23:26.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.018+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd6c104510 con 0x7efd6c1039e0 2024-04-26T21:23:26.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.019+0000 7efd63400700 1 -- 172.21.15.55:0/726326058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7efd5805b250 con 0x7efd6c1039e0 2024-04-26T21:23:26.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 msgr2=0x7efd50071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:26.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 0x7efd50071190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b5c0 tx=0x7efd5c01a040 comp rx=0 tx=0).stop 2024-04-26T21:23:26.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 msgr2=0x7efd6c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:26.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efd5800c8f0 tx=0x7efd5800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 shutdown_connections 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7efd5006ecd0 0x7efd50071190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd6c103030 0x7efd6c19ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 --2- 172.21.15.55:0/726326058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd6c1039e0 0x7efd6c19ef80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 >> 172.21.15.55:0/726326058 conn(0x7efd6c0fe8c0 msgr2=0x7efd6c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 shutdown_connections 2024-04-26T21:23:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:26.023+0000 7efd71a00700 1 -- 172.21.15.55:0/726326058 wait complete. 2024-04-26T21:23:26.043 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)" 2024-04-26T21:23:26.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:26 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/726326058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:26.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:26 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/726326058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-26T21:23:26.863 DEBUG:teuthology.parallel:result is None 2024-04-26T21:23:26.863 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T21:23:26.875 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:23:26.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T21:23:27.293 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/mon.smithi055/config 2024-04-26T21:23:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:27 smithi064 ceph-mon[84240]: pgmap v346: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:27.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:27 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:27.683 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:27 smithi055 ceph-mon[109028]: pgmap v346: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:27.684 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:27 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:28.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:28 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:28.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:28 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:29 smithi064 ceph-mon[84240]: pgmap v347: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:29.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:29 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:23:29.678 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:29 smithi055 ceph-mon[109028]: pgmap v347: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:29.678 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:29.678 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:29.678 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:29 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' 2024-04-26T21:23:29.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.854+0000 7f4a68e00700 1 -- 172.21.15.55:0/745175607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a641025a0 msgr2=0x7f4a6410aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:29.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.854+0000 7f4a68e00700 1 --2- 172.21.15.55:0/745175607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a641025a0 0x7f4a6410aa90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009910 tx=0x7f4a50009c20 comp rx=0 tx=0).stop 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 -- 172.21.15.55:0/745175607 shutdown_connections 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 --2- 172.21.15.55:0/745175607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a641025a0 0x7f4a6410aa90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 --2- 172.21.15.55:0/745175607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a64101c80 0x7f4a64102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 -- 172.21.15.55:0/745175607 >> 172.21.15.55:0/745175607 conn(0x7f4a640fb3f0 msgr2=0x7f4a640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 -- 172.21.15.55:0/745175607 shutdown_connections 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.855+0000 7f4a68e00700 1 -- 172.21.15.55:0/745175607 wait complete. 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 Processor -- start 2024-04-26T21:23:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 -- start start 2024-04-26T21:23:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a641025a0 0x7f4a640ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a641018b0 con 0x7f4a64101c80 2024-04-26T21:23:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.856+0000 7f4a68e00700 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64100360 con 0x7f4a641025a0 2024-04-26T21:23:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:29.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56170/0 (socket says 172.21.15.55:56170) 2024-04-26T21:23:29.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 -- 172.21.15.55:0/2759590849 learned_addr learned my addr 172.21.15.55:0/2759590849 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:29.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 -- 172.21.15.55:0/2759590849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a641025a0 msgr2=0x7f4a640ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:29.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a641025a0 0x7f4a640ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:29.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.857+0000 7f4a63400700 1 -- 172.21.15.55:0/2759590849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500095f0 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a63400700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c930 tx=0x7f4a5400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a54007ad0 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a54007c30 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a54018610 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a64100610 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.858+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a641a2db0 con 0x7f4a64101c80 2024-04-26T21:23:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.859+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a64108290 con 0x7f4a64101c80 2024-04-26T21:23:29.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.860+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4a5400f450 con 0x7f4a64101c80 2024-04-26T21:23:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.861+0000 7f4a5be00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 0x7f4a48071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.861+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4a5408f0a0 con 0x7f4a64101c80 2024-04-26T21:23:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.862+0000 7f4a62a00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 0x7f4a48071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.862+0000 7f4a62a00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 0x7f4a48071190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006010 tx=0x7f4a5000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:29.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:29.867+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4a54057de0 con 0x7f4a64101c80 2024-04-26T21:23:30.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.147+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a64069670 con 0x7f4a64101c80 2024-04-26T21:23:30.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.148+0000 7f4a5be00700 1 -- 172.21.15.55:0/2759590849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1961 (secure 0 0 0) 0x7f4a5405b4a0 con 0x7f4a64101c80 2024-04-26T21:23:30.150 INFO:teuthology.orchestra.run.smithi055.stdout:e38 2024-04-26T21:23:30.150 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T21:23:30.150 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-26T21:23:30.150 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-04-26T21:23:30.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 38 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-26T21:03:57.989144+0000 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-04-26T21:21:23.458473+0000 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 60 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-04-26T21:23:30.151 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 85 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 1 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:in 0 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=34462} 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 1 2024-04-26T21:23:30.152 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 34462 members: 34462 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.coveew{0:34462} state up:active seq 25 join_fscid=1 addr [v2:172.21.15.55:6826/498152331,v1:172.21.15.55:6827/498152331] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi055.nwfjlb{0:34494} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.55:6828/2855585077,v1:172.21.15.55:6829/2855585077] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.ukvnjs{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6824/3858142462,v1:172.21.15.64:6825/3858142462] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:23:30.153 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.cephfs.smithi064.xrdyeb{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.64:6826/1442123081,v1:172.21.15.64:6827/1442123081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 msgr2=0x7f4a48071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 0x7f4a48071190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a50006010 tx=0x7f4a5000b540 comp rx=0 tx=0).stop 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 msgr2=0x7f4a640ff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c930 tx=0x7f4a5400ccf0 comp rx=0 tx=0).stop 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 shutdown_connections 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a64101c80 0x7f4a640ff8e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f4a4806ecd0 0x7f4a48071190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 --2- 172.21.15.55:0/2759590849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a641025a0 0x7f4a640ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 >> 172.21.15.55:0/2759590849 conn(0x7f4a640fb3f0 msgr2=0x7f4a641053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.152+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 shutdown_connections 2024-04-26T21:23:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:30.153+0000 7f4a68e00700 1 -- 172.21.15.55:0/2759590849 wait complete. 2024-04-26T21:23:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 38 2024-04-26T21:23:30.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:30 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2759590849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:30.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:30 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2759590849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T21:23:31.026 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-26T21:23:31.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:23:31.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.254+0000 7fdea3e00640 1 -- 172.21.15.55:0/1397108915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea4072790 msgr2=0x7fdea4072b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.254+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1397108915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea4072790 0x7fdea4072b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde94009c20 tx=0x7fde9402c230 comp rx=0 tx=0).stop 2024-04-26T21:23:31.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 -- 172.21.15.55:0/1397108915 shutdown_connections 2024-04-26T21:23:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1397108915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea40730b0 0x7fdea4110960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1397108915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea4072790 0x7fdea4072b70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 -- 172.21.15.55:0/1397108915 >> 172.21.15.55:0/1397108915 conn(0x7fdea40fb980 msgr2=0x7fdea40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 -- 172.21.15.55:0/1397108915 shutdown_connections 2024-04-26T21:23:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.255+0000 7fdea3e00640 1 -- 172.21.15.55:0/1397108915 wait complete. 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 Processor -- start 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 -- start start 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea4072790 0x7fdea419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea419d260 con 0x7fdea40730b0 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.256+0000 7fdea3e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea41a0f70 con 0x7fdea4072790 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56180/0 (socket says 172.21.15.55:56180) 2024-04-26T21:23:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 -- 172.21.15.55:0/1646505918 learned_addr learned my addr 172.21.15.55:0/1646505918 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2a00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea4072790 0x7fdea419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 -- 172.21.15.55:0/1646505918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea4072790 msgr2=0x7fdea419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea4072790 0x7fdea419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 -- 172.21.15.55:0/1646505918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009900 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.257+0000 7fdea2000640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b420 tx=0x7fde8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.258+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c011800 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.258+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde8c011e20 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.258+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8c00f2e0 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.258+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea41a1250 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.258+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea41a17b0 con 0x7fdea40730b0 2024-04-26T21:23:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.259+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea4073ed0 con 0x7fdea40730b0 2024-04-26T21:23:31.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.260+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fde8c010380 con 0x7fdea40730b0 2024-04-26T21:23:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.261+0000 7fde9b400640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 0x7fde88071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.262+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fde8c08e8d0 con 0x7fdea40730b0 2024-04-26T21:23:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.262+0000 7fdea2a00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 0x7fde88071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.263+0000 7fdea2a00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 0x7fde88071110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde94006010 tx=0x7fde94032840 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.266+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fde8c057590 con 0x7fdea40730b0 2024-04-26T21:23:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.474+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdea404e9b0 con 0x7fdea40730b0 2024-04-26T21:23:31.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.476+0000 7fde9b400640 1 -- 172.21.15.55:0/1646505918 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16736 (secure 0 0 0) 0x7fde8c055e60 con 0x7fdea40730b0 2024-04-26T21:23:31.478 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:31.478 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:20:26.260042+0000","last_up_change":"2024-04-26T21:18:42.568192+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:03:56.593833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:03:57.521866+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6803","nonce":307437476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6805","nonce":307437476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6809","nonce":307437476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6807","nonce":307437476}]},"public_addr":"172.21.15.55:6803/307437476","cluster_addr":"172.21.15.55:6805/307437476","heartbeat_back_addr":"172.21.15.55:6809/307437476","heartbeat_front_addr":"172.21.15.55:6807/307437476","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6811","nonce":3666316230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6813","nonce":3666316230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6817","nonce":3666316230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6815","nonce":3666316230}]},"public_addr":"172.21.15.55:6811/3666316230","cluster_addr":"172.21.15.55:6813/3666316230","heartbeat_back_addr":"172.21.15.55:6817/3666316230","heartbeat_front_addr":"172.21.15.55:6815/3666316230","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6819","nonce":2146980962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6821","nonce":2146980962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6825","nonce":2146980962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6823","nonce":2146980962}]},"public_addr":"172.21.15.55:6819/2146980962","cluster_addr":"172.21.15.55:6821/2146980962","heartbeat_back_addr":"172.21.15.55:6825/2146980962","heartbeat_front_addr":"172.21.15.55:6823/2146980962","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6801","nonce":2708520812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6803","nonce":2708520812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6807","nonce":2708520812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6805","nonce":2708520812}]},"public_addr":"172.21.15.64:6801/2708520812","cluster_addr":"172.21.15.64:6803/2708520812","heartbeat_back_addr":"172.21.15.64:6807/2708520812","heartbeat_front_addr":"172.21.15.64:6805/2708520812","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6809","nonce":3376099307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6811","nonce":3376099307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6815","nonce":3376099307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6813","nonce":3376099307}]},"public_addr":"172.21.15.64:6809/3376099307","cluster_addr":"172.21.15.64:6811/3376099307","heartbeat_back_addr":"172.21.15.64:6815/3376099307","heartbeat_front_addr":"172.21.15.64:6813/3376099307","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6817","nonce":2282216695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6819","nonce":2282216695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6823","nonce":2282216695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6821","nonce":2282216695}]},"public_addr":"172.21.15.64:6817/2282216695","cluster_addr":"172.21.15.64:6819/2282216695","heartbeat_back_addr":"172.21.15.64:6823/2282216695","heartbeat_front_addr":"172.21.15.64:6821/2282216695","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6827/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.64:6826/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.55:6829/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6828/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6827/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3680986491":"2024-04-27T21:13:11.675470+0000","172.21.15.64:0/3692425588":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2020032469":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2401109697":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6826/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.64:0/1265976667":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6801/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2964479330":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/2338326874":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2401553078":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6800/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/108673769":"2024-04-27T21:06:59.742397+0000","172.21.15.64:0/359559082":"2024-04-27T21:08:25.366623+0000","172.21.15.64:6829/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.64:6828/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3943565490":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/1497600698":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.64:0/3627849680":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:0/218375879":"2024-04-27T21:13:11.675470+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.479+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 msgr2=0x7fde88071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.479+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 0x7fde88071110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde94006010 tx=0x7fde94032840 comp rx=0 tx=0).stop 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.479+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 msgr2=0x7fdea419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.479+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b420 tx=0x7fde8c00b8e0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 shutdown_connections 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fde8806ec50 0x7fde88071110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea40730b0 0x7fdea419cbd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 --2- 172.21.15.55:0/1646505918 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdea4072790 0x7fdea419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 >> 172.21.15.55:0/1646505918 conn(0x7fdea40fb980 msgr2=0x7fdea40ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 shutdown_connections 2024-04-26T21:23:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.480+0000 7fdea3e00640 1 -- 172.21.15.55:0/1646505918 wait complete. 2024-04-26T21:23:31.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:00:32.215135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:03:56.593833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:03:57.521866+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:23:31.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:23:31.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:31 smithi064 ceph-mon[84240]: pgmap v348: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 -- 172.21.15.55:0/3540334449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 msgr2=0x7fcd541069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 --2- 172.21.15.55:0/3540334449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd541069d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009880 tx=0x7fcd4002bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 -- 172.21.15.55:0/3540334449 shutdown_connections 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 --2- 172.21.15.55:0/3540334449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd541069d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 --2- 172.21.15.55:0/3540334449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 0x7fcd5410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 -- 172.21.15.55:0/3540334449 >> 172.21.15.55:0/3540334449 conn(0x7fcd54075cb0 msgr2=0x7fcd540780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 -- 172.21.15.55:0/3540334449 shutdown_connections 2024-04-26T21:23:31.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.726+0000 7fcd53200640 1 -- 172.21.15.55:0/3540334449 wait complete. 2024-04-26T21:23:31.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.727+0000 7fcd53200640 1 Processor -- start 2024-04-26T21:23:31.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd53200640 1 -- start start 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd53200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd53200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 0x7fcd5419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd53200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419d010 con 0x7fcd54106550 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd53200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419d180 con 0x7fcd5410c5c0 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd51e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56196/0 (socket says 172.21.15.55:56196) 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.728+0000 7fcd51e00640 1 -- 172.21.15.55:0/3254849612 learned_addr learned my addr 172.21.15.55:0/3254849612 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd51400640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 0x7fcd5419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd51e00640 1 -- 172.21.15.55:0/3254849612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 msgr2=0x7fcd5419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd51e00640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 0x7fcd5419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd51e00640 1 -- 172.21.15.55:0/3254849612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009560 con 0x7fcd54106550 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd51e00640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c8a0 tx=0x7fcd4400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd44007b80 con 0x7fcd54106550 2024-04-26T21:23:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd44007ce0 con 0x7fcd54106550 2024-04-26T21:23:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd541a0f50 con 0x7fcd54106550 2024-04-26T21:23:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.729+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd44018810 con 0x7fcd54106550 2024-04-26T21:23:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.730+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd541a1530 con 0x7fcd54106550 2024-04-26T21:23:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.731+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54107c20 con 0x7fcd54106550 2024-04-26T21:23:31.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.732+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcd44018970 con 0x7fcd54106550 2024-04-26T21:23:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.733+0000 7fcd4aa00640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 0x7fcd38071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.733+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcd4408f0d0 con 0x7fcd54106550 2024-04-26T21:23:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.733+0000 7fcd51400640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 0x7fcd38071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:31.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.734+0000 7fcd51400640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 0x7fcd38071100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd5419da20 tx=0x7fcd40000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.738+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fcd44057e10 con 0x7fcd54106550 2024-04-26T21:23:31.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:31 smithi055 ceph-mon[109028]: pgmap v348: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.935+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd5410e9d0 con 0x7fcd54106550 2024-04-26T21:23:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.936+0000 7fcd4aa00640 1 -- 172.21.15.55:0/3254849612 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd4405b4d0 con 0x7fcd54106550 2024-04-26T21:23:31.937 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 msgr2=0x7fcd38071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 0x7fcd38071100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd5419da20 tx=0x7fcd40000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 msgr2=0x7fcd5419c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400c8a0 tx=0x7fcd4400cd60 comp rx=0 tx=0).stop 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 shutdown_connections 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd5410c5c0 0x7fcd5419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcd3806ec40 0x7fcd38071100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 --2- 172.21.15.55:0/3254849612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd54106550 0x7fcd5419c4d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.938+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 >> 172.21.15.55:0/3254849612 conn(0x7fcd54075cb0 msgr2=0x7fcd5410b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.939+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 shutdown_connections 2024-04-26T21:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:31.939+0000 7fcd53200640 1 -- 172.21.15.55:0/3254849612 wait complete. 2024-04-26T21:23:31.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 -- 172.21.15.55:0/2018973810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8100675f0 msgr2=0x7fd8100679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 --2- 172.21.15.55:0/2018973810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8100675f0 0x7fd8100679d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd800009880 tx=0x7fd80002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 -- 172.21.15.55:0/2018973810 shutdown_connections 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 --2- 172.21.15.55:0/2018973810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd810067fa0 0x7fd810104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 --2- 172.21.15.55:0/2018973810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8100675f0 0x7fd8100679d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 -- 172.21.15.55:0/2018973810 >> 172.21.15.55:0/2018973810 conn(0x7fd810074910 msgr2=0x7fd810074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 -- 172.21.15.55:0/2018973810 shutdown_connections 2024-04-26T21:23:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.154+0000 7fd816000640 1 -- 172.21.15.55:0/2018973810 wait complete. 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.155+0000 7fd816000640 1 Processor -- start 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.155+0000 7fd816000640 1 -- start start 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd816000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8100675f0 0x7fd810195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd816000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd816000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810196aa0 con 0x7fd8101964a0 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd816000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810196c10 con 0x7fd8100675f0 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56208/0 (socket says 172.21.15.55:56208) 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 -- 172.21.15.55:0/1352719903 learned_addr learned my addr 172.21.15.55:0/1352719903 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd814c00640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8100675f0 0x7fd810195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 -- 172.21.15.55:0/1352719903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8100675f0 msgr2=0x7fd810195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8100675f0 0x7fd810195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.156+0000 7fd80fe00640 1 -- 172.21.15.55:0/1352719903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009560 con 0x7fd8101964a0 2024-04-26T21:23:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd80fe00640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800cc90 tx=0x7fd7f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f8004b20 con 0x7fd8101964a0 2024-04-26T21:23:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81019ae40 con 0x7fd8101964a0 2024-04-26T21:23:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7f8004c80 con 0x7fd8101964a0 2024-04-26T21:23:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f800f680 con 0x7fd8101964a0 2024-04-26T21:23:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.157+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81019b3a0 con 0x7fd8101964a0 2024-04-26T21:23:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.158+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81019b680 con 0x7fd8101964a0 2024-04-26T21:23:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.160+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd7f8005020 con 0x7fd8101964a0 2024-04-26T21:23:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.161+0000 7fd80d600640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 0x7fd7f0071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.161+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd7f808f130 con 0x7fd8101964a0 2024-04-26T21:23:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.161+0000 7fd814c00640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 0x7fd7f0071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.162+0000 7fd814c00640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 0x7fd7f0071100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd800036040 tx=0x7fd80002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.167+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd7f8057df0 con 0x7fd8101964a0 2024-04-26T21:23:32.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.372+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fd810197260 con 0x7fd8101964a0 2024-04-26T21:23:32.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.373+0000 7fd80d600640 1 -- 172.21.15.55:0/1352719903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd7f805b4b0 con 0x7fd8101964a0 2024-04-26T21:23:32.374 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 msgr2=0x7fd7f0071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 0x7fd7f0071100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd800036040 tx=0x7fd80002cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 msgr2=0x7fd81019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800cc90 tx=0x7fd7f800a620 comp rx=0 tx=0).stop 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 shutdown_connections 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd7f006ec40 0x7fd7f0071100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8101964a0 0x7fd81019a840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 --2- 172.21.15.55:0/1352719903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8100675f0 0x7fd810195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.375+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 >> 172.21.15.55:0/1352719903 conn(0x7fd810074910 msgr2=0x7fd810103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:32.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.376+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 shutdown_connections 2024-04-26T21:23:32.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.376+0000 7fd816000640 1 -- 172.21.15.55:0/1352719903 wait complete. 2024-04-26T21:23:32.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:23:32.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 -- 172.21.15.55:0/285822735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 msgr2=0x7f22741026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 --2- 172.21.15.55:0/285822735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f22741026d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2264009c20 tx=0x7f226402c1b0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 -- 172.21.15.55:0/285822735 shutdown_connections 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 --2- 172.21.15.55:0/285822735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2274102ca0 0x7f2274106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 --2- 172.21.15.55:0/285822735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f22741026d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 -- 172.21.15.55:0/285822735 >> 172.21.15.55:0/285822735 conn(0x7f22740fdb70 msgr2=0x7f22740fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 -- 172.21.15.55:0/285822735 shutdown_connections 2024-04-26T21:23:32.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.610+0000 7f2278e00640 1 -- 172.21.15.55:0/285822735 wait complete. 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.611+0000 7f2278e00640 1 Processor -- start 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.611+0000 7f2278e00640 1 -- start start 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2278e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2278e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22741986c0 0x7f227419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2278e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274198cc0 con 0x7f22741022f0 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2278e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274198e30 con 0x7f22741986c0 2024-04-26T21:23:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2273400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2273400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56220/0 (socket says 172.21.15.55:56220) 2024-04-26T21:23:32.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2273400640 1 -- 172.21.15.55:0/2082828724 learned_addr learned my addr 172.21.15.55:0/2082828724 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.612+0000 7f2272a00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22741986c0 0x7f227419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2273400640 1 -- 172.21.15.55:0/2082828724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22741986c0 msgr2=0x7f227419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2273400640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22741986c0 0x7f227419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2273400640 1 -- 172.21.15.55:0/2082828724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264009900 con 0x7f22741022f0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2273400640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2264037040 tx=0x7f2264032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2264032790 con 0x7f22741022f0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2264003e30 con 0x7f22741022f0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226403f440 con 0x7f22741022f0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227419cfb0 con 0x7f22741022f0 2024-04-26T21:23:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.613+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227419d510 con 0x7f22741022f0 2024-04-26T21:23:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.615+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22741037c0 con 0x7f22741022f0 2024-04-26T21:23:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.616+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f226403b040 con 0x7f22741022f0 2024-04-26T21:23:32.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.617+0000 7f226be00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 0x7f2258071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:32.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.617+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f22640b1540 con 0x7f22741022f0 2024-04-26T21:23:32.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.617+0000 7f2272a00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 0x7f2258071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:32.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.618+0000 7f2272a00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 0x7f2258071100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f225c0058c0 tx=0x7f225c00a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:32.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.622+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f226407a280 con 0x7f22741022f0 2024-04-26T21:23:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:32 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1646505918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:32.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:32 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3254849612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:32.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:32 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1646505918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:32 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3254849612' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:32.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.821+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f227419d780 con 0x7f22741022f0 2024-04-26T21:23:32.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.822+0000 7f226be00640 1 -- 172.21.15.55:0/2082828724 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f226407d940 con 0x7f22741022f0 2024-04-26T21:23:32.824 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:32.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 msgr2=0x7f2258071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 0x7f2258071100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f225c0058c0 tx=0x7f225c00a4c0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 msgr2=0x7f2274198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:32.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2264037040 tx=0x7f2264032570 comp rx=0 tx=0).stop 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 shutdown_connections 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22741986c0 0x7f227419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f225806ec40 0x7f2258071100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 --2- 172.21.15.55:0/2082828724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22741022f0 0x7f2274198180 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 >> 172.21.15.55:0/2082828724 conn(0x7f22740fdb70 msgr2=0x7f2274105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 shutdown_connections 2024-04-26T21:23:32.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:32.825+0000 7f2278e00640 1 -- 172.21.15.55:0/2082828724 wait complete. 2024-04-26T21:23:32.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.052+0000 7f0ae2600640 1 -- 172.21.15.55:0/1506663886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 msgr2=0x7f0adc110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.052+0000 7f0ae2600640 1 --2- 172.21.15.55:0/1506663886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc110980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009880 tx=0x7f0ac802bd70 comp rx=0 tx=0).stop 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 -- 172.21.15.55:0/1506663886 shutdown_connections 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 --2- 172.21.15.55:0/1506663886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc110980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 --2- 172.21.15.55:0/1506663886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc072b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 -- 172.21.15.55:0/1506663886 >> 172.21.15.55:0/1506663886 conn(0x7f0adc0fb9a0 msgr2=0x7f0adc0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:33.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 -- 172.21.15.55:0/1506663886 shutdown_connections 2024-04-26T21:23:33.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.053+0000 7f0ae2600640 1 -- 172.21.15.55:0/1506663886 wait complete. 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 Processor -- start 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 -- start start 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc19d120 con 0x7f0adc0730b0 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.054+0000 7f0ae2600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1a0e30 con 0x7f0adc072790 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56250/0 (socket says 172.21.15.55:56250) 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 -- 172.21.15.55:0/2708824928 learned_addr learned my addr 172.21.15.55:0/2708824928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:33.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0ae1200640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 -- 172.21.15.55:0/2708824928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 msgr2=0x7f0adc19c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc19c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 -- 172.21.15.55:0/2708824928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8009560 con 0x7f0adc0730b0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0ae1200640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.055+0000 7f0adbe00640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8036040 tx=0x7f0ac802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.056+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac80044a0 con 0x7f0adc0730b0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.056+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ac8003ab0 con 0x7f0adc0730b0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.056+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc1a10b0 con 0x7f0adc0730b0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.056+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac8005590 con 0x7f0adc0730b0 2024-04-26T21:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.056+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc1a1610 con 0x7f0adc0730b0 2024-04-26T21:23:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.057+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc073ed0 con 0x7f0adc0730b0 2024-04-26T21:23:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.058+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ac8004dd0 con 0x7f0adc0730b0 2024-04-26T21:23:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.059+0000 7f0ad9600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 0x7f0ac0071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.059+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0ac80b1950 con 0x7f0adc0730b0 2024-04-26T21:23:33.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.059+0000 7f0ae1200640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 0x7f0ac0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.060+0000 7f0ae1200640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 0x7f0ac0071110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005fd0 tx=0x7f0acc0093e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:33.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.064+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0ac807a730 con 0x7f0adc0730b0 2024-04-26T21:23:33.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.312+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0adc04e9b0 con 0x7f0adc0730b0 2024-04-26T21:23:33.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.313+0000 7f0ad9600640 1 -- 172.21.15.55:0/2708824928 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5212 (secure 0 0 0) 0x7f0ac807ddf0 con 0x7f0adc0730b0 2024-04-26T21:23:33.315 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:33.315 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:21:23.458473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:active","state_seq":25,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34494":{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34462,"qdb_cluster":[34462]},"id":1}]} 2024-04-26T21:23:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 38 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 msgr2=0x7f0ac0071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 0x7f0ac0071110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005fd0 tx=0x7f0acc0093e0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 msgr2=0x7f0adc19ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8036040 tx=0x7f0ac802c850 comp rx=0 tx=0).stop 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 shutdown_connections 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ac006ec50 0x7f0ac0071110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0adc0730b0 0x7f0adc19ca90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 --2- 172.21.15.55:0/2708824928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0adc072790 0x7f0adc19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 >> 172.21.15.55:0/2708824928 conn(0x7f0adc0fb9a0 msgr2=0x7f0adc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 shutdown_connections 2024-04-26T21:23:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.317+0000 7f0ae2600640 1 -- 172.21.15.55:0/2708824928 wait complete. 2024-04-26T21:23:33.338 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 1, 'flags': 50} 2024-04-26T21:23:33.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-04-26T21:23:33.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 -- 172.21.15.55:0/1367067626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 msgr2=0x7f383c10c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 --2- 172.21.15.55:0/1367067626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c10c9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3834009880 tx=0x7f383402bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 -- 172.21.15.55:0/1367067626 shutdown_connections 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 --2- 172.21.15.55:0/1367067626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 0x7f383c1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 --2- 172.21.15.55:0/1367067626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c10c9a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 -- 172.21.15.55:0/1367067626 >> 172.21.15.55:0/1367067626 conn(0x7f383c075cb0 msgr2=0x7f383c0780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 -- 172.21.15.55:0/1367067626 shutdown_connections 2024-04-26T21:23:33.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.565+0000 7f383b200640 1 -- 172.21.15.55:0/1367067626 wait complete. 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 Processor -- start 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 -- start start 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 0x7f383c19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c19d0a0 con 0x7f383c10c5c0 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.566+0000 7f383b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c1a0db0 con 0x7f383c106550 2024-04-26T21:23:33.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56262/0 (socket says 172.21.15.55:56262) 2024-04-26T21:23:33.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 -- 172.21.15.55:0/3114014424 learned_addr learned my addr 172.21.15.55:0/3114014424 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:33.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839e00640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 0x7f383c19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 -- 172.21.15.55:0/3114014424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 msgr2=0x7f383c19c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 0x7f383c19c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.567+0000 7f3839400640 1 -- 172.21.15.55:0/3114014424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834009560 con 0x7f383c10c5c0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f3839400640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f382400c810 tx=0x7f382400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38240041f0 con 0x7f383c10c5c0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3824007e70 con 0x7f383c10c5c0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38240049d0 con 0x7f383c10c5c0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c1a1090 con 0x7f383c10c5c0 2024-04-26T21:23:33.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.568+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c1a1670 con 0x7f383c10c5c0 2024-04-26T21:23:33.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.570+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c107c20 con 0x7f383c10c5c0 2024-04-26T21:23:33.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.571+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f38240079b0 con 0x7f383c10c5c0 2024-04-26T21:23:33.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.572+0000 7f3832a00640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 0x7f3820071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:33.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.572+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f382408ec90 con 0x7f383c10c5c0 2024-04-26T21:23:33.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.572+0000 7f3839e00640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 0x7f3820071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:33.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.573+0000 7f3839e00640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 0x7f3820071100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3834000c00 tx=0x7f383402cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:33.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.577+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f38240579d0 con 0x7f383c10c5c0 2024-04-26T21:23:33.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:33 smithi064 ceph-mon[84240]: pgmap v349: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:33 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1352719903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:33 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2082828724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:33.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:33 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2708824928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:23:33.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:33 smithi055 ceph-mon[109028]: pgmap v349: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:33.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:33 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1352719903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:33.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:33 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2082828724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:33.756 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:33 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2708824928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T21:23:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.821+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f383c10e9d0 con 0x7f383c10c5c0 2024-04-26T21:23:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.823+0000 7f3832a00640 1 -- 172.21.15.55:0/3114014424 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v38) v1 ==== 107+0+4860 (secure 0 0 0) 0x7f382401d090 con 0x7f383c10c5c0 2024-04-26T21:23:33.824 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:33.824 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:04:19.278071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14466":{"gid":14466,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6827/2158832788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2158832788},{"type":"v1","addr":"172.21.15.55:6827","nonce":2158832788}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi064.ukvnjs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":4,"addr":"172.21.15.64:6825/1419129911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1419129911},{"type":"v1","addr":"172.21.15.64:6825","nonce":1419129911}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 msgr2=0x7f3820071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 0x7f3820071100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3834000c00 tx=0x7f383402cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 msgr2=0x7f383c19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f382400c810 tx=0x7f382400ccd0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 shutdown_connections 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f382006ec40 0x7f3820071100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c10c5c0 0x7f383c19ca10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 --2- 172.21.15.55:0/3114014424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c106550 0x7f383c19c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.825+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 >> 172.21.15.55:0/3114014424 conn(0x7f383c075cb0 msgr2=0x7f383c10b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.826+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 shutdown_connections 2024-04-26T21:23:33.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:33.826+0000 7f383b200640 1 -- 172.21.15.55:0/3114014424 wait complete. 2024-04-26T21:23:33.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-04-26T21:23:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.056+0000 7faabbe00640 1 -- 172.21.15.55:0/4293419027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 msgr2=0x7faabc1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.056+0000 7faabbe00640 1 --2- 172.21.15.55:0/4293419027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc1069d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009880 tx=0x7faaa402bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 -- 172.21.15.55:0/4293419027 shutdown_connections 2024-04-26T21:23:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 --2- 172.21.15.55:0/4293419027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc1069d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 --2- 172.21.15.55:0/4293419027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc10c5c0 0x7faabc10c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 -- 172.21.15.55:0/4293419027 >> 172.21.15.55:0/4293419027 conn(0x7faabc075cb0 msgr2=0x7faabc0780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 -- 172.21.15.55:0/4293419027 shutdown_connections 2024-04-26T21:23:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.057+0000 7faabbe00640 1 -- 172.21.15.55:0/4293419027 wait complete. 2024-04-26T21:23:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 Processor -- start 2024-04-26T21:23:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 -- start start 2024-04-26T21:23:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc10c5c0 0x7faabc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc19d0c0 con 0x7faabc106550 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabbe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1a0dd0 con 0x7faabc10c5c0 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.058+0000 7faabaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56280/0 (socket says 172.21.15.55:56280) 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 -- 172.21.15.55:0/268297832 learned_addr learned my addr 172.21.15.55:0/268297832 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 -- 172.21.15.55:0/268297832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc10c5c0 msgr2=0x7faabc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc10c5c0 0x7faabc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 -- 172.21.15.55:0/268297832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4009560 con 0x7faabc106550 2024-04-26T21:23:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faabaa00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d6f0 tx=0x7faaac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.059+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaac009a30 con 0x7faabc106550 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.060+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faaac0054e0 con 0x7faabc106550 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.060+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaac010460 con 0x7faabc106550 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.060+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc1a10b0 con 0x7faabc106550 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.060+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc1a1690 con 0x7faabc106550 2024-04-26T21:23:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.061+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc107c20 con 0x7faabc106550 2024-04-26T21:23:34.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.062+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faaac009b90 con 0x7faabc106550 2024-04-26T21:23:34.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.063+0000 7faab3400640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 0x7faaa0071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.063+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faaac08ea40 con 0x7faabc106550 2024-04-26T21:23:34.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.063+0000 7faab3e00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 0x7faaa0071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:34.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.064+0000 7faab3e00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 0x7faaa0071100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faaa402efd0 tx=0x7faaa4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:34.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.069+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7faaac057780 con 0x7faabc106550 2024-04-26T21:23:34.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.317+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7faabc10ea70 con 0x7faabc106550 2024-04-26T21:23:34.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.320+0000 7faab3400640 1 -- 172.21.15.55:0/268297832 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v38) v1 ==== 107+0+4084 (secure 0 0 0) 0x7faaac017090 con 0x7faabc106550 2024-04-26T21:23:34.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:34.320 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:18:49.787116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14466":{"gid":14466,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6827/2158832788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2158832788},{"type":"v1","addr":"172.21.15.55:6827","nonce":2158832788}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14466,"qdb_cluster":[14466]},"id":1}]} 2024-04-26T21:23:34.321 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 14 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.321+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 msgr2=0x7faaa0071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.321+0000 7faabbe00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 0x7faaa0071100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faaa402efd0 tx=0x7faaa4000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.321+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 msgr2=0x7faabc19c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.321+0000 7faabbe00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faaac00d6f0 tx=0x7faaac00dbb0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.321+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 shutdown_connections 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faabc10c5c0 0x7faabc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faaa006ec40 0x7faaa0071100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 --2- 172.21.15.55:0/268297832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faabc106550 0x7faabc19c4f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 >> 172.21.15.55:0/268297832 conn(0x7faabc075cb0 msgr2=0x7faabc10b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:34.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 shutdown_connections 2024-04-26T21:23:34.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.322+0000 7faabbe00640 1 -- 172.21.15.55:0/268297832 wait complete. 2024-04-26T21:23:34.344 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 14 2024-04-26T21:23:34.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.549+0000 7f74f3800640 1 -- 172.21.15.55:0/1321639884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101b40 msgr2=0x7f74ec10a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.549+0000 7f74f3800640 1 --2- 172.21.15.55:0/1321639884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101b40 0x7f74ec10a020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009880 tx=0x7f74d402bd70 comp rx=0 tx=0).stop 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 -- 172.21.15.55:0/1321639884 shutdown_connections 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 --2- 172.21.15.55:0/1321639884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101b40 0x7f74ec10a020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 --2- 172.21.15.55:0/1321639884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101220 0x7f74ec101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 -- 172.21.15.55:0/1321639884 >> 172.21.15.55:0/1321639884 conn(0x7f74ec0faa40 msgr2=0x7f74ec0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:34.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 -- 172.21.15.55:0/1321639884 shutdown_connections 2024-04-26T21:23:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.550+0000 7f74f3800640 1 -- 172.21.15.55:0/1321639884 wait complete. 2024-04-26T21:23:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.551+0000 7f74f3800640 1 Processor -- start 2024-04-26T21:23:34.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.551+0000 7f74f3800640 1 -- start start 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.551+0000 7f74f3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.551+0000 7f74f3800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101b40 0x7f74ec198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec198ed0 con 0x7f74ec101220 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f3800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec19cbe0 con 0x7f74ec101b40 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56306/0 (socket says 172.21.15.55:56306) 2024-04-26T21:23:34.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 -- 172.21.15.55:0/89220453 learned_addr learned my addr 172.21.15.55:0/89220453 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74ebe00640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101b40 0x7f74ec198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 -- 172.21.15.55:0/89220453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101b40 msgr2=0x7f74ec198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101b40 0x7f74ec198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.552+0000 7f74f0e00640 1 -- 172.21.15.55:0/89220453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4009560 con 0x7f74ec101220 2024-04-26T21:23:34.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74f0e00640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00ea00 tx=0x7f74dc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc00cd50 con 0x7f74ec101220 2024-04-26T21:23:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec19cec0 con 0x7f74ec101220 2024-04-26T21:23:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74dc005020 con 0x7f74ec101220 2024-04-26T21:23:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc0116a0 con 0x7f74ec101220 2024-04-26T21:23:34.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.553+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec19d420 con 0x7f74ec101220 2024-04-26T21:23:34.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.555+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec068de0 con 0x7f74ec101220 2024-04-26T21:23:34.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.556+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f74dc005190 con 0x7f74ec101220 2024-04-26T21:23:34.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.557+0000 7f74e9600640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 0x7f74d00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:34.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.559+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f74dc08f270 con 0x7f74ec101220 2024-04-26T21:23:34.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.559+0000 7f74ebe00640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 0x7f74d00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:34.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.560+0000 7f74ebe00640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 0x7f74d00710f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74ec199850 tx=0x7f74d4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:34.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.563+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f74dc057fd0 con 0x7f74ec101220 2024-04-26T21:23:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:34 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3114014424' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-26T21:23:34.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:34 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/268297832' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-26T21:23:34.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:34 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3114014424' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-26T21:23:34.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:34 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/268297832' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-26T21:23:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.813+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f74ec04e160 con 0x7f74ec101220 2024-04-26T21:23:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.815+0000 7f74e9600640 1 -- 172.21.15.55:0/89220453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v38) v1 ==== 107+0+4863 (secure 0 0 0) 0x7f74dc07ae60 con 0x7f74ec101220 2024-04-26T21:23:34.815 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:34.815 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:18:49.787116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14466":{"gid":14466,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6827/2158832788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2158832788},{"type":"v1","addr":"172.21.15.55:6827","nonce":2158832788}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14466,"qdb_cluster":[14466]},"id":1}]} 2024-04-26T21:23:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 msgr2=0x7f74d00710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 0x7f74d00710f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f74ec199850 tx=0x7f74d4000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 msgr2=0x7f74ec198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00ea00 tx=0x7f74dc00eec0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 shutdown_connections 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74ec101b40 0x7f74ec198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f74d006ec30 0x7f74d00710f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 --2- 172.21.15.55:0/89220453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74ec101220 0x7f74ec198300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.817+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 >> 172.21.15.55:0/89220453 conn(0x7f74ec0faa40 msgr2=0x7f74ec100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.818+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 shutdown_connections 2024-04-26T21:23:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:34.818+0000 7f74f3800640 1 -- 172.21.15.55:0/89220453 wait complete. 2024-04-26T21:23:34.837 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 15 2024-04-26T21:23:34.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 -- 172.21.15.55:0/1565467366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 msgr2=0x7fcb3010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/1565467366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3010c9a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009880 tx=0x7fcb2002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 -- 172.21.15.55:0/1565467366 shutdown_connections 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/1565467366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 0x7fcb301069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/1565467366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3010c9a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.105+0000 7fcb2fe00640 1 -- 172.21.15.55:0/1565467366 >> 172.21.15.55:0/1565467366 conn(0x7fcb30075cb0 msgr2=0x7fcb300780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.106+0000 7fcb2fe00640 1 -- 172.21.15.55:0/1565467366 shutdown_connections 2024-04-26T21:23:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.106+0000 7fcb2fe00640 1 -- 172.21.15.55:0/1565467366 wait complete. 2024-04-26T21:23:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.107+0000 7fcb2fe00640 1 Processor -- start 2024-04-26T21:23:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.107+0000 7fcb2fe00640 1 -- start start 2024-04-26T21:23:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.107+0000 7fcb2fe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 0x7fcb3019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3019d0c0 con 0x7fcb3010c5c0 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2fe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301a0dd0 con 0x7fcb30106550 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38512/0 (socket says 172.21.15.55:38512) 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 -- 172.21.15.55:0/3686444924 learned_addr learned my addr 172.21.15.55:0/3686444924 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2ea00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 0x7fcb3019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 -- 172.21.15.55:0/3686444924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 msgr2=0x7fcb3019c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 0x7fcb3019c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.108+0000 7fcb2e000640 1 -- 172.21.15.55:0/3686444924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009560 con 0x7fcb3010c5c0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb2e000640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00c8f0 tx=0x7fcb1c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1c007b80 con 0x7fcb3010c5c0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb1c0054e0 con 0x7fcb3010c5c0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb301a10b0 con 0x7fcb3010c5c0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1c00f450 con 0x7fcb3010c5c0 2024-04-26T21:23:35.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.109+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb301a1690 con 0x7fcb3010c5c0 2024-04-26T21:23:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.110+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb30107c20 con 0x7fcb3010c5c0 2024-04-26T21:23:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.112+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcb1c004f60 con 0x7fcb3010c5c0 2024-04-26T21:23:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.113+0000 7fcb27400640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 0x7fcb14071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.113+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcb1c08edb0 con 0x7fcb3010c5c0 2024-04-26T21:23:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.114+0000 7fcb2ea00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 0x7fcb14071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.114+0000 7fcb2ea00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 0x7fcb14071100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb2002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.119+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fcb1c057a70 con 0x7fcb3010c5c0 2024-04-26T21:23:35.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.376+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fcb3004e9b0 con 0x7fcb3010c5c0 2024-04-26T21:23:35.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.377+0000 7fcb27400640 1 -- 172.21.15.55:0/3686444924 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v38) v1 ==== 107+0+4066 (secure 0 0 0) 0x7fcb1c05b130 con 0x7fcb3010c5c0 2024-04-26T21:23:35.378 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:35.378 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:18:56.003806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 16 2024-04-26T21:23:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 msgr2=0x7fcb14071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 0x7fcb14071100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb2002cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 msgr2=0x7fcb3019ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00c8f0 tx=0x7fcb1c00cdb0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 shutdown_connections 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fcb1406ec40 0x7fcb14071100 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb3010c5c0 0x7fcb3019ca30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 --2- 172.21.15.55:0/3686444924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb30106550 0x7fcb3019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 >> 172.21.15.55:0/3686444924 conn(0x7fcb30075cb0 msgr2=0x7fcb3010b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 shutdown_connections 2024-04-26T21:23:35.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.381+0000 7fcb2fe00640 1 -- 172.21.15.55:0/3686444924 wait complete. 2024-04-26T21:23:35.400 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-04-26T21:23:35.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 -- 172.21.15.55:0/1379246728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4964067fa0 msgr2=0x7f4964104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 --2- 172.21.15.55:0/1379246728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4964067fa0 0x7f4964104af0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4950009880 tx=0x7f495002bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 -- 172.21.15.55:0/1379246728 shutdown_connections 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 --2- 172.21.15.55:0/1379246728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4964067fa0 0x7f4964104af0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 --2- 172.21.15.55:0/1379246728 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 0x7f49640679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 -- 172.21.15.55:0/1379246728 >> 172.21.15.55:0/1379246728 conn(0x7f4964074910 msgr2=0x7f4964074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 -- 172.21.15.55:0/1379246728 shutdown_connections 2024-04-26T21:23:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.614+0000 7f4963e00640 1 -- 172.21.15.55:0/1379246728 wait complete. 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.615+0000 7f4963e00640 1 Processor -- start 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.615+0000 7f4963e00640 1 -- start start 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4963e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 0x7f4964196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4963e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4963e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964196bc0 con 0x7f49641965c0 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4963e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964196d30 con 0x7f49640675f0 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4962000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4962000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38536/0 (socket says 172.21.15.55:38536) 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4962000640 1 -- 172.21.15.55:0/16424185 learned_addr learned my addr 172.21.15.55:0/16424185 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.616+0000 7f4962a00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 0x7f4964196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4962000640 1 -- 172.21.15.55:0/16424185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 msgr2=0x7f4964196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4962000640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 0x7f4964196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4962000640 1 -- 172.21.15.55:0/16424185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009560 con 0x7f49641965c0 2024-04-26T21:23:35.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4962000640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f495002ceb0 tx=0x7f495002c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:35.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49500035f0 con 0x7f49641965c0 2024-04-26T21:23:35.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496419af60 con 0x7f49641965c0 2024-04-26T21:23:35.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4950003c10 con 0x7f49641965c0 2024-04-26T21:23:35.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.617+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4950005690 con 0x7f49641965c0 2024-04-26T21:23:35.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.618+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496419b4c0 con 0x7f49641965c0 2024-04-26T21:23:35.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.619+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49641015d0 con 0x7f49641965c0 2024-04-26T21:23:35.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.620+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4950004ed0 con 0x7f49641965c0 2024-04-26T21:23:35.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.621+0000 7f4968a00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 0x7f49480710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:35.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.621+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f49500b12c0 con 0x7f49641965c0 2024-04-26T21:23:35.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.621+0000 7f4962a00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 0x7f49480710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:35.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.622+0000 7f4962a00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 0x7f49480710a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4954009890 tx=0x7f4954008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:35.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.626+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f4950079f80 con 0x7f49641965c0 2024-04-26T21:23:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:35 smithi064 ceph-mon[84240]: pgmap v350: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:35.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:35 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/89220453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-26T21:23:35.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:35 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3686444924' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-26T21:23:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:35 smithi055 ceph-mon[109028]: pgmap v350: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:35 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/89220453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-26T21:23:35.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:35 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3686444924' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-26T21:23:35.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.876+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f49640008d0 con 0x7f49641965c0 2024-04-26T21:23:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.877+0000 7f4968a00640 1 -- 172.21.15.55:0/16424185 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v38) v1 ==== 107+0+4077 (secure 0 0 0) 0x7f495007d640 con 0x7f49641965c0 2024-04-26T21:23:35.878 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:35.878 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:18:56.016922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":17,"state":"up:replay","state_seq":3,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:35.878 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-26T21:23:35.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.880+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 msgr2=0x7f49480710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.880+0000 7f4963e00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 0x7f49480710a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4954009890 tx=0x7f4954008040 comp rx=0 tx=0).stop 2024-04-26T21:23:35.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 msgr2=0x7f496419a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f495002ceb0 tx=0x7f495002c7d0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 shutdown_connections 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f494806ebe0 0x7f49480710a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49641965c0 0x7f496419a960 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 --2- 172.21.15.55:0/16424185 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49640675f0 0x7f4964196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 >> 172.21.15.55:0/16424185 conn(0x7f4964074910 msgr2=0x7f4964103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 shutdown_connections 2024-04-26T21:23:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:35.881+0000 7f4963e00640 1 -- 172.21.15.55:0/16424185 wait complete. 2024-04-26T21:23:35.902 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-04-26T21:23:35.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-26T21:23:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.114+0000 7f5936600640 1 -- 172.21.15.55:0/2681223834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930067fa0 msgr2=0x7f5930104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.114+0000 7f5936600640 1 --2- 172.21.15.55:0/2681223834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930067fa0 0x7f5930104af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5920009c20 tx=0x7f592002c1b0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 -- 172.21.15.55:0/2681223834 shutdown_connections 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 --2- 172.21.15.55:0/2681223834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930067fa0 0x7f5930104af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 --2- 172.21.15.55:0/2681223834 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 0x7f59300679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 -- 172.21.15.55:0/2681223834 >> 172.21.15.55:0/2681223834 conn(0x7f5930074910 msgr2=0x7f5930074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 -- 172.21.15.55:0/2681223834 shutdown_connections 2024-04-26T21:23:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.115+0000 7f5936600640 1 -- 172.21.15.55:0/2681223834 wait complete. 2024-04-26T21:23:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 Processor -- start 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 -- start start 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 0x7f59301981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930198d10 con 0x7f5930198710 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.116+0000 7f5936600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930198e80 con 0x7f59300675f0 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38550/0 (socket says 172.21.15.55:38550) 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 -- 172.21.15.55:0/3553900207 learned_addr learned my addr 172.21.15.55:0/3553900207 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f5935200640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 0x7f59301981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 -- 172.21.15.55:0/3553900207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 msgr2=0x7f59301981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 0x7f59301981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.117+0000 7f592fe00640 1 -- 172.21.15.55:0/3553900207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009900 con 0x7f5930198710 2024-04-26T21:23:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f592fe00640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5920000f80 tx=0x7f5920032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5920034610 con 0x7f5930198710 2024-04-26T21:23:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593019d000 con 0x7f5930198710 2024-04-26T21:23:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5920003e30 con 0x7f5930198710 2024-04-26T21:23:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59200047a0 con 0x7f5930198710 2024-04-26T21:23:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.118+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593019d560 con 0x7f5930198710 2024-04-26T21:23:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.119+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59301015d0 con 0x7f5930198710 2024-04-26T21:23:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.120+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f592003b040 con 0x7f5930198710 2024-04-26T21:23:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.121+0000 7f592d600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 0x7f5914071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.121+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f59200b1a90 con 0x7f5930198710 2024-04-26T21:23:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.122+0000 7f5935200640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 0x7f5914071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:36.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.122+0000 7f5935200640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 0x7f5914071100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5918005fd0 tx=0x7f5918005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:36.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.126+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f592007a750 con 0x7f5930198710 2024-04-26T21:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.377+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f5930100910 con 0x7f5930198710 2024-04-26T21:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.378+0000 7f592d600640 1 -- 172.21.15.55:0/3553900207 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v38) v1 ==== 107+0+4082 (secure 0 0 0) 0x7f592007de10 con 0x7f5930198710 2024-04-26T21:23:36.379 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:36.379 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:04.299535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":17,"state":"up:reconnect","state_seq":224,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 18 2024-04-26T21:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 msgr2=0x7f5914071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 0x7f5914071100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5918005fd0 tx=0x7f5918005850 comp rx=0 tx=0).stop 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 msgr2=0x7f593019ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5920000f80 tx=0x7f5920032570 comp rx=0 tx=0).stop 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 shutdown_connections 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f591406ec40 0x7f5914071100 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5930198710 0x7f593019ca60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 --2- 172.21.15.55:0/3553900207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59300675f0 0x7f59301981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.381+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 >> 172.21.15.55:0/3553900207 conn(0x7f5930074910 msgr2=0x7f5930101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:36.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.382+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 shutdown_connections 2024-04-26T21:23:36.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.382+0000 7f5936600640 1 -- 172.21.15.55:0/3553900207 wait complete. 2024-04-26T21:23:36.403 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-04-26T21:23:36.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-26T21:23:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 -- 172.21.15.55:0/1538045821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 msgr2=0x7f9f9c0679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 --2- 172.21.15.55:0/1538045821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c0679d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009c20 tx=0x7f9f9002c1b0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 -- 172.21.15.55:0/1538045821 shutdown_connections 2024-04-26T21:23:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 --2- 172.21.15.55:0/1538045821 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f9c067fa0 0x7f9f9c104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 --2- 172.21.15.55:0/1538045821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c0679d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 -- 172.21.15.55:0/1538045821 >> 172.21.15.55:0/1538045821 conn(0x7f9f9c074a80 msgr2=0x7f9f9c074e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 -- 172.21.15.55:0/1538045821 shutdown_connections 2024-04-26T21:23:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.618+0000 7f9fa4000640 1 -- 172.21.15.55:0/1538045821 wait complete. 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 Processor -- start 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 -- start start 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f9c198960 0x7f9f9c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c198f60 con 0x7f9f9c0675f0 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.619+0000 7f9fa4000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c1990d0 con 0x7f9f9c198960 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38560/0 (socket says 172.21.15.55:38560) 2024-04-26T21:23:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 -- 172.21.15.55:0/3899338236 learned_addr learned my addr 172.21.15.55:0/3899338236 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 -- 172.21.15.55:0/3899338236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f9c198960 msgr2=0x7f9f9c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f9c198960 0x7f9f9c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.620+0000 7f9fa1600640 1 -- 172.21.15.55:0/3899338236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90009900 con 0x7f9f9c0675f0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9fa1600640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f90037040 tx=0x7f9f90032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f90032790 con 0x7f9f9c0675f0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f90003e30 con 0x7f9f9c0675f0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c19d250 con 0x7f9f9c0675f0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9003f440 con 0x7f9f9c0675f0 2024-04-26T21:23:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.621+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c19d7b0 con 0x7f9f9c0675f0 2024-04-26T21:23:36.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.622+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c1017c0 con 0x7f9f9c0675f0 2024-04-26T21:23:36.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.624+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9f9003b040 con 0x7f9f9c0675f0 2024-04-26T21:23:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.625+0000 7f9f9a000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 0x7f9f840710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.625+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f900b1b20 con 0x7f9f9c0675f0 2024-04-26T21:23:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.626+0000 7f9fa0c00640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 0x7f9f840710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:36.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.627+0000 7f9fa0c00640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 0x7f9f840710f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f88005fd0 tx=0x7f9f88005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.634+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9f9007a860 con 0x7f9f9c0675f0 2024-04-26T21:23:36.654 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:36 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/16424185' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-26T21:23:36.654 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:36 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3553900207' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-26T21:23:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:36 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/16424185' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-26T21:23:36.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:36 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3553900207' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-26T21:23:36.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.886+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f9f9c100ae0 con 0x7f9f9c0675f0 2024-04-26T21:23:36.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.887+0000 7f9f9a000640 1 -- 172.21.15.55:0/3899338236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v38) v1 ==== 107+0+4079 (secure 0 0 0) 0x7f9f9007df20 con 0x7f9f9c0675f0 2024-04-26T21:23:36.888 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:36.888 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:04.382511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":17,"state":"up:rejoin","state_seq":225,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:36.888 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2024-04-26T21:23:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 msgr2=0x7f9f840710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 0x7f9f840710f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f88005fd0 tx=0x7f9f88005850 comp rx=0 tx=0).stop 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 msgr2=0x7f9f9c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f90037040 tx=0x7f9f90032570 comp rx=0 tx=0).stop 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 shutdown_connections 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f9c198960 0x7f9f9c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9f8406ec30 0x7f9f840710f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 --2- 172.21.15.55:0/3899338236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f9c0675f0 0x7f9f9c198420 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 >> 172.21.15.55:0/3899338236 conn(0x7f9f9c074a80 msgr2=0x7f9f9c101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 shutdown_connections 2024-04-26T21:23:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:36.891+0000 7f9fa4000640 1 -- 172.21.15.55:0/3899338236 wait complete. 2024-04-26T21:23:36.916 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-26T21:23:36.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-26T21:23:37.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 -- 172.21.15.55:0/2036654902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c104e80 msgr2=0x7f3b7c067380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 --2- 172.21.15.55:0/2036654902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c104e80 0x7f3b7c067380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009880 tx=0x7f3b6c02bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 -- 172.21.15.55:0/2036654902 shutdown_connections 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 --2- 172.21.15.55:0/2036654902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c067d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 --2- 172.21.15.55:0/2036654902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c104e80 0x7f3b7c067380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 -- 172.21.15.55:0/2036654902 >> 172.21.15.55:0/2036654902 conn(0x7f3b7c074910 msgr2=0x7f3b7c074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 -- 172.21.15.55:0/2036654902 shutdown_connections 2024-04-26T21:23:37.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.109+0000 7f3b81600640 1 -- 172.21.15.55:0/2036654902 wait complete. 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.110+0000 7f3b81600640 1 Processor -- start 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.110+0000 7f3b81600640 1 -- start start 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b81600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b81600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 0x7f3b7c19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b81600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c19d0a0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b81600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1a0db0 con 0x7f3b7c104e80 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38576/0 (socket says 172.21.15.55:38576) 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b7be00640 1 -- 172.21.15.55:0/4015258840 learned_addr learned my addr 172.21.15.55:0/4015258840 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.111+0000 7f3b7b400640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 0x7f3b7c19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b7be00640 1 -- 172.21.15.55:0/4015258840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 msgr2=0x7f3b7c19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b7be00640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 0x7f3b7c19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b7be00640 1 -- 172.21.15.55:0/4015258840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009560 con 0x7f3b7c0678c0 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b7b400640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 0x7f3b7c19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:23:37.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b7be00640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c02c220 tx=0x7f3b6c02cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c0044a0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c1a1030 con 0x7f3b7c0678c0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6c003ab0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.112+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c005590 con 0x7f3b7c0678c0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.113+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c1a15b0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.114+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c0ff3c0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.116+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3b6c004dd0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.117+0000 7f3b78c00640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 0x7f3b600710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.117+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3b6c0b13d0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.117+0000 7f3b7b400640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 0x7f3b600710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.118+0000 7f3b7b400640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 0x7f3b600710f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b68005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.123+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3b6c07a090 con 0x7f3b7c0678c0 2024-04-26T21:23:37.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.370+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f3b7c04e9b0 con 0x7f3b7c0678c0 2024-04-26T21:23:37.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.372+0000 7f3b78c00640 1 -- 172.21.15.55:0/4015258840 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) v1 ==== 107+0+4088 (secure 0 0 0) 0x7f3b6c07d750 con 0x7f3b7c0678c0 2024-04-26T21:23:37.372 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:37.372 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:06.392973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":17,"state":"up:active","state_seq":226,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-04-26T21:23:37.373 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 20 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.374+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 msgr2=0x7f3b600710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 0x7f3b600710f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b680058c0 tx=0x7f3b68005850 comp rx=0 tx=0).stop 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 msgr2=0x7f3b7c19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c02c220 tx=0x7f3b6c02cea0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 shutdown_connections 2024-04-26T21:23:37.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b7c104e80 0x7f3b7c19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3b6006ec30 0x7f3b600710f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 --2- 172.21.15.55:0/4015258840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b7c0678c0 0x7f3b7c19c4d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 >> 172.21.15.55:0/4015258840 conn(0x7f3b7c074910 msgr2=0x7f3b7c102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 shutdown_connections 2024-04-26T21:23:37.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.375+0000 7f3b81600640 1 -- 172.21.15.55:0/4015258840 wait complete. 2024-04-26T21:23:37.396 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-26T21:23:37.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-26T21:23:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 -- 172.21.15.55:0/2137865796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70800730b0 msgr2=0x7f7080110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 --2- 172.21.15.55:0/2137865796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70800730b0 0x7f7080110970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f706c009880 tx=0x7f706c02bd70 comp rx=0 tx=0).stop 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 -- 172.21.15.55:0/2137865796 shutdown_connections 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 --2- 172.21.15.55:0/2137865796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70800730b0 0x7f7080110970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 --2- 172.21.15.55:0/2137865796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7080072790 0x7f7080072b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 -- 172.21.15.55:0/2137865796 >> 172.21.15.55:0/2137865796 conn(0x7f70800fb9b0 msgr2=0x7f70800fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 -- 172.21.15.55:0/2137865796 shutdown_connections 2024-04-26T21:23:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.597+0000 7f707f200640 1 -- 172.21.15.55:0/2137865796 wait complete. 2024-04-26T21:23:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 Processor -- start 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 -- start start 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70800730b0 0x7f708019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708019d150 con 0x7f7080072790 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.598+0000 7f707f200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70801a0e60 con 0x7f70800730b0 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38590/0 (socket says 172.21.15.55:38590) 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 -- 172.21.15.55:0/2806941356 learned_addr learned my addr 172.21.15.55:0/2806941356 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 -- 172.21.15.55:0/2806941356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70800730b0 msgr2=0x7f708019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70800730b0 0x7f708019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 -- 172.21.15.55:0/2806941356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009560 con 0x7f7080072790 2024-04-26T21:23:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.599+0000 7f707de00640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f707000d6f0 tx=0x7f707000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.600+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7070009a30 con 0x7f7080072790 2024-04-26T21:23:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.600+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70700054e0 con 0x7f7080072790 2024-04-26T21:23:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.600+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70801a1140 con 0x7f7080072790 2024-04-26T21:23:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.600+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7070010460 con 0x7f7080072790 2024-04-26T21:23:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.600+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70801a16a0 con 0x7f7080072790 2024-04-26T21:23:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.601+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080073ed0 con 0x7f7080072790 2024-04-26T21:23:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.602+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7070009b90 con 0x7f7080072790 2024-04-26T21:23:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.603+0000 7f7076a00640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 0x7f7064071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.603+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f707008eb00 con 0x7f7080072790 2024-04-26T21:23:37.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.603+0000 7f707d400640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 0x7f7064071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.604+0000 7f707d400640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 0x7f7064071100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f706c036040 tx=0x7f706c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.608+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f70700577c0 con 0x7f7080072790 2024-04-26T21:23:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:37 smithi064 ceph-mon[84240]: pgmap v351: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:37.656 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:37 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3899338236' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-26T21:23:37.657 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:37 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/4015258840' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-26T21:23:37.754 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:37 smithi055 ceph-mon[109028]: pgmap v351: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:37 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3899338236' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-26T21:23:37.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:37 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/4015258840' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-26T21:23:37.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.851+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f708004e9b0 con 0x7f7080072790 2024-04-26T21:23:37.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.852+0000 7f7076a00640 1 -- 172.21.15.55:0/2806941356 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f7070017090 con 0x7f7080072790 2024-04-26T21:23:37.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:37.852 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:06.392973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":17,"state":"up:active","state_seq":226,"addr":"172.21.15.55:6829/1757258712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1757258712},{"type":"v1","addr":"172.21.15.55:6829","nonce":1757258712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-04-26T21:23:37.852 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 21 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.854+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 msgr2=0x7f7064071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.854+0000 7f707f200640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 0x7f7064071100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f706c036040 tx=0x7f706c000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.854+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 msgr2=0x7f708019c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.854+0000 7f707f200640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f707000d6f0 tx=0x7f707000dbb0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.854+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 shutdown_connections 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70800730b0 0x7f708019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f706406ec40 0x7f7064071100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 --2- 172.21.15.55:0/2806941356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7080072790 0x7f708019c580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:37.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 >> 172.21.15.55:0/2806941356 conn(0x7f70800fb9b0 msgr2=0x7f70800ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:37.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 shutdown_connections 2024-04-26T21:23:37.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:37.855+0000 7f707f200640 1 -- 172.21.15.55:0/2806941356 wait complete. 2024-04-26T21:23:37.874 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-26T21:23:37.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 -- 172.21.15.55:0/2895141212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf94100c80 msgr2=0x7fbf94104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 --2- 172.21.15.55:0/2895141212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf94100c80 0x7fbf94104cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009880 tx=0x7fbf7c02bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 -- 172.21.15.55:0/2895141212 shutdown_connections 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 --2- 172.21.15.55:0/2895141212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf94100c80 0x7fbf94104cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 --2- 172.21.15.55:0/2895141212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf941002d0 0x7fbf941006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 -- 172.21.15.55:0/2895141212 >> 172.21.15.55:0/2895141212 conn(0x7fbf940fbb50 msgr2=0x7fbf940fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 -- 172.21.15.55:0/2895141212 shutdown_connections 2024-04-26T21:23:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.061+0000 7fbf9b800640 1 -- 172.21.15.55:0/2895141212 wait complete. 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.062+0000 7fbf9b800640 1 Processor -- start 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.062+0000 7fbf9b800640 1 -- start start 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf9b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf9b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf94198880 0x7fbf9419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf9b800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94198e80 con 0x7fbf941002d0 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf9b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94198ff0 con 0x7fbf94198880 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf98e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf98e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38604/0 (socket says 172.21.15.55:38604) 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf98e00640 1 -- 172.21.15.55:0/1679693755 learned_addr learned my addr 172.21.15.55:0/1679693755 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.063+0000 7fbf8be00640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf94198880 0x7fbf9419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf98e00640 1 -- 172.21.15.55:0/1679693755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf94198880 msgr2=0x7fbf9419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf98e00640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf94198880 0x7fbf9419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf98e00640 1 -- 172.21.15.55:0/1679693755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009560 con 0x7fbf941002d0 2024-04-26T21:23:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf98e00640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400d720 tx=0x7fbf8400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf840051f0 con 0x7fbf941002d0 2024-04-26T21:23:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf84009ce0 con 0x7fbf941002d0 2024-04-26T21:23:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf84010460 con 0x7fbf941002d0 2024-04-26T21:23:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9419d220 con 0x7fbf941002d0 2024-04-26T21:23:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.064+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9419d780 con 0x7fbf941002d0 2024-04-26T21:23:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.066+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9419da50 con 0x7fbf941002d0 2024-04-26T21:23:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.067+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbf84005350 con 0x7fbf941002d0 2024-04-26T21:23:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.067+0000 7fbf92000640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 0x7fbf780710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.068+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbf8408e9b0 con 0x7fbf941002d0 2024-04-26T21:23:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.068+0000 7fbf8be00640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 0x7fbf780710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.069+0000 7fbf8be00640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 0x7fbf780710f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c006010 tx=0x7fbf7c02cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.072+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fbf84057790 con 0x7fbf941002d0 2024-04-26T21:23:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.321+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fbf94073da0 con 0x7fbf941002d0 2024-04-26T21:23:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.322+0000 7fbf92000640 1 -- 172.21.15.55:0/1679693755 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) v1 ==== 107+0+4131 (secure 0 0 0) 0x7fbf84017090 con 0x7fbf941002d0 2024-04-26T21:23:38.323 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:38.323 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:32.205013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 22 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 msgr2=0x7fbf780710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 0x7fbf780710f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c006010 tx=0x7fbf7c02cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 msgr2=0x7fbf94198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400d720 tx=0x7fbf8400dbe0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 shutdown_connections 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf94198880 0x7fbf9419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fbf7806ec30 0x7fbf780710f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 --2- 172.21.15.55:0/1679693755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf941002d0 0x7fbf94198340 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 >> 172.21.15.55:0/1679693755 conn(0x7fbf940fbb50 msgr2=0x7fbf940fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 shutdown_connections 2024-04-26T21:23:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.325+0000 7fbf9b800640 1 -- 172.21.15.55:0/1679693755 wait complete. 2024-04-26T21:23:38.344 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-26T21:23:38.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.556+0000 7f0bb3200640 1 -- 172.21.15.55:0/2871823089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40675f0 msgr2=0x7f0bb40679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.556+0000 7f0bb3200640 1 --2- 172.21.15.55:0/2871823089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40675f0 0x7f0bb40679d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009880 tx=0x7f0ba402bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 -- 172.21.15.55:0/2871823089 shutdown_connections 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 --2- 172.21.15.55:0/2871823089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb4067fa0 0x7f0bb4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 --2- 172.21.15.55:0/2871823089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40675f0 0x7f0bb40679d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 -- 172.21.15.55:0/2871823089 >> 172.21.15.55:0/2871823089 conn(0x7f0bb4074910 msgr2=0x7f0bb4074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 -- 172.21.15.55:0/2871823089 shutdown_connections 2024-04-26T21:23:38.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.557+0000 7f0bb3200640 1 -- 172.21.15.55:0/2871823089 wait complete. 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 Processor -- start 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 -- start start 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb40675f0 0x7f0bb40fef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4100ed0 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb3200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41a2150 con 0x7f0bb40675f0 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.558+0000 7f0bb1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38618/0 (socket says 172.21.15.55:38618) 2024-04-26T21:23:38.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 -- 172.21.15.55:0/299191810 learned_addr learned my addr 172.21.15.55:0/299191810 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:38.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 -- 172.21.15.55:0/299191810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb40675f0 msgr2=0x7f0bb40fef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb40675f0 0x7f0bb40fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 -- 172.21.15.55:0/299191810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009560 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0bb1400640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00ea50 tx=0x7f0b9c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.559+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c00cd10 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.560+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b9c00ce70 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.560+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c01a960 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.560+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb41a2350 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.560+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb41a2880 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.562+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb41015d0 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.563+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0b9c01aac0 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.564+0000 7f0baaa00640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 0x7f0b940710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:38.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.564+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0b9c08f460 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.564+0000 7f0bb1e00640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 0x7f0b940710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:38.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.565+0000 7f0bb1e00640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 0x7f0b940710f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4036040 tx=0x7f0ba4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.569+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0b9c058220 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:38 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2806941356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-26T21:23:38.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:38 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1679693755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-26T21:23:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.815+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f0bb404e9b0 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.816+0000 7f0baaa00640 1 -- 172.21.15.55:0/299191810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) v1 ==== 107+0+4142 (secure 0 0 0) 0x7f0b9c05b8e0 con 0x7f0bb40ff4b0 2024-04-26T21:23:38.817 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:38.817 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:32.212767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:38.817 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 msgr2=0x7f0b940710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 0x7f0b940710f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4036040 tx=0x7f0ba4000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 msgr2=0x7f0bb40ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00ea50 tx=0x7f0b9c00ef10 comp rx=0 tx=0).stop 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 shutdown_connections 2024-04-26T21:23:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0b9406ec30 0x7f0b940710f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bb40ff4b0 0x7f0bb40ff910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 --2- 172.21.15.55:0/299191810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0bb40675f0 0x7f0bb40fef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.819+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 >> 172.21.15.55:0/299191810 conn(0x7f0bb4074910 msgr2=0x7f0bb4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.820+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 shutdown_connections 2024-04-26T21:23:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:38.820+0000 7f0bb3200640 1 -- 172.21.15.55:0/299191810 wait complete. 2024-04-26T21:23:38.840 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-26T21:23:38.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-26T21:23:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:38 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2806941356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-26T21:23:38.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:38 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1679693755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-26T21:23:39.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 -- 172.21.15.55:0/147393830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48074920 msgr2=0x7f3a48074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/147393830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48074920 0x7f3a48074d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009880 tx=0x7f3a3c02bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 -- 172.21.15.55:0/147393830 shutdown_connections 2024-04-26T21:23:39.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/147393830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48075240 0x7f3a481107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/147393830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48074920 0x7f3a48074d00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 -- 172.21.15.55:0/147393830 >> 172.21.15.55:0/147393830 conn(0x7f3a480fdb70 msgr2=0x7f3a480fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 -- 172.21.15.55:0/147393830 shutdown_connections 2024-04-26T21:23:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.049+0000 7f3a4ea00640 1 -- 172.21.15.55:0/147393830 wait complete. 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 Processor -- start 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 -- start start 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48074920 0x7f3a4819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4819d0c0 con 0x7f3a48075240 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.050+0000 7f3a4ea00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481a0d80 con 0x7f3a48074920 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38644/0 (socket says 172.21.15.55:38644) 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 -- 172.21.15.55:0/1874920779 learned_addr learned my addr 172.21.15.55:0/1874920779 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4d600640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48074920 0x7f3a4819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 -- 172.21.15.55:0/1874920779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48074920 msgr2=0x7f3a4819c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48074920 0x7f3a4819c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.051+0000 7f3a4cc00640 1 -- 172.21.15.55:0/1874920779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009560 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a4cc00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400c8f0 tx=0x7f3a3400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a34007b80 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a340054e0 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3400f450 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a481a1060 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.052+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a481a15c0 con 0x7f3a48075240 2024-04-26T21:23:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.054+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a48076060 con 0x7f3a48075240 2024-04-26T21:23:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.055+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3a34004f60 con 0x7f3a48075240 2024-04-26T21:23:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.056+0000 7f3a46000640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 0x7f3a30071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.056+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3a3408ed10 con 0x7f3a48075240 2024-04-26T21:23:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.056+0000 7f3a4d600640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 0x7f3a30071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.057+0000 7f3a4d600640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 0x7f3a30071100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c000c00 tx=0x7f3a3c02cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.061+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3a34057a70 con 0x7f3a48075240 2024-04-26T21:23:39.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.309+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f3a4804e9b0 con 0x7f3a48075240 2024-04-26T21:23:39.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.311+0000 7f3a46000640 1 -- 172.21.15.55:0/1874920779 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) v1 ==== 107+0+4989 (secure 0 0 0) 0x7f3a3405b130 con 0x7f3a48075240 2024-04-26T21:23:39.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:32.212767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:39.312 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-04-26T21:23:39.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 msgr2=0x7f3a30071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 0x7f3a30071100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c000c00 tx=0x7f3a3c02cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:39.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 msgr2=0x7f3a4819ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400c8f0 tx=0x7f3a3400cdb0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 shutdown_connections 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f3a3006ec40 0x7f3a30071100 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a48075240 0x7f3a4819ca30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 --2- 172.21.15.55:0/1874920779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a48074920 0x7f3a4819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 >> 172.21.15.55:0/1874920779 conn(0x7f3a480fdb70 msgr2=0x7f3a480fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 shutdown_connections 2024-04-26T21:23:39.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.314+0000 7f3a4ea00640 1 -- 172.21.15.55:0/1874920779 wait complete. 2024-04-26T21:23:39.333 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-26T21:23:39.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 -- 172.21.15.55:0/323560508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3190102ca0 msgr2=0x7f3190106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 --2- 172.21.15.55:0/323560508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3190102ca0 0x7f3190106ce0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f317c009880 tx=0x7f317c02bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 -- 172.21.15.55:0/323560508 shutdown_connections 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 --2- 172.21.15.55:0/323560508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3190102ca0 0x7f3190106ce0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 --2- 172.21.15.55:0/323560508 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f31901026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 -- 172.21.15.55:0/323560508 >> 172.21.15.55:0/323560508 conn(0x7f31900fdb70 msgr2=0x7f31900fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 -- 172.21.15.55:0/323560508 shutdown_connections 2024-04-26T21:23:39.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.551+0000 7f3196a00640 1 -- 172.21.15.55:0/323560508 wait complete. 2024-04-26T21:23:39.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.552+0000 7f3196a00640 1 Processor -- start 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3196a00640 1 -- start start 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3196a00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f3190198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3196a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3196a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190198cb0 con 0x7f31901986b0 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3196a00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190198e20 con 0x7f31901022f0 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3194c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3194c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38662/0 (socket says 172.21.15.55:38662) 2024-04-26T21:23:39.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.553+0000 7f3194c00640 1 -- 172.21.15.55:0/159041432 learned_addr learned my addr 172.21.15.55:0/159041432 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:39.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3195600640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f3190198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3194c00640 1 -- 172.21.15.55:0/159041432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 msgr2=0x7f3190198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3194c00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f3190198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3194c00640 1 -- 172.21.15.55:0/159041432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c009560 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3195600640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f3190198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.554+0000 7f3194c00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f317c036040 tx=0x7f317c02c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.555+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c0035f0 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.555+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f317c003c10 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.555+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319019cff0 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.555+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c0055f0 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.555+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319019d550 con 0x7f31901986b0 2024-04-26T21:23:39.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.556+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31901037c0 con 0x7f31901986b0 2024-04-26T21:23:39.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.557+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f317c004e60 con 0x7f31901986b0 2024-04-26T21:23:39.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.558+0000 7f318e000640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 0x7f3178071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:39.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.558+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f317c0b12b0 con 0x7f31901986b0 2024-04-26T21:23:39.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.559+0000 7f3195600640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 0x7f3178071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:39.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.559+0000 7f3195600640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 0x7f3178071100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3184009b40 tx=0x7f3184005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:39.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.563+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f317c079f70 con 0x7f31901986b0 2024-04-26T21:23:39.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:39 smithi055 ceph-mon[109028]: pgmap v352: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:39.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:39 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/299191810' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-26T21:23:39.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:39 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1874920779' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-26T21:23:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.815+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f319004e9b0 con 0x7f31901986b0 2024-04-26T21:23:39.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.817+0000 7f318e000640 1 -- 172.21.15.55:0/159041432 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) v1 ==== 107+0+4994 (secure 0 0 0) 0x7f317c07d630 con 0x7f31901986b0 2024-04-26T21:23:39.817 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:39.817 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:39.989519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":232,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-26T21:23:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 msgr2=0x7f3178071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 0x7f3178071100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3184009b40 tx=0x7f3184005e50 comp rx=0 tx=0).stop 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 msgr2=0x7f319019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f317c036040 tx=0x7f317c02c7c0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 shutdown_connections 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f317806ec40 0x7f3178071100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31901986b0 0x7f319019ca50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 --2- 172.21.15.55:0/159041432 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31901022f0 0x7f3190198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 >> 172.21.15.55:0/159041432 conn(0x7f31900fdb70 msgr2=0x7f31900feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 shutdown_connections 2024-04-26T21:23:39.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:39.820+0000 7f3196a00640 1 -- 172.21.15.55:0/159041432 wait complete. 2024-04-26T21:23:39.839 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-26T21:23:39.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-26T21:23:39.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:39 smithi064 ceph-mon[84240]: pgmap v352: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:39.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:39 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/299191810' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-26T21:23:39.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:39 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1874920779' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 -- 172.21.15.55:0/3279502352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9994106680 msgr2=0x7f9994106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 --2- 172.21.15.55:0/3279502352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9994106680 0x7f9994106b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9980009c20 tx=0x7f998002c1b0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 -- 172.21.15.55:0/3279502352 shutdown_connections 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 --2- 172.21.15.55:0/3279502352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9994106680 0x7f9994106b00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 --2- 172.21.15.55:0/3279502352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f999410c690 0x7f999410ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.052+0000 7f999b800640 1 -- 172.21.15.55:0/3279502352 >> 172.21.15.55:0/3279502352 conn(0x7f9994075e90 msgr2=0x7f99940782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.053+0000 7f999b800640 1 -- 172.21.15.55:0/3279502352 shutdown_connections 2024-04-26T21:23:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.053+0000 7f999b800640 1 -- 172.21.15.55:0/3279502352 wait complete. 2024-04-26T21:23:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 Processor -- start 2024-04-26T21:23:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 -- start start 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9994106680 0x7f999419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999419d2c0 con 0x7f999410c690 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f999b800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99941a0f80 con 0x7f9994106680 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f9993e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f9993e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38684/0 (socket says 172.21.15.55:38684) 2024-04-26T21:23:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.054+0000 7f9993e00640 1 -- 172.21.15.55:0/2743381799 learned_addr learned my addr 172.21.15.55:0/2743381799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9993e00640 1 -- 172.21.15.55:0/2743381799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9994106680 msgr2=0x7f999419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9993e00640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9994106680 0x7f999419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9993e00640 1 -- 172.21.15.55:0/2743381799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980009900 con 0x7f999410c690 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9993e00640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f998002c6f0 tx=0x7f9980032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9980034610 con 0x7f999410c690 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9980003e30 con 0x7f999410c690 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9980004830 con 0x7f999410c690 2024-04-26T21:23:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.055+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99941a1200 con 0x7f999410c690 2024-04-26T21:23:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.056+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99941a1700 con 0x7f999410c690 2024-04-26T21:23:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.057+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9994107dc0 con 0x7f999410c690 2024-04-26T21:23:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.058+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f998003b040 con 0x7f999410c690 2024-04-26T21:23:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.059+0000 7f9991600640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 0x7f99780710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.059+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f99800b1ba0 con 0x7f999410c690 2024-04-26T21:23:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.059+0000 7f9998e00640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 0x7f99780710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:40.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.060+0000 7f9998e00640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 0x7f99780710f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9984005fd0 tx=0x7f9984005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:40.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.064+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f998007a8e0 con 0x7f999410c690 2024-04-26T21:23:40.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.318+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f999410ec10 con 0x7f999410c690 2024-04-26T21:23:40.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.319+0000 7f9991600640 1 -- 172.21.15.55:0/2743381799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) v1 ==== 107+0+4991 (secure 0 0 0) 0x7f998007dfa0 con 0x7f999410c690 2024-04-26T21:23:40.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:40.320 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:40.294930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":233,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:40.320 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 26 2024-04-26T21:23:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.322+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 msgr2=0x7f99780710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 0x7f99780710f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9984005fd0 tx=0x7f9984005850 comp rx=0 tx=0).stop 2024-04-26T21:23:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 msgr2=0x7f999419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f998002c6f0 tx=0x7f9980032570 comp rx=0 tx=0).stop 2024-04-26T21:23:40.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 shutdown_connections 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f997806ec30 0x7f99780710f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f999410c690 0x7f999419cc30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 --2- 172.21.15.55:0/2743381799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9994106680 0x7f999419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 >> 172.21.15.55:0/2743381799 conn(0x7f9994075e90 msgr2=0x7f9994076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 shutdown_connections 2024-04-26T21:23:40.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.323+0000 7f999b800640 1 -- 172.21.15.55:0/2743381799 wait complete. 2024-04-26T21:23:40.342 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-26T21:23:40.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-26T21:23:40.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.551+0000 7fd6bec00640 1 -- 172.21.15.55:0/1454281853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8100af0 msgr2=0x7fd6b8104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.551+0000 7fd6bec00640 1 --2- 172.21.15.55:0/1454281853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8100af0 0x7fd6b8104b30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009c20 tx=0x7fd6a402c1b0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 -- 172.21.15.55:0/1454281853 shutdown_connections 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 --2- 172.21.15.55:0/1454281853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8100af0 0x7fd6b8104b30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 --2- 172.21.15.55:0/1454281853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 0x7fd6b8100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 -- 172.21.15.55:0/1454281853 >> 172.21.15.55:0/1454281853 conn(0x7fd6b80fb9e0 msgr2=0x7fd6b80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 -- 172.21.15.55:0/1454281853 shutdown_connections 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.552+0000 7fd6bec00640 1 -- 172.21.15.55:0/1454281853 wait complete. 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.553+0000 7fd6bec00640 1 Processor -- start 2024-04-26T21:23:40.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.553+0000 7fd6bec00640 1 -- start start 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bec00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 0x7fd6b8195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8196a70 con 0x7fd6b8196500 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bec00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8196be0 con 0x7fd6b8100140 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38710/0 (socket says 172.21.15.55:38710) 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bce00640 1 -- 172.21.15.55:0/736263976 learned_addr learned my addr 172.21.15.55:0/736263976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.554+0000 7fd6bd800640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 0x7fd6b8195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:40.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6bce00640 1 -- 172.21.15.55:0/736263976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 msgr2=0x7fd6b8195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6bce00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 0x7fd6b8195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6bce00640 1 -- 172.21.15.55:0/736263976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009900 con 0x7fd6b8196500 2024-04-26T21:23:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6bce00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6a402c6f0 tx=0x7fd6a4032570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a4034820 con 0x7fd6b8196500 2024-04-26T21:23:40.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6a4003e30 con 0x7fd6b8196500 2024-04-26T21:23:40.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a403f440 con 0x7fd6b8196500 2024-04-26T21:23:40.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.555+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b819ae40 con 0x7fd6b8196500 2024-04-26T21:23:40.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.556+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b819b350 con 0x7fd6b8196500 2024-04-26T21:23:40.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.557+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8101610 con 0x7fd6b8196500 2024-04-26T21:23:40.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.558+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd6a403b040 con 0x7fd6b8196500 2024-04-26T21:23:40.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.559+0000 7fd6b6000640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 0x7fd69c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:40.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.559+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd6a40b1c50 con 0x7fd6b8196500 2024-04-26T21:23:40.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.559+0000 7fd6bd800640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 0x7fd69c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:40.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.560+0000 7fd6bd800640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 0x7fd69c0710f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8005e10 tx=0x7fd6a8005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:40.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.564+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fd6a407a990 con 0x7fd6b8196500 2024-04-26T21:23:40.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:40 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/159041432' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-26T21:23:40.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:40 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2743381799' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-26T21:23:40.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.814+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fd6b8108440 con 0x7fd6b8196500 2024-04-26T21:23:40.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.815+0000 7fd6b6000640 1 -- 172.21.15.55:0/736263976 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) v1 ==== 107+0+5000 (secure 0 0 0) 0x7fd6a407e050 con 0x7fd6b8196500 2024-04-26T21:23:40.816 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:40.816 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44279,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3118315402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3118315402},{"type":"v1","addr":"172.21.15.64:6825","nonce":3118315402}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:42.298233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:active","state_seq":234,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24291,"qdb_cluster":[24291]},"id":1}]} 2024-04-26T21:23:40.816 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2024-04-26T21:23:40.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 msgr2=0x7fd69c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 0x7fd69c0710f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8005e10 tx=0x7fd6a8005da0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 msgr2=0x7fd6b819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6a402c6f0 tx=0x7fd6a4032570 comp rx=0 tx=0).stop 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 shutdown_connections 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fd69c06ec30 0x7fd69c0710f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6b8196500 0x7fd6b819a8a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 --2- 172.21.15.55:0/736263976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6b8100140 0x7fd6b8195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 >> 172.21.15.55:0/736263976 conn(0x7fd6b80fb9e0 msgr2=0x7fd6b80fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.818+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 shutdown_connections 2024-04-26T21:23:40.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:40.819+0000 7fd6bec00640 1 -- 172.21.15.55:0/736263976 wait complete. 2024-04-26T21:23:40.839 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-26T21:23:40.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-26T21:23:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:40 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/159041432' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-26T21:23:40.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:40 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2743381799' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-26T21:23:41.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.055+0000 7f96b3200640 1 -- 172.21.15.55:0/2125750241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40ff6f0 msgr2=0x7f96b4103bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.055+0000 7f96b3200640 1 --2- 172.21.15.55:0/2125750241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40ff6f0 0x7f96b4103bb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009c20 tx=0x7f96a402c230 comp rx=0 tx=0).stop 2024-04-26T21:23:41.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 -- 172.21.15.55:0/2125750241 shutdown_connections 2024-04-26T21:23:41.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 --2- 172.21.15.55:0/2125750241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40ff6f0 0x7f96b4103bb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 --2- 172.21.15.55:0/2125750241 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40fedd0 0x7f96b40ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 -- 172.21.15.55:0/2125750241 >> 172.21.15.55:0/2125750241 conn(0x7f96b40759d0 msgr2=0x7f96b40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:41.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 -- 172.21.15.55:0/2125750241 shutdown_connections 2024-04-26T21:23:41.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.056+0000 7f96b3200640 1 -- 172.21.15.55:0/2125750241 wait complete. 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 Processor -- start 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 -- start start 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40ff6f0 0x7f96b419c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b419d070 con 0x7f96b40fedd0 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b3200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41a0d80 con 0x7f96b40ff6f0 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.057+0000 7f96b1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38726/0 (socket says 172.21.15.55:38726) 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1e00640 1 -- 172.21.15.55:0/431475229 learned_addr learned my addr 172.21.15.55:0/431475229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1400640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40ff6f0 0x7f96b419c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1e00640 1 -- 172.21.15.55:0/431475229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40ff6f0 msgr2=0x7f96b419c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1e00640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40ff6f0 0x7f96b419c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1e00640 1 -- 172.21.15.55:0/431475229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4009900 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96b1e00640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d6f0 tx=0x7f969c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.058+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f969c009a30 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.059+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f969c0054e0 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.059+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f969c010460 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.059+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b41a1060 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.059+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b41a15c0 con 0x7f96b40fedd0 2024-04-26T21:23:41.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.060+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b4067c60 con 0x7f96b40fedd0 2024-04-26T21:23:41.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.061+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f969c009b90 con 0x7f96b40fedd0 2024-04-26T21:23:41.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.062+0000 7f96aaa00640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 0x7f96980710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.062+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f969c08eb00 con 0x7f96b40fedd0 2024-04-26T21:23:41.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.062+0000 7f96b1400640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 0x7f96980710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.063+0000 7f96b1400640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 0x7f96980710f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96a4037040 tx=0x7f96a4034c10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:41.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.067+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f969c0577c0 con 0x7f96b40fedd0 2024-04-26T21:23:41.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.319+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f96b41136c0 con 0x7f96b40fedd0 2024-04-26T21:23:41.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.320+0000 7f96aaa00640 1 -- 172.21.15.55:0/431475229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) v1 ==== 107+0+4221 (secure 0 0 0) 0x7f969c017090 con 0x7f96b40fedd0 2024-04-26T21:23:41.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:41.322 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:42.298233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:active","state_seq":234,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24291,"qdb_cluster":[24291]},"id":1}]} 2024-04-26T21:23:41.322 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 28 2024-04-26T21:23:41.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 msgr2=0x7f96980710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 0x7f96980710f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96a4037040 tx=0x7f96a4034c10 comp rx=0 tx=0).stop 2024-04-26T21:23:41.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 msgr2=0x7f96b419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d6f0 tx=0x7f969c00dbb0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 shutdown_connections 2024-04-26T21:23:41.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96b40ff6f0 0x7f96b419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f969806ec30 0x7f96980710f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 --2- 172.21.15.55:0/431475229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96b40fedd0 0x7f96b419c4a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.323+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 >> 172.21.15.55:0/431475229 conn(0x7f96b40759d0 msgr2=0x7f96b410d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:41.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.324+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 shutdown_connections 2024-04-26T21:23:41.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.324+0000 7f96b3200640 1 -- 172.21.15.55:0/431475229 wait complete. 2024-04-26T21:23:41.343 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-26T21:23:41.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-26T21:23:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 -- 172.21.15.55:0/161849970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4102330 msgr2=0x7f75f4102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 --2- 172.21.15.55:0/161849970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4102330 0x7f75f4102710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009880 tx=0x7f75dc02bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 -- 172.21.15.55:0/161849970 shutdown_connections 2024-04-26T21:23:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 --2- 172.21.15.55:0/161849970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102ce0 0x7f75f4106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 --2- 172.21.15.55:0/161849970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4102330 0x7f75f4102710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 -- 172.21.15.55:0/161849970 >> 172.21.15.55:0/161849970 conn(0x7f75f40fdbb0 msgr2=0x7f75f40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 -- 172.21.15.55:0/161849970 shutdown_connections 2024-04-26T21:23:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.560+0000 7f75f9000640 1 -- 172.21.15.55:0/161849970 wait complete. 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 Processor -- start 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 -- start start 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102330 0x7f75f4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4198e50 con 0x7f75f4198850 2024-04-26T21:23:41.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.561+0000 7f75f9000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4198fc0 con 0x7f75f4102330 2024-04-26T21:23:41.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38740/0 (socket says 172.21.15.55:38740) 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 -- 172.21.15.55:0/4141762726 learned_addr learned my addr 172.21.15.55:0/4141762726 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f3400640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102330 0x7f75f4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 -- 172.21.15.55:0/4141762726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102330 msgr2=0x7f75f4198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102330 0x7f75f4198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.562+0000 7f75f2a00640 1 -- 172.21.15.55:0/4141762726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009560 con 0x7f75f4198850 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75f2a00640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75e400b9f0 tx=0x7f75e400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e400cb20 con 0x7f75f4198850 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f419d1f0 con 0x7f75f4198850 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75e400cc80 con 0x7f75f4198850 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e40126f0 con 0x7f75f4198850 2024-04-26T21:23:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.563+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f419d750 con 0x7f75f4198850 2024-04-26T21:23:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.564+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f419da30 con 0x7f75f4198850 2024-04-26T21:23:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.565+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f75e4012960 con 0x7f75f4198850 2024-04-26T21:23:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.566+0000 7f75ebe00640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 0x7f75d80710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.566+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f75e408e910 con 0x7f75f4198850 2024-04-26T21:23:41.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.567+0000 7f75f3400640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 0x7f75d80710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:41.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.567+0000 7f75f3400640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 0x7f75d80710f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c00 tx=0x7f75dc02ca70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:41.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.572+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f75e4057680 con 0x7f75f4198850 2024-04-26T21:23:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:41 smithi055 ceph-mon[109028]: pgmap v353: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:41 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/736263976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-26T21:23:41.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:41 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/431475229' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-26T21:23:41.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:41 smithi064 ceph-mon[84240]: pgmap v353: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:41.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:41 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/736263976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-26T21:23:41.789 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:41 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/431475229' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-26T21:23:41.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.819+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f75f4199610 con 0x7f75f4198850 2024-04-26T21:23:41.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.820+0000 7f75ebe00640 1 -- 172.21.15.55:0/4141762726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) v1 ==== 107+0+5068 (secure 0 0 0) 0x7f75e405ad40 con 0x7f75f4198850 2024-04-26T21:23:41.821 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:41.821 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:19:42.298233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24291":{"gid":24291,"name":"cephfs.smithi064.xrdyeb","rank":0,"incarnation":23,"state":"up:active","state_seq":234,"addr":"172.21.15.64:6827/258074733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":258074733},{"type":"v1","addr":"172.21.15.64:6827","nonce":258074733}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24291,"qdb_cluster":[24291]},"id":1}]} 2024-04-26T21:23:41.821 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 29 2024-04-26T21:23:41.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 msgr2=0x7f75d80710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 0x7f75d80710f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c00 tx=0x7f75dc02ca70 comp rx=0 tx=0).stop 2024-04-26T21:23:41.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 msgr2=0x7f75f419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:41.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75e400b9f0 tx=0x7f75e400beb0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 shutdown_connections 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f75d806ec30 0x7f75d80710f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75f4198850 0x7f75f419cbf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 --2- 172.21.15.55:0/4141762726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75f4102330 0x7f75f4198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 >> 172.21.15.55:0/4141762726 conn(0x7f75f40fdbb0 msgr2=0x7f75f40ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 shutdown_connections 2024-04-26T21:23:41.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:41.823+0000 7f75f9000640 1 -- 172.21.15.55:0/4141762726 wait complete. 2024-04-26T21:23:41.843 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-26T21:23:41.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-26T21:23:42.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 -- 172.21.15.55:0/3339014760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae8106550 msgr2=0x7f2ae81069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/3339014760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae8106550 0x7f2ae81069d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009880 tx=0x7f2ad402bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 -- 172.21.15.55:0/3339014760 shutdown_connections 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/3339014760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae8106550 0x7f2ae81069d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/3339014760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae810c5c0 0x7f2ae810c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 -- 172.21.15.55:0/3339014760 >> 172.21.15.55:0/3339014760 conn(0x7f2ae8075cb0 msgr2=0x7f2ae80780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 -- 172.21.15.55:0/3339014760 shutdown_connections 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.055+0000 7f2ae7e00640 1 -- 172.21.15.55:0/3339014760 wait complete. 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 Processor -- start 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 -- start start 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 0x7f2ae819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae819d180 con 0x7f2ae810c5c0 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.056+0000 7f2ae7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81a0e40 con 0x7f2ae8106550 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38766/0 (socket says 172.21.15.55:38766) 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 -- 172.21.15.55:0/1802557911 learned_addr learned my addr 172.21.15.55:0/1802557911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6a00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 0x7f2ae819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 -- 172.21.15.55:0/1802557911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 msgr2=0x7f2ae819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 0x7f2ae819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6000640 1 -- 172.21.15.55:0/1802557911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009560 con 0x7f2ae810c5c0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.057+0000 7f2ae6a00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 0x7f2ae819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2ae6000640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4036040 tx=0x7f2ad4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad40035f0 con 0x7f2ae810c5c0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ad4003c10 con 0x7f2ae810c5c0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad4034440 con 0x7f2ae810c5c0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae81a10c0 con 0x7f2ae810c5c0 2024-04-26T21:23:42.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.058+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae81a1640 con 0x7f2ae810c5c0 2024-04-26T21:23:42.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.060+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8107c20 con 0x7f2ae810c5c0 2024-04-26T21:23:42.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.061+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2ad4004f60 con 0x7f2ae810c5c0 2024-04-26T21:23:42.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.062+0000 7f2adf400640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 0x7f2acc071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.062+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2ad40b12c0 con 0x7f2ae810c5c0 2024-04-26T21:23:42.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.063+0000 7f2ae6a00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 0x7f2acc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.063+0000 7f2ae6a00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 0x7f2acc071100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006fd0 tx=0x7f2ad8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:42.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.068+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f2ad407a000 con 0x7f2ae810c5c0 2024-04-26T21:23:42.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.316+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f2ae810ea70 con 0x7f2ae810c5c0 2024-04-26T21:23:42.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.317+0000 7f2adf400640 1 -- 172.21.15.55:0/1802557911 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) v1 ==== 107+0+4270 (secure 0 0 0) 0x7f2ad407d6c0 con 0x7f2ae810c5c0 2024-04-26T21:23:42.318 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:42.318 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34462,"name":"cephfs.smithi055.coveew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:26.260511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:42.318 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 30 2024-04-26T21:23:42.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 msgr2=0x7f2acc071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 0x7f2acc071100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006fd0 tx=0x7f2ad8008040 comp rx=0 tx=0).stop 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 msgr2=0x7f2ae819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4036040 tx=0x7f2ad4004040 comp rx=0 tx=0).stop 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 shutdown_connections 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f2acc06ec40 0x7f2acc071100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ae810c5c0 0x7f2ae819caf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 --2- 172.21.15.55:0/1802557911 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ae8106550 0x7f2ae819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 >> 172.21.15.55:0/1802557911 conn(0x7f2ae8075cb0 msgr2=0x7f2ae810b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.320+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 shutdown_connections 2024-04-26T21:23:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.321+0000 7f2ae7e00640 1 -- 172.21.15.55:0/1802557911 wait complete. 2024-04-26T21:23:42.339 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-26T21:23:42.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-26T21:23:42.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 -- 172.21.15.55:0/2225479633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 msgr2=0x7f85281026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 --2- 172.21.15.55:0/2225479633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281026f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8518009880 tx=0x7f851802bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 -- 172.21.15.55:0/2225479633 shutdown_connections 2024-04-26T21:23:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 --2- 172.21.15.55:0/2225479633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8528102cc0 0x7f8528106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 --2- 172.21.15.55:0/2225479633 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281026f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 -- 172.21.15.55:0/2225479633 >> 172.21.15.55:0/2225479633 conn(0x7f85280fdb70 msgr2=0x7f85280fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 -- 172.21.15.55:0/2225479633 shutdown_connections 2024-04-26T21:23:42.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.561+0000 7f8527200640 1 -- 172.21.15.55:0/2225479633 wait complete. 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.562+0000 7f8527200640 1 Processor -- start 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.562+0000 7f8527200640 1 -- start start 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8527200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8527200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 0x7f852819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8527200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528198ce0 con 0x7f8528102310 2024-04-26T21:23:42.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8527200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528198e50 con 0x7f85281986e0 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38784/0 (socket says 172.21.15.55:38784) 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 -- 172.21.15.55:0/3289337008 learned_addr learned my addr 172.21.15.55:0/3289337008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f851fe00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 0x7f852819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 -- 172.21.15.55:0/3289337008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 msgr2=0x7f852819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 0x7f852819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.563+0000 7f8525e00640 1 -- 172.21.15.55:0/3289337008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009560 con 0x7f8528102310 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f851fe00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 0x7f852819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:42.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f8525e00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8518006010 tx=0x7f8518004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:42.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8518004420 con 0x7f8528102310 2024-04-26T21:23:42.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8518003ab0 con 0x7f8528102310 2024-04-26T21:23:42.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852819d020 con 0x7f8528102310 2024-04-26T21:23:42.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8518005520 con 0x7f8528102310 2024-04-26T21:23:42.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.564+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852819d580 con 0x7f8528102310 2024-04-26T21:23:42.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.566+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85281037e0 con 0x7f8528102310 2024-04-26T21:23:42.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.567+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8518003c20 con 0x7f8528102310 2024-04-26T21:23:42.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.568+0000 7f851ea00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 0x7f850c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:42.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.568+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f85180b11f0 con 0x7f8528102310 2024-04-26T21:23:42.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.568+0000 7f851fe00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 0x7f850c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:42.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.569+0000 7f851fe00640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 0x7f850c0710f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85280692f0 tx=0x7f8510005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:42.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.573+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f8518079eb0 con 0x7f8528102310 2024-04-26T21:23:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:42 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/4141762726' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-26T21:23:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:42 smithi055 ceph-mon[109028]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:42.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:42 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1802557911' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-26T21:23:42.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.821+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f852810a610 con 0x7f8528102310 2024-04-26T21:23:42.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.822+0000 7f851ea00640 1 -- 172.21.15.55:0/3289337008 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) v1 ==== 107+0+4349 (secure 0 0 0) 0x7f851807d570 con 0x7f8528102310 2024-04-26T21:23:42.822 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:42.822 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:26.275396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:42.823 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 31 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 msgr2=0x7f850c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 0x7f850c0710f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85280692f0 tx=0x7f8510005f90 comp rx=0 tx=0).stop 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 msgr2=0x7f85281981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8518006010 tx=0x7f8518004a10 comp rx=0 tx=0).stop 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 shutdown_connections 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85281986e0 0x7f852819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f850c06ec30 0x7f850c0710f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.824+0000 7f8527200640 1 --2- 172.21.15.55:0/3289337008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8528102310 0x7f85281981a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.825+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 >> 172.21.15.55:0/3289337008 conn(0x7f85280fdb70 msgr2=0x7f85280fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.825+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 shutdown_connections 2024-04-26T21:23:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:42.825+0000 7f8527200640 1 -- 172.21.15.55:0/3289337008 wait complete. 2024-04-26T21:23:42.844 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-26T21:23:42.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-26T21:23:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:42 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/4141762726' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-26T21:23:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:42 smithi064 ceph-mon[84240]: from='mgr.34104 172.21.15.55:0/397506636' entity='mgr.smithi055.ybbowr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-26T21:23:42.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:42 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1802557911' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 -- 172.21.15.55:0/425418445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 msgr2=0x7ff8cc1028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 --2- 172.21.15.55:0/425418445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1028d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009880 tx=0x7ff8bc02bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 -- 172.21.15.55:0/425418445 shutdown_connections 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 --2- 172.21.15.55:0/425418445 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc102ea0 0x7ff8cc106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 --2- 172.21.15.55:0/425418445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1028d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.057+0000 7ff8d1200640 1 -- 172.21.15.55:0/425418445 >> 172.21.15.55:0/425418445 conn(0x7ff8cc0fdd10 msgr2=0x7ff8cc100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.058+0000 7ff8d1200640 1 -- 172.21.15.55:0/425418445 shutdown_connections 2024-04-26T21:23:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.058+0000 7ff8d1200640 1 -- 172.21.15.55:0/425418445 wait complete. 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.058+0000 7ff8d1200640 1 Processor -- start 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8d1200640 1 -- start start 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8d1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8d1200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc198910 0x7ff8cc19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8d1200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc198e80 con 0x7ff8cc1024f0 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8d1200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc198ff0 con 0x7ff8cc198910 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38802/0 (socket says 172.21.15.55:38802) 2024-04-26T21:23:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.059+0000 7ff8c9e00640 1 -- 172.21.15.55:0/49380681 learned_addr learned my addr 172.21.15.55:0/49380681 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.060+0000 7ff8c9400640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc198910 0x7ff8cc19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.060+0000 7ff8c9e00640 1 -- 172.21.15.55:0/49380681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc198910 msgr2=0x7ff8cc19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.060+0000 7ff8c9e00640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc198910 0x7ff8cc19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.060+0000 7ff8c9e00640 1 -- 172.21.15.55:0/49380681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009560 con 0x7ff8cc1024f0 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.060+0000 7ff8c9e00640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc02c230 tx=0x7ff8bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.061+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc0035f0 con 0x7ff8cc1024f0 2024-04-26T21:23:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.061+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc19d250 con 0x7ff8cc1024f0 2024-04-26T21:23:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.061+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8bc003c10 con 0x7ff8cc1024f0 2024-04-26T21:23:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.061+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc03e460 con 0x7ff8cc1024f0 2024-04-26T21:23:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.061+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc19d760 con 0x7ff8cc1024f0 2024-04-26T21:23:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.062+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc0ff5c0 con 0x7ff8cc1024f0 2024-04-26T21:23:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.063+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff8bc004f40 con 0x7ff8cc1024f0 2024-04-26T21:23:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.064+0000 7ff8c2a00640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 0x7ff8b00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.064+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff8bc0b1750 con 0x7ff8cc1024f0 2024-04-26T21:23:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.064+0000 7ff8c9400640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 0x7ff8b00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.065+0000 7ff8c9400640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 0x7ff8b00710f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005e10 tx=0x7ff8b8005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:43.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.069+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff8bc07a410 con 0x7ff8cc1024f0 2024-04-26T21:23:43.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.321+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7ff8cc04e160 con 0x7ff8cc1024f0 2024-04-26T21:23:43.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.322+0000 7ff8c2a00640 1 -- 172.21.15.55:0/49380681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) v1 ==== 107+0+5200 (secure 0 0 0) 0x7ff8bc07dad0 con 0x7ff8cc1024f0 2024-04-26T21:23:43.323 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:43.323 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:34.345659+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":23,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:43.323 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2024-04-26T21:23:43.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 msgr2=0x7ff8b00710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 0x7ff8b00710f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005e10 tx=0x7ff8b8005da0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 msgr2=0x7ff8cc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc02c230 tx=0x7ff8bc004040 comp rx=0 tx=0).stop 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 shutdown_connections 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8cc198910 0x7ff8cc19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff8b006ec30 0x7ff8b00710f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 --2- 172.21.15.55:0/49380681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc1024f0 0x7ff8cc1983d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 >> 172.21.15.55:0/49380681 conn(0x7ff8cc0fdd10 msgr2=0x7ff8cc105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 shutdown_connections 2024-04-26T21:23:43.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.326+0000 7ff8d1200640 1 -- 172.21.15.55:0/49380681 wait complete. 2024-04-26T21:23:43.345 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-26T21:23:43.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.556+0000 7f5324e00640 1 -- 172.21.15.55:0/3107667978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 msgr2=0x7f53201028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.556+0000 7f5324e00640 1 --2- 172.21.15.55:0/3107667978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f53201028d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5310009880 tx=0x7f531002bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.556+0000 7f5324e00640 1 -- 172.21.15.55:0/3107667978 shutdown_connections 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.556+0000 7f5324e00640 1 --2- 172.21.15.55:0/3107667978 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5320102ea0 0x7f5320106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.557+0000 7f5324e00640 1 --2- 172.21.15.55:0/3107667978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f53201028d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.557+0000 7f5324e00640 1 -- 172.21.15.55:0/3107667978 >> 172.21.15.55:0/3107667978 conn(0x7f53200fdd50 msgr2=0x7f5320100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.557+0000 7f5324e00640 1 -- 172.21.15.55:0/3107667978 shutdown_connections 2024-04-26T21:23:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.557+0000 7f5324e00640 1 -- 172.21.15.55:0/3107667978 wait complete. 2024-04-26T21:23:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.558+0000 7f5324e00640 1 Processor -- start 2024-04-26T21:23:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.558+0000 7f5324e00640 1 -- start start 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f5324e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f5324e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53201988d0 0x7f532019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f5324e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320198ed0 con 0x7f53201024f0 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f5324e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320199040 con 0x7f53201988d0 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38810/0 (socket says 172.21.15.55:38810) 2024-04-26T21:23:43.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 -- 172.21.15.55:0/3178745869 learned_addr learned my addr 172.21.15.55:0/3178745869 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f5315400640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53201988d0 0x7f532019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 -- 172.21.15.55:0/3178745869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53201988d0 msgr2=0x7f532019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53201988d0 0x7f532019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.559+0000 7f531de00640 1 -- 172.21.15.55:0/3178745869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310009560 con 0x7f53201024f0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f531de00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f531002ceb0 tx=0x7f531002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53100035f0 con 0x7f53201024f0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5310003c10 con 0x7f53201024f0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5310005660 con 0x7f53201024f0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532019d220 con 0x7f53201024f0 2024-04-26T21:23:43.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.560+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532019d780 con 0x7f53201024f0 2024-04-26T21:23:43.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.562+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53201039c0 con 0x7f53201024f0 2024-04-26T21:23:43.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.563+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5310004ed0 con 0x7f53201024f0 2024-04-26T21:23:43.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.564+0000 7f5317400640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 0x7f53040710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:43.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.564+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f53100b1270 con 0x7f53201024f0 2024-04-26T21:23:43.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.564+0000 7f5315400640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 0x7f53040710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:43.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.565+0000 7f5315400640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 0x7f53040710f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f53080058c0 tx=0x7f5308005c60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:43.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.570+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5310079fb0 con 0x7f53201024f0 2024-04-26T21:23:43.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:43 smithi055 ceph-mon[109028]: pgmap v354: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:43.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:43 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3289337008' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-26T21:23:43.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:43 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/49380681' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-26T21:23:43.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.819+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f532019d9f0 con 0x7f53201024f0 2024-04-26T21:23:43.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.820+0000 7f5317400640 1 -- 172.21.15.55:0/3178745869 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) v1 ==== 107+0+5197 (secure 0 0 0) 0x7f531007d670 con 0x7f53201024f0 2024-04-26T21:23:43.820 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:43.821 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:35.368407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T21:23:43.821 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 33 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.822+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 msgr2=0x7f53040710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.822+0000 7f5324e00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 0x7f53040710f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f53080058c0 tx=0x7f5308005c60 comp rx=0 tx=0).stop 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.822+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 msgr2=0x7f5320198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.822+0000 7f5324e00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f531002ceb0 tx=0x7f531002c860 comp rx=0 tx=0).stop 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.822+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 shutdown_connections 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53201988d0 0x7f532019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f530406ec30 0x7f53040710f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 --2- 172.21.15.55:0/3178745869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53201024f0 0x7f5320198390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 >> 172.21.15.55:0/3178745869 conn(0x7f53200fdd50 msgr2=0x7f5320105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:43.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 shutdown_connections 2024-04-26T21:23:43.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:43.823+0000 7f5324e00640 1 -- 172.21.15.55:0/3178745869 wait complete. 2024-04-26T21:23:43.843 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-26T21:23:43.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-26T21:23:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:43 smithi064 ceph-mon[84240]: pgmap v354: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:43 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3289337008' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-26T21:23:43.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:43 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/49380681' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-26T21:23:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 -- 172.21.15.55:0/2150998389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c680675f0 msgr2=0x7f9c680679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 --2- 172.21.15.55:0/2150998389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c680675f0 0x7f9c680679d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009880 tx=0x7f9c5802bd10 comp rx=0 tx=0).stop 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 -- 172.21.15.55:0/2150998389 shutdown_connections 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 --2- 172.21.15.55:0/2150998389 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c68067fa0 0x7f9c68104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 --2- 172.21.15.55:0/2150998389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c680675f0 0x7f9c680679d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 -- 172.21.15.55:0/2150998389 >> 172.21.15.55:0/2150998389 conn(0x7f9c68074910 msgr2=0x7f9c68074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 -- 172.21.15.55:0/2150998389 shutdown_connections 2024-04-26T21:23:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.061+0000 7f9c67200640 1 -- 172.21.15.55:0/2150998389 wait complete. 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 Processor -- start 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 -- start start 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c680675f0 0x7f9c68196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68196bc0 con 0x7f9c681965c0 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c67200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68196d30 con 0x7f9c680675f0 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.062+0000 7f9c65400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38830/0 (socket says 172.21.15.55:38830) 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 -- 172.21.15.55:0/3161321774 learned_addr learned my addr 172.21.15.55:0/3161321774 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65e00640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c680675f0 0x7f9c68196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 -- 172.21.15.55:0/3161321774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c680675f0 msgr2=0x7f9c68196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c680675f0 0x7f9c68196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 -- 172.21.15.55:0/3161321774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c58009560 con 0x7f9c681965c0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.063+0000 7f9c65400640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b3d0 tx=0x7f9c5000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.064+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c50011800 con 0x7f9c681965c0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.064+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c50011e20 con 0x7f9c681965c0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.064+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5000f2e0 con 0x7f9c681965c0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.064+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6819af60 con 0x7f9c681965c0 2024-04-26T21:23:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.064+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6819b4c0 con 0x7f9c681965c0 2024-04-26T21:23:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.065+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c681015d0 con 0x7f9c681965c0 2024-04-26T21:23:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.067+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9c50010380 con 0x7f9c681965c0 2024-04-26T21:23:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.067+0000 7f9c5ea00640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 0x7f9c48071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.068+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9c5008ec70 con 0x7f9c681965c0 2024-04-26T21:23:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.068+0000 7f9c65e00640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 0x7f9c48071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.068+0000 7f9c65e00640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 0x7f9c48071100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006010 tx=0x7f9c58000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:44.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.073+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9c50095080 con 0x7f9c681965c0 2024-04-26T21:23:44.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.310+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f9c6819b770 con 0x7f9c681965c0 2024-04-26T21:23:44.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.312+0000 7f9c5ea00640 1 -- 172.21.15.55:0/3161321774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) v1 ==== 107+0+5206 (secure 0 0 0) 0x7f9c50057930 con 0x7f9c681965c0 2024-04-26T21:23:44.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:44.313 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:37.377536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:active","state_seq":25,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34462,"qdb_cluster":[34462]},"id":1}]} 2024-04-26T21:23:44.313 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 34 2024-04-26T21:23:44.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.314+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 msgr2=0x7f9c48071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.314+0000 7f9c67200640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 0x7f9c48071100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006010 tx=0x7f9c58000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.314+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 msgr2=0x7f9c6819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.314+0000 7f9c67200640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b3d0 tx=0x7f9c5000b890 comp rx=0 tx=0).stop 2024-04-26T21:23:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 shutdown_connections 2024-04-26T21:23:44.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9c4806ec40 0x7f9c48071100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c681965c0 0x7f9c6819a960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 --2- 172.21.15.55:0/3161321774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c680675f0 0x7f9c68196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 >> 172.21.15.55:0/3161321774 conn(0x7f9c68074910 msgr2=0x7f9c68103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:44.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 shutdown_connections 2024-04-26T21:23:44.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.315+0000 7f9c67200640 1 -- 172.21.15.55:0/3161321774 wait complete. 2024-04-26T21:23:44.332 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-04-26T21:23:44.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-26T21:23:44.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 -- 172.21.15.55:0/2502034221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c101900 msgr2=0x7f422c109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 --2- 172.21.15.55:0/2502034221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c101900 0x7f422c109de0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4214009880 tx=0x7f421402bd70 comp rx=0 tx=0).stop 2024-04-26T21:23:44.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 -- 172.21.15.55:0/2502034221 shutdown_connections 2024-04-26T21:23:44.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 --2- 172.21.15.55:0/2502034221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c101900 0x7f422c109de0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 --2- 172.21.15.55:0/2502034221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c100fe0 0x7f422c1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.552+0000 7f422b200640 1 -- 172.21.15.55:0/2502034221 >> 172.21.15.55:0/2502034221 conn(0x7f422c0759d0 msgr2=0x7f422c0fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.553+0000 7f422b200640 1 -- 172.21.15.55:0/2502034221 shutdown_connections 2024-04-26T21:23:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.553+0000 7f422b200640 1 -- 172.21.15.55:0/2502034221 wait complete. 2024-04-26T21:23:44.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.554+0000 7f422b200640 1 Processor -- start 2024-04-26T21:23:44.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.554+0000 7f422b200640 1 -- start start 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f422b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f422b200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c101900 0x7f422c0ff170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f422b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0ff6b0 con 0x7f422c100fe0 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f422b200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0ff820 con 0x7f422c101900 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38840/0 (socket says 172.21.15.55:38840) 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 -- 172.21.15.55:0/360931965 learned_addr learned my addr 172.21.15.55:0/360931965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229400640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c101900 0x7f422c0ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 -- 172.21.15.55:0/360931965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c101900 msgr2=0x7f422c0ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c101900 0x7f422c0ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.555+0000 7f4229e00640 1 -- 172.21.15.55:0/360931965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214009560 con 0x7f422c100fe0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f4229e00640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d6f0 tx=0x7f421c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c009a30 con 0x7f422c100fe0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f421c0054e0 con 0x7f422c100fe0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c1a2060 con 0x7f422c100fe0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c010460 con 0x7f422c100fe0 2024-04-26T21:23:44.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.556+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c1a23d0 con 0x7f422c100fe0 2024-04-26T21:23:44.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.558+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c067c60 con 0x7f422c100fe0 2024-04-26T21:23:44.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.559+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f421c009b90 con 0x7f422c100fe0 2024-04-26T21:23:44.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.560+0000 7f4222a00640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 0x7f42100710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:44.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.560+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f421c08ea60 con 0x7f422c100fe0 2024-04-26T21:23:44.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.561+0000 7f4229400640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 0x7f42100710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:44.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.561+0000 7f4229400640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 0x7f42100710f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f422c100360 tx=0x7f4214000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:44.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.565+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f421c0577c0 con 0x7f422c100fe0 2024-04-26T21:23:44.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:44 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3178745869' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-26T21:23:44.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:44 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3161321774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-26T21:23:44.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.805+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f422c1046c0 con 0x7f422c100fe0 2024-04-26T21:23:44.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.807+0000 7f4222a00640 1 -- 172.21.15.55:0/360931965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) v1 ==== 107+0+5206 (secure 0 0 0) 0x7f421c017090 con 0x7f422c100fe0 2024-04-26T21:23:44.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:44.807 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:48.386067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:active","state_seq":25,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34462,"qdb_cluster":[34462]},"id":1}]} 2024-04-26T21:23:44.808 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 msgr2=0x7f42100710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 0x7f42100710f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f422c100360 tx=0x7f4214000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 msgr2=0x7f422c0fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d6f0 tx=0x7f421c00dbb0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 shutdown_connections 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f422c101900 0x7f422c0ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f421006ec30 0x7f42100710f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 --2- 172.21.15.55:0/360931965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f422c100fe0 0x7f422c0fec30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 >> 172.21.15.55:0/360931965 conn(0x7f422c0759d0 msgr2=0x7f422c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 shutdown_connections 2024-04-26T21:23:44.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:44.809+0000 7f422b200640 1 -- 172.21.15.55:0/360931965 wait complete. 2024-04-26T21:23:44.827 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-04-26T21:23:44.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-04-26T21:23:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:44 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3178745869' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-26T21:23:44.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:44 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3161321774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 -- 172.21.15.55:0/21080811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 msgr2=0x7f5aa0074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/21080811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa0074d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009880 tx=0x7f5a9002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 -- 172.21.15.55:0/21080811 shutdown_connections 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/21080811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/21080811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa0074d00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.041+0000 7f5aa5e00640 1 -- 172.21.15.55:0/21080811 >> 172.21.15.55:0/21080811 conn(0x7f5aa00fdd80 msgr2=0x7f5aa01001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:45.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.042+0000 7f5aa5e00640 1 -- 172.21.15.55:0/21080811 shutdown_connections 2024-04-26T21:23:45.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.042+0000 7f5aa5e00640 1 -- 172.21.15.55:0/21080811 wait complete. 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 Processor -- start 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 -- start start 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01a3070 con 0x7f5aa0074920 2024-04-26T21:23:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5aa5e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa019c640 con 0x7f5aa0075240 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5a9ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5a9ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43154/0 (socket says 172.21.15.55:43154) 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.043+0000 7f5a9ea00640 1 -- 172.21.15.55:0/1945858194 learned_addr learned my addr 172.21.15.55:0/1945858194 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a9ea00640 1 -- 172.21.15.55:0/1945858194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 msgr2=0x7f5aa01a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a97e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a9ea00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a9ea00640 1 -- 172.21.15.55:0/1945858194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009560 con 0x7f5aa0074920 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a97e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5a9ea00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a90005ab0 tx=0x7f5a90004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.044+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a900035f0 con 0x7f5aa0074920 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.045+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a90003c10 con 0x7f5aa0074920 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.045+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa019c8c0 con 0x7f5aa0074920 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.045+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a90034440 con 0x7f5aa0074920 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.045+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa019cdc0 con 0x7f5aa0074920 2024-04-26T21:23:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.046+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa0076060 con 0x7f5aa0074920 2024-04-26T21:23:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.047+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5a90004dd0 con 0x7f5aa0074920 2024-04-26T21:23:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.048+0000 7f5aa4a00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 0x7f5a840710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.048+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5a900b12b0 con 0x7f5aa0074920 2024-04-26T21:23:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.048+0000 7f5a97e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 0x7f5a840710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.049+0000 7f5a97e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 0x7f5a840710f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.053+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f5a9007a090 con 0x7f5aa0074920 2024-04-26T21:23:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.305+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f5aa0113940 con 0x7f5aa0074920 2024-04-26T21:23:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.307+0000 7f5aa4a00640 1 -- 172.21.15.55:0/1945858194 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) v1 ==== 107+0+5205 (secure 0 0 0) 0x7f5a9007d750 con 0x7f5aa0074920 2024-04-26T21:23:45.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:45.307 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:49.387723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:active","state_seq":25,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34462,"qdb_cluster":[34462]},"id":1}]} 2024-04-26T21:23:45.308 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 36 2024-04-26T21:23:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 msgr2=0x7f5a840710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 0x7f5a840710f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88008040 comp rx=0 tx=0).stop 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 msgr2=0x7f5aa01a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5a90005ab0 tx=0x7f5a90004040 comp rx=0 tx=0).stop 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 shutdown_connections 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5aa0075240 0x7f5aa01a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f5a8406ec30 0x7f5a840710f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 --2- 172.21.15.55:0/1945858194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5aa0074920 0x7f5aa01a2510 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 >> 172.21.15.55:0/1945858194 conn(0x7f5aa00fdd80 msgr2=0x7f5aa00ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 shutdown_connections 2024-04-26T21:23:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.310+0000 7f5aa5e00640 1 -- 172.21.15.55:0/1945858194 wait complete. 2024-04-26T21:23:45.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 -- 172.21.15.55:0/160666030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e400675f0 msgr2=0x7f7e400679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 --2- 172.21.15.55:0/160666030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e400675f0 0x7f7e400679d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009880 tx=0x7f7e3002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 -- 172.21.15.55:0/160666030 shutdown_connections 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 --2- 172.21.15.55:0/160666030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e40067fa0 0x7f7e40104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 --2- 172.21.15.55:0/160666030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e400675f0 0x7f7e400679d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 -- 172.21.15.55:0/160666030 >> 172.21.15.55:0/160666030 conn(0x7f7e40074910 msgr2=0x7f7e40074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 -- 172.21.15.55:0/160666030 shutdown_connections 2024-04-26T21:23:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.530+0000 7f7e46600640 1 -- 172.21.15.55:0/160666030 wait complete. 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.531+0000 7f7e46600640 1 Processor -- start 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e46600640 1 -- start start 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e46600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e400675f0 0x7f7e401981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e46600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e46600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40198d10 con 0x7f7e40198710 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e46600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40198e80 con 0x7f7e400675f0 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43180/0 (socket says 172.21.15.55:43180) 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.532+0000 7f7e37e00640 1 -- 172.21.15.55:0/3309439132 learned_addr learned my addr 172.21.15.55:0/3309439132 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e45200640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e400675f0 0x7f7e401981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e37e00640 1 -- 172.21.15.55:0/3309439132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e400675f0 msgr2=0x7f7e401981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e37e00640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e400675f0 0x7f7e401981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e37e00640 1 -- 172.21.15.55:0/3309439132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009560 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e37e00640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800c920 tx=0x7f7e2800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e280041f0 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e28007e70 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4019d0b0 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.533+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e280049d0 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.534+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4019d610 con 0x7f7e40198710 2024-04-26T21:23:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.535+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4019d8f0 con 0x7f7e40198710 2024-04-26T21:23:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.536+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7e280050b0 con 0x7f7e40198710 2024-04-26T21:23:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.537+0000 7f7e3e000640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 0x7f7e240710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.537+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7e2808ed20 con 0x7f7e40198710 2024-04-26T21:23:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.537+0000 7f7e45200640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 0x7f7e240710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:45.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.538+0000 7f7e45200640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 0x7f7e240710f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e30006010 tx=0x7f7e30000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:45.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.542+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f7e28057a80 con 0x7f7e40198710 2024-04-26T21:23:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:45 smithi055 ceph-mon[109028]: pgmap v355: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:45 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/360931965' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-26T21:23:45.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:45 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1945858194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-26T21:23:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.779+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f7e401994d0 con 0x7f7e40198710 2024-04-26T21:23:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.781+0000 7f7e3e000640 1 -- 172.21.15.55:0/3309439132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) v1 ==== 107+0+5212 (secure 0 0 0) 0x7f7e2805b140 con 0x7f7e40198710 2024-04-26T21:23:45.781 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:45.781 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi064.ukvnjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6825/3858142462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":3858142462},{"type":"v1","addr":"172.21.15.64:6825","nonce":3858142462}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44339,"name":"cephfs.smithi064.xrdyeb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6827/1442123081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1442123081},{"type":"v1","addr":"172.21.15.64:6827","nonce":1442123081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T21:03:57.989144+0000","modified":"2024-04-26T21:20:50.399767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34462":{"gid":34462,"name":"cephfs.smithi055.coveew","rank":0,"incarnation":31,"state":"up:active","state_seq":25,"addr":"172.21.15.55:6827/498152331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":498152331},{"type":"v1","addr":"172.21.15.55:6827","nonce":498152331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34494":{"gid":34494,"name":"cephfs.smithi055.nwfjlb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6829/2855585077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2855585077},{"type":"v1","addr":"172.21.15.55:6829","nonce":2855585077}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34462,"qdb_cluster":[34462]},"id":1}]} 2024-04-26T21:23:45.782 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 37 2024-04-26T21:23:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.783+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 msgr2=0x7f7e240710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.783+0000 7f7e46600640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 0x7f7e240710f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e30006010 tx=0x7f7e30000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 msgr2=0x7f7e4019cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800c920 tx=0x7f7e2800cde0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 shutdown_connections 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f7e2406ec30 0x7f7e240710f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e40198710 0x7f7e4019cab0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 --2- 172.21.15.55:0/3309439132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e400675f0 0x7f7e401981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 >> 172.21.15.55:0/3309439132 conn(0x7f7e40074910 msgr2=0x7f7e40101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 shutdown_connections 2024-04-26T21:23:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:45.784+0000 7f7e46600640 1 -- 172.21.15.55:0/3309439132 wait complete. 2024-04-26T21:23:45.803 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T21:23:45.814 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T21:23:45.814 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T21:23:45.814 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:23:45.870 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-26T21:23:45.870 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:23:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:45 smithi064 ceph-mon[84240]: pgmap v355: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:45 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/360931965' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-26T21:23:45.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:45 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1945858194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-26T21:23:45.927 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.140+0000 7f80ce600640 1 -- 172.21.15.55:0/199712671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 msgr2=0x7f80c8072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.140+0000 7f80ce600640 1 --2- 172.21.15.55:0/199712671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c8072c00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009880 tx=0x7f80b802bd80 comp rx=0 tx=0).stop 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 -- 172.21.15.55:0/199712671 shutdown_connections 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 --2- 172.21.15.55:0/199712671 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c810c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 --2- 172.21.15.55:0/199712671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c8072c00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 -- 172.21.15.55:0/199712671 >> 172.21.15.55:0/199712671 conn(0x7f80c80fbb60 msgr2=0x7f80c80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 -- 172.21.15.55:0/199712671 shutdown_connections 2024-04-26T21:23:46.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.141+0000 7f80ce600640 1 -- 172.21.15.55:0/199712671 wait complete. 2024-04-26T21:23:46.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 Processor -- start 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 -- start start 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8198ec0 con 0x7f80c8072820 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80ce600640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c819cb60 con 0x7f80c8073140 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.142+0000 7f80c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43198/0 (socket says 172.21.15.55:43198) 2024-04-26T21:23:46.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 -- 172.21.15.55:0/2779952975 learned_addr learned my addr 172.21.15.55:0/2779952975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80bea00640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 -- 172.21.15.55:0/2779952975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 msgr2=0x7f80c8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 -- 172.21.15.55:0/2779952975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8009560 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80bea00640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.143+0000 7f80c7400640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009430 tx=0x7f80b802c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.144+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b8004520 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.144+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80b8003ab0 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.144+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c819cde0 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.144+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b80055d0 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.144+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c819d340 con 0x7f80c8072820 2024-04-26T21:23:46.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.145+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c8073ed0 con 0x7f80c8072820 2024-04-26T21:23:46.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.146+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f80b8004dd0 con 0x7f80c8072820 2024-04-26T21:23:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.147+0000 7f80c4c00640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 0x7f80ac071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.147+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f80b80b1980 con 0x7f80c8072820 2024-04-26T21:23:46.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.147+0000 7f80bea00640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 0x7f80ac071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.148+0000 7f80bea00640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 0x7f80ac071100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f80c8109660 tx=0x7f80b0005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:46.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.152+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f80b807a760 con 0x7f80c8072820 2024-04-26T21:23:46.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.359+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c804e160 con 0x7f80c8072820 2024-04-26T21:23:46.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.361+0000 7f80c4c00640 1 -- 172.21.15.55:0/2779952975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16736 (secure 0 0 0) 0x7f80b807de20 con 0x7f80c8072820 2024-04-26T21:23:46.362 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:46.362 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:20:26.260042+0000","last_up_change":"2024-04-26T21:18:42.568192+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:03:56.593833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:03:57.521866+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6803","nonce":307437476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6805","nonce":307437476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6809","nonce":307437476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6807","nonce":307437476}]},"public_addr":"172.21.15.55:6803/307437476","cluster_addr":"172.21.15.55:6805/307437476","heartbeat_back_addr":"172.21.15.55:6809/307437476","heartbeat_front_addr":"172.21.15.55:6807/307437476","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6811","nonce":3666316230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6813","nonce":3666316230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6817","nonce":3666316230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6815","nonce":3666316230}]},"public_addr":"172.21.15.55:6811/3666316230","cluster_addr":"172.21.15.55:6813/3666316230","heartbeat_back_addr":"172.21.15.55:6817/3666316230","heartbeat_front_addr":"172.21.15.55:6815/3666316230","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6819","nonce":2146980962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6821","nonce":2146980962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6825","nonce":2146980962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6823","nonce":2146980962}]},"public_addr":"172.21.15.55:6819/2146980962","cluster_addr":"172.21.15.55:6821/2146980962","heartbeat_back_addr":"172.21.15.55:6825/2146980962","heartbeat_front_addr":"172.21.15.55:6823/2146980962","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6801","nonce":2708520812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6803","nonce":2708520812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6807","nonce":2708520812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6805","nonce":2708520812}]},"public_addr":"172.21.15.64:6801/2708520812","cluster_addr":"172.21.15.64:6803/2708520812","heartbeat_back_addr":"172.21.15.64:6807/2708520812","heartbeat_front_addr":"172.21.15.64:6805/2708520812","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6809","nonce":3376099307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6811","nonce":3376099307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6815","nonce":3376099307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6813","nonce":3376099307}]},"public_addr":"172.21.15.64:6809/3376099307","cluster_addr":"172.21.15.64:6811/3376099307","heartbeat_back_addr":"172.21.15.64:6815/3376099307","heartbeat_front_addr":"172.21.15.64:6813/3376099307","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6817","nonce":2282216695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6819","nonce":2282216695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6823","nonce":2282216695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6821","nonce":2282216695}]},"public_addr":"172.21.15.64:6817/2282216695","cluster_addr":"172.21.15.64:6819/2282216695","heartbeat_back_addr":"172.21.15.64:6823/2282216695","heartbeat_front_addr":"172.21.15.64:6821/2282216695","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6827/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.64:6826/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.55:6829/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6828/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6827/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3680986491":"2024-04-27T21:13:11.675470+0000","172.21.15.64:0/3692425588":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2020032469":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2401109697":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6826/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.64:0/1265976667":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6801/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2964479330":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/2338326874":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2401553078":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6800/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/108673769":"2024-04-27T21:06:59.742397+0000","172.21.15.64:0/359559082":"2024-04-27T21:08:25.366623+0000","172.21.15.64:6829/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.64:6828/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3943565490":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/1497600698":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.64:0/3627849680":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:0/218375879":"2024-04-27T21:13:11.675470+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 msgr2=0x7f80ac071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 0x7f80ac071100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f80c8109660 tx=0x7f80b0005d30 comp rx=0 tx=0).stop 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 msgr2=0x7f80c81982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009430 tx=0x7f80b802c8f0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 shutdown_connections 2024-04-26T21:23:46.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80c8073140 0x7f80c8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f80ac06ec40 0x7f80ac071100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 --2- 172.21.15.55:0/2779952975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80c8072820 0x7f80c81982f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 >> 172.21.15.55:0/2779952975 conn(0x7f80c80fbb60 msgr2=0x7f80c8104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 shutdown_connections 2024-04-26T21:23:46.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.364+0000 7f80ce600640 1 -- 172.21.15.55:0/2779952975 wait complete. 2024-04-26T21:23:46.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:00:32.215135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:03:56.593833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:03:57.521866+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:23:46.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 -- 172.21.15.55:0/3800086141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100ab0 msgr2=0x7fb6e8104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 --2- 172.21.15.55:0/3800086141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100ab0 0x7fb6e8104af0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009880 tx=0x7fb6d002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 -- 172.21.15.55:0/3800086141 shutdown_connections 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 --2- 172.21.15.55:0/3800086141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100ab0 0x7fb6e8104af0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 --2- 172.21.15.55:0/3800086141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e8100100 0x7fb6e81004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 -- 172.21.15.55:0/3800086141 >> 172.21.15.55:0/3800086141 conn(0x7fb6e80fb980 msgr2=0x7fb6e80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 -- 172.21.15.55:0/3800086141 shutdown_connections 2024-04-26T21:23:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.606+0000 7fb6ed200640 1 -- 172.21.15.55:0/3800086141 wait complete. 2024-04-26T21:23:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.607+0000 7fb6ed200640 1 Processor -- start 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.607+0000 7fb6ed200640 1 -- start start 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6ed200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6ed200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 0x7fb6e819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6ed200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e8196aa0 con 0x7fb6e8100100 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6ed200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e8196c10 con 0x7fb6e81964a0 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43224/0 (socket says 172.21.15.55:43224) 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 -- 172.21.15.55:0/1920586733 learned_addr learned my addr 172.21.15.55:0/1920586733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e6a00640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 0x7fb6e819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 -- 172.21.15.55:0/1920586733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 msgr2=0x7fb6e819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 0x7fb6e819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e7400640 1 -- 172.21.15.55:0/1920586733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009560 con 0x7fb6e8100100 2024-04-26T21:23:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.608+0000 7fb6e6a00640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 0x7fb6e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6e7400640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800ea30 tx=0x7fb6d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d800cdb0 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6d8005020 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e819ae40 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d80116a0 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.609+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e819b3a0 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.610+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e819b680 con 0x7fb6e8100100 2024-04-26T21:23:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.611+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb6d8005190 con 0x7fb6e8100100 2024-04-26T21:23:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.613+0000 7fb6dfe00640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 0x7fb6cc071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.613+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb6d808f3e0 con 0x7fb6e8100100 2024-04-26T21:23:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.613+0000 7fb6e6a00640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 0x7fb6cc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.614+0000 7fb6e6a00640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 0x7fb6cc071100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0036040 tx=0x7fb6d002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.618+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fb6d80580a0 con 0x7fb6e8100100 2024-04-26T21:23:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:46 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3309439132' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-26T21:23:46.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:46 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/2779952975' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:46.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.825+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6e8197260 con 0x7fb6e8100100 2024-04-26T21:23:46.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.827+0000 7fb6dfe00640 1 -- 172.21.15.55:0/1920586733 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6d805b760 con 0x7fb6e8100100 2024-04-26T21:23:46.827 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 msgr2=0x7fb6cc071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 0x7fb6cc071100 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0036040 tx=0x7fb6d002cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 msgr2=0x7fb6e8195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800ea30 tx=0x7fb6d800eef0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 shutdown_connections 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6e81964a0 0x7fb6e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fb6cc06ec40 0x7fb6cc071100 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.829+0000 7fb6ed200640 1 --2- 172.21.15.55:0/1920586733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6e8100100 0x7fb6e8195f60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.830+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 >> 172.21.15.55:0/1920586733 conn(0x7fb6e80fb980 msgr2=0x7fb6e80fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.830+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 shutdown_connections 2024-04-26T21:23:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:46.830+0000 7fb6ed200640 1 -- 172.21.15.55:0/1920586733 wait complete. 2024-04-26T21:23:46.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:23:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:46 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3309439132' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-26T21:23:46.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:46 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/2779952975' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.056+0000 7fdf91400640 1 -- 172.21.15.55:0/1135005565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 msgr2=0x7fdf8c1004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.056+0000 7fdf91400640 1 --2- 172.21.15.55:0/1135005565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c1004e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009880 tx=0x7fdf7c02bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 -- 172.21.15.55:0/1135005565 shutdown_connections 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 --2- 172.21.15.55:0/1135005565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c100ab0 0x7fdf8c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 --2- 172.21.15.55:0/1135005565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c1004e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 -- 172.21.15.55:0/1135005565 >> 172.21.15.55:0/1135005565 conn(0x7fdf8c0fb980 msgr2=0x7fdf8c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 -- 172.21.15.55:0/1135005565 shutdown_connections 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.057+0000 7fdf91400640 1 -- 172.21.15.55:0/1135005565 wait complete. 2024-04-26T21:23:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 Processor -- start 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 -- start start 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 0x7fdf8c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c196a70 con 0x7fdf8c100100 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.058+0000 7fdf91400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c196be0 con 0x7fdf8c196470 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43242/0 (socket says 172.21.15.55:43242) 2024-04-26T21:23:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 -- 172.21.15.55:0/121346183 learned_addr learned my addr 172.21.15.55:0/121346183 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf83400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 0x7fdf8c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 -- 172.21.15.55:0/121346183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 msgr2=0x7fdf8c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 0x7fdf8c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf8be00640 1 -- 172.21.15.55:0/121346183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009560 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.059+0000 7fdf83400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 0x7fdf8c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf8be00640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c02ceb0 tx=0x7fdf7c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf7c0035f0 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf7c003c10 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c19ae10 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf7c005660 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.060+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c19b370 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.061+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c1015d0 con 0x7fdf8c100100 2024-04-26T21:23:47.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.062+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdf7c004ed0 con 0x7fdf8c100100 2024-04-26T21:23:47.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.064+0000 7fdf89600640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 0x7fdf70071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.064+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdf7c0b1270 con 0x7fdf8c100100 2024-04-26T21:23:47.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.064+0000 7fdf83400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 0x7fdf70071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.065+0000 7fdf83400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 0x7fdf70071100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf740058c0 tx=0x7fdf74005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.069+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7fdf7c079fb0 con 0x7fdf8c100100 2024-04-26T21:23:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.278+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fdf8c197260 con 0x7fdf8c100100 2024-04-26T21:23:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.279+0000 7fdf89600640 1 -- 172.21.15.55:0/121346183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdf7c07d670 con 0x7fdf8c100100 2024-04-26T21:23:47.279 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 msgr2=0x7fdf70071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 0x7fdf70071100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf740058c0 tx=0x7fdf74005d30 comp rx=0 tx=0).stop 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 msgr2=0x7fdf8c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c02ceb0 tx=0x7fdf7c02c860 comp rx=0 tx=0).stop 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 shutdown_connections 2024-04-26T21:23:47.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c196470 0x7fdf8c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7fdf7006ec40 0x7fdf70071100 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 --2- 172.21.15.55:0/121346183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf8c100100 0x7fdf8c195f30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 >> 172.21.15.55:0/121346183 conn(0x7fdf8c0fb980 msgr2=0x7fdf8c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 shutdown_connections 2024-04-26T21:23:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.282+0000 7fdf91400640 1 -- 172.21.15.55:0/121346183 wait complete. 2024-04-26T21:23:47.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 -- 172.21.15.55:0/3591635970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 msgr2=0x7f6fc0102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 --2- 172.21.15.55:0/3591635970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0102710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009880 tx=0x7f6fb002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 -- 172.21.15.55:0/3591635970 shutdown_connections 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 --2- 172.21.15.55:0/3591635970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fc0102ce0 0x7f6fc0106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 --2- 172.21.15.55:0/3591635970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0102710 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 -- 172.21.15.55:0/3591635970 >> 172.21.15.55:0/3591635970 conn(0x7f6fc00fdbb0 msgr2=0x7f6fc00fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 -- 172.21.15.55:0/3591635970 shutdown_connections 2024-04-26T21:23:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.500+0000 7f6fc5400640 1 -- 172.21.15.55:0/3591635970 wait complete. 2024-04-26T21:23:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 Processor -- start 2024-04-26T21:23:47.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 -- start start 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fc01986a0 0x7f6fc019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0198ca0 con 0x7f6fc0102330 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.502+0000 7f6fc5400640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0198e10 con 0x7f6fc01986a0 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43268/0 (socket says 172.21.15.55:43268) 2024-04-26T21:23:47.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 -- 172.21.15.55:0/4262842792 learned_addr learned my addr 172.21.15.55:0/4262842792 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 -- 172.21.15.55:0/4262842792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fc01986a0 msgr2=0x7f6fc019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fc01986a0 0x7f6fc019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 -- 172.21.15.55:0/4262842792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0009560 con 0x7f6fc0102330 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.503+0000 7f6fbfe00640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0036040 tx=0x7f6fb0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.504+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb00035f0 con 0x7f6fc0102330 2024-04-26T21:23:47.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.504+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fb0003c10 con 0x7f6fc0102330 2024-04-26T21:23:47.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.504+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb0034440 con 0x7f6fc0102330 2024-04-26T21:23:47.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.504+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc019cf90 con 0x7f6fc0102330 2024-04-26T21:23:47.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.504+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc019d4f0 con 0x7f6fc0102330 2024-04-26T21:23:47.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.505+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc0103800 con 0x7f6fc0102330 2024-04-26T21:23:47.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.506+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6fb0004f60 con 0x7f6fc0102330 2024-04-26T21:23:47.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.507+0000 7f6fbcc00640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 0x7f6fa40710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.507+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6fb00b1220 con 0x7f6fc0102330 2024-04-26T21:23:47.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.508+0000 7f6fbf400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 0x7f6fa40710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.508+0000 7f6fbf400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 0x7f6fa40710f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0073fd0 tx=0x7f6fac005bf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.512+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f6fb007a000 con 0x7f6fc0102330 2024-04-26T21:23:47.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.722+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6fc010a630 con 0x7f6fc0102330 2024-04-26T21:23:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.723+0000 7f6fbcc00640 1 -- 172.21.15.55:0/4262842792 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6fb007d6c0 con 0x7f6fc0102330 2024-04-26T21:23:47.724 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 msgr2=0x7f6fa40710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 0x7f6fa40710f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0073fd0 tx=0x7f6fac005bf0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 msgr2=0x7f6fc0198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0036040 tx=0x7f6fb0004040 comp rx=0 tx=0).stop 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 shutdown_connections 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6fc01986a0 0x7f6fc019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f6fa406ec30 0x7f6fa40710f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 --2- 172.21.15.55:0/4262842792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fc0102330 0x7f6fc0198160 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 >> 172.21.15.55:0/4262842792 conn(0x7f6fc00fdbb0 msgr2=0x7f6fc00fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 shutdown_connections 2024-04-26T21:23:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.726+0000 7f6fc5400640 1 -- 172.21.15.55:0/4262842792 wait complete. 2024-04-26T21:23:47.742 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:47 smithi055 ceph-mon[109028]: pgmap v356: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:47.742 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:47 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1920586733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:47.742 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:47 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/121346183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:47.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:23:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:47 smithi064 ceph-mon[84240]: pgmap v356: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:47 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1920586733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:47.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:47 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/121346183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 -- 172.21.15.55:0/2318739895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 msgr2=0x7ff86c101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 --2- 172.21.15.55:0/2318739895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c101620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009880 tx=0x7ff85c02bd90 comp rx=0 tx=0).stop 2024-04-26T21:23:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 -- 172.21.15.55:0/2318739895 shutdown_connections 2024-04-26T21:23:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 --2- 172.21.15.55:0/2318739895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 0x7ff86c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 --2- 172.21.15.55:0/2318739895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c101620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 -- 172.21.15.55:0/2318739895 >> 172.21.15.55:0/2318739895 conn(0x7ff86c075c40 msgr2=0x7ff86c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 -- 172.21.15.55:0/2318739895 shutdown_connections 2024-04-26T21:23:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.970+0000 7ff871200640 1 -- 172.21.15.55:0/2318739895 wait complete. 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.971+0000 7ff871200640 1 Processor -- start 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.971+0000 7ff871200640 1 -- start start 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff871200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff871200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 0x7ff86c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff871200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c198de0 con 0x7ff86c101240 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff871200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c198f50 con 0x7ff86c101b60 2024-04-26T21:23:47.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff869e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff869e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43282/0 (socket says 172.21.15.55:43282) 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff869e00640 1 -- 172.21.15.55:0/817522652 learned_addr learned my addr 172.21.15.55:0/817522652 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.972+0000 7ff869400640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 0x7ff86c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff869e00640 1 -- 172.21.15.55:0/817522652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 msgr2=0x7ff86c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff869e00640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 0x7ff86c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff869e00640 1 -- 172.21.15.55:0/817522652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c009560 con 0x7ff86c101240 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff869e00640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009430 tx=0x7ff85c02c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c004520 con 0x7ff86c101240 2024-04-26T21:23:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff85c003ab0 con 0x7ff86c101240 2024-04-26T21:23:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c19ccc0 con 0x7ff86c101240 2024-04-26T21:23:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.973+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c0055d0 con 0x7ff86c101240 2024-04-26T21:23:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.974+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c19d220 con 0x7ff86c101240 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.975+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c067c60 con 0x7ff86c101240 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.976+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff85c004dd0 con 0x7ff86c101240 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.977+0000 7ff862a00640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 0x7ff8500710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.977+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff85c0b1a50 con 0x7ff86c101240 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.977+0000 7ff869400640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 0x7ff8500710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.978+0000 7ff869400640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 0x7ff8500710a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff858005fd0 tx=0x7ff858005f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:47.982+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7ff85c07a7b0 con 0x7ff86c101240 2024-04-26T21:23:48.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.203+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff86c04e160 con 0x7ff86c101240 2024-04-26T21:23:48.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.204+0000 7ff862a00640 1 -- 172.21.15.55:0/817522652 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2420 (secure 0 0 0) 0x7ff85c07de70 con 0x7ff86c101240 2024-04-26T21:23:48.204 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6827/258074733 2024-04-27T21:20:26.259982+0000 2024-04-26T21:23:48.204 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6826/258074733 2024-04-27T21:20:26.259982+0000 2024-04-26T21:23:48.204 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6829/1757258712 2024-04-27T21:19:32.204707+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6828/1757258712 2024-04-27T21:19:32.204707+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6827/2158832788 2024-04-27T21:18:56.003369+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/4088155030 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/4088155030 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/164718892 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/435275509 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3680986491 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/3692425588 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2020032469 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2401109697 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6826/2158832788 2024-04-27T21:18:56.003369+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/1265976667 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/912138010 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2964479330 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/4047324171 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:48.205 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/2338326874 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2401553078 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/912138010 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/108673769 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/359559082 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6829/1518549536 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2358731820 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/154137240 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6828/1518549536 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/154137240 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3032989181 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:48.206 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2810095520 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2276472174 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3943565490 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3951282282 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/1497600698 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/305427654 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/3627849680 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1897911263 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2398171578 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2398171578 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2358731820 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:48.207 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/218375879 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:listed 41 entries 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 msgr2=0x7ff8500710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 0x7ff8500710a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff858005fd0 tx=0x7ff858005f60 comp rx=0 tx=0).stop 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 msgr2=0x7ff86c1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009430 tx=0x7ff85c02c900 comp rx=0 tx=0).stop 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 shutdown_connections 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff86c101b60 0x7ff86c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7ff85006ebe0 0x7ff8500710a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 --2- 172.21.15.55:0/817522652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c101240 0x7ff86c1982a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 >> 172.21.15.55:0/817522652 conn(0x7ff86c075c40 msgr2=0x7ff86c109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 shutdown_connections 2024-04-26T21:23:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.207+0000 7ff871200640 1 -- 172.21.15.55:0/817522652 wait complete. 2024-04-26T21:23:48.227 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T21:23:48.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:48.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T21:23:48.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:23:48.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:48.306 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T21:23:48.412 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T21:23:48.412 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:23:48.472 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-26T21:23:48.472 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:23:48.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:23:48.606 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:48 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/4262842792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:48.607 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:48 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/817522652' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 -- 172.21.15.55:0/2148506254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888100c90 msgr2=0x7f3888104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 --2- 172.21.15.55:0/2148506254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888100c90 0x7f3888104cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3870009880 tx=0x7f387002bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 -- 172.21.15.55:0/2148506254 shutdown_connections 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 --2- 172.21.15.55:0/2148506254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888100c90 0x7f3888104cd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 --2- 172.21.15.55:0/2148506254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38881002e0 0x7f38881006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 -- 172.21.15.55:0/2148506254 >> 172.21.15.55:0/2148506254 conn(0x7f38880fbb60 msgr2=0x7f38880fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 -- 172.21.15.55:0/2148506254 shutdown_connections 2024-04-26T21:23:48.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.747+0000 7f388d000640 1 -- 172.21.15.55:0/2148506254 wait complete. 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.748+0000 7f388d000640 1 Processor -- start 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f388d000640 1 -- start start 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f388d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f388d000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888196720 0x7f388819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f388d000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3888196d20 con 0x7f38881002e0 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f388d000640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3888196e90 con 0x7f3888196720 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f3885e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f3885e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43310/0 (socket says 172.21.15.55:43310) 2024-04-26T21:23:48.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.749+0000 7f3885e00640 1 -- 172.21.15.55:0/1579819279 learned_addr learned my addr 172.21.15.55:0/1579819279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:48.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.750+0000 7f3885400640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888196720 0x7f388819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:48.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.750+0000 7f3885e00640 1 -- 172.21.15.55:0/1579819279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888196720 msgr2=0x7f388819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.750+0000 7f3885e00640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888196720 0x7f388819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.750+0000 7f3885e00640 1 -- 172.21.15.55:0/1579819279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009560 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.750+0000 7f3885e00640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f387800d720 tx=0x7f387800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.751+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38780051f0 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.751+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3878009ce0 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.751+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388819b0c0 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.751+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3878010460 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.751+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388819b620 con 0x7f38881002e0 2024-04-26T21:23:48.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.752+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388819b8f0 con 0x7f38881002e0 2024-04-26T21:23:48.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.753+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3878005350 con 0x7f38881002e0 2024-04-26T21:23:48.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.754+0000 7f387ea00640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 0x7f386c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:48.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.755+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f387808e9b0 con 0x7f38881002e0 2024-04-26T21:23:48.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.755+0000 7f3885400640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 0x7f386c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:48.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.756+0000 7f3885400640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 0x7f386c0710f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3870006010 tx=0x7f3870005b70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:48.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.765+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f3878057790 con 0x7f38881002e0 2024-04-26T21:23:48.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:48 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/4262842792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:48.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:48 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/817522652' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:23:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.976+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38881974e0 con 0x7f38881002e0 2024-04-26T21:23:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.980+0000 7f387ea00640 1 -- 172.21.15.55:0/1579819279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16736 (secure 0 0 0) 0x7f3878017090 con 0x7f38881002e0 2024-04-26T21:23:48.982 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-26T21:23:48.982 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"fsid":"fbc85ba0-040e-11ef-bc93-c7b262605968","created":"2024-04-26T20:54:19.522840+0000","modified":"2024-04-26T21:20:26.260042+0000","last_up_change":"2024-04-26T21:18:42.568192+0000","last_in_change":"2024-04-26T21:01:52.889112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:00:32.215135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-26T21:03:56.593833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-26T21:03:57.521866+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5bf35a1-adc3-4e73-8968-1bf88bc80fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6803","nonce":307437476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6805","nonce":307437476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6809","nonce":307437476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":307437476},{"type":"v1","addr":"172.21.15.55:6807","nonce":307437476}]},"public_addr":"172.21.15.55:6803/307437476","cluster_addr":"172.21.15.55:6805/307437476","heartbeat_back_addr":"172.21.15.55:6809/307437476","heartbeat_front_addr":"172.21.15.55:6807/307437476","state":["exists","up"]},{"osd":1,"uuid":"e3153742-3be4-40d5-9f37-da19d515b5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6811","nonce":3666316230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6813","nonce":3666316230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6817","nonce":3666316230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3666316230},{"type":"v1","addr":"172.21.15.55:6815","nonce":3666316230}]},"public_addr":"172.21.15.55:6811/3666316230","cluster_addr":"172.21.15.55:6813/3666316230","heartbeat_back_addr":"172.21.15.55:6817/3666316230","heartbeat_front_addr":"172.21.15.55:6815/3666316230","state":["exists","up"]},{"osd":2,"uuid":"04b01aca-d29c-4eae-8676-f25c3670cd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6819","nonce":2146980962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6821","nonce":2146980962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6825","nonce":2146980962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2146980962},{"type":"v1","addr":"172.21.15.55:6823","nonce":2146980962}]},"public_addr":"172.21.15.55:6819/2146980962","cluster_addr":"172.21.15.55:6821/2146980962","heartbeat_back_addr":"172.21.15.55:6825/2146980962","heartbeat_front_addr":"172.21.15.55:6823/2146980962","state":["exists","up"]},{"osd":3,"uuid":"451e4cc2-a142-42e7-af62-c34d3ea9017d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6801","nonce":2708520812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6803","nonce":2708520812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6807","nonce":2708520812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":2708520812},{"type":"v1","addr":"172.21.15.64:6805","nonce":2708520812}]},"public_addr":"172.21.15.64:6801/2708520812","cluster_addr":"172.21.15.64:6803/2708520812","heartbeat_back_addr":"172.21.15.64:6807/2708520812","heartbeat_front_addr":"172.21.15.64:6805/2708520812","state":["exists","up"]},{"osd":4,"uuid":"fad5ee98-3422-47cf-9915-11690ee0dea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6809","nonce":3376099307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6811","nonce":3376099307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6815","nonce":3376099307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3376099307},{"type":"v1","addr":"172.21.15.64:6813","nonce":3376099307}]},"public_addr":"172.21.15.64:6809/3376099307","cluster_addr":"172.21.15.64:6811/3376099307","heartbeat_back_addr":"172.21.15.64:6815/3376099307","heartbeat_front_addr":"172.21.15.64:6813/3376099307","state":["exists","up"]},{"osd":5,"uuid":"67735946-26c0-4d63-a775-363b3cc0ccbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6817","nonce":2282216695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6819","nonce":2282216695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6823","nonce":2282216695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2282216695},{"type":"v1","addr":"172.21.15.64:6821","nonce":2282216695}]},"public_addr":"172.21.15.64:6817/2282216695","cluster_addr":"172.21.15.64:6819/2282216695","heartbeat_back_addr":"172.21.15.64:6823/2282216695","heartbeat_front_addr":"172.21.15.64:6821/2282216695","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:08.811651+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:59:49.421113+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:00:29.953846+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:05.179517+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:01:39.897363+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:02:16.194168+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6827/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.64:6826/258074733":"2024-04-27T21:20:26.259982+0000","172.21.15.55:6829/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6828/1757258712":"2024-04-27T21:19:32.204707+0000","172.21.15.55:6827/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.55:6800/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:6801/4088155030":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/164718892":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/435275509":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3680986491":"2024-04-27T21:13:11.675470+0000","172.21.15.64:0/3692425588":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2020032469":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2401109697":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6826/2158832788":"2024-04-27T21:18:56.003369+0000","172.21.15.64:0/1265976667":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6801/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/2964479330":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/4047324171":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/2338326874":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/2401553078":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6800/912138010":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/108673769":"2024-04-27T21:06:59.742397+0000","172.21.15.64:0/359559082":"2024-04-27T21:08:25.366623+0000","172.21.15.64:6829/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6801/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.64:6828/1518549536":"2024-04-27T21:08:25.366623+0000","172.21.15.55:6800/154137240":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/3032989181":"2024-04-27T20:57:21.478634+0000","172.21.15.55:0/2810095520":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/2276472174":"2024-04-27T20:55:02.938534+0000","172.21.15.55:0/3943565490":"2024-04-27T21:06:59.742397+0000","172.21.15.55:0/3951282282":"2024-04-27T20:55:46.378997+0000","172.21.15.64:0/1497600698":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/305427654":"2024-04-27T20:57:21.478634+0000","172.21.15.64:0/3627849680":"2024-04-27T21:08:25.366623+0000","172.21.15.55:0/1897911263":"2024-04-27T20:55:46.378997+0000","172.21.15.55:6800/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2398171578":"2024-04-27T21:13:11.675470+0000","172.21.15.55:6801/2358731820":"2024-04-27T20:55:46.378997+0000","172.21.15.55:0/218375879":"2024-04-27T21:13:11.675470+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:23:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 msgr2=0x7f386c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 0x7f386c0710f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3870006010 tx=0x7f3870005b70 comp rx=0 tx=0).stop 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 msgr2=0x7f38881961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f387800d720 tx=0x7f387800dbe0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 shutdown_connections 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888196720 0x7f388819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f386c06ec30 0x7f386c0710f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 --2- 172.21.15.55:0/1579819279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38881002e0 0x7f38881961e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 >> 172.21.15.55:0/1579819279 conn(0x7f38880fbb60 msgr2=0x7f38880fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 shutdown_connections 2024-04-26T21:23:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:48.983+0000 7f388d000640 1 -- 172.21.15.55:0/1579819279 wait complete. 2024-04-26T21:23:49.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:00:32.215135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-26T21:03:56.593833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-26T21:03:57.521866+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:23:49.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:23:49.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 -- 172.21.15.55:0/799966548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0100aa0 msgr2=0x7f0cc0104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/799966548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0100aa0 0x7f0cc0104ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009880 tx=0x7f0ca802bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 -- 172.21.15.55:0/799966548 shutdown_connections 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/799966548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0100aa0 0x7f0cc0104ae0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/799966548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 0x7f0cc01004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 -- 172.21.15.55:0/799966548 >> 172.21.15.55:0/799966548 conn(0x7f0cc00fb970 msgr2=0x7f0cc00fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 -- 172.21.15.55:0/799966548 shutdown_connections 2024-04-26T21:23:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.225+0000 7f0cbfe00640 1 -- 172.21.15.55:0/799966548 wait complete. 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.226+0000 7f0cbfe00640 1 Processor -- start 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.226+0000 7f0cbfe00640 1 -- start start 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.226+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 0x7f0cc01981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.226+0000 7f0cbfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0198ce0 con 0x7f0cc01986e0 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cbfe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0198e50 con 0x7f0cc01000f0 2024-04-26T21:23:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43332/0 (socket says 172.21.15.55:43332) 2024-04-26T21:23:49.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 -- 172.21.15.55:0/1296019354 learned_addr learned my addr 172.21.15.55:0/1296019354 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cbea00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 0x7f0cc01981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 -- 172.21.15.55:0/1296019354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 msgr2=0x7f0cc01981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 0x7f0cc01981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.227+0000 7f0cb6000640 1 -- 172.21.15.55:0/1296019354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009560 con 0x7f0cc01986e0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cb6000640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802ca00 tx=0x7f0ca802c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca80035f0 con 0x7f0cc01986e0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ca8003c10 con 0x7f0cc01986e0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca80055f0 con 0x7f0cc01986e0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc019d080 con 0x7f0cc01986e0 2024-04-26T21:23:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.228+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc019d5e0 con 0x7f0cc01986e0 2024-04-26T21:23:49.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.229+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc019d8c0 con 0x7f0cc01986e0 2024-04-26T21:23:49.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.230+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ca8004e60 con 0x7f0cc01986e0 2024-04-26T21:23:49.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.231+0000 7f0cb7e00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 0x7f0ca4071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.231+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0ca80b11d0 con 0x7f0cc01986e0 2024-04-26T21:23:49.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.232+0000 7f0cbea00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 0x7f0ca4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.232+0000 7f0cbea00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 0x7f0ca4071100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005fd0 tx=0x7f0cb0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:49.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.236+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f0ca8079f10 con 0x7f0cc01986e0 2024-04-26T21:23:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.449+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cc0073da0 con 0x7f0cc01986e0 2024-04-26T21:23:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.450+0000 7f0cb7e00640 1 -- 172.21.15.55:0/1296019354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ca807d5d0 con 0x7f0cc01986e0 2024-04-26T21:23:49.451 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.452+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 msgr2=0x7f0ca4071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.452+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 0x7f0ca4071100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005fd0 tx=0x7f0cb0005850 comp rx=0 tx=0).stop 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.452+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 msgr2=0x7f0cc019ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.452+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ca802ca00 tx=0x7f0ca802c7d0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.452+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 shutdown_connections 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f0ca406ec40 0x7f0ca4071100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc01986e0 0x7f0cc019ca80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 --2- 172.21.15.55:0/1296019354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc01000f0 0x7f0cc01981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 >> 172.21.15.55:0/1296019354 conn(0x7f0cc00fb970 msgr2=0x7f0cc00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:49.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 shutdown_connections 2024-04-26T21:23:49.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.453+0000 7f0cbfe00640 1 -- 172.21.15.55:0/1296019354 wait complete. 2024-04-26T21:23:49.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 -- 172.21.15.55:0/2959735308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0100100 msgr2=0x7f9cf01004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 --2- 172.21.15.55:0/2959735308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0100100 0x7f9cf01004e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009880 tx=0x7f9ce002bce0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 -- 172.21.15.55:0/2959735308 shutdown_connections 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 --2- 172.21.15.55:0/2959735308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100ab0 0x7f9cf0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 --2- 172.21.15.55:0/2959735308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0100100 0x7f9cf01004e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 -- 172.21.15.55:0/2959735308 >> 172.21.15.55:0/2959735308 conn(0x7f9cf00fb980 msgr2=0x7f9cf00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 -- 172.21.15.55:0/2959735308 shutdown_connections 2024-04-26T21:23:49.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.691+0000 7f9cefe00640 1 -- 172.21.15.55:0/2959735308 wait complete. 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.692+0000 7f9cefe00640 1 Processor -- start 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cefe00640 1 -- start start 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cefe00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100100 0x7f9cf00726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cefe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0074630 con 0x7f9cf0072c30 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cefe00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01a20d0 con 0x7f9cf0100100 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cee000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cee000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43344/0 (socket says 172.21.15.55:43344) 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.693+0000 7f9cee000640 1 -- 172.21.15.55:0/3129533691 learned_addr learned my addr 172.21.15.55:0/3129533691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:49.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.694+0000 7f9ceea00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100100 0x7f9cf00726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.694+0000 7f9cee000640 1 -- 172.21.15.55:0/3129533691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100100 msgr2=0x7f9cf00726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.694+0000 7f9cee000640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100100 0x7f9cf00726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.694+0000 7f9cee000640 1 -- 172.21.15.55:0/3129533691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009560 con 0x7f9cf0072c30 2024-04-26T21:23:49.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.694+0000 7f9cee000640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d6f0 tx=0x7f9cdc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:49.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.695+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cdc009a30 con 0x7f9cf0072c30 2024-04-26T21:23:49.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.695+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cdc009b90 con 0x7f9cf0072c30 2024-04-26T21:23:49.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.695+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cdc00f680 con 0x7f9cf0072c30 2024-04-26T21:23:49.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.695+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf01a22d0 con 0x7f9cf0072c30 2024-04-26T21:23:49.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.695+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf01a2800 con 0x7f9cf0072c30 2024-04-26T21:23:49.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.696+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf01015d0 con 0x7f9cf0072c30 2024-04-26T21:23:49.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.697+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9cdc009d00 con 0x7f9cf0072c30 2024-04-26T21:23:49.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.698+0000 7f9ce7400640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 0x7f9cd4071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:49.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.698+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9cdc08ee50 con 0x7f9cf0072c30 2024-04-26T21:23:49.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.698+0000 7f9ceea00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 0x7f9cd4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:49.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.699+0000 7f9ceea00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 0x7f9cd4071100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000c00 tx=0x7f9ce002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:49.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.704+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f9cdc057b10 con 0x7f9cf0072c30 2024-04-26T21:23:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:49 smithi055 ceph-mon[109028]: pgmap v357: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:49 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1579819279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:49.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:49 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1296019354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:49.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:49 smithi064 ceph-mon[84240]: pgmap v357: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-26T21:23:49.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:49 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1579819279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T21:23:49.907 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:49 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1296019354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T21:23:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.910+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f9cf004e9b0 con 0x7f9cf0072c30 2024-04-26T21:23:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.911+0000 7f9ce7400640 1 -- 172.21.15.55:0/3129533691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9cdc05b1d0 con 0x7f9cf0072c30 2024-04-26T21:23:49.912 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.913+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 msgr2=0x7f9cd4071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.913+0000 7f9cefe00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 0x7f9cd4071100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000c00 tx=0x7f9ce002cf90 comp rx=0 tx=0).stop 2024-04-26T21:23:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 msgr2=0x7f9cf0073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d6f0 tx=0x7f9cdc00dbb0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 shutdown_connections 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f9cd406ec40 0x7f9cd4071100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf0072c30 0x7f9cf0073090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 --2- 172.21.15.55:0/3129533691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cf0100100 0x7f9cf00726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 >> 172.21.15.55:0/3129533691 conn(0x7f9cf00fb980 msgr2=0x7f9cf0103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 shutdown_connections 2024-04-26T21:23:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:49.914+0000 7f9cefe00640 1 -- 172.21.15.55:0/3129533691 wait complete. 2024-04-26T21:23:49.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-26T21:23:50.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 -- 172.21.15.55:0/1096081666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ffac0 msgr2=0x7faa541039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1096081666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ffac0 0x7faa541039f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faa40009880 tx=0x7faa4002bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 -- 172.21.15.55:0/1096081666 shutdown_connections 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1096081666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ffac0 0x7faa541039f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1096081666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa540ff110 0x7faa540ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 -- 172.21.15.55:0/1096081666 >> 172.21.15.55:0/1096081666 conn(0x7faa54074910 msgr2=0x7faa54074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 -- 172.21.15.55:0/1096081666 shutdown_connections 2024-04-26T21:23:50.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.150+0000 7faa5ae00640 1 -- 172.21.15.55:0/1096081666 wait complete. 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.151+0000 7faa5ae00640 1 Processor -- start 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.151+0000 7faa5ae00640 1 -- start start 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa5ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa5ae00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 0x7faa54101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa5ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54102a40 con 0x7faa540ff110 2024-04-26T21:23:50.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa5ae00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541a2120 con 0x7faa54100fd0 2024-04-26T21:23:50.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa59a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa59a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43370/0 (socket says 172.21.15.55:43370) 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa59a00640 1 -- 172.21.15.55:0/1217901573 learned_addr learned my addr 172.21.15.55:0/1217901573 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.152+0000 7faa59000640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 0x7faa54101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa59a00640 1 -- 172.21.15.55:0/1217901573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 msgr2=0x7faa54101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa59a00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 0x7faa54101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa59a00640 1 -- 172.21.15.55:0/1217901573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40009560 con 0x7faa540ff110 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa59000640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 0x7faa54101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa59a00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa4800d8d0 tx=0x7faa4800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4800bea0 con 0x7faa540ff110 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa48009c00 con 0x7faa540ff110 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa541a2380 con 0x7faa540ff110 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4800f710 con 0x7faa540ff110 2024-04-26T21:23:50.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.153+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa541a28b0 con 0x7faa540ff110 2024-04-26T21:23:50.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.155+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa541004d0 con 0x7faa540ff110 2024-04-26T21:23:50.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.156+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faa4800f990 con 0x7faa540ff110 2024-04-26T21:23:50.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.157+0000 7faa52000640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 0x7faa3c071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.157+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faa4808ebf0 con 0x7faa540ff110 2024-04-26T21:23:50.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.158+0000 7faa59000640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 0x7faa3c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.159+0000 7faa59000640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 0x7faa3c071100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa40036040 tx=0x7faa40000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:50.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.162+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7faa48057950 con 0x7faa540ff110 2024-04-26T21:23:50.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.370+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7faa5404e9b0 con 0x7faa540ff110 2024-04-26T21:23:50.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.371+0000 7faa52000640 1 -- 172.21.15.55:0/1217901573 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7faa4805b010 con 0x7faa540ff110 2024-04-26T21:23:50.372 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-26T21:23:50.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.373+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 msgr2=0x7faa3c071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.373+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 0x7faa3c071100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa40036040 tx=0x7faa40000bc0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.373+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 msgr2=0x7faa54100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.373+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa4800d8d0 tx=0x7faa4800dd90 comp rx=0 tx=0).stop 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 shutdown_connections 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa54100fd0 0x7faa54101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7faa3c06ec40 0x7faa3c071100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 --2- 172.21.15.55:0/1217901573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa540ff110 0x7faa54100a90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 >> 172.21.15.55:0/1217901573 conn(0x7faa54074910 msgr2=0x7faa54067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 shutdown_connections 2024-04-26T21:23:50.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.374+0000 7faa5ae00640 1 -- 172.21.15.55:0/1217901573 wait complete. 2024-04-26T21:23:50.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 -- 172.21.15.55:0/759511546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f8102c80 msgr2=0x7f11f8106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 --2- 172.21.15.55:0/759511546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f8102c80 0x7f11f8106cc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009880 tx=0x7f11e402bcf0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 -- 172.21.15.55:0/759511546 shutdown_connections 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 --2- 172.21.15.55:0/759511546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f8102c80 0x7f11f8106cc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 --2- 172.21.15.55:0/759511546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f81022d0 0x7f11f81026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 -- 172.21.15.55:0/759511546 >> 172.21.15.55:0/759511546 conn(0x7f11f80fdb70 msgr2=0x7f11f80fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 -- 172.21.15.55:0/759511546 shutdown_connections 2024-04-26T21:23:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.615+0000 7f11f7e00640 1 -- 172.21.15.55:0/759511546 wait complete. 2024-04-26T21:23:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 Processor -- start 2024-04-26T21:23:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 -- start start 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f819d890 0x7f11f81a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f819dcf0 con 0x7f11f81022d0 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.617+0000 7f11f7e00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f819de60 con 0x7f11f819d890 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43386/0 (socket says 172.21.15.55:43386) 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 -- 172.21.15.55:0/4064211312 learned_addr learned my addr 172.21.15.55:0/4064211312 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-26T21:23:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6000640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f819d890 0x7f11f81a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 -- 172.21.15.55:0/4064211312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f819d890 msgr2=0x7f11f81a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f819d890 0x7f11f81a61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.618+0000 7f11f6a00640 1 -- 172.21.15.55:0/4064211312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009560 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11f6a00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f11e800ea30 tx=0x7f11e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e800cdb0 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11e8011930 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e801aa30 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f81a6720 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.619+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f81a6ba0 con 0x7f11f81022d0 2024-04-26T21:23:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.620+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f81037a0 con 0x7f11f81022d0 2024-04-26T21:23:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.621+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f11e801ab90 con 0x7f11f81022d0 2024-04-26T21:23:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.623+0000 7f11ef400640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 0x7f11dc071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:23:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.623+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f11e808f570 con 0x7f11f81022d0 2024-04-26T21:23:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.623+0000 7f11f6000640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 0x7f11dc071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:23:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.624+0000 7f11f6000640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 0x7f11dc071110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11e4006010 tx=0x7f11e402ca70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:23:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.628+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188494 (secure 0 0 0) 0x7f11e80582b0 con 0x7f11f81022d0 2024-04-26T21:23:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:50 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/3129533691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:50.755 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:50 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/1217901573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:50.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.848+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11f80782a0 con 0x7f11f81022d0 2024-04-26T21:23:50.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.849+0000 7f11ef400640 1 -- 172.21.15.55:0/4064211312 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2420 (secure 0 0 0) 0x7f11e805b970 con 0x7f11f81022d0 2024-04-26T21:23:50.850 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6827/258074733 2024-04-27T21:20:26.259982+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6826/258074733 2024-04-27T21:20:26.259982+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6829/1757258712 2024-04-27T21:19:32.204707+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6828/1757258712 2024-04-27T21:19:32.204707+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6827/2158832788 2024-04-27T21:18:56.003369+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/4088155030 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/4088155030 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/164718892 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/435275509 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3680986491 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/3692425588 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2020032469 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2401109697 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.851 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6826/2158832788 2024-04-27T21:18:56.003369+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/1265976667 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/912138010 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2964479330 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/4047324171 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/2338326874 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2401553078 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/912138010 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/108673769 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/359559082 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6829/1518549536 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2358731820 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/154137240 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:6828/1518549536 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/154137240 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:50.852 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3032989181 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2810095520 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2276472174 2024-04-27T20:55:02.938534+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3943565490 2024-04-27T21:06:59.742397+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3951282282 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/1497600698 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/305427654 2024-04-27T20:57:21.478634+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.64:0/3627849680 2024-04-27T21:08:25.366623+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1897911263 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2398171578 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2398171578 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2358731820 2024-04-27T20:55:46.378997+0000 2024-04-26T21:23:50.853 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/218375879 2024-04-27T21:13:11.675470+0000 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:listed 41 entries 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 msgr2=0x7f11dc071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 0x7f11dc071110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11e4006010 tx=0x7f11e402ca70 comp rx=0 tx=0).stop 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 msgr2=0x7f11f819d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f11e800ea30 tx=0x7f11e800eef0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 shutdown_connections 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f11f819d890 0x7f11f81a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:6800/3120849084,v1:172.21.15.55:6801/3120849084] conn(0x7f11dc06ec50 0x7f11dc071110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 --2- 172.21.15.55:0/4064211312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11f81022d0 0x7f11f819d350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:23:50.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 >> 172.21.15.55:0/4064211312 conn(0x7f11f80fdb70 msgr2=0x7f11f80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:23:50.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 shutdown_connections 2024-04-26T21:23:50.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-26T21:23:50.852+0000 7f11f7e00640 1 -- 172.21.15.55:0/4064211312 wait complete. 2024-04-26T21:23:50.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T21:23:50.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:50.874 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-26T21:23:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:50 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/3129533691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-26T21:23:50.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:50 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/1217901573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-26T21:23:50.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-04-26T21:23:50.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:50.977 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T21:23:51.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.100 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-26T21:23:51.161 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:23:51.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:23:51.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-26T21:23:51.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.360 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-04-26T21:23:51.422 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T21:23:51.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.423 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:23:51.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:23:51.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-04-26T21:23:51.610 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-26T21:23:51.622 INFO:tasks.cephadm:Teardown begin 2024-04-26T21:23:51.622 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:23:51.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:23:51.794 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:51 smithi064 ceph-mon[84240]: pgmap v358: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:51.794 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:51 smithi064 ceph-mon[84240]: from='client.? 172.21.15.55:0/4064211312' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:23:51.807 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-26T21:23:51.807 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T21:23:51.866 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-26T21:23:51.925 INFO:tasks.cephadm:Stopping all daemons... 2024-04-26T21:23:51.925 INFO:tasks.cephadm.mon.smithi055:Stopping mon.smithi055... 2024-04-26T21:23:51.925 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055 2024-04-26T21:23:52.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:51 smithi055 ceph-mon[109028]: pgmap v358: 65 pgs: 65 active+clean; 199 MiB data, 825 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:52.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:51 smithi055 ceph-mon[109028]: from='client.? 172.21.15.55:0/4064211312' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-26T21:23:52.505 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:52 smithi055 systemd[1]: Stopping Ceph mon.smithi055 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:23:53.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:52 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[109024]: 2024-04-26T21:23:52.743+0000 7effccc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi055 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:23:53.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:52 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055[109024]: 2024-04-26T21:23:52.743+0000 7effccc00700 -1 mon.smithi055@0(leader) e3 *** Got Signal Terminated *** 2024-04-26T21:23:53.006 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:52 smithi055 podman[155540]: 2024-04-26 21:23:52.816305447 +0000 UTC m=+0.390730368 container died 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424) 2024-04-26T21:23:53.700 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:53 smithi055 podman[155540]: 2024-04-26 21:23:53.53093229 +0000 UTC m=+1.105357239 container cleanup 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:23:53.700 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:53 smithi055 bash[155540]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055 2024-04-26T21:23:54.005 INFO:journalctl@ceph.mon.smithi055.smithi055.stdout:Apr 26 21:23:53 smithi055 podman[155565]: 2024-04-26 21:23:53.698892119 +0000 UTC m=+0.872600884 container remove 56a4908b348c35ed7e159ea6c3f238fe977a6daac45f1b09d8b46fd847faef4c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi055, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T21:23:54.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi055.service' 2024-04-26T21:23:54.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:23:54.414 INFO:tasks.cephadm.mon.smithi055:Stopped mon.smithi055 2024-04-26T21:23:54.414 INFO:tasks.cephadm.mon.smithi064:Stopping mon.smithi064... 2024-04-26T21:23:54.414 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064 2024-04-26T21:23:54.609 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:54 smithi064 systemd[1]: Stopping Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:23:55.287 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:54 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064[84236]: 2024-04-26T21:23:54.913+0000 7f935c400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi064 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:23:55.287 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:54 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064[84236]: 2024-04-26T21:23:54.913+0000 7f935c400700 -1 mon.smithi064@1(peon) e3 *** Got Signal Terminated *** 2024-04-26T21:23:55.287 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:54 smithi064 podman[120945]: 2024-04-26 21:23:54.954723905 +0000 UTC m=+0.187971160 container died fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:23:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:55 smithi064 podman[120945]: 2024-04-26 21:23:55.620561925 +0000 UTC m=+0.853809202 container cleanup fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:23:55.906 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:55 smithi064 bash[120945]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064 2024-04-26T21:23:56.167 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:55 smithi064 podman[120961]: 2024-04-26 21:23:55.913595159 +0000 UTC m=+0.948823468 container remove fe7ea8a311703f5a1b7bb928c7502261afa3e315f8135aae7f0eff18812e1e6b (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-mon-smithi064, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T21:23:56.168 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:56 smithi064 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064.service: Deactivated successfully. 2024-04-26T21:23:56.168 INFO:journalctl@ceph.mon.smithi064.smithi064.stdout:Apr 26 21:23:56 smithi064 systemd[1]: Stopped Ceph mon.smithi064 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:23:56.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@mon.smithi064.service' 2024-04-26T21:23:56.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:23:56.317 INFO:tasks.cephadm.mon.smithi064:Stopped mon.smithi064 2024-04-26T21:23:56.318 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-26T21:23:56.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0 2024-04-26T21:23:56.755 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:23:56 smithi055 systemd[1]: Stopping Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:23:57.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:23:57 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:23:57.118+0000 7fe6b0a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:23:57.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:23:57 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:23:57.118+0000 7fe6b0a00700 -1 osd.0 85 *** Got signal Terminated *** 2024-04-26T21:23:57.505 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:23:57 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0[121014]: 2024-04-26T21:23:57.118+0000 7fe6b0a00700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:03.005 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:02 smithi055 podman[155682]: 2024-04-26 21:24:02.702546877 +0000 UTC m=+5.909011909 container died e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-26T21:24:03.438 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:03 smithi055 podman[155682]: 2024-04-26 21:24:03.402357523 +0000 UTC m=+6.608822609 container cleanup e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T21:24:03.438 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:03 smithi055 bash[155682]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0 2024-04-26T21:24:04.004 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:03 smithi055 podman[155703]: 2024-04-26 21:24:03.671013234 +0000 UTC m=+0.953184052 container remove e7b4650b60b7b0801f1470c2eebd335b5ada442403b528e941b3ac813384d9bd (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T21:24:04.814 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:04 smithi055 podman[155790]: 2024-04-26 21:24:04.47084232 +0000 UTC m=+0.040842718 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:04.814 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:04 smithi055 podman[155790]: 2024-04-26 21:24:04.596930698 +0000 UTC m=+0.166931134 container create f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T21:24:05.067 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:04 smithi055 podman[155790]: 2024-04-26 21:24:04.926127841 +0000 UTC m=+0.496128263 container init f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T21:24:05.068 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:04 smithi055 podman[155790]: 2024-04-26 21:24:04.938165885 +0000 UTC m=+0.508166328 container start f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True) 2024-04-26T21:24:05.068 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:05 smithi055 podman[155790]: 2024-04-26 21:24:05.06665412 +0000 UTC m=+0.636654606 container attach f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T21:24:05.755 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:05 smithi055 podman[155790]: 2024-04-26 21:24:05.416189228 +0000 UTC m=+0.986189691 container died f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T21:24:06.459 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service' 2024-04-26T21:24:06.540 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:06 smithi055 podman[155815]: 2024-04-26 21:24:06.406706436 +0000 UTC m=+0.968492430 container remove f0215acaa76e14b48cd888811f37957af2ad798cc732c1bc06b17f58c4d6f937 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T21:24:06.540 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:06 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-26T21:24:06.540 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:06 smithi055 systemd[1]: Stopped Ceph osd.0 for fbc85ba0-040e-11ef-bc93-c7b262605968. 2024-04-26T21:24:06.540 INFO:journalctl@ceph.osd.0.smithi055.stdout:Apr 26 21:24:06 smithi055 systemd[1]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.0.service: Consumed 18.009s CPU time. 2024-04-26T21:24:06.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:06.584 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-26T21:24:06.584 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-26T21:24:06.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.1 2024-04-26T21:24:07.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:06 smithi055 systemd[1]: Stopping Ceph osd.1 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:24:07.739 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:07 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:24:07.392+0000 7f8238a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:24:07.740 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:07 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:24:07.392+0000 7f8238a00700 -1 osd.1 85 *** Got signal Terminated *** 2024-04-26T21:24:07.740 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:07 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1[126411]: 2024-04-26T21:24:07.392+0000 7f8238a00700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:13.256 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:12 smithi055 podman[155892]: 2024-04-26 21:24:12.965390513 +0000 UTC m=+5.862590089 container died 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True) 2024-04-26T21:24:13.696 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:13 smithi055 podman[155892]: 2024-04-26 21:24:13.426858006 +0000 UTC m=+6.324057592 container cleanup 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T21:24:13.696 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:13 smithi055 bash[155892]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1 2024-04-26T21:24:14.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:13 smithi055 podman[155924]: 2024-04-26 21:24:13.695061298 +0000 UTC m=+0.716190322 container remove 4a3c3f9692bc298b5af79896332b3744d14e45f126a93f3b182f868f837da00e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:24:14.829 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:14 smithi055 podman[156014]: 2024-04-26 21:24:14.480860135 +0000 UTC m=+0.042278445 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:14.829 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:14 smithi055 podman[156014]: 2024-04-26 21:24:14.596448407 +0000 UTC m=+0.157866733 container create 63a096ce9aacca8dda2bf07009a485852f1a6602ba90d5ae08f43c033237bc2d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:24:15.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:15 smithi055 podman[156014]: 2024-04-26 21:24:15.101292572 +0000 UTC m=+0.662710905 container init 63a096ce9aacca8dda2bf07009a485852f1a6602ba90d5ae08f43c033237bc2d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:24:15.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:15 smithi055 podman[156014]: 2024-04-26 21:24:15.114019447 +0000 UTC m=+0.675437745 container start 63a096ce9aacca8dda2bf07009a485852f1a6602ba90d5ae08f43c033237bc2d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:24:15.505 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:15 smithi055 podman[156014]: 2024-04-26 21:24:15.191322816 +0000 UTC m=+0.752741192 container attach 63a096ce9aacca8dda2bf07009a485852f1a6602ba90d5ae08f43c033237bc2d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-04-26T21:24:15.984 INFO:journalctl@ceph.osd.1.smithi055.stdout:Apr 26 21:24:15 smithi055 podman[156040]: 2024-04-26 21:24:15.667307338 +0000 UTC m=+0.039778444 container died 63a096ce9aacca8dda2bf07009a485852f1a6602ba90d5ae08f43c033237bc2d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T21:24:16.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.1.service' 2024-04-26T21:24:16.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:16.539 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-26T21:24:16.539 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-26T21:24:16.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.2 2024-04-26T21:24:17.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:16 smithi055 systemd[1]: Stopping Ceph osd.2 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:24:17.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:17 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:24:17.130+0000 7f5e3ea00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:24:17.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:17 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:24:17.130+0000 7f5e3ea00700 -1 osd.2 85 *** Got signal Terminated *** 2024-04-26T21:24:17.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:17 smithi055 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2[132174]: 2024-04-26T21:24:17.130+0000 7f5e3ea00700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:23.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:22 smithi055 podman[156119]: 2024-04-26 21:24:22.606990145 +0000 UTC m=+5.613120286 container died 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD) 2024-04-26T21:24:23.507 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:23 smithi055 podman[156119]: 2024-04-26 21:24:23.282723394 +0000 UTC m=+6.288853572 container cleanup 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-26T21:24:23.507 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:23 smithi055 bash[156119]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2 2024-04-26T21:24:24.005 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:23 smithi055 podman[156138]: 2024-04-26 21:24:23.543370622 +0000 UTC m=+0.919800868 container remove 352ba789497da3202bbdb38fd48ed990b3b2c988dc27d6b9633c86a14f3f9fe4 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T21:24:24.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:24 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:24.238+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:24.684 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:24 smithi055 podman[156231]: 2024-04-26 21:24:24.328899503 +0000 UTC m=+0.036074419 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:24.684 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:24 smithi055 podman[156231]: 2024-04-26 21:24:24.435913504 +0000 UTC m=+0.143088452 container create 47b07860cd375fa07665d5896dcf866a03699f0aadc12fbec6ea454c3cf0b2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T21:24:25.236 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:24 smithi055 podman[156231]: 2024-04-26 21:24:24.781695637 +0000 UTC m=+0.488870557 container init 47b07860cd375fa07665d5896dcf866a03699f0aadc12fbec6ea454c3cf0b2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T21:24:25.236 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:24 smithi055 podman[156231]: 2024-04-26 21:24:24.793153595 +0000 UTC m=+0.500328550 container start 47b07860cd375fa07665d5896dcf866a03699f0aadc12fbec6ea454c3cf0b2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T21:24:25.236 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:24 smithi055 podman[156231]: 2024-04-26 21:24:24.922634082 +0000 UTC m=+0.629809037 container attach 47b07860cd375fa07665d5896dcf866a03699f0aadc12fbec6ea454c3cf0b2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T21:24:25.273 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:24 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:24.969+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:25.505 INFO:journalctl@ceph.osd.2.smithi055.stdout:Apr 26 21:24:25 smithi055 podman[156231]: 2024-04-26 21:24:25.260773144 +0000 UTC m=+0.967948099 container died 47b07860cd375fa07665d5896dcf866a03699f0aadc12fbec6ea454c3cf0b2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T21:24:25.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:25 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:25.271+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:26.173 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.2.service' 2024-04-26T21:24:26.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:26.278 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-26T21:24:26.278 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-26T21:24:26.278 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.3 2024-04-26T21:24:26.300 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:25 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:25.961+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:26.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:26.298+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:26.657 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:26 smithi064 systemd[1]: Stopping Ceph osd.3 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:24:27.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:26.972+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:27.157 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:26.856+0000 7f9c43000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:24:27.157 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:26.856+0000 7f9c43000700 -1 osd.3 85 *** Got signal Terminated *** 2024-04-26T21:24:27.157 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:26 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:26.856+0000 7f9c43000700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:27.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:27 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:27.296+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:28.262 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:28 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:28.003+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:28.656 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:28 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:28.261+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:28.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:28 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:28.457+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:29.406 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:29 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:29.232+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:29.407 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:29 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:29.004+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:29.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:29 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:29.455+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:30.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:29 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:29.997+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:30.406 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:30 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:30.244+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:30.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:30 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:30.414+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:31.406 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:31 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3[94025]: 2024-04-26T21:24:31.221+0000 7f9c39800700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.632686+0000 front 2024-04-26T21:23:58.632531+0000 (oldest deadline 2024-04-26T21:24:23.332662+0000) 2024-04-26T21:24:31.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:31 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:31.046+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:31.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:31 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:31.454+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:32.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:32 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:32.037+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:32.723 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:32 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:32.411+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:32.724 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:32 smithi064 podman[121080]: 2024-04-26 21:24:32.419533122 +0000 UTC m=+5.692162251 container died 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-26T21:24:33.026 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:32 smithi064 podman[121080]: 2024-04-26 21:24:32.857707283 +0000 UTC m=+6.130336436 container cleanup 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:24:33.026 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:32 smithi064 bash[121080]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3 2024-04-26T21:24:33.406 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:33 smithi064 podman[121100]: 2024-04-26 21:24:33.025212961 +0000 UTC m=+0.593800582 container remove 0f129480461331f43d2ed7b27ff6967fe21482abfad93f298fcb4a1d9e9aa622 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-26T21:24:33.407 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:33.031+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:33.886 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:33 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:33.409+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:34.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:34 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:34.081+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:34.158 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:33 smithi064 podman[121187]: 2024-04-26 21:24:33.793036778 +0000 UTC m=+0.039816458 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:34.158 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:33 smithi064 podman[121187]: 2024-04-26 21:24:33.934804898 +0000 UTC m=+0.181584615 container create 030bbb17b49b0e10965ead86a4f515d41d2a775aa8678ee3a1dcff0e9ba765ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T21:24:34.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:34 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:34.400+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:34.657 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:34 smithi064 podman[121187]: 2024-04-26 21:24:34.205229404 +0000 UTC m=+0.452009165 container init 030bbb17b49b0e10965ead86a4f515d41d2a775aa8678ee3a1dcff0e9ba765ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T21:24:34.657 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:34 smithi064 podman[121187]: 2024-04-26 21:24:34.216980498 +0000 UTC m=+0.463760218 container start 030bbb17b49b0e10965ead86a4f515d41d2a775aa8678ee3a1dcff0e9ba765ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T21:24:34.657 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:34 smithi064 podman[121187]: 2024-04-26 21:24:34.320922621 +0000 UTC m=+0.567702381 container attach 030bbb17b49b0e10965ead86a4f515d41d2a775aa8678ee3a1dcff0e9ba765ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5) 2024-04-26T21:24:34.961 INFO:journalctl@ceph.osd.3.smithi064.stdout:Apr 26 21:24:34 smithi064 podman[121187]: 2024-04-26 21:24:34.680023513 +0000 UTC m=+0.926803255 container died 030bbb17b49b0e10965ead86a4f515d41d2a775aa8678ee3a1dcff0e9ba765ce (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T21:24:35.316 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:35 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:35.083+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:35.371 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.3.service' 2024-04-26T21:24:35.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:35.537 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-26T21:24:35.537 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-26T21:24:35.537 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.4 2024-04-26T21:24:35.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:35 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:35.363+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:35.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:35 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:35.363+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:36.135 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:35 smithi064 systemd[1]: Stopping Ceph osd.4 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:24:36.409 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:36.331+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:36.409 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:36.331+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:36.409 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:36.133+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:36.410 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:36.150+0000 7f8419000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:24:36.410 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:36.150+0000 7f8419000700 -1 osd.4 85 *** Got signal Terminated *** 2024-04-26T21:24:36.410 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:36 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:36.150+0000 7f8419000700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:37.320 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:37.149+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:37.320 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:37.149+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:11.545899+0000 front 2024-04-26T21:24:11.546077+0000 (oldest deadline 2024-04-26T21:24:36.845697+0000) 2024-04-26T21:24:37.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:37.317+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:37.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:37 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:37.317+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:38.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:38 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:38.122+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:38.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:38 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:38.122+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:11.545899+0000 front 2024-04-26T21:24:11.546077+0000 (oldest deadline 2024-04-26T21:24:36.845697+0000) 2024-04-26T21:24:38.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:38 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:38.267+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:38.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:38 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:38.267+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:39.407 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:39 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:39.133+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:39.407 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:39 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:39.133+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:11.545899+0000 front 2024-04-26T21:24:11.546077+0000 (oldest deadline 2024-04-26T21:24:36.845697+0000) 2024-04-26T21:24:39.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:39 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:39.313+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:39.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:39 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:39.313+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:40.361 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:40.108+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:40.361 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:40.108+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:11.545899+0000 front 2024-04-26T21:24:11.546077+0000 (oldest deadline 2024-04-26T21:24:36.845697+0000) 2024-04-26T21:24:40.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:40.359+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:40.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:40 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:40.359+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:41.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:41.145+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:24:01.143309+0000 front 2024-04-26T21:24:01.143394+0000 (oldest deadline 2024-04-26T21:24:24.042758+0000) 2024-04-26T21:24:41.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4[99331]: 2024-04-26T21:24:41.145+0000 7f8414800700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:11.545899+0000 front 2024-04-26T21:24:11.546077+0000 (oldest deadline 2024-04-26T21:24:36.845697+0000) 2024-04-26T21:24:41.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:41.392+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:41.407 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:41 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:41.392+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:42.067 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:41 smithi064 podman[121292]: 2024-04-26 21:24:41.754087322 +0000 UTC m=+5.735182485 container died 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T21:24:42.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:42 smithi064 podman[121292]: 2024-04-26 21:24:42.17671985 +0000 UTC m=+6.157815051 container cleanup 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:24:42.406 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:42 smithi064 bash[121292]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4 2024-04-26T21:24:42.906 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:42 smithi064 podman[121324]: 2024-04-26 21:24:42.486308095 +0000 UTC m=+0.718723600 container remove 822dbca881c4af0188179f50cd16fc7f1453d1e9c5499dae9daf6cecafa9ea5d (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff) 2024-04-26T21:24:42.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:42 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:42.436+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:42.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:42 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:42.436+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:43.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:43 smithi064 podman[121414]: 2024-04-26 21:24:43.235690009 +0000 UTC m=+0.038159154 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:43.657 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:43 smithi064 podman[121414]: 2024-04-26 21:24:43.380605529 +0000 UTC m=+0.183074704 container create b503b8cedb2a976e65f4673cc9e703db81f8c5e9fe97a1821f5d7d2cede5a91e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T21:24:43.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:43 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:43.452+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:43.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:43 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:43.452+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:44.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:43 smithi064 podman[121414]: 2024-04-26 21:24:43.713326381 +0000 UTC m=+0.515795594 container init b503b8cedb2a976e65f4673cc9e703db81f8c5e9fe97a1821f5d7d2cede5a91e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:24:44.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:43 smithi064 podman[121414]: 2024-04-26 21:24:43.725909529 +0000 UTC m=+0.528378705 container start b503b8cedb2a976e65f4673cc9e703db81f8c5e9fe97a1821f5d7d2cede5a91e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:24:44.157 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:43 smithi064 podman[121414]: 2024-04-26 21:24:43.806469384 +0000 UTC m=+0.608938577 container attach b503b8cedb2a976e65f4673cc9e703db81f8c5e9fe97a1821f5d7d2cede5a91e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-04-26T21:24:44.497 INFO:journalctl@ceph.osd.4.smithi064.stdout:Apr 26 21:24:44 smithi064 podman[121414]: 2024-04-26 21:24:44.20671158 +0000 UTC m=+1.009180756 container died b503b8cedb2a976e65f4673cc9e703db81f8c5e9fe97a1821f5d7d2cede5a91e (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T21:24:44.497 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:44 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:44.407+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:44.497 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:44 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:44.407+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:44.918 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.4.service' 2024-04-26T21:24:45.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:45.037 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-26T21:24:45.038 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-26T21:24:45.038 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.5 2024-04-26T21:24:45.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 systemd[1]: Stopping Ceph osd.5 for fbc85ba0-040e-11ef-bc93-c7b262605968... 2024-04-26T21:24:45.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.406+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:45.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.406+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:45.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.406+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:45.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.629+0000 7f77ece00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T21:24:45.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.629+0000 7f77ece00700 -1 osd.5 85 *** Got signal Terminated *** 2024-04-26T21:24:45.908 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:45 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:45.629+0000 7f77ece00700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-26T21:24:46.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:46 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:46.439+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:46.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:46 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:46.439+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:46.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:46 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:46.439+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:47.767 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:47.451+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:47.767 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:47.451+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:47.767 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:47 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:47.451+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:48.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:48 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:48.463+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:48.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:48 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:48.463+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:48.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:48 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:48.463+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:49.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:49 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:49.482+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:49.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:49 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:49.482+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:49.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:49 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:49.482+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:50.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:50 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:50.438+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6806 osd.0 since back 2024-04-26T21:23:58.222374+0000 front 2024-04-26T21:23:58.222470+0000 (oldest deadline 2024-04-26T21:24:28.222811+0000) 2024-04-26T21:24:50.906 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:50 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:50.438+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6814 osd.1 since back 2024-04-26T21:24:09.324767+0000 front 2024-04-26T21:24:09.324639+0000 (oldest deadline 2024-04-26T21:24:35.224027+0000) 2024-04-26T21:24:50.907 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:50 smithi064 ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5[104759]: 2024-04-26T21:24:50.438+0000 7f77e8600700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.55:6822 osd.2 since back 2024-04-26T21:24:19.325807+0000 front 2024-04-26T21:24:19.325476+0000 (oldest deadline 2024-04-26T21:24:45.225298+0000) 2024-04-26T21:24:51.656 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:51 smithi064 podman[121520]: 2024-04-26 21:24:51.262200876 +0000 UTC m=+5.761543391 container died 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T21:24:52.100 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:51 smithi064 podman[121520]: 2024-04-26 21:24:51.839962928 +0000 UTC m=+6.339305473 container cleanup 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T21:24:52.100 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:51 smithi064 bash[121520]: ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5 2024-04-26T21:24:52.406 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:52 smithi064 podman[121541]: 2024-04-26 21:24:52.099115635 +0000 UTC m=+0.821714709 container remove 6091c379a579bd61a1767baf40fdf35285e00b17178574387bad0bdf78a4e00c (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T21:24:53.238 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:52 smithi064 podman[121625]: 2024-04-26 21:24:52.838813909 +0000 UTC m=+0.037481462 image pull 55dc54019ad82626637ea289d349113ba783f0c02a3b8251fba6bc77c1a60c07 quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2 2024-04-26T21:24:53.239 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:52 smithi064 podman[121625]: 2024-04-26 21:24:52.974983924 +0000 UTC m=+0.173651496 container create d9b5d08ba74a5039397b47de82242553733595c5b64bb0fb993d60e7aba15e79 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T21:24:53.239 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:53 smithi064 podman[121625]: 2024-04-26 21:24:53.237444497 +0000 UTC m=+0.436112112 container init d9b5d08ba74a5039397b47de82242553733595c5b64bb0fb993d60e7aba15e79 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T21:24:53.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:53 smithi064 podman[121625]: 2024-04-26 21:24:53.248952226 +0000 UTC m=+0.447619769 container start d9b5d08ba74a5039397b47de82242553733595c5b64bb0fb993d60e7aba15e79 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T21:24:53.657 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:53 smithi064 podman[121625]: 2024-04-26 21:24:53.394775673 +0000 UTC m=+0.593443298 container attach d9b5d08ba74a5039397b47de82242553733595c5b64bb0fb993d60e7aba15e79 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T21:24:54.066 INFO:journalctl@ceph.osd.5.smithi064.stdout:Apr 26 21:24:53 smithi064 podman[121625]: 2024-04-26 21:24:53.709409194 +0000 UTC m=+0.908076772 container died d9b5d08ba74a5039397b47de82242553733595c5b64bb0fb993d60e7aba15e79 (image=quay.ceph.io/ceph-ci/ceph@sha256:39d00e115f9430aba1116fce52d7d386b73fc3b9ed873e7f9c2c3b6cdcd253c2, name=ceph-fbc85ba0-040e-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240426.111959-bc612ff, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T21:24:54.487 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fbc85ba0-040e-11ef-bc93-c7b262605968@osd.5.service' 2024-04-26T21:24:54.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-26T21:24:54.595 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-26T21:24:54.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T21:24:54.884 INFO:teuthology.orchestra.run.smithi055.stdout:Deleting cluster with fsid: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:25:30.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-26T21:25:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:25:49.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:25:49.762 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-26T21:25:49.859 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-26T21:25:49.861 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi055/crash 2024-04-26T21:25:49.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash -- . 2024-04-26T21:25:49.943 INFO:teuthology.orchestra.run.smithi055.stderr:tar: /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T21:25:49.943 INFO:teuthology.orchestra.run.smithi055.stderr:tar: Error is not recoverable: exiting now 2024-04-26T21:25:49.946 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi064/crash 2024-04-26T21:25:49.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash -- . 2024-04-26T21:25:50.040 INFO:teuthology.orchestra.run.smithi064.stderr:tar: /var/lib/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-26T21:25:50.040 INFO:teuthology.orchestra.run.smithi064.stderr:tar: Error is not recoverable: exiting now 2024-04-26T21:25:50.043 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-26T21:25:50.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T21:25:50.153 INFO:tasks.cephadm:Compressing logs... 2024-04-26T21:25:50.154 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:25:50.158 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T21:25:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T21:25:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T21:25:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.coveew.log 2024-04-26T21:25:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi055.ybbowr.log 2024-04-26T21:25:50.218 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.coveew.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi055.log 2024-04-26T21:25:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi055.ybbowr.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log 2024-04-26T21:25:50.221 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi055.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.nwfjlb.log 2024-04-26T21:25:50.222 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-26T21:25:50.224 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.nwfjlb.log: 2024-04-26T21:25:50.224 INFO:teuthology.orchestra.run.smithi055.stderr: 94.1% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi055.log.gz 2024-04-26T21:25:50.226 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T21:25:50.228 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-26T21:25:50.229 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-26T21:25:50.232 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.1.log: /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T21:25:50.234 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T21:25:50.235 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.8% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T21:25:50.236 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T21:25:50.238 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi055.log 2024-04-26T21:25:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi055.log: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T21:25:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-26T21:25:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-26T21:25:50.249 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi064.log 2024-04-26T21:25:50.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log 2024-04-26T21:25:50.252 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi064.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-26T21:25:50.252 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-26T21:25:50.253 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi064.tchyje.log 2024-04-26T21:25:50.254 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-26T21:25:50.256 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi064.tchyje.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-26T21:25:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.5.log: 88.4% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-26T21:25:50.257 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-26T21:25:50.259 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.3.log: 91.5% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-26T21:25:50.259 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.ukvnjs.log 2024-04-26T21:25:50.260 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi064.log 2024-04-26T21:25:50.261 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T21:25:50.262 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.4.log: /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.ukvnjs.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-26T21:25:50.265 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi064.log: /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.xrdyeb.log 2024-04-26T21:25:50.266 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-client.ceph-exporter.smithi064.log.gz 2024-04-26T21:25:50.270 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.xrdyeb.log: 85.8% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-26T21:25:50.271 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-26T21:25:50.301 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log: 90.9% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-26T21:25:50.310 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi064.tchyje.log.gz 2024-04-26T21:25:50.682 INFO:teuthology.orchestra.run.smithi064.stderr: 92.3% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi064.log.gz 2024-04-26T21:25:50.708 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mgr.smithi055.ybbowr.log.gz 2024-04-26T21:25:51.229 INFO:teuthology.orchestra.run.smithi055.stderr: 90.4% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mon.smithi055.log.gz 2024-04-26T21:25:55.431 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-26T21:25:55.511 INFO:teuthology.orchestra.run.smithi055.stderr: 93.6% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-26T21:25:57.064 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-26T21:25:57.719 INFO:teuthology.orchestra.run.smithi064.stderr: 94.8% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.xrdyeb.log.gz 2024-04-26T21:25:57.851 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-26T21:25:58.107 INFO:teuthology.orchestra.run.smithi055.stderr: 93.5% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-26T21:25:58.591 INFO:teuthology.orchestra.run.smithi055.stderr: 93.6% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-26T21:26:00.689 INFO:teuthology.orchestra.run.smithi064.stderr: 94.9% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi064.ukvnjs.log.gz 2024-04-26T21:26:00.693 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-04-26T21:26:00.693 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m10.476s 2024-04-26T21:26:00.694 INFO:teuthology.orchestra.run.smithi064.stderr:user 0m35.298s 2024-04-26T21:26:00.694 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m2.774s 2024-04-26T21:26:02.023 INFO:teuthology.orchestra.run.smithi055.stderr: 94.7% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.nwfjlb.log.gz 2024-04-26T21:27:32.125 INFO:teuthology.orchestra.run.smithi055.stderr: 92.6% -- replaced with /var/log/ceph/fbc85ba0-040e-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi055.coveew.log.gz 2024-04-26T21:27:32.128 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-04-26T21:27:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:real 1m41.939s 2024-04-26T21:27:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:user 2m6.946s 2024-04-26T21:27:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m9.299s 2024-04-26T21:27:32.130 INFO:tasks.cephadm:Archiving logs... 2024-04-26T21:27:32.130 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi055/log 2024-04-26T21:27:32.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:27:50.156 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi064/log 2024-04-26T21:27:50.157 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T21:27:54.505 INFO:tasks.cephadm:Removing cluster... 2024-04-26T21:27:54.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 --force 2024-04-26T21:27:54.789 INFO:teuthology.orchestra.run.smithi055.stdout:Deleting cluster with fsid: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:27:55.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fbc85ba0-040e-11ef-bc93-c7b262605968 --force 2024-04-26T21:27:56.221 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: fbc85ba0-040e-11ef-bc93-c7b262605968 2024-04-26T21:27:56.988 INFO:tasks.cephadm:Removing cephadm ... 2024-04-26T21:27:56.988 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T21:27:57.049 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-26T21:27:57.106 INFO:tasks.cephadm:Teardown complete 2024-04-26T21:27:57.106 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T21:27:57.120 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T21:27:57.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:27:57.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T21:27:57.258 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T21:27:57.269 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T21:27:57.269 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:27:57.277 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:27:57.327 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:27:57.333 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:27:57.338 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:27:57.338 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-04-26T21:27:57.338 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +1228us[+1199us] +/- 46ms 2024-04-26T21:27:57.338 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -890us[ -919us] +/- 62ms 2024-04-26T21:27:57.339 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -842us[ -872us] +/- 79ms 2024-04-26T21:27:57.339 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:27:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:27:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-04-26T21:27:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +1186us[+1232us] +/- 46ms 2024-04-26T21:27:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -926us[ -880us] +/- 62ms 2024-04-26T21:27:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -875us[ -829us] +/- 79ms 2024-04-26T21:27:57.344 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:27:57.345 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T21:27:57.357 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T21:27:57.357 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T21:27:57.380 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T21:27:57.614 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T21:27:57.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:27:57.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:27:57.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:27:58.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:27:58.045 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T21:27:58.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T21:27:58.093 INFO:teuthology.task.internal:Duration was 2577.445704 seconds 2024-04-26T21:27:58.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T21:27:58.125 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T21:27:58.125 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:27:58.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T21:27:58.270 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:27:58.289 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:27:58.608 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T21:27:58.608 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-04-26T21:27:58.608 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:27:58.681 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-04-26T21:27:58.681 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T21:27:58.754 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T21:27:58.754 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:27:58.762 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T21:27:58.851 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T21:27:58.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:27:58.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T21:27:59.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T21:27:59.693 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T21:27:59.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:27:59.777 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T21:27:59.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T21:27:59.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:27:59.897 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:27:59.993 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-04-26T21:27:59.994 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-04-26T21:28:00.040 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:28:00.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:28:00.089 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T21:28:00.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:28:00.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T21:28:00.159 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T21:28:00.161 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi055 2024-04-26T21:28:00.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:28:00.278 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675180/remote/smithi064 2024-04-26T21:28:00.279 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T21:28:00.385 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T21:28:00.386 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:28:00.394 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T21:28:00.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T21:28:00.496 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T21:28:00.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T21:28:00.534 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T21:28:00.534 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:28:00.542 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T21:28:00.594 INFO:teuthology.orchestra.run.smithi055.stdout: 393940 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 21:28 /home/ubuntu/cephtest 2024-04-26T21:28:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 21:28 /home/ubuntu/cephtest 2024-04-26T21:28:00.604 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T21:28:00.620 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T21:28:00.685 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2577.445704460144 flavor: default host.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 host.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology success: true 2024-04-26T21:28:00.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T21:28:00.763 INFO:teuthology.run:pass